graceful degradation
reliability
Graceful Degradation is the system design principle ensuring that applications maintain core functionality when components fail, resources become constrained, or dependencies…
29,259 technical terms and definitions
reliability
Graceful Degradation is the system design principle ensuring that applications maintain core functionality when components fail, resources become constrained, or dependencies…
optimization
Graceful Degradation is a resilience strategy that serves reduced functionality when full capability is unavailable - It is a core method in modern semiconductor AI serving…
graceful degradation fallback, graceful degradation, degradation fallback
Graceful Degradation Fallback Introduction & Motivation Graceful Degradation Fallback addresses a central problem in cloud process control and degradation-mode-service-quality…
graph neural networks
Graclus Pooling is a fast graph-clustering based pooling method for multilevel graph coarsening. - It greedily matches nodes to form compact clusters used in graph CNN…
Grad-CAM Class Activation Mapping Introduction & Motivation Grad-CAM Class Activation Mapping addresses a central problem in interpretability and explanation of xai predictions…
grad-cam class activation mapping prediction, grad-cam class activation, class activation mapping, activation mapping prediction, grad-cam class, class activation
Grad-CAM Class Activation Mapping Prediction with Machine Learning Introduction & Motivation Grad-CAM Class Activation Mapping Prediction with Machine Learning addresses a central…
Grad-CAM Class Activation Mapping (Extended Study) Introduction & Motivation Grad-CAM Class Activation Mapping (Extended Study) addresses a central problem in interpretability…
Grad-CAM Class Activation Mapping (Extended Study) Introduction & Motivation Grad-CAM Class Activation Mapping (Extended Study) addresses a central problem in interpretability…
Grad-CAM Class Activation Mapping (Extended Study) Introduction & Motivation Grad-CAM Class Activation Mapping (Extended Study) addresses a central problem in interpretability…
Grad-CAM++ for Multi-Instance Visual Feature Attribution Introduction & Motivation Grad-CAM++ for Multi-Instance Visual Feature Attribution addresses a central problem…
Grad-CAM Gradient-Weighted Class Activation Mapping Introduction & Motivation Grad-CAM Gradient-Weighted Class Activation Mapping addresses a central problem in explainability…
explainable ai
Grad-CAM (Gradient-weighted Class Activation Mapping) is a visual explanation technique that produces a coarse localization map highlighting the important regions in an image…
explainable ai
Grad-CAM++ is an improved version of Grad-CAM that uses higher-order gradients (second and third derivatives) — providing better localization for multiple instances of the same…
interpretability
GradCAM is a class-discriminative localization method using gradients of target outputs over feature maps - It identifies image regions most associated with model class…
backprop, backward pass
Gradients and Backpropagation What is Backpropagation? Backpropagation computes gradients of the loss with respect to each parameter, enabling gradient-based optimization.…
compression, distributed, training, communication
Gradient Compression Distributed Training is a technique reducing communication volume during distributed training by compressing gradient updates before transmission, minimizing…
effective batch
Gradient Accumulation What is Gradient Accumulation? Accumulate gradients over multiple mini-batches before updating weights, simulating a larger batch size without requiring more…
microbatch
Gradient accumulation simulates larger batch sizes by summing gradients over multiple forward/backward passes (micro-batches) before performing a single optimizer step, enabling…
model training
Gradient accumulation simulates larger batch sizes by accumulating gradients over multiple forward-backward passes before updating. How it works: Run forward and backward multiple…
large batch, vit training
Gradient Accumulation is a critical memory optimization technique universally employed in large-scale Vision Transformer and LLM training that mathematically simulates the effect…
effective batch size, gradient accumulation steps, large batch training, memory efficient training, micro-batch training
Gradient accumulation addresses memory-constrained training by splitting what would otherwise be one large batch into several smaller micro-batches, running a separate…
micro-batching, effective batch size, memory efficient training, large batch simulation
Gradient Accumulation and Micro-Batching is a training technique that simulates large effective batch sizes by accumulating gradients across multiple small forward/backward passes…
large batch training, distributed gradient synchronization, effective batch size, memory efficient training
Gradient Accumulation and Large Batch Training — Scaling Optimization Beyond Memory Limits Gradient accumulation enables training with effectively large batch sizes…
gradient accumulation effective batch size and memory efficiency, gradient accumulation effective, accumulation effective batch, effective batch size, batch size memory
Gradient Accumulation Effective Batch Size and Memory Efficiency Introduction & Motivation Gradient Accumulation Effective Batch Size and Memory Efficiency addresses a central…
gradient accumulation hardware and synchronization overhead, gradient accumulation hardware, accumulation hardware synchronization, hardware synchronization overhead
Gradient Accumulation Hardware and Synchronization Overhead Introduction & Motivation Gradient Accumulation Hardware and Synchronization Overhead addresses a central problem…
gradient accumulation large batch, gradient accumulation large, accumulation large batch, gradient accumulation, accumulation large, large batch
Gradient Accumulation Large Batch Introduction & Motivation Gradient Accumulation Large Batch addresses a central problem in systems process control…
optimization
Gradient accumulation steps let a training run simulate a larger effective batch size than would otherwise fit in available memory by running several smaller forward-and-backward…
gradient accumulation and large batch training, gradient accumulation large, accumulation large batch, large batch training, gradient accumulation, accumulation large, large batch
Gradient Accumulation and Large Batch Training Introduction & Motivation Gradient Accumulation and Large Batch Training addresses a central problem in ml-training process control…
micro batch accumulation, memory efficient training, gradient accumulation steps, effective batch size
Gradient Accumulation is the training technique that simulates large batch sizes by accumulating gradients over multiple forward-backward passes (micro-batches) before performing…
Gradient Accumulation for Large Effective Batch Sizes Introduction & Motivation Gradient Accumulation for Large Effective Batch Sizes addresses a central problem in optimization…
Gradient-Based Architecture Search with Gumbel Softmax Introduction & Motivation Gradient-Based Architecture Search with Gumbel Softmax addresses a central problem in automated…
Gradient-Based Architecture Search with Gumbel Softmax (Extended Study) Introduction & Motivation Gradient-Based Architecture Search with Gumbel Softmax (Extended Study) addresses…
Gradient-Based Architecture Search with Gumbel Softmax (Extended Study) Introduction & Motivation Gradient-Based Architecture Search with Gumbel Softmax (Extended Study) addresses…
Implicit Differentiation for Gradient Hyperparameter Tuning Introduction & Motivation Implicit Differentiation for Gradient Hyperparameter Tuning addresses a central problem…
nlp
Gradient-Based Masking is a technique that selects tokens to mask based on their influence on the loss gradient — identifying tokens that are most critical for the model's current…
Gradient-Based Meta-Learning for RL Introduction & Motivation Gradient-Based Meta-Learning for RL addresses a central problem in metalearning learning and rapid task adaptation…
Gradient-Based Meta-Learning for RL (Extended Study) Introduction & Motivation Gradient-Based Meta-Learning for RL (Extended Study) addresses a central problem in metalearning…
Gradient-Based Meta-Learning for RL (Extended Study) Introduction & Motivation Gradient-Based Meta-Learning for RL (Extended Study) addresses a central problem in metalearning…
neural architecture
Gradient-Based NAS is a family of NAS methods that reformulate the architecture search as a continuous optimization problem — making architecture parameters differentiable…
fine-tuning
Gradient-Based Prompt Tuning is the parameter-efficient fine-tuning technique that prepends learnable continuous embedding vectors ("soft prompts") to the model input…
model optimization
Gradient-Based Pruning is a more principled pruning criterion — using gradient information (or second-order derivatives) to estimate the impact of removing a weight on the loss…
model optimization
Gradient-Based Pruning is pruning strategies that rank parameters using gradient-derived importance signals - It leverages optimization sensitivity to remove low-impact…
xgboost, lgbm
Gradient boosting builds an ensemble one tree at a time, and unlike random forest's independent trees, every new tree in a boosted ensemble is trained specifically to predict…
gradient boosting, ensemble learning iterative, ctr f1 gb gpu l1 l2, gradient boosting ensemble learning & iterative refinement, gradient boosting ensemble, boosting ensemble
Gradient Boosting: Ensemble Learning & Iterative Refinement Introduction & Motivation Gradient boosting constructs strong learners by sequentially training weak learners…
data analysis
Gradient Boosting for Defect Detection is the application of gradient boosted tree models (XGBoost, LightGBM, CatBoost) to identify and classify wafer defects — sequentially…
gradient boosting sequential residuals prediction, gradient boosting sequential, boosting sequential residuals, sequential residuals prediction, gradient boosting
Gradient Boosting Sequential Residuals Prediction with Machine Learning Introduction & Motivation Gradient Boosting Sequential Residuals Prediction with Machine Learning addresses…
Gradient Boosting Uncertainty Introduction & Motivation Gradient Boosting Uncertainty addresses a central problem in uncertainty methods and prediction intervals: how to Quantify…
distributed training
Gradient bucketing is the grouping of many small gradient tensors into larger communication chunks before collective operations - it improves network efficiency by reducing…
optimization
Gradient Centralization (GC) is a simple optimization technique that centralizes (zero-means) gradients before each update — subtracting the mean of the gradient vector from each…
activation recomputation, memory optimization training
Gradient checkpointing (also called activation checkpointing) reduces a training run's peak memory usage by storing only a selected subset of intermediate activations during…