data
parallelism, all-reduce, optimization, algorithms
Data is the raw material every machine learning system is built from — not yet a feature, not yet a label, just the unprocessed record of something that happened: a pixel value…
1,817 technical terms and definitions
parallelism, all-reduce, optimization, algorithms
Data is the raw material every machine learning system is built from — not yet a feature, not yet a label, just the unprocessed record of something that happened: a pixel value…
exploratory data analysis, confirmatory data analysis, John Tukey, quantitative vs qualitative analysis, confirmation bias data
Data analysis is the process of inspecting, cleaning, and modeling data to surface conclusions that support a decision, and it sits one step narrower than data science: where data…
data
Data labeling turns raw examples into the supervised signal a model trains on, and the single hardest thing to internalize about it is that a label is a measurement, not ground…
privacy
Data anonymization is the process of removing or modifying personally identifiable information (PII) from datasets so that individuals cannot be identified from the remaining…
training techniques
Data Anonymization is process that irreversibly removes identifying information so individuals cannot be reasonably reidentified - It is a core method in modern semiconductor AI…
data anonymization techniques, data anonymization, anonymization techniques
Data Anonymization Techniques Introduction & Motivation Data Anonymization Techniques addresses a central problem in ml-ops process control and anonymization-time-per-record…
model training
Data augmentation creates new training examples from existing ones through label-preserving transformations — a flipped cat is still a cat, a back-translated sentence still means…
image augmentation, augmentation techniques
Data Augmentation — artificially expanding the training dataset by applying random transformations, improving generalization without collecting more data. Common Techniques…
training data expansion, mixup, cutmix, randaugment, synthetic data
Data augmentation creates additional training variation by transforming, mixing, simulating, or generating examples while preserving or deliberately modifying target semantics.…
augmentation strategy training, mixup cutmix augmentation, autoaugment randaugment, synthetic data augmentation
Data Augmentation is the training regularization technique that artificially expands the effective size and diversity of a training dataset by applying label-preserving…
augmentation strategy, mixup cutmix, augmentation pipeline, randaugment
Data Augmentation is the training-time technique that artificially expands the effective dataset size by applying random transformations to training examples — creating modified…
augmentation strategy training, cutout mixup cutmix, autoaugment randaugment, augmentation generalization overfitting
Data Augmentation in Deep Learning is the training regularization technique that artificially expands the effective training dataset by applying random transformations to input…
data augmentation generation, data augmentation, augmentation generation
Data Augmentation Generation Introduction & Motivation Data Augmentation Generation addresses a central problem in nlp process control and data-augmentation-text-generation…
randaugment augmentation policy, augmax robust augmentation, data augmentation deep learning, augmentation strategy training
Data Augmentation Strategies (Mixup, CutMix, RandAugment, AugMax) is the practice of applying transformations to training data to artificially increase dataset diversity…
data augmentation, mixup cutmix augmentation, cifar passed, data augmentation mixup cutmix & augmentation strategies, data augmentation mixup, augmentation mixup cutmix, mixup cutmix
Data Augmentation: Mixup, CutMix & Augmentation Strategies Introduction & Motivation Data Augmentation: increase training data variety. Mixup: linear interpolation in input space.…
data augmentation, mixup cutmix consistency, 1m 4d 50k cifar kl nlp, data augmentation mixup cutmix & consistency regularization, data augmentation mixup, augmentation mixup cutmix
Data Augmentation: Mixup, CutMix & Consistency Regularization Introduction & Motivation Data augmentation artificially increases training data via transformations. Mixup…
training techniques
Data Augmentation Privacy is augmentation strategy that improves model robustness while minimizing disclosure of identifiable training information - It is a core method in modern…
data augmentation, augmentation strategies, cifar nlp sst
Data Augmentation Strategies Introduction & Motivation Data Augmentation: expand training data synthetically. Image augmentation, text augmentation. Applications: improve…
data augmentation, strategies advanced techniques, cifar passed, data augmentation strategies & advanced techniques (mixup cutmix), data augmentation strategies, (mixup cutmix)
Data Augmentation: Strategies & Advanced Techniques (Mixup, CutMix) Introduction & Motivation Data augmentation: artificially expand dataset. Geometric: rotation, flipping…
Data Augmentation Strategies Introduction & Motivation Data Augmentation Strategies addresses a central problem in vision processing and augmentation-diversity prediction: how…
data augmentation and regularization, data augmentation regularization, data augmentation, augmentation regularization
Data Augmentation and Regularization Introduction & Motivation Data Augmentation and Regularization addresses a central problem in ml-training process control…
augmentation strategy deep learning, mixup cutmix augmentation, randaugment autoaugment, image augmentation technique
Data Augmentation is the training technique that artificially expands and diversifies the training dataset by applying label-preserving transformations to existing examples…
cutout cutmix mixup augmentation, autoaugment policy, augmentation invariance, test time augmentation
Data Augmentation Techniques is the family of methods that artificially expand training data diversity through geometric transformations, color perturbations, and mixing…
data cache optimization techniques, data cache optimization, cache optimization techniques, data cache, cache optimization, optimization techniques
Data Cache Optimization Techniques Introduction & Motivation Data Cache Optimization Techniques addresses a central problem in performance-optimization process control…
documentation
Data Card is the standardized documentation framework that provides comprehensive metadata about datasets used in machine learning — describing data collection methods…
evaluation
Data Card is a documentation artifact that records dataset provenance, collection methods, labeling process, and ethical considerations - It is a core method in modern AI…
AI data center, PUE, power usage effectiveness, liquid cooling, rack density, Open Compute Project, warehouse-scale computer, InfiniBand
A data center is a facility that houses large numbers of networked computers together with the power, cooling, networking and physical security needed to keep them running…
data center cooling efficiency drift prediction, data center cooling, center cooling efficiency, cooling efficiency drift, efficiency drift prediction, data center
Data Center Cooling Efficiency Drift Prediction with Machine Learning Introduction & Motivation Data Center Cooling Efficiency Drift Prediction with Machine Learning addresses…
data center processor power efficiency prediction, data center processor, center processor power, processor power efficiency, power efficiency prediction, data center
Data Center Processor Power Efficiency Prediction with Machine Learning Introduction & Motivation Data Center Processor Power Efficiency Prediction with Machine Learning addresses…
data center switch fabric latency prediction, data center switch, center switch fabric, switch fabric latency, fabric latency prediction, data center, center switch
Data Center Switch Fabric Latency Prediction with Machine Learning Introduction & Motivation Data Center Switch Fabric Latency Prediction with Machine Learning addresses a central…
data quality, data labeling, data augmentation advanced, data flywheel
Data-Centric AI is the paradigm that prioritizes systematic improvement of training data quality, diversity, and labeling consistency over model architecture changes — recognizing…
data cleansing, deduplication, fuzzy matching, validation rules, missing value handling
Data cleaning is the process of detecting and correcting errors, inconsistencies, and gaps in a dataset before it's used for analysis or modeling — fixing malformed entries…
code ai
Data Clumps are a code smell where the same group of 3 or more data items repeatedly appear together across function parameter lists, class fields, and object initializations…
automation
Data collection automatically gathers process data and metrology results via automation systems, enabling SPC, traceability, and advanced analytics. Data types: (1) Summary…
Column-Wise and Row-Wise Completeness Profiling Introduction & Motivation Column-Wise and Row-Wise Completeness Profiling addresses a central problem in {subject} assurance…
training
Data-constrained regime is the training regime where model performance is primarily limited by insufficient effective data rather than compute or model size - it indicates that…
evaluation
Data contamination occurs when test data appears in training data, artificially inflating benchmark scores. The problem: Model memorizes test examples rather than learning…
evaluation
Data contamination detection is the process of checking whether evaluation benchmark data has been inadvertently included in a model's training set. When test data leaks into…
data quality, quality over quantity, Textbooks Are All You Need, phi-1, Gunasekar 2023, FineWeb, FineWeb-Edu, data filtering, deduplication
Data curation is the work of selecting, cleaning, filtering, deduplicating, balancing, and sometimes rewriting or generating the examples a model is trained on, so that…
data quality
Data deduplication is the process of identifying and removing duplicate or near-duplicate examples from a dataset. It is a critical data quality step for training language models…
data quality
Data deduplication is the process of identifying and removing repeated or near-repeated content from training corpora - it improves data efficiency, reduces memorization risk…
data deduplication storage, data deduplication, deduplication storage
Data Deduplication Storage Introduction & Motivation Data Deduplication Storage addresses a central problem in systems process control and deduplication-overhead-latency…
optimization
Data-Dependent Initialization is a weight initialization approach that uses a batch of real training data to calibrate initial weights — adjusting weight magnitudes and biases…
Prior Distribution Matching for Truncated Datasets Introduction & Motivation Prior Distribution Matching for Truncated Datasets addresses a central problem in {subject} assurance…
mlops
Data drift (also called dataset shift or distribution shift) occurs when the statistical properties of the input data that a deployed model receives in production differ from…
data driven process innovation, data driven, driven process, ct th wip, data-driven process, process innovation
Data-Driven Process Innovation Introduction & Motivation Data-Driven Process Innovation addresses a central problem in process discovery and operational improvement: how to turn…
computer vision
Data efficiency of ViT measures the ability of transformer vision models to reach strong accuracy with limited labeled examples - this efficiency depends heavily on architectural…
data encryption at rest and transit, data encryption rest, encryption rest transit, data encryption, encryption rest, rest transit
Data Encryption at Rest and Transit Introduction & Motivation Data Encryption at Rest and Transit addresses a central problem in ml-security process control…
data engineer, data platform, etl pipeline, elt pipeline, data architecture
Data engineering definition and system boundary. Data engineering designs, builds, and operates the systems that collect, validate, transform, store, govern, and serve data…
Shannon Entropy and Information Density Data Audit Introduction & Motivation Shannon Entropy and Information Density Data Audit addresses a central problem in {subject} assurance…