
Adversarial TrainingTraining with deliberately challenging inputs to make AI models more robust and accurate.


7 terms

Adversarial TrainingTraining with deliberately challenging inputs to make AI models more robust and accurate.

AlignmentThe process of making AI behavior and outputs conform to human intentions and ethical standards.

Answer VerificationThe process of checking each important claim in an answer against permitted sources and flagging anything unsupported.

AttentionA mechanism that allows AI models to weigh the importance of different pieces of information.

Attention MechanismA technique that helps AI models focus on relevant parts of their input data.

Authoritative EvidenceA relevant, trusted, permitted, and current source you can rely on when checking a claim.

AutoregressionA statistical approach that predicts future behavior from past outcomes in time-series data.
4 terms

BackpropagationA method for training artificial neural networks by adjusting weights in response to error rates.

Backward ChainingA reasoning method that starts with a goal and works backward to identify a path to the solution.

Bandit OptimizationA strategy that balances exploring new choices with exploiting options known to produce rewards.

Beam SearchA search algorithm that efficiently identifies the most likely sequences of outcomes in a model.
3 terms

Chain-of-ThoughtA prompting strategy that encourages AI to break complex problems into more manageable steps.

CompletionThe output an AI produces in response to an input or prompt, completing a sentence or thought.

Coreference ResolutionAn NLP task that determines which words or phrases refer to the same entity in a text.
5 terms

Data AugmentationA technique that expands training data by adding modified copies or synthetic examples.

Data MiningThe practice of examining large datasets to uncover new information and hidden patterns.

Decoding RulesGuidelines that dictate how a language model translates its internal representations to output.

Dependency ParsingAnalyzing the grammatical structure of a sentence to understand relationships between words.

Distributed TrainingA method where AI model training is spread across multiple computers or servers.
4 terms

Entity AnnotationThe process of labeling text with information about entities, enhancing data structure.

Entity ExtractionIdentifying and classifying named entities in text into predefined categories.

Evaluation MetricsQuantitative measures used to assess the performance and effectiveness of AI models.

Extractive SummarizationCreating summaries by extracting key sentences or fragments directly from the source text.
5 terms

Feature ExtractionIdentifying and isolating useful information from data to improve model training and performance.

Few-Shot LearningThe ability of a model to learn and generalize from a very small number of examples.

Fine TuningThe process of adjusting a pre-trained model to perform well on a specific task or dataset.

Fine-Grained ControlThe capability to precisely adjust the output or behavior of an AI model based on specific criteria.

Forward ChainingA logical reasoning method that starts with known facts and applies rules to reach new conclusions.
2 terms

GenerationThe process of producing new content, such as text or images, based on learned patterns and data.

Greedy AlgorithmsOptimization algorithms that make the locally optimal choice at each step to find a global optimum.
2 terms

HallucinationWhen AI generates information that is not grounded in reality, often because of limitations in its training data.

HeuristicsProblem-solving approaches that rely on practical methods or shortcuts to reach a solution.
2 terms

InferenceThe phase in which a trained model makes predictions or decisions from new, unseen data.

Information ExtractionThe process of automatically extracting structured information from unstructured data such as text.
1 term

Joint ProbabilityThe probability that two events happen at the same time in a probabilistic model.
1 term

Knowledge RepresentationThe way AI systems model, store, and retrieve knowledge to solve complex tasks.
2 terms

Linguistic AnnotationThe process of adding metadata about linguistic features to text so it can be analyzed.

Low Rank Adaption (LoRA)A technique for fine-tuning large models in a memory-efficient and computationally efficient way.
3 terms

Markov Decision ProcessA mathematical framework for modeling decision-making in situations with random outcomes.

Masked Language ModelingA training technique in which some words in the input are hidden and the model predicts them.

Multitask LearningTraining one AI model on multiple tasks at the same time by leveraging what those tasks share.
1 term

Named Entity Recognition (NER)The process of identifying and classifying key entities in text into predefined categories.
5 terms

Offline Reinforcement Learning (RL)A reinforcement learning approach that learns optimal actions from a fixed dataset without further interaction with the environment.

One-Shot / Few-ShotLearning techniques in which a model uses one example or a small number of examples, respectively.

One-Shot LearningA model's ability to learn new information or a new task from a single example or a few examples.

Online LearningA training approach in which a model updates continuously as new data arrives.

Overuse PenaltyA technique that discourages repetitive or overly similar responses from generative AI models.
6 terms

Part-of-Speech Tagging (POS)The process of labeling each word in a text with its corresponding part of speech.

Pre-training in AIThe initial phase in which a model learns from a large, general dataset before task-specific training.

PromptText given to an AI model to elicit a specific type of response or output.

Prompt EngineeringThe practice of crafting prompts that communicate effectively with AI models and elicit desired responses.

Prompt InjectionA technique that uses specially crafted inputs to influence or manipulate an AI system's behavior.

Proximal Policy Optimization (PPO)A reinforcement learning algorithm that balances exploration with exploitation during policy learning.
1 term

QueryA request for information or an action sent to a database, search engine, or AI model.
4 terms

RegularizationTechniques that help prevent overfitting by penalizing model complexity during training.

Reinforcement Learning from Human Feedback (RLHF)A training approach that refines models using feedback from human evaluators.

Response QualityA measure of how well an AI system's responses meet standards for relevance, coherence, and accuracy.

Retrieval Augmented Generation (RAG)An approach that combines relevant retrieved information with generative models to produce informed responses.
8 terms

Scaling LawsObserved patterns showing that AI model performance improves predictably as model size increases.

Self-AttentionA mechanism that lets a model weigh the importance of different parts of its input relative to one another.

Semantic AnnotationThe process of adding semantic metadata to content so AI systems can understand and process it more easily.

Semantic SimilarityA measure of how closely two pieces of text are related in meaning, often used in NLP tasks.

Sequence GenerationThe process of producing an ordered series of items, such as words in generated text, from patterns an AI model has learned.

StalenessWhen information that was once correct no longer applies because a date, product, or policy has changed.

Supervised Fine-TuningThe process of improving a model on specific tasks through further training with labeled data.

System PromptInternal instructions that guide an AI model's behavior and influence how it processes and responds to input.
4 terms

Text ClassificationThe task of assigning text to predefined categories, as in spam detection and sentiment analysis.

Topic ModelingA statistical method for discovering abstract topics in a collection of documents to support content organization and discovery.

TrainingThe process of teaching a machine learning model to make predictions or decisions, typically with a large dataset.

Transfer LearningA machine learning approach that applies knowledge gained from one problem to a different but related problem.
1 term

Upstream SamplingA generative AI technique that produces multiple outputs and selects the best one by a chosen set of criteria.
3 terms

ValidationThe process of evaluating a model on separate data that was not used in training to estimate its accuracy.

VariationDifferent phrasings that express the same intent or meaning, which matters when modeling natural language variation.

Vector RepresentationThe encoding of words or phrases as numerical vectors so AI models can compare them and perform mathematical operations.
1 term

Word EmbeddingAn NLP technique that represents words as vectors in a high-dimensional space to capture semantic similarity.
1 term

Zero-Shot LearningA model's ability to perform tasks it was not explicitly trained to do, demonstrating generalization.