A working reference for the words that decide AI budgets. 72 terms, each defined in plain language and paired with what it actually changes about how you buy, build, measure and govern AI. Written for the people in the room when the money is committed — not for the people building the model. Every term has its own link, so you can send someone exactly one definition.
72 terms
01 — Foundations
The words underneath every other word here. If a vendor deck uses these interchangeably, that tells you something.
Artificial IntelligenceAI
Software that performs tasks normally requiring human judgement — recognising, classifying, predicting, generating, deciding. The term covers everything from a 1970s rules engine to a frontier language model, which is why it means almost nothing on its own. What matters commercially is which technique is being used, on which task, to what measurable standard.
Why it matters
"We use AI" is not a capability claim. Ask what the system does when it is wrong, how often that happens, and who finds out — the answers separate a product from a demo.
See also
Context Window
The maximum amount of text a model can consider at once — the prompt, any retrieved documents, the conversation so far and the answer it is producing, all counted together. Exceed it and the earliest content is dropped or the request fails outright.
Why it matters
A large context window is not a substitute for retrieval. Filling one with everything you own is slow, expensive, and measurably worse than supplying the twenty passages that were actually relevant.
See also
Deep Learning
Also called Neural networks
Machine learning using neural networks with many layers, which learn their own intermediate representations of the data instead of relying on features a human engineered. It is the technique behind modern image recognition, speech transcription and language models, and it trades interpretability and data efficiency for raw capability on unstructured inputs.
Why it matters
Deep models are where explainability gets hard. If a decision has to be defensible to a regulator or a credit committee, that constraint belongs in the design conversation, not the launch review.
See also
Foundation Model
Also called Frontier model, Base model
A large, general-purpose model trained once at great expense on broad data, then adapted to many downstream tasks by prompting, fine-tuning or tool use. The economic point is that the expensive part is shared: organizations build on a foundation model instead of training one, the way they build on a cloud platform instead of a data centre.
Why it matters
Building on a foundation model means inheriting someone else's release schedule, pricing and deprecation policy. Design the system so the model is a swappable component, and that dependency stays commercial rather than structural.
See also
Generative AIGenAI
AI that produces new content — text, code, images, audio, video, structured data — rather than only scoring or classifying existing content. Generative systems predict plausible continuations of their input, which is why they are fluent, fast and capable of being confidently wrong in the same breath.
Why it matters
Generation is the easy half. The work that produces returns is everything around it: grounding the output in your data, constraining it to a task, and checking it before it reaches a customer.
See also
Inference
Running a trained model to get an answer, as opposed to training it in the first place. Training is a large one-off cost; inference is the recurring one, paid on every request for as long as the feature is live.
Why it matters
Programmes are budgeted on build cost and then surprised by run cost. Inference is the line that scales with adoption — success makes it bigger, which is exactly when nobody wants to discover it.
See also
Large Language ModelLLM
A model trained on very large volumes of text to predict what comes next, which turns out to be enough to summarise, translate, reason over documents, write code and hold a conversation. An LLM has no database and no memory of your organization: everything it appears to know is either baked into its weights during training or supplied in the prompt at the moment you ask.
Why it matters
That distinction is the whole architecture decision. Knowledge you need to be current, private or auditable does not belong in the weights — it belongs in retrieval, where you can update it and cite it.
See also
Machine LearningML
A family of techniques in which a system learns patterns from data rather than following rules a person wrote. You supply examples and a target; the training process fits a model that maps one to the other, and the model is then used on inputs it has never seen. Forecasting, fraud scoring, churn prediction and recommendation are all classical ML, and most of them long predate generative AI.
Why it matters
A great deal of the highest-ROI work in an enterprise is still classical ML on tabular data. Reaching for a language model because it is the current news is how organizations pay frontier prices for a regression problem.
See also
Multimodal AI
A model that accepts or produces more than one kind of input — text alongside images, audio, video or documents — in a single context rather than by chaining separate specialist systems. A multimodal model can read a scanned contract, a chart and the email about them together and answer one question across all three.
Why it matters
Most enterprise knowledge is trapped in formats that were never text: scans, screenshots, slides, recordings. Multimodality is what makes that backlog addressable without a transcription project in front of it.
See also
Token
The unit a language model actually reads and writes — roughly a word fragment. English averages about four characters per token, so 750 words is near 1,000 tokens. Context limits, latency and price are all denominated in tokens, not words or pages.
Why it matters
Every cost model for a generative feature starts here. Tokens in plus tokens out, times volume, times price, is the unit economics of the feature — and it is knowable before a line of code is written.
See also
02 — Models & Architectures
What a model actually is, how it comes to be, and the levers that change its cost and behaviour.
Distillation
Training a smaller model to reproduce the behaviour of a larger one on a target task, keeping most of the quality at a fraction of the cost and latency. Distillation is how a capability proven on an expensive model becomes economic to run at scale.
Why it matters
A sensible arc for a high-volume feature: prove it on the best model available, instrument it, then distil once you know exactly what good looks like. Doing it in the other order optimises something nobody has validated.
See also
Embedding
Also called Vector representation
A list of numbers representing a piece of content — a sentence, a document, an image — positioned so that things with similar meaning sit close together. Embeddings are what make it possible to search by meaning instead of by keyword, and they are the substrate underneath retrieval, clustering, deduplication and recommendation.
Why it matters
Two documents that share no vocabulary can still be near-identical in meaning. Embeddings are how a system finds the policy that answers a question phrased in words the policy never uses.
See also
Fine-Tuning
Continuing to train an existing model on your own examples so it adopts a format, a house style or a specialised task. Fine-tuning changes behaviour reliably; it is a poor way to teach facts, because the knowledge is frozen at training time and cannot be updated, cited or removed on request.
Why it matters
The common mistake is fine-tuning to fix wrong answers. Wrong answers are usually a retrieval problem, and retrieval is cheaper to build, cheaper to change and possible to audit.
See also
Mixture of ExpertsMoE
An architecture that splits a model into many specialised sub-networks and activates only a few per token, so a very large model can be served at the cost of a much smaller one. It is a primary reason capability has kept climbing while price per token has kept falling.
See also
Open-Weight Model
Also called Open-source model, Self-hosted model
A model whose trained parameters are published for download, so it can be run on infrastructure you control, inspected, and adapted without an API call leaving your network. Open weights are not the same as open source: the training data and code usually remain private, and licences vary from genuinely permissive to sharply restricted.
Why it matters
Read the licence before the benchmark. Field-of-use restrictions and acceptable-use clauses in a permissive-sounding model have ended more deployments than capability gaps have.
See also
Quantization
Storing a model's parameters at lower numerical precision so it needs less memory and runs faster, with a small and measurable loss of quality. It is the standard technique for fitting a capable model onto modest hardware or a device.
See also
Reasoning Model
Also called Thinking model, Test-time compute
A model trained to spend additional computation working through a problem before answering — effectively thinking in a scratchpad the user may never see. Reasoning models are materially stronger on multi-step maths, code and analysis, and materially slower and more expensive per answer.
Why it matters
Not every task deserves deliberation. Routing the hard ten percent of requests to a reasoning model and the rest to a fast one is one of the largest cost levers available, and it is an architecture choice, not a model choice.
See also
Reinforcement Learning from Human FeedbackRLHF
A training stage in which human raters compare model outputs and their preferences are used to steer the model toward helpful, honest and harmless responses. It is the step that turns a raw text predictor into something that follows instructions and declines the requests it should decline.
Why it matters
A model's manners are a training artefact, not a law of nature. Two models with similar benchmark scores can behave very differently on refusal, tone and hedging — which is a product decision, so evaluate it like one.
See also
Small Language ModelSLM
A compact model — typically a few billion parameters — designed to run cheaply, quickly, and often on your own infrastructure or a device. Small models trail frontier models on open-ended reasoning but can match them on narrow, well-specified tasks such as classification, extraction and routing.
Why it matters
Most production volume is narrow, well-specified tasks. Sizing the model to the job rather than to the hardest thing the system ever does is where run-rate cost quietly halves.
See also
Transformer
Also called Attention mechanism
The neural network architecture behind essentially every modern language model, introduced by Google researchers in 2017. Its defining move is attention: instead of reading a sequence strictly in order, the model weighs how much each part of the input should inform each other part. That is what allows a model to connect a pronoun to a name forty sentences earlier.
See also
03 — Building with AI
The craft layer — how instructions, tools and constraints turn a general model into a system that does one job reliably.
AI-Native
A system or process designed around what AI can do, rather than an existing workflow with AI added to one step. AI-native design assumes the model in the architecture from the start — which typically means fewer handoffs and different roles, not the same process running faster.
Why it matters
Bolting a model onto an unchanged process caps the return at whatever that one step was worth. The compounding gains come from redesigning the work, which is an operating decision before it is a technical one.
Prompting a model to work through intermediate steps before committing to an answer, which improves accuracy on problems that need more than recall. The stated reasoning is a useful artefact but not a guaranteed account of how the answer was produced.
Why it matters
Do not treat a model's explanation as an audit trail. If a decision must be defensible, the evidence has to come from the sources and checks around the model, not from its narration of itself.
See also
Few-Shot Prompting
Also called In-context learning
Including a handful of worked examples in the prompt so the model infers the pattern you want instead of being told it in the abstract. Showing three correctly formatted answers is usually more effective than three paragraphs describing the format.
See also
Guardrails
Checks around a model that constrain what goes in and what comes out — input filtering, output validation, schema enforcement, refusal policies, rate and spend limits, and escalation paths. Guardrails are deterministic code wrapped around a probabilistic component.
Why it matters
You cannot make a generative system incapable of being wrong. You can make it incapable of being wrong in ways that reach a customer unchecked, and that is the difference between a pilot and a deployment.
See also
Human in the LoopHITL
Also called Human oversight
A design in which a person reviews, approves or corrects the system's output before it takes effect — usually on the consequential subset rather than everything. Well built, the review queue is also a training signal: every correction is a labelled example of what good looks like.
Why it matters
The right question is not whether to keep a human in the loop but which decisions require one. Answer it explicitly and you get a defensible control; leave it implicit and you get a rubber stamp.
See also
Model Context ProtocolMCP
An open standard, introduced by Anthropic in late 2024 and since adopted across the industry, for connecting AI applications to external tools and data sources through a common interface. It replaces bespoke per-integration glue with one protocol that any compliant client and server can speak.
Why it matters
Integration work is where AI budgets actually go. A shared protocol turns each connector into an asset you keep rather than plumbing you rewrite the next time the model or the vendor changes.
See also
Orchestration
The layer that decides what runs in what order: which model handles a request, which tools it may call, how retries and failures are handled, what gets logged, and when a human is brought in. It is ordinary software engineering, and it is most of the system.
Why it matters
The model is the component teams argue about and the orchestration is the component that determines whether the thing works. Building it well is also what keeps the model swappable.
See also
Prompt Engineering
Designing the instructions, examples and structure given to a model so it produces the right output reliably rather than occasionally. In production it looks less like clever phrasing and more like specification writing: define the task, the format, the edge cases and what to do when the input is unusable.
Why it matters
A prompt is production code. It should be versioned, tested against a fixed set of cases, and changed with the same care as anything else customers depend on — because a one-word edit can move accuracy several points.
See also
System Prompt
The standing instruction that governs a model's behaviour across every request in an application — its role, its boundaries, its tone, its output format. Users supply the question; the system prompt supplies the job description.
Why it matters
This is where most of a product's behaviour actually lives, and where policy gets encoded in practice. It belongs under review and version control, not in a text box someone edits on a Friday.
See also
Tool Use
Also called Function calling
Giving a model the ability to call software — a search index, a database query, a pricing API, a calculator — and use the result in its answer. The model decides which tool fits and with what arguments; your code decides what tools exist and what they are permitted to do.
Why it matters
This is the line between a chatbot and a system that does work. It is also where permissions become real: a tool that can write is a tool that can be wrong in production, so scope it like a service account.
See also
Workflow Recomposition
Restructuring a process once AI is in it — some steps automate, some become human-AI loops, some disappear because they only existed to compensate for a constraint that is gone. Recomposition is distinct from augmentation, where each step stays and gets assisted, and from replacement, where the whole process is handed over.
Why it matters
Which of the three patterns a workflow needs is the single most predictive thing about whether the investment pays back. It is also the question most programmes never explicitly ask.
Software that decides its own next step. The most oversold category in the market, and the most consequential when it works.
Agent Memory
How a system carries information across steps and sessions, since the model itself remembers nothing between calls. Short-term memory is the running context; long-term memory is an external store the agent writes to and retrieves from deliberately.
Why it matters
Memory is a data asset and a liability at once. Whatever an agent remembers about a customer is now personal data you hold, with a retention policy, an access model and a deletion obligation attached.
See also
Agentic AI
The broad category of AI systems that act rather than only answer. In practice the label spans everything from a model calling two tools in sequence to a long-running process that manages a workflow for days, so it says far more about ambition than about architecture.
Why it matters
The useful question is never "is it agentic". It is how many steps it takes unsupervised, what it can change, and what happens on step seven when step three was wrong.
A system that pursues a goal over multiple steps, choosing its own actions along the way — calling tools, reading results, revising its approach — rather than producing one answer to one prompt. The distinguishing feature is not intelligence but discretion: nobody specified the sequence in advance.
Why it matters
Discretion is the thing to scope. An agent that can read is a research assistant; an agent that can write to a system of record is an employee, and it needs the permissions, logging and review that implies.
An architecture in which several specialised agents work on parts of a problem and coordinate — one researches, one drafts, one checks — usually under a coordinating agent. It buys parallelism and separation of concerns at the cost of more failure modes and much harder debugging.
Why it matters
Most problems sold as multi-agent are one agent with better tools. Add agents when the work genuinely parallelises, not because the diagram looks more impressive with boxes in it.
See also
Robotic Process AutomationRPA
Rule-based automation that replays a fixed sequence of user-interface or API actions — the generation of automation that preceded AI agents. RPA is deterministic and auditable, and it breaks the moment a screen, a form or an exception falls outside its script.
Why it matters
The interesting pattern is not replacing RPA but pairing it: the model handles the judgement and the unstructured input, the deterministic path handles the transaction. Keeping the irreversible step deterministic is usually the right instinct.
See also
05 — Data & Retrieval
How a model gets access to what your organization knows — the part that determines whether output is grounded or invented.
Chunking
Splitting documents into passages small enough to retrieve precisely and large enough to still make sense on their own. Chunk on the document's actual structure — sections, clauses, rows — rather than every N characters, or you will routinely retrieve half a sentence and half an answer.
Why it matters
When a retrieval system gives confidently incomplete answers, chunking is the first place to look. It is unglamorous, it is rarely the thing anyone demos, and it moves quality more than swapping models does.
See also
Data Readiness
Whether the data an AI use case depends on actually exists, is accessible, is current, and is trustworthy enough to act on. Readiness is assessed per use case, not per organization: the same company can be fully ready for one workflow and nowhere near it for the one next to it.
Why it matters
This is the most common reason a promising use case stalls, and it is knowable in days rather than quarters. Assessing readiness before committing to a build is the cheapest risk reduction available.
Tying a model's output to verifiable sources — retrieved documents, tool results, database records — so each claim can be traced back to something outside the model. Grounding is the mechanism; citation is the visible part of it.
Why it matters
Ungrounded output cannot be checked at the speed it is produced, which means it cannot safely be used at that speed either. Grounding is what makes review possible without re-doing the work.
See also
Knowledge Graph
A structured representation of entities and the relationships between them — this company owns that subsidiary, which holds this contract, which references that clause. Where retrieval finds passages that look relevant, a graph answers questions about how things connect.
Why it matters
Questions that traverse relationships — exposure across a portfolio, dependency across a supply chain — are exactly where pure retrieval underperforms and where the graph earns its keep.
See also
Retrieval-Augmented GenerationRAG
Also called Retrieval augmentation, Grounded generation
A pattern in which the system searches your own content for passages relevant to a question and puts them in the prompt, so the model answers from supplied evidence rather than from memory. It is the standard way to make a general model useful on private, current or regulated information — and the standard way to get citations.
Why it matters
RAG turns "the AI said so" into "this document says so, here it is". That single property is what makes a generative answer acceptable in a context where somebody has to stand behind it.
See also
Semantic Search
Also called Vector search
Search that matches on meaning rather than exact words, by comparing embeddings of the query and the content. It finds the right document when the user's vocabulary differs from the author's — and it can miss an exact identifier that keyword search would have found instantly.
Why it matters
The production answer is almost always hybrid: keyword for names, codes and identifiers, semantic for questions. Choosing one is how a search feature ends up worse than the one it replaced.
Data generated by a model rather than collected from the world, used to augment scarce training sets, cover rare cases, or stand in for records that cannot leave a controlled environment. It is genuinely useful and it inherits every bias and blind spot of whatever produced it.
Why it matters
Synthetic data is a good way to test a pipeline and a poor way to establish that a system works. Validation has to happen against real cases or it has not happened.
See also
Vector Database
A store built to hold embeddings and find the nearest ones to a query fast. It is the index behind semantic search and retrieval, and it is increasingly a feature of databases you already run rather than a separate product you must buy.
Why it matters
Check what your existing data platform already does before adding a system of record for meaning. A second store is a second thing to secure, sync, back up and explain to an auditor.
See also
06 — Evaluation & Measurement
How you know it works, and how you prove it kept working. The discipline most AI programmes skip, then fail on.
Baseline
The measured performance of the current process before AI — cycle time, error rate, cost per case, throughput. Captured before the build, not reconstructed afterwards from memory or from the best week anyone remembers.
Why it matters
A missing baseline is the most common reason a working deployment cannot prove it worked. Half a day of measurement up front is what makes every later ROI claim defensible rather than rhetorical.
A standardised public test used to compare models — reasoning, coding, retrieval, domain knowledge. Benchmarks are useful for tracking the frontier and weak evidence about your workflow, since a model tuned to score well on a public test has been optimised for that test, not your task.
Why it matters
Nobody buys a model. They buy performance on a workflow. Benchmark leadership is a reason to try something and never a reason to deploy it.
A fixed set of test cases with known-good outcomes, run automatically against the system so you can tell whether a change made it better or worse. Evals are to an AI feature what a test suite is to software, and they are the only way to upgrade a model without guessing.
Why it matters
Without evals, every prompt edit and model upgrade is a coin flip nobody can score. Teams that build them early ship faster within a quarter, because they stop re-litigating whether the last change helped.
See also
Four-Lens ROI
Also called Four-Lens Reconciliation
The AWSM LABS framework for scoring an AI deployment on four instruments that measure different things: operational, financial, experiential and custodial. The discipline is not to average them but to find where they disagree — agreement confirms what you suspected, while a wide spread points at where value is actually sitting or leaking.
Why it matters
Single-lens measurement does not under-report AI value; it produces a confident wrong answer. The spread between the highest and lowest lens tells you more than any individual score.
Output that is fluent, plausible and wrong — an invented citation, a policy clause that does not exist, a number with no source. It is not a bug to be patched out but a property of systems that predict likely continuations, which is why the engineering response is grounding, validation and review rather than a fix.
Why it matters
The danger is not that a model is wrong. It is that wrong output is indistinguishable from right output at a glance — so the control has to be structural, not vigilance.
See also
LLM-as-Judge
Using a language model to score another model's output against a rubric, so evaluation can run at a scale human review cannot reach. It correlates reasonably with human judgement on clear criteria, and inherits the judge's own biases — toward length, confidence and its own house style.
Why it matters
Calibrate the judge against a human-scored sample before trusting it, and re-check periodically. An uncalibrated judge produces a quality metric that is precise, cheap, and unrelated to what your users experience.
See also
Model Drift
Also called Data drift, Performance drift
Degradation in a deployed system's performance over time as the world moves away from the conditions it was built for — new products, new language, new customer behaviour, or a provider updating the model underneath you. Nothing breaks; results quietly get worse.
Why it matters
Drift is why an AI deployment needs monitoring rather than a launch date. The failure mode is silent, and the first person to notice is usually a customer.
See also
Workflow–Tool Fit
Scoring an AI tool against a specific workflow rather than ranking tools in the abstract, on the grounds that the same tool can be excellent on one task and actively harmful on the next. AWSM RSRCH scores the pair across five dimensions: outcome efficacy, adoption velocity, integration fit, total cost of ownership and deployment risk.
Why it matters
Tool selection debates are usually unresolvable because the question is malformed. Name the workflow and the same debate becomes a measurable comparison.
The obligations, frameworks and failure modes a board, a regulator, an LP or an auditor will eventually ask about.
AI Governance
The structures that determine who may deploy AI, on what, under what controls, and who answers for the outcome. In practice it is an inventory of what is running, a risk tier per system, named owners, documented evaluation, and monitoring after launch — not a policy document.
Why it matters
The most common governance finding is not a bad control. It is that nobody can say who owns a system that is already making decisions — which is an unbounded position, not an oversight.
Systematic, unjustified differences in how a system performs across groups of people — arising from the training data, the way the objective was framed, or how the output gets used in practice. Bias is measurable, and measuring it requires deciding in advance which differences would be unacceptable.
Why it matters
A model that is accurate on average can still be unusable on a subgroup that matters legally or commercially. Aggregate accuracy hides exactly the failure that produces a complaint.
See also
Audit Trail
Also called Traceability
A durable record of what the system did — inputs, retrieved evidence, model and prompt version, tools called, output, and any human review — kept so a decision can be reconstructed months later by someone who was not there.
Why it matters
The first serious question after an AI incident is what the system saw and what it did. Logging designed in from the start answers it in an afternoon; logging added afterwards cannot answer it at all.
See also
Data Residency
Where data is physically processed and stored, and which jurisdiction's law therefore applies to it. For AI this covers prompts, retrieved documents, logs and any content retained for training — and the answers differ by provider, by product tier and by region.
Why it matters
Whether your prompts can be used to train someone else's model is a contract term, not a technical property. Read it, and read what changes on the enterprise tier.
See also
EU AI Act
Also called Regulation (EU) 2024/1689
The European Union's regulation on artificial intelligence, which entered into force in August 2024 and applies in stages. It classifies systems by risk — prohibited, high-risk, limited and minimal — and attaches obligations accordingly, with separate rules for general-purpose models. Prohibitions and AI-literacy duties applied from February 2025, general-purpose model obligations from August 2025, and the bulk of the high-risk requirements follow from August 2026.
Why it matters
It reaches providers and deployers outside the EU whose systems affect people in it, and the obligations attach to the use case rather than the technology. The practical first step is knowing which of your systems would be classified high-risk.
See also
Explainability
Also called Interpretability, XAI
The ability to say why a system produced a particular output in terms a person can evaluate and, where required, contest. For modern models this is rarely a look inside the weights; it is the evidence, retrieved sources, inputs and rules surrounding the decision.
Why it matters
If a decision affects someone's credit, care, employment or eligibility, explanation is an obligation rather than a feature. Design the evidence trail in at the start — it cannot be added convincingly afterwards.
See also
ISO/IEC 42001
Also called AI management system
The international management-system standard for artificial intelligence, published in December 2023. It specifies how an organization establishes, operates and continually improves an AI management system, and — unlike a framework — it can be independently certified.
Why it matters
Certification is becoming a procurement shortcut in regulated sectors, in the way ISO 27001 did for information security. Worth knowing whether your buyers are about to start asking.
See also
Model Card
Also called System card
A short standard document describing a model or AI system: what it is for, what it was evaluated on, how it performed, where it should not be used, and what is known about its limitations. The system-level equivalent of a datasheet.
Why it matters
Writing one forces the questions a governance review will ask anyway, at the point when the answers are cheap to act on rather than expensive.
See also
NIST AI Risk Management FrameworkAI RMF
A voluntary framework published by the US National Institute of Standards and Technology in January 2023, organised around four functions — Govern, Map, Measure, Manage — for identifying and managing AI risk across a system's life. A companion profile for generative AI followed in July 2024.
Why it matters
Voluntary, widely referenced, and the most common thing an enterprise customer's security questionnaire is quietly modelled on. Mapping to it early is cheaper than retrofitting it during a deal.
See also
Prompt Injection
Also called Indirect prompt injection
An attack in which instructions hidden in content the model reads — a web page, a document, an email, a calendar invite — are treated as commands. The model cannot reliably tell your instructions from text that merely looks like instructions, which makes this a design constraint rather than a bug to be patched.
Why it matters
Risk scales with what the system can do, not with what it can read. An agent that can send mail, move money or change records needs the untrusted input path and the privileged action path kept apart by construction.
See also
Shadow AI
AI tools used inside an organization without its knowledge or approval — personal accounts, unvetted browser extensions, features switched on inside software already deployed. It is usually a sign that the sanctioned path is slower than the work requires.
Why it matters
You cannot govern an inventory you do not have, and the data already left. The durable fix is a sanctioned path that is genuinely easier to use, backed by visibility into what is actually running.
What AI costs, what it returns, and why the gap between the two is almost never a technology problem.
Adoption Rate
The share of intended users genuinely using a deployed AI system for real work, as against licences issued or accounts activated. Measured properly it is depth and frequency per role, not a headline percentage.
Why it matters
Licences bought is the number most often reported and the least informative. A tool at ten percent real adoption has not half-worked; it has produced a cost with no offsetting return.
See also
AI Maturity
How ready an organization is to get value from AI, across data, workflows, skills, governance and executive ownership. Maturity is uneven by design: most organizations are further along in one function than the enterprise average suggests, and that unevenness is where the sequencing decision lives.
Why it matters
Maturity assessment is worth doing when it produces a ranked, costed sequence of use cases. Done as a scorecard it produces a slide; done properly it produces a plan.
The accumulation of overlapping AI subscriptions, licences and embedded features across an organization, typically bought team by team without a central view. The cost is rarely any single licence; it is duplicated spend, fragmented data and the absence of anyone who can say what is running.
Why it matters
Sprawl is a visibility problem before it is a spend problem. Organizations that instrument adoption find the same capability paid for three times, and two of the three barely used.
The decision between licensing an AI product, building a system you own, or activating capability already present in software you run. The honest framing is three options rather than two, and the deciding question is whether the workflow is a differentiator or a commodity.
Why it matters
Buy the commodity, build the differentiator, and activate what you are already paying for before doing either. Most organizations discover the third option last.
The work of getting people to actually use a new system — redefining roles, retraining, resetting expectations about what good work looks like, and deciding explicitly where the freed-up time goes. For AI it is heavier than for conventional software, because the tool changes judgement rather than just tooling.
Why it matters
Time saved does not become value until somebody with authority says where it goes. Absent that sentence, the hours dissipate and the financial lens reads flat — correctly.
The state in which AI pilots keep succeeding on their own terms and none reaches production. The usual causes are structural rather than technical: no named owner, no baseline to prove value against, unresolved data access, and no route through security and procurement.
Why it matters
The escape is decided before the pilot starts — by naming the production owner, the success threshold and the integration path up front. A pilot without those is a demonstration, and demonstrations do not graduate.
How long from starting work to the point where a business number measurably moves — not first demo, not launch. It is the metric that most cleanly separates AI programmes that compound from ones that consume budget.
Why it matters
Short cycles create evidence, and evidence is what funds the next one. A programme structured around one large delivery has a single point of failure with a twelve-month fuse.
See also
Token Economics
Also called Cost per token, Inference cost
The unit cost model of a generative feature: tokens in plus tokens out, multiplied by price per token, multiplied by volume. Retrieved context, conversation history, reasoning steps and retries all count, which is why real cost per request is routinely several times the naive estimate.
Why it matters
This is calculable before you build. Model the cost of the tenth-thousandth request, not the first — that is the one that decides whether the feature survives success.
See also
Total Cost of OwnershipTCO
Everything an AI system costs over its life — licences and inference, integration, data work, evaluation, monitoring, human review, retraining and the eventual migration off it. Model spend is usually a minority of the total and almost always the only line in the business case.
Why it matters
The costs that get omitted are the recurring ones, which is why year-two economics disappoint so reliably. A build estimate without a run-rate attached is half a number.
Knowing the words is not the same as knowing where to start.
This glossary grows from the questions we get asked in engagements. If a term you keep hearing isn't here, tell us and we'll add it — and if the real question is which of these belongs in your stack, that is a shorter conversation than it looks.