NIST AI 100-2e2025: the adversarial machine learning taxonomy, explained

Last updated:

Key takeaways

  • Evasion attacks — crafting an input at inference time (an adversarial example) that causes a deployed model to misclassify or mis-score something it would otherwise handle correctly.
  • The clearest expansion in e2025 relative to the 2023 edition is its treatment of Generative AI (GenAI).
  • Two separate parts of this taxonomy map directly onto trends we see in device and firmware security work.
  • Identify which half of the taxonomy actually applies to your product.

NIST AI 100-2e2025, "Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations," is a NIST Trustworthy and Responsible AI report published 24 March 2025 that defines a standard vocabulary for describing attacks on machine learning systems and their defenses. NIST's own abstract states it provides "a taxonomy of concepts and defines terminology in the field of adversarial machine learning (AML)," organized by ML method type, lifecycle stage, and attacker goals, capabilities and knowledge, so that practitioners across industry, academia and government can describe the same attack the same way.

A sourcing note: the full NIST AI 100-2e2025 PDF (nvlpubs.nist.gov) is a large, image- and figure-heavy document that our fetch tooling could not render as extractable text — attempts returned raw compressed PDF structure rather than readable prose. The facts in this guide are instead drawn from NIST's own publication and CSRC abstract/metadata pages (fetched directly, including the exact abstract text, author list, keywords and document history) and cross-checked against independent secondary summaries — the OECD.AI policy tracker, a Burges Salmon legal analysis, and the CADE project's review — that describe the same taxonomy consistently. We did not verify an exact numbered count of attack sub-categories from the primary text and have avoided stating one; readers who need section-level or page-level detail should consult the PDF directly.

What problem is this taxonomy trying to solve?

Before this report, researchers, vendors and regulators describing an attack on a machine learning system often used inconsistent or overlapping terms for the same underlying technique — a problem the earlier NIST AI 100-2e2023 (finalized 4 January 2024, after an 8 March 2023 initial public draft) first set out to fix for predictive AI, and which e2025 extends more fully to generative AI. NIST's stated goal, per its own abstract, is to "inform other standards and future practice guides for assessing and managing the security of AI systems by establishing a common language for the rapidly developing AML landscape." That framing matters for the same reason a shared vocabulary matters in MITRE ATLAS or MITRE ATT&CK: a taxonomy is only useful once enough people use the same terms for the same things, and NIST positions this report as the terminology layer other frameworks and standards can build on rather than reinvent.

How does the taxonomy classify attacks on predictive AI?

The report splits AI systems into two classes before classifying attacks within each: Predictive AI (PredAI), described as still dominating industrial applications, and Generative AI (GenAI), whose adoption in business and consumer products has grown rapidly. For PredAI systems — the kind of model that scores, classifies or predicts rather than generates new content — the taxonomy, per NIST's own keywords and independent summaries of the report, organizes attacks into three major classes:

  • Evasion attacks — crafting an input at inference time (an adversarial example) that causes a deployed model to misclassify or mis-score something it would otherwise handle correctly.
  • Poisoning attacks — corrupting the training data or the training process itself, so the resulting model behaves incorrectly or contains a hidden backdoor.
  • Privacy attacks — extracting information about the training data or the model's internals that was never meant to be exposed, through techniques such as membership inference or model extraction.

Each class is further broken down by the attacker's goal (which property — availability, integrity or privacy — is being violated), the attacker's capability and access level, and the attacker's knowledge of the target, ranging from black-box query access to full white-box visibility into model internals.

What did NIST add for generative AI and AI agents?

The clearest expansion in e2025 relative to the 2023 edition is its treatment of Generative AI (GenAI). Per NIST's own publication abstract and keywords (which explicitly list "large language model" and "chatbot" among the report's subject terms) and consistent with independent secondary analyses of the document, GenAI coverage extends to:

  • Supply-chain attacks against generative models and the data or components used to build them.
  • Direct and indirect prompt injection — direct injection being an attacker's own crafted prompt, indirect injection being malicious instructions embedded in content a model later ingests, such as a web page, document, or other data source the model is asked to process.
  • Misuse and abuse violations, including jailbreaks that bypass a model's intended behavioral constraints.
  • AI-agent security, covering the newer risk surface created when a generative model is given tools, autonomy or the ability to take actions rather than only produce text — an area secondary sources describe as not meaningfully covered in the 2023 edition.

This is the same attack surface covered from a case-study and tactic/technique angle in MITRE ATLAS's LLM Prompt Injection technique, and from an application-security-controls angle in the OWASP Top 10 for LLM Applications — NIST AI 100-2e2025 supplies the underlying taxonomy and terminology that both of those frameworks assume a reader already understands.

Why does this matter for devices that embed AI on-device?

Two separate parts of this taxonomy map directly onto trends we see in device and firmware security work. First, products that run an on-device predictive model — an anomaly-detection model in an industrial sensor, an object-detection model in a camera, a predictive-maintenance classifier in a gateway — sit squarely inside the PredAI half of this taxonomy: an attacker with physical or network access to the device may be able to attempt evasion (crafting a sensor input that the model misclassifies) or, if the device supports on-device learning or periodic retraining, poisoning. These are exactly the risks the AI-BOM for embedded AI devices guide argues a device maker needs to inventory in the first place — you cannot threat-model an on-device model's evasion or poisoning risk if you have not first recorded that the model exists, what it does, and how it is updated.

Second, a growing number of devices now embed a generative AI assistant directly — a local or edge-deployed chatbot, voice assistant, or agent that can read device logs, sensor data or user input and take action. That puts the device squarely inside this taxonomy's GenAI coverage, and specifically its direct and indirect prompt-injection categories: a malicious instruction hidden in a voice command, a scanned document, or data pulled from a connected sensor or cloud feed is exactly the indirect-injection scenario the taxonomy describes. Teams building either kind of embedded AI feature can use this taxonomy's categories — evasion, poisoning and privacy for the on-device model; prompt injection, misuse and agent security for the embedded assistant — as a structured starting checklist for threat-modeling, in the same way the NIST AI Risk Management Framework's Map function asks teams to identify which AI-specific risks actually apply before trying to measure or manage them.

A workable starting point

  1. Identify which half of the taxonomy actually applies to your productA device with an on-device classifier or detector needs PredAI's evasion/poisoning/privacy categories; a device with an embedded chatbot or agent needs GenAI's prompt-injection, misuse and supply-chain categories — many products will need both.
  2. Treat direct and indirect prompt injection as separate risks, the same way MITRE ATLAS splits its own prompt-injection technique into sub-techniques — indirect injection via a sensor feed, scanned document or network response is a data-provenance problem, not just an input-validation one.
  3. Record the on-device model and any embedded assistant in your AI-BOMbefore trying to threat-model them — see AI-BOM for embedded AI devices for what to capture.
  4. Use the taxonomy's attacker-knowledge dimension when scoping a testWhether an attacker has only black-box query access to your device's model or full white-box access (for example, after extracting firmware) changes which attacks in the taxonomy are realistic to test for.
  5. Pin the exact edition when citing this report internallyNIST issued a corrected PDF on 1 April 2025 and an errata/potential-updates document dated 3 June 2025 against the 24 March 2025 final — cite the specific date or DOI rather than just "NIST's adversarial ML taxonomy."

SoftWSP's device and firmware security assessments are a natural place to apply this taxonomy in practice: see Device & Firmware Security for threat-modeling that can cover both an on-device predictive model's evasion and poisoning exposure and an embedded AI assistant's prompt-injection and agent-security risk, alongside conventional firmware vulnerability classes.

This guide summarizes NIST's own publication and CSRC metadata pages for NIST AI 100-2e2025 and the prior NIST AI 100-2e2023, cross-checked against independent secondary analyses (OECD.AI, Burges Salmon, the CADE project) because the primary PDF could not be fully extracted by our fetch tooling. It is not a substitute for the current nvlpubs.nist.gov PDF or CSRC publication record, and does not constitute security or compliance advice.

Sources

  1. NIST: Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations (publication page, NIST AI 100-2e2025)
  2. NIST CSRC: AI 100-2 E2025, Adversarial Machine Learning (final publication page — abstract, authors, keywords, document history, errata)
  3. NIST CSRC: AI 100-2 E2023, Adversarial Machine Learning (final publication page — prior edition, document history including IR 8269 and 2023 draft)
  4. NIST AI 100-2e2025 full text (PDF, nvlpubs.nist.gov)
  5. NIST AI 100-2e2023 full text (PDF, nvlpubs.nist.gov — prior edition)
  6. NIST AI 100-2e2025 Errata (Potential Updates), last updated 3 June 2025 (PDF)
  7. OECD.AI Policy Observatory: Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations (NIST AI 100-2e2025)
  8. Burges Salmon: Adversarial machine learning — NIST terminology of attacks and mitigations
  9. CADE Project: NIST report unveils the tactics behind machine learning exploits

Frequently asked questions

What is NIST AI 100-2e2025?

NIST AI 100-2e2025, "Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations," is a NIST Trustworthy and Responsible AI report published 24 March 2025 (DOI 10.6028/NIST.AI.100-2e2025). Per its own abstract, it "provides a taxonomy of concepts and defines terminology in the field of adversarial machine learning (AML)," organized "in a conceptual hierarchy that includes key types of ML methods, life cycle stages of attack, and attacker goals, objectives, capabilities, and knowledge," alongside mitigation methods and a glossary. NIST states the purpose is to "establish a common language for the rapidly developing AML landscape" so that researchers, vendors and auditors can describe the same attacks and defenses consistently. It is a reference taxonomy, not a compliance standard or regulation — it sets no mandatory controls.

How is NIST AI 100-2e2025 different from the earlier NIST AI 100-2e2023?

NIST AI 100-2e2023 was finalized on 4 January 2024 (after an initial public draft released 8 March 2023), authored by Apostol Vassilev, Alina Oprea, Alie Fordyce and Hyrum Anderson, and already covered evasion, poisoning, privacy and abuse attacks across predictive and generative AI at a foundational level. The e2025 edition, published 24 March 2025, added two new co-authors — Xander Davies of the UK AI Security Institute and Maia Hamin of the US AI Safety Institute — reflecting international input into the update. Secondary analyses that reviewed both editions describe the 2025 update as substantially deepening generative-AI coverage: expanded treatment of large-language-model and chatbot-specific attacks, retrieval-augmented-generation (RAG) systems, and AI-agent security, an area not treated in the 2023 edition. We did not independently verify a section-by-section diff between the two editions from the primary PDFs, since the full e2025 PDF could not be rendered as extractable text by our fetch tooling (see the sourcing note below); readers who need exact wording changes should compare the two PDFs directly.

What attack categories does the taxonomy define for predictive AI versus generative AI?

Per NIST's own publication abstract and keywords, cross-checked against independent summaries (including a UK law firm's analysis and the CADE project's review), the taxonomy first splits AI systems into two classes: Predictive AI (PredAI), described as still dominating industrial applications, and Generative AI (GenAI), whose adoption has grown rapidly. For PredAI, the taxonomy addresses evasion attacks (fooling a deployed model at inference time), poisoning attacks (corrupting training data or the training process), and privacy attacks (extracting information about training data or the model itself). For GenAI, coverage extends to supply-chain attacks, direct and indirect prompt injection, misuse/abuse violations (such as jailbreaks), and the security of AI agents built on generative models. NIST's own keyword list for the document includes "attack taxonomy," "abuse," "data poisoning," "evasion," "attack mitigation," "large language model," "chatbot," and "privacy breach." We were not able to verify an exact, numbered count of sub-categories from the primary PDF text, so this guide does not state one.

What dimensions does NIST use to classify an individual attack?

Independent summaries of the report (consistent across the sources we checked) describe attacks as classified along several dimensions together, not just by attack name: the type of AI system targeted (predictive or generative), the stage of the machine learning lifecycle at which the attack occurs (from design and training through deployment and inference), the attacker's goal or the system property being violated (availability, integrity or privacy, plus misuse for GenAI), the attacker's capabilities and access level, and the attacker's knowledge of the target system (ranging from black-box query access to full white-box knowledge of model internals). NIST's own abstract describes this as "a conceptual hierarchy that includes key types of ML methods, life cycle stages of attack, and attacker goals, objectives, capabilities, and knowledge." This multi-dimensional structure is why the same named attack — prompt injection, for example — can appear differently depending on whether it is direct or indirect, and at what point in a system's lifecycle it is introduced.

Who wrote NIST AI 100-2e2025, and is it mandatory for any device or product category?

The final 24 March 2025 edition lists six authors: Apostol Vassilev (NIST), Alina Oprea (Northeastern University), Alie Fordyce and Hyrum Anderson (Cisco), Xander Davies (UK AI Security Institute), and Maia Hamin (US AI Safety Institute) — spanning NIST's own Computer Security Division, academia, industry, and two national AI safety/security institutes. NIST issued a corrected PDF on 1 April 2025 (updating author affiliations for corporate changes and improving figure alt text) and published an errata/potential-updates document dated 3 June 2025 noting at least one identified error pending correction in a future revision. Like the companion AI RMF (NIST AI 100-1), this taxonomy is not a regulation and imposes no mandatory requirements on device makers, cloud providers or any other organization — it is a vocabulary and classification system that other standards, procurement requirements or internal security programs can choose to reference.

In this cluster