Join our Newsletter — 33% off our NHI Course
Home› Guides› AI Security Engineer Career Guide: Skills, Roles and…
Guide Security Careers

AI Security Engineer Career Guide: Skills, Roles and How to Get Started

PDF for newsletter subscribers · free to read online

← All guides
By Lalit Choda, NHI Mgmt Group Updated 24 October 2026 13 min read
On this page

Organisations are shipping LLM applications, retrieval pipelines and AI agents faster than they can find people who know how to secure them. The AI security engineer is the role that fills that gap: part application security engineer, part cloud and identity engineer, with enough machine learning knowledge to reason about how models fail. The job title is new and the boundaries are still moving, so there is no single accepted definition or official workforce code for it yet. This guide sets out what the role does in practice, the skills and frameworks it draws on, realistic routes in, the certifications that help, and how the career develops. It is written for security engineers, developers and ML engineers considering the move, and for managers defining the role.

Key takeaways

  • It is a security engineering role first. Most of the work is application, API, cloud and identity security applied to systems that happen to contain models, plus a smaller set of AI-specific threats.
  • No official work role exists yet. The NICE Framework components (v2.2.0) have no AI security work role, so employers borrow from software security assessment, security architecture and data science roles.
  • Know the AI threat catalogues cold. OWASP Top 10 for LLM Applications 2025, MITRE ATLAS and NIST AI 100-2 E2025 are the shared vocabulary for prompt injection, poisoning, extraction and excessive agency.
  • Agents turn model bugs into identity incidents. When an agent holds API keys, OAuth tokens and tool access, a successful prompt injection becomes an access control failure, so non-human identity skills are central.
  • Evidence beats credentials. AI-specific certifications are young; red-team write-ups, threat models of real LLM features and contributions to open projects carry more weight with hiring panels.

What the role does

An AI security engineer protects systems that build, host or call machine learning models, with most current demand centred on generative AI: chat assistants, retrieval-augmented generation (RAG), coding assistants and autonomous agents that call tools. NIST describes the attack surface in NIST AI 100-2 E2025, Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations (March 2025), which covers poisoning, evasion, privacy attacks and abuse across predictive and generative systems. Because the NICE Framework has no dedicated AI security work role, job descriptions usually combine tasks from Software Security Assessment (DD-WRL-005), such as performing code reviews (T1073) and developing threat models (T1106), with architecture and cloud work.

VariantTypical employerMain focus
AI application security engineerEnterprises building LLM featuresDesign reviews, threat models, guardrails, secure integration of model APIs and RAG data
AI red team engineerModel providers, large enterprises, consultanciesAdversarial testing of models and agents, jailbreak and prompt injection testing, reporting
AI platform or MLOps security engineerOrganisations training or hosting modelsModel supply chain, training data integrity, GPU cluster and pipeline security, model registry access
AI governance engineerRegulated sectorsTurning AI policy, risk assessments and regulatory duties into technical controls and evidence

Typical weekly work includes:

  • Design and threat model reviews: examining new AI features for prompt injection paths, data leakage through retrieval, over-broad tool permissions and unsafe output handling. See the AI Agent Threat Modelling Guide.
  • Adversarial testing: building test suites and running red-team exercises against models and agents before and after release. See the AI Red Teaming Guide.
  • Guardrail and gateway engineering: input and output filtering, rate limits, content policies and logging, often centralised in an AI gateway. See the AI Gateway and LLM Gateway Guide.
  • Credential and access design for AI workloads: scoping model API keys, agent tokens and connector permissions, and preventing stolen keys being resold for model access. The LLMjacking cases from 2024 to 2026 show what happens when cloud credentials and API keys leak.
  • Model and dependency supply chain: vetting model files, packages and datasets, and controlling who can publish to model registries.
  • Monitoring and incident response: defining what to log for prompts, tool calls and retrievals, and handling AI-specific incidents. See the LLM Observability Guide.

Core skills and tools

AI threat knowledge

ThreatOWASP LLM Top 10 2025MITRE ATLASWhat the engineer must be able to do
Prompt injection, direct and indirectLLM01 Prompt InjectionAML.T0051 LLM Prompt InjectionTrace untrusted content into the context window and limit what injected instructions can trigger
Sensitive data leakageLLM02 Sensitive Information Disclosure; LLM07 System Prompt LeakageAML.T0024 Exfiltration via AI Inference APIEnforce access control on retrieved data, keep secrets out of prompts
Model and data supply chainLLM03 Supply Chain; LLM04 Data and Model PoisoningAML.T0010 AI Supply Chain Compromise; AML.T0020 Poison Training DataVerify provenance of models, datasets and packages; control training pipelines
Unsafe output useLLM05 Improper Output HandlingAML.T0043 Craft Adversarial DataTreat model output as untrusted input to downstream systems
Over-privileged agentsLLM06 Excessive AgencyAML.T0051 (as the usual trigger)Design least-privilege tools, human approval for high-impact actions, scoped credentials
RAG weaknessesLLM08 Vector and Embedding Weaknesses(no single technique)Segregate vector stores by tenant and permission, validate ingested documents
Cost and availability abuseLLM10 Unbounded Consumption(no single technique)Quotas, rate limits and spend alerts per identity

The EchoLeak case against Microsoft 365 Copilot (2025) is a useful study of indirect prompt injection combined with data access, and the LiteLLM PyPI package breach (2026) shows how AI tooling inherits ordinary package supply chain risk. See the OWASP Top 10 for LLM Applications Guide, the MITRE ATLAS Guide and the Prompt Injection Guide.

Foundation skills

  • Application and API security: authentication, authorisation, input handling and secure SDLC practice. NIST SP 800-218 (SSDF v1.1) is the baseline, with SP 800-218A published as a companion part.
  • Cloud and identity: IAM policy design, workload identity federation, secrets management and logging on at least one major cloud, since most models are consumed as cloud services.
  • Machine learning literacy: enough to understand training, fine-tuning, embeddings, inference and evaluation. Python is the working language of the field.
  • Testing and automation: writing evaluation harnesses and regression tests for model behaviour, and wiring them into CI/CD.
  • Risk and governance: reading the NIST AI RMF 1.0 (January 2023) and its four functions, Govern, Map, Measure and Manage, plus the Generative AI Profile, NIST AI 600-1 (July 2024). See the NIST AI RMF Guide and the ISO/IEC 42001 Guide.
  • Communication: explaining probabilistic risks to product teams who expect a binary pass or fail.

Tool categories

  • Adversarial testing harnesses: open-source and commercial tools that generate jailbreak and injection attempts and score responses.
  • Guardrails and AI gateways: policy layers that filter prompts and outputs, enforce quotas and log every call.
  • Model and dependency scanners: tools that inspect model files for unsafe serialisation and check package provenance.
  • AI security posture management: inventory of models, endpoints, agents and their permissions. See the AI Security Posture Management (AI-SPM) Guide.

Routes into the role

Starting pointStrength it bringsGap to close
Application security engineerThreat modelling, code review, SDLC integrationML concepts, model behaviour testing, agent design
Penetration tester or red teamerAdversarial mindset, reportingEvaluation methods, statistics of non-deterministic results, defensive engineering
Cloud or IAM engineerCredential, workload identity and logging designAI threat catalogues, model supply chain
ML or data engineerDeep understanding of training and inferenceSecurity fundamentals, threat modelling, incident handling
Software developer building LLM featuresHands-on knowledge of RAG and agent frameworksSecurity testing, risk language, governance
  1. Pick your anchor: decide whether you come from the security side or the ML side, and plan the opposite half deliberately.
  2. Learn the catalogues: read the OWASP Top 10 for LLM Applications 2025, browse MITRE ATLAS techniques and case studies, and work through NIST AI 100-2 E2025. The OWASP AI Exchange adds more than 300 pages of free guidance on threats, controls and testing.
  3. Build and break something: create a small RAG application and an agent with two or three tools, then attack them yourself. Document the threat model, the attacks that worked and the fixes.
  4. Volunteer internally: ask to review the next AI feature in your organisation, or join its AI governance working group.
  5. Publish evidence: write-ups of test findings (sanitised), talks, or contributions to OWASP AI projects carry weight because the field is short of verifiable experience.
  6. Apply for hybrid roles first: application security or cloud security posts with an AI focus are more common than pure AI security titles.

In a small organisation the AI security engineer is often the application security lead who also covers AI features, so breadth matters most. Large enterprises and model providers split the work across red teams, platform security and governance functions. See the Cybersecurity Careers Guide and the Security Architect Career Guide.

Certifications that help

Checked on the certifying bodies' sites on 24 October 2026. AI credentials are new and change quickly, so confirm details with the awarding body before planning around them.

CertificationBodyWhat it showsNotes from the official page
AAISM (Advanced in AI Security Management)ISACAAI security management for experienced security managersRequires an active CISM or CISSP; covers AI Governance and Program Management, AI Technologies and Controls, and AI Risk Management
GMLE (GIAC Machine Learning Engineer)GIACApplied machine learning skills for security work82 questions, 3 hours, 65% pass mark; Python, supervised and unsupervised learning, deep learning
AIGP (Artificial Intelligence Governance Professional)IAPPAI governance, law and responsible AISuits governance-leaning roles more than hands-on engineering
CSSLPISC2Secure software lifecycle knowledgeFour years' work experience required; ANAB accredited under ISO/IEC 17024
CISSP or CISMISC2; ISACABroad security managementPrerequisite for AAISM; useful for senior and lead roles
ISO/IEC 42001 Lead Implementer or Lead AuditorVarious accredited training bodiesAI management system implementation and auditRelevant to AI governance engineering

See the ISACA AAISM and AAIA AI Certifications Guide, the CISSP Certification Guide, the CISM Certification Guide, the ISO 42001 Lead Auditor and Lead Implementer Guide and the Cybersecurity Certifications Guide.

Choosing: an engineer early in the move gets more from a portfolio and an applied ML certification such as GMLE than from a management credential. A security manager who already holds CISM or CISSP and owns AI risk is the intended audience for AAISM. Governance-heavy roles in regulated sectors benefit from AIGP or ISO/IEC 42001 training.

Progression

LevelFocusSigns you are ready for the next step
Security engineer with AI scopeReviews and tests individual AI features under guidanceRuns threat models alone, findings accepted by product teams
AI security engineerOwns security of a product line or platform, builds test suites and guardrailsPatterns you wrote are reused by other teams
Senior or lead AI security engineerSets AI security standards, leads red-team programmes, handles AI incidentsInfluences architecture and governance decisions across the organisation
Principal engineer, AI security architect or head of AI securityStrategy, reference architectures, regulatory alignment, team leadershipBoard and regulator-facing work

Pay is not given here because no official statistics source publishes a separate figure for AI security engineers. For context, the US Bureau of Labor Statistics reports a median annual wage of $129,180 in May 2025 for the broader information security analyst occupation, with employment projected to grow 21% from 2025 to 2035. See the AI Security Architecture Reference Guide for the design side of senior roles.

Where identity fits

An AI agent acts through credentials: model provider API keys, OAuth tokens for connected SaaS, cloud workload identities and MCP server connections. If an injected instruction can reach a tool, the blast radius equals that tool's permissions. AI security engineers therefore need to design short-lived, narrowly scoped credentials per agent, separate identities for each tool connection, human approval for high-impact actions, and full logging of every tool call against the identity that made it. See the Zero Trust for AI Agents Guide, the MCP Security Guide and the LLMjacking Guide.

Measuring your effectiveness

  • Review coverage: percentage of AI features and agents that had a threat model and security review before release.
  • Adversarial test coverage: share of production AI applications with an automated injection and jailbreak regression suite in CI/CD.
  • Credential hygiene: number of long-lived model API keys and agent tokens, and the median credential lifetime.
  • Inventory completeness: models, endpoints and agents discovered by posture tooling that were not in the official register.
  • Time to contain: hours from detection of an AI misuse event to revocation of the credentials involved.

Framework mapping

FrameworkReferenceRelevance to the role
NICE FrameworkDD-WRL-005 Software Security Assessment (closest existing role)Code review, threat modelling and security testing tasks
NIST AI RMF 1.0 and AI 600-1Govern, Map, Measure, ManageRisk language for AI systems and generative AI
NIST CSF 2.0GV.RR-02, ID.AM-08, ID.RA-01Defined roles, life cycle management of AI systems, vulnerability identification
NIST SP 800-53 Rev. 5SA-8, SA-11, SR-3Engineering principles, developer testing, supply chain controls
MITRE ATLASAML.T0051, AML.T0020, AML.T0010Adversary techniques against AI systems
OWASPTop 10 for LLM Applications 2025; AI ExchangeThreat and control catalogues used in reviews

Common failure patterns

  • Treating it as prompt filtering only: engineers who rely on input filters miss output handling, retrieval permissions and tool scoping, which is where most real damage occurs.
  • Ignoring conventional security: leaked API keys, exposed model endpoints and vulnerable packages cause more AI incidents than exotic model attacks.
  • One-off red teaming: model updates and prompt changes alter behaviour, so tests that are not automated and repeated go stale quickly.
  • No ownership for agent credentials: agents built in pilots keep broad, long-lived tokens after they move to production.
  • Learning ML without security depth: candidates who know model internals but cannot threat model a web application struggle in interviews and in the job.

Practitioner checklist

  • Read the OWASP Top 10 for LLM Applications 2025 and map each item to a control you could implement.
  • Work through NIST AI 100-2 E2025 and the MITRE ATLAS case studies.
  • Build a small RAG app and agent, threat model it, attack it and document the fixes.
  • Get working depth in one cloud's IAM, workload identity and secrets management.
  • Write an automated prompt injection regression suite and run it in CI.
  • Learn the NIST AI RMF functions and how your organisation records AI risk.
  • Choose one certification that matches your stage: GMLE for applied ML, AAISM once you hold CISM or CISSP.
  • Publish one sanitised write-up or talk on an AI security finding.

Standards and references

Related NHI Mgmt Group resources: Cybersecurity Careers Guide · LLM Security Guide · AI Red Teaming Guide · Agentic AI Security Guide · ISACA AAISM and AAIA AI Certifications Guide

PDF for subscribers

Take this guide with you

Every section, table and checklist in one PDF, with links to the sources and related guides. Subscribe to our weekly NHI & AI Identity Journal and we’ll email you a download link.

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.

NHIMG Editorial Note
Written and reviewed by Lalit Choda, NHI Mgmt Group. Last updated 24 October 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org

PDF Downloads for Newsletter Subscribers

Get the guide

Enter your details and we’ll email you a download link.

The full guide is free to read online. The PDF is a thank you for subscribing.

Fill in all fields marked * and tick the PDF box to continue.