AI security at model and application layers: what changes now?

TL;DR: AI security now splits into two battlefronts: model-layer corruption through memory poisoning, backdoored checkpoints and unsafe data merges, and application-layer abuse through tool calling, memory, retrieval and multi-agent workflows, according to VotalAI. Static filters are not enough when systems reason dynamically and fail at runtime.

Editorial analysis by NHI Mgmt Group, based on content published by VotalAI: “Our CTO's View on the Future of AI Security”.

Key questions

Q: What breaks when AI security is treated only as model security?

A: Model-only security misses the part of the system that actually touches tools, data, and workflows in production.

Q: Why do agentic AI systems increase risk for API security and governance?

A: Agentic AI increases risk because it can interpret context, make decisions, and execute multi-step actions without waiting for direct human approval.

Q: What signals show that AI runtime controls are failing?

A: Warning signs include unexplained tool usage, access to data outside the expected workflow, repeated policy overrides, and behavioural drift across sessions.

Practitioner guidance

• Define separate controls for model and runtime risk Document which controls apply to training-time integrity and which apply to deployed application behaviour.
• Inventory every tool and retrieval path an agent can reach List the exact tools, connectors, memory stores and retrieval sources available to each agentic workflow, then classify each one by data sensitivity and permitted action scope.
• Restrict delegated access to the minimum runtime scope Limit each agent to the smallest set of actions, data sources and session permissions required for the task, and remove broad standing access from production flows.

Bottom line: AI security failures increasingly arise after deployment, when tools, memory and retrieval turn a competent model into an exposed system.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →