Join our Newsletter — 33% off our NHI Course

Generative AI security: what it means for human risk management

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 16623
Topic starter  

TL;DR: Generative AI is expanding both attack capability and defensive opportunity, with Living Security Human Risk Management Platform arguing that security teams must move from reactive detection to predictive controls across behavior, identity, and threat signals. The broader lesson is that AI security now depends on governing both people and AI agents, not just filtering prompts.

Editorial analysis by NHI Mgmt Group, based on content published by Living Security Human Risk Management Platform: “A Guide to AI Cybersecurity for Generative AI Applications”.

Key questions

Q: What breaks when generative AI security relies only on reactive detection?

A: Reactive detection fails because AI-driven attacks can be generated, personalised, and scaled faster than alerts can be triaged.

Q: Why do human behaviour and identity signals matter in AI security programmes?

A: Because malicious AI use often looks legitimate in the content itself.

Q: What are the signs that a generative AI support workflow is failing in practice?

A: A workflow is likely failing when it optimizes for model performance but does not improve the customer experience, call handling, or business impact.

Practitioner guidance

  • Define AI governance for acceptable use and data handling Set clear rules for what employees may do with generative AI tools, what data they may expose, and which use cases require review before deployment.
  • Correlate behaviour, identity, and threat telemetry Build detection logic that combines employee activity, identity and access signals, and current threat intelligence so risky AI use is visible before an incident escalates.
  • Add synthetic-data guardrails for model training Use synthetic data for testing where appropriate, but require approval, lineage checks, and privacy review before it is used to train or validate AI systems.

Bottom line: Generative AI expands both attack volume and defensive capability, so security programmes need to manage the same technology on both sides of the risk equation.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 5 months ago
Posts: 17054
 

Predictive human risk management is becoming the right control lens for generative AI. The article is correct that reactive detection is too slow when AI can scale phishing, synthetic media, and malware generation. The stronger governance model is to correlate behaviour, identity, and threat data before an incident occurs, because that is where misuse becomes visible. Practitioners should treat prediction as the control objective, not a reporting enhancement.

A few things that frame the scale:

  • According to Gartner, worldwide spending on generative AI is set to reach $644 billion in 2025, a nearly 77% year-over-year increase.

A question worth separating out:

Q: How should organizations approach the governance of AI agents?

A: Organizations should adopt a governance framework that incorporates continuous visibility, adaptive IAM practices, and stringent policy-based controls. This ensures that all agent actions are tracked, authorized appropriately, and assessed for compliance.

👉 Read our full editorial: AI cybersecurity for generative AI demands predictive human risk



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.