Join our Newsletter — 33% off our NHI Course

Did hidden images make Gemini CLI, Google Assistant risky?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20230
Topic starter  

TL;DR: Hidden text inside images can survive preprocessing and steer AI systems into unintended tool calls, according to ZioSec. Tool-using systems need tighter authorisation around sensitive actions, because preprocessing can turn a prompt into execution.

Editorial analysis by NHI Mgmt Group, based on content published by ZioSec: “Anamorpher: How LLMs Are Compromised With An Image”.

Key questions

Q: Why do multimodal prompt injection attacks create operational risk beyond the model itself?

A: Because the damage comes from downstream actions, not just the prompt.

Q: What are the signs that an AI agent may be vulnerable to prompt injection?

A: Look for mismatches between the prompt a system received and the actions it attempted, especially unexpected data retrieval, unusual API calls, or tool use that does not match the user's request.

Q: What breaks when AI systems accept images as prompts and can also use tools?

A: The boundary between user input and machine action breaks down.

Practitioner guidance

  • Harden the image-to-prompt boundary Resize and normalise uploaded media in a controlled pipeline, then inspect the downscaled output before it reaches the model or tool broker.
  • Gate sensitive tool calls Require explicit confirmation before the system sends emails, writes calendar events, or makes external API calls from multimodal sessions.
  • Restrict model tool scope Limit each session to the minimum tool set needed for the task and separate read-only interactions from write-capable workflows.

Bottom line: Hidden text in images can become executable AI instructions after preprocessing, which means the trust boundary is no longer text-only.

Glossary terms: Multimodal Prompt Injection, Tool Misuse, Plugin Provenance, Delegated Execution

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 1 week ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20712
 

Multimodal prompt injection is really delegated action abuse. The article shows that the attacker is no longer trying to win a text-only parsing contest. They are trying to influence an identity that already has tool reach, which turns the model into an execution layer with delegated authority. That means the governance question is not whether the prompt looked malicious, but whether the model had permission to act on what it inferred.

A few things that frame the scale:

  • AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.

A question worth separating out:

Q: How should security teams reduce the blast radius of multimodal AI workflows?

A: Separate read-only and write-capable tools, require confirmation for sensitive actions, and treat image preprocessing as part of the attack surface. The goal is to make hidden instructions less likely to become executed actions.

👉 Read our full editorial: Multimodal prompt injection turns images into AI tool abuse



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.