What Is Tool Misuse?
When users manipulate an AI agent to use tools (APIs) in unintended ways.
Risks:
• Unauthorised data access
• Execution of unintended actions
High Risk When:
Tools have broad access Instructions lack restrictions No authorization checks exist
Prevention:
• Use strict and explicit instructions
• Limit tool capabilities (narrow scope)