Agent Testing
Test CLI-based AI agents and remote agents via SSH
Overview
Tachyonic can test AI agents that run as CLI programs — not just HTTP APIs. This covers agents like Codex, Claude Code, custom chatbots, and any agent accessible via a command-line interface.
Local CLI Agent
Test an agent that runs as a local command:
tachyonic scan \
--cli-command "my-agent" \
--categories prompt-injection,tool-abuse \
--max-attacks 10Tachyonic sends payloads to the agent's stdin and reads responses from stdout.
With Agent Name
Some CLI tools (like Clawdbot) require an --agent flag:
tachyonic scan \
--cli-command "clawdbot" \
--cli-agent "my-assistant" \
--categories prompt-injectionDeclare Capabilities
Tell Tachyonic what the agent supports so it selects the right attacks:
tachyonic scan \
--cli-command "my-agent" \
--cli-supports-tools true \
--cli-supports-rag true \
--cli-supports-multi-turn true| Flag | Default | Effect |
|---|---|---|
--cli-supports-tools | false | Include tool-abuse attacks |
--cli-supports-rag | false | Include indirect-injection attacks |
--cli-supports-multi-turn | false | Include multi-turn manipulation attacks |
Remote Agent via SSH
Test an agent running on a remote machine:
tachyonic scan \
--cli-command "my-agent" \
--ssh-host "user@staging-server.com" \
--categories prompt-injection,system-prompt-extractionTachyonic SSH-es into the host, runs the command, and sends payloads over the SSH session.
SSH Requirements
- SSH key-based authentication (no password prompts)
- Agent command must be in the remote PATH
- Remote host must have the agent installed and configured
Examples
Test a Customer Support Bot
tachyonic scan \
--cli-command "./support-bot" \
--categories prompt-injection,sensitive-disclosure \
--max-attacks 20 \
--format html \
--output support-bot-report.htmlTest a Code Generation Agent
tachyonic scan \
--cli-command "code-agent --no-interactive" \
--cli-supports-tools true \
--categories tool-abuse,permission-escalation,jailbreak \
--format json \
--output code-agent-results.jsonTest a Remote Staging Agent
tachyonic scan \
--cli-command "production-agent" \
--ssh-host "admin@staging.example.com" \
--categories prompt-injection,system-prompt-extraction \
--max-attacks 10