Blog
CTFs Are Dead?
A new era of agent-versus-agent challenges and collaborative security research that could redefine the future of the field
Major Themes
1. AI Realism vs. CTF Rules Paradox CTF competitions limit autonomous AI usage to preserve manual skill assessment, whereas real-world attackers operate with zero constraints using every AI tool available. Restricting AI in training environments creates a gap between competitive formats and modern threat realities.
2. The Shift to Human as Agent Orchestrator
Security execution is moving from manual command running to orchestrating multi-agent CLI systems (Kiro, OpenCode, Antigravity). The core human role becomes context steering, environment fix-it, and guardrail configuration via setup files like agents.md.
3. Death of Low-Hanging Fruit & Industry Entry Barriers AI automates basic vulnerability discovery and script generation for both Red and Blue teams. This eliminates entry-level security tasks, raising the career entry bar and pushing senior human value toward complex context integration and system architecture.
4. Exponential Leverage vs. Cognitive Burnout Running parallel agent workflows grants the output capacity of an entire security team to a single operator. However, scaling execution capability tenfold without strict boundaries causes severe context-switching fatigue and burnout risk.
Concise Communication Strategies
AI Realism vs. CTF Rules Paradox
- Elevator Pitch: Traditional CTFs test manual puzzle-solving, but modern threat actors operate with AI automation. We must train security professionals to orchestrate AI agents, not artificially isolate them from modern workflows.
- Key Takeaway: Restricting AI in security training prepares engineers for past threat landscapes rather than current realities.
The Shift to Human as Agent Orchestrator
- Elevator Pitch: Modern security research relies on managing a cluster of specialized AI agents running in parallel, stepping in to fix environment errors and feed high-quality context to keep operations moving.
- Single-Sentence Summary: The modern security engineer is a context architect and agent orchestrator, not a manual tool executor.
Death of Low-Hanging Fruit & Industry Entry Barriers
- Elevator Pitch: AI is eliminating basic security tasks. Future engineers will not succeed through surface-level scanning, but by mapping complex logic and contextual systems that models cannot reason through alone.
- Key Takeaway: Trivial bug hunting is automated; human value now rests entirely on deep, non-linear system architecture.
Exponential Leverage vs. Cognitive Burnout
- Elevator Pitch: AI multiplies personal output tenfold, but managing continuous parallel workflows creates exponential cognitive overhead that requires aggressive work-life boundaries to sustain.
- Single-Sentence Summary: Execution leverage scales speed, but operational discipline dictates long-term sustainability.
Deeper Meanings and Critical Counter-Perspectives
1. Verification vs. True Muscle Memory Questioning an LLM after it solves a challenge provides conceptual understanding, but it does not replicate the deep mental model built through manual debugging. Reviewing AI outputs is passive learning; struggling through terminal errors manually builds the intuition required when models fail.
2. The Orchestration Overhead Trap Running multiple agents simultaneously across OSINT, crypto, and hardware creates an illusion of massive output. However, managing model rate limits, API keys, package dependencies, and prompt context can consume more cognitive bandwidth than solving a focused problem directly.
3. CTFs as Athletic Conditioning, Not Pure Warfare CTF rules limit AI not because organizers ignore real-world attack vectors, but because CTFs are designed as deliberate practice for human cognition. Using an agent to bypass basic challenges is similar to using a machine at the gym: it moves the weight efficiently, but bypasses the physical conditioning.
4. Brittle Infrastructure Dependency Relying heavily on multi-model pipelines, free tiers, and prompt-steering instructions makes operational capability fragile. When rate limits hit or models hallucinate on specialized protocols (like ICS or RPC endpoints), security performance drops to zero if manual fallbacks are not maintained.