πŸ€– πŸš€ ✨

The Evolution of
Subagent Expertise

How AI Agent Specialization
Transforms Complex Development

A Case Study with Optimizely CMS

The Strategy: Divide & Conquer

1

Identify Major Domains

Break the monolith into logical areas of expertise

2

Specialize Further

Within each domain, identify specific responsibilities

3

Create Expert Agents

Build specialized agents with deep domain knowledge

The Agent Creation System (ACS)

πŸ€–

Meta-Agents

6 Agents
The Governance Layer
πŸ“ .acs/agents/
πŸ“Š
Solution Analysis
Understands project structure
πŸ—οΈ
Agent Creation
Spawns specialized domain agents
πŸ”§
Agent Maintenance
Keeps agents up to date
⬆️
Upgrade
Manages system evolution
πŸ“š
Docs
Documents everything
🎯
Feedback
Learns and improves
The Governance Layer
These Meta-Agents analyze your project structure and create specialized Domain Agents for each area of expertise.

Agent Creation Flow

From Request to Activation: How AI Agents Are Born

1
πŸ—£οΈ
Request
Input: Problem statement
"Create presentation agents"
~30 seconds
β†’ Problem defined
2
πŸ”
Analysis
Identifies: 3 domains
Design, Content, Technical
Analyzes: Overlaps & risks
~2 minutes
β†’ Specialization map
3
πŸ“
Architecture
Defines: Responsibilities
Establishes: Guardrails β›”
Maps: Handoff patterns
~3 minutes
β†’ Agent specs
4
πŸ“
Documentation
Generates: 350-550 lines
YAML, patterns, examples
Includes: Anti-patterns
~5 minutes
β†’ 3 agent .md files
5
πŸ”—
Integration
Updates: GOVERNANCE.md
3 routing rules added
Links: To ecosystem
~1 minute
β†’ Updated governance
6
βœ…
Activation
Status: Live & callable
Ready: Accept queries
Monitored: Performance
Instant
✨ Active agents
🎯 Real Example: Presentation Agents
User Input
"Create agents for this presentation using ACS"
Analysis Result
3 specializations identified
Documentation
Designer (350) + Content (450) + Technical (550 lines)
Governance
3 new routing rules
Total Time
~12 minutes end-to-end
Outcome
3 production-ready agents ✨

The Opportunity

Optimizely's product suite is incredibly powerful and complex.
Let's enhance how we work with these systems using specialized AI expertise.

πŸ”Œ
Commerce Connect
πŸ›οΈ
Configured Commerce
πŸ§ͺ
Web Experimentation
✨
Feature Experimentation
Today's Example
πŸ“
CMS
🎨
CMP + DAM
πŸ’Ž
Opal
πŸ”„
ODP/OCP
πŸ“ˆ
Analytics

Your Presentation Creators

This presentation was designed, written, and built by specialized AI agents

🎨 πŸ“ πŸ’»

3 Presentation Agents

Specialized domain experts for presentation creation
🎨
Designer
Visual hierarchy, brand consistency, layout optimization
"No scrollbars allowed"
πŸ“
Content
Storytelling, messaging strategy, narrative structure
"Opportunity over problem"
πŸ’»
Technical
HTML/CSS/JS implementation, navigation, performance
"Sections array must sync"
🀝 Coordinated Creation
These agents collaborated using the same ACS governance modelβ€”each with clear responsibilities, deferred to each other's expertise.
✨ Meta-Moment
All 25 agentsβ€”these 3 presentation specialists plus 22 CMS domain expertsβ€”will be featured in the gallery ahead.

Step 1: Major Layers

Step 2: Subspecialties

25 Specialized Agents

Meet All 25 Agents

Smart Agent Selection

Smart Agent Selection

Smart Agent Selection

Why Subagent Expertise Works

🎯

Specialization

Each agent is an expert in their domain with deep, specific knowledge

🧠

Context Management

Focused knowledge means better token efficiency and relevant responses

🚧

Clear Boundaries

Agents know their limits and defer to experts when needed

πŸ”€

Smart Routing

Governance system routes tasks to the right expert automatically

πŸ“‹

Accountability

Every decision is attributed, enabling targeted feedback

πŸ”„

Scalability

New domains? Just add a new specialized agent

The Result

From one overwhelming monolith to 22 cooperating experts, each with crystal-clear responsibilities, boundaries, and deep domain knowledge.

Better answers. Faster solutions. Scalable expertise.

Real-World Challenge

CMS 12 β†’ CMS 13 Upgrade

39
Issues Identified
12
Packages Disabled
βœ…
Functional Build

Key Challenges

πŸ—οΈ Architectural Changes
Sites β†’ Applications, .NET 10 migration
βš™οΈ API Surface Changes
Removed interfaces, renamed services
πŸ“¦ Third-Party Lag
12 packages lacking CMS 13 versions
πŸ“‹ Documentation Gaps
Preview version mismatches, runtime issues

AI-Assisted Migration

πŸš€ 3 UPGRADE1213 Agents

🎯
Coordinator
Orchestrates phases, agents, verification, and progress tracking
πŸ“š
Docs Specialist
Living plan management, issue tracking, knowledge preservation
πŸ’»
Code Specialist
Code transformations, API migrations, build verification

4-Step Process

1
Pre-Planning
Analyze breaking changes
2
Migration
Apply upgrades & fixes
3
Resolution
Troubleshoot 39 issues
4
Documentation
Generate 65 docs

Documentation vs. Reality

AI Agents Discovered What Docs Couldn't Predict

38%
Documented
In breaking changes
13%
Partial Hints
Needed investigation
49%
AI Discoveries
Found by agents

Where AI Agents Added Value

πŸ“¦ Third-Party Discovery
Identified 12 packages needing alternatives beyond Optimizely's official docs
⚑ Runtime Investigation
Discovered database conflicts and service registration issues through testing
πŸ”¬ Version Tracking
Caught preview version mismatches between docs and actual package releases
πŸ”— Cross-Package Analysis
Mapped authorization, constructor, and attribute interactions across packages

The Impact

❌ Traditional Approach

πŸ“… Timeline: 3-4 weeks of manual troubleshooting
πŸ” Discovery: Sequential issue hunting, reactive debugging
πŸ“ Documentation: Scattered notes, tribal knowledge
🧠 Knowledge Loss: Context vanishes after project ends
⚠️ Blind Spots: 49% of issues discovered too late

βœ… AI-Assisted Approach

⚑ Timeline: Days instead of weeks
🎯 Discovery: Systematic issue identification & gap analysis
πŸ“š Documentation: 65 structured docs auto-generated
πŸ”„ Persistent Knowledge: Captured for future upgrades
πŸ“Š Analytics: Quantified doc accuracy (38%/13%/49%)

πŸ“Š Final Metrics

29/39
Issues Resolved
65
Docs Generated
100%
Future-Ready