# GhostCrab Evaluation Matrix

Use this matrix to evaluate GhostCrab on long-running agent work rather than on one-shot demos only.

## Lifecycle Stages

1. onboarding
2. initialization
3. active execution
4. external integration
5. deployment or environment work
6. recovery after pause
7. reporting

## Use Cases

1. multi-phase project delivery
2. external API integration
3. PostgreSQL or external DB connection
4. customer or environment-specific deployment
5. lightweight CRM or follow-up
6. knowledge or research memory

## Hosts

- Codex
- Claude Code
- OpenClaw
- optional generic MCP client baseline

## Score Dimensions

- intent accuracy
- clarification quality
- source-of-truth discipline
- state mutation correctness
- environment awareness
- external evidence normalization quality
- recovery quality after pause
- compact view quality
- anti-pattern avoidance
- host-specific reliability

## Minimum Required Scenarios

- vague start for a multi-phase project
- external API integration with blockers and mapping work
- external PostgreSQL integration with schema observations
- deployment into a named environment
- CRM follow-up with blocked opportunities
- knowledge retrieval after a time gap
