{"_id":"@ai-test-harness/cli","name":"@ai-test-harness/cli","dist-tags":{"latest":"1.0.0"},"versions":{"1.0.0":{"name":"@ai-test-harness/cli","version":"1.0.0","description":"CLI tool for AI Test Harness - scaffold and run AI quality tests","bin":{"ai-test-harness":"dist/bin/cli.js"},"main":"dist/index.js","types":"dist/index.d.ts","scripts":{"build":"tsc --build","type-check":"tsc --build","dev":"tsx src/bin/cli.ts"},"keywords":["ai","llm","testing","cli","scaffold","bedrock"],"author":{"name":"AI Test Harness Contributors"},"license":"MIT","repository":{"type":"git","url":"git+https://github.com/c2pig/ai-test-harness.git","directory":"packages/cli"},"bugs":{"url":"https://github.com/c2pig/ai-test-harness/issues"},"homepage":"https://github.com/c2pig/ai-test-harness/tree/main/packages/cli#readme","publishConfig":{"access":"public"},"dependencies":{"@ai-test-harness/core":"*","commander":"^12.0.0","chalk":"^5.3.0","inquirer":"^9.2.0","ora":"^8.0.0","handlebars":"^4.7.0","fs-extra":"^11.2.0"},"devDependencies":{"@types/fs-extra":"^11.0.0","@types/inquirer":"^9.0.0","@types/node":"^20.11.0","typescript":"^5.3.0","tsx":"^4.7.0"},"engines":{"node":">=18.0.0"},"_id":"@ai-test-harness/cli@1.0.0","gitHead":"26c39271f8312e9120c7bd72f297844d04d0381e","_nodeVersion":"24.2.0","_npmVersion":"11.3.0","dist":{"integrity":"sha512-U/FX8iwZomE7OOUMiUihMQbVHWYxRROifv+9bVa7BAle3DLpgUp7jPW/vRYiIMhnQee3KgRwXX+KrRpisNrNdg==","shasum":"25eacc7ec0286abf84a2d9580cd6e1464bdb1168","tarball":"https://registry.npmjs.org/@ai-test-harness/cli/-/cli-1.0.0.tgz","fileCount":151,"unpackedSize":143870,"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEUCIQDYGtSnt3HJ3ImcxCI5Dv85Z0tbHxZCe5MpnwHQo1YyzQIgG5IIhqlZSovDfd8iWKnqaaegoBZR52LjLCukqJEZKZg="}]},"_npmUser":{"name":"c2pigisme","email":"bluecurves@gmail.com"},"directories":{},"maintainers":[{"name":"c2pigisme","email":"bluecurves@gmail.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/cli_1.0.0_1764488482469_0.14537273693846853"},"_hasShrinkwrap":false}},"time":{"created":"2025-11-30T07:41:22.375Z","1.0.0":"2025-11-30T07:41:22.681Z","modified":"2025-11-30T07:41:22.962Z"},"maintainers":[{"name":"c2pigisme","email":"bluecurves@gmail.com"}],"description":"CLI tool for AI Test Harness - scaffold and run AI quality tests","homepage":"https://github.com/c2pig/ai-test-harness/tree/main/packages/cli#readme","keywords":["ai","llm","testing","cli","scaffold","bedrock"],"repository":{"type":"git","url":"git+https://github.com/c2pig/ai-test-harness.git","directory":"packages/cli"},"author":{"name":"AI Test Harness Contributors"},"bugs":{"url":"https://github.com/c2pig/ai-test-harness/issues"},"license":"MIT","readme":"# @ai-test-harness/cli\n\n[![npm version](https://badge.fury.io/js/%40ai-test-harness%2Fcli.svg)](https://www.npmjs.com/package/@ai-test-harness/cli)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\nCommand-line interface for AI Test Harness - scaffold and run AI quality tests.\n\n## Installation\n\n```bash\nnpm install -g @ai-test-harness/cli\n# or use npx\nnpx @ai-test-harness/cli <command>\n```\n\n## Commands\n\n### Create New Project\n\n```bash\n# Interactive mode\nai-test-harness new my-llm-tests\n\n# Non-interactive with defaults\nai-test-harness new my-llm-tests -y\n\n# Specify test type\nai-test-harness new my-tests --type=agent-simulation\n\n# Use minimal template\nai-test-harness new my-tests --template=minimal\n```\n\n### Run Tests\n\n```bash\n# Run with default config\nai-test-harness run\n\n# Specify config file\nai-test-harness run --config=staging.yaml\n\n# Override model\nai-test-harness run --model=claude-3-5-sonnet\n\n# Verbose output\nai-test-harness run --verbose\n```\n\n### Validate Configuration\n\n```bash\nai-test-harness validate\nai-test-harness validate --config=staging.yaml\n```\n\n### Add Scaffolding\n\n```bash\n# Add custom quality attribute\nai-test-harness add quality ResponseQuality\n\n# Add test scenario\nai-test-harness add scenario edge-case-test\n\n# Add data connector\nai-test-harness add connector production-logs\n```\n\n## Generated Project Structure\n\n```\nmy-llm-tests/\n├── config.yaml           # Main configuration\n├── custom/\n│   ├── pricing.yaml      # Custom model pricing\n│   ├── prompts.yaml      # Prompt definitions\n│   ├── connectors.yaml   # Data source connectors\n│   └── qualities/        # Custom quality attributes\n│       └── ExampleQuality.ts\n├── data/                 # Test data files\n├── calibration/          # Judge calibration\n├── scenarios/            # Test scenarios (agent tests)\n├── outputs/              # Test outputs (gitignored)\n├── package.json\n└── README.md\n```\n\n## Example Workflow\n\n```bash\n# 1. Create new project\nai-test-harness new my-llm-tests\ncd my-llm-tests\n\n# 2. Install dependencies\nnpm install\n\n# 3. Configure your tests\n# Edit config.yaml, add data, customize qualities\n\n# 4. Validate configuration\nnpm run validate\n\n# 5. Run tests\nnpm test\n```\n\n## Documentation\n\nFor complete documentation, see the [main repository](https://github.com/c2pig/ai-test-harness).\n\n## Contributing\n\nSee [CONTRIBUTING.md](https://github.com/c2pig/ai-test-harness/blob/main/CONTRIBUTING.md) in the main repository.\n\n## License\n\nMIT © AI Test Harness Contributors\n\n","readmeFilename":"README.md","_rev":"1-da58f5db8403336c119e0b6f991535b2"}