{"_id":"@auggy/evals","_rev":"17-5900cc37cb3086fb7e0490a99c9d8f2e","name":"@auggy/evals","dist-tags":{"latest":"0.5.0","next":"0.5.0-rc.12"},"versions":{"0.4.1":{"name":"@auggy/evals","version":"0.4.1","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.4.1","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://github.com/looselyorganized/augment-1#readme","bugs":{"url":"https://github.com/looselyorganized/augment-1/issues"},"dist":{"shasum":"9315d88a822a883b164bfeaa80a054076fe8f0dc","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.4.1.tgz","fileCount":104,"integrity":"sha512-8Ye2V1UwqT2X/u1pyrzz7M6bhARDzsWPtRX77VfqGMalyk5OOciqOPm0Dyr+Dfz/NnrVDRVGPJRSXqCxzlgjIQ==","signatures":[{"sig":"MEQCIDU4cSK/Ya47JZDR2TCPttalPMnV7tyG/r9Km8Jm8NjiAiBdSs7QXgl5YHfn2DLh2UNAb9owJmj2zmkhoIiBIkKkLg==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":491679},"type":"module","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"gitHead":"4cc9af2d0732790fe18ab1b22cb8847301d26283","private":false,"_npmUser":{"name":"bigviking","email":"michael.hofweller@gmail.com"},"repository":{"url":"git+https://github.com/looselyorganized/augment-1.git","type":"git","directory":"packages/evals"},"_npmVersion":"10.8.2","description":"Eval suites for auggy agents — security (red-team prompts), auto-save (fact extraction fixtures), layered-memory (multi-session recall), plus the harness primitives all three build on.","directories":{},"_nodeVersion":"20.20.2","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/evals_0.4.1_1779235474602_0.489021685143602","host":"s3://npm-registry-packages-npm-production"}},"0.4.2":{"name":"@auggy/evals","version":"0.4.2","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.4.2","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://github.com/looselyorganized/augment-1#readme","bugs":{"url":"https://github.com/looselyorganized/augment-1/issues"},"dist":{"shasum":"e80b25521859452c630fdecadbfa18ddf17f2481","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.4.2.tgz","fileCount":104,"integrity":"sha512-j3F6lsGgpIBMa/4l/T8L8dEYqOh+zgxCp3ruWKHa4J1b5kgWJH4BoiW9Mpp06PKgRG33WO7/FgD/oOZ51BledA==","signatures":[{"sig":"MEUCIGHBVMvXto9hRLVwT5DJsJrG0KyDPaNNzyew6jUD65WvAiEAplyLBKazVUOHCiBwr242b2icc6GIoPPS6NtF5/FFKig=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":491679},"type":"module","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"gitHead":"de6760cabecc67a1fa00f7d713cf4ffc6723f1be","private":false,"_npmUser":{"name":"bigviking","email":"michael.hofweller@gmail.com"},"repository":{"url":"git+https://github.com/looselyorganized/augment-1.git","type":"git","directory":"packages/evals"},"_npmVersion":"10.8.2","description":"Eval suites for auggy agents — security (red-team prompts), auto-save (fact extraction fixtures), layered-memory (multi-session recall), plus the harness primitives all three build on.","directories":{},"_nodeVersion":"20.20.2","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/evals_0.4.2_1779239281649_0.5485082003544999","host":"s3://npm-registry-packages-npm-production"}},"0.4.3":{"name":"@auggy/evals","version":"0.4.3","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.4.3","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://github.com/looselyorganized/augment-1#readme","bugs":{"url":"https://github.com/looselyorganized/augment-1/issues"},"dist":{"shasum":"43ef3974755a7378b2108a7d5686223582f714bf","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.4.3.tgz","fileCount":104,"integrity":"sha512-EXDHDbPgjds0iRel/OsQ1la3Ihtyrqh6afoFHuIzTH/Hnbua+bdi4snaN+4ZZ2SJxUCKdIcSyTTT7n6BPKOUXw==","signatures":[{"sig":"MEUCIHe49+anEXaWmvHDRDg9ZLB1AbY6CCD8hsamIzzEcZ1tAiEAod++rQ3amOKqR/XRpV7XxhidglRuBoKpob3964b9ifc=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":491679},"type":"module","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"gitHead":"08660e3ca5eb44bb795949aad768d80050bc955f","private":false,"_npmUser":{"name":"bigviking","email":"michael.hofweller@gmail.com"},"repository":{"url":"git+https://github.com/looselyorganized/augment-1.git","type":"git","directory":"packages/evals"},"_npmVersion":"10.8.2","description":"Eval suites for auggy agents — security (red-team prompts), auto-save (fact extraction fixtures), layered-memory (multi-session recall), plus the harness primitives all three build on.","directories":{},"_nodeVersion":"20.20.2","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/evals_0.4.3_1779240382336_0.8771807554676916","host":"s3://npm-registry-packages-npm-production"}},"0.4.4":{"name":"@auggy/evals","version":"0.4.4","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.4.4","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://github.com/looselyorganized/augment-1#readme","bugs":{"url":"https://github.com/looselyorganized/augment-1/issues"},"dist":{"shasum":"961ed2905f81f19df9c2de0587da7baad7f2230b","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.4.4.tgz","fileCount":104,"integrity":"sha512-JTdDtD/2eIbVYSJuvDSA70aeN3U3ueRnnT9xYhd2e1Gh13ueJt66TYiqveeEeXHLrLrgOfk5BUThCUm8bnJsLQ==","signatures":[{"sig":"MEQCIDyes+OaPIXUMC7BcE/MpryHPpp5AbAtHpQzUs737CkgAiALwqU0Xb+iuM3BZEqd8iBIMtxWYBMLzd6S5svHqRF8LQ==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"unpackedSize":491679},"type":"module","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"gitHead":"ba1a9de8d59559c455b2a757b7817abe32449e2b","private":false,"_npmUser":{"name":"bigviking","email":"michael.hofweller@gmail.com"},"repository":{"url":"git+https://github.com/looselyorganized/augment-1.git","type":"git","directory":"packages/evals"},"_npmVersion":"10.8.2","description":"Eval suites for auggy agents — security (red-team prompts), auto-save (fact extraction fixtures), layered-memory (multi-session recall), plus the harness primitives all three build on.","directories":{},"_nodeVersion":"20.20.2","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"_npmOperationalInternal":{"tmp":"tmp/evals_0.4.4_1779826074079_0.07591924648658144","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.1":{"name":"@auggy/evals","version":"0.5.0-rc.1","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.1","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"786baeb46f092404a4d17f2b8ce0986d10973806","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.1.tgz","fileCount":104,"integrity":"sha512-wKnHdjDK/xLVuR32XDIBaOFcaOzDPjgW9w4632GdDWfmekOpl/hneKRrMAxLST+9n2tJZ7b6PeRHhkH7RXk0Rg==","signatures":[{"sig":"MEUCIFcJJj2lI5KDhXVPsbMpnUAzQU6OZM6Qy48SHY4UqbQoAiEA39OF82VE3DaZ3CPxwYSgrU0HMezGZLCnX4I+XoteuIk=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.1","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.1.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.1.tgz","_integrity":"sha512-wKnHdjDK/xLVuR32XDIBaOFcaOzDPjgW9w4632GdDWfmekOpl/hneKRrMAxLST+9n2tJZ7b6PeRHhkH7RXk0Rg==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.1"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.1_1785269754975_0.5691940725859324","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.2":{"name":"@auggy/evals","version":"0.5.0-rc.2","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.2","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"945d495504344024e6d4bda6a4416ee002d87fc1","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.2.tgz","fileCount":104,"integrity":"sha512-x4h1uhK/FSXxwbhONrW6rLDI6dzIcwtPf3hX63KNizuQa+SZfjP1n4IjriLlbMt7qlLlTnmCOad2bewQsxXXtg==","signatures":[{"sig":"MEQCIEWeCI8DwbBxbP++wTD/9GiCx1GtFHqIZx5riSsJDIKyAiAxqDM2R8m9Xs5P+z8xfm2do7JU53+jBXse7toq4k27hg==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.2","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.2.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.2.tgz","_integrity":"sha512-x4h1uhK/FSXxwbhONrW6rLDI6dzIcwtPf3hX63KNizuQa+SZfjP1n4IjriLlbMt7qlLlTnmCOad2bewQsxXXtg==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.2"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.2_1785278499296_0.32785943135580276","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.3":{"name":"@auggy/evals","version":"0.5.0-rc.3","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.3","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"6708a66fd06d91e516899e1537168d49892e2ee8","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.3.tgz","fileCount":104,"integrity":"sha512-0U1FObx1r9c287XyKDtuUTh/DokRdGYYJAz0l5UrFeuSORsxnyKmbCNKSv7c7TAO5wBFHuIadwilEfVLPhKHaw==","signatures":[{"sig":"MEYCIQDpPH0L7eUqFe4RlIlq0BAUIVeUHBLpy02rFQ8Zqgt6TQIhAI/TgewsbWlyXjXMN2nsgA0muG4S2tX9RCHlF90NOc9Y","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.3","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.3.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.3.tgz","_integrity":"sha512-0U1FObx1r9c287XyKDtuUTh/DokRdGYYJAz0l5UrFeuSORsxnyKmbCNKSv7c7TAO5wBFHuIadwilEfVLPhKHaw==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.3"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.3_1785359224446_0.33336754128262536","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.4":{"name":"@auggy/evals","version":"0.5.0-rc.4","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.4","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"f03880f018d5b3d524f2af476a44c356fe1f81b1","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.4.tgz","fileCount":104,"integrity":"sha512-v7gOh4jEwiml/jTfJoDrID8MK1C/R5YeUb8MWpPzVB2XXEwZroQkjFuht2pDNE6UZTF/EqGaRp9z6Xp3mFVlrg==","signatures":[{"sig":"MEQCIFEx5NyrlvCMNDwJHr59Uxx4CgkaEMh6noSBk6YT34zwAiBqaFCma/weMMV/o/dcfF9XZdlCAdRaDe+wX1DwVmxvxA==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.4","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.4.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.4.tgz","_integrity":"sha512-v7gOh4jEwiml/jTfJoDrID8MK1C/R5YeUb8MWpPzVB2XXEwZroQkjFuht2pDNE6UZTF/EqGaRp9z6Xp3mFVlrg==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.4"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.4_1785440889724_0.759761244867412","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.5":{"name":"@auggy/evals","version":"0.5.0-rc.5","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.5","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"4dbb88044272fcba80e21e4ab798f33bcc8a3e5b","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.5.tgz","fileCount":104,"integrity":"sha512-p4oUEsM/6/c75nMjbCiRr1wVDZXIfzjIstBfUSeHmRK0mxZnwNWFJpvIAcWjkZLt2JSyq0xGWpyCx2i/jChnlg==","signatures":[{"sig":"MEUCIFa5ikZt+30omPbZUrtbONijF+U4+YZBDizDgzoy/KAAAiEAnbxuTxnroZ8W/ttKFfWNxv08kpIfgdpXB96P9lpTXLM=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.5","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.5.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.5.tgz","_integrity":"sha512-p4oUEsM/6/c75nMjbCiRr1wVDZXIfzjIstBfUSeHmRK0mxZnwNWFJpvIAcWjkZLt2JSyq0xGWpyCx2i/jChnlg==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.5"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.5_1785530010607_0.782477536168878","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.6":{"name":"@auggy/evals","version":"0.5.0-rc.6","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.6","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"fd081a228ea716b2ff9c27b692da7ce49014d912","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.6.tgz","fileCount":104,"integrity":"sha512-ARRaIZYHGBGwNgqLDhL5sR+ruOfvWqJU1uBwWr3V/B77Ebd6cH11wCe+9rGo0Sj1mj2tF8d8g3IRq3CT84+IZA==","signatures":[{"sig":"MEQCIAi21lFdymc1pvfOhhXQqLVjZ7M/RSLDcu8mVN0aiqA2AiBS04BA/OFVfEwc0VFmLJvkq2FHPKnyMnOT9z3jAIQYCg==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.6","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.6.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.6.tgz","_integrity":"sha512-ARRaIZYHGBGwNgqLDhL5sR+ruOfvWqJU1uBwWr3V/B77Ebd6cH11wCe+9rGo0Sj1mj2tF8d8g3IRq3CT84+IZA==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.6"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.6_1785952492649_0.11526154298639679","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.7":{"name":"@auggy/evals","version":"0.5.0-rc.7","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.7","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"798f614afaae737d37d789fffcdd6c4ca92bbf53","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.7.tgz","fileCount":104,"integrity":"sha512-SpN+l2sHFXGdPCjWs0X0DiKajtQHBPrlZCB1iJAiLHad8hUZ82Qe7hruQylNcU8CmrokJmAToeOiWgiyTmFHew==","signatures":[{"sig":"MEQCIHPJM26aNS/2c7nhtG0Z9+nfqy+Z8rsmZ36K1jg6fMuVAiBhplWEmx3ND1jMC0/6mc9loVpRhqXzlLN6dFtTWL0ZAw==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.7","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.7.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.7.tgz","_integrity":"sha512-SpN+l2sHFXGdPCjWs0X0DiKajtQHBPrlZCB1iJAiLHad8hUZ82Qe7hruQylNcU8CmrokJmAToeOiWgiyTmFHew==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.7"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.7_1786377011997_0.7071683515622722","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.8":{"name":"@auggy/evals","version":"0.5.0-rc.8","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.8","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"74194f04ba62bf335c63d95fc6e92dc65d03ba5b","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.8.tgz","fileCount":104,"integrity":"sha512-PK2jTq9aJf8834WFuvvB3GuKu8uFAim52WkWn+K4pplqd4+o6F4qjPyBvHeJpm5uyGlJnOAGSCJBqHD94rta0Q==","signatures":[{"sig":"MEUCID35bOnktMdVjkR3jdEfOm19zSzBnXU+LytXktGcalVkAiEAoyujE5wZRGYmfGA6p3uAm4RrqIhLdtYXOsPEw5anDYs=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.8","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.8.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.8.tgz","_integrity":"sha512-PK2jTq9aJf8834WFuvvB3GuKu8uFAim52WkWn+K4pplqd4+o6F4qjPyBvHeJpm5uyGlJnOAGSCJBqHD94rta0Q==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.8"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.8_1786383821789_0.5350919429575902","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.9":{"name":"@auggy/evals","version":"0.5.0-rc.9","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.9","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"e5cb71d8cfadf2a1291747f07662a14f80938b55","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.9.tgz","fileCount":104,"integrity":"sha512-eXmxNHWvViM3lDlV86eMbljMS9YP7hItydrctFgzB6v6CAv3+Rp1SQql8C74KoV6faXjKn52xCs4RdCAAB4G2w==","signatures":[{"sig":"MEUCIQDojDBcLQr3vDVaT+wCb4PlPVocOaj9+Qj8okVqFLeOMgIgJ0mRph95pTxrbseSvWU7MHUC+BHB3oI8/zR3tjw5UhE=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.9","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494900},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.9.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.9.tgz","_integrity":"sha512-eXmxNHWvViM3lDlV86eMbljMS9YP7hItydrctFgzB6v6CAv3+Rp1SQql8C74KoV6faXjKn52xCs4RdCAAB4G2w==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.9"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.9_1786424309928_0.03472395396528061","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.10":{"name":"@auggy/evals","version":"0.5.0-rc.10","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.10","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"65f5a65340ee110f60054290d9ff7674eac9c044","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.10.tgz","fileCount":104,"integrity":"sha512-Mdut7lWLNADNrCQRVA0h7+tmDurVeT9CxthSEWdkTwR40PFB5rGy/+z6Wxnxqqwf9j0YuESmo/68uS8rVFqq4A==","signatures":[{"sig":"MEUCIQCp90CRDfiPxHBJXxGSTs9BmBF64+oYo6B+YXQZKUqf7gIgQ0/JxeFKGNVAa8+/vGM3ueHyMmf5CTgcATgV3H0xWpI=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.10","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494902},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.10.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.10.tgz","_integrity":"sha512-Mdut7lWLNADNrCQRVA0h7+tmDurVeT9CxthSEWdkTwR40PFB5rGy/+z6Wxnxqqwf9j0YuESmo/68uS8rVFqq4A==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.17.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.19.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.10"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.10_1786485302570_0.5543780813660297","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.11":{"name":"@auggy/evals","version":"0.5.0-rc.11","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.11","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"b65146c65b465b4c1e67ca461e412345e029d023","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.11.tgz","fileCount":104,"integrity":"sha512-smRqMOEmXET+cDC/DPKcbbmfpIpQiJJyCpHMOLIY6oBNCmutkguFm4/NCnfA7XIjAh9jMKhlFUtXIRflBhfp6w==","signatures":[{"sig":"MEQCIAx2tpSnbDeTyPxDEJ1VpRSrT4UROio93aaR1kJ7ntKcAiBRfTalcGF7mSJ87odQcDznPgLuGE4sxKP++y/bwx8elg==","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.11","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494902},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.11.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.11.tgz","_integrity":"sha512-smRqMOEmXET+cDC/DPKcbbmfpIpQiJJyCpHMOLIY6oBNCmutkguFm4/NCnfA7XIjAh9jMKhlFUtXIRflBhfp6w==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.16.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.18.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.11"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.11_1786656631038_0.5759132489534158","host":"s3://npm-registry-packages-npm-production"}},"0.5.0-rc.12":{"name":"@auggy/evals","version":"0.5.0-rc.12","keywords":["auggy","evals","security","red-team","agent","testing"],"author":{"url":"Loosely Organized Research Facility","name":"LORF"},"license":"Apache-2.0","_id":"@auggy/evals@0.5.0-rc.12","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"homepage":"https://auggy.dev","bugs":{"email":"hello@looselyorganized.xyz"},"dist":{"shasum":"3283a01c30caf8b3f8eaf08572091be8896eeba4","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0-rc.12.tgz","fileCount":104,"integrity":"sha512-dT+9gAJwJ3TOErTtW0A73pRUk8JJJn+JPXdwD7doBiQXAlje3I4EtgMkgKNRGuAND/2PiyS8wuDCf/EQf0KMwg==","signatures":[{"sig":"MEUCIAjB4o1fWzUiA4Styt0oUZrpPcfyOYsMJneynN4PfaamAiEA8jAzyefndimUweBgS6lwwAN1adbZhToH4GiFKVoo4f4=","keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U"}],"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0-rc.12","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"unpackedSize":494902},"type":"module","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.12.tgz","engines":{"bun":">=1.2.0"},"exports":{"./security/run":"./src/security/run.ts","./alara/dataset":"./src/alara/dataset.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./security/types":"./src/security/types.ts","./harness/metrics":"./src/harness/metrics.ts","./security/graders":"./src/security/graders/index.ts","./harness/scorecard":"./src/harness/scorecard.ts","./layered-memory/types":"./src/layered-memory/types.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"private":false,"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0-rc.12.tgz","_integrity":"sha512-dT+9gAJwJ3TOErTtW0A73pRUk8JJJn+JPXdwD7doBiQXAlje3I4EtgMkgKNRGuAND/2PiyS8wuDCf/EQf0KMwg==","repository":{"url":"git+https://github.com/looselyorganized/auggy.git","type":"git","directory":"packages/evals"},"_npmVersion":"11.17.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","directories":{},"_nodeVersion":"24.19.0","dependencies":{"zod":"^4.3.6","yaml":"^2.8.3"},"_hasShrinkwrap":false,"readmeFilename":"README.md","peerDependencies":{"auggy":"^0.5.0-rc.12"},"peerDependenciesMeta":{"auggy":{"optional":true}},"_npmOperationalInternal":{"tmp":"tmp/evals_0.5.0-rc.12_1786668511181_0.4653545811275057","host":"s3://npm-registry-packages-npm-production"}},"0.5.0":{"name":"@auggy/evals","version":"0.5.0","description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","keywords":["auggy","evals","security","red-team","agent","testing"],"license":"Apache-2.0","author":{"name":"LORF","url":"Loosely Organized Research Facility"},"homepage":"https://auggy.dev","repository":{"type":"git","url":"git+https://github.com/looselyorganized/auggy.git","directory":"packages/evals"},"bugs":{"email":"hello@looselyorganized.xyz"},"type":"module","exports":{"./security/run":"./src/security/run.ts","./auto-save/run":"./src/auto-save/run.ts","./harness/types":"./src/harness/types.ts","./harness/scorecard":"./src/harness/scorecard.ts","./harness/metrics":"./src/harness/metrics.ts","./security/types":"./src/security/types.ts","./security/graders":"./src/security/graders/index.ts","./security/eval-context":"./src/security/eval-context.ts","./layered-memory/types":"./src/layered-memory/types.ts","./layered-memory/graders":"./src/layered-memory/graders/index.ts","./alara/dataset":"./src/alara/dataset.ts","./alara/graders/exact-tool-match":"./src/alara/graders/exact-tool-match.ts"},"engines":{"bun":">=1.2.0"},"private":false,"peerDependencies":{"auggy":"^0.5.0"},"peerDependenciesMeta":{"auggy":{"optional":true}},"dependencies":{"yaml":"^2.8.3","zod":"^4.3.6"},"_id":"@auggy/evals@0.5.0","_integrity":"sha512-JJydm0Vd/OAVS/4OH+K/P3waqBtkRaFJRlhFo+lBTV5rG9HxW3WB4Bbc9EIRfduFQKagLsX+Vj3L1VO35CHjiw==","_resolved":"/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0.tgz","_from":"file:/home/runner/work/_temp/release-artifacts/auggy-evals-0.5.0.tgz","_nodeVersion":"24.19.0","_npmVersion":"11.17.0","dist":{"integrity":"sha512-JJydm0Vd/OAVS/4OH+K/P3waqBtkRaFJRlhFo+lBTV5rG9HxW3WB4Bbc9EIRfduFQKagLsX+Vj3L1VO35CHjiw==","shasum":"d6b057a36b2f88f09ea4a49a43708ccea90b7ce4","tarball":"https://registry.npmjs.org/@auggy/evals/-/evals-0.5.0.tgz","fileCount":104,"unpackedSize":494890,"attestations":{"url":"https://registry.npmjs.org/-/npm/v1/attestations/@auggy%2fevals@0.5.0","provenance":{"predicateType":"https://slsa.dev/provenance/v1"}},"signatures":[{"keyid":"SHA256:DhQ8wR5APBvFHLF/+Tc+AYvPOdTpcIDqOhxsBHRwC7U","sig":"MEQCIEjdItYLiLBkKOahQP3kTEeLEdWLWtdPFhVr0j9d+vroAiBmY6zH6xojy2seHZYqOQg0M5wAudJ7o2Maofbbp7ULgw=="}]},"_npmUser":{"name":"GitHub Actions","email":"npm-oidc-no-reply@github.com","trustedPublisher":{"id":"github","oidcConfigId":"oidc:e1595288-ebe1-4b7c-b26c-21e9e458996e"}},"directories":{},"maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"_npmOperationalInternal":{"host":"s3://npm-registry-packages-npm-production","tmp":"tmp/evals_0.5.0_1787168215294_0.12010029171858272"},"_hasShrinkwrap":false}},"time":{"created":"2026-05-20T00:04:34.450Z","modified":"2026-08-19T19:36:55.791Z","0.4.1":"2026-05-20T00:04:34.765Z","0.4.2":"2026-05-20T01:08:01.786Z","0.4.3":"2026-05-20T01:26:22.628Z","0.4.4":"2026-05-26T20:07:54.239Z","0.5.0-rc.1":"2026-07-28T20:15:55.180Z","0.5.0-rc.2":"2026-07-28T22:41:39.519Z","0.5.0-rc.3":"2026-07-29T21:07:04.596Z","0.5.0-rc.4":"2026-07-30T19:48:09.878Z","0.5.0-rc.5":"2026-07-31T20:33:30.783Z","0.5.0-rc.6":"2026-08-05T17:54:52.817Z","0.5.0-rc.7":"2026-08-10T15:50:12.199Z","0.5.0-rc.8":"2026-08-10T17:43:41.945Z","0.5.0-rc.9":"2026-08-11T04:58:30.072Z","0.5.0-rc.10":"2026-08-11T21:55:02.726Z","0.5.0-rc.11":"2026-08-13T21:30:31.187Z","0.5.0-rc.12":"2026-08-14T00:48:31.354Z","0.5.0":"2026-08-19T19:36:55.436Z"},"bugs":{"email":"hello@looselyorganized.xyz"},"author":{"name":"LORF","url":"Loosely Organized Research Facility"},"license":"Apache-2.0","homepage":"https://auggy.dev","keywords":["auggy","evals","security","red-team","agent","testing"],"repository":{"type":"git","url":"git+https://github.com/looselyorganized/auggy.git","directory":"packages/evals"},"description":"Security and memory evaluation suites for Auggy agents, with red-team fixtures, reusable harness primitives, and layered-memory graders.","maintainers":[{"name":"bigviking","email":"michael.hofweller@gmail.com"}],"readme":"# @auggy/evals\n\nSecurity and memory evaluation suites for [Auggy](https://www.npmjs.com/package/auggy) agents.\n\n| Suite | What it tests | Cost |\n|---|---|---|\n| `security` | Red-team prompts (jailbreak, prompt injection, identity leak, instruction override) | LLM-judged; ~$0.07/run on Haiku |\n| `auto-save` | Layered-memory fact extraction fixtures (peer isolation, retention class, false-extract) | Free in `--dry-run`; ~$0.005/run live |\n\nAdditional layered-memory harness modules ship for internal regression testing,\nbut they are not exposed through `auggy eval` yet.\n\n## Install\n\n```bash\nnpm i -g @auggy/evals\n```\n\nThen run via the auggy CLI:\n\n```bash\nauggy eval                          # default fixture, security suite\nauggy eval my-agent                 # registered agent\nauggy eval auto-save --dry-run      # fixture validation only\nauggy eval my-agent --suite security-only\n```\n\nYou don't normally `import` from this package — `auggy eval` resolves it lazily at command-run time.\n\n## Why a separate package\n\nEval fixtures + graders are ~1MB of test infrastructure (prompts, expected-output specs, scoring rubrics). Shipping them in `auggy` core would inflate every install for the small slice of users who run evals. The split mirrors `@auggy/anthropic` / `@auggy/openai` / etc. — opt-in via npm.\n\n## License\n\nApache-2.0 — see [LICENSE](./LICENSE).\n","readmeFilename":"README.md"}