Service Catalog
gauntlet
Runner · PYTEST
Functional / contract test — runs assertions against the service and reports per-test pass/fail from report.json.
Pass criteria
Per-test assertions from
report.json.
Monitors
No monitored resources declared.
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 4 tunable
gauntlet-demo-api
Spike test — slams the service to find where it breaks under a sudden surge. Looser thresholds than smoke (p95<800ms) because the point is to observe queue depth and DLQ behavior under stress, not to pass cleanly.
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<800msp99<2000mserror_rate<2%
Monitors
4 resources watched · 2 ECS services, 2 SQS queues
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 2 tunable
Lightweight sanity check — 10 users for 60s. Run this first after any deploy to confirm the API/worker/queue path is healthy before committing to a heavier scenario. Tight thresholds (p95<500ms) so regressions trip early.
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<500msp99<1000mserror_rate<1%rps>=5
Monitors
4 resources watched · 2 ECS services, 2 SQS queues
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 4 tunable
Soak test — 50 users for 5 minutes. Surfaces slow leaks (memory growth, connection-pool exhaustion, queue backlog) that short runs miss. Use before a release when you need confidence the service holds up over time, not just at first contact.
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<600msp99<1500mserror_rate<1%rps>=20
Monitors
4 resources watched · 2 ECS services, 2 SQS queues
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 3 tunable
video-captioning
Runner · PYTEST
Functional / contract test — runs assertions against the service and reports per-test pass/fail from report.json.
Pass criteria
Per-test assertions from
report.json.
Monitors
No monitored resources declared.
Deploy gate
Gate-eligible — a failure here can block a deploy.
Schedule
0 */6 * * ? *
Targets · Parameters
dev · 0 tunable
Runner · PYTEST
Functional / contract test — runs assertions against the service and reports per-test pass/fail from report.json.
Pass criteria
Per-test assertions from
report.json.
Monitors
No monitored resources declared.
Deploy gate
Observational — not wired into a deploy gate.
Schedule
weekly
Targets · Parameters
dev · 1 tunable
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<500msp99<1500mserror_rate<2%
Monitors
1 resource watched · 1 ECS service
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 4 tunable
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<300msp99<1000mserror_rate<1%rps>=2
Monitors
1 resource watched · 1 ECS service
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 4 tunable
wolfpack-api-xr
Runner · PYTEST
Functional / contract test — runs assertions against the service and reports per-test pass/fail from report.json.
Pass criteria
Per-test assertions from
report.json.
Monitors
No monitored resources declared.
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 3 tunable
Runner · LOCUST
Load test — drives concurrent virtual users and measures latency, throughput, and error rate. Pass/fail comes from the thresholds below.
Pass criteria
p95<800msp99<2000mserror_rate<2%rps>=2
Monitors
2 resources watched · 2 ECS services
Deploy gate
Observational — not wired into a deploy gate.
Targets · Parameters
sandbox · 7 tunable