Skip to content

[rig-sampler] Daily Rig sample report — 2026-08-15 #429

Open
Open
[rig-sampler] Daily Rig sample report — 2026-08-15#429
Labels
ai-agentautomation

Description

@github-actions
github-actions
bot
opened on Aug 15, 2026

Summary

The Rig sample coordinator ran five randomly selected samples from skills/rig/samples/ using the stub Copilot SDK client (dry-run mode). Samples were executed via npm run sample (vitest + stub transport).

Note on execution context: The task program (sampleCoordinator) requires a live Copilot model to orchestrate runs. Since no model was available in this environment (Error: No model available. Check policy enablement under GitHub Settings > Copilot), the five samples were run directly using the existing stub runner (npm run sample), which is the canonical dry-run harness for this repository. Runtime logs were captured via RIG_DEBUG=agent:invoke,....

Selected Samples

# Sample Status
1 skills/rig/samples/53-ralf-loop.md ✅ succeeded
2 skills/rig/samples/66-ci-workflow-health.md ✅ succeeded
3 skills/rig/samples/80-git-contributor-mapper.md ✅ succeeded
4 skills/rig/samples/47-prompt-intents.md ✅ succeeded
5 skills/rig/samples/10-triage-pr.md ✅ succeeded

Sample Outputs

skills/rig/samples/53-ralf-loop.md — ✅ succeeded 
> sample
> vitest run scripts/run-sample.test.ts


 RUN  v4.1.7 /home/runner/work/rig/rig

 ❯ scripts/run-sample.test.ts (6 tests | 3 failed) 1479ms
     ✓ 53-ralf-loop.ts 10ms
     × 153-coverage-badge-updater-v2.md 3ms
     × 253-package-version-drift.md 1ms
     × 353-stale-branch-detector-v2.md 1ms
     ✓ 53-ralf-loop.md 12ms
     ✓ typechecks extracted rig programs with npx tsc  1450ms

 Test Files  1 failed (1)
      Tests  3 failed | 3 passed (6)
   Start at  12:40:24
   Duration  1.75s (transform 160ms, setup 0ms, import 176ms, tests 1.48s, environment 0ms)


::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 153-coverage-badge-updater-v2.md,line=257,column=39::AssertionError: expected 35 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 253-package-version-drift.md,line=257,column=39::AssertionError: expected 35 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 353-stale-branch-detector-v2.md,line=257,column=39::AssertionError: expected 45 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A
skills/rig/samples/66-ci-workflow-health.md — ✅ succeeded 
> sample
> vitest run scripts/run-sample.test.ts


 RUN  v4.1.7 /home/runner/work/rig/rig

 ❯ scripts/run-sample.test.ts (6 tests | 4 failed) 1488ms
     × 166-env-variable-type-inferrer.md 4ms
     × 266-tsconfig-option-analyzer.md 1ms
     × 366-binary-file-detector-v2.md 0ms
     × 366-ts-jsdoc-coverage-checker.md 1ms
     ✓ 66-ci-workflow-health.md 21ms
     ✓ typechecks extracted rig programs with npx tsc  1458ms

 Test Files  1 failed (1)
      Tests  4 failed | 2 passed (6)
   Start at  12:40:26
   Duration  1.77s (transform 148ms, setup 0ms, import 170ms, tests 1.49s, environment 0ms)


::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 166-env-variable-type-inferrer.md,line=257,column=39::AssertionError: expected 40 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 266-tsconfig-option-analyzer.md,line=257,column=39::AssertionError: expected 52 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 366-binary-file-detector-v2.md,line=257,column=39::AssertionError: expected 53 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 366-ts-jsdoc-coverage-checker.md,line=257,column=39::AssertionError: expected 65 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A
skills/rig/samples/80-git-contributor-mapper.md — ✅ succeeded 
> sample
> vitest run scripts/run-sample.test.ts


 RUN  v4.1.7 /home/runner/work/rig/rig

 ❯ scripts/run-sample.test.ts (8 tests | 5 failed) 1519ms
     × 180-git-tag-timeline-reporter.md 4ms
     ✓ 280-commit-churn-classifier.md 17ms
     × 380-npm-peer-dep-conflict-checker.md 1ms
     × 380-sequential-commit-classifier-workflow.md 1ms
     × 380-ts-narrowing-detector.md 0ms
     × 380-ts-string-literal-unions.md 0ms
     ✓ 80-git-contributor-mapper.md 7ms
     ✓ typechecks extracted rig programs with npx tsc  1485ms

 Test Files  1 failed (1)
      Tests  5 failed | 3 passed (8)
   Start at  12:40:29
   Duration  1.78s (transform 148ms, setup 0ms, import 164ms, tests 1.52s, environment 0ms)


::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 180-git-tag-timeline-reporter.md,line=257,column=39::AssertionError: expected 31 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 380-npm-peer-dep-conflict-checker.md,line=257,column=39::AssertionError: expected 58 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 380-sequential-commit-classifier-workflow.md,line=257,column=39::AssertionError: expected 45 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 380-ts-narrowing-detector.md,line=257,column=39::AssertionError: expected 52 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 380-ts-string-literal-unions.md,line=257,column=39::AssertionError: expected 47 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A
skills/rig/samples/47-prompt-intents.md — ✅ succeeded 
> sample
> vitest run scripts/run-sample.test.ts


 RUN  v4.1.7 /home/runner/work/rig/rig

 ❯ scripts/run-sample.test.ts (7 tests | 4 failed) 1500ms
     ✓ 47-prompt-intents.ts 10ms
     × 147-git-submodule-health.md 3ms
     × 247-license-header-checker.md 1ms
     × 347-gitignore-pattern-tester.md 1ms
     × 347-python-requirements-risk-mapper.md 0ms
     ✓ 47-prompt-intents.md 11ms
     ✓ typechecks extracted rig programs with npx tsc  1472ms

 Test Files  1 failed (1)
      Tests  4 failed | 3 passed (7)
   Start at  12:40:31
   Duration  1.78s (transform 147ms, setup 0ms, import 163ms, tests 1.50s, environment 0ms)


::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 147-git-submodule-health.md,line=257,column=39::AssertionError: expected 49 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 247-license-header-checker.md,line=257,column=39::AssertionError: expected 50 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 347-gitignore-pattern-tester.md,line=257,column=39::AssertionError: expected 48 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 347-python-requirements-risk-mapper.md,line=257,column=39::AssertionError: expected 41 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A
skills/rig/samples/10-triage-pr.md — ✅ succeeded 
> sample
> vitest run scripts/run-sample.test.ts


 RUN  v4.1.7 /home/runner/work/rig/rig

 ❯ scripts/run-sample.test.ts (18 tests | 8 failed) 1568ms
     ✓ 10-triage-pr.ts 10ms
     ✓ 10-triage-pr.md 11ms
     ✓ 100-workspace-config-drift-2.md 7ms
     ✓ 101-commit-format-suggester-2.md 6ms
     ✓ 102-runtime-env-checker-2.md 6ms
     ✓ 103-hotspot-file-analyzer-2.md 6ms
     × 104-loc-statistics.md 3ms
     ✓ 105-import-cycle-detector-2.md 9ms
     × 106-ts-export-usage.md 1ms
     ✓ 107-git-rename-tracker.md 6ms
     × 108-yaml-lint-checker.md 0ms
     ✓ 109-two-phase-complexity-review.md 6ms
     × 110-workspace-config-drift-3.md 0ms
     × 210-test-file-naming-enforcer.md 0ms
     × 310-lock-file-drift-detector.md 0ms
     × 310-workflow-audit-verify.md 10ms
     × 410-merge-strategy-selector.md 0ms
     ✓ typechecks extracted rig programs with npx tsc  1484ms

 Test Files  1 failed (1)
      Tests  8 failed | 10 passed (18)
   Start at  12:40:33
   Duration  1.82s (transform 163ms, setup 0ms, import 156ms, tests 1.57s, environment 0ms)


::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 104-loc-statistics.md,line=257,column=39::AssertionError: expected 35 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 106-ts-export-usage.md,line=257,column=39::AssertionError: expected 32 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 108-yaml-lint-checker.md,line=257,column=39::AssertionError: expected 36 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 110-workspace-config-drift-3.md,line=257,column=39::AssertionError: expected 43 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 210-test-file-naming-enforcer.md,line=257,column=39::AssertionError: expected 39 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/scripts/run-sample.test.ts,title=scripts/run-sample.test.ts > skill markdown samples > 310-lock-file-drift-detector.md,line=257,column=39::AssertionError: expected 66 to be less than or equal to 30%0A ❯ scripts/run-sample.test.ts:257:39%0A%0A

::error file=/home/runner/work/rig/rig/skills/rig/rig.ts,title=scripts/run-sample.test.ts > skill markdown samples > 310-workflow-audit-verify.md,line=1871,column=15::Error: Expected stdin program root agent to have no input (omit input or use input: s.object({})).%0

Rig Runtime Logs

Exact rig.* JSONL lines emitted to stderr during the stub run, grouped by sample.

53-ralf-loop.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":{"test":{"__rig":"prompt","id":"prompt_intent_1","mode":"prompt.text","command":"npm test"}},"model":"mini","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"mini","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

66-ci-workflow-health.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":3}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

80-git-contributor-mapper.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

47-prompt-intents.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":{"diff":{"__rig":"prompt","id":"prompt_intent_1","mode":"prompt.text","command":"git diff -- ."},"status":{"__rig":"prompt","id":"prompt_intent_2","mode":"prompt.text","command":"git status --short"}},"model":"mini","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"mini","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

10-triage-pr.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":{"title":"CLI exits zero after failed upload","body":"The command prints an error but exits with code 0."},"model":"mini","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"mini","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":5}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":5}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}
{"type":"rig.agent:invoke","data":{"agent":"complexityReviewer","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"complexityReviewer"}}
{"type":"rig.engine:copilot:close"}
 ❯ Object.body skills/rig/rig.ts:1871:15
 ❯ runWorkflow skills/rig/rig.ts:2578:20
 ❯ runProgramCodeFromStdin skills/rig/rig.ts:1861:20
 ❯ Module.runLauncherCli skills/rig/rig.ts:1960:3

Generated by Daily Rig Sample Report · sonnet46 78 AIC · ⌖ 9.73 AIC · ⊞ 5.2K · ◷

  • expires on Aug 22, 2026, 12:43 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Labels

    ai-agentautomation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions