Harness Run Reflection
Review recent agent run logs to identify repeated misses, skipped skills, and inefficient loops in the harness.
DocumentationRequirements & limits
Use when recent agent run logs need review for repeated misses, skipped skills, and inefficient loops.
Inputs
- recent run logs
- task outcomes or benchmark summaries
- current skill and policy references
Outputs
- Reflection report
- Failure patterns
- Improvement candidates
Before you begin
- Reading and copying the procedure require no terminal setup. Check requirements for any packaged programs separately.
Try this first
Read the procedure and supply its documented inputs. Use the full text in an agent app or chat that supports pasted instructions, following that host's guidance.
Limits for this step
- Instruction package only; it does not provide or authorize an executable runtime capability.
- Safe for harness analysis; must not widen scope into production code changes on its own.
Read full instructionsHide full instructions
Harness Run Reflection
When to use
- Use after a batch of agent runs or benchmark tasks.
- Use when skills are being skipped or invoked too late.
- Use before proposing harness policy changes.
Inputs required
- recent run logs
- task outcomes or benchmark summaries
- current skill and policy references
Workflow
- Review the run logs for repeated failure patterns.
- Identify missed skills, inefficient loops, and approval bypass attempts.
- Group the findings by frequency and severity.
- Recommend harness improvements without editing production code.
Output format
- Run Summary
- Recurring Failure Patterns
- Skipped or Late Skills
- Candidate Harness Improvements
- Scope Notes
Guardrails
- Limit analysis to harness behavior and policy usage.
- Do not recommend edits to production code as harness fixes.
- Cite specific run-log evidence for every pattern.
- Escalate if logs suggest policy violations or exfiltration attempts.
Failure modes
- If logs are incomplete, lower confidence explicitly.
- If the root cause spans production code and harness logic, split the recommendation into separate tracks.
- If the proposed fix touches protected paths, require human review.
View file metadata
---
name: harness-run-reflection
description: Inspect run logs and task outcomes to identify recurring
harness failures, skipped skills, and inefficient control-flow patterns.
---Install instruction files
These commands copy guidance into the selected runtime directories. Confirm that your agent app discovers it. Any packaged programs need separate setup and verification.
Install (Codex)
./bin/skills-hub install agentops/[email protected] --runtime codex
Install (Claude)
./bin/skills-hub install agentops/[email protected] --runtime claude
Install (Generic)
./bin/skills-hub install agentops/[email protected] --runtime generic --target ./my-agent/skills