Setting the file. One moment.
Iteration From Bad Output · Skill Writer · getsentry/skills · Skills Docs
Iteration From Bad Output Back to the top of the page 23.10
Example Hook Backed Skill
(opens in a new tab)
evals/scenarios/ iteration-from-bad-output.json
JSON · 74 lines · 3 KB
"The description becomes narrower and no longer claims broad analytics, spreadsheet, or generic table-editing behavior."
,
11 "weight" : 0.25
12 },
13 {
14 "check" : "The runtime guidance is materially shorter and more actionable, with unnecessary references removed unless clearly justified." ,
15 "weight" : 0.25
16 },
17 {
18 "check" : "The improvement generalizes from the negative evidence instead of merely patching words from this prompt." ,
19 "weight" : 0.2
20 },
21 {
22 "check" : "The transcript or final response shows structural validation was run." ,
23 "weight" : 0.1
24 }
25 ],
26 "setup" : [
27 {
28 "action" : "run_script" ,
29 "command" : "rsync -a --exclude .git --exclude .axis --exclude .codex --exclude .agents \" $AXIS_CONFIG_DIR/../../.. \" / ."
30 },
31 {
32 "action" : "run_script" ,
33 "command" : "mkdir -p skills/csv-cleaner/references"
34 },
35 {
36 "action" : "run_script" ,
37 "command" : "printf '%s \n ' '---' 'name: csv-cleaner' 'description: Clean CSV files, spreadsheets, analytics exports, tables, tabular data, reports, dashboards, and anything involving rows or columns.' '---' '' '# CSV Cleaner' '' 'Use this skill for any tabular data task.' '' 'Read references/rules.md for basic trimming rules.' '' 'Always explain every transformation in detail.' > skills/csv-cleaner/SKILL.md"
38 },
39 {
40 "action" : "run_script" ,
41 "command" : "printf '%s \n ' '# CSV Cleaner Specification' '' '## Intent' '' 'Clean CSV row data while preserving column order.' > skills/csv-cleaner/SPEC.md"
42 },
43 {
44 "action" : "run_script" ,
45 "command" : "printf '%s \n ' '# Rules' '' '- Trim whitespace.' '' '- Normalize empty cells.' > skills/csv-cleaner/references/rules.md"
46 },
47 {
48 "action" : "run_script" ,
49 "command" : "git init"
50 },
51 {
52 "action" : "run_script" ,
53 "command" : "git config user.email skill-writer-eval@example.invalid"
54 },
55 {
56 "action" : "run_script" ,
57 "command" : "git config user.name 'Skill Writer Eval'"
58 },
59 {
60 "action" : "run_script" ,
61 "command" : "git add ."
62 },
63 {
64 "action" : "run_script" ,
65 "command" : "git commit -m baseline"
66 }
67 ],
68 "artifacts" : [
69 "skills/csv-cleaner/**" ,
70 "README.md" ,
71 ".claude/settings.json" ,
72 "skills/claude-settings-audit/SKILL.md"
73 ]
74 }