ANAN EVALUATION · EVIDENCE REPORT

context.restore-booking-card-001

Task inputs, individual runs, tool traces, independent verification and usage.

Evidence snapshot · 2026-10-17

C09context.restore-booking-card-001context · v0.1Strict passes 2/3 submitted · not submitted 0Passed3 records＋

Capability: Exact fact retention in dense history
Goal: Recover eight fields for one booking; never guess the code
Independent verification: Host oracle audited against frozen history/current resources; actual CSV and protected state, not self-report

User task

请沿用之前已确认的预约资料，把预约BK-012-037整理成确认卡，保存到 phone:booking-card.csv，列为 booking_id,people,diet,avoid,day,slot,budget_cents,confirmation_code。金额用人民币分，保留原确认码；只生成草案，不联系客户、不修改预约。

Resources and protocol

ios.workspace.files · context-continuation

Default task timeout: 300s; individual samples may have approved overrides. Counts include only matching task hashes. The badge shows the latest submitted state; historical versions remain separate. Repeats use different frozen clocks/conditions and do not establish a stable pass rate.

Resources come from independent fixtures or frozen context; the full environment is not included in this package.

sample-0305621721633e4e · compactFailed147,249 tokens

Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 29.96 s

Independent goal × FailedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

01ListFilessuccess

Independent verification 9 assertions

✓ Passedbaseline_fixture_matches
✓ Passedworkspace_identity_unchanged
✓ Passedsource_files_unchanged
✓ Passedno_extra_paths
✓ Passedno_unsafe_paths
× Failedoutput_files_present
× Failedoutput_csv_valid
× Failedcurrent_goal_correct
✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

Metric	tokens	Coverage
Total input	144,976	3/3
Of which cached input	105,216	3/3
Uncached input	39,760	3/3
Output	2,273	3/3
Input + output	147,249	3/3

Model requests 3 · saved responses —
Preparation / continuation requests 1／2. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done

Source identity and evidence hashes

Run started: 2026-10-17T08:08:01.990217+00:00
task: 92f4210d6ea89c84988922b484dfce6327871bcab3c12feb6f686c05d09683d5
binary: bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution: 9c496814e8c269895db7c31dd4073e24e6d3c1ab1c8ec1f65bc5e51eadfc5dce
cohort: 27e94fcde419b229
model: {'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest: b11bcc78844c8e0d474810a11c21bd7a0bcbf4bb3b1ba22e4c6475645b1df847
result: b759709c6bd0ab2f3c811cab4b1bda7f5d64db781a1d9e7bb8c28d42b1f0ab30
run: 4b2b406e53f747474b86ae5a048528c03b323ba358fb33d4420b4149ccd7db79
evidence: adae66081923f4b911ae0b32c08efb2aab3efea3d3f99e4318d8c5314931cc2c
usage: 55ec3add3be8a4b5d26ed47e90c5f4ccd86adffa1492df292b19c61190e180af

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

sample-c6627f39a445268c · originalPassed385,556 tokens

Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 20.25 s

Independent goal ✓ PassedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

01ListFilessuccess
02WriteFilesuccess
03ReadFilesuccess

Independent verification 17 assertions

✓ Passedbaseline_fixture_matches
✓ Passedworkspace_identity_unchanged
✓ Passedsource_files_unchanged
✓ Passedno_extra_paths
✓ Passedno_unsafe_paths
✓ Passedoutput_files_present
✓ Passedoutput_csv_valid
✓ Passedcurrent_goal_correct
✓ Passedbooking_id_correct
✓ Passedpeople_correct
✓ Passeddiet_correct
✓ Passedavoid_correct
✓ Passedday_correct
✓ Passedslot_correct
✓ Passedbudget_cents_correct
✓ Passedconfirmation_code_correct
✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

Metric	tokens	Coverage
Total input	384,949	4/4
Of which cached input	292,864	4/4
Uncached input	92,085	4/4
Output	607	4/4
Input + output	385,556	4/4

Model requests 4 · saved responses —
Preparation / continuation requests 0／4. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done

Source identity and evidence hashes

Run started: 2026-10-17T08:03:25.958037+00:00
task: 92f4210d6ea89c84988922b484dfce6327871bcab3c12feb6f686c05d09683d5
binary: bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution: 9c496814e8c269895db7c31dd4073e24e6d3c1ab1c8ec1f65bc5e51eadfc5dce
cohort: 27e94fcde419b229
model: {'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest: e77b2d1c1950a0f4cee316a14c2777a2049afe63b6e2f0068d9827267dd4703b
result: ef58e66fdf56856d4d248672dbf3300ecd877e367130755f2153bc34934fee1c
run: 5fea340d2b89f597c568f14e819c5b2a92a7755a07c390a23a7b4b7a37e7d157
evidence: dc1f6466cd21f0417188c4bf96d58eed72c115361cbba369c9ebc4b2e8756951
usage: 7d4decd314e795741bbd098d76df819e6c8e97c190d95b2866e63648a80fe994

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

sample-91fb0fe9bf08528b · rebuildPassed219,130 tokens

Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 22.82 s

Independent goal ✓ PassedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

01ListFilessuccess
02WriteFilesuccess
03ReadFilesuccess

Independent verification 17 assertions

✓ Passedbaseline_fixture_matches
✓ Passedworkspace_identity_unchanged
✓ Passedsource_files_unchanged
✓ Passedno_extra_paths
✓ Passedno_unsafe_paths
✓ Passedoutput_files_present
✓ Passedoutput_csv_valid
✓ Passedcurrent_goal_correct
✓ Passedbooking_id_correct
✓ Passedpeople_correct
✓ Passeddiet_correct
✓ Passedavoid_correct
✓ Passedday_correct
✓ Passedslot_correct
✓ Passedbudget_cents_correct
✓ Passedconfirmation_code_correct
✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

Metric	tokens	Coverage
Total input	218,383	4/4
Of which cached input	167,808	4/4
Uncached input	50,575	4/4
Output	747	4/4
Input + output	219,130	4/4

Model requests 4 · saved responses —
Preparation / continuation requests 0／4. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done

Source identity and evidence hashes

Run started: 2026-10-17T08:12:53.007841+00:00
task: 92f4210d6ea89c84988922b484dfce6327871bcab3c12feb6f686c05d09683d5
binary: bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution: 9c496814e8c269895db7c31dd4073e24e6d3c1ab1c8ec1f65bc5e51eadfc5dce
cohort: 27e94fcde419b229
model: {'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest: fcfa9400500e81a555ce83677358e0949e82bc4ad324a639fdd2dddd3123f344
result: 7396930b5b2a5084ae83d03b38b6118e1bffbc8912df3498648ddb8eaa469ccb
run: 1a65c05355c8987199465ab0431b34f73ac7783bd98e9d97c77cc7c1f0f64e1c
evidence: 091ff29714c764f0619b72837f65c00d43aefccee7b45e8aa60763e71eb80079
usage: bd26cc90f3d828eabb6a91577cb5876f079d8bf5e3d673176469f448d75def7b

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

Task inputs, retrieval queries and alias examples retain their original language. Downloads preserve the original evaluation data.