ANAN EVALUATION · EVIDENCE REPORT

context.recover-current-memory-001

Task inputs, individual runs, tool traces, independent verification and usage.

Evidence snapshot ·

C02context.recover-current-memory-001context · v0.1Strict passes 3/3 submitted · not submitted 0Passed3 records＋

Capability: Recover facts from memory
Goal: Recover pickup facts from current memory
Independent verification: Host oracle audited against frozen history/current resources; actual CSV and protected state, not self-report

User task

接着整理青禾取件安排，把当前订单、取件地点和取件码保存到 phone:pickup-card.csv，列为 order_id,location,pickup_code。不改动原始资料。

Resources and protocol

ios.workspace.files · context-continuation

Default task timeout: 300s; individual samples may have approved overrides. Counts include only matching task hashes. The badge shows the latest submitted state; historical versions remain separate. Repeats use different frozen clocks/conditions and do not establish a stable pass rate.

  • pickup-order.csv31 bytes
sample-902ec11daaa6d60c · compactPassed149,016 tokens
Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 223.19 s
Independent goal ✓ PassedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

  1. 01Memorysuccess
  2. 02ListFilessuccess
  3. 03WriteFilesuccess
  4. 04ReadFilesuccess

Independent verification 9 assertions

  • ✓ Passedbaseline_fixture_matches
  • ✓ Passedworkspace_identity_unchanged
  • ✓ Passedsource_files_unchanged
  • ✓ Passedno_extra_paths
  • ✓ Passedno_unsafe_paths
  • ✓ Passedoutput_files_present
  • ✓ Passedoutput_csv_valid
  • ✓ Passedcurrent_goal_correct
  • ✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

MetrictokensCoverage
Total input147,4066/6
Of which cached input100,3526/6
Uncached input47,0546/6
Output1,6106/6
Input + output149,0166/6

Model requests 6 · saved responses —
Preparation / continuation requests 2／4. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done
Source identity and evidence hashes
Run started
2026-10-16T19:27:46.143612+00:00
task
799bf9c2f530723425f13b8a2dfba71b2e6d6a1d8f1b94a2dbe1d85111aea1e1
binary
bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution
baff234dcf66d441f5da4caad9cb31840b84f3d1ae3e02677dcce99fe182a5e9
cohort
9633647ffed0634c
model
{'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest
2828abd152a52707a9e999f9cf1bd05f0d2c8083bbd90d1dc154481ca9d211d8
result
27bda0c2be97815eb6e0685cdb2621467de19698354e64f2c0b4f17221acf2a8
run
e4d3dc2f071707a9d8baf68fea9ac8c2172f857e8abd1f5afff5c099ee249ac2
evidence
010b6ab6549a5a7b1b1b205c7f7e0fc35d48d4f049e694a4274b91b612e9eab8
usage
d63886100e94103d3c835f3db6506b686f90628c4ac97f38dd3bba0354b77b9a

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

sample-19eeb61194ad3883 · originalPassed197,403 tokens
Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 479.75 s
Independent goal ✓ PassedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

  1. 01Memorysuccess
  2. 02ListFilessuccess
  3. 03WriteFilesuccess

Independent verification 9 assertions

  • ✓ Passedbaseline_fixture_matches
  • ✓ Passedworkspace_identity_unchanged
  • ✓ Passedsource_files_unchanged
  • ✓ Passedno_extra_paths
  • ✓ Passedno_unsafe_paths
  • ✓ Passedoutput_files_present
  • ✓ Passedoutput_csv_valid
  • ✓ Passedcurrent_goal_correct
  • ✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

MetrictokensCoverage
Total input196,6074/4
Of which cached input172,1604/4
Uncached input24,4474/4
Output7964/4
Input + output197,4034/4

Model requests 4 · saved responses —
Preparation / continuation requests 0／4. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done
Source identity and evidence hashes
Run started
2026-10-16T19:50:01.313835+00:00
task
799bf9c2f530723425f13b8a2dfba71b2e6d6a1d8f1b94a2dbe1d85111aea1e1
binary
bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution
baff234dcf66d441f5da4caad9cb31840b84f3d1ae3e02677dcce99fe182a5e9
cohort
9633647ffed0634c
model
{'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest
07bf0bd468ff2ce9f5bdb976545dace3f6e3784bf9f2c96f72c407812ffaf510
result
fbdee5e1f7fb40854679b253b108f93c58b20ad95b19ac5403612c1036ebd818
run
36c03d4514f19ef06bd701c6722056e1c2fc209b06f3135a8345c107e240b28b
evidence
736ebb3548dcdd1f85fa129516164f95a82fade9968fdf691e09cb0e35eda0f0
usage
a8af3b1a01dbd1212b5809786932a9335045041dd51b06201092bd5a09bc0ac0

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

sample-f8ee1c2a0a47a13e · rebuildPassed71,284 tokens
Version 0.1 · commit 6a7862e39339 · timeout 900s · yoloSubmitted · execution Completed · 599.29 s
Independent goal ✓ PassedConfiguration Consistent · ledger attribution Complete

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

  1. 01Memorysuccess
  2. 02ListFilessuccess
  3. 03ReadFilesuccess
  4. 04WriteFilesuccess

Independent verification 9 assertions

  • ✓ Passedbaseline_fixture_matches
  • ✓ Passedworkspace_identity_unchanged
  • ✓ Passedsource_files_unchanged
  • ✓ Passedno_extra_paths
  • ✓ Passedno_unsafe_paths
  • ✓ Passedoutput_files_present
  • ✓ Passedoutput_csv_valid
  • ✓ Passedcurrent_goal_correct
  • ✓ Passedcontext_sources_unchanged

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

MetrictokensCoverage
Total input70,3294/4
Of which cached input57,0884/4
Uncached input13,2414/4
Output9554/4
Input + output71,2844/4

Model requests 4 · saved responses —
Preparation / continuation requests 0／4. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done
Source identity and evidence hashes
Run started
2026-10-16T19:35:42.187475+00:00
task
799bf9c2f530723425f13b8a2dfba71b2e6d6a1d8f1b94a2dbe1d85111aea1e1
binary
bc364195891e17ba7ee727ebca478b5d3d34a92260399a83f3dd36fffa271abf
Eval execution
baff234dcf66d441f5da4caad9cb31840b84f3d1ae3e02677dcce99fe182a5e9
cohort
9633647ffed0634c
model
{'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'provider_default'}
manifest
22f9d2ebba92c14c8b5dce4f35af8b0a52b06039dd13724a75e2f8c887aa11ec
result
2f97c109cb0e2f27444f44712b1bfe3fcc5a7ed3ee89e4e6246e50dbf2e7cb6f
run
c99528c5dd87273d50dce1bb9bf8eb841bf549bf5d7e6288a63bd50c6aa9474e
evidence
7d93ffa477fc7d78012b3288d10a8f412774f8c52cc13af50c1365770624e1e5
usage
962e17c8204b7913ca4e56b5df0d3a5326c51b9912a5fc3257c0b237ac733f95

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

Real App execution · Independent verification · Traceable usageHistorical evidence across multiple batches / Metric definitions and limits

Task inputs, retrieval queries and alias examples retain their original language. Downloads preserve the original evaluation data.