ANAN EVALUATION · EVIDENCE REPORT

mcp.github-owned-public-stars

Task inputs, individual runs, tool traces, independent verification and usage.

Evidence snapshot ·

mcp.github-owned-public-starsmcp · v0.2Strict passes 0/1 submitted · not submitted 0Unscored1 records＋

Capability: Scoped external-answer verification
Goal: Verify a scoped query; leave unscored when an independent reference is unavailable
Independent verification: Independent GitHub API, complete pagination and temporal checks; saved TLS failure is not a verified answer pass

User task

请统计当前 GitHub 账号本人拥有的公开、非 fork 仓库收到的 star 总数。不要计入私有仓库、fork、所属组织的仓库或我收藏的别人的仓库。请告诉我 star 总数。

Resources and protocol

mcp.github · answer-verification

Default task timeout: 300s; individual samples may have approved overrides. Counts include only matching task hashes. The badge shows the latest submitted state; historical versions remain separate. Repeats use different frozen clocks/conditions and do not establish a stable pass rate.

  • Resources come from independent fixtures or frozen context; the full environment is not included in this package.
sample-bd7ed052338cf1caUnscored≥ 99,454 tokens
Version 0.2 · commit ec6bb29448b2 · timeout 300s · yoloSubmitted · execution Completed · 56.98 s
Independent goal — Not determinedConfiguration Unknown · ledger attribution Unknown

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

  1. 01tool_searchsuccess
  2. 02Memorysuccess
  3. 03tool_searchsuccess
  4. 04tool_searchsuccess
  5. 05tool_describesuccess
  6. 06tool_describesuccess
  7. 07tool_callsuccess
  8. 08tool_callsuccess
  9. 09tool_callsuccess
  10. 10tool_callsuccess
  11. 11tool_callsuccess
  12. 12Memorysuccess

Independent verification 2 assertions

  • ✓ Passedgithub.identity.read
  • ✓ Passedgithub.repositories.read

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

MetrictokensCoverage
Total input97,2289/9
Of which cached input82,8169/9
Uncached input14,4129/9
Output2,2269/9
Input + output99,4549/9

Model requests 9 · saved responses —
Preparation / continuation requests —／—. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done
Source identity and evidence hashes
Run started
2026-10-12T12:22:07.467187+00:00
task
81aab02b4a66eac8bdc9ab4605e6aba5d82c8a7525a5be973ca355d96f98df0f
binary
2296cead77ac77274cff68e9234f903a3af4cee768d2b97d8b42f16928dc72c9
Eval execution
None
cohort
None
model
{'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'not_recorded'}
manifest
00c5c1adeb598a0c79b330632c5f2ffcc136528bf99556096e3a464e5fec15bd
result
fc63a2ffafa060d2a2a0b747104b19667ff3ea5e2877b6d0fb7bcfa9459f7314
run
77713e22d4bf08d2bb4593d09c88253e17b4e00cc97e87c14047be836e402e41
evidence
0c28ae50594c860cbf27e55c74a07bb5f6d2433a07386dcaeccfef70dba99db0
usage
6669cd708504cc6091480bc523c7d3864fbb96bf05900be2982f10ec80a92e7f

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

Real App execution · Independent verification · Traceable usageHistorical evidence across multiple batches / Metric definitions and limits

Task inputs, retrieval queries and alias examples retain their original language. Downloads preserve the original evaluation data.