ANAN EVALUATION · EVIDENCE REPORT

mcp.github-stars

Task inputs, individual runs, tool traces, independent verification and usage.

Evidence snapshot · 2026-10-17

mcp.github-starsmcp · v0.1Strict passes 0/1 submitted · not submitted 0Unscored1 records＋

Capability: Tool discovery and task cost
Goal: Query stars; retain the historical unscored-answer semantics
Independent verification: Required-operation checks and ledger cost do not prove answer correctness

User task

我的github有多少star

Resources and protocol

mcp.github · cost-observation

Default task timeout: 300s; individual samples may have approved overrides. Counts include only matching task hashes. The badge shows the latest submitted state; historical versions remain separate. Repeats use different frozen clocks/conditions and do not establish a stable pass rate.

Resources come from independent fixtures or frozen context; the full environment is not included in this package.

sample-47d7b6bc7e868ddcUnscored≥ 61,486 tokens

Version 0.1 · commit ec6bb29448b2 · timeout 300s · yoloSubmitted · execution Completed · 52.77 s

Independent goal — Not determinedConfiguration Unknown · ledger attribution Unknown

Tool trace saved

Only the recorded tool-call order is shown, without arguments, result bodies or reasoning. This is not a full reasoning trace.

01tool_searchsuccess
02tool_searchsuccess
03tool_searchsuccess
04tool_searchsuccess
05tool_searchsuccess
06tool_describesuccess
07tool_callsuccess
08tool_describesuccess
09tool_callsuccess
10tool_callsuccess

Independent verification 2 assertions

✓ Passedgithub.identity.read
✓ Passedgithub.repositories.read

Usage Request ledger

Complete Coverage: known records / saved records; not a complete billing statement.

Metric	tokens	Coverage
Total input	59,021	8/8
Of which cached input	51,712	8/8
Uncached input	7,309	8/8
Output	2,465	8/8
Input + output	61,486	8/8

Model requests 8 · saved responses —
Preparation / continuation requests —／—. Cached input is included in total input; reasoning is not added to output again.

Resource cleanup Done App reset Done Simulator reset Done Shutdown Done

Source identity and evidence hashes

Run started: 2026-10-12T12:16:45.606866+00:00
task: e1809b67b03f3c7445f4c84b8148ee3089fdb3926127278377a7c4a41983fc07
binary: 2296cead77ac77274cff68e9234f903a3af4cee768d2b97d8b42f16928dc72c9
Eval execution: None
cohort: None
model: {'provider': 'DeepSeek', 'model': 'deepseek-flash', 'thinking': 'not_recorded'}
manifest: 91ff65c3431a28f93319bfd40ef72be90f5388f8df37e96bc21f214c90e2fa17
result: 681dbd9120f63b4b51daaf152024d5065226694822d1cf44077f3f21a913a92e
run: 4e3bf98994eba480e7cd5271f2ed6d66f14d69fc862b15d466aa7758d7bff825
evidence: 1161b88ccd0a69f76b137ff67fab281fc09f929e2290736ecb4b6b62985679be
usage: 42af506d0d8a8aacd50b0b1596e73c2d342e6e1919b6a678c4cb55419d6a4088

Hashes identify private source materials. Raw Sessions are not included; hashes alone cannot reproduce business scoring.

Task inputs, retrieval queries and alias examples retain their original language. Downloads preserve the original evaluation data.