{"dataset_id":"ai-benchmark-public","dataset_version":"0.2.1","schema_version":"1.2.0","methodology_version":"1.1.0","hardware_rules_version":"memory-fit-1.0.0","generated_at":"2026-09-06T03:20:26.887339+00:00","source_cutoff_at":"2026-09-06T03:20:26.887339+00:00","eligible_model_count":5,"record_count":650,"published_record_count":650,"source_count":26,"provenance_coverage":1,"artifact_hashes":{"models.json":"6a3b11eea7961854076c1e176d190bd2f140ab065dbedf6a8f4ee93b56d5997a","hardware.json":"6bc93da3ae8e1fc4fd280da603487b425b98a56b13bfa16f00eee0a130eca732","sources.json":"d5f2098f36a766119535a8931085cf8bd486bdbc947b270965a8557ce343f34a","methodology.json":"529fd39f6804eb62763447ca45675577c39878728ed6c7c0df1e808e2b6e102a"},"source_registry_hash":"d5f2098f36a766119535a8931085cf8bd486bdbc947b270965a8557ce343f34a","model_version_count":624,"configuration_count":26,"count_unit":"model/version records and explicit model configurations; excludes provider duplicates and rolling aliases","data_license_reference":"/data/sources.json","known_limitations":["The comparison catalog currently contains four exact GPT-4o snapshots and one explicitly verified o3 high-effort configuration with complete mandatory evidence. IQ is derived from three historical tests published by one model developer; it is not a comprehensive or current frontier ranking.","The public catalog includes independently sourced model/version records; it is not a completed one-to-one re-source of every historical snapshot configuration.","API prices are dated curated observations, not live quotes. Some provider-only aliases remain unresolved and excluded.","Local memory assessment is available only for eight verified Qwen artifacts; other open-weight models are UNASSESSED.","Aider configurations and observation dates differ. Throughput and first-token latency have not been independently measured.","GGUF sizes are published rounded values with a 1% estimate allowance; actual runtime allocations may differ."],"build_commit":"e87785c0fe6438ffa12d0fcee0a3f787f4db9b74"}