SYSTEMS ARCHITECTURE BLUEPRINT · XKCD-BENCH V1
Two-Track Multimodal Evaluation & Hybrid Retrieval Topology
How 891 cross-joined Hugging Face comics flow through blind multimodal inference, TypeSafe System One (Noul) + deterministic reference grading, and tri-modal Reciprocal Rank Fusion.
XKCD-Bench Two-Track Evaluation and Retrieval Architecture
Architecture diagram showing 891 Hugging Face XKCD comics feeding Track 1 blind multimodal LLM evaluation judged by a hybrid TypeSafe Noul and ExplainXKCD rubric, and Track 2 reverse comic search powered by BM25F, 64-bit dHash, and TypeSafe Jev reranking.
01 · CORPUS & BLIND INPUTS
02 · EVALUATION & RETRIEVAL CORE
03 · TELEMETRY & WORKSPACES
PNG + ALT
EXPLAIN REF
30 QUERIES
4 PILLARS
HIT@1 · MRR
BLIND INPUT
Raw Strip + Hover Text
20 Canonical Comics · No Spoilers
HF CORPUS
891 Cross-Joined Strips
ExplainXKCD × AltTitle Topics
SEARCH EVAL
30 Retrieval Queries
Memory · Concept · PNG Upload
VISION + TEXT GEN
16 Frontier Multimodal & Reasoning Models
Argon · Fable 5.1 · Opus 5.5 · Nemotron 3.5 VL · Gemma 4
HYBRID JUDGE CORE
40% TypeSafe Noul + 60% Deterministic Rubric
Humor 30% · Domain 30% · Visual 25% · Alt 15% · Stem Recall
TRI-MODAL SEARCH
BM25F Lexical + 64-Bit dHash + TypeSafe Jev
Field-Weighted Index · Hamming Similarity · Zero-Shot LLM
STATE STORE
Live Eval Telemetry
live_eval_results.json · 320 Runs
TRACK 1 VIEW
Leaderboards & Arena
6 Domains · SVG Medals · Matrix
TRACK 2 VIEW
Reverse Search Lab
100% Hit@1 · Live 30-Query Sweep
LEGEND
Synchronous Eval / Search Pipeline
Focal Hybrid Rubric Judge (Noul + Deterministic)
Telemetry Persistence & Hydration