How To Read This Leaderboard

Each row is a model and corpus-slice result pair. Lower scores are better.

Model Ranking Across Slices

ProfileModelScoreHard FailsLatency (ms)Run
bible_old_testamentxai/grok-3-mini0.32138133.43open run
bible_author_solomonopenai/gpt-4.1-mini0.39331786.24open run
bible_new_testamentxai/grok-3-mini0.39338958.78open run
bible_author_augustinexai/grok-3-mini0.42946522.94open run
bible_old_testamentanthropic/claude-3-haiku-202403070.50041336.46open run
bible_old_testamentanthropic/claude-3-haiku-202403070.50041649.22open run
bible_author_solomonopenai/gpt-4.1-mini0.50042015.91open run
bible_author_augustineopenai/gpt-4.1-mini0.60751278.75open run
bible_new_testamentanthropic/claude-3-haiku-202403070.60751535.31open run
bible_new_testamentanthropic/claude-3-haiku-202403070.60751859.32open run
bible_author_augustineanthropic/claude-sonnet-4-60.75077608.67open run
bible_plus_fathersvertex_flash0.8400940.00open run
bible_author_paulllama3.2:latest1.00001722.72open run
bible_plus_fatherslocal_llama31_8b1.36011820.00open run
bible_section_minor_prophetsopenai/gpt-4.1-mini1.5001693.94open run
bible_section_revelationopenai/gpt-4.1-mini1.5001762.33open run
bible_section_actsopenai/gpt-4.1-mini1.50011528.94open run
bible_apocryphallama3.2:latest1.50011535.24open run
bible_section_epistlesopenai/gpt-4.1-mini1.50011792.65open run
bible_section_gospelsllama3.2:latest1.50012114.65open run
bible_old_testamentxai/grok-3-mini2.143207510.45open run
bible_section_lawopenai/gpt-4.1-mini2.5001616.97open run
bible_section_historyopenai/gpt-4.1-mini2.5001749.89open run
bible_section_gospelsopenai/gpt-4.1-mini2.5001797.93open run
bible_section_wisdomopenai/gpt-4.1-mini2.50011216.87open run
bible_section_apocryphaopenai/gpt-4.1-mini2.50011299.42open run
bible_new_testamentllama3.2:latest2.50011421.12open run
bible_section_major_prophetsopenai/gpt-4.1-mini2.50011437.43open run
bible_new_testamentmistral:latest2.50011728.04open run
bible_author_augustineopenai/gpt-4.1-mini2.50011810.65open run
bible_new_testamentllama3.2:latest2.50011970.61open run
bible_apocryphamistral:latest2.50012238.46open run
bible_old_testamentllama3.2:latest2.50012295.19open run
bible_old_testamentmistral:latest2.50012555.77open run
bible_old_testamentllama3.2:latest2.50012565.18open run
bible_old_testamentllama3.2:latest2.50013253.45open run
bible_new_testamentllama3.2:latest2.50013422.48open run
bible_new_testamentmistral:latest2.50014045.37open run
bible_new_testamentllama3.2:latest2.50014268.63open run
bible_new_testamentxai/grok-3-mini2.679257816.48open run
bible_author_augustineanthropic/claude-sonnet-4-63.00012976.26open run
bible_author_augustinexai/grok-3-mini3.00014071.51open run