Wolfram Data Repository
Immediate Computable Access to Curated Contributed Data
Results from the Wolfram LLM Benchmarking Project
Obtain the benchmark data:
In[1]:= | ![]() |
Out[1]= | ![]() |
Display a bar chart with the top 10 models:
In[2]:= | ![]() |
Out[2]= | ![]() |
Get the top three models by code generation correctness:
In[3]:= | ![]() |
Out[3]= | ![]() |
Select all models from Meta:
In[4]:= | ![]() |
Out[4]= | ![]() |
Select the top model for each vendor:
In[5]:= | ![]() |
Out[5]= | ![]() |
Sort the vendors by their average model score on generating valid Wolfram Language syntax:
In[6]:= | ![]() |
Out[6]= | ![]() |
Wolfram Research, "LLMBenchmarks Data" from the Wolfram Data Repository (2024)