Coding agent evals
AI & ML interests
None defined yet.
Recent Activity
A suite of recall-intensive tasks for evaluating sub-quadratic models
Linearizing LLMs with high quality and efficiency. We linearize the full Llama 3.1 model family -- 8b, 70b, 405b -- for the first time!
Models and Datasets for M2-BERT and LoCoV1
-
hazyresearch/qleylmcf
Viewer • Updated • 128 • 22 • 1 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-0
Viewer • Updated • 65.5k • 50 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-1
Viewer • Updated • 65.5k • 22 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-2
Viewer • Updated • 65.5k • 35
The models and datasets for Weaver: Shrinking the Generation-Verification Gap with Weak Verifiers
-
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_MMLU-Pro
Text Classification • Updated • 4 • 1 -
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_GPQA
Text Classification • Updated -
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_MATH500
Text Classification • Updated • 1 -
hazyresearch/MATH500_with_Llama_3.1_70B_Instruct_v1
Viewer • Updated • 500 • 64
These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes.
Here we provide models and benchmarks for the Just Read Twice work: https://arxiv.org/abs/2407.05483
Coding agent evals
-
hazyresearch/qleylmcf
Viewer • Updated • 128 • 22 • 1 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-0
Viewer • Updated • 65.5k • 50 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-1
Viewer • Updated • 65.5k • 22 -
hazyresearch/m07d11_longhealth_synthesize_llama-3.2-3b_p10_n65536-2
Viewer • Updated • 65.5k • 35
The models and datasets for Weaver: Shrinking the Generation-Verification Gap with Weak Verifiers
-
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_MMLU-Pro
Text Classification • Updated • 4 • 1 -
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_GPQA
Text Classification • Updated -
hazyresearch/Weaver_Distilled_ModernBERT_Large_for_MATH500
Text Classification • Updated • 1 -
hazyresearch/MATH500_with_Llama_3.1_70B_Instruct_v1
Viewer • Updated • 500 • 64
A suite of recall-intensive tasks for evaluating sub-quadratic models
Linearizing LLMs with high quality and efficiency. We linearize the full Llama 3.1 model family -- 8b, 70b, 405b -- for the first time!
These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes.
Models and Datasets for M2-BERT and LoCoV1
Here we provide models and benchmarks for the Just Read Twice work: https://arxiv.org/abs/2407.05483