☕︎ JavaBench Leaderboard ☕️

A Benchmark of Object-Oriented Code Generation for Evaluating Large Language Models

github arxiv github
# Model Completion Compilation Pass
# Model Compilation Pass

📝 Submission

Thank you for your interest in JavaBench. We warmly welcome researchers to submit additional benchmarking results, as we believe that collaborative efforts can significantly advance the study of Large Language Models and software engineering. For submission guidelines, please refer to our Github Repo.

🤗 Acknowledgement

Thanks for the EvalPlus for sharing the leaderboard template. In addition to JavaBench leaderboards, it is recommended to comprehensively understand LLM coding ability through a diverse set of benchmarks and leaderboards, such as:
  1. EvalPlus Leaderboard
  2. Big Code Models Leaderboard
  3. Chatbot Arena Leaderboard
  4. CrossCodeEval
  5. ClassEval
  6. CRUXEval
  7. Code Lingua
  8. Evo-Eval
  9. HumanEval.jl - Julia version HumanEval with EvalPlus test cases
  10. InfiCoder-Eval
  11. LiveCodeBench
  12. NaturalCodeBench
  13. RepoBench
  14. SWE-bench
  15. TabbyML Leaderboard
  16. CruxEval-X
  17. DomainEval