Getting Started

How to get started with Live Codebench

1

Clone the Repository

Run `git clone https://github.com/LiveCodeBench/LiveCodeBench.git` and navigate into the directory with `cd LiveCodeBench`.

2

Install Dependencies

Install required dependencies using the `uv` command to verify installation.

3

Download Dataset Release

Download a dataset release such as `release_v6` which contains 1055 problems.

4

Run Evaluations

Use provided scripts to run evaluations on supported LLMs for scenarios like code generation.

5

View Leaderboard

Submit results and view the leaderboard on the official website to compare model performance.