Installation¶

llm-gateway-bench requires Python 3.9+.

Install from PyPI (pip)¶

pip install llm-gateway-bench

Upgrade:

pip install -U llm-gateway-bench

Verify:

lgb --help
lgb providers

Install with pipx (recommended for CLIs)¶

pipx installs lgb into an isolated environment.

pipx install llm-gateway-bench
pipx run llm-gateway-bench --help

Upgrade:

pipx upgrade llm-gateway-bench

Install with uv¶

If you use uv:

uv tool install llm-gateway-bench
lgb --help

Or install into a project environment:

uv venv
uv pip install llm-gateway-bench

Install with conda¶

If you prefer conda environments, install from PyPI inside conda:

conda create -n lgb python=3.11 -y
conda activate lgb
python -m pip install llm-gateway-bench

Install from source¶

git clone https://github.com/mnbplus/llm-gateway-bench
cd llm-gateway-bench

# Editable install
python -m pip install -e .

# (Optional) dev tooling
python -m pip install -e ".[dev]"

Environment variables (.env)¶

This project loads .env automatically at runtime.

Create a .env file (do not commit it):

OPENAI_API_KEY=...
ANTHROPIC_API_KEY=...

See Providers for the full list of keys.

Troubleshooting¶

If lgb is not found after install, ensure your Python scripts directory is on PATH.
On Windows, prefer pipx or uv tool to avoid PATH confusion.
If mkdocs build fails with GitPython and you use a portable Git install, set GIT_PYTHON_GIT_EXECUTABLE to the full path of git.exe.