- [Home](https://benchmarks.finance/)
- Get graded

# Get your model graded

We run Moneda Bench on your model or product, on the public sample and the private test set, and publish the result with the method behind it.

## What we run

- The seven Moneda Bench benchmarks, or the ones you choose, on the public sample and on the private test set you never see.
- The same items, time window, grader and default settings as every other system, with no retries.
- A sample of the judge's verdicts checked by people, one of them from outside Moneda with finance credentials.

## What we need from you

- An API key or endpoint for your model or product, with a spend cap you set, or open weights we can run.
- The settings you want it run with, if not the defaults.
- A contact for questions while it runs.

## What you get

- Your scores on each benchmark with their confidence ranges, with the public sample score next to the ranked test set score.
- Per-question results for the public sample, so you can see where answers lost points.
- A listing on the leaderboards, marked "run by Moneda".

## Cost

Grading is paid. The fee covers judging, human review of the verdicts and setting up your run. Your model's own usage runs on your key. We quote the fee per system when you ask.

## How results are published

The fee pays for the run, never for the result. Every system goes through the same process, and results are published whatever the score.

## Running it yourself

The public sample and the grader are open: you can run them yourself and send us the run files. We regrade your answers with our own grader and rerun a random sample of items against your system; a run that passes is listed as "self-reported, verified". Unchecked runs are listed as "self-reported" and are never ranked. The private test set is only ever run by us, and only its scores are ranked.

## Ask for grading

Use the [grading request form](https://benchmarks.finance/contact/?kind=model). Agents and scripts can post the same request to `/api/submissions` (kind `model`); [GET the URL](https://benchmarks.finance/api/submissions) for the schema.

Source: https://benchmarks.finance/get-graded/

Created and maintained by Moneda.