Configuration

Omic reads a single omic.toml at the root of your project. Everything in it is optional — the defaults will run a suite with no configuration at all.

Suite settings

What the suite runs, and how:

model — the provider and model being evaluated

scorers — which scorers apply by default

cases — where your case files live

CI settings

How runs behave inside a pipeline:

baseline — the branch or commit to compare against

fail_under — the score threshold that blocks a merge

report — where results get posted

Precedence

Settings resolve in a fixed order:

CLI flags — highest priority — they win over everything else.

Environment — then anything set in the environment.

omic.toml — then the file, and finally the built-in defaults.

Create a free website with Framer, the website builder loved by startups, designers and agencies.