Skip to content

Get Benchmark Run

GET
/api/etherforce/benchmark/run/{run_id}

Full run detail including per-fixture results + diffs.

run_id
required
Run Id
string

Successful Response

BenchmarkRunDetail
object
summary
required
BenchmarkRunSummary
object
id
required
Id
string
startedAt
required
Startedat
string format: date-time
completedAt
required
Any of:
string format: date-time
handlerId
required
Handlerid
string
revision
required
Revision
string
fixtureSetTag
required
Any of:
string
overallScore
required
Overallscore
number
totalFixtures
required
Totalfixtures
integer
passedFixtures
required
Passedfixtures
integer
failedFixtures
required
Failedfixtures
integer
status
required
BenchmarkRunStatus

Lifecycle of a single benchmark run.

string
Allowed values: pending running completed errored
notes
required
Notes
string
fixtureResults
required
Fixtureresults
Array<object>
BenchmarkFixtureResultItem
object
id
required
Id
string
fixtureId
required
Fixtureid
string
handlerId
required
Handlerid
string
baselineEngineVersion
required
Any of:
string
candidateEngineVersion
required
Candidateengineversion
string
diff
required
Any of:
BenchmarkDiffModel
object
findingsMatchRate
required
Findingsmatchrate
number
findingsAdded
required
Findingsadded
Array<object>
object
key
additional properties
any
findingsRemoved
required
Findingsremoved
Array<object>
object
key
additional properties
any
itemsMatchRate
required
Itemsmatchrate
number
itemsAdded
required
Itemsadded
Array<object>
object
key
additional properties
any
itemsRemoved
required
Itemsremoved
Array<object>
object
key
additional properties
any
appliedParametersDiff
required
BenchmarkAppliedParametersDiffModel
object
keysAdded
required
Keysadded
Array<string>
keysRemoved
required
Keysremoved
Array<string>
valuesChanged
required
Valueschanged
object
key
additional properties
Array
latencyDeltaMs
required
Latencydeltams
number
baselineDurationMs
required
Baselinedurationms
number
cacheHitChanged
required
Cachehitchanged
boolean
summaryChanged
required
Summarychanged
boolean
summaryLevenshteinRatio
required
Summarylevenshteinratio
number
engineVersionChanged
required
Engineversionchanged
boolean
baselineEngineVersion
required
Baselineengineversion
string
candidateEngineVersion
required
Candidateengineversion
string
score
required
Score
number
status
required
BenchmarkFixtureStatus

Per-fixture verdict inside a run.

string
Allowed values: passed regressed improved error
errorText
required
Any of:
string

Validation Error

HTTPValidationError
object
detail
Detail
Array<object>
ValidationError
object
loc
required
Location
Array
msg
required
Message
string
type
required
Error Type
string
input
Input
ctx
Context
object