Multi-Agent System Ontology

Definition of a metric: what is measured, by whom, and over what range of values. Not an observation itself — see mas:MetricResult for that.

One computed observation of a Metric for one resource at one point in time. Distinct from mas:Metric (the definition being computed): a MetricResult is to a Metric what an mas:LLMCall is to an mas:LLM.

Completion (output) tokens produced by the LLM calls that computed this observation, summed over every call the metric made.
Domain: MetricResult
Range: integer

Estimated monetary cost in US dollars of the LLM calls that computed this observation, derived from the token counts and the evaluation model's list price at computation time. An estimate, not a billed amount.
Domain: MetricResult
Range: double

Identifier of the LLM that judged this observation (the evaluation model), when the metric is computed with an LLM. Absent for deterministic metrics.
Domain: MetricResult
Range: string

Prompt (input) tokens consumed by the LLM calls that computed this observation, summed over every call the metric made. Absent when the metric makes no LLM call.
Domain: MetricResult
Range: integer

Total tokens (prompt plus completion) consumed computing this observation.
Domain: MetricResult
Range: integer

Metric result measures an execution element, or a Cognition protocol execution report (the protocol's evaluation metrics).
Domain: MetricResult
Range: nff71cda8c18f4b5b8a4b427bb1a7b27cb2

System or method that computes this metric. Example: 'ragas', 'deepeval', 'mce', 'custom-rule'.
Domain: Metric
Range: string

MetricResult is a computed observation of this Metric definition.
Domain: MetricResult
Range: Metric

Logical reasoning/justification behind a metric evaluation, or the explanation of a cognitive failure detection: what in the trace matches the failure. A single property shared by both, so its shape is defined once.
Domain: nff71cda8c18f4b5b8a4b427bb1a7b27cb5
Range: string

Numeric value of the metric observation (raw measurement). Unit and possible range are documented on the associated Metric (see mas:unit, mas:valueRange). Example: Latency_obs_001 mas:result 1250.5 (ms), TokenCount_obs_002 mas:result 450 (tokens).
Domain: MetricResult
Range: double

When this observation was computed. Used to order a metric's results over time.
Domain: MetricResult
Range: dateTime

Measurement unit for metric value. Documents interpretation. Example: 'ms' (milliseconds), 'tokens', 'calls/sec', 'dimensionless' (for normalized scores).
Domain: Metric
Range: string

Description of the metric's possible values. Example: '0.0-1.0', '0-100', '{pass, fail}', 'non-negative integer'.
Domain: Metric
Range: string