Scorecards
A Scorecard is a set of rules evaluated on a scope of catalog items, used to express the overall compliance posture of that scope. Where a single Rule answers a single yes/no question, a scorecard rolls many rules together into one comprehensive view: for example a "Production-readiness" scorecard, a "Security baseline" scorecard, or an "Observability" scorecard.
Concepts
- Scope. The set of catalog items the scorecard applies to. The scope is either a reference to a View or a raw query over the catalog (see Query Language).
- Levels. A scorecard is organized into named, ordered levels (for example Bronze → Silver → Gold). Each level groups a subset of the scorecard's rules.
- Rules. The list of rules whose results contribute to the scorecard. Each rule is normally assigned to one level and is evaluated independently per item; a rule left without a level is still evaluated but never contributes to any level's outcome. A rule can also be skipped for a given item (for example, when the item's type falls outside the rule's target item types) — a skip never counts against the item, but a level needs at least one actually-executed rule to be achievable.
- Achieved level. The result of a scorecard evaluation for a single item is the highest level whose rules are all satisfied by that item. An item that does not satisfy every rule of the lowest level has no achieved level (it is reported as "without level").
Score and progress
When a scorecard is evaluated, every item in scope gets:
- a per-rule pass/fail result,
- an achieved level computed from those results.
From the per-item achieved level the catalog derives two aggregate indicators that are surfaced on the scorecard and on the Catalog App:
- Median level. The median achieved level across all items in scope. It summarizes "where most of the fleet sits" without being skewed by a handful of outliers.
- Progress. The percentage of items in scope that have achieved at least the lowest level of the scorecard (i.e. items that have a level at all). Progress is the simplest reading of "how many things in scope are compliant enough to be on the ladder".
The Catalog App also surfaces the count of items without level — those that fail at least one rule of the lowest level — which is the natural starting point for remediation work.
Where scorecards live
Scorecards are catalog items governed by an Item Type Definition under the compliance.mia-platform.eu group. As catalog items they:
- can be created, listed, fetched, updated, and deleted via the Catalog API,
- can carry labels and annotations,
- can be related to the items they target via the catalog's relationship system,
- are versioned through
resourceVersionlike any other object.
How a scorecard is evaluated
A scorecard refresh is, internally, a fan-out of rule evaluations:
- The scorecard's scope is resolved into a concrete list of items.
- For each rule in the scorecard, a rule evaluation is triggered against that list (the same flow described in Evaluation Criteria).
- The raw, per-item, per-rule results (pass, fail, or skipped) are recorded on a new
ScorecardEvaluationitem — a separate catalog kind that references the scorecard viascorecardRef, the same way aRule-runreferences its rule. - The achieved level for each item, the median level, and the progress percentage are not stored anywhere: they are computed on the fly from the latest
ScorecardEvaluation's raw results, every time the scorecard is viewed.
Because every individual evaluation produces both a Rule-run item and a ScorecardEvaluation item, scorecards retain a full audit trail: you can drill from a computed score down to the rule, the items that failed it, and the moment the evaluation happened.
Scorecards vs. Campaigns
Scorecards and Campaigns both bundle multiple rules, but they answer different questions:
| Aspect | Scorecard | Campaign |
|---|---|---|
| Purpose | Continuously summarize compliance posture of a scope | Drive a time-bounded compliance program toward a deadline |
| Time dimension | Standing, refreshed on demand or on schedule | Has startTime and endTime |
| Notifications | Not the primary mechanism | Sends notifications to followers at start and end |
| Output | An aggregate score over rules and items | Per-item compliance status with deadline-driven follow-up |
In practice, the two are complementary: a campaign can use a scorecard's rule set to define what "compliant" means, while a scorecard surfaces the long-term health of the same scope.
See also
- Evaluation Criteria: the rule model and evaluation flow scorecards build on.
- Campaigns: time-bounded compliance programs.
- Catalog App: where scorecard scores are visualized.