Decide whether an Article 50 provenance marking survives a transform.
Statutory anchor
EU AI Act Art 50 marking + C2PA Specification 2.4
How it is graded
Deterministically. A regex extracts the label, scored by macro-F1 — no model judges another
model. A response with no readable label is reported as UNMEASURED and is
excluded from the denominator; it is never scored as a wrong answer. That distinction separates
"the model was wrong" from "the model never answered", and it is enforced in the harness code, not
just claimed in prose.
What may be quoted
This axis is measured. n = 15 frozen items — which is below usable_n = 30, so no confidence interval is published on it, including by us. Report the n with any figure you quote.
The same 15 items sov34 answered, graded by the same
deterministic rule. sov34 scored 0.273 macro-F1 on these.
No sign-up, nothing leaves your browser.
Items: csoai/gspc-prv ·
grading is a regex label read plus macro-F1, identical to the published harness ·
measurement, not certification, and not legal advice.