Evaluation

Evaluation methods

2 methods

Every result on the platform names the evaluation method and version that produced it, and a method version is reviewed before its results are published. Each method declares what it defends against, who gets to observe what, and the limits a submission must run within. The conformance specification calls these methods routes; the two words mean the same thing here.

  • OCI predictions scoring (reference)

    Predictions file scored on the platform.

    Provider
    Reference implementation
    Latest version
    1.0.0provisional. Provisional: the evaluation method that produced this result has not yet passed review, so it is excluded from published reporting.
    oci-predictions-scoring1 version
  • OCI sealed execution (reference)

    Sealed container run next to the data.

    Provider
    Reference implementation
    Latest version
    1.0.0provisional. Provisional: the evaluation method that produced this result has not yet passed review, so it is excluded from published reporting.
    oci-sealed-execution1 version