Skip to content

IEFS004: registry

The evaluation is registered so inspect eval can find its tasks.

Category: file_structure ยท Applies to: eval

What it does

With registry = "entry-points" (the template layout) the package or its module must appear under [project.entry-points.inspect_ai] in pyproject.toml. With registry = "module" (the inspect_evals monorepo) the registry module must import it. registry = "none" skips the rule.

Why is this bad?

An unregistered evaluation runs from a file path in development and then cannot be found by name anywhere else.

Example

[project.entry-points.inspect_ai]
my_eval = "my_eval"

Options

  • registry
  • registry-module

Suppress on a line with # inspect-evals-lint: ignore[IEFS004] or ignore[registry]; select or ignore it in configuration by either, or by the prefix IEFS.