Bounded substrate comparison

Benchmark performance and biological plausibility

How should task utility and resemblance to biological mechanisms coexist?

Evidence status

Cites 1 source, none of which has been read

The source is named, but it has been retrieved and read as part of building this page. Nothing here has been matched to a passage, so the citations show where a reader might look rather than what was checked.

Rely on this page for

Orientation: how the topic is organised, which terms matter, and where to start reading.

Do not rely on it for

A claim you intend to act on or repeat. Follow the cited material yourself first.

engineered evaluation

Task performance

Valid claim: Meets this metric on this benchmark.

model-to-biology comparison

Biological plausibility

Valid claim: Matches these selected biological observations under this test.

Comparable axes

  • Declared model
  • Observed outputs
  • Uncertainty and alternatives

Non-equivalences

  • High accuracy does not imply brain likeness.
  • Biological resemblance does not imply engineering utility.

Comparison procedure

  1. 1.Score task independently.
  2. 2.Test biological predictions independently.
  3. 3.Publish a two-axis result.

Prohibited inference

Do not collapse benchmark rank and biological plausibility into one intelligence score or use success on either axis to certify the other.

Connected concepts and sources

  1. NeuroBench: Advancing Neuromorphic Computing Through Collaborative, Fair and Representative Benchmarking · National Institute of Standards and Technology

Direct answer

  • How should task utility and resemblance to biological mechanisms coexist?

Mechanism and method

  • Score task independently.
  • Test biological predictions independently.
  • Publish a two-axis result.

What is measured

  • Declared model
  • Observed outputs
  • Uncertainty and alternatives

Comparison: Benchmark performance and biological plausibility

  • High accuracy does not imply brain likeness.
  • Biological resemblance does not imply engineering utility.
  • Must not be read as: Do not collapse benchmark rank and biological plausibility into one intelligence score or use success on either axis to certify the other.

Limitations

  • High accuracy does not imply brain likeness.
  • Biological resemblance does not imply engineering utility.

What this does not establish

  • Do not collapse benchmark rank and biological plausibility into one intelligence score or use success on either axis to certify the other.

Related records