TechiSeek

VendorsFor Vendors

Evaluating Causal Reasoning in LLMs: A Case Study in the Challenges of Procedural Generation

arXiv cs.AI

Evaluating Causal Reasoning in LLMs: A Case Study in the Challenges of Procedural Generation

The study asks what can be reliably inferred when LLMs score well on CLadder, a 2023 framework for procedurally generating formal causal-reasoning benchmarks.

Methodology

  • Examine what can be reliably inferred when LLMs perform well on test sets produced by CLadder.

Key findings

  • Several examples of superficial and highly predictive patterns are embedded by the CLadder generator in the data sets it generates.
  • Even simple models such as random forests perform well on CLadder-generated data sets after training on a sample of generated data.
  • The performance of many commercial LLMs on CLadder test sets is extremely brittle.

Key findings

  • Experiments with CLadder appear to indicate LLMs can perform formal causal reasoning in a large percentage of generated examples.
Read More