Extended generalization and improved safety with the System‐2 features of the Scientist AI

Abstract

Neural networks usually answer queries with a single forward pass—an analog of Kahneman's System 1. In unfamiliar or high‐stakes regimes, this can be brittle and overconfident. The Scientist AI framework augments a fast Predictor trained to approximate the Bayesian posterior with System 2 inference: structured probabilistic reasoning over intermediate natural‐language statements and causal hypotheses. The units that are generated and related via probabilistic dependencies are not the words or tokens but these Boolean statements about arbitrary properties of the world. Because inference‐time compute is spent only on the query at hand, marginalizing over latent statements can reduce computational uncertainty, produce better calibrated conditional probabilities and confidence intervals, and generate explanations as explicit argument graphs. With data transformed into these statements processed to make a syntactic difference between communication acts and factual hypotheses and the Predictor trained to be consequence‐invariant —insensitive to downstream effects of its outputs (Fornasiere et al., 2026)—this epistemic caution supports a safety case: the system is not imitating humans, has less incentive to acquire implicit goals, and is better suited as a guardrail for untrusted agents.