Topic

Constitutional AI

1 post about Constitutional AI. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Posts

Anthropic
Claude's constitution
Claude’s constitution describes how explicit principles can guide a language model’s behavior instead of relying on values implicitly determined through large-scale human feedback. The approach uses AI feedback in two training phases: the model first critiques and revises responses using the principles, then reinforcement learning selects the more harmless output using AI-generated evaluations. The post says Constitutional AI produced a Pareto improvement in tests, with the model responding more appropriately to adversarial inputs while remaining helpful and not evasive; harmlessness results came without human harmlessness data. The constitution draws on the UN Declaration of Human Rights, safety practices, other AI-lab principles, global platform guidelines, and attempts to include non-Western perspectives, while remaining an iterative, adjustable document.

The best engineering reads, once a week.

Topic

1 post about Constitutional AI. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Anthropic
Claude's constitution
Claude’s constitution describes how explicit principles can guide a language model’s behavior instead of relying on values implicitly determined through large-scale human feedback. The approach uses AI feedback in two training phases: the model first critiques and revises responses using the principles, then reinforcement learning selects the more harmless output using AI-generated evaluations. The post says Constitutional AI produced a Pareto improvement in tests, with the model responding more appropriately to adversarial inputs while remaining helpful and not evasive; harmlessness results came without human harmlessness data. The constitution draws on the UN Declaration of Human Rights, safety practices, other AI-lab principles, global platform guidelines, and attempts to include non-Western perspectives, while remaining an iterative, adjustable document.

The best engineering reads, once a week.