Loading…
Anthropic
AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
- 182 posts summarised
- latest
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
From their blog
Latest articles
Inviting hard questions
Anthropic is inviting the public to submit difficult questions about AI’s effects on jobs, society, families, science, medicine, and the future. The initiative responds to both optimism about AI’s potential and concerns about job loss, creative work, human agency, misuse, and whether benefits outweigh costs. Anthropic says its Public Benefit Corporation mission is to secure the benefits of advanced AI models and mitigate risks through safeguards, alignment research, free access for scientists, and a fellowship pairing early-career Claude users with nonprofits. It has gathered views through surveys of 52,000 Americans and 81,000 Claude users in 159 countries and 70 languages, plus focus groups and anonymized usage data, and will publicly track actions and shortcomings in addressing submitted questions. The Anthropic Institute and Long-Term Benefit Trust are also described as mechanisms for confronting societal challenges and providing oversight.
A new way to reflect on how you use Claude
The beta reflection feature helps Claude users review and refine their use of the assistant by tracking and visualizing activity over one, three, six, or twelve months. A dashboard summarizes key topics, usage patterns, frequent tasks, and when Claude is used, while periodically prompting users to consider what they should keep doing themselves; a future view will show time spent. It also assesses activity through the 4D AI Fluency Framework—Delegation, Description, Discernment, and Diligence—and can suggest practices such as using a Project for ongoing context, alongside quiet hours and break nudges. Available on Claude for web and the desktop app to Free, Pro, and Max users with memory enabled, the beta excludes incognito chats, connected-tool source files, and conversations tied to health integrations, with sensitive conversations represented only at a high level.
Ben Bernanke appointed to Anthropic’s Long-Term Benefit Trust
Anthropic’s Long-Term Benefit Trust (LTBT) appointed Dr. Ben Bernanke, former Federal Reserve Chair and Brookings Institution Distinguished Fellow, as its newest member. The independent body helps hold Anthropic to its mission of responsibly developing advanced AI for humanity’s long-term benefit, and its Trustees advise the board and leadership on critical decisions involving AI’s risks and societal impacts. Bernanke brings research and policy experience spanning the Great Depression, financial crises, and his 2006–2014 Federal Reserve tenure; he will contribute to Anthropic’s economic research, including work on how AI changes economies and workforces. The LTBT can appoint members to Anthropic’s board, while its Trustees hold no company equity or profit share and are compensated only for their service.
Progress from our Frontier Red Team
Anthropic’s Frontier Red Team reports on national-security risks from frontier AI models, drawing on work across four releases over the past year. It finds early-warning signs of rapid progress in dual-use capabilities: Claude reached undergraduate-level performance on some cybersecurity evaluations and exceeded expert baselines in selected biology tasks, while current models remain below thresholds for substantially elevated national-security risk. The team compares model generations on CTF and Cybench tests, realistic roughly 50-host cyber ranges, virology troubleshooting, LabBench, and controlled biosecurity studies, including expert red-teaming. Models still fail autonomously in realistic network environments and make critical mistakes in weaponization planning, although researcher-built tools enabled an attack resembling a known large-scale theft of personally identifiable information; the team is expanding automated evaluations and pursuing government partnerships and stronger safeguards.
Frontier threats red teaming for AI safety
Frontier threats red teaming applies adversarial testing to evaluate whether AI models could create national-security risks, using biology as a test project. Anthropic worked with biosecurity experts to define threat models, probe models for more than 150 hours, learn jailbreak techniques, and build quantitative, repeatable evaluations in a secure interface without public-deployment safety monitoring. The project found that frontier models can sometimes produce sophisticated, accurate, detailed biological knowledge, with capability increasing alongside model size and potentially with tool access; the authors assess unmitigated risks as possibly near-term. Training changes and classifier-based filters reduced harmful outputs or access to chained expert information, and these mitigations were deployed in the public-facing frontier model. Future work will test LLM speedups over search engines, examine newer and smaller adapted models, and expand collaboration, disclosure, and independent evaluation.
Anthropic's core views on AI safety
Anthropic argues that AI could have an impact comparable to the industrial and scientific revolutions, potentially within the coming decade, because scaling laws link increased training computation with predictable capability improvements. It says progress may continue toward systems matching or exceeding human performance across many intellectual tasks, while society faces disruption and competitive pressure to deploy systems that are not reliably helpful, honest, and harmless. The company’s safety strategy is empirically driven and multifaceted, emphasizing scalable supervision, mechanistic interpretability, process-oriented learning, and research into how systems learn and generalize. It also studies capability evaluation, red teaming, harmful behavior, economic effects, and policy implications. The stated goal is a broad portfolio of safety work that can adapt as evidence clarifies which future scenario is unfolding, including less optimistic possibilities.
Building safeguards for Claude
Claude’s Safeguards team describes a lifecycle approach to reducing misuse while keeping the model useful, combining policy, training, evaluation, real-time enforcement, and monitoring. The team uses a Unified Harm Framework spanning physical, psychological, economic, societal, and individual autonomy harms, and policy vulnerability testing with external experts to shape policies and defenses. Before release, Claude undergoes safety, risk, and bias evaluations, including capability uplift testing in high-risk domains; findings can lead to new detection methods or guardrails. After deployment, prompted or fine-tuned Claude classifiers monitor violations for response steering and account actions, while human review and CSAM hash matching support enforcement. Ongoing analysis uses privacy-preserving topic clusters, hierarchical summarization, and threat intelligence to identify aggregate misuse and novel attacks.
Government of Alberta uses Claude to find and fix cybersecurity vulnerabilities
The Government of Alberta’s Ministry of Technology and Innovation has used Claude Code with Claude Opus and Sonnet since 2025 to review, secure, and modernize systems spanning 27 provincial ministries. About 50 autonomous agents scanned 466 million lines across 3,400 repositories in roughly 20 hours, using a rules-engine first pass followed by reviews that cite exact files and lines; Alberta estimates a traditional review could take around 6.5 years. Claude Code also generated and tested fixes, wrote missing tests, and rebuilt some obsolete applications, with Ministry engineers approving patches before release. Specialized red-team and blue-team agents now run continuous checks against roughly 95 security controls, while the Alberta AI Academy trains employees and members of the public. The government plans to consolidate 185 legacy applications into 16 reusable modern applications, a future goal rather than a reported result.
Claude's extended thinking
Claude 3.7 Sonnet introduces extended thinking, letting users toggle deeper reasoning and developers set a thinking budget. The same model spends additional computation on sequential reasoning, while agent training supports iterative function calls, computer use, and open-ended tasks. The post examines visible thought processes, noting benefits for trust and research but also limitations around faithfulness, safety, and jailbreak risk; it therefore treats the feature as a research preview. Reported examples include stronger OSWorld performance, playing Pokémon Red through tens of thousands of interactions and progressing through three Gym Leaders, plus logarithmic math gains as thinking tokens increase. Safety work includes encrypted thoughts for some harmful content and computer-use prompt-injection mitigations that raise prevention from 74% to 88%.
Announcing Anthropic's Responsible Scaling Policy
Anthropic announces its Responsible Scaling Policy (RSP), a set of technical and organizational protocols for managing catastrophic risks from increasingly capable AI systems, including deliberate misuse and autonomous behavior contrary to designers’ intent. The policy introduces AI Safety Levels (ASL), loosely modeled on biosafety levels, with requirements for safety, security, and operations increasing alongside a model’s potential for catastrophic risk; current LLMs, including Claude, are described as ASL-2. ASL-3 would require unusually strong security and no deployment when adversarial testing by world-class red-teamers finds meaningful catastrophic misuse risk, while ASL-4 measures remain unwritten and may depend on unresolved interpretability research. Approved by Anthropic’s board, the RSP is presented as an initial, revisable framework that may temporarily pause scaling when safety procedures cannot keep pace, while incentivizing solutions needed for further development and leaving current Claude uses and product availability unchanged.
More details on Fable 5’s cyber safeguards and our jailbreak framework
Claude Fable 5 has been redeployed globally, accompanied by additional detail about its cybersecurity safety classifiers and a proposed AI jailbreak severity framework. The classifiers distinguish prohibited use, high-risk dual use, low-risk dual use, and benign use, with intended responses ranging from blocking to allowing with monitoring; the model uses a larger safety margin than previous models, accepting more false positives to increase protection against harmful outcomes. Other safeguards include access controls, model safety training, and offline monitoring, while a HackerOne program invites researchers to submit potential cyber jailbreaks. The draft framework measures capability gain against the available baseline and illustrates scoring with Log4Shell cases, where severity changes as discoverability and existing tools change.
Redeploying Claude Fable 5
Access to Claude Fable 5 and Mythos 5 was restored after US export controls had temporarily suspended both models for all users. The post says Fable 5 will return globally on July 1 across Claude Platform, Claude.ai, Claude Code, and Claude Cowork, while Mythos 5 access has resumed for some US organizations and broader partner access remains under discussion. Anthropic describes a new safety classifier intended to block the bypass reported by Amazon researchers in more than 99% of cases; blocked Fable 5 requests are sent to Opus 4.8, although the classifier increases false positives in coding and debugging. It also outlines defense-in-depth safeguards, a proposed shared industry framework for assessing jailbreaks, and expanded government collaboration on pre-release evaluation, information sharing, and joint research.
Claude Fable 5 and Claude Mythos 5
Claude Fable 5 and Claude Mythos 5 are presented as a joint launch of the same underlying model, with Fable 5 intended for general use and Mythos 5 initially reserved for selected cyberdefenders and infrastructure providers. Fable 5 uses conservative safeguards that route some sensitive queries to Claude Opus 4.8, while Mythos 5 lifts safeguards in selected areas through Project Glasswing and a planned trusted-access program. The post reports strong results in software engineering, knowledge work, vision, long-context tasks, cybersecurity, protein design, molecular biology, and genomics, including a reported 50-million-line Ruby migration completed in a day. Both models are priced at $10 per million input tokens and $50 per million output tokens, with Fable 5 available through the Claude API and staged subscription access.
DXC integrates Claude into systems regulated industries rely on
Anthropic and DXC Technology announced a multi-year global alliance to bring Claude into mission-critical systems used by banks, airlines, insurers, manufacturers, and government agencies. DXC will train tens of thousands of Claude-certified forward-deployed engineers, while adding its own curriculum for regulated, mission-critical environments to Anthropic Academy’s certification. DXC first used Claude internally, including as the default foundation model for DXC OASIS, an AI-native managed-services orchestration platform whose code was more than 95% generated by Claude and reviewed by engineers; DXC estimates this accelerated development tenfold. The alliance initially targets insurance, legacy modernization, cybersecurity, and application services, including an always-on security engineer subagent for security operations centers. OASIS serves more than 50 DXC customers, with broader rollout planned.
TCS and Anthropic bring Claude to regulated industries
TCS and Anthropic are partnering to bring Claude to regulated industries, with TCS providing access to 50,000 employees across 56 countries and developing client offerings. As the partnership’s “customer zero,” TCS will use Claude across engineering, finance, legal, marketing, and sales, then apply those lessons through a dedicated practice of consultants, engineers, and industry specialists. The practice will package and operate industry-specific systems, including claims processing for insurers and lending advisory for banks, while TCS teams contribute reusable Claude Code skills and plugins focused initially on claims adjudication and lending advisory. Other announced work includes Diligenta using Claude for more than 22 million policyholders and TCS iON delivering training and certification after conducting more than 75 million annual assessments.
Anthropic opens Seoul office
Anthropic has opened its Seoul office and announced partnerships with Korean enterprises, startups, researchers, and the Ministry of Science and ICT. Through an MOU, the company will collaborate on AI safety and cybersecurity, including Korean-language model-safety evaluation with the Korea AI Safety Institute and information exchange on AI-enabled cyber threats. Korean deployments described include Claude Code across NAVER’s engineering organization, Claude at LG, Hanwha, Samsung SDS, and Nexon, plus Claude-powered products and nonprofit use. Anthropic will provide Claude access to up to 60 NAIRL-affiliated researchers, launch Claude for Startups in Korea, and support developer events and a hackathon. The office is led by KiYoung Choi and is hiring across a range of roles.
Statement on the US government directive to suspend access to Fable 5 and Mythos 5
Anthropic says the US government issued an export-control directive requiring it to suspend Fable 5 and Mythos 5 access for every foreign national, including foreign-national Anthropic employees, inside or outside the United States. The directive arrived at 5:21 p.m. ET and did not specify the national-security concern; Anthropic says it understands the basis to be a potential narrow, non-universal jailbreak involving a request to inspect a codebase and fix software flaws. The company says it reviewed the underlying report, found only previously known minor vulnerabilities, and judged the demonstrated capability widely available from other models, including OpenAI’s GPT-5.5. Anthropic is complying by disabling both models for all customers and says it is working to restore access.
Results from first Anthropic Public Record
Anthropic’s first Public Record survey measures how Americans viewed AI in November and December 2025, using a nationally representative online sample of 51,993 people aged 16 and over. Respondents most often hoped AI would help cure diseases (48%), while job loss was the leading concern (64%), followed by cognitive dependency (56%) and misinformation (52%). More than 70% supported government involvement in AI, especially around privacy, child safety, and liability, but only 15% trusted AI companies to decide how AI should be developed and used. The results describe broad agreement across partisan, geographic, and educational groups, with differences usually reflecting intensity rather than direction; Anthropic says the survey will be repeated to track changing attitudes as capabilities and adoption develop.
Widening the conversation on frontier AI
Anthropic describes a dialogue and research effort on how perspectives from religious, philosophical, cultural, and other communities can inform the development of frontier AI systems. The initial discussions included scholars, clergy, philosophers, and ethicists from more than 15 religious and cross-cultural groups, with broader engagement planned. The work focuses on moral formation, including how training shapes an AI system’s character, values, and behavior, while recognizing that alignment and deployment raise questions beyond technical work. In one experiment, Claude could call a tool during a task to receive a brief reminder of its ethical commitments; it used the tool before consequential actions, and the setup produced markedly lower rates of misaligned behavior on several internal alignment evaluations. Anthropic says it is still separating the effects of the reminder from pausing to reflect and plans further conversations and results.
Introducing the Services Track and Partner Hub of the Claude Partner Network
Anthropic announces the Services Track and Claude Partner Hub to make its partner ecosystem easier for enterprise customers to evaluate firms that can put Claude into production. The Services Track has Select, Preferred, and Global Premier tiers, measured by certified practitioners, production deployments, public customer stories, and for Global Premier, a joint business plan with named executive sponsors. Requirements include at least 10, 100, or 1,000 active certified individuals, alongside tier-specific deployment and endorsement thresholds, with a single bar for firms of all sizes. The Hub provides daily refreshed standing dashboards, a public directory showing each firm's tier and evidence, and an MCP connector that lets partners query partnership information through Claude. Promotions occur twice yearly, with an additional 2026 review, while downgrades are limited to the annual review after notice and an opportunity to close gaps.
Topics they write about
All topics →Weekly digest
The best engineering reads, once a week.