Loading…
Anthropic
AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
- 182 posts summarised
- latest
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
From their blog
Latest articles
Expanding Project Glasswing
Project Glasswing is expanding its collaboration from roughly 50 initial partners to approximately 150 new organizations across more than 15 countries. These partners must meet security requirements, and many operate critical infrastructure or maintain software used widely, with a major attack estimated to affect more than 100 million people for most. The program follows partners’ use of Claude Mythos Preview to scan codebases, finding more than 10,000 high- or critical-severity flaws, while some now use it to write patches and run pre-release checks. Its broader purpose is to help defenders adapt to powerful cyber models by providing tools and infrastructure, then shifting support toward disclosure, fixing, and deployment of patched software. General access will require safeguards against misuse that have yet to be developed.
Anthropic confidentially submits draft S-1 to the SEC
Anthropic, PBC says it has confidentially submitted a draft registration statement on Form S-1 to the U.S. Securities and Exchange Commission for a proposed initial public offering of its common stock. The filing preserves an option to go public after the SEC completes its review, but the offering remains dependent on market conditions and other factors. Anthropic has not set the number of shares or the offering price. Published under Rule 135 of the Securities Act of 1933, the announcement states that it is not an offer to sell securities or a solicitation to buy them; any offers, solicitations, or sales would occur only under the Act’s registration requirements.
Anthropic raises $65B in Series H funding at $965B post-money valuation
Anthropic says it has raised $65 billion in Series H funding at a $965 billion post-money valuation, with the round led by Altimeter Capital, Dragoneer, Greenoaks, and Sequoia Capital. The company says its run-rate revenue crossed $47 billion earlier this month and that the financing will support safety and interpretability research, additional compute, and expanded products and partnerships. It reports agreements for up to five gigawatts of new Amazon capacity, five gigawatts of next-generation TPU capacity with Google and Broadcom, and GPU access in SpaceX’s Colossus 1 and Colossus 2; AWS remains its primary cloud provider and training partner. The round includes $15 billion in previously committed hyperscaler investments, including $5 billion from Amazon, alongside strategic infrastructure partners Micron, Samsung, and SK hynix.
Anthropic opens Milan office to support Italian enterprise, research, and developers
Anthropic will open a Milan office, its sixth in Europe, to work with Italian companies and developers building and scaling with Claude responsibly and to join Italy’s broader conversation about AI. Led by Thomas Remy, Head of Southern Europe, the team already works with companies including Generali Group, Unipol Group, Angelini Pharma, Bracco Group, Enel Group, and Pirelli. A partnership with JAKALA has deployed Claude across more than 3,000 seats to free up roughly 70% of senior team time for higher-judgment client work, while Satispay compressed an 18-month roadmap into seven months. The office follows the presentation of Magnifica Humanitas, where Chris Olah addressed AI ethics, and will also support research, culture, and design through initiatives such as an Alcova Milano workshop.
Anthropic co-founder Chris Olah's remarks on Pope Leo XIV's encyclical "Magnifica humanitas"
At the presentation of Pope Leo XIV’s encyclical “Magnifica humanitas,” Anthropic co-founder Chris Olah argues that AI’s consequences cannot be governed by frontier labs alone. Because commercial, geopolitical, and personal incentives can conflict with safety, he calls for independent critics and sustained dialogue among religious communities, civil society, scholars, governments, and developers. He describes models as grown from human language on brain-modeled structures, making their character and interaction with society questions for the humanities as well as computer science. His three priorities are protecting displaced workers and sharing gains globally, imagining conditions for human flourishing, and investigating findings about model structures and internal states that he says resemble human neuroscience and emotions, while acknowledging their meaning remains uncertain.
How we contain Claude across products
Anthropic describes how it contains Claude across claude.ai, Claude Code, and Claude Cowork as model capabilities and access expand the potential blast radius of autonomous agents. It distinguishes user misuse, model misbehavior, and external attackers, then assigns defenses across the agent’s environment, the model, and external content such as MCP servers, plugins, and web results. The main containment patterns include ephemeral gVisor containers for claude.ai, while Claude Code’s sandboxing and Cowork’s virtual-machine design tailor isolation to different users and capabilities. Reported measurements show Claude Opus 4.7 at roughly 0.1% attack success on single prompt-injection attempts and Claude Code auto mode catching roughly 83% of overeager behaviors, but neither replaces hard environmental boundaries. The conclusion favors mature isolation primitives, least-necessary access, and defense in depth because probabilistic safeguards can miss failures and permitted egress can still expose data.
Building a new enterprise AI services company
Anthropic, Blackstone, Hellman & Friedman, and Goldman Sachs announced a new AI services company that will help mid-sized organizations bring Claude into core operations. The firm will combine its engineering team with Anthropic Applied AI engineers to identify high-impact opportunities, build custom Claude-powered systems, and support customers over the long term; it is backed by additional alternative asset managers including General Atlantic, Leonard Green, Apollo Global Management, GIC, and Sequoia Capital. Engagements will start with a small team working with customer staff, then tailor systems to existing workflows, such as documentation, medical coding, prior authorizations, and compliance reviews in healthcare. The company will also join Anthropic’s Claude Partner Network, extending delivery capacity alongside systems integrators that serve large enterprises.
Australia and Anthropic sign AI safety MOU
Anthropic and the Australian government signed a Memorandum of Understanding to cooperate on AI safety research and support Australia’s National AI Plan. The agreement centers on collaboration with Australia’s AI Safety Institute, including sharing findings about emerging model capabilities and risks, participating in joint safety and security evaluations, and conducting research with Australian academic institutions. Anthropic will also share Anthropic Economic Index data to track AI adoption, economic effects, and workforce implications, initially covering natural resources, agriculture, healthcare, and financial services. Separately, AUD$3 million in Claude API credits will support four Australian institutions working on clinical genomics, precision medicine, pediatric research, and computing education. The company is also exploring data-center and energy investments, launching a startup credit program, and preparing to open a Sydney office.
Sydney becomes Anthropic's fourth APAC office
Anthropic plans to open an office in Sydney in the coming weeks, making it the company’s fourth Asia-Pacific office alongside Tokyo, Bengaluru, and Seoul. The expansion responds to strong demand in Australia and New Zealand and is intended to support their distinct AI ecosystems, with initial attention on enterprise, startup, and research customers. Anthropic says it will hire locally, deepen engagement with Australian institutions, pursue partnerships in national-interest and priority sectors, and explore additional compute capacity through third-party infrastructure already in place, partly to address data-residency requirements. Australia and New Zealand rank fourth and eighth globally in Claude.ai usage relative to population, while reported usage is especially strong for computer and coding tasks, educational instruction, and research.
Dario Amodei on the Department of War discussions
Dario Amodei says Anthropic considers AI deployment for US and allied democratic defense existentially important and has deployed Claude across the Department of War and other national security agencies, including classified networks and National Laboratories. The company says it supports intelligence analysis, modeling and simulation, operational planning, and cyber operations, while restricting Claude’s use by firms linked to the Chinese Communist Party and advocating chip export controls. Anthropic maintains two safeguards: mass domestic surveillance is incompatible with democratic values, and current frontier systems are not reliable enough for fully autonomous weapons without proper oversight. The Department has stated it demands “any lawful use” and threatens offboarding, a “supply chain risk” designation, and Defense Production Act action; Anthropic says it will not remove the safeguards, while offering continued service or transition support.
Detecting and preventing distillation attacks
Anthropic reports identifying industrial-scale distillation campaigns by DeepSeek, Moonshot, and MiniMax that generated more than 16 million Claude exchanges through approximately 24,000 fraudulent accounts. The campaigns used proxy services and coordinated account networks to extract agentic reasoning, tool use, coding, computer-use, and other capabilities, including chain-of-thought data and reinforcement-learning tasks. Anthropic attributed the operations with high confidence using IP correlation, request metadata, infrastructure indicators, and partner corroboration, while describing hydra cluster architectures that replace banned accounts and obscure patterns. The response combines classifiers, behavioral fingerprinting, coordinated-activity detection, intelligence sharing, stronger account verification, and product, API, and model-level countermeasures. The report argues illicitly distilled models may strip safeguards and undermine export controls, and says coordinated action across AI labs, cloud providers, and policymakers is required.
Anthropic opens Bengaluru office
Anthropic has officially opened a Bengaluru office, marking its second in Asia after Tokyo, and announced partnerships spanning enterprise, education, agriculture, and public services in India. India is Claude.ai's second-largest market, with nearly half of usage involving computer and mathematical tasks; Anthropic says its run-rate revenue there has doubled since its October 2025 expansion. The company is improving support for Indic languages through training data in ten languages and is working with Karya and the Collective Intelligence Project on evaluations for locally relevant tasks in agriculture and law. Other initiatives include Claude-powered education pilots, public-sector projects such as an Adalat AI WhatsApp helpline, and adoption of the open-source Model Context Protocol, while the office will hire local talent and provide applied AI expertise to customers.
Claude's constitution
Claude’s constitution describes how explicit principles can guide a language model’s behavior instead of relying on values implicitly determined through large-scale human feedback. The approach uses AI feedback in two training phases: the model first critiques and revises responses using the principles, then reinforcement learning selects the more harmless output using AI-generated evaluations. The post says Constitutional AI produced a Pareto improvement in tests, with the model responding more appropriately to adversarial inputs while remaining helpful and not evasive; harmlessness results came without human harmlessness data. The constitution draws on the UN Declaration of Human Rights, safety practices, other AI-lab principles, global platform guidelines, and attempts to include non-Western perspectives, while remaining an iterative, adjustable document.
Introducing Agent Skills
Agent Skills are folders containing instructions, scripts, and resources that Claude loads when relevant to specialized tasks, enabling custom expertise across Claude apps, Claude Code, and the API. The system scans available skills, loads only the minimal information and files needed, and can combine multiple skills automatically. Skills may include executable code, and API use requires the Code Execution Tool beta; developers can manage versions through the /v1/skills endpoint and Claude Console. Users can build skills with the skill-creator workflow or install them through the anthropics/skills marketplace, while organization-wide management and a partner-built directory were added in the December 18, 2025 update. The post presents Skills as composable, portable, efficient, and powerful, but cautions that code-executing skills should come from trusted sources to protect data.
Usage Policy update
Anthropic is updating its Usage Policy to reflect product changes, user feedback, regulatory developments, evolving AI risks, and enforcement priorities, with changes taking effect September 15, 2025. The update adds explicit prohibitions on malicious computer, network, and infrastructure compromise while continuing to permit vulnerability discovery with system-owner consent, and provides supplementary guidance for agentic use. It narrows political restrictions from broad bans on lobbying and campaign content to prohibitions on deceptive or disruptive democratic activity and voter or campaign targeting. Law-enforcement wording is clarified without changing the permitted scope, while high-risk requirements are specified for consumer-facing legal, financial, and employment uses, including human oversight and AI disclosure. Anthropic describes the policy as a living document and says it will continue evaluation with policymakers, experts, and civil society.
Strengthening safeguards with US CAISI and UK AISI
Anthropic describes an ongoing partnership with the US Center for AI Standards and Innovation (CAISI) and UK AI Security Institute (AISI) to test and improve AI safeguards during model development. The organizations evaluated multiple iterations of Constitutional Classifiers on models including Claude Opus 4 and 4.1, using pre-deployment prototypes, varied system configurations, documentation, and classifier scores for red-teaming. Their testing exposed prompt-injection bypasses, universal jailbreaks, cipher-based and input/output obfuscation attacks, and automated attack refinement that produced an effective universal jailbreak. Anthropic patched specific vulnerabilities and restructured safeguard architecture, improved detection and filtering, and used findings to strengthen evaluation, deployment monitoring, and response practices. The collaboration also showed that sustained access, real-time data, daily technical communication, and complementary government, expert, and bug-bounty testing can reveal both common exploits and subtle attack vectors.
Updating sales restrictions for unsupported regions
Anthropic is updating its Terms of Service to address access by companies from regions where its products are not permitted, including entities operating through foreign subsidiaries. The company says ownership or control from jurisdictions such as China can create legal obligations to share data, cooperate with intelligence services, or support military and intelligence objectives. Under the change, companies or organizations more than 50% owned directly or indirectly by companies headquartered in unsupported regions are prohibited from using the services, regardless of where they operate. Anthropic frames the update as aligning its restrictions with real-world national-security risks and reiterates support for export controls, US energy projects, and rigorous evaluation of AI models for capabilities relevant to national security.
Updates to Consumer Terms and Privacy Policy
Anthropic is updating its Consumer Terms and Privacy Policy for Claude Free, Pro, and Max users, including Claude Code sessions tied to those accounts. Users can choose whether their data is used to improve Claude and strengthen safeguards against scams, abuse, and harmful content; the change excludes Commercial Terms services and API use. New users choose during signup, while existing users must decide by October 8, 2025; accepting immediately applies the updates to new or resumed chats and coding sessions, and the setting remains changeable in Privacy Settings. For users who opt in, retention will extend to five years, compared with 30 days otherwise, while deleted conversations are excluded from future training; Anthropic says it filters or obfuscates sensitive data and does not sell user data.
Developing nuclear safeguards for AI through public-private partnership
AI models are increasingly capable, raising concern that they could provide dangerous nuclear-technical knowledge that threatens national security. Nuclear information is especially difficult for a private company to evaluate alone, motivating a partnership with the U.S. Department of Energy’s National Nuclear Security Administration (NNSA). Together with NNSA and DOE national laboratories, the company co-developed a classifier that distinguishes concerning from benign nuclear-related conversations, achieving 96% accuracy in preliminary testing. The classifier has been deployed on Claude traffic within a broader system for identifying model misuse, and early deployment data suggests it works well on real conversations; the approach will be shared with the Frontier Model Forum as a potential blueprint for similar safeguards developed with NNSA.
Building Effective AI Agents
Effective agentic systems need not begin with complex frameworks: the post reports that successful implementations commonly use simple, composable patterns and recommends choosing the least complex solution that meets the task's needs. It distinguishes workflows, which follow predefined code paths, from agents, where LLMs dynamically direct their processes and tool use. The proposed foundation is an augmented LLM with retrieval, tools, and memory, potentially integrated through the Model Context Protocol; larger designs include prompt chaining, routing, parallelization, and orchestrator-workers patterns. Frameworks can simplify implementation but may obscure prompts and responses, so direct API use and understanding underlying code are recommended. Tool definitions are treated as an interface requiring testing, clear examples, low formatting overhead, and mistake-resistant parameters; absolute filepaths eliminated observed errors in a coding agent.
Topics they write about
All topics →Weekly digest
The best engineering reads, once a week.