Loading…
Anthropic
AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
- 182 posts summarised
- latest
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
From their blog
Latest articles
Claude for Enterprise powers LLNL research
Lawrence Livermore National Laboratory (LLNL) is expanding Claude for Enterprise access to its entire laboratory, reaching about 10,000 scientists, researchers, and staff. The deployment is intended to support work in nuclear deterrence, energy, materials science, and energy security, with applications spanning emergency response, fusion research, advanced manufacturing, computational biology, and high-performance computing. Claude’s government-oriented security features include single sign-on, audit logging, role-based access controls, end-to-end encryption, and an expanded context window that can process hundreds of documents, codebases exceeding 100,000 lines, or complex datasets in one query. The expansion follows a pilot, an AI Jam with U.S. National Labs, and a March aiEDGE for Innovation Day attended by approximately 3,200 LLNL scientists and operational staff.
Understanding and addressing AI harms
An evolving framework addresses AI harms beyond catastrophic risks, covering concerns such as biological threats, child safety, disinformation, and fraud. It complements the Responsible Scaling Policy by examining physical, psychological, economic, societal, and individual-autonomy impacts, then assessing likelihood, scale, affected populations, duration, causality, technology contribution, and mitigation feasibility. Policies and practices include a Usage Policy, pre- and post-launch evaluations, red teaming, adversarial testing, misuse detection, and enforcement ranging from prompt modifications to account blocking. Examples include computer-use safeguards for banking platforms and communications tools, plus hierarchical summarization intended to detect harms while maintaining privacy standards, alongside model-response evaluations balancing helpfulness with harmlessness. For Claude 3.7 Sonnet, encouraging safe, helpful responses to ambiguous prompts produced a reported 45% reduction in unnecessary refusals while maintaining safeguards against truly harmful content; the broader approach remains under development.
Challenges in red teaming AI systems
AI red teaming is presented as adversarial testing intended to identify vulnerabilities and risks in AI systems, but inconsistent practices make safety comparisons difficult. The post surveys domain-specific expert testing, policy vulnerability testing, frontier-threat assessments, multilingual and multicultural work, language-model-assisted attacks, automated red teaming, multimodal testing, and crowdsourced or community-based approaches. It describes an iterative process in which experts articulate threat models and probe systems qualitatively, then standardize inputs and use language models to generate many variations for more quantitative automated evaluation. In automated red teaming, a red team model generates attacks and a blue team model is fine-tuned on those outputs to improve robustness. The conclusion calls for technical standards, independent testing capacity, professional services, third-party access, and links between red teaming and model release conditions.
Accenture, AWS, and Anthropic collaboration
Anthropic, AWS, and Accenture announced a collaboration to help enterprises move generative AI ideas from concept to production, with an emphasis on regulated sectors where accuracy, reliability, and data security are paramount. More than 1,400 Accenture engineers will train as specialists in Anthropic models on AWS, supporting end-to-end delivery, customer-specific fine-tuning with private data, and prompt and platform engineering through Amazon Bedrock and Amazon SageMaker. In public health, the initiative has already produced Knowledge Assist, a Claude-powered chatbot built with the District of Columbia Department of Health that answers questions about health programs and services in English and Spanish. The collaboration combines Anthropic’s AI expertise, AWS’s security and reliability approach, and Accenture’s industry knowledge to develop tailored solutions for trust-driven sectors and streamline adoption of AI systems.
SKT partnership announcement
SK Telecom (SKT), Korea’s largest mobile operator, has become a commercial partner and strategic investor in Anthropic. The companies will develop a multilingual large language model customized for telecommunications applications such as customer service, marketing, sales, and interactive consumer experiences, with support planned for Korean, English, Japanese, Spanish, and more. Anthropic will fine-tune Claude using SKT’s telecommunications expertise: SKT experts will provide feedback on responses, and that feedback will help train industry-specific solutions. SKT has invested an additional $100 million in Anthropic, following an earlier investment by SK Telecom Venture Capital, while the companies describe the partnership as a way to promote AI innovation and develop safer, more reliable technology for telcos worldwide.
Frontier model security
Frontier AI models and their research are presented as strategic assets requiring protections beyond ordinary commercial technology because theft or misuse could affect economic and national security. The post recommends treating advanced AI as akin to critical infrastructure, with public-private cooperation and possible procurement or regulatory requirements. Its central control is multi-party authorization: no individual retains persistent access to production-critical environments, and time-limited access requires a coworker’s approval and business justification. It also argues that NIST’s SSDF and SLSA can be adapted to model development and coupled software, creating a chain of custody that supports provenance for deployed systems. Anthropic says it is implementing these controls and other cybersecurity practices through an iterative process, while acknowledging protections must evolve as model capabilities scale.
Zoom partnership and investment in Anthropic
Anthropic announces a partnership with Zoom under which Zoom will use Claude, Anthropic’s AI assistant built with Constitutional AI, to develop customer-facing products centered on reliability, productivity, and safety. Zoom’s federated approach will combine its own technology with models including Claude to address diverse customer needs, with the first Claude integration planned for the Zoom Contact Center portfolio. There, Claude is intended to improve the end-user experience and support contact-center agent performance. Zoom Ventures has also invested in Anthropic, aligning the companies around customer-centric AI products grounded in trust and security and designed for real-world use. The announcement presents the collaboration as a way to bring robust, steerable AI into workplace applications.
Introducing 100K context windows
Claude’s context window has expanded from 9K to 100K tokens, or about 75,000 words, enabling businesses to submit hundreds of pages and sustain conversations for hours or days. The announcement describes using the larger window to digest documents, synthesize information across multiple files, answer questions, and work with full codebases, with the claim that complex questions may perform substantially better than vector-search approaches. In a test, Claude-Instant processed the 72K-token text of The Great Gatsby after one line was altered, identified the change correctly, and responded in 22 seconds; 100K tokens is also described as roughly six hours of audio. The capability is available through the API, with examples including financial analysis, legal review, developer-documentation search, podcast summarization, and rapid prototyping.
Anthropic partners with Google Cloud
Anthropic, an AI safety and research company, has selected Google Cloud as its cloud provider in a partnership intended to support the next phase of its work. The companies plan to co-develop AI computing systems, while Anthropic will use Google Cloud’s GPU and TPU clusters to train, scale, and deploy its AI systems to a larger set of people. The work centers on Claude, Anthropic’s AI assistant, and on building safe, steerable systems using techniques including Constitutional AI, which is intended to make AI technologies easier to rely on and understand. Anthropic says the infrastructure’s performance and scale will support a more robust platform for reliable, interpretable, and steerable AI systems.
Funding better evaluations of AI’s impact on wellbeing
A $5 million grant program will fund independent research into how AI affects user wellbeing, offering direct funding, model access, and technical support for open-source evaluations. The initiative addresses the difficulty of judging wellbeing-related behavior, where risks may emerge only across long, shifting conversations and where otherwise reasonable advice can become harmful in a different context, such as disordered eating. Grantees will work independently and publish reusable evaluations or benchmarks, with guidance asking projects to define pass/fail criteria, involve clinical and subject-matter experts, test overcompliance and overrefusal, model realistic multi-turn scenarios, and validate graders against experts. Applications are due September 21, with selected full-proposal applicants notified by October 5.
Introducing the Anthropic Economic Index
Anthropic introduced the Anthropic Economic Index to track how AI is used in work and to study its effects on labor markets over time. Its first report analyzes approximately one million anonymized Free and Pro Claude.ai conversations, using Clio to match them with occupational tasks from the U.S. Department of Labor’s O*NET database. Usage concentrated in computer and mathematical work, which represented 37.2% of queries, while 36% of occupations showed AI use in at least a quarter of associated tasks and about 4% reached three-quarters. The report found 57% augmentation versus 43% automation, lower use in both low- and very-high-wage occupations, and plans for open data and repeated analyses, while noting possible classification errors and coding overrepresentation.
Launching the Anthropic Economic Futures Programme in the UK and Europe
Anthropic is expanding its Economic Futures Programme to the UK and Europe to support research and policy discussions about AI’s effects on labor, productivity, and growth. The expansion begins with an Economic Futures Symposium at the London School of Economics and Political Science, where more than 100 experts and selected researchers will discuss policy proposals. Planned support includes research grants, API credits for UK and EU researchers, forums for evidence-based policy, and more granular data on European AI use. The Anthropic Economic Index reports that coding is Claude’s most common use across Europe, while UK usage most often supports academic research, writing, and educational content; Germany shows high per-capita use for manufacturing equipment, and France records four times the global average for dining, shopping, and nightlife information. Regular public releases will track adoption across European industries and regions as the programme seeks to inform decisions about the workforce transition.
Supporting ambitious external research through the Anthropic Economic Futures Research Fund
The Anthropic Economic Futures Research Fund commits $200 million to external research on interventions that could help society prepare for AI’s economic impacts. It prioritizes five areas: workplace integration, support for AI-driven transitions, income support for displacement, worker stakes in AI-driven growth, and evidence on public investments. The fund will favor large-scale randomized controlled trials, ambitious pilots, and program evaluations, with particular interest in projects that share findings at key milestones and can scale rapidly if promising; typical awards will be $5 million to $30 million, with nothing below $1 million funded directly. Eligible applicants include accredited degree-granting institutions, independent research and policy organizations, and nonprofits with experience running field experiments at scale, while the fund remains global despite US-centric examples.
Anthropic Economic Index: Insights from Claude 3.7 Sonnet
Anthropic’s second Economic Index report examines how Claude.ai usage changed after Claude 3.7 Sonnet launched, using 1 million anonymized Free and Pro conversations from the following 11 days. Clio maps conversations to 17,000 tasks in the U.S. Department of Labor’s O*NET database, enabling comparisons across occupations and interaction modes, while the report also introduces a 630-category bottom-up taxonomy. Coding, education, and science usage increased modestly, and extended thinking appeared most often in technical and creative work, including computer science research, software development, multimedia art, and video game design. Augmentation remained 57% of usage, learning interactions rose from about 23% to 28%, and the report releases task- and occupation-level datasets covering thinking mode and augmentation-versus-automation patterns.
The Anthropic Economic Index connector
The Anthropic Economic Index connector for Claude makes the Index’s data available for direct question-and-answer exploration. The Index measures how AI is used in the economy, including occupations, geographic usage, and the tasks people perform or automate with Claude. Users enable the connector from the claude.ai connectors directory, without installing anything, then can ask broad or specific questions and request the underlying data behind an answer. Responses are grounded in Index data, but the source cautions that it reflects Claude usage patterns rather than the labor market as a whole; the full datasets remain freely available on the website for further exploration.
Improving Fable 5 Safeguards
Claude Fable 5’s biology safeguards have been updated to reduce false positives that reroute biology-related requests to Opus 5. In testing, the change reduced biology-related fallbacks by about 85% across product surfaces, expanding support for everyday health and educational questions and some clinical tasks. The update followed a rewrite of the classifier’s constitution, feedback from internal and external experts, new training data, and retraining, with verification that harmful and dual-use biology content would still trigger it. Fable 5 still blocks dual-use professional biology and drug-development queries, including virology, toxicology, and molecular design, while trusted access pathways are being developed for frontier research.
Introducing Claude Sonnet 5
Claude Sonnet 5 is introduced as an agentic Sonnet model that plans, uses browser and terminal tools, and operates autonomously. The post says it approaches Opus 4.8 performance at lower prices while improving on Sonnet 4.6 in reasoning, tool use, coding, and knowledge work. Comparisons on BrowseComp and OSWorld-Verified across effort levels show a wider cost-performance range, with higher-effort results matching Opus 4.8 on some tasks. Safety assessments found lower overall undesirable behavior, hallucination, and sycophancy rates than Sonnet 4.6, while default cyber safeguards address dangerous usage; the model is available across all plans and via the Claude API for $2 per million input tokens and $10 per million output tokens.
Tino Cuellar joins Anthropic as Chief Global Affairs Officer
Mariano-Florentino (Tino) Cuéllar will join Anthropic as its first Chief Global Affairs Officer, leading policy, strategic international engagement, and government relationships worldwide. He brings experience spanning law, technology, international security, and public institutions, including the presidency of Carnegie Endowment, a California Supreme Court justice role, Stanford leadership, and service on federal advisory boards. Cuéllar has also co-led California’s Frontier AI Working Group and organized artificial intelligence classes at Stanford Law School nearly a decade ago. He stepped down as a Trustee of Anthropic’s Long-Term Benefit Trust, a position he held since January 2026, to join the company; Anthropic says he will help engage governments, civil society, and communities on AI’s risks, opportunities, and democratic governance.
Introducing Claude for Nonprofits
Claude for Nonprofits launches with GivingTuesday to help nonprofit organizations address limited resources while fitting AI into existing workflows and meeting community privacy expectations. The program offers discounts of up to 75% on Team and Enterprise plans, including Claude Opus 4.6, Sonnet 4.5, and Haiku 4.5, with plan capabilities and intended organization sizes described in the announcement. It also adds open-source connectors for Benevity, Blackbaud, and Candid, linking Claude to nonprofit and fundraising data and searches. A free, no-background course, AI Fluency for Nonprofits, offers instruction on grant writing, program evaluation, donor engagement, and efficiency. Pilot partnerships with more than 60 grantee organizations and customer examples are being used to learn how nonprofits can apply Claude to impact analysis, fundraising, documentation, and operational work.
Our position on open-weights models
Anthropic CEO Dario Amodei states that Anthropic has never advocated banning open-weights models, while distinguishing models without dangerous capabilities as a public good from risks associated with sufficiently capable systems. The post identifies two concerns: authoritarian governments gaining military superiority or enabling repression, and powerful models being misused for cyberattacks, biological attacks, or serious alignment problems. It argues open weights can increase misuse risk because guardrails and monitoring are difficult after release, but says banning their use by US businesses would not address bad actors. Instead, Amodei supports restricting powerful chips and chipmaking equipment exports to China, disrupting industrial-scale distillation, and requiring global pre-release safety testing for sufficiently capable open and closed models. He agrees open weights can expand access, competition, and customer control, but says claims about safeguards should be tested empirically.
Topics they write about
All topics →Weekly digest
The best engineering reads, once a week.