--- title: "Anthropic" description: "AI safety and research company that's working to build reliable, interpretable, and steerable AI systems." --- # Anthropic > AI safety and research company that's working to build reliable, interpretable, and steerable AI systems. ## Articles ### [Strengthening safeguards with US CAISI and UK AISI](https://yomu.fyi/post/strengthening-safeguards-with-us-caisi-and-uk-aisi.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Sep 12, 2025 - Type: Explainer Anthropic describes an ongoing partnership with the US Center for AI Standards and Innovation (CAISI) and UK AI Security Institute (AISI) to test and improve AI safeguards during model development. The organizations evaluated multiple iterations of Constitutional Classifiers on models including Claude Opus 4 and 4.1, using pre-deployment prototypes, varied system configurations, documentation, and classifier scores for red-teaming. Their testing exposed prompt-injection bypasses, universal jailbreaks, cipher-based and input/output obfuscation attacks, and automated attack refinement that produced an effective universal jailbreak. Anthropic patched specific vulnerabilities and restructured safeguard architecture, improved detection and filtering, and used findings to strengthen evaluation, deployment monitoring, and response practices. The collaboration also showed that sustained access, real-time data, daily technical communication, and complementary government, expert, and bug-bounty testing can reveal both common exploits and subtle attack vectors. ### [Updating sales restrictions for unsupported regions](https://yomu.fyi/post/updating-sales-restrictions-for-unsupported-regions.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Sep 4, 2025 - Type: Announcement Anthropic is updating its Terms of Service to address access by companies from regions where its products are not permitted, including entities operating through foreign subsidiaries. The company says ownership or control from jurisdictions such as China can create legal obligations to share data, cooperate with intelligence services, or support military and intelligence objectives. Under the change, companies or organizations more than 50% owned directly or indirectly by companies headquartered in unsupported regions are prohibited from using the services, regardless of where they operate. Anthropic frames the update as aligning its restrictions with real-world national-security risks and reiterates support for export controls, US energy projects, and rigorous evaluation of AI models for capabilities relevant to national security. ### [Updates to Consumer Terms and Privacy Policy](https://yomu.fyi/post/updates-to-consumer-terms-and-privacy-policy.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Aug 28, 2025 - Type: Announcement Anthropic is updating its Consumer Terms and Privacy Policy for Claude Free, Pro, and Max users, including Claude Code sessions tied to those accounts. Users can choose whether their data is used to improve Claude and strengthen safeguards against scams, abuse, and harmful content; the change excludes Commercial Terms services and API use. New users choose during signup, while existing users must decide by October 8, 2025; accepting immediately applies the updates to new or resumed chats and coding sessions, and the setting remains changeable in Privacy Settings. For users who opt in, retention will extend to five years, compared with 30 days otherwise, while deleted conversations are excluded from future training; Anthropic says it filters or obfuscates sensitive data and does not sell user data. ### [Developing nuclear safeguards for AI through public-private partnership](https://yomu.fyi/post/developing-nuclear-safeguards-for-ai-through-public-private-partnershi.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Aug 21, 2025 - Type: Problem & solution AI models are increasingly capable, raising concern that they could provide dangerous nuclear-technical knowledge that threatens national security. Nuclear information is especially difficult for a private company to evaluate alone, motivating a partnership with the U.S. Department of Energy’s National Nuclear Security Administration (NNSA). Together with NNSA and DOE national laboratories, the company co-developed a classifier that distinguishes concerning from benign nuclear-related conversations, achieving 96% accuracy in preliminary testing. The classifier has been deployed on Claude traffic within a broader system for identifying model misuse, and early deployment data suggests it works well on real conversations; the approach will be shared with the Frontier Model Forum as a potential blueprint for similar safeguards developed with NNSA. ### [Building Effective AI Agents](https://yomu.fyi/post/building-effective-ai-agents.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Dec 19, 2024 - Type: Explainer Effective agentic systems need not begin with complex frameworks: the post reports that successful implementations commonly use simple, composable patterns and recommends choosing the least complex solution that meets the task's needs. It distinguishes workflows, which follow predefined code paths, from agents, where LLMs dynamically direct their processes and tool use. The proposed foundation is an augmented LLM with retrieval, tools, and memory, potentially integrated through the Model Context Protocol; larger designs include prompt chaining, routing, parallelization, and orchestrator-workers patterns. Frameworks can simplify implementation but may obscure prompts and responses, so direct API use and understanding underlying code are recommended. Tool definitions are treated as an interface requiring testing, clear examples, low formatting overhead, and mistake-resistant parameters; absolute filepaths eliminated observed errors in a coding agent. ### [U.S. elections readiness](https://yomu.fyi/post/u-s-elections-readiness.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Nov 5, 2024 - Type: Announcement Anthropic outlines its preparations for the 2024 U.S. election cycle, the first in which generative AI tools are widely available. Since July 2023, it has updated its Usage Policy, strengthened misuse detection, and redirected users toward authoritative voting information. The policy prohibits campaigning, lobbying, election misinformation, targeting voting machines, and interference with vote counting or certification, while Claude's text-only output prevents it from generating image, audio, or video deepfakes. Controls include prompt modifications, API audits, possible account suspensions, cloud-provider coordination, red-teaming, Policy Vulnerability Testing, and automated evaluations of political parity, harmful-query refusals, misinformation prevention, and voter-profiling risks; a TurboVote pop-up handles voting-information requests because models lack real-time election data, while the system prompt states Claude's knowledge cutoff. ### [Charting a path to AI accountability](https://yomu.fyi/post/charting-a-path-to-ai-accountability.md) - Company: [Anthropic](https://yomu.fyi/company/anthropic.md) - Published: Jun 13, 2023 - Type: Explainer Anthropic’s response to the NTIA’s Request for Comment on AI Accountability proposes processes and infrastructure for evaluating highly capable and general-purpose AI models. It recommends funding rigorous evaluations, requiring near-term disclosure of evaluation methods and results, and developing longer-term industry standards with agencies such as NIST. The framework would use capability-based risk thresholds, pre-registration of large training runs, confidential registries, technically literate and security-conscious third-party auditors, and external red teaming before advanced model release. It also calls for more interpretability research, acknowledges that regulations requiring interpretable models are currently infeasible, and seeks antitrust guidance for industry safety collaboration. Anthropic says these measures require collaboration among researchers, AI labs, regulators, auditors, and other stakeholders to build accountability and auditing mechanisms that support safe development and deployment. [Newer posts](https://yomu.fyi/company/anthropic/page/9.md)