Loading…
Topic
Computer Use
7 posts about Computer Use. Every summary links to the original.
- 7 posts
- 3 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
Your diff has a demo now with Junie /demo
Junie /demo adds a mode to Junie CLI that builds and launches an application, drives its UI, and records a requested check. It produces an HTML report, screenshots, and video, while leaving reviewers able to inspect steps, outcomes, and evidence. In the example, a prompt selects two issues, marks them Done, checks counter changes, reloads the page, and verifies persistence. Initial setup analyzes the repository and generates configuration after a confirmed build and launch plan; Docker-based environments can use custom templates for complex repositories. The mode also supports GitHub Actions workflows for pull-request demonstrations and release smoke tests, but an explicit PASS verdict is required for a scenario to pass.
Anthropic acquires Vercept
Anthropic announces its acquisition of Vercept to advance Claude’s ability to operate inside live applications, where computer use supports multi-step work across tools and teams. Vercept’s team, including co-founders Kiana Ehsani, Luca Weihs, and Ross Girshick, focused on the perception and interaction problems involved in helping AI systems see and act within software used by people. Vercept will wind down its external product in the coming weeks and join Anthropic. The announcement cites Claude Sonnet 4.6’s progress on OSWorld: Sonnet models rose from under 15% in late 2024 to 72.5% today, with Sonnet 4.6 approaching human-level performance on complex spreadsheets and web forms across browser tabs. The deal follows Anthropic’s recent acquisition of Bun.
Self-hosted machines
Cursor’s self-hosted machines keep tool execution inside an organization’s own network, leaving the codebase, build outputs, and secrets on internal infrastructure while the agent handles tool calls locally. The feature supports My Machines for connecting one laptop or VM and team pools that provide named queues of workers, with capacity expanding as requests arrive and contracting when workers disconnect. Pools are repository-independent, can hibernate idle machines, and can restore them within a reconnect window, avoiding the need to keep costly capacity warm. Cloud agents can run on infrastructure including AWS Lambda, Coder, Cloudflare, Daytona, Modal, Namespace, Vercel, and E2B, while Linux and Mac workers add computer use for clicking, typing, screenshots, and browser control.
Understanding and addressing AI harms
An evolving framework addresses AI harms beyond catastrophic risks, covering concerns such as biological threats, child safety, disinformation, and fraud. It complements the Responsible Scaling Policy by examining physical, psychological, economic, societal, and individual-autonomy impacts, then assessing likelihood, scale, affected populations, duration, causality, technology contribution, and mitigation feasibility. Policies and practices include a Usage Policy, pre- and post-launch evaluations, red teaming, adversarial testing, misuse detection, and enforcement ranging from prompt modifications to account blocking. Examples include computer-use safeguards for banking platforms and communications tools, plus hierarchical summarization intended to detect harms while maintaining privacy standards, alongside model-response evaluations balancing helpfulness with harmlessness. For Claude 3.7 Sonnet, encouraging safe, helpful responses to ambiguous prompts produced a reported 45% reduction in unnecessary refusals while maintaining safeguards against truly harmful content; the broader approach remains under development.
Introducing Claude Opus 4.5
Claude Opus 4.5 is available today across Claude apps, the API, and all three major cloud platforms, with the model identifier claude-opus-4-5-20251101 and pricing of $5/$25 per million tokens. The announcement positions it as a state-of-the-art model for coding, agents, computer use, deep research, spreadsheets, and slides, while reporting stronger vision, reasoning, and mathematics than predecessors. On the Claude API, an effort parameter lets developers trade off speed and spend against capability; at medium effort, Opus 4.5 matched Sonnet 4.5’s best SWE-bench Verified score using 76% fewer output tokens, while highest effort exceeded it by 4.3 percentage points using 48% fewer tokens. Additional platform changes include context compaction, advanced tool use, memory, and improved multi-agent coordination. Product updates add Claude Code’s editable Plan Mode and desktop sessions, automatic conversation summarization, and expanded Claude for Chrome and Excel access.
Introducing Claude Sonnet 4.5
The release introduces Claude Sonnet 4.5 as a model aimed at complex coding, agentic work, computer use, reasoning, and math, with claimed gains in alignment. It reports state-of-the-art SWE-bench Verified performance and a 61.4% OSWorld score, up from Sonnet 4’s 42.2%, while noting more than 30 hours of observed focus on complex multi-step tasks. Alongside the model, the company released Claude Agent SDK, added Claude Code checkpoints, a refreshed terminal interface, native VS Code extension, context editing, and a memory tool, and brought code execution and file creation to paid Claude apps. Sonnet 4.5 is available through the Claude API as claude-sonnet-4-5 at $3/$15 per million tokens, the same pricing as Sonnet 4. It is released under AI Safety Level 3 protections, with reported reductions in concerning behaviors and improved defenses against prompt injection, while the temporary Imagine with Claude preview is available to Max subscribers for five days.
Introducing Sonnet 4.6
Claude Sonnet 4.6 is introduced as an upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It adds a 1M token context window in beta, becomes the default for Free and Pro users in claude.ai and Claude Cowork, and keeps Sonnet 4.5’s starting price of $3/$15 per million tokens. Early testing reports that users preferred it over Sonnet 4.5 in Claude Code roughly 70% of the time and over Opus 4.5 59% of the time. The release also reports gains on OSWorld computer use, prompt-injection resistance, OfficeQA document comprehension, and long-horizon planning, while adding adaptive and extended thinking, beta context compaction, and generally available code execution, memory, programmatic tool calling, tool search, and tool-use examples.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.