What Has Changed

Anthropic has stopped live internet access in “all internal evaluations”. This change was announced as a measure to ensure the reliability of AI agents.

(Source: techcrunch.com)

How It Works

The internal evaluation process reduces unpredictable behavior and security risks by preventing AI agents from accessing real-time internet data. This change aims to limit the evaluation environment to offline, minimizing differences with actual operational environments.

(Source: techcrunch.com)

Migration Procedure

To change the internal evaluation settings, it is necessary to set the “internet_access” parameter to “false” through Anthropic’s console or API. However, since specific steps are not documented in the official documentation, direct operation is currently not possible.

(Source: techcrunch.com)

Summary

  • Disabling internet access in Anthropic’s internal evaluation environment can improve the reliability of AI agents
  • Offline evaluation processes can minimize differences with actual operational environments, resulting in more predictable outcomes
  • Since specific setting procedures are not currently documented in the official documentation, changes to console or API settings may be necessary