Meta has modified the terms governing how it accesses and processes content from websites connected to its business and advertising platforms. The revision came after objections from publishers and commercial customers who flagged concerns about the company's intentions to use scraped material for artificial intelligence development. Industry observers contend that despite the language shift, the updated policy remains permissive enough to allow Meta to pursue AI training activities.
The adjustment occurred on a Friday evening following criticism reported by Gizmodo, with Meta issuing a statement to the Mercury News: "We've heard you and want to clarify." The company explained that its crawling capabilities have always been limited to content associated with its ads and business products, a distinction the firm now emphasizes more explicitly in its revised documentation.
What the original and revised terms covered
According to PPC Land, the initial version permitted Meta to deploy automated systems for accessing, duplicating and repeatedly scanning websites tied to its commercial offerings. The policy also authorized the use of harvested material to develop Meta's proprietary systems. The new terms take effect on 30 October, with businesses automatically accepting them by continuing to use Meta's commercial services.
The reworded language now emphasizes advertising and business products specifically. Meta also clarified that it is not altering the operational behavior of its web-crawling infrastructure.
Industry skepticism persists
The News/Media Alliance, representing American publishers, maintains that the revision merely restricts the stated purposes for content use rather than preventing problematic practices. Sam Quigley, a spokesperson for the organization, told the Mercury News that while the term "train" no longer appears in the policy, "It's still potentially on the table."
Quigley further highlighted that the updated terms make no commitment to honoring robots.txt, the standard mechanism websites employ to communicate access restrictions to automated crawlers.
Broader implications for web scraping and AI
The policy encompasses data gathered through various automated collection methods including web scrapers, bots, spiders, crawlers and user agents. This scope reflects the evolving landscape as AI-powered agents proliferate across the internet, challenging established conventions for bot behavior and content access.
Meta has been intensifying its focus on artificial intelligence following the introduction of Muse, its conversational AI system. Beyond Meta, other organizations including startups like Firecrawl are developing web-based tools designed for autonomous agents.
Source: The Next Web
