Meta is delaying its controversial new business terms amid scraping concerns

Meta is delaying its updated Commercial Terms and Self-Serve Ad Terms. They were scheduled to take effect on October 30, but Meta now says they will take effect on 20 November. The change matters because the terms govern how Meta may access and use content connected with business accounts.

The company told Reuters and Fast Company that it was extending the date to explain what is changing and what is not. The planned terms included language about Meta using web scrapers and automated tools on associated websites, pages, and URLs. Publishers and businesses objected to those provisions.

The delay does not cancel the revised terms. Meta says it will use the extra time to explain its web crawlers and clarify that content owners can use robots.txt. Complaints to antitrust authorities and an open letter from the News Media Alliance show that concerns remain unresolved.

Web scrapers and automated crawlers are software tools that visit websites and gather information without someone manually opening every page. The proposed terms would give Meta rights to use these tools on domains, pages, and URLs associated with business accounts. That could include accessing, indexing, caching, analyzing, collecting, retrieving, or crawling available content.

For example, a crawler could visit a publisher's website, copy information from its pages, and organize or analyze that material. The terms also said Meta could use content from those sites to provide, develop, improve, research, train, and maintain Meta products, services, and features. The company later removed the specific reference to AI training.

The wording has raised concerns among publishers and other businesses. They fear broad access could affect valuable content and competitive relationships. Meta says it will explain how its crawlers work and discuss robots.txt controls with partners.

The clearest scale comes from the News Media Alliance. It represents thousands of news media organizations in the United States and Canada. That means the dispute could affect a very large community of publishers, although the article does not provide an exact combined number for every business or organization opposing Meta's terms.

The Alliance sent Meta an open letter demanding that the revised terms be withdrawn before October 30. Its members argued that publishers could be forced to provide journalism that supports products competing for readers and advertisers. Other publishers and businesses also raised concerns, and potentially affected entities submitted complaints to antitrust authorities.

The article therefore supports a scale of thousands of represented news organizations, not a precise total across all opponents. Meta's delay until 20 November gives it more time to explain the policy. It does not establish how many organizations will ultimately be affected or whether the terms will change further.

Publishers fear losing control over valuable journalism while helping Meta build products that compete with their own businesses. Their concern is not only access to articles. It is also the possibility that Meta could use that material to develop, improve, research, or maintain services that attract the same readers and advertisers.

The News Media Alliance described this risk in an open letter. It said publishers would be forced to provide journalism supporting products that may compete with them for readers and advertising revenue. The concern is especially serious because the proposed terms were connected to business accounts and broad automated collection of website content.

The publishers also objected to providing this value under duress and without compensation. Meta removed the explicit AI-training reference, but complaints continued. The delay gives Meta time to explain its practices, while publishers and other businesses continue challenging terms they believe could weaken their bargaining position.

The opposition includes publishers, other businesses, and other potentially affected entities. The article does not name individual companies. It specifically identifies the News Media Alliance, which represents thousands of news media organizations in the United States and Canada.

Potentially affected entities submitted complaints to antitrust authorities about Meta's updated terms. Separately, the News Media Alliance sent Meta an open letter. The group demanded that Meta withdraw the revised terms before their planned October 30 effective date. Its letter focused on the possible use of journalism in products competing for readers and advertisers.

Meta has not withdrawn the terms in the article. Instead, it moved the effective date to 20 November. The company said it wants more time to explain what is changing and what is not, including how its web crawlers work and how content owners and publishers can use robots.txt.

Robots.txt is a plain text file placed on a website to signal the owner's preferences to crawlers and AI bots. A site can use it to request that automated tools do not index particular content or the site more broadly. Meta says content owners and publishers will be able to use this method.

For example, a publisher could add instructions telling crawlers not to index its pages. A compliant crawler would read those instructions and avoid indexing the specified content. This gives website owners a way to communicate their wishes without manually contacting every automated tool.

However, robots.txt may not fully prevent scraping. The article notes that Reuters previously reported multiple AI companies' crawlers regularly ignore robots.txt instructions. Meta's promise to explain the mechanism therefore may not resolve publishers' concerns. The file signals preferences, but the article shows that compliance by crawlers is not guaranteed.

Online terms of service are the rules that set the conditions for using a digital platform. They explain what users or businesses permit, what the platform may do, and what responsibilities apply. Here, Meta's Commercial Terms and Self-Serve Ad Terms would govern commercial relationships connected with business accounts.

The proposed language would give Meta rights to use web scrapers and automated tools on associated domains, pages, and URLs. It listed actions including accessing, indexing, caching, analyzing, collecting, retrieving, and crawling content. It also said Meta could use that content to provide, develop, improve, research, and maintain its products and services.

Those rules matter because accepting them could affect how business website content is handled. Publishers and other businesses challenged the breadth of the language, especially its possible competitive effects. Meta delayed the effective date to 20 November and said it would explain what is changing, what is not, and how robots.txt can be used.