← Back to Technomalist
Devices/news/2 min read

ChatGPT and Perplexity Enter Top Scraped Websites as AI Platforms Become Data Targets

New research reveals a shift in web scraping focus, with AI platforms now among the most targeted sites.

A man on a laptop, close on the hands hovering over the keys
A man on a laptop, close on the hands hovering over the keys

New research from Decodo shows that AI platforms are increasingly becoming targets for web scraping, with ChatGPT and Perplexity appearing in the top five most scraped websites for the first time. The findings, reported by TechRadar, indicate a changing landscape in data collection priorities.

According to the study, TikTok remains the most scraped site, accounting for 18% of observed activity. Google holds the second spot, while ChatGPT ranks third with 14% of the activity. Perplexity follows in fifth place with 10%. Amazon, a long-time target, reappears in eighth place. Notably, seven of the top ten sites are new entrants this year, reflecting a dynamic shift in scraping targets.

Decodo CEO Vaidotas Juknys commented on the trend, stating that the purpose of scraping has evolved. Two years ago, businesses scraped the web to understand search trends. Now, they scrape AI platforms to see what information is being delivered to users. This suggests that companies are keen to monitor how AI tools represent their brands, products, and competitors.

The research highlights that businesses are scraping ChatGPT to check product rankings, monitor company descriptions, measure brand mention frequency, and record citations. Similar motivations likely drive scraping of Perplexity. The drop of previous top-10 sites like Walmart, eBay, and Airbnb from the list further underscores a broader shift in consumer behavior and data-gathering strategies.

Looking ahead, Decodo anticipates that other AI platforms such as Gemini and Copilot could enter the top 10 next year. Moreover, Juknys predicts that AI agents may eventually initiate scraping activities autonomously, potentially replacing human-driven decisions.

While the data provides clear evidence of increased scraping of AI platforms, it is important to note that the study's methodology and sample size are not detailed in the report. The findings represent observed activity within Decodo's analysis and may not capture the entire web scraping landscape. Additionally, the reasons behind scraping are inferred from the company's interpretation, not directly confirmed by the scrapers themselves. As such, the conclusions should be considered with caution.

This development signals a growing interest in how AI platforms shape information and brand perception, but further independent research is needed to fully understand the implications.

REPORTING NOTES

Sources and further reading

See an error? Read our corrections policy or email [email protected].

MORE FROM TECHNOMALIST

Continue reading

View all ↗