Ahrefs: 97% of LLM.txt Files See Zero AI Bot Requests
Search Engine Journal11h ago·1 min readSEO & Search
AI Summary
New Ahrefs data reveals that a vast majority (97%) of llms.txt files across 137K domains received no requests from AI retrieval bots. This indicates that current AI crawling and data ingestion practices are not widely targeting these files.
⚡ Marketer Insight
Despite the hype, AI bots are largely ignoring llms.txt files, suggesting that current AI data scraping strategies are not yet sophisticated enough to leverage them. This presents an opportunity for SEOs to potentially optimize these files for future AI indexing.
#llms.txt#ai bots#seo#data ingestion
Original article
Search Engine Journal