Microsoft Clarity has announced the "AI Scrape-to-Referral" feature, a new metric that combines AI bots' content scraping activities on websites with the amount of traffic those bots send back to the site into a single metric. The new tool allows website owners to directly evaluate whether they are receiving adequate visitor value in return for serving content to AI crawlers.
What Do the New Metric and Bot Analytics Features Offer?
Added to the Bot Analytics report, this innovation provides webmasters with detailed data on optimizing their AI integrations and crawling permissions. The key features introduced with the update include:
- AI Scrape-to-Referral Scorecard: Enables the comparison of the balance between content extraction and traffic return through a single metric.
- Operator-Level Breakdown: Displays a ranked list showing which AI sources actually send traffic to the site and which provide low conversion despite high crawling activity.
- Direct Access to Session Recordings: Allows for the examination of real-time user behavior by providing one-click access to filtered session recordings based on the selected AI referral source.
- Domain Coverage Safeguards: To prevent inaccurate data in cases where CDN and Clarity coverages do not fully align, ratios are calculated exclusively using properly matched domain names.
Industry Implications and Strategic Evaluation
As the crawling intensity of AI search engines and bots on websites increases, one of the biggest concerns for content producers is that data scraping activities go uncompensated. The scorecard introduced by Microsoft Clarity allows you to see with concrete figures when an AI crawling your site brings you only one or zero visitors in exchange for thousands of crawls. This provides digital marketers and web administrators with a data-driven decision-making mechanism regarding which AI bots to permit and which to block.
Frequently Asked Questions
What are some practical measures that can be taken for websites with a low AI Scrape-to-Referral ratio?
Once low-performing AI sources are identified, site owners can limit the crawling frequency of the relevant bots or restrict access entirely via their robots.txt file or server-level rules.
Is any additional configuration or code change required to analyze this new metric data?
No; if the Clarity tracking code is already installed on your site, the new AI Scrape-to-Referral scorecard and Bot Analytics reports will automatically appear on your dashboard and begin functioning via matched domain names.
*This news report has been prepared based on data published by Search Engine Land.
💬 Comments
No comments yet. Be the first!
You must be logged in to comment.
🔑 Log In