Technophile NewsTechnophile News
  • Home
  • News
  • PC
  • Phones
  • Android
  • Gadgets
  • Games
  • Guides
  • Accessories
  • Reviews
  • Spotlight
  • More
    • Artificial Intelligence
    • Web Stories
    • Press Release
What's On

OpenAI Said to Be Working on Weekly and Lifetime ChatGPT Subscription Plans

9 May 2025

Samsung’s Tri-Fold Phone Tipped to Use Silicon-Carbon Battery; Could Share Features With Galaxy Z Fold 7

9 May 2025

Buy Now or Pay More Later? ‘Macroeconomic Uncertainty’ Has Shoppers Anxious

9 May 2025

X notifications are broken | The Verge

9 May 2025

Whoop MG With Medical Grade ECG Readings, Blood Pressure Insights Launched Alongside Refreshed Whoop 5.0

9 May 2025
Facebook X (Twitter) Instagram
  • Privacy
  • Terms
  • Advertise
  • Contact Us
Friday, May 9
Facebook X (Twitter) Instagram YouTube
Technophile NewsTechnophile News
Demo
  • Home
  • News
  • PC
  • Phones
  • Android
  • Gadgets
  • Games
  • Guides
  • Accessories
  • Reviews
  • Spotlight
  • More
    • Artificial Intelligence
    • Web Stories
    • Press Release
Technophile NewsTechnophile News
Home » Cloudflare is luring web-scraping bots into an ‘AI Labyrinth’
News

Cloudflare is luring web-scraping bots into an ‘AI Labyrinth’

By News Room22 March 20253 Mins Read
Facebook Twitter Pinterest LinkedIn Telegram Tumblr Reddit WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Email

Cloudflare, one of the biggest network internet infrastructure companies in the world, has announced AI Labyrinth, a new tool to fight web-crawling bots that scrape sites for AI training data without permission. The company says in a blog post that when it detects “inappropriate bot behavior,” the free, opt-in tool lures crawlers down a path of links to AI-generated decoy pages that “slow down, confuse, and waste the resources” of those acting in bad faith.

Websites have long used the honor system approach of robots.txt, a text file that gives or denies permission to scrapers, but which AI companies, even well-known ones like Anthropic and Perplexity AI, have been accused of ignoring. Cloudflare writes that it sees over 50 billion web crawler requests per day, and although it has tools for spotting and blocking the malicious ones, this often prompts attackers to switch tactics in “a never-ending arms race.”

Cloudflare says rather than block bots, AI Labyrinth fights back by making them process data that has nothing to do with a given website’s actual data. The company says it also functions as “a next-generation honeypot,” drawing in AI crawlers that keep following links to fake pages deeper, whereas a regular human being wouldn’t. It says this makes it easier to fingerprint malicious bots for Cloudflare’s list of bad actors as well as identify “new bot patterns and signatures” it wouldn’t have detected otherwise. According to the post, these links shouldn’t be visible to human visitors.

You can read more about how AI Labyrinth works on Cloudflare’s blog, but here’s a bit more detail from the post:

We found that generating a diverse set of topics first, then creating content for each topic, produced more varied and convincing results. It is important to us that we don’t generate inaccurate content that contributes to the spread of misinformation on the Internet, so the content we generate is real and related to scientific facts, just not relevant or proprietary to the site being crawled.

Website administrators can opt into using AI Labyrinth by navigating to the Bot Management section of their site’s Cloudflare dashboard’s settings and toggling it on. The company says that this “is only the first iteration of using generative AI to thwart bots.” It plans to create “whole networks of linked URLs” that bots that end up in will have a hard time clocking as fake. As Ars Technica notes, AI Labyrinth sounds similar to Nepenthes, a tool that’s designed to sideline crawlers for “months” in a hell of AI-generated junk data.

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related News

Buy Now or Pay More Later? ‘Macroeconomic Uncertainty’ Has Shoppers Anxious

9 May 2025

X notifications are broken | The Verge

9 May 2025

Review: Netgear Orbi 770 Series

9 May 2025

Why Apple is trying to save Google Search in the antitrust fight

9 May 2025

Review: Thule Chariot Cross 2 Bike Trailer and Stroller

9 May 2025

A Visit to the ‘Best Bike Shop in the World’

9 May 2025
Top Articles

The Best Laptop Backpacks for Work (and Life)

13 February 202517 Views

The Best Cooling Sheets for Hot Sleepers

30 March 202515 Views

Honor Power Smartphone Set to Launch on April 15; Tipped to Get 7,800mAh Battery

8 April 202514 Views
Stay In Touch
  • Facebook
  • YouTube
  • TikTok
  • WhatsApp
  • Twitter
  • Instagram
Don't Miss

Lenovo Legion 9i With Intel Core Ultra 9 Chip, Up to GeForce RTX 5090 Laptop GPU Announced

9 May 2025

Lenovo Legion 9i was announced at the Tech World Shanghai 2025 on Thursday. It is…

Review: Netgear Orbi 770 Series

9 May 2025

Why Apple is trying to save Google Search in the antitrust fight

9 May 2025

Boat Storm Infinity Plus Smartwatch With Up to 20 Days Battery Launched in India: Price, Specifications

9 May 2025
Technophile News
Facebook X (Twitter) Instagram Pinterest YouTube Dribbble
  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact Us
© 2025 Technophile News. All Rights Reserved.

Type above and press Enter to search. Press Esc to cancel.