Cloudflare Reveals Most Founded And Blocked AI Bots On The Internet

Data bot Ai dari Cloudflare (photo: Cloudflare)

JAKARTA - Launching Darkvistor, the so-called termite Bot AI, will work by creeping or visiting certain websites with information density, to train their AI models.

Cloudflare's latest AI bot trend report sees that Bytespider, Amazonbot, ClaudeBot, and GPTBot are the four most common AI bots or visit websites to train their AI models.

Operated by ByteDance, a Chinese company owned by TikTok, Bytespider is reportedly used to collect training data for a large language model (LLM), including those supporting its ChatGPT rival, Doubao.

Meanwhile, Amazonbot and ClaudeBot follow Bytespider in the volume of demand. Amazonbot, reportedly used to index content for Alexa's questions, sent the second highest number of requests.

Meanwhile, ClaudeBot, Cloudflare revealed that the bot used to train Claude's chat bot recently increased in demand volume.

Among the top AI bots, Bytespider does not only lead to the number of requests but also in internet access or access rates and the frequency is blocked at most.

Following Bytespider, the GPTBot managed by OpenAI occupies second place, where they collect training data for its LLM, which supports AI-driven products such as ChatGPT.

Berikut adalah daftar bot AI dengan tingkat perayapan atau penakesan internet terbanyak versi Cloudflare: