12 Commits

Author SHA1 Message Date
Faisal Salman
647b6232bd [extensions][helpers] Add some bots from Vercel: v0bot, vercel-favicon-bot, vercel-screenshot-bot, vercelflags, verceltracing 2025-08-14 19:34:14 +07:00
Faisal Salman
95485f7b5d [extensions][helpers] Add new bots: cohere-training-data-crawler, Gemini-Deep-Research, kakaotalk-scrap, TikTokSpider 2025-08-11 13:14:45 +07:00
Faisal Salman
74ef71cf63 [extensions][helpers] Add new bots: Asana, bitlybot, Chrome-Lighthouse, DeepSeekBot, DuckDuckGo-Favicons-Bot, Elastic, Zoombot 2025-08-10 00:40:20 +07:00
Faisal Salman
0bb6e24837 [extensions] Add new bots: Blueno, BufferLinkPreviewBot, Claude-SearchBot, Claude-User, Coveobot, CriteoBot 2025-07-22 12:29:01 +07:00
Faisal Salman
a3549efc22 [extensions] Add new bots: Daumoa, iAskBot, Iframely, Qwantbot 2025-05-30 23:16:02 +07:00
Faisal Salman
64a933bae8 [extensions] Add new fetcher: MistralAI-User, Perplexity-User 2025-05-20 16:46:40 +07:00
Faisal Salman
a9b31c0f7b [extensions] Add bots: AdIdxBot, Linespider, LinkedInBot, MicrosoftPreview, OpenAI Image Downloader 2025-03-07 00:15:54 +07:00
Faisal Salman
3d41647a55 [extensions] Update some more bots #780: Better Uptime Bot, SemrushBot, Yahoo! Slurp 2025-03-04 11:16:16 +07:00
Faisal Salman
178e678b15 [extensions] Update some fetcher bots #780 - Google-PageRenderer, GoogleImageProxy, Snap URL Preview, SkypeUriPreview, TelegramBot 2025-03-01 08:08:44 +07:00
Faisal Salman
837d319630 [extensions][helpers] Update Semrush bot variants 2025-02-20 21:53:49 +07:00
Faisal Salman
d024fe2006 [extensions] Fix #770 - Add new fetcher bot: Bluesky 2024-12-03 21:48:01 +07:00
Faisal Salman
1a057b4be2 Reorganize test files & directories 2024-11-28 23:24:19 +07:00