Faisal Salman
|
c9badeb345
|
[extensions] Add new crawlers: Algolia, Baidu, BLEXBot, Botify, Freespoke, Marginalia, MSNBot, OnCrawl, SeekportBot, Siteimprove, TwinAgent, YepBot, ZumBot
|
2025-08-21 21:40:50 +07:00 |
|
Faisal Salman
|
9003fe5724
|
[extensions] Add new bots: Algolia Crawler, contxbot, HubSpot Page Fetcher, Kagibot
|
2025-08-15 20:42:41 +07:00 |
|
Faisal Salman
|
975c4860f4
|
[extensions][helpers] Add some new AI bots: Bravebot, Cotoyogi, FirecrawlAgent, HuggingFace-Bot, Kangaroo Bot, PanguBot, Replicate-Bot, RunPod-Bot, Together-Bot, xAI-Bot
|
2025-08-14 20:42:17 +07:00 |
|
Faisal Salman
|
647b6232bd
|
[extensions][helpers] Add some bots from Vercel: v0bot, vercel-favicon-bot, vercel-screenshot-bot, vercelflags, verceltracing
|
2025-08-14 19:34:14 +07:00 |
|
Faisal Salman
|
95485f7b5d
|
[extensions][helpers] Add new bots: cohere-training-data-crawler, Gemini-Deep-Research, kakaotalk-scrap, TikTokSpider
|
2025-08-11 13:14:45 +07:00 |
|
Faisal Salman
|
74ef71cf63
|
[extensions][helpers] Add new bots: Asana, bitlybot, Chrome-Lighthouse, DeepSeekBot, DuckDuckGo-Favicons-Bot, Elastic, Zoombot
|
2025-08-10 00:40:20 +07:00 |
|
Faisal Salman
|
0bb6e24837
|
[extensions] Add new bots: Blueno, BufferLinkPreviewBot, Claude-SearchBot, Claude-User, Coveobot, CriteoBot
|
2025-07-22 12:29:01 +07:00 |
|
Faisal Salman
|
ee88f16620
|
[extensions] Add new email: Apple's Mail, DaumMail, Polymail, ProtonMail, SparkDesktop, Zimbra, ZohoMail-Desktop
|
2025-06-18 19:07:14 +07:00 |
|
Faisal Salman
|
d28d74fea7
|
[extensions] Add new apps: Discord, Evernote, Figma, Flipboard, Mattermost, Notion, Postman, Rambox, Rocket.Chat, Teams, TikTok Lite, VS Code
|
2025-06-17 01:50:33 +07:00 |
|
Faisal Salman
|
1282175bac
|
[extensions] Add new libraries: AdobeAIR, aiohttp, nutch, httpx, urllib3
|
2025-06-10 23:05:03 +07:00 |
|
Faisal Salman
|
72d0c2acb3
|
[extensions] Add new crawler bots: ChatGLM, Onespot, Startpage
|
2025-06-03 11:07:27 +07:00 |
|
Faisal Salman
|
a3549efc22
|
[extensions] Add new bots: Daumoa, iAskBot, Iframely, Qwantbot
|
2025-05-30 23:16:02 +07:00 |
|
Faisal Salman
|
64a933bae8
|
[extensions] Add new fetcher: MistralAI-User, Perplexity-User
|
2025-05-20 16:46:40 +07:00 |
|
Faisal Salman
|
367eae4c85
|
[extensions] Add new Vehicles: BMW, Jeep Wagooner
|
2025-03-07 10:15:47 +07:00 |
|
Faisal Salman
|
a9b31c0f7b
|
[extensions] Add bots: AdIdxBot, Linespider, LinkedInBot, MicrosoftPreview, OpenAI Image Downloader
|
2025-03-07 00:15:54 +07:00 |
|
Faisal Salman
|
8a05328ce0
|
[extensions] Improve inapp browser detection: Slack, Yahoo! Japan
|
2025-03-06 21:03:29 +07:00 |
|
Faisal Salman
|
3d41647a55
|
[extensions] Update some more bots #780: Better Uptime Bot, SemrushBot, Yahoo! Slurp
|
2025-03-04 11:16:16 +07:00 |
|
Faisal Salman
|
178e678b15
|
[extensions] Update some fetcher bots #780 - Google-PageRenderer, GoogleImageProxy, Snap URL Preview, SkypeUriPreview, TelegramBot
|
2025-03-01 08:08:44 +07:00 |
|
Faisal Salman
|
837d319630
|
[extensions][helpers] Update Semrush bot variants
|
2025-02-20 21:53:49 +07:00 |
|
Faisal Salman
|
d024fe2006
|
[extensions] Fix #770 - Add new fetcher bot: Bluesky
|
2024-12-03 21:48:01 +07:00 |
|
Faisal Salman
|
1a057b4be2
|
Reorganize test files & directories
|
2024-11-28 23:24:19 +07:00 |
|