5 Commits

Author	SHA1	Message	Date
Faisal Salman	a4c81a5600	[submodule:extensions] Add new crawler: OAI-SearchBot (OpenAI's bot for SearchGPT)	2024-09-28 10:33:33 +07:00
Faisal Salman	b1dae13245	[extension][bot] Add AhrefsBot, AhrefsSiteAudit, Dotbot, Rogerbot, Uptimerobot, Coc Coc Bot	2024-08-20 14:06:06 +07:00
Pablo Osés	68ae2a76de	adding detection of MJ12Bot and SemrushBot into extension Crawlers including testing (#738)	2024-08-14 10:46:46 +07:00
Faisal Salman	a74ace8dd1	Add Yahoo! Japan to Crawler, Fetcher, & InApp browser	2024-06-22 00:13:13 +07:00
Faisal Salman	bdcd927304	Update test for extensions	2024-06-08 00:27:28 +07:00