Faisal Salman
|
de4978e8d9
|
Add mediaplayer as a new browser.type
|
2024-06-11 09:12:36 +07:00 |
|
Faisal Salman
|
6b642e2838
|
[Extensions submodule] Add ChatGPT-User as fetcher
|
2024-06-08 20:18:56 +07:00 |
|
Faisal Salman
|
5328642e18
|
Update version to 2.0.0-beta.3
|
2024-06-08 01:17:52 +07:00 |
|
Faisal Salman
|
bdcd927304
|
Update test for extensions
|
2024-06-08 00:27:28 +07:00 |
|
Faisal Salman
|
db3423a76c
|
BREAKING - Remove bot type, divide as crawler / fetcher
Add new crawler: Baiduspider, DuckDuckBot, & Sogou Web Spider
Add new fetcher: Mastodon, Pinterestbot, Redditbot, LinkedInBot, Discordbot, Telegrambot, Twitterbot, Snapchat Bot, WhatsApp
|
2024-06-08 00:06:27 +07:00 |
|
Faisal Salman
|
173325faa1
|
Add some well-known bot user-agents: Applebot, Amazonbot, Bytespider, Claudebot, Yandexbot
|
2024-06-06 22:36:15 +07:00 |
|
Faisal Salman
|
39590f112d
|
BREAKING CHANGE - Add new property to browser: type
|
2024-06-02 23:04:25 +07:00 |
|
Faisal Salman
|
4d950db145
|
Update version to 2.0.0-beta.2
|
2024-01-28 22:34:46 +07:00 |
|
Faisal Salman
|
ac282df13e
|
Update version to 2.0.0-beta.1
|
2023-10-02 15:11:31 +07:00 |
|
Faisal Salman
|
f57f8fa1a7
|
Update enums & extensions
|
2023-09-30 14:10:53 +07:00 |
|
Faisal Salman
|
d168b75a3a
|
Bump version 2.0.0-alpha.3
|
2023-08-17 11:29:18 +07:00 |
|
Faisal Salman
|
6e26e38247
|
[extension] Add Axios, jsdom, Scrapy. Also fixes #627 #156 #217 #227
Axios: `axios/VERSION`
https://www.zenrows.com/blog/axios-user-agent#what-is-axios-user-agent
JSDOM: `Mozilla/5.0 (${process.platform || "unknown OS"}) AppleWebKit/537.36 (KHTML, like Gecko) jsdom/${jsdomVersion}`
https://github.com/jsdom/jsdom
Scrapy: `Scrapy/VERSION (+https://scrapy.org)`
https://docs.scrapy.org/en/master/topics/settings.html
|
2023-08-15 11:46:31 +07:00 |
|
Faisal Salman
|
22eae9f70c
|
[extensions] Add GPTBot to Bots
|
2023-08-07 21:39:21 +07:00 |
|
Faisal Salman
|
4c77c5ef21
|
Revive the extensive list of MediaPlayers regexes by @leofiore as an Extension
(Original commit reference: 3fa1fe9f704d716e8f57dea46bccc5724da7b952)
|
2023-04-24 14:58:08 +07:00 |
|
Faisal Salman
|
9102871dea
|
Rearrange the structure of src folders
|
2023-04-21 09:47:51 +07:00 |
|