Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 11:42:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,114 Commits 273 Branches 1 Tag 48 MiB
nsc/mobile-support
Commit Graph

2114 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nicolas
c00cd21308 Nick: adds support for mobile web scraping 2024-10-29 14:10:40 -03:00
Nicolas
c96b36d045
Merge pull request #830 from mendableai/nsc/geo-to-location
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
Geo-location rename to location
 2024-10-28 20:28:30 -03:00
Nicolas
6d38c65466 Update package.json 2024-10-28 20:25:28 -03:00
Nicolas
07e76f2ba5 Merge branch 'main' into nsc/geo-to-location 2024-10-28 20:24:29 -03:00
Nicolas
b6ce49e5bb Update index.ts 2024-10-28 20:24:16 -03:00
Nicolas
3d1bb82aa2 Nick: languages support 2024-10-28 20:16:11 -03:00
Nicolas
0bad436061 Nick: fixed the batch scrape + llm extract billing
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-28 17:04:42 -03:00
Nicolas
726430c2e6 Nick: llm extract in batch scrape 2024-10-28 16:51:49 -03:00
Nicolas
298a343a90
Merge pull request #831 from twlite/patch-1 
chore(README.md): use `satisfies` instead of `as` for ts example
 2024-10-28 16:06:41 -03:00
Nicolas
d2d5c0b6c0
Merge pull request #838 from mendableai/nsc/rm-wait-before-click 
RM wait before interacting
 2024-10-28 16:06:31 -03:00
Nicolas
a13c2442e6
Merge pull request #628 from SearchApi/feature/add-searchapi-search 
Add SearchApi as a Web Search Tool
 2024-10-28 16:04:56 -03:00
Nicolas
ea0f458b9f
Merge pull request #739 from s-smits/main 
Bump to gemini-1.5-pro-002 website_qa_with_gemini_caching.ipynb and add flash example
 2024-10-28 15:49:04 -03:00
Nicolas
19ed042181
Merge pull request #829 from mendableai/nsc/prevent-single-url-logs 
Remove ph logs for single_urls
 2024-10-28 15:47:44 -03:00
Nicolas
fa8875d64d Update single_url.ts 2024-10-28 15:09:50 -03:00
Nicolas
007e3edfc5
Update README.md 2024-10-28 12:40:04 -03:00
Eric Ciarla
e3e8375c7d Add AgentOps Monitoring 2024-10-28 11:13:33 -04:00
Twilight
b48eed5716
chore(README.md): use satisfies instead of as for ts example 2024-10-28 09:40:35 +05:45
Nicolas
877d5e4383 Update types.ts 2024-10-27 23:17:20 -03:00
Nicolas
68b2e1b209 Update log_job.ts 2024-10-27 23:14:25 -03:00
Nicolas
8a4f4cb9d9
Update README.md
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details
2024-10-26 16:10:51 -03:00
Nicolas
9593ab80e1
Update README.md 2024-10-26 16:03:07 -03:00
Nicolas
801f0f773e Nick: fix auto charge failing when payment is through Link
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-26 03:59:15 -03:00
Nicolas
20e5348e9a
Merge pull request #809 from mendableai/nsc/pay-as-you-go-lw2
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
feat: Auto Recharge Credits + Credit Packs
 2024-10-25 16:15:08 -03:00
Nicolas
97b8d6c333 Update auto_charge.ts 2024-10-25 16:05:39 -03:00
Nicolas
95c4652fd4 Nick: 10min cooldown on auto charge 2024-10-25 16:05:23 -03:00
Nicolas
4590577cba Merge branch 'main' into nsc/pay-as-you-go-lw2 2024-10-25 14:02:24 -03:00
Nicolas
dbcf2d7ff6 Nick: fix loggin for batch scrape
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-24 23:44:08 -03:00
Nicolas
73e6db45de Update email_notification.ts 2024-10-24 23:14:41 -03:00
Nicolas
d965f2ce7d Nick: fixes 2024-10-24 23:13:30 -03:00
Nicolas
29b34270c8 Merge branch 'main' into nsc/pay-as-you-go-lw2 2024-10-24 22:31:04 -03:00
Eric Ciarla
9a4ccd0801 Claude Web Crawler with Batch Scrape
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-24 14:40:53 -04:00
Gergő Móricz
1da6360b77 feat(batch/scrape): restructure logs, add webhooks
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-23 21:55:21 +02:00
Nicolas
e3cb00990a Merge branch 'mog/bulk-scrape' 2024-10-23 16:31:14 -03:00
Nicolas
19cac2220f Nick: 2024-10-23 16:31:01 -03:00
Nicolas
76ca7fdcb5
Merge pull request #789 from mendableai/mog/bulk-scrape 
feat: Batch Scrape
 2024-10-23 16:12:42 -03:00
Nicolas
b11035814a Nick: 2024-10-23 16:10:21 -03:00
Nicolas
f0054da934 Nick: lgtm 2024-10-23 16:06:08 -03:00
Nicolas
c7f2170980 Update example.py 2024-10-23 16:04:46 -03:00
Nicolas
60b6e6b1d4 Nick: fixes 2024-10-23 15:59:40 -03:00
Nicolas
d8abd15716 Nick: from bulk to batch 2024-10-23 15:37:24 -03:00
Gergő Móricz
70c4e7c334 feat(bulk/scrape): check credits via url list length 2024-10-23 19:42:02 +02:00
Nicolas
66e505317e Merge branch 'main' into mog/bulk-scrape 2024-10-23 14:36:26 -03:00
Nicolas
e0d3b761fc
Merge pull request #808 from mendableai/feat/skipTlsVerification
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
feat: skipTlsVerification
 2024-10-22 20:47:13 -03:00
Nicolas
7432f25523
Merge pull request #807 from mendableai/mog/acuc-cache-clear 
feat: clear ACUC cache endpoint based on team ID
 2024-10-22 20:43:18 -03:00
Nicolas
d375bca167 Update acuc-cache-clear.ts 2024-10-22 20:42:59 -03:00
Nicolas
bbfdda8867 Nick: init 2024-10-22 19:47:23 -03:00
Thomas Kosmas
acde353e56 skipTlsVerification on robots.txt scraping 2024-10-23 01:07:03 +03:00
Thomas Kosmas
bd55464b52 skipTlsVerification 2024-10-22 22:28:02 +03:00
Gergő Móricz
6ed3104eb6 feat: clear ACUC cache endpoint based on team ID 2024-10-22 20:28:10 +02:00
Gergő Móricz
3cd328cf93 feat(bulk/scrape): add node and python SDK integration + docs 2024-10-22 18:58:48 +02:00