Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 11:42:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
2,146 Commits 273 Branches 1 Tag 48 MiB
f07bbef78e
Commit Graph

1633 Commits

Author SHA1 Message Date
rafaelmmiller
f07bbef78e added trycatch and removed redundancy 2024-11-05 08:11:49 -03:00
Dmitriy Vasilyuk
2fa25cb992
[Fix] Prevent Python Firecrawl logger from interfering with loggers in client applications (#613)
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
* Prevent firecrawl logger from interfering with other loggers

* Always check if logger has handlers

---------

Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
 2024-11-05 08:33:39 +01:00
Nicolas
9e22c9a428 Nick: etier1a
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-11-04 18:14:38 -05:00
Rafael Miller
8297e5beef
Merge branch 'main' into fix/remove-base64-images 2024-11-04 10:35:09 -03:00
rafaelmmiller
4c5bb21a6f added remove base64 images options (true by default) 2024-11-04 10:31:44 -03:00
Eric Ciarla
2eff27ba43
Merge pull request #847 from mendableai/nsc/mobile-support
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details 
Adds support for mobile web scraping + mobile screenshot
 2024-11-02 11:16:33 -04:00
rafaelsideguide
61f659190d bumped js-sdk version 2024-11-01 12:44:29 -03:00
rafaelsideguide
28db4dd3b5 fixed zod validation for wait 2024-11-01 12:40:40 -03:00
Nicolas
80beedb46f Update index.ts 2024-10-31 20:03:19 -03:00
Nicolas
446acfccde Nick: support for the new actions 2024-10-31 20:01:52 -03:00
Thomas Kosmas
3911fe1fba Fix
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-31 18:14:20 +02:00
Thomas Kosmas
6e5c95d5e7 fix bug 2024-10-31 17:55:43 +02:00
Thomas Kosmas
3eb79f1293 Fix dockerfile 2024-10-31 17:52:38 +02:00
Thomas Kosmas
ae919ad896 Fix go parser 2024-10-31 17:36:32 +02:00
rafaelsideguide
367af9512f added iframe links to extractLinksFromHTML 2024-10-31 10:53:47 -03:00
Thomas Kosmas
fe02101a12 Iframe support 2024-10-31 14:40:33 +02:00
Nicolas
47d276d3b5 Update rate-limiter.ts 2024-10-30 17:19:37 -03:00
Nicolas
ea85b1d602 Merge branch 'main' into mog/concurrency-limit-2 2024-10-30 17:05:40 -03:00
Nicolas
96c579f1cd Nick: etier2c
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-29 21:01:43 -03:00
Nicolas
e0ba339c50 Update auth.ts 2024-10-29 16:06:12 -03:00
Nicolas
6948ca6fe1 Revert "Update auth.ts" 
This reverts commit 7152ac8856.
 2024-10-29 16:02:21 -03:00
Nicolas
7152ac8856 Update auth.ts 2024-10-29 15:58:20 -03:00
Nicolas
c00cd21308 Nick: adds support for mobile web scraping 2024-10-29 14:10:40 -03:00
Nicolas
6d38c65466 Update package.json 2024-10-28 20:25:28 -03:00
Nicolas
07e76f2ba5 Merge branch 'main' into nsc/geo-to-location 2024-10-28 20:24:29 -03:00
Nicolas
b6ce49e5bb Update index.ts 2024-10-28 20:24:16 -03:00
Nicolas
3d1bb82aa2 Nick: languages support 2024-10-28 20:16:11 -03:00
Nicolas
0bad436061 Nick: fixed the batch scrape + llm extract billing
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-28 17:04:42 -03:00
Nicolas
726430c2e6 Nick: llm extract in batch scrape 2024-10-28 16:51:49 -03:00
Nicolas
d2d5c0b6c0
Merge pull request #838 from mendableai/nsc/rm-wait-before-click 
RM wait before interacting
 2024-10-28 16:06:31 -03:00
Nicolas
a13c2442e6
Merge pull request #628 from SearchApi/feature/add-searchapi-search 
Add SearchApi as a Web Search Tool
 2024-10-28 16:04:56 -03:00
Nicolas
fa8875d64d Update single_url.ts 2024-10-28 15:09:50 -03:00
Nicolas
877d5e4383 Update types.ts 2024-10-27 23:17:20 -03:00
Nicolas
68b2e1b209 Update log_job.ts 2024-10-27 23:14:25 -03:00
Nicolas
8a4f4cb9d9
Update README.md
Some checks failed
Deploy Images to GHCR / push-app-image (push) Has been cancelled
Details
2024-10-26 16:10:51 -03:00
Nicolas
9593ab80e1
Update README.md 2024-10-26 16:03:07 -03:00
Nicolas
801f0f773e Nick: fix auto charge failing when payment is through Link
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-26 03:59:15 -03:00
Nicolas
97b8d6c333 Update auto_charge.ts 2024-10-25 16:05:39 -03:00
Nicolas
95c4652fd4 Nick: 10min cooldown on auto charge 2024-10-25 16:05:23 -03:00
Gergő Móricz
4468a49aee concurrency limit fix PoC II. 2024-10-25 20:21:12 +02:00
Nicolas
4590577cba Merge branch 'main' into nsc/pay-as-you-go-lw2 2024-10-25 14:02:24 -03:00
Nicolas
dbcf2d7ff6 Nick: fix loggin for batch scrape
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-24 23:44:08 -03:00
Nicolas
73e6db45de Update email_notification.ts 2024-10-24 23:14:41 -03:00
Nicolas
d965f2ce7d Nick: fixes 2024-10-24 23:13:30 -03:00
Nicolas
29b34270c8 Merge branch 'main' into nsc/pay-as-you-go-lw2 2024-10-24 22:31:04 -03:00
Gergő Móricz
1da6360b77 feat(batch/scrape): restructure logs, add webhooks
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-23 21:55:21 +02:00
Nicolas
19cac2220f Nick: 2024-10-23 16:31:01 -03:00
Nicolas
b11035814a Nick: 2024-10-23 16:10:21 -03:00
Nicolas
f0054da934 Nick: lgtm 2024-10-23 16:06:08 -03:00
Nicolas
c7f2170980 Update example.py 2024-10-23 16:04:46 -03:00