Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 11:42:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,991 Commits 273 Branches 1 Tag 48 MiB
c2d79e1842
Commit Graph

1532 Commits

Author SHA1 Message Date
Nicolas
5ab52854b9
Merge pull request #757 from busaud/patch-1
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
Update README.md
 2024-10-11 15:50:06 -03:00
Nicolas
5f16688bd4
Merge pull request #766 from mendableai/doc/issue-764 
[Doc] Better explained how includePaths and excludePaths work
 2024-10-11 15:48:19 -03:00
rafaelsideguide
2d3d7c827a fix/added unkwown status to job filter 2024-10-11 15:40:29 -03:00
Rafael Miller
ca51521625
Merge pull request #761 from mendableai/fix/filter-status-unknown-jobs 
[BUG] filters failed and unknown jobs now
 2024-10-11 15:36:16 -03:00
Nicolas
0bff5b1a24 Update auth.ts 2024-10-11 15:29:25 -03:00
Nicolas
257a951132 Update auth.ts 2024-10-11 14:21:04 -03:00
rafaelsideguide
e916ea7e1a updated openapi.json 2024-10-11 13:55:15 -03:00
rafaelsideguide
e57a8e9d45 better explain how includePaths and excludePaths work 2024-10-11 13:52:18 -03:00
rafaelsideguide
c1f98d0371 fixed developer.notion special case 2024-10-11 10:54:59 -03:00
rafaelsideguide
8cbd94ed2d fix/filters failed and unknown jobs now 2024-10-11 09:45:51 -03:00
Nicolas
bfed65d443 Update package.json 2024-10-10 17:46:49 -03:00
Nicolas
2cde877342 Nick: version bump 2024-10-10 17:44:27 -03:00
Nicolas
4960b2b0c2 Merge branch 'main' into feat-sdks/cancel-crawl 2024-10-10 17:43:20 -03:00
rafaelsideguide
2689ffa748 feat-sdk/cancel-crawl 2024-10-10 17:08:08 -03:00
rafaelsideguide
68a4c2e402 Fixed missing error handling in JS-SDK 2024-10-10 16:29:35 -03:00
rafaelsideguide
f113222829 fix: removing test teams concurrency limit
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
2024-10-10 09:46:25 -03:00
busaud
0934dd88d3
Update README.md 
I believe wait_until_done was removed as of v1?
 2024-10-10 09:35:12 +03:00
Nicolas
d410804348
Merge pull request #755 from busaud/main
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details 
bugfix: self-host crawling doesnt respect limit
 2024-10-09 22:56:44 -03:00
Nicolas
abb5ec7439 Update playwright.ts 2024-10-09 22:55:01 -03:00
Nicolas
f6ec45f046
Merge pull request #747 from Harsh0707005/timeout-parameter-not-passed 
Fixed Issue #734
 2024-10-09 22:53:26 -03:00
Nicolas
222a34cae8
Update playwright.ts 2024-10-09 22:53:03 -03:00
busaud
c6ebbc6f6a bugfix: self-host crawling doesnt respect limit 2024-10-09 22:52:49 +00:00
Nicolas
52ec43aac3 Update index.ts 2024-10-09 19:42:25 -03:00
Nicolas
5ff6c64d77 Update index.ts 2024-10-09 19:30:14 -03:00
Gergő Móricz
17d0ed061e push 2024-10-09 23:13:26 +02:00
Gergő Móricz
b2ae1a52d5 fix(Dockerfile): remove chromium 2024-10-09 23:13:13 +02:00
Gergő Móricz
2d365ebc6d fix(redis): protected mode off 2024-10-09 22:09:08 +02:00
busaud
237442fabb Make sure the entrypoint script has the correct line endings 2024-10-09 20:58:37 +02:00
rafaelsideguide
ae464ada60 tests: teamIds
Some checks failed
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Details
Fly Deploy / Deploy app (push) Has been cancelled
Details
Fly Deploy Direct / Deploy app (push) Has been cancelled
Details
2024-10-09 15:06:29 -03:00
Nicolas
1cd49a0a95 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-10-09 14:41:25 -03:00
Nicolas
064ce482c2 Update blocklist.ts 2024-10-09 14:41:23 -03:00
rafaelsideguide
4020a7d781 test: added test suite tokens
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
Fly Deploy / Pre-deploy checks (push) Waiting to run
Details
Fly Deploy / Deploy app (push) Blocked by required conditions
Details
2024-10-08 15:11:08 -03:00
Gergő Móricz
075b63b57b
feat(redis): add memory calcualtion when not running on fly 2024-10-08 17:03:37 +02:00
Harsh Master
aa3d4b8d6c
Fixed Issue #734 2024-10-08 11:36:12 +05:30
Nicolas
5c0c952a27 Update website_params.ts
Some checks are pending
Deploy Images to GHCR / push-app-image (push) Waiting to run
Details
Fly Deploy / Pre-deploy checks (push) Waiting to run
Details
Fly Deploy / Deploy app (push) Blocked by required conditions
Details
2024-10-07 14:51:05 -03:00
Nicolas
1f1afeaac4 Update system-monitor.ts 2024-10-04 15:15:04 -03:00
Nicolas
dba96998e3 Update fetch.ts 2024-10-03 18:56:51 -03:00
Nicolas
668ff3c71b Update fetch.ts 2024-10-03 18:55:39 -03:00
Nicolas
25dd16bf2a Nick: removed 401 2024-10-03 18:52:17 -03:00
Nicolas
93657f6a44 Update queue-worker.ts 2024-10-03 18:44:40 -03:00
Thomas Kosmas
28b64fc704 Change the gracefull shutdown signal 2024-10-04 00:40:09 +03:00
Nicolas
497ac3328b
Merge pull request #732 from mendableai/fix/url-validation-params 
[BUG] Fixed URLs with params
 2024-10-03 17:43:37 -03:00
rafaelsideguide
cfd776a5de fix: now urls with params are passing validation 
example: https://www.granitecreek.com?asljhda=akjshd
 2024-10-03 17:37:04 -03:00
Nicolas
99ca852e5d
Merge pull request #731 from mendableai/nsc/crawl-fixes 
Fixes crawl failed and webhooks not working properly
 2024-10-03 17:37:03 -03:00
Nicolas
85e9f7b9b9
Merge pull request #727 from mendableai/nsc/error-js-sdk-improv 
Improves error handler in Node SDK to return the status code
 2024-10-03 17:36:31 -03:00
Nicolas
4f7608821f Update package.json 2024-10-03 17:36:20 -03:00
Nicolas
f743f2b922 Update index.ts 2024-10-03 17:34:29 -03:00
Nicolas
c6a29efbed Update crawl-status.ts 2024-10-03 17:33:38 -03:00
Nicolas
ddd774ed68 Nick: 2024-10-03 17:20:57 -03:00
Nicolas
82551bb6bc Update index.test.ts 2024-10-03 17:13:30 -03:00