Commit Graph

1979 Commits

Author SHA1 Message Date
Nicolas
03eb47d426 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-18 15:58:54 -04:00
Nicolas
3a4dd8fc7e Nick: v1 openapi spec 2024-09-18 15:58:53 -04:00
Gergő Móricz
712ca31615 minor fixes 2024-09-18 21:34:09 +02:00
Nicolas
d338c3402b
Update CONTRIBUTING.md 2024-09-18 15:18:44 -04:00
Gergő Móricz
20d1855ad5 feat(js-sdk): actions integration 2024-09-18 20:47:56 +02:00
Gergő Móricz
093c064bff feat(v1): add public actions api 2024-09-18 20:39:25 +02:00
Gergő Móricz
42d677fe3c feat(fire-engine): port waitFor and screenshot to use actions 2024-09-18 20:04:54 +02:00
Gergő Móricz
c28e1e2959 fix(v1/zod): formats: add error message if both sc and sc@fP
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-18 19:35:38 +02:00
Nicolas
255db84879 Update package.json
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-17 15:06:53 -04:00
Gergő Móricz
b2b7f8d874 fix(js-sdk): default type for LLM extract 2024-09-17 20:49:01 +02:00
Nicolas
43d8563bb1
Update fly-direct.yml 2024-09-17 14:15:34 -04:00
Harsha
d76cb6a6d2
fix space in the folder name 2024-09-17 12:56:05 -05:00
Nicolas
a0189acbec Update fly.yml 2024-09-17 12:58:49 -04:00
Nicolas
31633317dd Update package.json 2024-09-17 12:33:07 -04:00
Nicolas
6b920aa87f
Merge pull request #677 from mendableai/fix/js-sdk-full-page-screenshot
[Bug] Fixed screenshot typo and added test for fullpage screenshot
2024-09-17 12:31:57 -04:00
rafaelsideguide
fb8a2c7549 fixed screenshot typo and added test for fullpage screenshot 2024-09-17 11:03:33 -04:00
Nicolas
3c2bfe2da2
Update single_url.ts
Some checks are pending
Fly Deploy / Deploy app (push) Waiting to run
2024-09-17 01:58:47 -04:00
Nicolas
18b024c238 Update single_url.ts 2024-09-17 01:41:46 -04:00
Nicolas
a4039bd008 Revert "Update single_url.ts"
This reverts commit 0f8c0a570d.
2024-09-16 23:36:38 -04:00
Nicolas
a6e1b17386
Update README.md 2024-09-16 21:53:51 -04:00
Nicolas
66577d1d03
Update fly.yml 2024-09-16 21:53:35 -04:00
Nicolas
358f8f9def
Update fly-direct.yml 2024-09-16 21:50:56 -04:00
Nicolas
4884439fd9
Update fly.yml 2024-09-16 21:48:12 -04:00
Nicolas
473e8491b5
Update README.md 2024-09-16 21:46:54 -04:00
Nicolas
d21a797ef9
Update fly.yml 2024-09-16 21:46:40 -04:00
Nicolas
0f8c0a570d
Update single_url.ts 2024-09-16 21:44:56 -04:00
Eric Ciarla
b7444acb4d
Merge pull request #676 from mendableai/o1-crawler
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Rust SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Fly Deploy / Build and publish Rust SDK (push) Blocked by required conditions
O1 crawler example
2024-09-16 16:07:07 -04:00
Eric Ciarla
2619522fe7
Merge branch 'main' into o1-crawler 2024-09-16 16:06:15 -04:00
Eric Ciarla
e58144798f Update o1_web_crawler.py 2024-09-16 16:04:32 -04:00
Nicolas
9da3432596 Update map.ts 2024-09-16 12:03:14 -04:00
Eric Ciarla
8c05aed6e9 Finishing o1 crawler example 2024-09-16 11:30:25 -04:00
Eric Ciarla
3900603a28 Almost done 2024-09-16 11:18:57 -04:00
Nicolas
af4804e13b Merge branch 'main' into nsc/map-pagination 2024-09-16 11:04:44 -04:00
Nicolas
98de36feb2
Merge pull request #664 from mendableai/nsc/manual-rate-limit
Some checks failed
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Fly Deploy / Test Suite (push) Has been cancelled
Fly Deploy / Python SDK Tests (push) Has been cancelled
Fly Deploy / JavaScript SDK Tests (push) Has been cancelled
Fly Deploy / Go SDK Tests (push) Has been cancelled
Fly Deploy / Rust SDK Tests (push) Has been cancelled
Fly Deploy / Deploy app (push) Has been cancelled
Fly Deploy / Build and publish Python SDK (push) Has been cancelled
Fly Deploy / Build and publish JavaScript SDK (push) Has been cancelled
Fly Deploy / Build and publish Rust SDK (push) Has been cancelled
Manual Rate Limiter for select team ids
2024-09-13 18:12:41 -04:00
Nicolas
030ecab6ee Update rate-limiter.ts 2024-09-13 18:09:59 -04:00
Eric Ciarla
2ee7d1d0e4 init 2024-09-13 15:08:23 -04:00
Gergo Moricz
000a316cc3 fix(fire-engine): poll more frequently
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Rust SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Fly Deploy / Build and publish Rust SDK (push) Blocked by required conditions
2024-09-13 16:41:27 +02:00
Gergo Moricz
f7c4cee404 fix(queue-worker): don't send LLM extract hallucination error to Sentry 2024-09-13 14:02:49 +02:00
Gergő Móricz
0d1b46d476 fix(js-sdk): improve error logging 2024-09-12 21:30:17 +02:00
Nicolas
e6ac90c1a0 Update package.json 2024-09-12 14:01:47 -04:00
Gergő Móricz
d30356a22c fix(js-sdk): infer keyword collision 2024-09-12 19:57:33 +02:00
Gergő Móricz
d497284b40 feat(api/queue): auto-remove completed jobs after 25 hours 2024-09-12 19:47:22 +02:00
Nicolas
620b02f9ca Nick: 2024-09-12 12:51:14 -04:00
Gergő Móricz
a2903e75cf feat(js-sdk): type-safe LLM extract 2024-09-12 18:48:19 +02:00
Nicolas
eec22a56d3 Nick: self host issue template 2024-09-12 11:43:40 -04:00
Nicolas
ee38273ff9
Merge pull request #653 from mendableai/mog/fix-status-job-get
fix(v0/crawl-status): don't crash on big crawls when requesting jobs from supa
2024-09-12 11:39:42 -04:00
Nicolas
e1171ade1b Merge branch 'main' into mog/fix-status-job-get 2024-09-12 11:35:36 -04:00
Nicolas
503c8b3efa Update package-lock.json 2024-09-12 11:35:26 -04:00
Nicolas
e19dc68718 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-09-11 14:59:40 -04:00
Nicolas
99c1af0a9f Update package.json 2024-09-11 14:59:36 -04:00