Commit Graph

978 Commits

Author SHA1 Message Date
Gergő Móricz
afa48e8a6b add read replica 2024-08-31 05:02:43 +02:00
Gergő Móricz
11232bf4f8 add "profiling" 2024-08-31 04:37:45 +02:00
Gergő Móricz
d30f77c8d8 fix(db): switch from postgres-js to pg 2024-08-31 04:01:35 +02:00
Gergő Móricz
acc28a9249 remove rpc for getJobs 2024-08-31 03:06:21 +02:00
Gergő Móricz
453a42910e fix requests.http 2024-08-31 02:23:56 +02:00
Gergő Móricz
8a781f28db drizzle port 2024-08-31 02:19:19 +02:00
Gergő Móricz
693dc14d9b remove invalid keys
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Rust SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Fly Deploy / Build and publish Rust SDK (push) Waiting to run
2024-08-31 00:08:24 +02:00
Nicolas
050cac51ec Update types.ts 2024-08-30 17:02:29 -03:00
Gergo Moricz
c8e0bb93ea fix(crawl-status): handle null data when purging rawHtml 2024-08-30 20:40:57 +02:00
Gergo Moricz
6a6b487474 fix(v1): don't fail on doc = null 2024-08-30 20:28:18 +02:00
Nicolas
71dab56e36 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-08-30 15:21:29 -03:00
Nicolas
d7dbc2536d Update crawl.ts 2024-08-30 15:21:22 -03:00
Nicolas
9de39cfa2c
Merge pull request #591 from mendableai/mog/websocket-sdk
[v1] Websockets SDKs
2024-08-30 15:06:06 -03:00
Nicolas
234c6daee8 Update supabase-jobs.ts 2024-08-30 14:52:59 -03:00
Nicolas
2fd9c285bd
Merge pull request #582 from mendableai/fix--rawHtml-return-on-crawl
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Rust SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Fly Deploy / Build and publish Rust SDK (push) Waiting to run
[Bug] Moved delete rawHtml to end of controller
2024-08-30 12:40:06 -03:00
Gergő Móricz
26d87bd099
fix(api): handle zoderrors earlier 2024-08-30 17:33:42 +02:00
Nicolas
52ac132328
Update auth.ts 2024-08-30 11:10:48 -03:00
Gergő Móricz
d4001e4528 fix(api/websocket): fix auth and termination 2024-08-29 20:01:00 +02:00
Nicolas
1174bc3c82 Nick: blocked sw/ra
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
2024-08-29 13:55:54 -03:00
rafaelsideguide
7eefaffe48 fix: rawHtml for v0 2024-08-29 12:24:14 -03:00
rafaelsideguide
f8323f9b11 fix: moved delete rawHtml to end of controller 2024-08-29 10:02:05 -03:00
Nicolas
02410aca36 Update runWebScraper.ts
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
2024-08-28 22:39:50 -03:00
Nicolas
67229c6b3a Nick: fixed credits issue
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
2024-08-28 18:32:45 -03:00
Nicolas
70bff7f8fb Nick: 2024-08-28 15:59:20 -03:00
Nicolas
8be75accb8 Nick: 2024-08-28 15:40:30 -03:00
Nicolas
547da88ccd Update rate-limiter.test.ts 2024-08-28 14:53:02 -03:00
Nicolas
4edd9a34c7 Nick: totalCount -> total, completedCount -> completed 2024-08-28 14:46:53 -03:00
Nicolas
2a56f89f50 Update index.test.ts 2024-08-28 14:24:26 -03:00
Nicolas
59547d7129 Update index.test.ts 2024-08-28 14:22:26 -03:00
rafaelsideguide
b7f62f93c4 Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-28 14:18:07 -03:00
rafaelsideguide
1c35534e2a fix(v1): check-status for preview 2024-08-28 14:18:05 -03:00
Nicolas
af67b14c9d Nick: 2024-08-28 14:17:59 -03:00
Nicolas
8fbff28009 Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-28 14:09:20 -03:00
Nicolas
08387c06f8 Update auth.ts 2024-08-28 14:09:12 -03:00
rafaelsideguide
ef2d8d012b Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper 2024-08-28 14:07:31 -03:00
rafaelsideguide
5cbf0dcaf5 fix(v1): includeTags 2024-08-28 14:07:28 -03:00
Nicolas
7ba3f3bd1a Nick: 2024-08-28 13:54:39 -03:00
Nicolas
9a13034095 Nick: 2024-08-28 13:46:39 -03:00
Nicolas
ecd07be49e Nick: fixed issues 2024-08-28 13:17:22 -03:00
Nicolas
4003d37fbc Nick: 2024-08-28 12:46:59 -03:00
Nicolas
d872bf0c4c Merge branch 'main' into v1-webscraper 2024-08-28 12:42:23 -03:00
Nicolas
7dff5cdf49 Nick: fixed sdk types and map preview 2024-08-27 20:02:39 -03:00
Nicolas
e7d283c4ef Update job-priority.ts 2024-08-27 17:04:04 -03:00
Nicolas
ca34f1203b Nick: bucket limit increase 2024-08-27 17:03:46 -03:00
Nicolas
f0dfcd6a49 Update job-priority.ts 2024-08-27 16:58:28 -03:00
Nicolas
080240e040 Merge branch 'main' into nsc/job-priority 2024-08-27 16:18:02 -03:00
Nicolas
88239d7211 Merge branch 'main' into v1-webscraper 2024-08-27 16:16:40 -03:00
Nicolas
8c8d0602bb Update rate-limiter.test.ts 2024-08-27 15:38:01 -03:00
Nicolas
bd84e49a77 Update rate-limiter.ts 2024-08-27 15:37:36 -03:00
Nicolas
a0f9a81ee6 Nick: 2024-08-27 15:36:46 -03:00