Nicolas
|
bf1d325aa9
|
Merge pull request #512 from mendableai/nsc/digikey-tls
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Fly Deploy / Test Suite (push) Has been cancelled
Fly Deploy / Python SDK Tests (push) Has been cancelled
Fly Deploy / JavaScript SDK Tests (push) Has been cancelled
Fly Deploy / Deploy app (push) Has been cancelled
Fly Deploy / Build and publish Python SDK (push) Has been cancelled
Fly Deploy / Build and publish JavaScript SDK (push) Has been cancelled
Digikey support
|
2024-08-08 12:34:18 -04:00 |
|
Nicolas
|
f1f5605010
|
Update website_params.ts
|
2024-08-08 12:31:58 -04:00 |
|
Nicolas
|
b0abad07da
|
Merge pull request #496 from tak-s/improve-logging-level
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Improve logs
|
2024-08-07 22:01:12 -04:00 |
|
Gergo Moricz
|
920b7f2f44
|
fix(runWebScraper): don't filter empty docs
|
2024-08-07 21:00:22 +02:00 |
|
Gergo Moricz
|
55ec96c23f
|
fix(queue-worker): bad job lock extension time
|
2024-08-07 20:24:16 +02:00 |
|
Gergo Moricz
|
ab7a35c581
|
fix(queue-worker): log lock extensions
|
2024-08-07 19:49:48 +02:00 |
|
Gergo Moricz
|
a1c2ee5aa9
|
fix: always complete job, no try
|
2024-08-07 19:39:09 +02:00 |
|
Gergo Moricz
|
191dfbd9ca
|
fix: move to completed in one place
|
2024-08-07 18:49:58 +02:00 |
|
Nicolas
|
457c082ba1
|
Nick: fixed tests
|
2024-08-07 11:08:53 -04:00 |
|
Nicolas
|
8a992b1596
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
|
2024-08-07 10:40:06 -04:00 |
|
Nicolas
|
b12e1157cc
|
Nick: v35 bump
|
2024-08-07 10:40:00 -04:00 |
|
Gergő Móricz
|
5fc7fcb77c
|
Merge branch 'main' into feat/queue-scrapes
|
2024-08-07 16:35:44 +02:00 |
|
Gergo Moricz
|
fe9fdb578b
|
revert bad hotfixes
|
2024-08-07 16:34:25 +02:00 |
|
Gergo Moricz
|
b7c01dcb9b
|
fix(webScraperQueue): reduce retries to 2
|
2024-08-07 16:31:50 +02:00 |
|
Gergo Moricz
|
cdf7bad5b4
|
fix(runWebScraper): don't move to completed
|
2024-08-07 15:20:56 +02:00 |
|
Gergo Moricz
|
9df8719efa
|
fix(queue-worker): raise queue log level to info
|
2024-08-07 14:56:04 +02:00 |
|
Gergo Moricz
|
7bb922071c
|
fix(queue-worker): manually renew lock (testing)
|
2024-08-07 14:35:20 +02:00 |
|
Gergo Moricz
|
8216266d16
|
fix(scrape_log): display error properly
|
2024-08-07 14:19:20 +02:00 |
|
Gergo Moricz
|
2e2e80d679
|
fix(scrape-events): updateScrapeResult fix
|
2024-08-07 14:17:50 +02:00 |
|
Gergo Moricz
|
b5ec47fd96
|
fix(runWebScraper): don't fetch next job
|
2024-08-07 13:53:04 +02:00 |
|
Nicolas
|
44c9a22731
|
Merge pull request #508 from mendableai/mog/js-sdk-cjs
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
fix(js-sdk): build both CJS and EJS versions
|
2024-08-06 19:46:20 -04:00 |
|
Gergo Moricz
|
020a5efdb7
|
Revert "Revert "Merge pull request #432 from mendableai/mog/js-sdk-cjs""
This reverts commit 5da4472842.
|
2024-08-07 01:27:26 +02:00 |
|
Gergő Móricz
|
7380d7799f
|
Merge branch 'main' into mog/js-sdk-cjs
|
2024-08-07 01:12:36 +02:00 |
|
Gergo Moricz
|
5f7724205f
|
fix(js-sdk): re-add types
|
2024-08-07 01:06:21 +02:00 |
|
Nicolas
|
f294d3922c
|
Nick: revert
|
2024-08-06 18:44:45 -04:00 |
|
Nicolas
|
5da4472842
|
Revert "Merge pull request #432 from mendableai/mog/js-sdk-cjs"
This reverts commit bb90e03dea, reversing
changes made to 3321ca9398.
|
2024-08-06 18:41:06 -04:00 |
|
Nicolas
|
a67a5c04c9
|
Revert "Merge pull request #432 from mendableai/mog/js-sdk-cjs"
This reverts commit bb90e03dea, reversing
changes made to 3321ca9398.
|
2024-08-06 18:02:56 -04:00 |
|
Nicolas
|
bb90e03dea
|
Merge pull request #432 from mendableai/mog/js-sdk-cjs
fix(js-sdk): build both CommonJS and ESM versions
|
2024-08-06 17:38:57 -04:00 |
|
Nicolas
|
3321ca9398
|
Merge pull request #504 from mendableai/feat/fullpage-screenshot
[Feat] Added fullpagescreenshot capabilities
|
2024-08-06 13:52:29 -04:00 |
|
Gergo Moricz
|
b60ee30dba
|
fix(single_url): accept 500
|
2024-08-06 18:00:56 +02:00 |
|
Gergo Moricz
|
06751a8e21
|
fix(crawl-status): missing partial data after cancel
|
2024-08-06 17:31:20 +02:00 |
|
Gergo Moricz
|
810b98ec38
|
fix(scrape): fix timeout error code
|
2024-08-06 17:30:01 +02:00 |
|
Gergo Moricz
|
3ae95a2740
|
fix(scrape): consider timeout property
|
2024-08-06 17:25:58 +02:00 |
|
Gergo Moricz
|
8566ece700
|
fix(scrape): pass extractorOptions
|
2024-08-06 17:15:19 +02:00 |
|
Gergo Moricz
|
8e0aa69603
|
fix(crawl-status): partial_data
|
2024-08-06 17:06:21 +02:00 |
|
Gergo Moricz
|
1ab119c874
|
fix(scrape): don't double-bill for scrape
|
2024-08-06 16:57:23 +02:00 |
|
Gergo Moricz
|
7c5cda7b45
|
fix(queue-worker): concurrency
|
2024-08-06 16:57:00 +02:00 |
|
Gergo Moricz
|
d7d63790e5
|
fix(crawl-status): isCancelled should be status failed
|
2024-08-06 16:35:55 +02:00 |
|
Gergo Moricz
|
03c84a9372
|
cleanup and fix cancelling
|
2024-08-06 16:26:46 +02:00 |
|
rafaelsideguide
|
4d24a99d50
|
fix params
|
2024-08-06 09:34:43 -03:00 |
|
Nicolas
|
e195ddbef4
|
Merge branch 'main' into nsc/hyper-v81
|
2024-08-05 20:47:39 -04:00 |
|
Nicolas
|
72f2c3616f
|
Merge pull request #503 from mendableai/bugfix/empty-excludes
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
[Bug] Fixed the empty excludes.filter is undefined bug
|
2024-08-05 20:42:21 -04:00 |
|
rafaelsideguide
|
3edc3a3d15
|
added fullpagescreenshot capabilities, wip on fire-engine side
|
2024-08-05 18:17:37 -03:00 |
|
rafaelsideguide
|
f32e8de156
|
fixes the empty excludes.filter undefined bug
|
2024-08-05 18:13:31 -03:00 |
|
KentHsu
|
b2e1b2ca68
|
chore: add go-sdk-tests job
|
2024-08-04 17:33:36 +08:00 |
|
KentHsu
|
1378ffc138
|
feat: add go-sdk
|
2024-08-04 17:33:33 +08:00 |
|
tak-s
|
af9bc5c8bb
|
Suppressed repetitive logs
|
2024-08-04 15:09:36 +09:00 |
|
tak-s
|
db926a4146
|
set LOGGING_LEVEL to environment
|
2024-08-04 15:05:53 +09:00 |
|
Nicolas
|
789c6cf5d7
|
Merge pull request #494 from mendableai/nsc/website-param-fixes
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Fly Deploy / Test Suite (push) Has been cancelled
Fly Deploy / Python SDK Tests (push) Has been cancelled
Fly Deploy / JavaScript SDK Tests (push) Has been cancelled
Fly Deploy / Deploy app (push) Has been cancelled
Fly Deploy / Build and publish Python SDK (push) Has been cancelled
Fly Deploy / Build and publish JavaScript SDK (push) Has been cancelled
Custom engine params fix
|
2024-08-02 19:29:03 -04:00 |
|
Nicolas
|
1742e4ceae
|
Nick:
|
2024-08-02 19:25:15 -04:00 |
|