Nicolas
|
441628998f
|
Reapply "Merge pull request #561 from mendableai/bug/dealing-with-dns-error"
This reverts commit ffe11a5bf7.
|
2024-08-20 19:16:48 -03:00 |
|
Nicolas
|
ffe11a5bf7
|
Revert "Merge pull request #561 from mendableai/bug/dealing-with-dns-error"
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
This reverts commit 2030ec6031, reversing
changes made to f494d2b707.
|
2024-08-20 18:16:11 -03:00 |
|
Gergő Móricz
|
5818236659
|
fix: remove rawHtml properly
|
2024-08-20 22:51:12 +02:00 |
|
rafaelsideguide
|
0f48823c9c
|
Merge remote-tracking branch 'origin/v1-webscraper' into v1/node-sdk
|
2024-08-20 17:24:59 -03:00 |
|
rafaelsideguide
|
9d64c8eedc
|
screenshot should not be undefined also
|
2024-08-20 17:24:45 -03:00 |
|
Gergő Móricz
|
1368f9a87f
|
fix: treat existing screenshot as a scraper success condition
|
2024-08-20 22:24:18 +02:00 |
|
rafaelsideguide
|
70d81ca69e
|
Merge remote-tracking branch 'origin/v1-webscraper' into v1/node-sdk
|
2024-08-20 17:08:07 -03:00 |
|
rafaelsideguide
|
537fc689b6
|
fixing request
|
2024-08-20 17:08:02 -03:00 |
|
Nicolas
|
2030ec6031
|
Merge pull request #561 from mendableai/bug/dealing-with-dns-error
[Bug] Added a way for dealing with DNS without IP resolution
|
2024-08-20 16:59:09 -03:00 |
|
rafaelsideguide
|
f98be7d94e
|
Update fireEngine.ts
|
2024-08-20 16:53:01 -03:00 |
|
Nicolas
|
0c48c8a436
|
Nick: billing for map
|
2024-08-20 16:43:46 -03:00 |
|
Gergő Móricz
|
f494d2b707
|
prioritize search lower
|
2024-08-20 21:18:31 +02:00 |
|
Nicolas
|
59eb552df5
|
Merge pull request #560 from mendableai/feat/cancel-fire-engine
[Feat] Added check job and cancel to fire-engine requests
|
2024-08-20 15:43:31 -03:00 |
|
rafaelsideguide
|
1f27182a13
|
added try catch
|
2024-08-20 15:42:39 -03:00 |
|
Gergő Móricz
|
efb91f9ca5
|
fix(search): delete jobs after done
|
2024-08-20 20:29:08 +02:00 |
|
Nicolas
|
39388cdc35
|
Update crawl.ts
|
2024-08-20 14:41:43 -03:00 |
|
Nicolas
|
674adee144
|
Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper
|
2024-08-20 14:41:05 -03:00 |
|
Nicolas
|
b36faeaf54
|
Nick:
|
2024-08-20 14:39:52 -03:00 |
|
Nicolas
|
2b221fd4a9
|
Merge pull request #559 from mendableai/nsc/Nick-set-the-crawl-limit-to-the-remaining-credits
Set the crawl limit to the remaining credits
|
2024-08-20 14:38:10 -03:00 |
|
Gergő Móricz
|
cf32893c2e
|
add strict enforcement + move crawlerOptions to top-level in /crawl
|
2024-08-20 19:31:26 +02:00 |
|
rafaelsideguide
|
e326249a57
|
added check job and cancel to fire-engine requests
|
2024-08-20 14:26:42 -03:00 |
|
Gergő Móricz
|
70d50b3640
|
fix(queue-worker): move dotenv config up
|
2024-08-20 19:25:19 +02:00 |
|
Nicolas
|
c5ad4dedeb
|
Update crawl.ts
|
2024-08-20 14:19:20 -03:00 |
|
Nicolas
|
de0dc20a02
|
Update credit_billing.ts
|
2024-08-20 14:18:14 -03:00 |
|
Nicolas
|
5abd26a267
|
Nick: set the crawl limit to the remaining credits
|
2024-08-20 14:16:54 -03:00 |
|
Nicolas
|
e200ec9e12
|
Nick:
|
2024-08-20 12:24:14 -03:00 |
|
Nicolas
|
55dad82df1
|
Nick: fixed map search
|
2024-08-20 12:17:53 -03:00 |
|
Nicolas
|
27903247b6
|
Nick: map tests and fixes
|
2024-08-20 12:04:08 -03:00 |
|
rafaelsideguide
|
fa89d2e535
|
v1 support for crawl/monitor status
|
2024-08-20 10:37:24 -03:00 |
|
rafaelsideguide
|
7727302ef1
|
Merge remote-tracking branch 'origin/v1-webscraper' into v1/node-sdk
|
2024-08-20 09:22:55 -03:00 |
|
rafaelsideguide
|
e160d5529a
|
fixed test
|
2024-08-20 09:22:38 -03:00 |
|
rafaelsideguide
|
e1c9cbf709
|
bug fixed. crawl should not stop if sitemap url is invalid
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
|
2024-08-20 09:11:58 -03:00 |
|
Thomas Kosmas
|
0dce57832d
|
Merge pull request #555 from mendableai/feat/beta-customers
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
added variables to beta customers
|
2024-08-20 02:20:23 +03:00 |
|
rafaelsideguide
|
ecd472356b
|
added variables to beta customers
|
2024-08-19 16:41:54 -03:00 |
|
Nicolas
|
3dc298be54
|
Nick: 2x rate limits for standard and growth for /scrape
|
2024-08-19 13:52:54 -03:00 |
|
rafaelsideguide
|
32aba44167
|
fixing merge issues
|
2024-08-19 13:37:20 -03:00 |
|
rafaelsideguide
|
72461ce9a6
|
Update index.test.ts
|
2024-08-19 13:29:52 -03:00 |
|
rafaelsideguide
|
fd7fdc1d52
|
added blocklist middleware
|
2024-08-19 13:28:54 -03:00 |
|
Nicolas
|
5a44191344
|
Merge pull request #554 from mendableai/nsc/check-team-credits-limit
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
Check team credits based on the crawl limit
|
2024-08-19 11:54:47 -03:00 |
|
rafaelsideguide
|
e516e4993b
|
Merge remote-tracking branch 'origin/v1-webscraper' into v1/node-sdk
|
2024-08-19 11:24:57 -03:00 |
|
Nicolas
|
8e4ca86463
|
Update crawl.ts
|
2024-08-19 11:02:24 -03:00 |
|
Nicolas
|
36b35dbc67
|
Update crawl.ts
|
2024-08-19 11:01:26 -03:00 |
|
rafaelsideguide
|
4ffc60596a
|
Update queue-worker.ts
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
|
2024-08-19 09:29:23 -03:00 |
|
rafaelsideguide
|
b8170aaa47
|
Update blocklist.ts
|
2024-08-19 08:51:48 -03:00 |
|
Nicolas
|
3fe82b4f12
|
Update queue-worker.ts
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Fly Deploy / Test Suite (push) Has been cancelled
Fly Deploy / Python SDK Tests (push) Has been cancelled
Fly Deploy / JavaScript SDK Tests (push) Has been cancelled
Fly Deploy / Go SDK Tests (push) Has been cancelled
Fly Deploy / Deploy app (push) Has been cancelled
Fly Deploy / Build and publish Python SDK (push) Has been cancelled
Fly Deploy / Build and publish JavaScript SDK (push) Has been cancelled
|
2024-08-17 03:09:31 -04:00 |
|
Nicolas
|
f797380112
|
Nick:
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Test Suite (push) Blocked by required conditions
Fly Deploy / Python SDK Tests (push) Blocked by required conditions
Fly Deploy / JavaScript SDK Tests (push) Blocked by required conditions
Fly Deploy / Go SDK Tests (push) Blocked by required conditions
Fly Deploy / Deploy app (push) Blocked by required conditions
Fly Deploy / Build and publish Python SDK (push) Blocked by required conditions
Fly Deploy / Build and publish JavaScript SDK (push) Blocked by required conditions
|
2024-08-16 22:17:38 -04:00 |
|
Nicolas
|
47123be783
|
Nick: weird activity block
|
2024-08-16 22:01:56 -04:00 |
|
Nicolas
|
ff84f1fe5e
|
Update map.ts
|
2024-08-16 20:42:36 -04:00 |
|
Nicolas
|
4314313477
|
Update map.ts
|
2024-08-16 19:56:18 -04:00 |
|
Nicolas
|
af9a0a6f0b
|
Update map.ts
|
2024-08-16 19:56:03 -04:00 |
|