Commit Graph

2114 Commits

Author SHA1 Message Date
Gergő Móricz
250c3bb5c6 fix(auth): move redlock settings 2024-09-26 22:15:15 +02:00
Gergő Móricz
81245e68fa fix(auth/redlock): retry cached ACUC lock for 20 seconds 2024-09-26 22:15:15 +02:00
Gergő Móricz
0f89f5e7cb fix(billTeam): cache update race condition 2024-09-26 22:15:15 +02:00
Gergő Móricz
d13a97f979 fix(credit_billing): allow spending of exact credits 2024-09-26 22:15:15 +02:00
Gergő Móricz
84bff8add8 fix(billTeam): update cached ACUC after billing 2024-09-26 22:15:15 +02:00
Gergő Móricz
f22ab5ffaf feat(db): implement bill_team RPC 2024-09-26 22:15:15 +02:00
Gergő Móricz
c1f68c3e0a fix(credit_billing): return chunk.remaining_credits 2024-09-26 22:15:15 +02:00
Gergő Móricz
2073063fb7 fix(db): fix caching and rpc error 2024-09-26 22:15:15 +02:00
Gergő Móricz
f8c70fe5dd feat(db): implement auth_credit_usage_chunk RPC 2024-09-26 22:15:15 +02:00
Gergő Móricz
29815e084b feat(v1/Document): add warning field 2024-09-26 21:19:05 +02:00
Gergő Móricz
095babe70b fix(queue-jobs): jobs with concurrency fails may vanish 2024-09-26 21:18:56 +02:00
Gergő Móricz
b696bfc854 fix(crawl-status): avoid race conditions where crawl may be deemed failed 2024-09-26 21:00:27 +02:00
Eric Ciarla
75e32b0e5c
Merge pull request #707 from mendableai/new_examples
o1 job recommender
2024-09-26 14:51:45 -04:00
Eric Ciarla
20b998e66a Delete o1_job_recommender.ipynb 2024-09-26 14:51:07 -04:00
Eric Ciarla
5c4d436f1e Create o1_job_recommender.py 2024-09-26 14:46:48 -04:00
Gergő Móricz
dec4171937 fix(queue-worker, queue-jobs): logic fixes 2024-09-26 20:39:19 +02:00
Gergő Móricz
d2881927c1 fix(queue-worker): remove concurrency entries when done in sentry-less branch 2024-09-26 20:29:17 +02:00
Gergő Móricz
53fce67ca1 feat(queue-worker): PoC of concurrency limits 2024-09-26 20:24:34 +02:00
Nicolas
30058b1da0 Nick: increased timeout for chrome-cdp due to smart wait 2024-09-26 20:24:34 +02:00
Eric Ciarla
51bc2f25fe remove actions crawler 2024-09-26 11:44:55 -04:00
Eric Ciarla
289af6f89e example 2024-09-25 21:10:09 -04:00
Nicolas
a9773a24a3 Nick: increased timeout for chrome-cdp due to smart wait
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-25 19:27:02 -04:00
Gergő Móricz
953d4fb197 fix(redlock): use redlock.using for stability 2024-09-25 22:47:42 +02:00
Gergő Móricz
eef116bef8 fix(auth): move redlock settings 2024-09-25 22:27:51 +02:00
Gergő Móricz
2c96d2eef6 fix(auth/redlock): retry cached ACUC lock for 20 seconds 2024-09-25 22:25:13 +02:00
Gergő Móricz
1cca9b8ae6 fix(billTeam): cache update race condition 2024-09-25 22:15:02 +02:00
Gergő Móricz
eb7317c08a fix(credit_billing): allow spending of exact credits 2024-09-25 21:44:05 +02:00
Gergő Móricz
e67cbc2ca1 fix(billTeam): update cached ACUC after billing 2024-09-25 21:37:01 +02:00
Gergő Móricz
5a8eb17a82 feat(db): implement bill_team RPC 2024-09-25 20:57:45 +02:00
Gergő Móricz
415fd9f333 fix(credit_billing): return chunk.remaining_credits 2024-09-25 20:37:35 +02:00
Gergő Móricz
417adf8e96 fix(db): fix caching and rpc error 2024-09-25 19:42:45 +02:00
Gergő Móricz
331e826bca feat(db): implement auth_credit_usage_chunk RPC 2024-09-25 19:25:18 +02:00
Eric Ciarla
abdc08edea
Merge pull request #679 from h4r5h4/fix/folder-name
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
remove space in the examples/o1_web_crawler folder name
2024-09-25 10:40:09 -04:00
Nicolas
1da026b26e Update single_url.ts
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-24 23:29:48 -04:00
Nicolas
b8266cc329 Update website_params.ts 2024-09-24 23:28:58 -04:00
Gergő Móricz
f00c0b82f9 fix(v1/scrape): add total wait specified in request to timeout
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-24 21:56:22 +02:00
Nicolas
3f138e559e Update website_params.ts 2024-09-24 15:14:26 -04:00
Gergő Móricz
43730b5db6 feat(WebScraper): always report error of last scraper in order 2024-09-24 20:03:49 +02:00
Gergő Móricz
3e661a2087 fix(v1/crawl-cancel): avoid double authing 2024-09-24 20:01:34 +02:00
Nicolas
86744f6deb
Update README.md 2024-09-24 13:22:09 -04:00
Gergő Móricz
4194525640 fix(blocklist): unblock TikTok Business page
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
This is just a regular business site, not social media.
2024-09-24 16:55:19 +02:00
Gergő Móricz
4a623c084a fix(fly): don't use Depot builders (doesn't work) 2024-09-24 10:50:30 +02:00
Gergő Móricz
a59b5836d5 Revert error tallying 2024-09-24 10:27:49 +02:00
Gergő Móricz
a4b128e8b7 fix(rust): blocklisted error test
Some checks are pending
Fly Deploy / Pre-deploy checks (push) Waiting to run
Fly Deploy / Deploy app (push) Blocked by required conditions
2024-09-23 23:03:00 +02:00
Gergő Móricz
483f97d21b fix(v0/search): don't sent scrape fail errors to Sentry 2024-09-23 18:49:27 +02:00
Gergő Móricz
d927cafeea fix(queue-worker): don't send scraping errors to sentry 2024-09-23 18:48:01 +02:00
Gergő Móricz
677faa27f3 fix(WebScraper): explicitly ignore 404s 2024-09-23 18:47:07 +02:00
Gergő Móricz
83d8287c14 fix(v0, sentry): don't send all scraping methods failed errors to Sentry 2024-09-23 18:40:21 +02:00
Gergő Móricz
d2f7031069 fix(WebScraper): fatal error handler triggering for 404s 2024-09-23 18:33:10 +02:00
Nicolas
4721aa1687
Merge pull request #690 from mendableai/nsc/search-fix-version-v0
Some checks failed
Fly Deploy / Pre-deploy checks (push) Has been cancelled
Fly Deploy / Deploy app (push) Has been cancelled
Fix the error message when trying search in v0
2024-09-21 21:12:01 -04:00