Austin/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2024-11-16 19:58:08 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,074 Commits 273 Branches 1 Tag 48 MiB
3242872503
Commit Graph

1074 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric Ciarla
59451754f5 Add tests 2024-06-14 10:14:07 -04:00
Rafael Miller
5fd228f9ec
Merge pull request #253 from mattjoyce/py-sdk-improve-response-handling 
Python sdk improve response handling
 2024-06-14 11:12:16 -03:00
rafaelsideguide
afee5684a3 Fixed tests' message and updated version 2024-06-14 11:05:19 -03:00
Eric Ciarla
9b254c1cd0 Update index.test.ts 2024-06-14 09:48:14 -04:00
Rafael Miller
5a5c532bea
Merge branch 'main' into py-sdk-improve-response-handling 2024-06-14 10:42:51 -03:00
Eric Ciarla
9aba451b18 Update index.test.ts 2024-06-14 09:33:43 -04:00
Rafael Miller
cc2e3f05b0
Merge pull request #256 from mattjoyce/feat-254-sdk-py-logging 
Added logging to python sdk FIRECRAWL_LOGGING_LEVEL
 2024-06-14 10:22:40 -03:00
rafaelsideguide
6963a490f1 Updated version 2024-06-14 10:21:44 -03:00
rafaelsideguide
5dd18ca79b fixed edge cases 2024-06-14 09:46:55 -03:00
Eric Ciarla
ab9de0f5ab Update maxDepth tests 2024-06-13 18:46:30 -04:00
Eric Ciarla
393bd45237 Update index.test.ts 2024-06-13 18:13:15 -04:00
Eric Ciarla
71c98d8b80 Update logic 2024-06-13 18:00:52 -04:00
Eric Ciarla
095951aa4d Update test 2024-06-13 17:40:00 -04:00
Eric Ciarla
5e8aa92788 Update index.ts 2024-06-13 17:33:13 -04:00
Eric Ciarla
bf10e9d392 Update index.test.ts 2024-06-13 17:28:59 -04:00
Eric Ciarla
65d63bae45 Update index.ts 2024-06-13 17:17:44 -04:00
Eric Ciarla
32e814bedc Update index.ts 2024-06-13 17:02:30 -04:00
Nicolas
6fc1ee32fd
Merge pull request #275 from mendableai/feat/issue-273 
Added pageOptions.removeTags
 2024-06-13 13:27:01 -07:00
rafaelsideguide
bb859ae9a7 Added metadata.pageStatusCode and metadata.pageError properties to the responses 2024-06-13 17:08:40 -03:00
rafaelsideguide
676d6e8ab5 Added pageOptions.removeTags 2024-06-13 10:51:05 -03:00
Nicolas
d48c0df6c5
Merge pull request #274 from mendableai/nsc/clusters 
Clusters support to scale our API to # of CPUs running
 2024-06-12 18:09:26 -07:00
Nicolas
182f8d4d6c Update index.ts 2024-06-12 18:07:05 -07:00
Nicolas
11b6d5afa5 Update fly.toml 2024-06-12 18:00:22 -07:00
Nicolas
67dc46b454 Nick: clusters 2024-06-12 17:53:04 -07:00
Nicolas
bad0f57134
Merge pull request #272 from mendableai/bug/issue-258 
[Feat] Added jobId to webhook data
 2024-06-12 12:29:50 -07:00
rafaelsideguide
d20af257ba Added jobId to webhook data 2024-06-12 15:38:41 -03:00
rafaelsideguide
e37d151404 added parsePDF option to pageOptions 
user can decide if they are going to let us take care of the parse or they are going to parse the pdf by themselves
 2024-06-12 15:06:47 -03:00
Rafael Miller
48f6c19a05
Merge pull request #269 from mendableai/feat/allowbackwardcrawling-option 
[Feat] Added allowBackwardCrawling option
 2024-06-12 11:34:39 -03:00
rafaelsideguide
01c9f071fa fixed 2024-06-12 11:27:06 -03:00
rafaelsideguide
dc6acbf1f0 Merge remote-tracking branch 'origin/main' into feat/allowbackwardcrawling-option 2024-06-12 11:01:05 -03:00
Nicolas
f93231499f
Merge pull request #265 from mendableai/feat/issue-264 
[Feat] Added route to clean completed jobs and a github action cron that triggers every 24h
 2024-06-11 21:33:52 -07:00
Nicolas
705f5ebe78 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-06-11 15:49:35 -07:00
Nicolas
d4df6f049d Nick: 2024-06-11 15:49:30 -07:00
Nicolas
45dee63943
Merge pull request #262 from mendableai/nsc/webhook-self-host-fix 
Only fetch webhook from db if self host webhook not set and using db auth
 2024-06-11 15:46:57 -07:00
rafaelsideguide
157fbe4a1e added bull auth key 2024-06-11 17:52:01 -03:00
rafaelsideguide
df3a678cf4 getting back the cancel test, this should work 2024-06-11 17:46:56 -03:00
rafaelsideguide
def2ba9987 added tests 2024-06-11 17:46:25 -03:00
Nicolas
c08db830df
Merge pull request #268 from mendableai/nsc/abs-path-fix 
Fixed bugs associated with absolute path replacements
 2024-06-11 13:20:42 -07:00
Nicolas
1e3e06a1d5 Update replacePaths.test.ts 2024-06-11 13:02:39 -07:00
Nicolas
2239e03269 Update replacePaths.test.ts 2024-06-11 12:54:02 -07:00
Nicolas
520739c9f4 Nick: fixed bugs associated with absolute path replacements 2024-06-11 12:43:16 -07:00
Nicolas
788abdce6e Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-06-11 12:08:51 -07:00
Nicolas
b87725c683 Update openapi.json 2024-06-11 12:08:49 -07:00
rafaelsideguide
ee282c3d55 Added allowBackwardCrawling option 2024-06-11 15:24:39 -03:00
rafaelsideguide
a9f93c2f1e Added route to clean completed jobs and a github action cron that triggers every 24h 2024-06-11 14:18:05 -03:00
Eric Ciarla
06b0d01fd4 Update examples 2024-06-11 12:23:36 -04:00
Eric Ciarla
00c23855b1 Update examples 2024-06-11 11:46:35 -04:00
Nicolas
da38dad9a7 Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-06-10 18:26:31 -07:00
Nicolas
9390816c1b Update openapi.json 2024-06-10 18:26:25 -07:00
Nicolas
15e791ffb1
Merge pull request #263 from mendableai/nsc/pageoptions-crawler 
ignoreSitemap feature, pageOptions now respected in the initial crawl as well
 2024-06-10 18:22:51 -07:00