937 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
rafaelsideguide	ad7795f973	Merge remote-tracking branch 'origin/main' into test/load-testing	2024-06-14 15:14:01 -03:00
Rafael Miller	0ec26576d6	Merge pull request #277 from mendableai/feat/maxDepthRelative ... Make maxDepth relative to the entered url	2024-06-14 13:07:23 -03:00
rafaelsideguide	354712a8a3	just changed the name for the test?	2024-06-14 13:02:04 -03:00
Eric Ciarla	2c5f5c0ea2	Merge branch 'main' into feat/maxDepthRelative	2024-06-14 11:49:12 -04:00
Eric Ciarla	80c10393b4	Update index.test.ts	2024-06-14 11:32:30 -04:00
Eric Ciarla	42ed1f4479	Update index.test.ts	2024-06-14 11:20:24 -04:00
Rafael Miller	52d6201c42	Merge pull request #276 from mendableai/feat/issue-266 ... [Feat] Added metadata.pageStatusCode and metadata.pageError properties	2024-06-14 12:19:24 -03:00
Eric Ciarla	8830acce07	Update index.test.ts	2024-06-14 11:11:58 -04:00
Eric Ciarla	278bb311cb	Update index.test.ts	2024-06-14 11:02:39 -04:00
Eric Ciarla	36a62727b8	Update index.test.ts	2024-06-14 10:52:43 -04:00
Rafael Miller	f9c7ca9388	Merge branch 'main' into feat/issue-266	2024-06-14 11:47:58 -03:00
Rafael Miller	2c0a2c742a	Merge pull request #271 from mendableai/feat/issue-205 ... [Feat] Added parsePDF option to pageOptions	2024-06-14 11:29:26 -03:00
Rafael Miller	3e2e76311c	Merge branch 'main' into feat/issue-205	2024-06-14 11:25:20 -03:00
Eric Ciarla	59451754f5	Add tests	2024-06-14 10:14:07 -04:00
Rafael Miller	5fd228f9ec	Merge pull request #253 from mattjoyce/py-sdk-improve-response-handling ... Python sdk improve response handling	2024-06-14 11:12:16 -03:00
rafaelsideguide	afee5684a3	Fixed tests' message and updated version	2024-06-14 11:05:19 -03:00
Eric Ciarla	9b254c1cd0	Update index.test.ts	2024-06-14 09:48:14 -04:00
Rafael Miller	5a5c532bea	Merge branch 'main' into py-sdk-improve-response-handling	2024-06-14 10:42:51 -03:00
Eric Ciarla	9aba451b18	Update index.test.ts	2024-06-14 09:33:43 -04:00
Rafael Miller	cc2e3f05b0	Merge pull request #256 from mattjoyce/feat-254-sdk-py-logging ... Added logging to python sdk FIRECRAWL_LOGGING_LEVEL	2024-06-14 10:22:40 -03:00
rafaelsideguide	6963a490f1	Updated version	2024-06-14 10:21:44 -03:00
rafaelsideguide	5dd18ca79b	fixed edge cases	2024-06-14 09:46:55 -03:00
Eric Ciarla	ab9de0f5ab	Update maxDepth tests	2024-06-13 18:46:30 -04:00
Eric Ciarla	393bd45237	Update index.test.ts	2024-06-13 18:13:15 -04:00
Eric Ciarla	71c98d8b80	Update logic	2024-06-13 18:00:52 -04:00
Eric Ciarla	095951aa4d	Update test	2024-06-13 17:40:00 -04:00
Eric Ciarla	5e8aa92788	Update index.ts	2024-06-13 17:33:13 -04:00
Eric Ciarla	bf10e9d392	Update index.test.ts	2024-06-13 17:28:59 -04:00
Eric Ciarla	65d63bae45	Update index.ts	2024-06-13 17:17:44 -04:00
Eric Ciarla	32e814bedc	Update index.ts	2024-06-13 17:02:30 -04:00
Nicolas	6fc1ee32fd	Merge pull request #275 from mendableai/feat/issue-273 ... Added pageOptions.removeTags	2024-06-13 13:27:01 -07:00
rafaelsideguide	bb859ae9a7	Added metadata.pageStatusCode and metadata.pageError properties to the responses	2024-06-13 17:08:40 -03:00
rafaelsideguide	676d6e8ab5	Added pageOptions.removeTags	2024-06-13 10:51:05 -03:00
Nicolas	d48c0df6c5	Merge pull request #274 from mendableai/nsc/clusters ... Clusters support to scale our API to # of CPUs running	2024-06-12 18:09:26 -07:00
Nicolas	182f8d4d6c	Update index.ts	2024-06-12 18:07:05 -07:00
Nicolas	11b6d5afa5	Update fly.toml	2024-06-12 18:00:22 -07:00
Nicolas	67dc46b454	Nick: clusters	2024-06-12 17:53:04 -07:00
Nicolas	bad0f57134	Merge pull request #272 from mendableai/bug/issue-258 ... [Feat] Added jobId to webhook data	2024-06-12 12:29:50 -07:00
rafaelsideguide	d20af257ba	Added jobId to webhook data	2024-06-12 15:38:41 -03:00
rafaelsideguide	e37d151404	added parsePDF option to pageOptions ... user can decide if they are going to let us take care of the parse or they are going to parse the pdf by themselves	2024-06-12 15:06:47 -03:00
Rafael Miller	48f6c19a05	Merge pull request #269 from mendableai/feat/allowbackwardcrawling-option ... [Feat] Added allowBackwardCrawling option	2024-06-12 11:34:39 -03:00
rafaelsideguide	01c9f071fa	fixed	2024-06-12 11:27:06 -03:00
rafaelsideguide	dc6acbf1f0	Merge remote-tracking branch 'origin/main' into feat/allowbackwardcrawling-option	2024-06-12 11:01:05 -03:00
Nicolas	f93231499f	Merge pull request #265 from mendableai/feat/issue-264 ... [Feat] Added route to clean completed jobs and a github action cron that triggers every 24h	2024-06-11 21:33:52 -07:00
Nicolas	705f5ebe78	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-06-11 15:49:35 -07:00
Nicolas	d4df6f049d	Nick:	2024-06-11 15:49:30 -07:00
Nicolas	45dee63943	Merge pull request #262 from mendableai/nsc/webhook-self-host-fix ... Only fetch webhook from db if self host webhook not set and using db auth	2024-06-11 15:46:57 -07:00
rafaelsideguide	157fbe4a1e	added bull auth key	2024-06-11 17:52:01 -03:00
rafaelsideguide	df3a678cf4	getting back the cancel test, this should work	2024-06-11 17:46:56 -03:00
rafaelsideguide	def2ba9987	added tests	2024-06-11 17:46:25 -03:00