152 Commits

Author	SHA1	Message	Date
Yanlong Wang	d3f3a8502a	fix: revert screenshot behavior and introduce pageshot	2024-07-30 20:09:06 +08:00
yanlong.wang	57cbae864e	fix: jsdom, cache tolerance, screenshot pricing	2024-07-30 17:47:26 +08:00
yanlong.wang	77c8480ca6	feat: with-iframe and full-page screenshot	2024-07-30 15:08:09 +08:00
Yanlong Wang	e4d46e7acb	fix: count parameter	2024-07-25 19:46:28 +08:00
Yanlong Wang	1c4b64fe04	feat: bring your own html	2024-07-25 16:54:28 +08:00
Yanlong Wang	78ea13b101	fix	2024-07-25 15:14:36 +08:00
Yanlong Wang	9bcde30f11	fix	2024-07-25 14:56:19 +08:00
Yanlong Wang	09dbbd3b0f	fix: retry for brave search	2024-07-25 08:56:02 +08:00
Yanlong Wang	ec7c2ab52c	fix: scrap timing	2024-07-24 22:59:00 +08:00
yanlong.wang	873994397a	fix: allow POST with url	2024-07-24 15:08:32 +08:00
yanlong.wang	786b1828b7	fix: brave search operators in headers	2024-07-23 15:50:28 +08:00
yanlong.wang	efe7a61e3b	fix: timeout parameter	2024-07-18 12:33:19 +08:00
yanlong.wang	61ff011c13	fix: stop early return when timeout is explicitly defined	2024-07-18 11:41:58 +08:00
yanlong.wang	d0e2920163	feat: expose brave search operators explicitly	2024-07-15 18:11:58 +08:00
Yanlong Wang	336931b5e8	chore: tweak deployment	2024-07-12 15:10:01 +08:00
yanlong.wang	c6634298c4	fix: provide empty content field	2024-07-09 18:14:19 +08:00
Yanlong Wang	f6a183f87a	fix	2024-07-06 01:00:37 +08:00
Yanlong Wang	c69ec77c60	fix	2024-07-06 00:59:37 +08:00
Yanlong Wang	c9ef602a94	fix: potential firebase blockade	2024-07-06 00:25:48 +08:00
yanlong.wang	1bcb5a742e	fix: dos abuse	2024-07-01 18:40:14 +08:00
Yanlong Wang	0a09aeb967	fix	2024-07-01 11:06:30 +08:00
Yanlong Wang	8951578ef1	chore	2024-07-01 00:29:12 +08:00
Yanlong Wang	858e52fe2e	chore: tweak cpu	2024-06-30 22:19:03 +08:00
yanlong.wang	62fb6cff94	feat: keepImgDataUrl	2024-06-24 15:18:53 +08:00
yanlong.wang	1084b16c84	fix: typo	2024-06-20 18:31:56 +08:00
yanlong.wang	579f259cb9	fix: detect when readability does not work	2024-06-20 18:20:13 +08:00
yanlong.wang	eaa06781e3	fix: normalize-url pollution	2024-06-20 14:53:25 +08:00
yanlong.wang	6f37e5d3b4	feat: x-remove-selector	2024-06-18 18:07:38 +08:00
yanlong.wang	ee008ebe10	fix: improved code rules	2024-06-13 16:27:30 +08:00
yanlong.wang	fd9a86bc00	chore: fix abuse timing	2024-06-11 13:57:19 +08:00
Yanlong Wang	70d80bbcfe	fix: abuse condition	2024-06-10 17:41:38 +08:00
Yanlong Wang	5789ae1407	chore: dont abuse our service	2024-06-10 17:23:50 +08:00
yanlong.wang	1e3bae6aad	fix: timeout parsing	2024-06-05 19:50:48 +08:00
yanlong.wang	a9936d322e	fix: search descriptions	2024-06-05 19:47:04 +08:00
yanlong.wang	165cce6c91	refactor: options dto	2024-06-05 18:55:40 +08:00
Yanlong Wang	f0668a96b4	fix: potential circular crawling	2024-06-02 23:23:39 +08:00
Yanlong Wang	be91371b93	fix: ignore blockade for authenticated users	2024-06-02 09:09:21 +08:00
Yanlong Wang	154d8ede45	fix: truncate svg	2024-06-02 08:57:39 +08:00
Yanlong Wang	7a7e49bc00	fix: blockade query	2024-06-01 08:06:46 +08:00
Yanlong Wang	d2bebec60f	fix: abuse blocker	2024-06-01 02:01:12 +08:00
Yanlong Wang	249408df6b	fix	2024-06-01 01:07:50 +08:00
Yanlong Wang	43dee08dcc	security: detect abuse	2024-06-01 00:57:51 +08:00
Yanlong Wang	908157b61e	fix: pdf cache	2024-05-31 19:05:17 +08:00
Yanlong Wang	9c60b4b93d	fix: setup expire for pdf caches	2024-05-31 18:36:23 +08:00
Yanlong Wang	1ba21da0c5	fix: pdf cache	2024-05-31 18:26:05 +08:00
Yanlong Wang	fd0b77285f	fix: firebase fail to save large docs	2024-05-31 18:16:37 +08:00
Yanlong Wang	964b66b6ab	fix: data crunching import	2024-05-31 17:32:16 +08:00
Yanlong Wang	9ac40606d5	fix: bulk fix multiple issues	2024-05-31 17:30:57 +08:00
Yanlong Wang	0c15946874	fix: trimstart url	2024-05-30 20:29:31 +08:00
Yanlong Wang	33e14e5404	feat: extract text from pdf (#70) ... * feat: pdf * fix * fix	2024-05-30 20:21:33 +08:00