127 Commits

Author	SHA1	Message	Date
yanlong.wang	579f259cb9	fix: detect when readability does not work	2024-06-20 18:20:13 +08:00
yanlong.wang	eaa06781e3	fix: normalize-url pollution	2024-06-20 14:53:25 +08:00
yanlong.wang	6f37e5d3b4	feat: x-remove-selector	2024-06-18 18:07:38 +08:00
yanlong.wang	ee008ebe10	fix: improved code rules	2024-06-13 16:27:30 +08:00
yanlong.wang	fd9a86bc00	chore: fix abuse timing	2024-06-11 13:57:19 +08:00
Yanlong Wang	70d80bbcfe	fix: abuse condition	2024-06-10 17:41:38 +08:00
Yanlong Wang	5789ae1407	chore: dont abuse our service	2024-06-10 17:23:50 +08:00
yanlong.wang	1e3bae6aad	fix: timeout parsing	2024-06-05 19:50:48 +08:00
yanlong.wang	a9936d322e	fix: search descriptions	2024-06-05 19:47:04 +08:00
yanlong.wang	165cce6c91	refactor: options dto	2024-06-05 18:55:40 +08:00
Yanlong Wang	f0668a96b4	fix: potential circular crawling	2024-06-02 23:23:39 +08:00
Yanlong Wang	be91371b93	fix: ignore blockade for authenticated users	2024-06-02 09:09:21 +08:00
Yanlong Wang	154d8ede45	fix: truncate svg	2024-06-02 08:57:39 +08:00
Yanlong Wang	7a7e49bc00	fix: blockade query	2024-06-01 08:06:46 +08:00
Yanlong Wang	d2bebec60f	fix: abuse blocker	2024-06-01 02:01:12 +08:00
Yanlong Wang	249408df6b	fix	2024-06-01 01:07:50 +08:00
Yanlong Wang	43dee08dcc	security: detect abuse	2024-06-01 00:57:51 +08:00
Yanlong Wang	908157b61e	fix: pdf cache	2024-05-31 19:05:17 +08:00
Yanlong Wang	9c60b4b93d	fix: setup expire for pdf caches	2024-05-31 18:36:23 +08:00
Yanlong Wang	1ba21da0c5	fix: pdf cache	2024-05-31 18:26:05 +08:00
Yanlong Wang	fd0b77285f	fix: firebase fail to save large docs	2024-05-31 18:16:37 +08:00
Yanlong Wang	964b66b6ab	fix: data crunching import	2024-05-31 17:32:16 +08:00
Yanlong Wang	9ac40606d5	fix: bulk fix multiple issues	2024-05-31 17:30:57 +08:00
Yanlong Wang	0c15946874	fix: trimstart url	2024-05-30 20:29:31 +08:00
Yanlong Wang	33e14e5404	feat: extract text from pdf (#70) ... * feat: pdf * fix * fix	2024-05-30 20:21:33 +08:00
yanlong.wang	7c5712363c	feat: allow custom rate limit per uid	2024-05-23 15:36:09 +08:00
yanlong.wang	8eee95119d	feat: index brief in JSON format	2024-05-23 12:06:07 +08:00
yanlong.wang	4f37de24f6	fix: docs	2024-05-21 17:35:16 +08:00
Yanlong Wang	a8e0628460	feat: links and images summary (#63) ... * wip: dedicated link and image summary * fix * fix * fix * fix: docs * fix * fix * fix	2024-05-21 17:34:19 +08:00
Yanlong Wang	df71c9a534	fix: stop using pool	2024-05-20 01:12:22 +08:00
Yanlong Wang	4077fa7040	fix: geoip encoding	2024-05-17 09:31:22 +08:00
Yanlong Wang	2941be6096	fix: potential unencoded query	2024-05-17 09:15:37 +08:00
Yanlong Wang	ed9e9f43cf	fix: block rough requests	2024-05-16 20:22:26 +08:00
yanlong.wang	8ec8c1e718	fix: logging for search error	2024-05-16 19:01:30 +08:00
yanlong.wang	e0e37ad4d7	fix: potential chargeAmount mismatch	2024-05-16 18:43:41 +08:00
yanlong.wang	8b0916f858	fix: race condition while logging chargeAmount	2024-05-16 18:26:18 +08:00
yanlong.wang	6f4819bc49	chore: tweak deployment	2024-05-16 17:46:53 +08:00
yanlong.wang	322cb86f21	fix: on no results	2024-05-16 17:30:47 +08:00
yanlong.wang	e2698b48bd	fix: rate limit tag for search	2024-05-16 16:58:10 +08:00
yanlong.wang	72e1c46a6c	fix: improve search responsiveness	2024-05-16 15:47:49 +08:00
Yanlong Wang	0583645613	fix: noCache in search	2024-05-16 00:42:30 +08:00
Yanlong Wang	4556954d17	fix: image url	2024-05-16 00:39:24 +08:00
Yanlong Wang	6f65083f8d	feat: control cache tolerance and select target using headers	2024-05-16 00:10:20 +08:00
yanlong.wang	77fc500f41	fix: allow x-return-format header alias	2024-05-15 12:24:46 +08:00
Yanlong Wang	445624c405	fix: early return for search	2024-05-15 08:47:16 +08:00
Yanlong Wang	1cf8e83857	fix: add cache tolerance	2024-05-15 08:06:35 +08:00
Yanlong Wang	d100c3fc5f	fix: search result cache save	2024-05-14 19:57:49 +08:00
Yanlong Wang	ec4ce4fef3	chore: update rate limits	2024-05-14 19:44:35 +08:00
Yanlong Wang	2e3c217479	feat: web search (#57)	2024-05-14 19:39:43 +08:00
Yanlong Wang	f171e54ac9	fix: log charge amount	2024-05-14 17:25:59 +08:00