Commit Graph

71 Commits

Author SHA1 Message Date
omr
6d2c6caa23
refactor: remove unnecessary 'closing' usage for boto3 client (#9343) 2024-10-15 08:42:39 +08:00
Garfield Dai
c6b74daa0a
Fix/s3 iam add region name (#7819) 2024-10-12 18:47:59 +08:00
zhuhao
7a6970e570
feat: add supabase object storage (#9229) 2024-10-11 22:48:57 +08:00
kurokobo
c0b71f8286
feat: respect x-* headers for redirections (#9054) 2024-10-09 14:42:30 +08:00
Bowen Liang
b360feb4c1
refactor: introduce storage factory and speed up api startup by importing storage client on demand (#9086) 2024-10-09 14:15:27 +08:00
zhuhao
2571b0c4e3
feat: add baidu obs storage (#9024)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-10-07 11:09:27 +08:00
zhuhao
e1e2d0b364
fix: failed to open links to images generated by QR code tool when using Huawei OBS (#9034) 2024-10-07 11:06:08 +08:00
Jyong
d96f5ba1ca
add storage error log (#8556) 2024-09-19 17:34:12 +08:00
swingchen01
f55e06d8bf
fix: resolve runtime error when self.folder is None (#8401)
Co-authored-by: 陈长君 <chenchangjun@shuwen.com>
2024-09-14 11:07:16 +08:00
Joe
84ac5ccc8f
fix: add before send to remove langfuse defaultErrorResponse (#8361) 2024-09-13 16:08:08 +08:00
Joe
82f7875a52
feat: add langfuse sentry ignore error (#8353) 2024-09-13 13:44:19 +08:00
Bowen Liang
40fb4d16ef
chore: refurbish Python code by applying refurb linter rules (#8296) 2024-09-12 15:50:49 +08:00
Bowen Liang
292220c596
chore: apply pep8-naming rules for naming convention (#8261) 2024-09-11 16:40:52 +08:00
ice yao
c8df92d0eb
add volcengine tos storage (#8164) 2024-09-10 09:19:47 +08:00
Zhi
d542b15cc0
feat: support redis sentinel mode (#7756) 2024-09-08 13:23:51 +08:00
zhuhao
e0d3cd91c6
support huawei cloud obs storage (#7980) (#7981) 2024-09-06 14:00:47 +08:00
Seayon
78989e9049
Add ALIYUN_OSS_PATH configuration for Aliyun OSS (#7864)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
Co-authored-by: seayon <zhaoxuyang@shouqianba.com>
2024-09-01 21:30:17 +08:00
takatost
0e0a703496
chore: ignore openai error record in sentry (#7770)
Some checks are pending
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/amd64, build-api-amd64) (push) Waiting to run
Build and Push API & Web / build (api, DIFY_API_IMAGE_NAME, linux/arm64, build-api-arm64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/amd64, build-web-amd64) (push) Waiting to run
Build and Push API & Web / build (web, DIFY_WEB_IMAGE_NAME, linux/arm64, build-web-arm64) (push) Waiting to run
Build and Push API & Web / create-manifest (api, DIFY_API_IMAGE_NAME, merge-api-images) (push) Blocked by required conditions
Build and Push API & Web / create-manifest (web, DIFY_WEB_IMAGE_NAME, merge-web-images) (push) Blocked by required conditions
2024-08-28 23:26:11 +08:00
Vimpas
4682e0ac7c
fix(storage): 🐛 HeadBucket Operation Permission (#7733)
Co-authored-by: 莫岳恒 <moyueheng@datagrand.com>
2024-08-28 13:57:45 +08:00
Vimpas
0006c6f0fd
fix(storage): 🐛 Create S3 bucket if it doesn't exist (#7514)
Co-authored-by: 莫岳恒 <moyueheng@datagrand.com>
2024-08-22 09:45:42 +08:00
-LAN-
3571292fbf
chore(api): Introduce Ruff Formatter. (#7291) 2024-08-15 12:54:05 +08:00
-LAN-
feb4576ee7
chore: update SQLAlchemy configuration with custom naming convention (#6854) 2024-08-01 11:16:49 +08:00
yanghx
349ec0db77
fix tencent_cos_storage image-preview error is not a byte (#6652) 2024-07-25 11:20:20 +08:00
Jyong
7c397f5722
update celery beat scheduler time to env (#6352) 2024-07-17 02:31:30 +08:00
Jyong
988aa4b5da
update clean_unused_datasets_task timedelta (#6324) 2024-07-16 13:43:04 +08:00
Jyong
678ad6b7eb
Fix/file stream azure blob (#6196) 2024-07-11 17:01:03 +08:00
Jyong
cbbe28f40d
fix azure stream download (#6063) 2024-07-08 17:13:16 +08:00
hymvp
1d3e96ffa6
add support oracle oci object storage (#5616) 2024-07-01 17:21:44 +08:00
Bowen Liang
3cc6093e4b
feat: introduce pydantic-settings for config definition and validation (#5202)
Co-authored-by: -LAN- <laipz8200@outlook.com>
2024-06-19 13:41:12 +08:00
quicksand
147a39b984
feat: support tencent cos storage (#5297) 2024-06-17 19:18:52 +08:00
Jyong
d7fbae286a
add aws s3 iam check (#5174) 2024-06-14 15:19:59 +08:00
Kazuki Takamatsu
3f18369ad2
Fix: google storage init with sa and download (#5054) 2024-06-13 17:36:34 +08:00
Jyong
481e7bc6b9
Fix/azure blob new version (#5004) 2024-06-06 23:36:13 +08:00
Jyong
9cf9720efa
Fix/azure blob token expire (#4914) 2024-06-04 14:30:23 +08:00
Jyong
d828a7fc35
fix azure blob token expire (#4911) 2024-06-04 13:04:56 +08:00
Charles Zhou
a325a294bd
feat: opportunistic tls flag for smtp (#4794) 2024-05-30 18:56:46 +08:00
Kota-Yamaguchi
3b60b712ec
feat: Add logging warning when MAIL_TYPE is not set (#4771) 2024-05-29 18:06:16 +08:00
Jyong
bdd409970f
fix the wrong env variable AZURE_BLOB_CONTAINER_NAME (#4455) 2024-05-16 18:30:52 +08:00
Kota Matsumoto
e2a78888b9
Fix: setup google-storage client (#4296)
Co-authored-by: kotamat <kota1681@gmail.com>
Co-authored-by: crazywoola <427733928@qq.com>
2024-05-15 08:05:41 +08:00
S96EA
13cd409575
feat: support aliyun oss auth v4 (#3886)
Co-authored-by: owen <owen@owen.hawk-toad.ts.net>
2024-05-06 11:56:04 +08:00
Jyong
338e4669e5
add storage factory (#3922) 2024-04-29 18:22:03 +08:00
miendinh
9ad489d133
feat: Add google storage support (#3887)
Co-authored-by: miendinh <miendinh@users.noreply.github.com>
2024-04-27 18:26:52 +08:00
Henrybit
80b9507e7a
feat: add aliyun oss storage (#3690)
Co-authored-by: henrybit <qipenghui3056@sina.com>
2024-04-25 16:57:19 +08:00
LIU HONGWEI
c227f3d985
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416) 2024-04-12 16:22:24 +08:00
Bowen Liang
28089c98c1
fix: skip Celery warning by setting broker_connection_retry_on_startup config (#3188) 2024-04-09 16:14:43 +08:00
Jyong
5e66a60f1c
add embedding cache and clean embedding cache job (#3087)
Co-authored-by: jyong <jyong@dify.ai>
2024-04-02 20:46:24 +08:00
Jyong
a94d86da6d
add keyword table s3 storage support (#3065)
Co-authored-by: jyong <jyong@dify.ai>
2024-04-01 20:19:30 +08:00
Jyong
1716ac562c
add clean_unused_datasets_task (#3057)
Co-authored-by: jyong <jyong@dify.ai>
2024-04-01 01:34:21 +08:00
Leo Q
7c8c233cf4
Add S3_ADDRESS_STYLE configuration option (#2934) 2024-03-26 10:18:26 +08:00
Bowen Liang
1f98a4fff3
improve: cache tool icons by setting max-age HTTP header and enable gzip compression SVG icons from backend (#2971) 2024-03-26 10:11:43 +08:00