fran/rustfs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,491 Commits 52 Branches 132 Tags
60aa47bf61ba1566576ac8f0f3c0a7a8f3d74621
Commit Graph
62 Commits
Author SHA1 Message Date
housemeandGitHub 60aa47bf61 feat(storage): integrate S3Operation into OperationHelper for unified metrics and audit (#2103) 2026-03-08 17:57:33 +08:00
evan slackGitHubloverustfs
 		d52a10c5fb chore(obs): Improve tracing instrumentation (#2086) 
Co-authored-by: loverustfs <[email protected]>
 2026-03-07 20:03:20 +08:00
LeonWang0735andGitHub a0503168d4 fix(heal):heal failed replication via must_replicate instead of check replicate_delete (#2072) 2026-03-05 15:47:36 +08:00
安正超andGitHub b4a633ebc6 fix(ecstore): set expiration header for put object via lifecycle prediction (#2003) 2026-02-28 16:21:58 +08:00
安正超andGitHub 3f5ccb20fc fix(s3): normalize GetObjectAttributes ETag XML response (#2002) 2026-02-28 14:53:53 +08:00
安正超andGitHub af6c32efac refactor: improve code quality with safer error handling, trait decomposition, and dead code cleanup (#1997) 2026-02-28 01:19:47 +08:00
Brayan JulesGitHubheihutu安正超
 		7ce23c6b54 fix(ecstore): allow trailing slash in object names to match S3 behavior (#1996) 
Co-authored-by: heihutu <[email protected]>
Co-authored-by: 安正超 <[email protected]>
 2026-02-27 22:46:42 +08:00
安正超GitHubhouseme
 		9d2b8822cf refactor: stabilize heal format recovery integration tests (#1984) 
Co-authored-by: houseme <[email protected]>
 2026-02-27 15:26:19 +08:00
LeonWang0735andGitHub 10140be6d8 fix(replication): handle TLS CA trust and force-delete replication edge cases (#1983) 2026-02-27 08:40:39 +08:00
安正超andGitHub 09aa6d9f6f refactor(app): remove remaining global access in main init (#1978) 2026-02-26 22:14:51 +08:00
安正超andGitHub 49579129c1 refactor(app): decouple AppContext adapters from GLOBAL statics (#1970) 2026-02-26 14:54:45 +08:00
LeonWang0735GitHubloverustfshouseme
 		06d12a8ec8 feat(replication):add replication bandwidth throttle monitor and reader (#1885) 
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: houseme <[email protected]>
 2026-02-24 15:21:45 +08:00
安正超andGitHub 4211652991 refactor(app): add application layer module entry (#1907) 2026-02-22 22:15:37 +08:00
LeonWang0735GitHubloverustfs
 		f31cd4b716 fix(replication): replicate delete all versions to targets (#1898) 
Co-authored-by: loverustfs <[email protected]>
 2026-02-21 20:12:05 +08:00
evan slackGitHubhousemeloverustfsheihutu
 		9786d9b004 metrics(scanner): Add metrics to scanner (#1823) 
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: heihutu <[email protected]>
 2026-02-15 18:36:40 +08:00
LeonWang0735GitHubloverustfs
 		f4e9ef2edc fix(replication): avoid re-replication loop in Active-Active replication (#1751) 
Co-authored-by: loverustfs <[email protected]>
 2026-02-09 14:11:30 +08:00
thorntonmcGitHubhouseme
 		927f3a57d7 perf(quota): Skip expensive usage checks when no quota configured (#1749) 
Co-authored-by: houseme <[email protected]>
 2026-02-08 22:37:53 +08:00
LeonWang0735GitHubhousemeCopilot
 		60793c17d7 fix: persist replication status and timestamp after replicate_object (#1747) 
Signed-off-by: houseme <[email protected]>
Co-authored-by: houseme <[email protected]>
Co-authored-by: Copilot <[email protected]>
 2026-02-07 12:50:37 +08:00
housemeandGitHub 0b870d6301 build(deps): bump the dependencies group with 19 updates (#1745) 2026-02-07 12:22:14 +08:00
housemeGitHubCopilot
 		6bba41f11f Fix/fix issues #1564 (#1708) 
Signed-off-by: houseme <[email protected]>
Co-authored-by: Copilot <[email protected]>
 2026-02-05 13:45:14 +08:00
weisdandGitHub 4d19b069c3 fix: replication delete (#1714) 2026-02-04 13:39:35 +08:00
loverustfsandGitHub a4563f7b41 fix: return null versionId when suspended (#1066) (#1709) 2026-02-04 09:22:52 +08:00
LeonWang0735GitHubloverustfs
 		36f14acbe9 fix: object lock compliance mode allows deletion (#1687) 
Co-authored-by: loverustfs <[email protected]>
 2026-02-03 17:06:24 +08:00
likewuGitHubloverustfs
 		087f58b7c8 fix(lifecycle): lifecycle fixes (#1625) 
Signed-off-by: likewu <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2026-01-31 19:14:47 +08:00
evan slackandGitHub 51e8a4820f fix: map unversioned destination replication error correctly (#1645) 2026-01-29 10:13:36 +08:00
LeonWang0735GitHubhousemeloverustfsheihutu
 		8edb1affc0 Fix:s3 compatibility (#1617) 
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: heihutu <[email protected]>
 2026-01-27 16:56:31 +08:00
housemeGitHubheihutuLeonWang0735loverustfs安正超Copilot
 		d251b9fb35 fix: unify path handling to use S3-standard forward slashes on all platforms (#1555) 
Signed-off-by: houseme <[email protected]>
Signed-off-by: 安正超 <[email protected]>
Co-authored-by: heihutu <[email protected]>
Co-authored-by: LeonWang0735 <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: 安正超 <[email protected]>
Co-authored-by: Copilot <[email protected]>
 2026-01-26 18:49:21 +08:00
安正超GitHubloverustfs
 		173dad27d1 fix: preserve exact JSON format in bucket policy GET response (#1598) 
Co-authored-by: loverustfs <[email protected]>
 2026-01-24 23:02:01 +08:00
GatewayJandGitHub 9285acba06 feat: object retention (#1589) 2026-01-24 22:12:45 +08:00
weisdandGitHub 6631407416 feat: Add RustFS Scanner Module and Multiple Bug Fixes (#1579) 2026-01-22 13:39:38 +08:00
GatewayJGitHubloverustfsCopilothouseme
 		55e4cdec5d feat: add Cors (#1496) 
Signed-off-by: GatewayJ <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: houseme <[email protected]>
 2026-01-15 20:03:26 +08:00
housemeandGitHub f795299d53 Optimization and collation of dependencies introduction processing (#1493) 2026-01-13 15:02:54 +08:00
yxrxyGitHubloverustfs
 		29d86036b1 feat: implement bucket quota system (#1461) 
Signed-off-by: yxrxy <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2026-01-12 11:42:07 +08:00
housemeGitHubreatang
 		760cb1d734 Fix Windows Path Separator Handling in rustfs_utils (#1464) 
Co-authored-by: reatang <[email protected]>
 2026-01-11 19:53:51 +08:00
weisdandGitHub ab752458ce Fix Path Traversal and Enhance Object Validation (#1387) 2026-01-05 15:57:15 +08:00
housemeandGitHub 8d7cd4cb1b chore: upgrade dependencies and migrate to aws-lc-rs (#1333) 2026-01-02 00:02:34 +08:00
yxrxyGitHubhouseme
 		8821fcc1e7 feat: Replace LRU cache with Moka async cache in policy variables (#1166) 
Co-authored-by: houseme <[email protected]>
 2025-12-17 00:19:31 +08:00
tennislengGitHubloverustfs
 		978845b555 fix(lifecycle): Fix ObjectInfo fields and mod_time error handling (#1088) 
Co-authored-by: loverustfs <[email protected]>
 2025-12-11 07:17:35 +08:00
CopilotGitHubcopilot-swe-agent[bot] <[email protected]>housemehouseme
 		277d80de13 Fix: Implement priority-based heal queue with comprehensive diagnostic logging (#884) 
* Initial plan

* Implement priority-based heal queue with deduplication

Co-authored-by: houseme <[email protected]>

* Apply cargo fmt formatting fixes

Co-authored-by: houseme <[email protected]>

* Add queue monitoring, better error handling, and adaptive processing

- Add priority-based queue statistics tracking
- Implement queue capacity warnings (>80% full)
- Process multiple tasks per cycle when capacity allows
- Add proper error logging for failed heal request submissions
- Add Hash trait to HealPriority for HashMap support
- Improve observability with detailed queue status logs

Co-authored-by: houseme <[email protected]>

* Add comprehensive diagnostic logging to heal flow

- Add detailed logging for shard availability checks during reads
- Log successful heal request submissions
- Add detailed logging in heal_object for disk checking
- Log each disk's heal decision with reason and endpoint
- Add logging for heal writing and renaming phases
- Improve variable naming (nil_count -> available_shards)
- Add success confirmation messages for renamed healed data

These logs will help diagnose where the heal flow is failing.

Co-authored-by: houseme <[email protected]>

* fix

* feat(heal): enhance robustness, safety, and observability of heal process

- **Logging & Observability**:
  - Upgrade critical heal logs from [info](/crates/e2e_test/src/reliant/node_interact_test.rs:196:0-213:1) to `warn` for better visibility.
  - Implement structured logging with `tracing` fields for machine readability.
  - Add `#[tracing::instrument]` to [HealTask](c/crates/ahm/src/heal/task.rs:182:0-205:1) and [SetDisks](/crates/ecstore/src/set_disk.rs:120:0-131:1) methods for automatic context propagation.

- **Robustness**:
  - Add exponential backoff retry (3 attempts) for acquiring write locks in [heal_object](/crates/ahm/src/heal/storage.rs:438:4-460:5) to handle contention.
  - Handle [rename_data](/crates/ecstore/src/set_disk.rs:392:4-516:5) failures gracefully by preserving temporary files instead of forcing deletion, preventing potential data loss.

- **Data Safety**:
  - Fix [object_exists](/crates/ahm/src/heal/storage.rs:395:4-412:5) to propagate IO errors instead of treating them as "object not found".
  - Update [ErasureSetHealer](/crates/ahm/src/heal/erasure_healer.rs:28:0-33:1) to mark objects as failed rather than skipped when existence checks error, ensuring they are tracked for retry.

* fix

* fmt

* improve code for heal_object

* fix

* fix

* fix

---------

Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: houseme <[email protected]>
Co-authored-by: houseme <[email protected]>
 2025-11-20 00:36:25 +08:00
weisdandGitHub 85bc0ce2d5 fix: filemeta version handling and delete operations (#879) 
* fix filemeta version

* fix clippy

* fix delete version

* fix clippy/test
 2025-11-18 09:24:22 +08:00
weisdandGitHub 1279baa72b fix replication (#875) 2025-11-17 17:37:41 +08:00
housemeandGitHub 7e1a9e2ede 🔒 Upgrade Cryptography Libraries to Latest RC Versions (#837) 
* fix

* chore: upgrade cryptography libraries to RC versions

- Upgrade aes-gcm to 0.11.0-rc.2 with rand_core support
- Upgrade chacha20poly1305 to 0.11.0-rc.2
- Upgrade argon2 to 0.6.0-rc.2 with std features
- Upgrade hmac to 0.13.0-rc.3
- Upgrade pbkdf2 to 0.13.0-rc.2
- Upgrade rsa to 0.10.0-rc.10
- Upgrade sha1 and sha2 to 0.11.0-rc.3
- Upgrade md-5 to 0.11.0-rc.3

These upgrades provide enhanced security features and performance
improvements while maintaining backward compatibility with existing
encryption workflows.

* add

* improve code

* fix
 2025-11-11 21:10:03 +08:00
weisdandGitHub 5941062909 fix (#828) 2025-11-10 19:22:58 +08:00
housemeandGitHub d934e3905b Refactor telemetry initialization for non-production environments (#789) 
* add dep `scopeguard`

* improve for tracing

* fix

* fix

* improve code for import

* add logger trace id

* fix

* fix

* fix

* fix

* fix
 2025-11-05 00:55:08 +08:00
安正超andGitHub dd47fcf2a8 fix: restore localized samples in tests (#749) 
* fix: restore required localized examples

* style: fix formatting issues
 2025-10-29 13:16:31 +08:00
likewuandGitHub 2aca1f77af Fix/ilm (#721) 
* fix tip remote tier error
* fix transitioned_object
* fix filemeta
* add GCS R2
* add aliyun tencent huaweicloud azure gcs r2 backend tier
* fix signer
* change azure to s3
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2025-10-27 20:23:50 +08:00
weisdGitHubovertrue
 		cd1e244c68 Refactor: Introduce content checksums and improve multipart/object metadata handling (#671) 
* feat:  adapt to s3s typed etag support

* refactor: move replication struct to rustfs_filemeta, fix filemeta transition bug

* add head_object checksum, filter object metadata output

* fix multipart checksum

* fix multipart checksum

* add content md5,sha256 check

* fix test

* fix cargo

---------

Co-authored-by: overtrue <[email protected]>
 2025-10-20 23:46:13 +08:00
安正超andGitHub 007d9c0b21 fix: normalize ETag comparison in multipart upload and replication (#627) 
- Normalize ETags by removing quotes before comparison in complete_multipart_upload
- Fix ETag comparison in replication logic to handle quoted ETags from API responses
- Fix ETag comparison in transition object logic
- Add unit tests for trim_etag function

This fixes the ETag mismatch error when uploading large files (5GB+) via multipart upload,
which was caused by PR #592 adding quotes to ETag responses while internal storage remains unquoted.

Fixes #625
 2025-10-08 21:19:57 +08:00
weisdandGitHub 90f21a9102 refactor: Reimplement bucket replication system with enhanced architecture (#590) 
* feat:refactor replication

* use aws sdk for replication client

* refactor/replication

* merge main

* fix lifecycle test
 2025-09-26 14:27:53 +08:00
guojidanandGitHub 12ecb36c6d Fix collect (#586) 
* fix: fix datausageinfo

Signed-off-by: junxiang Mu <[email protected]>

* feat(data-usage): implement local disk snapshot aggregation for data usage statistics

Signed-off-by: junxiang Mu <[email protected]>

* feat(scanner): improve data usage collection with local scan aggregation

Signed-off-by: junxiang Mu <[email protected]>

* refactor: improve object existence check and code style

Signed-off-by: junxiang Mu <[email protected]>

---------

Signed-off-by: junxiang Mu <[email protected]>
 2025-09-24 02:48:23 -07:00