fran/rustfs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,762 Commits 52 Branches 132 Tags
49366ee2004fccff239cdf00f1449f492d913b67
Commit Graph
66 Commits
Author SHA1 Message Date
TungliesandGitHub 49366ee200 chore(lint): clippy rules redundant_clone (#2554) 2026-04-15 13:54:07 +00:00
weisdandGitHub da9dfb51e7 fix(ecstore): cleanup stale put object temp data (#2529) 2026-04-15 14:40:58 +08:00
安正超andGitHub 6d476ae9a1 revert: remove BlockReadable trait and chunk-based I/O from rio, ecstore, disk layers (#2533) 2026-04-14 19:09:02 +08:00
weisdandGitHub a8a2aaa460 fix(ecstore): avoid duplicate keys in ListObjectsV2 (#2467) 2026-04-10 11:29:23 +08:00
housemeGitHubheihutucxymds
 		32bf8f5bf3 feat(storage): add direct chunk GET fast path (#2351) 
Signed-off-by: houseme <[email protected]>
Co-authored-by: heihutu <[email protected]>
Co-authored-by: cxymds <[email protected]>
 2026-04-07 08:33:46 +08:00
安正超andGitHub d5f05993a3 test(ecstore): cover read offset overflow (#2341) 2026-03-30 20:48:03 +08:00
housemeGitHubheihutu
 		7172e151de fix: address correctness, safety, and concurrency issues (#2327) 
Co-authored-by: heihutu <[email protected]>
Co-authored-by: houseme <[email protected]>
 2026-03-30 00:30:57 +08:00
weisdGitHubmomoda693
 		05dc131a49 perf(storage): optimize internode RPC transfer path (#2262) 
Co-authored-by: momoda693 <[email protected]>
 2026-03-23 17:09:49 +08:00
weisdGitHubhousemeheihutu
 		2e7abfbd63 fix(ecstore): preserve raw metadata read semantics (#2258) 
Signed-off-by: houseme <[email protected]>
Co-authored-by: houseme <[email protected]>
Co-authored-by: heihutu <[email protected]>
 2026-03-23 10:42:16 +08:00
weisdandGitHub a42320848c fix(ecstore): invalidate xl.meta cache after writes and rename (#2255) 2026-03-22 11:30:29 +08:00
weisdandGitHub b9b7d86ae4 feat: improve legacy metadata and admin compatibility (#2202) 2026-03-18 21:05:09 +08:00
evan slackGitHubloverustfs
 		d52a10c5fb chore(obs): Improve tracing instrumentation (#2086) 
Co-authored-by: loverustfs <[email protected]>
 2026-03-07 20:03:20 +08:00
安正超GitHubhouseme
 		9d2b8822cf refactor: stabilize heal format recovery integration tests (#1984) 
Co-authored-by: houseme <[email protected]>
 2026-02-27 15:26:19 +08:00
weisdandGitHub 368bba3345 fix(ecstore): adjust unformatted disk error mapping (#1988) 2026-02-27 13:45:33 +08:00
安正超andGitHub 4211652991 refactor(app): add application layer module entry (#1907) 2026-02-22 22:15:37 +08:00
evan slackGitHubhousemeloverustfs
 		23f7ffe36b fix(startup): Only monitor disk health after format loading (#1854) 
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2026-02-21 20:46:14 +08:00
loverustfsandGitHub 5d737eaeb7 fix(ecstore): invalidate GlobalFileCache after write_all_private to fix DeleteMarker visibility (#1890) 2026-02-20 22:47:45 +08:00
安正超andGitHub 2fc36bb52e fix: restore s3 compatibility regressions and CI coverage (#1793) 2026-02-13 12:26:52 +08:00
TyooughtulandGitHub 1184806c3f Fix/resolve pr 1710 (#1743) 2026-02-11 08:24:55 +08:00
weisdandGitHub 4d19b069c3 fix: replication delete (#1714) 2026-02-04 13:39:35 +08:00
weisdGitHubCopilotweisdhouseme
 		dce117840c refactor: NamespaceLock (nslock), AHM→Heal Crate, and Lock/Clippy Fixes (#1664) 
Co-authored-by: Copilot <[email protected]>
Co-authored-by: weisd <[email protected]>
Co-authored-by: houseme <[email protected]>
 2026-01-30 13:13:41 +08:00
weisdGitHubhouseme
 		6ab7b75fd4 fix bug (#1615) 
Co-authored-by: houseme <[email protected]>
 2026-01-27 09:54:13 +08:00
housemeGitHubheihutuLeonWang0735loverustfs安正超Copilot
 		d251b9fb35 fix: unify path handling to use S3-standard forward slashes on all platforms (#1555) 
Signed-off-by: houseme <[email protected]>
Signed-off-by: 安正超 <[email protected]>
Co-authored-by: heihutu <[email protected]>
Co-authored-by: LeonWang0735 <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: 安正超 <[email protected]>
Co-authored-by: Copilot <[email protected]>
 2026-01-26 18:49:21 +08:00
安正超andGitHub 4890fb25c1 fix: listobjects v2 pagination (#1607) 2026-01-25 09:30:08 +08:00
weisdandGitHub 6631407416 feat: Add RustFS Scanner Module and Multiple Bug Fixes (#1579) 2026-01-22 13:39:38 +08:00
LeonWang0735andGitHub 18b22eedd9 Fix:correctly handle versioning obj (#1521) 2026-01-16 08:12:05 +08:00
housemeandGitHub f795299d53 Optimization and collation of dependencies introduction processing (#1493) 2026-01-13 15:02:54 +08:00
housemeGitHubreatang
 		760cb1d734 Fix Windows Path Separator Handling in rustfs_utils (#1464) 
Co-authored-by: reatang <[email protected]>
 2026-01-11 19:53:51 +08:00
weisdandGitHub 359c9d2d26 Enhance Object Version Management and Replication Status Handling (#1413) 2026-01-07 10:44:35 +08:00
weisdandGitHub 3ce99939a3 fix: improve memory ordering for disk health tracker (#1412) 2026-01-06 23:59:08 +08:00
weisdandGitHub b142563127 fix rpc client (#1393) 2026-01-05 21:52:04 +08:00
weisdandGitHub ab752458ce Fix Path Traversal and Enhance Object Validation (#1387) 2026-01-05 15:57:15 +08:00
housemeandGitHub 8d7cd4cb1b chore: upgrade dependencies and migrate to aws-lc-rs (#1333) 2026-01-02 00:02:34 +08:00
weisdGitHubloverustfs
 		80cfb4feab Add Disk Timeout and Health Check Functionality (#1196) 
Signed-off-by: weisd <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2025-12-22 17:15:19 +08:00
housemeandGitHub 9e2fa148ee Fix type errors in ecfs.rs and apply clippy fixes for Rust 1.92.0 (#1121) 2025-12-12 00:49:21 +08:00
JacobGitHubhousemeloverustfs
 		53c126d678 fix: decode percent-encoded paths in get_file_path() (#1072) 
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2025-12-10 22:30:02 +08:00
weisdandGitHub 030d3c9426 fix filemeta nil versionid (#1002) 2025-12-05 20:30:08 +08:00
weisdGitHubhousemeloverustfs
 		b3c80ae362 fix: listdir rpc (#979) 
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
 2025-12-04 16:12:10 +08:00
weisdGitHubCopilotloverustfshouseme
 		a8b7b28fd0 Fix Admin Heal API and Add Pagination Support for Large Buckets (#933) 
Co-authored-by: Copilot <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: houseme <[email protected]>
 2025-12-03 18:10:46 +08:00
ShyimGitHubloverustfshouseme
 		ee04cc77a0 remove debug (#912) 
* remove debug

* Refactor get_global_encryption_service function

* Refactor get_global_encryption_service function

---------

Co-authored-by: loverustfs <[email protected]>
Co-authored-by: houseme <[email protected]>
 2025-11-26 11:56:01 +08:00
CopilotGitHubcopilot-swe-agent[bot] <[email protected]>housemehouseme
 		277d80de13 Fix: Implement priority-based heal queue with comprehensive diagnostic logging (#884) 
* Initial plan

* Implement priority-based heal queue with deduplication

Co-authored-by: houseme <[email protected]>

* Apply cargo fmt formatting fixes

Co-authored-by: houseme <[email protected]>

* Add queue monitoring, better error handling, and adaptive processing

- Add priority-based queue statistics tracking
- Implement queue capacity warnings (>80% full)
- Process multiple tasks per cycle when capacity allows
- Add proper error logging for failed heal request submissions
- Add Hash trait to HealPriority for HashMap support
- Improve observability with detailed queue status logs

Co-authored-by: houseme <[email protected]>

* Add comprehensive diagnostic logging to heal flow

- Add detailed logging for shard availability checks during reads
- Log successful heal request submissions
- Add detailed logging in heal_object for disk checking
- Log each disk's heal decision with reason and endpoint
- Add logging for heal writing and renaming phases
- Improve variable naming (nil_count -> available_shards)
- Add success confirmation messages for renamed healed data

These logs will help diagnose where the heal flow is failing.

Co-authored-by: houseme <[email protected]>

* fix

* feat(heal): enhance robustness, safety, and observability of heal process

- **Logging & Observability**:
  - Upgrade critical heal logs from [info](/crates/e2e_test/src/reliant/node_interact_test.rs:196:0-213:1) to `warn` for better visibility.
  - Implement structured logging with `tracing` fields for machine readability.
  - Add `#[tracing::instrument]` to [HealTask](c/crates/ahm/src/heal/task.rs:182:0-205:1) and [SetDisks](/crates/ecstore/src/set_disk.rs:120:0-131:1) methods for automatic context propagation.

- **Robustness**:
  - Add exponential backoff retry (3 attempts) for acquiring write locks in [heal_object](/crates/ahm/src/heal/storage.rs:438:4-460:5) to handle contention.
  - Handle [rename_data](/crates/ecstore/src/set_disk.rs:392:4-516:5) failures gracefully by preserving temporary files instead of forcing deletion, preventing potential data loss.

- **Data Safety**:
  - Fix [object_exists](/crates/ahm/src/heal/storage.rs:395:4-412:5) to propagate IO errors instead of treating them as "object not found".
  - Update [ErasureSetHealer](/crates/ahm/src/heal/erasure_healer.rs:28:0-33:1) to mark objects as failed rather than skipped when existence checks error, ensuring they are tracked for retry.

* fix

* fmt

* improve code for heal_object

* fix

* fix

* fix

---------

Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: houseme <[email protected]>
Co-authored-by: houseme <[email protected]>
 2025-11-20 00:36:25 +08:00
weisdandGitHub 85bc0ce2d5 fix: filemeta version handling and delete operations (#879) 
* fix filemeta version

* fix clippy

* fix delete version

* fix clippy/test
 2025-11-18 09:24:22 +08:00
weisdandGitHub 77a3489ed2 fix list object err (#831) 
fix list object err (#831)

#827
#815
#635
#752
 2025-11-10 23:42:15 +08:00
housemeandGitHub d934e3905b Refactor telemetry initialization for non-production environments (#789) 
* add dep `scopeguard`

* improve for tracing

* fix

* fix

* improve code for import

* add logger trace id

* fix

* fix

* fix

* fix

* fix
 2025-11-05 00:55:08 +08:00
安正超andGitHub dd47fcf2a8 fix: restore localized samples in tests (#749) 
* fix: restore required localized examples

* style: fix formatting issues
 2025-10-29 13:16:31 +08:00
weisdandGitHub 40660e7b80 fix: scandir object (#733) 
* fix: scandir object count

* fix: base64 list continuation_token
 2025-10-28 15:02:43 +08:00
weisdandGitHub e524a106c5 add make bucket error logs (#683) 
* add make bucket error logs
 2025-10-22 16:23:08 +08:00
weisdandGitHub 90f21a9102 refactor: Reimplement bucket replication system with enhanced architecture (#590) 
* feat:refactor replication

* use aws sdk for replication client

* refactor/replication

* merge main

* fix lifecycle test
 2025-09-26 14:27:53 +08:00
guojidanandGitHub 12ecb36c6d Fix collect (#586) 
* fix: fix datausageinfo

Signed-off-by: junxiang Mu <[email protected]>

* feat(data-usage): implement local disk snapshot aggregation for data usage statistics

Signed-off-by: junxiang Mu <[email protected]>

* feat(scanner): improve data usage collection with local scan aggregation

Signed-off-by: junxiang Mu <[email protected]>

* refactor: improve object existence check and code style

Signed-off-by: junxiang Mu <[email protected]>

---------

Signed-off-by: junxiang Mu <[email protected]>
 2025-09-24 02:48:23 -07:00
guojidanandGitHub 9ddf6a011d feature: support kms && encryt (#573) 
* feat(kms): implement key management service with local and vault backends

Signed-off-by: junxiang Mu <[email protected]>

* feat(kms): enhance security with zeroize for sensitive data and improve key management

Signed-off-by: junxiang Mu <[email protected]>

* remove Hashi word

Signed-off-by: junxiang Mu <[email protected]>

* refactor: remove unused request structs from kms handlers

Signed-off-by: junxiang Mu <[email protected]>

---------

Signed-off-by: junxiang Mu <[email protected]>
 2025-09-22 17:53:05 +08:00