Commit Graph
100 Commits
Author SHA1 Message Date
weisdandGitHub 4d19b069c3 fix: replication delete (#1714) 2026-02-04 13:39:35 +08:00
1aba8c10b9 refactor: Remove unused data usage collection code (#1672)
Co-authored-by: houseme <[email protected]>
2026-01-30 19:08:39 +08:00
dce117840c refactor: NamespaceLock (nslock), AHM→Heal Crate, and Lock/Clippy Fixes (#1664)
Co-authored-by: Copilot <[email protected]>
Co-authored-by: weisd <[email protected]>
Co-authored-by: houseme <[email protected]>
2026-01-30 13:13:41 +08:00
6ab7b75fd4 fix bug (#1615)
Co-authored-by: houseme <[email protected]>
2026-01-27 09:54:13 +08:00
weisdandGitHub 6631407416 feat: Add RustFS Scanner Module and Multiple Bug Fixes (#1579) 2026-01-22 13:39:38 +08:00
weisdandGitHub 0927f937a7 fix: Fix BitrotWriter encode writer implementation (#1531) 2026-01-16 17:11:54 +08:00
f0da8ce216 fix: avoid unwrap() panic in delete_prefix parsing (#1476)
Co-authored-by: houseme <[email protected]>
2026-01-12 13:26:01 +08:00
weisdandGitHub 78b13f3ff2 fix: add delete prefix option support (#1471) 2026-01-12 11:19:09 +08:00
weisdandGitHub 00f3275603 rm online check (#1416) 2026-01-07 13:42:03 +08:00
weisdandGitHub 359c9d2d26 Enhance Object Version Management and Replication Status Handling (#1413) 2026-01-07 10:44:35 +08:00
weisdandGitHub 3ce99939a3 fix: improve memory ordering for disk health tracker (#1412) 2026-01-06 23:59:08 +08:00
weisdandGitHub b142563127 fix rpc client (#1393) 2026-01-05 21:52:04 +08:00
weisdandGitHub 5660208e89 Refactor RPC Authentication System for Improved Maintainability (#1391) 2026-01-05 19:51:51 +08:00
weisdandGitHub ab752458ce Fix Path Traversal and Enhance Object Validation (#1387) 2026-01-05 15:57:15 +08:00
weisdandGitHub 8bdff3fbcb fix: Add retry mechanism for GLOBAL_CONFIG_SYS initialization (#1252) 2025-12-24 16:38:28 +08:00
80cfb4feab Add Disk Timeout and Health Check Functionality (#1196)
Signed-off-by: weisd <[email protected]>
Co-authored-by: loverustfs <[email protected]>
2025-12-22 17:15:19 +08:00
weisdandGitHub 030d3c9426 fix filemeta nil versionid (#1002) 2025-12-05 20:30:08 +08:00
b3c80ae362 fix: listdir rpc (#979)
Co-authored-by: houseme <[email protected]>
Co-authored-by: loverustfs <[email protected]>
2025-12-04 16:12:10 +08:00
a8b7b28fd0 Fix Admin Heal API and Add Pagination Support for Large Buckets (#933)
Co-authored-by: Copilot <[email protected]>
Co-authored-by: loverustfs <[email protected]>
Co-authored-by: houseme <[email protected]>
2025-12-03 18:10:46 +08:00
weisdandGitHub 4d7bf98c82 add logs (#962) 2025-12-03 13:17:47 +08:00
fce4e64da4 Fix/objectdelete (#917)
* fix getobject content length resp

* fix delete object

---------

Co-authored-by: houseme <[email protected]>
2025-11-24 16:35:51 +08:00
b73ca0220e add ifmatch support (#885)
Co-authored-by: loverustfs <[email protected]>
2025-11-20 08:40:47 +08:00
weisdandGitHub a13ce08590 fix listbucket sign (#890) 2025-11-19 11:08:16 +08:00
55d44622ed list object include deleted support (#882)
Co-authored-by: houseme <[email protected]>
2025-11-18 21:51:10 +08:00
weisdandGitHub 85bc0ce2d5 fix: filemeta version handling and delete operations (#879)
* fix filemeta version

* fix clippy

* fix delete version

* fix clippy/test
2025-11-18 09:24:22 +08:00
weisdandGitHub 1279baa72b fix replication (#875) 2025-11-17 17:37:41 +08:00
weisdandGitHub acdefb6703 fix read lock (#866) 2025-11-16 11:44:13 +08:00
weisdandGitHub 77a3489ed2 fix list object err (#831)
fix list object err (#831)

#827
#815
#635
#752
2025-11-10 23:42:15 +08:00
weisdandGitHub 5941062909 fix (#828) 2025-11-10 19:22:58 +08:00
weisdandGitHub e823922654 feat:add api error message (#801)
* feat:add api error message
* fix: check input
* fix: test
2025-11-07 09:53:49 +08:00
weisdandGitHub 461d5dff86 fix list max keys (#795) 2025-11-05 15:30:32 +08:00
weisdandGitHub 6617372b33 fix rmdir versionid (#784) 2025-11-03 18:23:16 +08:00
weisdandGitHub 769778e565 fix iam (#783) 2025-11-03 17:39:51 +08:00
weisdandGitHub 40660e7b80 fix: scandir object (#733)
* fix: scandir object count

* fix: base64 list continuation_token
2025-10-28 15:02:43 +08:00
weisdandGitHub ed73e2b782 fix:add favicon.ico route (#713) 2025-10-25 16:11:18 +08:00
weisdandGitHub 6a59c0a474 fix: multipart upload checksum validation (#712)
* fix multipart upload checksum
2025-10-24 18:23:32 +08:00
weisdandGitHub 1d069fd351 Improve the peer client (#693) 2025-10-23 17:21:55 +08:00
weisdandGitHub f30698ec7f Refactor Console Server Architecture (#685)
* todo

* fix console server

* fix console server

* fix console server

* fix console server

* fix console server
2025-10-23 00:06:09 +08:00
weisdandGitHub e524a106c5 add make bucket error logs (#683)
* add make bucket error logs
2025-10-22 16:23:08 +08:00
weisdandGitHub d9e5f5d2e3 fix (#682) 2025-10-22 10:35:40 +08:00
weisdandGitHub a65856bdf4 Fix CRC32C Checksum Implementation and Enhance Authentication System (#678)
* fix: get_condition_values

* fix checksum crc32c

* fix clippy
2025-10-21 21:28:00 +08:00
weisdandGitHub 2edb2929b2 fix: DataUsageInfo add list bucket permission (#674) 2025-10-21 10:05:54 +08:00
cd1e244c68 Refactor: Introduce content checksums and improve multipart/object metadata handling (#671)
* feat:  adapt to s3s typed etag support

* refactor: move replication struct to rustfs_filemeta, fix filemeta transition bug

* add head_object checksum, filter object metadata output

* fix multipart checksum

* fix multipart checksum

* add content md5,sha256 check

* fix test

* fix cargo

---------

Co-authored-by: overtrue <[email protected]>
2025-10-20 23:46:13 +08:00
weisdandGitHub 5689311cff fix:#630 (#633) 2025-10-10 15:16:28 +08:00
weisdandGitHub 7622b37f7b add iam notification (#604)
move tonic service to rustfs
2025-09-30 17:32:23 +08:00
weisdandGitHub 90f21a9102 refactor: Reimplement bucket replication system with enhanced architecture (#590)
* feat:refactor replication

* use aws sdk for replication client

* refactor/replication

* merge main

* fix lifecycle test
2025-09-26 14:27:53 +08:00
weisdandGitHub ae7e86d7ef refactor: simplify initialization flow and modernize string formatting (#548) 2025-09-16 15:44:50 +08:00
weisdandGitHub 70e6bec2a4 feat:admin auth (#512)
* feat:admin auth

* fix:#509
2025-09-11 16:49:07 +08:00
weisdandGitHub 01b2623f66 Fix/response (#485)
* fix:list_parts response

* fix:list_objects skip delete_marker
2025-09-03 17:52:31 +08:00
c9d26c6e88 Fix/delete version (#484)
* fix:delete_version

* fix:test_lifecycle_expiry_basic

---------

Co-authored-by: likewu <[email protected]>
2025-09-03 15:12:58 +08:00
weisdandGitHub 10c949af62 fix:make bucket exists (#428) 2025-08-19 16:14:59 +08:00
weisdandGitHub 387f4faf78 fix:rm object versions (#385) 2025-08-12 15:33:47 +08:00
weisdandGitHub 9aba89a12c fix: miss inline metadata (#345) 2025-08-06 11:45:23 +08:00
weisdandGitHub 56fd8132e9 fix:#303 returns empty when querying an empty or not dir (#304) 2025-07-28 16:17:40 +08:00
weisdandGitHub 0167b2decd fix: optimize RPC connection management and prevent race conditions (#252) 2025-07-18 10:41:00 +08:00
weisdandGitHub e67980ff3c Fix/range content length (#251)
* fix:getobject range length
2025-07-17 23:25:21 +08:00
weisdandGitHub 96760bba5a fix:getobject range length (#250) 2025-07-17 23:14:19 +08:00
weisdandGitHub 749f55d688 feat: enhance version function with automatic version increment (#227) 2025-07-16 18:09:43 +08:00
weisdandGitHub 982cc66c74 fix: Refactor session policy handling and fix owner permission check (#226) 2025-07-16 16:40:51 +08:00
weisdandGitHub 4c1fc9317e fix: content-range (#216) 2025-07-15 17:23:33 +08:00
weisdandGitHub a9d77a618f feat: implement list_parts API for S3 multipart upload compatibility (#209)
* feat: add list_parts api
2025-07-15 16:04:03 +08:00
weisdandGitHub be05b704b0 feat: add Content-Length headers to admin API responses (#169) 2025-07-11 09:40:57 +08:00
weisdandGitHub 646070ae7a Feat/browser redirect layer (#167)
* feat: add browser redirect layer to route GET requests to console

* refactor: move RedirectLayer to separate layer.rs file

* feat: restrict redirect layer to only handle root path and index.html

* feat: restrict redirect layer to only handle root path /rustfs and index.html
2025-07-11 07:38:42 +08:00
84f5a4cb48 console web server and the s3 api share the same port (#163)
* merge console router

* make code happy

* Scanner (#156)

* feat: integrate CancellationToken for unified background services management

- Consolidate data scanner and auto heal cancellation tokens into single unified token
- Move GLOBAL_BACKGROUND_SERVICES_CANCEL_TOKEN to global.rs for centralized management
- Add graceful shutdown support to MRF heal routine with MinIO-compatible logic
- Implement heal_routine_with_cancel method preserving original healing logic
- Update main.rs to use unified background services shutdown mechanism
- Enhance error handling with proper ecstore Result types
- Fix clippy warnings for needless return statements
- Maintain backward compatibility while adding modern cancellation support

This change provides a cleaner architecture for background service lifecycle management
and ensures all healing services can be gracefully shut down through a single token.

Signed-off-by: junxiang Mu <[email protected]>

* fix: Refact heal and scanner design

Signed-off-by: junxiang Mu <[email protected]>

* refact: step 2

Signed-off-by: junxiang Mu <[email protected]>

* feat: refactor scanner module and add data usage statistics

- Move scanner code to scanner/ subdirectory for better organization
- Add data usage statistics collection and persistence
- Implement histogram support for size and version distribution
- Add global cancel token management for scanner operations
- Integrate scanner with ECStore for comprehensive data analysis
- Update error handling and improve test isolation
- Add data usage API endpoints and backend integration

Signed-off-by: junxiang Mu <[email protected]>

* Chore: fix ref and fix comment

Signed-off-by: junxiang Mu <[email protected]>

* fix: fix clippy

Signed-off-by: junxiang Mu <[email protected]>

---------

Signed-off-by: junxiang Mu <[email protected]>
Co-authored-by: dandan <[email protected]>

---------

Signed-off-by: junxiang Mu <[email protected]>
Co-authored-by: guojidan <[email protected]>
Co-authored-by: dandan <[email protected]>
2025-07-10 23:31:42 +08:00
weisdandGitHub 363e37c791 fix(iam):decrypt_data failed when password changed (#150) 2025-07-10 11:07:01 +08:00
weisdandGitHub 00d8008a89 Feat/region (#132)
* add region config
2025-07-09 14:48:51 +08:00
weisdandGitHub 21516251b0 fix:ci (#124) 2025-07-09 09:49:27 +08:00
weisdandGitHub 2bd11d476e fix: delete empty dir (#100)
* fix: delete empty dir
2025-07-08 15:08:20 +08:00
weisdandGitHub ce2ce4b16e fix:make bucket err (#85) 2025-07-07 18:07:18 +08:00
weisdandGitHub 855541678e fix(ecstore): doc test (#38) 2025-07-03 16:23:36 +08:00
weisdandGitHub 73d3d8ab5c refactor: simplify hash algorithm API and remove custom hasher implementation (#37)
- Remove custom hasher.rs module and Hasher trait
- Replace with HashAlgorithm enum for better type safety
- Simplify hash calculation from write()+sum() to hash_encode()
- Remove stateful hasher operations (reset, write, sum)
- Update all hash usage in ecstore client modules
- Maintain compatibility with existing checksum functionality
2025-07-03 15:53:00 +08:00
weisdandGitHub 6983a3ffce feat: change default listen to IPv4 and add panic recovery (#36) 2025-07-03 13:51:38 +08:00
weisdandGitHub bf690ad353 feat: improve ImportBucketMetadata handle (#26)
* feat: improve ImportBucketMetadata handle
2025-07-02 16:31:16 +08:00
weisd 7c79d4c1ca feat: add ImportBucketMetadata handler 2025-07-01 21:47:28 +08:00
weisd c5358ba62c fix: clippy 2025-06-30 22:47:06 +08:00
weisd c63c6187c5 fix: clippy 2025-06-30 22:38:29 +08:00
weisd 2fe0c8cd32 fix: clippy 2025-06-30 22:04:12 +08:00
weisd e4971b6d83 fix: resolve clippy warnings for inherent to_string method shadowing Display trait 2025-06-30 21:51:19 +08:00
weisd 24738dc635 fix: resolve clippy warnings in signer module
- Add #[allow(clippy::too_many_arguments)] for functions with 8 parameters
- Replace vec initialization with array where appropriate
- Fix test code warnings by adding #[allow] attributes
- Improve code quality while maintaining functionality
2025-06-30 21:41:34 +08:00
weisd 0606d3fc29 config: enable console server by default
- Change console_enable default value from false to true
- This makes the console server available by default for better user experience
- Users can still disable it by setting RUSTFS_CONSOLE_ENABLE=false
2025-06-30 21:36:38 +08:00
weisd bfeb746c5f style: fix code formatting issues
- Fix spacing and line formatting in signer modules
- Remove unnecessary blank lines
- Ensure consistent code style per project standards
2025-06-30 21:36:26 +08:00
weisd 20054d0a56 fix: simplify filemeta MessagePack serialization and improve code quality
- Refactor `unmarshal_msg` to use `rmp_serde::from_slice` instead of manual parsing
- Add serde field renaming attributes to `FileMetaVersion` struct
- Remove 428 lines of manual MessagePack parsing code
- Improve string comparison using `!object.is_empty()` instead of `object != ""`
- Update volume directory numbering in run script from test{0..4} to test{1..4}
- Clean up unused imports and code

Fixes #517
2025-06-29 22:39:36 +08:00
weisd a6cfb04453 test: tls error 2025-06-24 23:16:45 +08:00
weisd 58faf141bd feat: rpc auth 2025-06-18 20:00:39 +08:00
weisd 039108ee5e fix test 2025-06-18 18:51:54 +08:00
weisd 0ca03465e3 fix(erasure): write_quorum 2025-06-11 23:49:55 +08:00
weisd d529b9abbd add error log 2025-06-11 23:44:22 +08:00
weisd 8d636dba7f fix ci 2025-06-11 18:31:07 +08:00
weisd 2eeb9dbcbc fix cargo test error, delete unnecessary files 2025-06-11 00:35:16 +08:00
weisd 7c9046c2cd feat: update erasure benchmark to use new calc_shard_size import 2025-06-11 00:30:15 +08:00
weisd 3338f3236f fix fmt 2025-06-10 18:51:06 +08:00
weisd 6ea0185519 add reed-solomon-simd banchmark 2025-06-10 00:09:05 +08:00
weisdandhouseme 3edfdbea76 fix is_multipart 2025-06-09 10:22:22 +08:00
weisd 27ab2350c9 fix is_multipart 2025-06-09 01:23:49 +08:00
weisd 96de65ebab add disk test 2025-06-09 00:30:29 +08:00
weisdandhouseme bf48d88a47 fix filemeta 2025-06-07 22:22:26 +08:00
weisd 62a7824d0d fix clippy 2025-06-07 15:39:06 +08:00
weisd b570b6aa36 fix filemeta 2025-06-06 22:22:53 +08:00
weisd 17aaf2cbc2 fix filemeta 2025-06-06 22:19:40 +08:00
weisd 6b0de4254f rustfs:add get/put_object_retention 2025-06-04 20:06:58 +08:00