78d6918c52
feat: extend hotpath coverage across crates ( #5505 )
...
Add opt-in hotpath feature surfaces to every workspace crate and wire the root rustfs feature passthrough for function, allocation, and CPU profiling.
Add a focused set of function-level measurements for scanner, heal, lock, target replay, IAM, KMS, Keystone, trusted proxy, and capacity paths without adding request-scoped primitive wrappers.
Co-authored-by: heihutu <[email protected]
2026-07-31 05:42:19 +00:00
ec25d09495
perf(utils): reduce highway hash key setup ( #5434 )
...
* fix: keep hotpath gate csv paths clean
Redirect the enhanced bench driver's verbose output away from command substitution so run_hotpath_warp_ab.sh records only the candidate cell path before passing baseline_compare.csv files to the gate.
Co-Authored-By: heihutu <[email protected] [email protected] [email protected]
2026-07-29 14:23:40 +00:00
c9848a6096
fix(security): enforce outbound connection policy ( #5135 )
...
Co-authored-by: cxymds <[email protected]
2026-07-22 22:11:28 +00:00
48b328d0d2
chore(deps): tighten crate dependency features ( #4896 )
...
* chore(deps): tighten crate dependency features
Narrow Tokio and dependency feature declarations for protocols, TLS runtime, utils, targets, and replication based on direct crate usage.
Co-Authored-By: heihutu <[email protected] [email protected] [email protected]
2026-07-16 06:55:52 +00:00
56179210ab
chore(deps): simplify dependency features ( #4890 )
...
* chore(deps): remove redundant dependency features
Remove manifest feature entries that are implied by other requested features in the same dependency declaration.
Verified that the resolved Cargo feature graph is unchanged after the cleanup.
Co-Authored-By: heihutu <[email protected] [email protected] [email protected]
2026-07-16 05:20:43 +00:00
f3a7a4b0da
chore(deps): localize workspace dependency features ( #4888 )
...
Move workspace-level dependency feature lists into the member crates that consume each dependency while keeping required default-features flags at the workspace root.
Also refresh starshard to 2.2.2 via cargo update and cargo upgrade --exclude ratelimit.
Co-authored-by: heihutu <[email protected]
2026-07-16 03:55:27 +00:00
houseme and GitHub
8cf11af649
fix(security): add shared outbound egress guard ( #3567 )
...
* fix(security): block unsafe outbound webhook targets
* chore: keep issue-3557 plan local only
2026-06-18 15:30:09 +08:00
houseme and GitHub
87a3d107d6
test(property): add path validator invariants ( #3541 )
...
test(property): add path validator invariants for #3525
2026-06-18 02:14:24 +08:00
houseme and GitHub
d74e6eb042
refactor(tls): centralize runtime foundation ( #3065 )
...
* refactor(targets): move notify net helpers from utils
* refactor(tls): centralize runtime foundation
* refactor(targets): move notify net helpers from utils
* refactor(tls): centralize runtime foundation
* feat(tls-runtime): add TLS debug state and admin handler
* refactor(tls-runtime): unify TLS debug consumer status view
* fix(tls): address PR3065 review feedback
* refactor(tls): align debug status payload types
* refactor(targets): harden TLS hot reload paths
* fix(targets): resolve review-4348251652 findings
* fix(targets): finalize tls runtime review follow-ups
* fix(targets): harden tls reload and review follow-ups
* fix(targets): align tls reload handling across targets
* fix(targets): finalize tls reload state and metrics updates
* chore(deps): trim unused TLS deps
* style(targets): normalize TLS reload formatting
* refactor(targets): introduce tls runtime adapter path
* chore: update workspace manifests for tls refactor
* fix(tls): stabilize material reload and audit workflow
* fix(targets): refresh tls fingerprint flow across sinks
* fix(tls): align runtime coordinator and http reader updates
* fix(sftp): simplify protocol error mapping
* fix(tls): harmonize material loading behavior
* fix(server): finalize tls material wiring in startup flow
* fix(protos): tighten tls generation cache and deps
2026-05-24 06:41:15 +00:00
安正超 and GitHub
3e3fcbf44d
fix(utils): cover sha256 checksum validation ( #3052 )
...
* fix(utils): cover sha256 checksum validation
* docs: clarify sha256 checksum validation
2026-05-22 02:45:53 +00:00
Henry Guo and GitHub
17eff5a97b
fix(tls): ignore Kubernetes secret projection dirs ( #2938 )
2026-05-13 03:45:42 +00:00
houseme and GitHub
f77ccd5b23
chore: move mcp crate to standalone repository ( #2578 )
2026-04-17 12:42:26 +00:00
979626c370
refactor(utils): decouple config deps and move sys helpers ( #2520 )
...
Co-authored-by: houseme <[email protected]
2026-04-13 21:05:03 +08:00
3c28f0a0ba
feat(metrics): migrate system monitoring from rustfs-obs to rustfs-metrics ( #2242 )
...
Co-authored-by: houseme <[email protected]
2026-03-20 18:52:33 +08:00
weisd and GitHub
b9b7d86ae4
feat: improve legacy metadata and admin compatibility ( #2202 )
2026-03-18 21:05:09 +08:00
d17d2083d4
feat(targets): enhance webhook TLS support with custom CA and skip-verify ( #1994 )
...
Co-authored-by: Copilot <[email protected] [email protected] [email protected]
2026-02-27 21:24:49 +08:00
houseme and GitHub
2ee81496b0
fix: deduplicate disks in capacity calculation to prevent inflation ( #1656 )
2026-01-30 00:03:21 +08:00
760cb1d734
Fix Windows Path Separator Handling in rustfs_utils ( #1464 )
...
Co-authored-by: reatang <[email protected]
2026-01-11 19:53:51 +08:00
houseme and GitHub
04f441361e
replace winapi to windows crate ( #1455 )
2026-01-10 02:15:08 +08:00
eb33e82b56
fix: Prevent panic in GetMetrics gRPC handler on invalid input ( #1291 )
...
Co-authored-by: Copilot <[email protected] [email protected]
2025-12-29 03:10:23 +08:00
8dd3e8b534
fix: decode form-urlencoded object names in webhook/mqtt Key field ( #1210 )
...
Co-authored-by: copilot-swe-agent[bot] <[email protected] [email protected] [email protected]
2025-12-20 01:31:09 +08:00
601f3456bc
Fix large file upload freeze with adaptive buffer sizing ( #869 )
...
* Initial plan
* Fix large file upload freeze by increasing StreamReader buffer size
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] #871 )
* Initial plan
* Fix: Trigger self-heal when missing shards detected during read
- Added proactive heal detection in get_object_with_fileinfo
- When reading an object, now checks if any shards are missing even if read succeeds
- Sends low-priority heal request to reconstruct missing shards on rejoined nodes
- This fixes the issue where data written during node outage is not healed when node rejoins
Co-authored-by: houseme <[email protected] #873 )
* Initial plan
* Replace CRC libraries with unified crc-fast implementation
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-11-17 23:15:20 +08:00
b7964081ce
Fix KMS configuration synchronization across cluster nodes ( #855 )
...
* Initial plan
* Add KMS configuration persistence to cluster storage
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-11-16 00:05:03 +08:00
houseme and GitHub
e22b24684f
chore: bump dependencies, add metrics support, remove DNS resolver ( #699 )
...
* upgrade version
* add metrics
* remove dns resolver
* add metrics counter for create bucket
* fix
* fix
* fix
2025-10-24 00:16:17 +08:00
weisd and GitHub
a65856bdf4
Fix CRC32C Checksum Implementation and Enhance Authentication System ( #678 )
...
* fix: get_condition_values
* fix checksum crc32c
* fix clippy
2025-10-21 21:28:00 +08:00
ad99019749
Add complete MNMD Docker deployment example with startup coordination and VolumeNotFound fix ( #642 )
...
* Initial plan
* Add MNMD Docker deployment example with 4 nodes x 4 drives
- Create docs/examples/mnmd/ directory structure
- Add docker-compose.yml with proper disk indexing (1..4)
- Add wait-and-start.sh for startup coordination
- Add README.md with usage instructions and alternatives
- Add CHECKLIST.md with step-by-step verification
- Fixes VolumeNotFound issue by using correct volume paths
- Implements health checks and startup ordering
- Uses service names for stable inter-node addressing
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-10-12 13:15:14 +08:00
aac9b1edb7
chore: improve event and docker-compose ,Improve the permissions of the endpoint health interface, upgrade otel from 0.30.0 to 0.31.0 ( #620 )
...
* feat: improve code for notify
* upgrade starshard version
* upgrade version
* Fix ETag format to comply with HTTP standards by wrapping with quotes (#592 )
* Initial plan
* Fix ETag format to comply with HTTP standards by wrapping with quotes
Co-authored-by: overtrue <[email protected] [email protected] [email protected] [email protected] #596 )
* improve lock
Signed-off-by: Mu junxiang <[email protected] [email protected] [email protected] [email protected] #599 )
* feat(append): implement object append operations with state tracking
Signed-off-by: junxiang Mu <[email protected] [email protected] [email protected] #595 )
Co-authored-by: loverustfs <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-10-11 09:08:25 +08:00
weisd and GitHub
90f21a9102
refactor: Reimplement bucket replication system with enhanced architecture ( #590 )
...
* feat:refactor replication
* use aws sdk for replication client
* refactor/replication
* merge main
* fix lifecycle test
2025-09-26 14:27:53 +08:00
houseme and GitHub
0c3079ae5e
remove deps ( #529 )
2025-09-13 21:06:40 +08:00
29c004d935
feat: enhance console separation with enterprise-grade security, monitoring, and advanced tower-http integration ( #513 )
...
* Initial plan
* feat: implement console service separation from endpoint
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-09-13 14:48:14 +08:00
ca9a2b6ab9
feat: Implement enhanced DNS resolver with hickory-resolver, TLS support, and layered fallback for Kubernetes environments ( #505 )
...
* Initial plan
* feat: Implement layered DNS resolver with caching and validation
Co-authored-by: houseme <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-09-10 21:16:33 +08:00
2525b66658
refactor: replace lazy_static with LazyLock ( #164 )
...
* refactor: replace `lazy_static` with `LazyLock`
* update cursorrules
---------
Co-authored-by: copilot-swe-agent[bot] <[email protected]
2025-07-10 23:50:46 +08:00
+2
36acb5bce9
feat(console): Enhance network address handling for WebUI ( #129 )
...
* add crates homepage,description,keywords,categories,documentation
* add readme
* modify version 0.0.3
* cargo fmt
* fix: yaml.docker-compose.security.no-new-privileges.no-new-privileges-docker-compose.yml (#63 )
* Feature up/ilm (#61 )
* fix delete-marker expiration. add api_restore.
* remove target return 204
* log level
* fix: make lint build and clippy happy (#71 )
Signed-off-by: yihong0618 <[email protected] #72 )
Signed-off-by: yihong0618 <[email protected] #77 )
* feat: optimize GitHub Actions workflows with performance improvements
- Rename workflows with more descriptive names
- Add unified setup action for consistent environment setup
- Optimize caching strategy with Swatinem/rust-cache@v2
- Implement skip-check mechanism to avoid duplicate builds
- Simplify matrix builds with better include/exclude logic
- Add intelligent build strategy checks
- Optimize Docker multi-arch builds
- Improve artifact naming and retention
- Add performance testing with benchmark support
- Enhance security audit with dependency scanning
- Change Chinese comments to English for better maintainability
Performance improvements:
- CI testing: ~35 min (42% faster)
- Build release: ~60 min (50% faster)
- Docker builds: ~45 min (50% faster)
- Security audit: ~8 min (47% faster)
* fix: correct secrets context usage in GitHub Actions workflow
- Move environment variables to job level to fix secrets access issue
- Fix unrecognized named-value 'secrets' error in if condition
- Ensure OSS upload step can properly check for required secrets
* fix: resolve GitHub API rate limit by adding authentication token
- Add github-token input to setup action to authenticate GitHub API requests
- Pass GITHUB_TOKEN to all setup action usages to avoid rate limiting
- Fix arduino/setup-protoc@v3 API access issues in CI/CD workflows
- Ensure protoc installation can successfully access GitHub releases API
* fix:make bucket err (#85 )
* Rename DEVELOPMENT.md to CONTRIBUTING.md
* Create issue-translator.yml (#89 )
Enable Issues Translator
* fix(dockerfile): correct env variable names for access/secret key and improve compatibility (#90 )
* fix: restore Zig and cargo-zigbuild caching in GitHub Actions setup action (#92 )
* fix: restore Zig and cargo-zigbuild caching in GitHub Actions setup action
Use mlugg/setup-zig and taiki-e/cache-cargo-install-action to speed up cross-compilation tool installation and avoid repeated downloads. All comments and code are in English.
* fix: use correct taiki-e/install-action for cargo-zigbuild
Use taiki-e/install-action@cargo-zigbuild instead of taiki-e/cache-cargo-install-action@v2 to match the original implementation from PR #77 .
* refactor: remove explicit Zig version to use latest stable
* Create CODE_OF_CONDUCT.md
* Create SECURITY.md
* Update issue templates
* Create CLA.md
* docs: update PR template to English version
* fix: improve data scanner random sleep calculation
- Fix random number generation API usage
- Adjust sleep calculation to follow MinIO pattern
- Ensure proper random range for scanner cycles
Signed-off-by: junxiang Mu <[email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected] [email protected]
2025-07-09 14:39:40 +08:00
houseme and GitHub
5826396cd0
refactor: Restructure project layout and clean up dependencies ( #30 )
...
This commit introduces a significant reorganization of the project structure to improve maintainability and clarity.
Key changes include:
- Adjusted the directory layout for a more logical module organization.
- Removed unused crate dependencies, reducing the overall project size and potentially speeding up build times.
- Updated import paths and configuration files to reflect the structural changes.
2025-07-02 19:33:12 +08:00
houseme and GitHub
2e14b32ccd
chore: Add copyright and license headers ( #23 )
...
* chore: Add copyright and license headers
This commit adds the Apache 2.0 license and a copyright notice to the header of all source files. This ensures that the licensing and copyright information is clearly stated within the codebase.
* cargo fmt
* fix
* fmt
* fix clippy
2025-07-02 15:07:47 +08:00
weisd and GitHub
830d2b8df5
fix: dep ( #21 )
2025-07-02 13:26:13 +08:00
2698d3aa10
fix/event ( #514 )
...
* improve code for notify
* fix
* cargo fmt
* improve code and create `DEFAULT_DELIMITER`
* fix
* fix
* improve code for notify
* fmt
* Update crates/notify/src/registry.rs
Co-authored-by: Copilot <[email protected] [email protected] [email protected]
2025-06-27 09:41:29 +08:00
26f84a9696
Feature/event ( #513 )
...
* improve code for notify
* fix
* cargo fmt
* improve code and create `DEFAULT_DELIMITER`
* fix
* fix
* improve code for notify
* fmt
* Update crates/notify/src/registry.rs
Co-authored-by: Copilot <[email protected] [email protected] [email protected]
2025-06-27 00:28:28 +08:00
likewu
81f0c9763f
Merge branch 'main' of https://github.com/rustfs/s3-rustfs into feature/ilm
...
# Conflicts:
# Cargo.lock
# Cargo.toml
# crates/utils/Cargo.toml
# crates/utils/src/net.rs
# ecstore/Cargo.toml
# ecstore/src/set_disk.rs
# rustfs/src/storage/ecfs.rs
2025-06-23 16:42:18 +08:00
likewu
cc71f40a6d
ilm feature add
2025-06-22 23:04:40 +08:00
houseme
c7af6587f5
trace log use local time and get custom user agent
2025-06-22 10:31:32 +08:00
houseme
48d530cb13
Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
...
# Conflicts:
# crates/utils/Cargo.toml
# ecstore/src/store_list_objects.rs
# iam/src/manager.rs
# rustfs/src/admin/rpc.rs
2025-06-20 12:58:47 +08:00
weisd
e145586b65
refactor: reorganize RPC modules into unified structure
2025-06-19 17:06:54 +08:00
houseme
e6b019c29d
Merge branch 'main' of github.com:rustfs/s3-rustfs into feature/observability-metrics
...
# Conflicts:
# .github/workflows/build.yml
# .github/workflows/ci.yml
# Cargo.lock
# Cargo.toml
# appauth/src/token.rs
# crates/config/src/config.rs
# crates/event-notifier/examples/simple.rs
# crates/event-notifier/src/global.rs
# crates/event-notifier/src/lib.rs
# crates/event-notifier/src/notifier.rs
# crates/event-notifier/src/store.rs
# crates/filemeta/src/filemeta.rs
# crates/notify/examples/webhook.rs
# crates/utils/Cargo.toml
# ecstore/Cargo.toml
# ecstore/src/cmd/bucket_replication.rs
# ecstore/src/config/com.rs
# ecstore/src/disk/error.rs
# ecstore/src/disk/mod.rs
# ecstore/src/set_disk.rs
# ecstore/src/store_api.rs
# ecstore/src/store_list_objects.rs
# iam/Cargo.toml
# iam/src/manager.rs
# policy/Cargo.toml
# rustfs/src/admin/rpc.rs
# rustfs/src/main.rs
# rustfs/src/storage/mod.rs
2025-06-19 13:16:48 +08:00
weisd
c48ebd5149
feat: add compress support
2025-06-17 15:06:40 +08:00
weisd
e8a59d7c07
move disk::utils to crates::utils
2025-06-11 15:55:40 +08:00
houseme
28c71cc351
fix
2025-06-09 12:25:56 +08:00
weisd and weisd
9384b831ec
ecstore update ec/disk/error
2025-06-06 01:13:51 +08:00
overtrue
c29841a5e7
feat: add comprehensive test coverage for utils certs module
2025-05-27 22:44:30 +08:00
overtrue
a6c3b122bd
feat: enhance test coverage and fix compilation errors
2025-05-25 12:56:43 +08:00
