houseme and GitHub
38f26b7c94
improve import,crate version,and copyright ( #790 )
2025-11-05 09:10:06 +08:00
houseme and GitHub
d934e3905b
Refactor telemetry initialization for non-production environments ( #789 )
...
* add dep `scopeguard`
* improve for tracing
* fix
* fix
* improve code for import
* add logger trace id
* fix
* fix
* fix
* fix
* fix
2025-11-05 00:55:08 +08:00
0714c7a9ca
modify logger level from info to error ( #744 )
...
* modify logger level from `info` to `error`
* fix test
* improve tokio runtime config
* add rustfs helm chart files (#747 )
* add rustfs helm chart files
* update readme file with helm chart
* delete helm chart license file
* fix typo in readme file
* fix: restore localized samples in tests (#749 )
* fix: restore required localized examples
* style: fix formatting issues
* improve code for Observability
* upgrade crates version
* fix
* up
* fix
---------
Co-authored-by: majinghe <[email protected] >
Co-authored-by: 安正超 <[email protected] >
2025-10-29 19:20:53 +08:00
weisd and GitHub
ed73e2b782
fix:add favicon.ico route ( #713 )
2025-10-25 16:11:18 +08:00
houseme and GitHub
e22b24684f
chore: bump dependencies, add metrics support, remove DNS resolver ( #699 )
...
* upgrade version
* add metrics
* remove dns resolver
* add metrics counter for create bucket
* fix
* fix
* fix
2025-10-24 00:16:17 +08:00
houseme and GitHub
416d3ad5b7
Refactor: Add observability enable flag, improve comments, remove unused config params, and enhance run function error logging. ( #689 )
...
* improve code for dns log
* fix
* Improve comments, remove unused parameters in config.rs (opt), add observability enable flag, and enhance error logging in run function execution.
2025-10-23 13:59:57 +08:00
42d3645d6f
fix(targets): make target removal and reload transactional; prevent reappearing entries ( #662 )
...
* feat: improve code for notify
* upgrade starshard version
* upgrade version
* Fix ETag format to comply with HTTP standards by wrapping with quotes (#592 )
* Initial plan
* Fix ETag format to comply with HTTP standards by wrapping with quotes
Co-authored-by: overtrue <[email protected] >
* bufigx
---------
Co-authored-by: copilot-swe-agent[bot] <[email protected] >
Co-authored-by: overtrue <[email protected] >
Co-authored-by: overtrue <[email protected] >
* Improve lock (#596 )
* improve lock
Signed-off-by: Mu junxiang <[email protected] >
* feat(tests): add wait_for_object_absence helper and improve lifecycle test reliability
Signed-off-by: Mu junxiang <[email protected] >
* chore: remove dirty docs
Signed-off-by: Mu junxiang <[email protected] >
---------
Signed-off-by: Mu junxiang <[email protected] >
* feat(append): implement object append operations with state tracking (#599 )
* feat(append): implement object append operations with state tracking
Signed-off-by: junxiang Mu <[email protected] >
* chore: rebase
Signed-off-by: junxiang Mu <[email protected] >
---------
Signed-off-by: junxiang Mu <[email protected] >
* build(deps): upgrade s3s (#595 )
Co-authored-by: loverustfs <[email protected] >
* fix: validate mqtt broker
* improve code for `import`
* fix
* improve
* remove logger from `rustfs-obs` crate
* remove code for config Observability
* fix
* improve code
* fix comment
* up
* up
* upgrade version
* fix
* fmt
* upgrade tokio version to 1.48.0
* upgrade `datafusion` and `reed-solomon-simd` version
* fix
* fmt
* improve code for notify webhook example
* improve code
* fix
* fix
* fmt
---------
Signed-off-by: Mu junxiang <[email protected] >
Signed-off-by: junxiang Mu <[email protected] >
Co-authored-by: Copilot <[email protected] >
Co-authored-by: overtrue <[email protected] >
Co-authored-by: overtrue <[email protected] >
Co-authored-by: guojidan <[email protected] >
Co-authored-by: Nugine <[email protected] >
Co-authored-by: loverustfs <[email protected] >
2025-10-17 15:34:53 +08:00
weisd and GitHub
ae7e86d7ef
refactor: simplify initialization flow and modernize string formatting ( #548 )
2025-09-16 15:44:50 +08:00
houseme and GitHub
a12a3bedc3
feat(obs): optimize WriteMode selection logic in init_telemetry ( #546 )
...
- Refactor WriteMode selection to ensure all variables moved into thread closures are owned types, preventing lifetime issues.
- Simplify and clarify WriteMode assignment for production and non-production environments.
- Improve code readability and maintainability for logger initialization.
2025-09-16 08:25:37 +08:00
cafec06b7e
[Optimization] Enhance obs module telemetry.rs with environment-aware logging and production security ( #539 )
...
* Initial plan
* Implement environment-aware logging with production stdout auto-disable
Co-authored-by: houseme <[email protected] >
* add mimalloc crate
* fix
* improve code
---------
Co-authored-by: copilot-swe-agent[bot] <[email protected] >
Co-authored-by: houseme <[email protected] >
Co-authored-by: houseme <[email protected] >
Co-authored-by: loverustfs <[email protected] >
2025-09-15 14:52:20 +08:00
c5df1f92c2
refactor: replace lazy_static with LazyLock and notify crate registry create_targets_from_config ( #311 )
...
* improve code for notify
* improve code for logger and fix typo (#272 )
* Add GNU to build.yml (#275 )
* fix unzip error
* fix url change error
fix url change error
* Simplify user experience and integrate console and endpoint
Simplify user experience and integrate console and endpoint
* Add gnu to build.yml
* upgrade version
* feat: add `cargo clippy --fix --allow-dirty` to pre-commit command (#282 )
Resolves #277
- Add --fix flag to automatically fix clippy warnings
- Add --allow-dirty flag to run on dirty Git trees
- Improves code quality in pre-commit workflow
* fix: the issue where preview fails when the path length exceeds 255 characters (#280 )
* fix
* fix: improve Windows build support and CI/CD workflow (#283 )
- Fix Windows zip command issue by using PowerShell Compress-Archive
- Add Windows support for OSS upload with ossutil
- Replace Chinese comments with English in build.yml
- Fix bash syntax error in package_zip function
- Improve code formatting and consistency
- Update various configuration files for better cross-platform support
Resolves Windows build failures in GitHub Actions.
* fix: update link in README.md leading to a 404 error (#285 )
* add rustfs.spec for rustfs (#103 )
add support on loongarch64
* improve cargo.lock
* build(deps): bump the dependencies group with 5 updates (#289 )
Bumps the dependencies group with 5 updates:
| Package | From | To |
| --- | --- | --- |
| [hyper-util](https://github.com/hyperium/hyper-util ) | `0.1.15` | `0.1.16` |
| [rand](https://github.com/rust-random/rand ) | `0.9.1` | `0.9.2` |
| [serde_json](https://github.com/serde-rs/json ) | `1.0.140` | `1.0.141` |
| [strum](https://github.com/Peternator7/strum ) | `0.27.1` | `0.27.2` |
| [sysinfo](https://github.com/GuillaumeGomez/sysinfo ) | `0.36.0` | `0.36.1` |
Updates `hyper-util` from 0.1.15 to 0.1.16
- [Release notes](https://github.com/hyperium/hyper-util/releases )
- [Changelog](https://github.com/hyperium/hyper-util/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/hyper-util/compare/v0.1.15...v0.1.16 )
Updates `rand` from 0.9.1 to 0.9.2
- [Release notes](https://github.com/rust-random/rand/releases )
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/compare/rand_core-0.9.1...rand_core-0.9.2 )
Updates `serde_json` from 1.0.140 to 1.0.141
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.140...v1.0.141 )
Updates `strum` from 0.27.1 to 0.27.2
- [Release notes](https://github.com/Peternator7/strum/releases )
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Peternator7/strum/compare/v0.27.1...v0.27.2 )
Updates `sysinfo` from 0.36.0 to 0.36.1
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GuillaumeGomez/sysinfo/compare/v0.36.0...v0.36.1 )
---
updated-dependencies:
- dependency-name: hyper-util
dependency-version: 0.1.16
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: dependencies
- dependency-name: rand
dependency-version: 0.9.2
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: dependencies
- dependency-name: serde_json
dependency-version: 1.0.141
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: dependencies
- dependency-name: strum
dependency-version: 0.27.2
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: dependencies
- dependency-name: sysinfo
dependency-version: 0.36.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: dependencies
...
Signed-off-by: dependabot[bot] <[email protected] >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* improve code for logger
* improve
* upgrade
* refactor: 优化构建工作流,统一 latest 文件处理和简化制品上传 (#293 )
* Refactor: DatabaseManagerSystem as global
Signed-off-by: junxiang Mu <[email protected] >
* fix: fmt
Signed-off-by: junxiang Mu <[email protected] >
* Test: add e2e_test for s3select
Signed-off-by: junxiang Mu <[email protected] >
* Test: add test script for e2e
Signed-off-by: junxiang Mu <[email protected] >
* improve code for registry and intergation
* improve code for registry `create_targets_from_config`
* fix
* Feature up/ilm (#305 )
* fix
* fix
* fix
* fix delete-marker expiration. add api_restore.
* fix
* time retry object upload
* lock file
* make fmt
* fix
* restore object
* fix
* fix
* serde-rs-xml -> quick-xml
* fix
* checksum
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* transfer lang to english
* upgrade clap version from 4.5.41 to 4.5.42
* refactor: replace `lazy_static` with `LazyLock`
* add router
* fix: modify comment
* improve code
* fix typos
* fix
* fix: modify name and fmt
* improve code for registry
* fix test
---------
Signed-off-by: dependabot[bot] <[email protected] >
Signed-off-by: junxiang Mu <[email protected] >
Co-authored-by: loverustfs <[email protected] >
Co-authored-by: 安正超 <[email protected] >
Co-authored-by: shiro.lee <[email protected] >
Co-authored-by: Marco Orlandin <[email protected] >
Co-authored-by: zhangwenlong <[email protected] >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: junxiang Mu <[email protected] >
Co-authored-by: likewu <[email protected] >
2025-07-30 19:02:10 +08:00
houseme and GitHub
3f095e75cb
improve code for logger and fix typo ( #272 )
2025-07-21 15:20:36 +08:00
houseme and GitHub
b4c316c662
fix logger format ( #134 )
...
* fix logger format
* fmt
2025-07-09 16:05:22 +08:00
houseme and GitHub
2e14b32ccd
chore: Add copyright and license headers ( #23 )
...
* chore: Add copyright and license headers
This commit adds the Apache 2.0 license and a copyright notice to the header of all source files. This ensures that the licensing and copyright information is clearly stated within the codebase.
* cargo fmt
* fix
* fmt
* fix clippy
2025-07-02 15:07:47 +08:00
houseme
7bd8431006
cargo fmt
2025-06-27 18:53:51 +08:00
houseme
749537664f
fix:Apply suggestions from clippy 1.88
2025-06-27 18:16:29 +08:00
weisd
7e17d7d729
refactor: improve object listing and version handling
...
- Refactor find_version_index to accept Uuid directly instead of string
- Split from_meta_cache_entries_sorted into separate methods for versions and infos
- Add support for after_version_id filtering in version listing
- Fix S3 error code for replication configuration not found
- Improve error handling and logging levels
- Clean up import statements and remove debug code
2025-06-24 11:10:23 +08:00
houseme
e8a5b5d12c
improve flexi_logger relation
2025-06-24 09:19:26 +08:00
weisd
4559baaeeb
feat: migrate to reed-solomon-simd only implementation
...
- Remove reed-solomon-erasure dependency and all related code
- Simplify ReedSolomonEncoder from enum to struct with SIMD-only implementation
- Eliminate all conditional compilation (#[cfg(feature = ...)])
- Add instance caching with RwLock-based encoder/decoder reuse
- Implement reset mechanism to avoid unnecessary allocations
- Ensure thread safety with proper cache management
- Update documentation and benchmark scripts for SIMD-only approach
- Apply code formatting across all files
Breaking Changes:
- Removes support for reed-solomon-erasure feature flag
- API remains compatible but implementation is now SIMD-only
Performance Impact:
- Improved encoding/decoding performance through SIMD optimization
- Reduced memory allocations via instance caching
- Enhanced thread safety and concurrency support
2025-06-23 10:00:17 +08:00
houseme
c7af6587f5
trace log use local time and get custom user agent
2025-06-22 10:31:32 +08:00
weisd
f85ef06783
merge main
2025-06-09 15:31:11 +08:00
houseme and GitHub
d66525a22f
refactor(deps): centralize crate versions in root Cargo.toml ( #448 )
...
* chore(ci): upgrade protoc from 30.2 to 31.1
- Update protoc version in GitHub Actions setup workflow
- Use arduino/setup-protoc@v3 to install the latest protoc version
- Ensure compatibility with current project requirements
- Improve proto file compilation performance and stability
This upgrade aligns our development environment with the latest protobuf standards.
* modify package version
* refactor(deps): centralize crate versions in root Cargo.toml
- Move all dependency versions to workspace.dependencies section
- Standardize AWS SDK and related crates versions
- Update tokio, bytes, and futures crates to latest stable versions
- Ensure consistent version use across all workspace members
- Implement workspace inheritance for common dependencies
This change simplifies dependency management and ensures version consistency across the project.
* fix
* modify
2025-06-07 21:52:59 +08:00
weisd
62a7824d0d
fix clippy
2025-06-07 15:39:06 +08:00
weisd
7032318858
update obs
2025-06-06 16:46:12 +08:00
houseme
b003d08d55
set logger level from RUST_LOG
2025-06-06 16:19:17 +08:00
houseme
541b812bb4
improve code for obs crate
2025-05-30 13:04:24 +08:00
houseme
7cff7f0bd1
fix(obs): align stdout log level with configured logger_level
...
- Replace fixed `flexi_logger::Duplicate::Info` with dynamic level from config
- Convert logger_level string to corresponding LevelFilter enum
- Ensure terminal output respects the same log level as file logs
- Fix documentation to reflect the dynamic level behavior
2025-05-30 00:22:21 +08:00
houseme
4a9b842aa3
fix
2025-05-29 22:30:33 +08:00
houseme
545e5b2efb
fix
2025-05-29 21:15:45 +08:00
houseme
3ceec7b5f2
improve code for obs
2025-05-29 21:10:04 +08:00
houseme and GitHub
7abcfe31e8
improve code for otel ( #418 )
2025-05-26 12:05:57 +08:00
houseme
571cedf4ce
feat(obs): implement global OpenTelemetry guard management
2025-05-12 13:32:18 +08:00
01d5383ce3
Feature/bucket event notification ( #365 )
...
* add tracing instrument
* fix rebalance/decom
* modify Telemetry filter order
* feat: improve address binding and port handling mechanism (#366 )
* feat: improve address binding and port handling mechanism
1. Add support for ":port" format to enable dual-stack binding (IPv4/IPv6)
2. Implement automatic port allocation when port 0 is specified
3. Optimize server startup process with unified address resolution
4. Enhance error handling and logging for address resolution
5. Improve graceful shutdown with signal listening
6. Clean up commented code in console.rs
Files:
- ecstore/src/utils/net.rs
- rustfs/src/console.rs
- rustfs/src/main.rs
Branch: feature/server-and-console-port
* improve code for console
* improve code
* improve code for console and net.rs
* Update rustfs/src/main.rs
Co-authored-by: Copilot <[email protected] >
* Update rustfs/src/utils/mod.rs
Co-authored-by: Copilot <[email protected] >
---------
Co-authored-by: Copilot <[email protected] >
* upgrade config file
* modify
* fix readme
Signed-off-by: junxiang Mu <[email protected] >
* improve readme.md
* improve code for readme.md
add chinese readme.md
* Implement Storage Service Event Notification System
Added event notification capability to the storage module, enabling the storage service to publish object operation events. Key changes include:
1. Created `event_notifier` module providing core functionality:
- `create_metadata()` - Creates event metadata objects with default configuration ID
- `send_event()` - Asynchronously sends event notifications with error handling
2. Integrated the `rustfs_event_notifier` library:
- Supports object creation, deletion, and access events
- Provides event metadata building and management
- Includes proper error propagation
These changes enable the system to trigger notifications when storage operations occur, facilitating auditing, monitoring, and integration with other systems.
* fix
---------
Signed-off-by: junxiang Mu <[email protected] >
Co-authored-by: weisd <[email protected] >
Co-authored-by: Copilot <[email protected] >
Co-authored-by: junxiang Mu <[email protected] >
2025-04-30 00:31:55 +08:00
houseme
e5cd061e18
improve code for request and telemetry
2025-04-29 11:55:59 +08:00
junxiang Mu
e346d20228
tmp1
...
Signed-off-by: junxiang Mu <[email protected] >
2025-04-29 02:53:42 +00:00
houseme
68a89d59e5
modify
2025-04-28 12:50:56 +08:00
houseme
e8f8a0872d
modify Telemetry filter order
2025-04-27 09:50:32 +08:00
houseme
05f1412323
improve code for opentelemetry
2025-04-26 17:26:54 +08:00
houseme
7dae5f8ab7
improve code
2025-04-25 13:35:03 +08:00
houseme and GitHub
86353d98d5
feat: add TraceLayer for HTTP service and improve metrics ( #361 )
...
* improve code for opentelemetry and add system metrics
* feat: add TraceLayer for HTTP service and improve metrics
- Add TraceLayer to HTTP server for request tracing
- Implement system metrics for process monitoring
- Optimize init_telemetry method for better resource management
- Add graceful shutdown handling for telemetry components
- Fix GracefulShutdown ownership issues with Arc wrapper
* improve code for init_process_observer
* remove tomlfmt.toml
* Translation comment
* improve code for console CompressionLayer params
2025-04-24 19:04:57 +08:00
weisd
cffd4fc28d
merge fix/pools
2025-04-23 16:48:57 +08:00
weisd and weisd
fff7e5f827
pool select idx
...
fixs:#346, #339 , #338 , #337 , #336 , #334
test healbucket
test get_available_pool_idx
fix
2025-04-23 15:11:43 +08:00
houseme
6d1a4ab824
improve for logger
2025-04-22 22:41:45 +08:00
weisd
18b50c1752
otel debug filter tower
2025-04-22 09:07:43 +08:00
houseme
ab8b19eb5d
improve signal watch
2025-04-11 16:48:07 +08:00
houseme
a07ca8ae81
improve code for obs
2025-04-09 15:12:31 +08:00