fran/rustfs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,697 Commits 52 Branches 132 Tags
4e87c4427fbc7ac5c66c9659acf23ab859488bfd
Commit Graph
1503 Commits
Author SHA1 Message Date
Zhengchao AnandGitHub 4e87c4427f refactor: route admin usecase construction boundary (#3894) 2026-06-26 11:39:32 +08:00
Zhengchao AnandGitHub 1d5bf2699a refactor: publish oidc through app context (#3893) 2026-06-26 10:17:30 +08:00
Zhengchao AnandGitHub c9614eb7cb refactor: route ecstore storage api boundaries (#3892) 2026-06-26 09:35:18 +08:00
Zhengchao AnandGitHub 97dce107f0 refactor: route storage owner contract imports (#3891) 2026-06-26 08:58:07 +08:00
Zhengchao AnandGitHub 2aca607119 refactor: move storage owner boundary aggregation (#3890) 2026-06-26 07:52:49 +08:00
Zhengchao AnandGitHub 19c925c480 refactor: expand storage api boundaries (#3886) 
* refactor: route root storage contracts

* refactor: expand storage api boundaries
 2026-06-26 04:19:02 +08:00
housemeandGitHub 7bf411f465 obs(get): add GET read pipeline metrics (#3868) 2026-06-26 04:02:02 +08:00
Zhengchao AnandGitHub 33b7f48f37 refactor: route root storage facades (#3867) 2026-06-25 23:23:45 +08:00
Zhengchao AnandGitHub 987ea4919f refactor: route admin storage facades (#3866) 2026-06-25 22:37:54 +08:00
Zhengchao AnandGitHub 1c973bc1d9 refactor: route app facade boundaries (#3865) 
* refactor: route app storage error helpers

* refactor: route app bucket owner facades

* refactor: route app runtime facades
 2026-06-25 21:57:42 +08:00
Zhengchao AnandGitHub 60c00f7622 refactor: route app and admin storage helpers (#3863) 
* refactor: route admin storage helper imports

* refactor: route app storage io helper imports
 2026-06-25 21:12:51 +08:00
cxymdsandGitHub 4cdc6ae63f fix(admin): refresh persisted pool states (#3861) 2026-06-25 21:08:55 +08:00
housemeandGitHub 96b1f5c373 feat(storage): optimize gt1g get read path (#3860) 
* feat(storage): tune gt1g get read path

* docs(ops): add gt1g get benchmark guide

* feat(scripts): add gt1g get fallback runner

* test(storage): trim gt1g get helper warnings

* test(storage): reduce gt1g get helper type complexity
 2026-06-25 20:12:08 +08:00
housemeandGitHub a30357d21e feat(storage): extend PUT path tuning and observability (#3829) 
* feat(storage): add multipart put stage metrics

* feat(scripts): add multipart put focus runner

* docs(operations): add multipart put server-path guides

* chore(scripts): add local rustfs restart helper

* docs(observability): add local metrics backend guide

* docs(observability): add localized multipart guides

* fix(ecstore): validate multipart batching path

* feat(obs): add erasure encode overlap metrics

* docs(ops): update overlap retest summary

* docs(ops): add batchblocks retest matrix

* docs(ops): extend overlap candidate summary

* docs(ops): capture 8-run overlap summary

* feat(storage): switch rename_data to msgpack map

* test(storage): add rename_data payload checks

* feat(object): add zero_copy_eager put path

* docs(ops): add zero_copy_eager put guide

* docs(ops): add deeper zero-copy next steps
 2026-06-25 19:24:35 +08:00
Zhengchao AnandGitHub 3942186f3d refactor: route app storage helper imports (#3856) 2026-06-25 18:10:49 +08:00
Zhengchao AnandGitHub a21f3c1a3f refactor: route app s3 api helpers (#3854) 2026-06-25 16:50:17 +08:00
Zhengchao AnandGitHub 2dd98b1f84 refactor: remove app dto wildcard imports (#3853) 2026-06-25 16:07:49 +08:00
Zhengchao AnandGitHub fe0227e9dc refactor: remove app storage wildcard imports (#3851) 2026-06-25 15:10:51 +08:00
GatewayJandGitHub 06fdbecf9d fix(s3tables): harden warehouse index races (#3849) 2026-06-25 14:35:24 +08:00
Zhengchao AnandGitHub bfb2a95e3d refactor: route admin context imports (#3848) 2026-06-25 14:27:25 +08:00
Zhengchao AnandGitHub 46fa28f542 refactor: centralize root runtime sources (#3846) 2026-06-25 13:19:52 +08:00
Zhengchao AnandGitHub 1c4bcd4372 refactor: centralize admin runtime sources (#3845) 2026-06-25 13:09:02 +08:00
Henry GuoandGitHub 1c4a279909 feat(table-catalog): add durable strong backing (#3836) 2026-06-25 12:22:30 +08:00
Zhengchao AnandGitHub 928074a97d refactor: centralize server storage runtime sources (#3843) 2026-06-25 12:20:53 +08:00
Zhengchao AnandGitHub 839cab47ce refactor: centralize startup runtime sources (#3838) 2026-06-25 11:31:38 +08:00
GatewayJandGitHub fe5961cc16 fix(s3tables): harden warehouse index consistency (#3835) 2026-06-25 11:31:25 +08:00
Henry GuoGitHubHenry Guo
 		1d6a8259c5 feat(table-catalog): add partition-local compaction (#3832) 
Co-authored-by: Henry Guo <[email protected]>
 2026-06-25 11:14:40 +08:00
Zhengchao AnandGitHub 873aea21ca refactor: centralize app context runtime fallbacks (#3837) 2026-06-25 11:00:42 +08:00
cxymdsandGitHub c6ef37d5a7 fix(server): handle MinIO cluster health probe (#3833) 2026-06-25 09:37:57 +08:00
Zhengchao AnandGitHub a935854b32 refactor: centralize scanner runtime source helpers (#3827) 
* refactor: batch lifecycle runtime source handles

* refactor: centralize scanner runtime source helpers
 2026-06-24 22:05:03 +08:00
Henry GuoGitHubHenry Guo
 		90f6371e29 fix(scanner): clear deleted bucket usage stats (#3822) 
* fix(scanner): clear deleted bucket usage stats

* fix(scanner): preserve usage timestamp on bucket cleanup

---------

Co-authored-by: Henry Guo <[email protected]>
 2026-06-24 21:08:32 +08:00
housemeandGitHub 623fc801f1 feat(replication): support custom TLS for bucket targets (#3825) 
* feat(replication): support insecure https bucket targets

* feat(replication): support custom ca bucket targets

* test(replication): satisfy e2e clippy for TLS helpers

* fix(replication): avoid native root panic for custom trust stores

* test(replication): decouple private IP target test from TLS roots

* test(replication): use target TLS client in private IP unit test
 2026-06-24 20:23:20 +08:00
Henry GuoandGitHub fcd0c9ec0f test(table-catalog): add atomic catalog backing fixture (#3821) 2026-06-24 19:05:13 +08:00
housemeandGitHub efebcb66be feat(perf): add large PUT tuning and encode optimization (#3816) 2026-06-24 19:04:04 +08:00
cxymdsandGitHub 0ffd561daf fix(health): decouple liveness and lock RPC deadlines (#3824) 2026-06-24 18:34:51 +08:00
cxymdsandGitHub 57e12e56d2 fix(admin): correct pool lifecycle status mapping (#3823) 2026-06-24 17:05:07 +08:00
cxymdsandGitHub eef8f43251 fix: harden lock timeouts, health, and heal paths (#3815) 2026-06-24 15:48:06 +08:00
Zhengchao AnandGitHub 94034ef406 refactor: centralize ecstore batch sources and aliases (#3817) 2026-06-24 14:12:48 +08:00
housemeandGitHub cbf526df87 refactor(admin): migrate OIDC consumers to app context (#3800) 2026-06-24 12:51:53 +08:00
GatewayJandGitHub 89dfb1357c fix(s3tables): harden catalog guard checks (#3801) 2026-06-24 12:51:40 +08:00
housemeandGitHub 31b5db9a75 feat(admin): expose cluster snapshot view (#3803) 2026-06-24 12:51:26 +08:00
cxymdsandGitHub 5eda332fee fix(heal): recover shards after node rejoin (#3814) 2026-06-24 12:51:16 +08:00
cxymdsandGitHub c14a442586 fix(storage): harden rebalance and decommission state (#3730) 2026-06-24 07:59:39 +08:00
housemeandGitHub 0a00d8d500 perf(server): lighten internode data-plane stack (#3735) 
* refactor(server): split internode dispatch scaffold

* test(server): cover internode dispatch prefix split

* refactor(server): name internode stack boundaries

* perf(server): skip internode request logging layer

* perf(server): skip internode trace layer

* perf(server): use lite internode request context

* feat(metrics): track internode rpc duration

* feat(ecstore): add put object stage summary logs

* test(metrics): update internode descriptor expectations

* fix(server): tighten internode path matching

* fix(pr): address review follow-up comments

* style(ecstore): simplify commit tail duration field

* refactor(ecstore): group put stage summary fields

* refactor(ecstore): inline put stage summary log

* fix(s3): return storage class for object attributes

* merge: sync latest main and resolve object attributes conflict

* fmt

* fix(server): remove duplicate rpc imports

* build(deps): bump memmap2 for RUSTSEC-2026-0186

* fix(s3select): align object_store with datafusion

* chore(deps): prune workspace dependencies

* perf(fuzz): optimize CI runtime with build/run split and matrix parallelization

  Separate fuzz harness compilation from execution to eliminate redundant
  builds across targets. Introduce matrix-based parallel execution for
  PR smoke and nightly fuzz jobs.

  Changes:

  - Split CI workflow into `fuzz-build` (compile once) and matrix run jobs
    (`pr-fuzz-smoke`, `nightly-fuzz-corpus`) that execute targets in parallel
  - Add `BUILD_ONLY` mode to run_ci_targets.sh / run_nightly_targets.sh
  - Add run_single_target.sh for matrix jobs (no build phase)
  - Optimize `local_metadata` fuzz target: reduce prefix iterations from
    8-10 (4 functions each) to 5 critical prefixes (parser-only), cutting
    per-iteration cost by ~3-5x
  - Move archive path validation (`validate_extract_relative_path`,
    `normalize_extract_entry_key`) from `rustfs` to `rustfs-utils::path`,
    eliminating `rustfs` binary crate dependency from fuzz harness
  - Remove `rustfs` from fuzz/Cargo.toml (drops significant transitive deps)
  - Add unit tests for archive path validation in rustfs-utils
  - Update fuzz/README.md with new workflow and script documentation

  Expected CI improvement: PR smoke wall-clock from ~120min (frequent
  timeout) to ~40min; nightly from ~180min to ~60min.

* refactor(fuzz): consolidate scripts and fix prefix test alignment

Replace three duplicated shell scripts (run_ci_targets.sh,
run_nightly_targets.sh, run_single_target.sh) with a single
parameterized run.sh that supports BUILD_ONLY, SKIP_BUILD, and
MAX_TOTAL_TIME environment variables.

Fix local_metadata fuzz target prefix testing: replace always-true
'len > 0' guard with lengths aligned to xl.meta binary layout
(4/5/8/12 bytes for magic+version+header fields). Remove redundant
empty-slice test.

Hoist RUSTFLAGS to workflow top-level env to eliminate per-job
duplication. Update README with unified script documentation.

Net: -118 lines, zero functionality loss.

* perf(fuzz): optimize CI runtime with build/run split and matrix parallelization

Restructure fuzz CI workflow to eliminate redundant compilation and
run targets in parallel via matrix strategy.

Workflow changes:
- Split into fuzz-build (compile once) and matrix run jobs
- PR smoke: 3 targets parallel, 60s each, timeout 30min (was 120min)
- Nightly: 3 targets parallel, 300s each, timeout 60min (was 180min)
- Pass compiled harness via actions/artifact between jobs
- Hoist RUSTFLAGS to workflow top-level env

Script consolidation:
- Replace 3 duplicated scripts with single parameterized run.sh
- Supports BUILD_ONLY, SKIP_BUILD, MAX_TOTAL_TIME env vars

Target optimizations:
- Remove rustfs binary crate from fuzz dependencies (was pulling
  979 transitive deps); move archive path validation to rustfs-utils
- Optimize local_metadata: reduce prefix iterations from 8-10x4
  calls to 5 prefixes with parser-only (no decompress), aligned
  with xl.meta binary layout (4/5/8/12 bytes)
- Add unit tests for archive path validation in rustfs-utils
- Update fuzz/README.md with unified script documentation

Expected: PR smoke wall-clock from ~120min (frequent timeout)
to ~40min; nightly from ~180min to ~60min.

* fix(rpc): resolve internode metrics via app context

* fmt

* ci: speed up fuzz smoke artifact restore

---------

Signed-off-by: houseme <[email protected]>
 2026-06-23 21:36:39 +08:00
唐小鸭GitHubhousemecxymds
 		eff656e086 fix(storage): restore legacy SSE-S3 read compatibility (#3584) 
* Update .gitignore

* Fix. fixed SSE-S3 compatibility issues in large-scale testing

* fix

* fix(ecstore): reject whitespace bucket names

* Update replication_extension_test.rs

* style(ecstore): format bucket whitespace test

---------

Co-authored-by: houseme <[email protected]>
Co-authored-by: cxymds <[email protected]>
 2026-06-23 21:35:17 +08:00
Zhengchao AnandGitHub 70a2441407 refactor: route notify dispatch through app context (#3789) 
* refactor: route notify dispatch through app context

* refactor: route admin IAM globals through app context (#3791)

* refactor: centralize IAM root credential access (#3792)
 2026-06-23 20:05:28 +08:00
housemeandGitHub da565c11bc refactor: migrate readiness and site replication app context (#3788) 
* refactor(runtime): route readiness lock clients via app context

* refactor(admin): route site replication iam via app context

* refactor(admin): route site replication oidc via app context
 2026-06-23 19:37:34 +08:00
housemeandGitHub 46775ae019 feat: harden runtime capability snapshots (#3784) 
* feat(admin): expose runtime capability snapshots

* feat(runtime): refine workload admission snapshots

* test(ci): align architecture migration checks

* build(deps): bump memmap2 for RUSTSEC-2026-0186

* build(deps): refresh cargo deny lockfile
 2026-06-23 18:10:49 +08:00
Zhengchao AnandGitHub fd2ab38581 refactor: route IAM reads through app context (#3786) 2026-06-23 17:57:55 +08:00
Zhengchao AnandGitHub 61cfd4fc13 refactor: route runtime consumers through app context (#3785) 2026-06-23 17:21:34 +08:00