cxymds and GitHub
ff28b79088
fix(s3): harden Snowball archive extraction ( #6942 )
...
* fix(s3): harden Snowball extract error boundaries
* fix(s3): close Snowball extract compatibility gaps
* fix(s3): verify Snowball request body completion
* test(s3): reject forged Snowball streaming signatures
* build(deps): pin Snowball archive parser limits
* fix(s3): preserve Snowball trailer and member errors
* docs(architecture): register Snowball tar fork cleanup
* refactor(s3): route Snowball errors through object boundary
* ci(deps): allow pinned tokio-tar source
* ci(e2e): refresh Snowball smoke selection
2026-08-31 11:18:09 +00:00
唐小鸭 and GitHub
35456bcede
test(scanner): serialize tests sharing process-global scanner state ( #6940 )
...
Under the cargo test fallback (threads in one process), tests that touch
the process-global scanner cycle recovery status or the global usage-save
metrics raced each other and failed randomly in full-suite runs.
Mark all touchers with #[serial] per docs/testing/README.md:
- 22 tests reading or writing scanner_cycle_recovery_status() via
load_scanner_cycle_state_for_startup / reset_scanner_cycle_recovery
- 24 tests mutating global_metrics() usage-save counters via
store_data_usage_in_backend*, which raced the existing serial
test_deferred_usage_save_keeps_last_real_save_metric
No-op under nextest, which isolates each test in its own process.
2026-08-31 18:20:25 +08:00
Zhengchao An and GitHub
9d4ccb7884
fix(ecstore): finalize decommission capacity recovery ( #6955 )
2026-08-31 18:09:09 +08:00
Zhengchao An and GitHub
9a22cb85f3
fix(ecstore): complete decommission capacity recovery ( #6949 )
2026-08-31 16:53:14 +08:00
Zhengchao An and GitHub
6c67086d0b
fix(ecstore): reserve decommission capacity safely ( #6917 )
2026-08-31 15:20:09 +08:00
bb37841362
chore(capacity): update default refresh tuning ( #6938 )
...
Align object-capacity refresh defaults with the production-oriented environment values and keep docs, script examples, and tests in sync.
Co-authored-by: heihutu <[email protected]
2026-08-31 14:43:59 +08:00
GatewayJ and GitHub
59a7194d7f
feat(s3select): schedule streaming progress events ( #6913 )
...
* feat(s3select): schedule streaming progress events
* test(s3select): poll permit release until timeout
2026-08-31 13:36:47 +08:00
GatewayJ and GitHub
589a954478
feat(s3select): support compressed CSV and JSON input ( #6915 )
2026-08-31 13:35:59 +08:00
1d606e1cf6
perf(ecstore): retry degraded GET with late parity ( #6933 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 13:32:46 +08:00
houseme and GitHub
d690f5d60d
test(ecstore): stabilize tier recovery cursor fixture ( #6935 )
2026-08-31 12:09:19 +08:00
houseme and GitHub
3eca80e37d
test(ecstore): make heal rename fixture deterministic ( #6934 )
2026-08-31 12:09:01 +08:00
45a2ccb734
fix(ecstore): recover late parity after exact quorum ( #6927 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 03:26:20 +00:00
c876df53f5
fix(ecstore): fence snapshot stream polls on lock loss ( #6930 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 02:26:24 +00:00
Zhengchao An and GitHub
ca46ae9e56
test(ecstore): pin bucket metadata rollback reads ( #6928 )
2026-08-31 01:48:03 +00:00
Zhengchao An and GitHub
7df0920c80
test(replication): bind writable paths to DTO fields ( #6923 )
2026-08-31 00:48:10 +00:00
Zhengchao An and GitHub
c4ac11d22e
fix(scanner): persist decommission catch-up debt ( #6922 )
2026-08-31 08:45:36 +08:00
602ed2cbcd
test(ecstore): add targeted refresh-loss harness ( #6924 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 08:45:04 +08:00
8ecd8f2520
fix(scanner): preserve cache cycle during usage recovery ( #6921 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 00:19:54 +00:00
Zhengchao An and GitHub
e6234d3714
test(ecstore): pin default bucket config bytes ( #6920 )
2026-08-31 00:03:07 +00:00
Zhengchao An and GitHub
042a0c3014
docs: register persisted XML compatibility cleanup ( #6918 )
...
docs: register persisted XML compatibility
2026-08-30 23:53:02 +00:00
87333f7b24
test(e2e): exercise cluster volume fault proxy ( #6919 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 23:37:34 +00:00
Zhengchao An and GitHub
9945c67f7e
fix(ecstore): supervise decommission worker recovery ( #6908 )
2026-08-31 06:18:00 +08:00
fca1514aac
fix(scanner): recover legacy empty usage floor ( #6914 )
...
Co-authored-by: heihutu <[email protected]
2026-08-31 06:17:26 +08:00
47ad69b691
fix(ecstore): fail closed on unverifiable data quorum ( #6903 )
...
fix(ecstore): require verification source for degraded GET
Fail closed when reconstruction has only an exact decode quorum, because no surplus source remains to validate the rebuilt data. Cover both erasure engines and the data-shards-only rollout gate.
Co-authored-by: heihutu <[email protected]
2026-08-30 21:07:47 +00:00
489408c0b0
perf(ecstore): reuse prepared Select metadata ( #6911 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 20:41:24 +00:00
9244eb36ed
test(e2e): route cluster volume endpoints through fault proxy ( #6909 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 20:17:16 +00:00
442298d5f7
test(ecstore): prove in-flight prefetch cancellation ( #6904 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 19:17:44 +00:00
唐小鸭 and GitHub
ec1cd606d3
fix(replication): surface object-lock denied purges and back off heal retries ( #6900 )
2026-08-30 18:59:55 +00:00
16af688a7a
fix(rpc): reject unsigned v2 control mutations ( #6905 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 18:17:43 +00:00
唐小鸭 and GitHub
37b23a16da
fix(replication): verify replica integrity and default to plain signed payloads ( #6895 )
2026-08-31 01:43:45 +08:00
006e9b7d28
test(e2e): cover four-node four-drive cluster topology ( #6902 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 17:32:36 +00:00
d214c27583
perf(ecstore): consolidate non-inline read planning ( #6892 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 17:15:48 +00:00
唐小鸭 and GitHub
1370434f3a
fix(scanner): unblock quota usage baseline on never-converged sites ( #6896 )
2026-08-31 00:20:04 +08:00
唐小鸭 and GitHub
5dde2c188c
fix(replication): retry failed multipart aborts on bounded backoff ( #6897 )
2026-08-31 00:19:49 +08:00
2f9c75d04f
perf(ecstore): reuse prepared metadata across pools ( #6889 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 16:15:10 +00:00
唐小鸭 and GitHub
9ee7b1221d
fix(admin): replicate user secret-key rotation to peer sites ( #6893 )
2026-08-30 23:32:07 +08:00
3d24526704
fix(ecstore): preserve parity reserves for data-only GET ( #6888 )
...
fix(ecstore): hedge data-only GET with parity
Route the opt-in data-shards-only lockstep path through the bounded parity race and preserve deferred parity reserves across canceled hedges.
Co-authored-by: heihutu <[email protected]
2026-08-30 20:16:32 +08:00
51532e19fb
test(ecstore): cover multipart snapshot overwrite race ( #6887 )
...
test(ecstore): cover multipart GET overwrite snapshot
Co-authored-by: heihutu <[email protected]
2026-08-30 12:15:02 +00:00
07212c4e26
perf(ecstore): gate quorum-aware GET early stop ( #6885 )
...
* perf(ecstore): add gated two-phase GET metadata reads
Co-Authored-By: heihutu <[email protected] [email protected] [email protected] [email protected] [email protected]
2026-08-30 09:33:35 +00:00
GatewayJ and GitHub
4932af080b
feat(s3select): expand typed JSON source paths ( #6864 )
2026-08-30 06:46:36 +00:00
7345b49cf6
perf(ecstore): gate GET metadata timing when metrics off ( #6879 )
...
Co-authored-by: heihutu <[email protected]
2026-08-30 05:43:08 +00:00
GatewayJ and GitHub
96239fc034
feat(s3select): report uncompressed input byte metrics ( #6865 )
2026-08-30 04:07:20 +00:00
cxymds and GitHub
0c18012442
fix(admin): version remote target credential capabilities ( #6876 )
2026-08-30 10:42:10 +08:00
ee39e4fccb
fix(scanner): own publication mutations through storage drain ( #6867 )
...
* fix(scanner): own publication mutations through storage drain
Co-Authored-By: heihutu <[email protected] [email protected] [email protected]
2026-08-30 02:39:07 +00:00
90ab2e24c3
perf(ecstore): reuse local fd metadata snapshots ( #6868 )
...
* perf(ecstore): reuse local fd metadata snapshots
Cache the validated shard length beside each reusable descriptor so read hits avoid a repeated fstat while retaining generation and mutation invalidation semantics.
Co-Authored-By: heihutu <[email protected] [email protected] [email protected]
2026-08-30 09:08:44 +08:00
cxymds and GitHub
21e5b3dc64
fix(ecstore): require durable decommission ledger format ( #6871 )
2026-08-30 08:47:09 +08:00
cxymds and GitHub
1e8c8d4cd5
feat(replication): support temporary target credentials ( #6860 )
2026-08-30 08:44:34 +08:00
ff3ad30f0c
fix(scanner): bound publication proof retries on main ( #6870 )
...
* fix(scanner): retain completed publication candidates
* fix(scanner): export publication activity helper
* test(ecstore): retain activity snapshot across retries
* fix(scanner): rebase publication proof retry onto main
Co-Authored-By: heihutu <[email protected] [email protected] [email protected] [email protected]
2026-08-29 22:41:36 +00:00
47a3f5ef01
perf(ecstore): converge disk metric atomic loads ( #6866 )
...
Use the seqlock version as the publication fence and keep payload reads relaxed while validating the final version. This reduces ordering overhead in disk metric recording and snapshot collection without changing the rolling-window contract.
Co-authored-by: heihutu <[email protected]
2026-08-29 20:38:59 +00:00
814ab5bbf3
fix(ecstore): classify system metadata failures ( #6862 )
...
fix(ecstore): classify system metadata volume failures
Preserve retryable quorum errors when system metadata reads or writes encounter missing volumes, and cover the create-bucket data-usage path with regressions.
Co-authored-by: heihutu <[email protected]
2026-08-29 19:48:50 +00:00
