Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: deflake rebalance/by-load roachtests #139037

Open
1 of 6 tasks
kvoli opened this issue Jan 14, 2025 · 1 comment
Open
1 of 6 tasks

roachtest: deflake rebalance/by-load roachtests #139037

kvoli opened this issue Jan 14, 2025 · 1 comment
Assignees
Labels
A-kv-distribution Relating to rebalancing and leasing. A-testing Testing tools and infrastructure branch-master Failures and bugs on the master branch. branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 branch-release-24.3.3-rc C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-kv KV Team

Comments

@kvoli
Copy link
Collaborator

kvoli commented Jan 14, 2025

The rebalance/by-load roachtests have been failing repeatedly over the last several months. Attempts at deflaking them have not been successful.

List of open failures:

rebalance/by-load/leases/mixed-version

rebalance/by-load/replicas/mixed-version

This issue is to skip, then deflake these roachtests.

Jira issue: CRDB-46484

@kvoli kvoli added A-kv-distribution Relating to rebalancing and leasing. A-testing Testing tools and infrastructure C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-kv KV Team labels Jan 14, 2025
@kvoli kvoli self-assigned this Jan 14, 2025
Copy link

blathers-crl bot commented Jan 14, 2025

Hi @kvoli, please add branch-* labels to identify which branch(es) this C-bug affects.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@kvoli kvoli added branch-master Failures and bugs on the master branch. branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 branch-release-24.1 Used to mark GA and release blockers, technical advisories, and bugs for 24.1 branch-release-23.2 Used to mark GA and release blockers, technical advisories, and bugs for 23.2 branch-release-24.2 Used to mark GA and release blockers, technical advisories, and bugs for 24.2 branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 branch-release-25.1 branch-release-24.3.3-rc and removed branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 branch-release-24.1 Used to mark GA and release blockers, technical advisories, and bugs for 24.1 branch-release-23.2 Used to mark GA and release blockers, technical advisories, and bugs for 23.2 branch-release-24.2 Used to mark GA and release blockers, technical advisories, and bugs for 24.2 branch-release-25.1 labels Jan 14, 2025
kvoli added a commit to kvoli/cockroach that referenced this issue Jan 14, 2025
In cockroachdb#129117, shared process deployments were added to the
`rebalance/by-load/*/mixed-version` roachtests. Despite multiple
deflaking attempts (cockroachdb#131787, cockroachdb#133681, cockroachdb#136115, cockroachdb#136116), these continue
to fail weekly. The root cause is currently unknown.

Part of: cockroachdb#139037
Release note: None
kvoli added a commit to kvoli/cockroach that referenced this issue Jan 14, 2025
In cockroachdb#129117, shared process deployments were added to the
`rebalance/by-load/*/mixed-version` roachtests. Despite multiple
deflaking attempts (cockroachdb#131787, cockroachdb#133681, cockroachdb#136115, cockroachdb#136116), these continue
to fail weekly. The root cause is currently unknown.

Part of: cockroachdb#139037
Release note: None
@kvoli kvoli removed the branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 label Jan 14, 2025
craig bot pushed a commit that referenced this issue Jan 14, 2025
139040: roachtest: disable shared process rebalance/by-load roachtests r=arulajmani a=kvoli

In #129117, shared process deployments were added to the `rebalance/by-load/*/mixed-version` roachtests. Despite multiple deflaking attempts (#131787, #133681, #136115, #136116), these continue to fail weekly. The root cause is currently unknown.

Part of: #139037
Release note: None

Co-authored-by: Austen McClernon <[email protected]>
craig bot pushed a commit that referenced this issue Jan 14, 2025
138696: sql: add CHECK EXTERNAL CONNECTION command r=kev-cao a=kev-cao

This patch adds the `CHECK EXTERNAL CONNECTION` command and replaces the old `SHOW BACKUP CONNECTION` syntax.

Epic: None

Release note: None

139040: roachtest: disable shared process rebalance/by-load roachtests r=arulajmani a=kvoli

In #129117, shared process deployments were added to the `rebalance/by-load/*/mixed-version` roachtests. Despite multiple deflaking attempts (#131787, #133681, #136115, #136116), these continue to fail weekly. The root cause is currently unknown.

Part of: #139037
Release note: None

139042: roachtest: fix single node sysbench setup r=srosenberg a=DarrylWong

The single node setup was accidentally using HAProxy for the prepare step, causing it to silently fail and segfault later on. Since segfaults are an ignored error, the single node tests were silently failing.

Fixes: #139024
Epic: none
Release note: none

Co-authored-by: Kevin Cao <[email protected]>
Co-authored-by: Austen McClernon <[email protected]>
Co-authored-by: DarrylWong <[email protected]>
blathers-crl bot pushed a commit that referenced this issue Jan 14, 2025
In #129117, shared process deployments were added to the
`rebalance/by-load/*/mixed-version` roachtests. Despite multiple
deflaking attempts (#131787, #133681, #136115, #136116), these continue
to fail weekly. The root cause is currently unknown.

Part of: #139037
Release note: None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-kv-distribution Relating to rebalancing and leasing. A-testing Testing tools and infrastructure branch-master Failures and bugs on the master branch. branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 branch-release-24.3.3-rc C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-kv KV Team
Projects
None yet
Development

No branches or pull requests

1 participant