Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sync to 1.2: fix Size() duplicate counting rows size. #17147

Conversation

gouhongshen
Copy link
Contributor

@gouhongshen gouhongshen commented Jun 25, 2024

What type of PR is this?

  • API-change
  • BUG
  • Improvement
  • Documentation
  • Feature
  • Test and CI
  • Code Refactoring

Which issue(s) this PR fixes:

issue ##17024

What this PR does / why we need it:

之前统计 partition state 里面的 rows 时,使用的是 row.Batch 的地址昨晚去重的手段,绝大多数情况下没有问题,但一条记录也可能会重复推到 CN,不属于同一个 logtail, 自然也不属于同一个 batch,所以就做不到去重的目的。现在使用 rowid 去重。

@matrix-meow matrix-meow added the size/S Denotes a PR that changes [10,99] lines label Jun 25, 2024
@gouhongshen gouhongshen changed the title fix Size() duplicate counting rows size. sync to 1.2: fix Size() duplicate counting rows size. Jun 25, 2024
@mergify mergify bot requested a review from sukki37 June 25, 2024 10:38
@mergify mergify bot added the kind/bug Something isn't working label Jun 25, 2024
@mergify mergify bot merged commit 994f3da into matrixorigin:1.2-dev Jun 25, 2024
17 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working size/S Denotes a PR that changes [10,99] lines
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants