Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[CELEBORN-1187][FOLLOWUP] Unify the size and file count of active shu…
…ffle metrics for master and worker ### What changes were proposed in this pull request? Unify the size and file count of active shuffle metrics for `MasterSource` and `WorkerSource`. Follow up #2171. ### Why are the changes needed? `MasterSource` uses `PartitionWritten` and `PartitionFileCount` metrics as the size and file count of active shuffle for all workers. Meanwhile, `WorkerSource` uses `ActiveShuffleSize` and `ActiveShuffleFileCount` metrics as the size and file count of active shuffle for a worker including master replica and slave replica. It's recommended to unify the size and file count of active shuffle metrics between `MasterSource` and `WorkerSource`. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Internal tests. Closes #2186 from SteNicholas/CELEBORN-1187. Authored-by: SteNicholas <[email protected]> Signed-off-by: mingji <[email protected]>
- Loading branch information