Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perform handle spill IO outside of locked section in SpillFramework #11880

Open
wants to merge 32 commits into
base: branch-25.02
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
1f97e53
try out a spill lock
zpuller Dec 11, 2024
128928d
fix test
zpuller Dec 16, 2024
664ec96
clean
zpuller Dec 16, 2024
82b0d7e
add host buffer handle spill lock test
zpuller Dec 16, 2024
2cf6f30
pr comments
zpuller Dec 17, 2024
4e3624e
atomic bool
zpuller Dec 17, 2024
9be9b38
fix comment
zpuller Dec 17, 2024
47e55ad
safe concurrency atomic swaps
zpuller Dec 18, 2024
d568860
no longer rely on setSpilling
zpuller Dec 18, 2024
48e30fb
fix races
zpuller Jan 8, 2025
8c449b3
[BROKEN] columnar batch impl
zpuller Jan 9, 2025
3c408b7
fix race
zpuller Jan 9, 2025
3994fb1
remaining impl
zpuller Jan 9, 2025
584b5e4
revert file
zpuller Jan 13, 2025
c33ce71
cleaning
zpuller Jan 13, 2025
340c331
clean up handle closing
zpuller Jan 14, 2025
1bac407
comments
zpuller Jan 14, 2025
3d3f7f7
license header
zpuller Jan 14, 2025
4f18c70
Merge branch 'branch-25.02' of https://github.com/zpuller/spark-rapid…
zpuller Jan 14, 2025
5b399bd
comments
zpuller Jan 14, 2025
d82890d
comments
zpuller Jan 14, 2025
07d8e7d
fix
zpuller Jan 14, 2025
04544e9
pr comments
zpuller Jan 15, 2025
97ba88f
pr comments
zpuller Jan 15, 2025
2bf8755
pr comments
zpuller Jan 20, 2025
6577c7f
add monte carlo tests
zpuller Jan 22, 2025
1a460bf
Merge branch 'branch-25.02' of https://github.com/NVIDIA/spark-rapids…
zpuller Jan 22, 2025
cb01f80
update license header
zpuller Jan 22, 2025
b3096d8
pr comments
zpuller Jan 22, 2025
cf47f32
Update sql-plugin/src/main/scala/com/nvidia/spark/rapids/spill/SpillF…
zpuller Jan 22, 2025
65a5579
simplify spill tracking
zpuller Jan 22, 2025
7c052d0
consolidate spilling var
zpuller Jan 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading