Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions #24765

Open
jrombi opened this issue Jan 22, 2025 · 3 comments · May be fixed by #24767
Open

Java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions #24765

jrombi opened this issue Jan 22, 2025 · 3 comments · May be fixed by #24767

Comments

@jrombi
Copy link

jrombi commented Jan 22, 2025

I cannot reproduce into a smaller query, yet, but sharing the stacktrace already. I have seen some similar issues in the past in the issue tracker.

Running on Trino 468
Query works in Athena
Query with different partition works.
Issue seems to be an edge in the ArrayHistogramFunction arourd null checks.

java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
	at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
	at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
	at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
	at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
	at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
	at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
	at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
	at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
	at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
	at io.trino.operator.Driver.processInternal(Driver.java:403)
	at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
	at io.trino.operator.Driver.tryWithLock(Driver.java:709)
	at io.trino.operator.Driver.process(Driver.java:298)
	at io.trino.operator.Driver.processForDuration(Driver.java:269)
	at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
	at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
	at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
	at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
	at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
	at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
	at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:75)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1575)
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.12.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.13.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 26 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.1.3 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 6 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.11.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 55 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180909_41.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180909_41.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180656_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.0.4 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
@wendigo
Copy link
Contributor

wendigo commented Jan 22, 2025

Can you share the query?

@wendigo wendigo linked a pull request Jan 22, 2025 that will close this issue
Open
@jrombi
Copy link
Author

jrombi commented Jan 22, 2025 •
edited
Loading

The query is very large, but this would the snippet I believe. There are couple of other ARRAY_HISTOGRAM's, but those are very straightforward. No filter, etc.

I can maybe build a docker image from your pr and test it?

Thanks for the quick response!

ARRAY_HISTOGRAM(
      FLATTEN(
        ARRAY_AGG(seller_ids) FILTER (WHERE seller_ids IS NOT NULL)
      )
    ) AS seller_id_frequency,

@wendigo
Copy link
Contributor

wendigo commented Jan 22, 2025

@jrombi sure, if you can test that I'd be grateful!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix null check in the array_histogram trinodb/trino
2 participants
@wendigo @jrombi