[HUDI-8855] Add bucket properties for spark bucket index query pruning

[xicm]

Change Logs

we support bucket index pruning since HUDI-6207, but the configurations of bucket index doesn't been passed to SparkHoodieTableFileIndex.

Impact

none

Risk level (write none, low medium or high below)

none

Documentation Update

none

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[hudi-bot]

CI report:

• d89310f Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[danny0405]

all of these properties are write configs, so we wanna fix it by explicitly setting up all the catalog properties.

[TheR1sing3un]

The current index-related configuration items are divided into write config. Before bucket index pruning is implemented, these index-related write configurations are not used when reading, but now we need to use index-related configurations when reading.
Could we consider addressing this problem in a more general way:

1. moving the configurations that are currently written to the configuration that determines the layout of the file and that depend on those configurations for reads at read time to the table-level configuration?
2. Or, a simpler way to do this is to put these write configurations into the hms and get them automatically when you read table.