WIP: Attempt to implement parallel processing for sub-queries with independent caching

[minhyeong112]

• Added async support for parallel query processing
• Modified cache agent to handle independent sub-queries
• Updated correction agent prompts
• Work in progress - sharing for review

Work in Progress: Parallel Sub-Query Processing Implementation

Implementation Attempt Overview

This draft PR represents an exploration of implementing parallel processing for sub-queries with independent caching. This is not yet ready for merging but sharing for architectural discussion and guidance.

Attempted Changes

1. Core Architecture Modifications:

• Added async/parallel processing support using asyncio
• Modified SQL query cache agent for independent sub-query handling
• Updated correction agent prompts for better sub-query generation

2. Technical Approach:

• Goal: Parallelize processing of sub-queries from rewrite phase
• Implement independent caching per sub-query
• Combine results in answer agent

Current Challenges

1. Integration Issues:

• Coordinating multiple async operations while maintaining query context
• Managing cache state across parallel operations
• Synchronization when combining results

2. Open Questions:

• Best approach for maintaining context across parallel operations
• Optimal cache management strategy for concurrent access
• Agent framework modifications needed for full parallel support

Seeking Feedback On

1. Overall architectural approach
2. Handling of cache state in parallel environment
3. Suggestions for better agent coordination in async operations
4. Alternative approaches to consider

Note: This is a work-in-progress implementation shared for discussion and guidance. Not ready for production use.