Skip to content

[FEATURE] [SPARK] add async fetch hdfs result #7235

@echo567

Description

@echo567

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the feature

During the Spark SQL execution phase, a thread pool is used when retrieving iterators to improve execution speed.

Motivation

Improve the speed of Spark SQL when retrieving results from HDFS

Describe the solution

Add a thread pool

Additional context

No response

Are you willing to submit PR?

  • Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
  • No. I cannot submit a PR at this time.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions