Skip to content

[manager] Checkpoint listing may be too expensive #5917

@mihaibudiu

Description

@mihaibudiu

From @swanandx in slack:

we might be spending too much time listing, using --files-from here instead of --include-from would help with this.

afaik: include-from lists whole dir and filters; where as files-from would directly fetch files we requested. As we provide list of files ( and also verify ) anyways, it should be fine right?

Metadata

Metadata

Assignees

Labels

Pipeline managerPipeline manager (API, API server, runner, compiler server)enterpriseIssue related to Feldera Enterprise features.

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions