Skip to content
This repository was archived by the owner on Jun 14, 2024. It is now read-only.
This repository was archived by the owner on Jun 14, 2024. It is now read-only.

Implement smart refresh indexes of append-only data  #112

Description

@apoorvedave1

Describe the issue

Implement refresh(mode = "smart") of refresh of incremental data. The smart mode does a combination of #110 and #111 in a single step when the user calls the above api.
It uses the new unindexed data along with the small files from previous index snapshot to create a new index version.

Thanks @sezruby for suggesting this.

To Reproduce

Expected behavior

Environment

Metadata

Metadata

Assignees

Labels

advanced issueThis is the tag for advanced issues which involve major design changes or introductionenhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions