Skip to content

Adding Maintenance Capabilities to PDX#13

Merged
lkuffo merged 24 commits intomainfrom
maintenance
Mar 5, 2026
Merged

Adding Maintenance Capabilities to PDX#13
lkuffo merged 24 commits intomainfrom
maintenance

Conversation

@lkuffo
Copy link
Copy Markdown
Collaborator

@lkuffo lkuffo commented Mar 5, 2026

New Features

Added a maintenance API for our PDXTree index. The API exposes index.append() and index.delete() methods in both the Flat and 8-bit variants.

  • Sustains 40k INSERTS/sec in 1 million scale datasets while maintaining high recall and low search latency thanks to PDX.
  • We have implemented an in-memory LIRE protocol (SPFresh) within our Tree index, combining some ideas of Quake. Further boosted by PDX pruning in several instances.

Limitations

  • Single threaded writer is assumed
  • Fully in-memory implementation

@lkuffo lkuffo changed the title Adding Mantainance Capabilities to PDX Adding Maintenance Capabilities to PDX Mar 5, 2026
@lkuffo lkuffo merged commit 93531b9 into main Mar 5, 2026
6 checks passed
@lkuffo lkuffo deleted the maintenance branch March 5, 2026 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant