Skip to content

sam33rch/kaldb

 
 

Repository files navigation

Astra

release version release pipeline license All Contributors

Astra is a polystore. The goal of this repo is to convert astra into a polystore.

Astra is a cloud-native search and analytics engine for log, trace, and audit data. It is designed to be easy to operate, cost-effective, and scale to petabytes of data.

Goals

  • Native support for log, trace, audit use cases.
  • Aggressively prioritize ingest of recent data over older data.
  • Full-text search capability.
  • First-class Kubernetes support for all components.
  • Autoscaling of ingest and query capacity.
  • Coordination free ingestion, so failure of a single node does not impact ingestion.
  • Works out of the box with sensible defaults.
  • Designed for zero data loss.
  • First-class Grafana support with accompanying plugin.
  • Built-in multi-tenancy, supporting several small use-cases on a single cluster.
  • Supports the majority of Apache Lucene features.
  • Drop-in replacement for most Opensearch log use cases.
  • Operate with multiple cloud providers.

Current Goals

  • General-purpose search cases, such as for an ecommerce site.
  • Document mutability - records are expected to be append only.
  • Additional storage engines other than Lucene.
  • Support for JVM versions other than the current LTS.
  • Supporting multiple Lucene versions.

Licensing

Licensed under MIT. Copyright (c) 2024 Slack.

About

KalDB is a cloud-native polystore for search and analytics

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 99.4%
  • Other 0.6%