Skip to content

Tracking issue: Prometheus compatibility MVP #111

@flyingmutant

Description

@flyingmutant

Initial Prometheus compatibility support: scraping, remote write, PromQL.

  • speed up ClickHouse access by using https://github.com/ClickHouse/ch-go
  • check the details of how VictoriaMetrics downsampling works (do MetricsQL query results looks the same no matter the downsampling?)
  • decide if we'll continue to use Prometheus PromQL implementation or migrate to MetricsQL
  • remove all fancy SQL mapping features and focus on in-memory computation on raw data

Setup:

  • setup StatsHouse agents on all nodes of our biggest k8s cluster
  • start scraping several big k8s (or node_exporter) metrics using k8s service discovery, probably prefixing them for namespacing (is this related to Tracking issue: group budgets #110?)
  • setup Prometheus/VM scraping of the same metrics
  • compare standard Grafana dashboards with StatsHouse vs Prometheus/VM data source

Optimizations:

  • translate regexp label selectors into SQL IN matches
  • consider making all internal operations operate on int tag values, translating to strings only before returning the result

Misc. things:

Out of MVP scope:

  • making sure PromQL is a superset of /api/query (e.g. topk semantics)
  • protobuf scraping

Histograms:

See also:

Metadata

Metadata

Assignees

No one assigned

    Labels

    A-promArea: Prometheus / OpenMetrics / PromQL compatibilityA-shArea: statshouse (agent / aggregator)A-uiArea: statshouse-uiC-feature-requestCategory: request for new functionalityC-tracking-issueCategory: tracking issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions