Skip to content

Use serializer exporter for sending metrics #37930

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
songy23 merged 28 commits into from
Mar 4, 2025
Merged

Use serializer exporter for sending metrics #37930

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
4e912f6
Use serializer exporter for sending metrics
dineshg13 Feb 14, 2025
7e7ae16
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Feb 14, 2025
0ddef65
Add changelog + add shutdown func
dineshg13 Feb 18, 2025
3206399
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Feb 18, 2025
b4f6c4f
update go mod versions
dineshg13 Feb 18, 2025
da798d0
fix lint + other issues
dineshg13 Feb 18, 2025
d16a4d0
local testing
dineshg13 Feb 18, 2025
b27ff55
update deps for serializerexporter
dineshg13 Feb 21, 2025
40bbef0
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Feb 21, 2025
a2420eb
merge main
dineshg13 Feb 21, 2025
5fb4ee6
some fixes
dineshg13 Feb 21, 2025
71110f5
Apply suggestions from code review
dineshg13 Mar 2, 2025
d7b983b
update go modules
dineshg13 Mar 3, 2025
3c7eaf0
compiling version
dineshg13 Mar 3, 2025
51ec0e7
add integration test
dineshg13 Mar 3, 2025
385829c
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 3, 2025
6e43527
merge main
dineshg13 Mar 3, 2025
e0b98f4
Fix tests + PR comments
dineshg13 Mar 4, 2025
dce41ff
run gotidy
dineshg13 Mar 4, 2025
6ebbcab
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 4, 2025
9063bf7
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 4, 2025
6841cc0
Apply suggestions from code review
dineshg13 Mar 4, 2025
c87f42b
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 4, 2025
30ae881
merge main + tidy
dineshg13 Mar 4, 2025
58e902f
run gotidy
dineshg13 Mar 4, 2025
c7c74f2
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 4, 2025
958cfe9
Merge remote-tracking branch 'origin/main' into dinesh.gurumurthy/use…
dineshg13 Mar 4, 2025
cd8ae9a
Merge branch 'main' into dinesh.gurumurthy/use-serializer-exporter
dineshg13 Mar 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions .chloggen/dinesh.gurumurthy_use-serializer-exporter.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# Use this changelog template to create an entry for release notes.

# One of 'breaking', 'deprecation', 'new_component', 'enhancement', 'bug_fix'
change_type: enhancement

# The name of the component, or a single word describing the area of concern, (e.g. filelogreceiver)
component: datadogexporter

# A brief description of the change. Surround your text with quotes ("") if it needs to start with a backtick (`).
note: |
Add support for exporting metrics to Datadog using the Datadog serializer. Enable feature gate `exporter.datadogexporter.metricexportserializerclient` to send metrics with the Datadog serializer.

# Mandatory: One or more tracking issues related to the change. You can use the PR number here if no issue exists.
issues: [37930]

# (Optional) One or more lines of additional information to render under the primary note.
# These lines will be padded with 2 spaces and then inserted directly into the document.
# Use pipe (|) for multiline entries.
subtext: |
This change adds ability to export metrics to Datadog using the Datadog serializer. Apart from performance improvements, this change also adds support for metrics origins in the Datadog App. It also removes the support for using the host attributes from the first resource the exporter processes.

# If your change doesn't affect end users or the exported elements of any package,
# you should instead start your pull request title with [chore] or use the "Skip Changelog" label.
# Optional: The change log or logs in which this entry should be included.
# e.g. '[user]' or '[user, api]'
# Include 'user' if the change is relevant to end users.
# Include 'api' if there is a change to a library API.
# Default: '[user]'
change_logs: [user]
27 changes: 24 additions & 3 deletions connector/datadogconnector/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,16 +50,23 @@ require (
github.com/DataDog/datadog-agent/comp/core/hostname/hostnameinterface v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/core/log/def v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/core/secrets v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/core/status v0.63.2 // indirect
github.com/DataDog/datadog-agent/comp/core/tagger/origindetection v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/core/telemetry v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/def v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/forwarder/defaultforwarder v0.63.2 // indirect
github.com/DataDog/datadog-agent/comp/forwarder/orchestrator/orchestratorinterface v0.63.2 // indirect
github.com/DataDog/datadog-agent/comp/logs/agent/config v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/otelcol/logsagentpipeline v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/otelcol/logsagentpipeline/logsagentpipelineimpl v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/otelcol/otlp/components/exporter/logsagentexporter v0.64.0-devel.0.20250218192636-64fdfe7ec366 // indirect
github.com/DataDog/datadog-agent/comp/otelcol/otlp/components/exporter/serializerexporter v0.65.0-devel.0.20250304124125-23a109221842 // indirect
github.com/DataDog/datadog-agent/comp/serializer/logscompression v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/serializer/metricscompression v0.63.2 // indirect
github.com/DataDog/datadog-agent/comp/trace/compression/def v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/comp/trace/compression/impl-gzip v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/aggregator/ckey v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/api v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/collector/check/defaults v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/config/env v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/config/mock v0.64.0-rc.6 // indirect
Expand All @@ -83,21 +90,31 @@ require (
github.com/DataDog/datadog-agent/pkg/logs/sources v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/logs/status/statusinterface v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/logs/status/utils v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/metrics v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/orchestrator/model v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/process/util/api v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/remoteconfig/state v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/serializer v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/status/health v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/tagger/types v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/tagset v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/telemetry v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/backoff v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/buf v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/util/cgroups v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/common v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/util/compression v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/executable v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/filesystem v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/fxutil v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/hostname/validate v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/http v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/json v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/util/log v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/option v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/pointer v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/scrubber v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/sort v0.63.2 // indirect
github.com/DataDog/datadog-agent/pkg/util/startstop v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/statstracker v0.64.0-rc.6 // indirect
github.com/DataDog/datadog-agent/pkg/util/system v0.64.0-rc.6 // indirect
Expand All @@ -109,12 +126,14 @@ require (
github.com/DataDog/go-sqllexer v0.1.1 // indirect
github.com/DataDog/go-tuf v1.1.0-0.5.2 // indirect
github.com/DataDog/gohai v0.0.0-20230524154621-4316413895ee // indirect
github.com/DataDog/mmh3 v0.0.0-20210722141835-012dc69a9e49 // indirect
github.com/DataDog/opentelemetry-mapping-go/pkg/inframetadata v0.26.0 // indirect
github.com/DataDog/opentelemetry-mapping-go/pkg/otlp/logs v0.26.0 // indirect
github.com/DataDog/opentelemetry-mapping-go/pkg/quantile v0.26.0 // indirect
github.com/DataDog/sketches-go v1.4.7 // indirect
github.com/DataDog/viper v1.14.0 // indirect
github.com/DataDog/zstd v1.5.6 // indirect
github.com/DataDog/zstd_0 v0.0.0-20210310093942-586c1286621f // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.26.0 // indirect
github.com/Microsoft/go-winio v0.6.2 // indirect
github.com/alecthomas/participle/v2 v2.1.1 // indirect
Expand Down Expand Up @@ -169,7 +188,7 @@ require (
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/mock v1.7.0-rc.1 // indirect
github.com/golang/protobuf v1.5.4 // indirect
github.com/golang/snappy v0.0.4 // indirect
github.com/golang/snappy v0.0.5-0.20220116011046-fa5810519dcb // indirect
github.com/google/gnostic-models v0.6.8 // indirect
github.com/google/gofuzz v1.2.0 // indirect
github.com/google/uuid v1.6.0 // indirect
Expand Down Expand Up @@ -230,6 +249,7 @@ require (
github.com/prometheus/client_model v0.6.1 // indirect
github.com/prometheus/common v0.62.0 // indirect
github.com/prometheus/procfs v0.15.1 // indirect
github.com/richardartoul/molecule v1.0.1-0.20240531184615-7ca0df43c0b3 // indirect
github.com/rs/cors v1.11.1 // indirect
github.com/secure-systems-lab/go-securesystemslib v0.9.0 // indirect
github.com/shirou/gopsutil/v3 v3.24.5 // indirect
Expand All @@ -245,6 +265,7 @@ require (
github.com/tinylib/msgp v1.2.5 // indirect
github.com/tklauser/go-sysconf v0.3.14 // indirect
github.com/tklauser/numcpus v0.9.0 // indirect
github.com/twmb/murmur3 v1.1.8 // indirect
github.com/ua-parser/uap-go v0.0.0-20240611065828-3a4781585db6 // indirect
github.com/x448/float16 v0.8.4 // indirect
github.com/yusufpapurcu/wmi v1.2.4 // indirect
Expand Down Expand Up @@ -317,9 +338,9 @@ require (
go.uber.org/dig v1.18.0 // indirect
go.uber.org/fx v1.23.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
golang.org/x/exp v0.0.0-20250210185358-939b2ce775ac // indirect
golang.org/x/exp v0.0.0-20250218142911-aa4b98e5adaa // indirect
golang.org/x/net v0.35.0 // indirect
golang.org/x/oauth2 v0.26.0 // indirect
golang.org/x/oauth2 v0.27.0 // indirect
golang.org/x/sys v0.30.0 // indirect
golang.org/x/term v0.29.0 // indirect
golang.org/x/text v0.22.0 // indirect
Expand Down
Loading