Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

report tested integrations and their tested versions #3669

Merged
merged 28 commits into from
Oct 18, 2023

Conversation

wconti27
Copy link
Contributor

@wconti27 wconti27 commented Oct 2, 2023

What does this PR do?

This PR collects data about each integration and its specific version during testing, which is then collected by the APM Test Agent. After plugin tests run, the Test Agent is queried for data describing each integration that was encountered during testing. This data is then stored as post-run artifacts.

Daily, the artifacts data will be pulled by a script located in an internal DataDog repo (here), and then uploaded to Metabase.

Dashboards and analytics will be created/performed with the data regarding supported integrations, and will be crossed with customer dependency data.

Motivation

Inform non-technical stakeholders of supported integrations & versions to make data-driven decisions

Plugin Checklist

Additional Notes

@wconti27 wconti27 self-assigned this Oct 2, 2023
@github-actions
Copy link

github-actions bot commented Oct 2, 2023

Overall package size

Self size: 5.38 MB
Deduped: 58.45 MB
No deduping: 58.62 MB

Dependency sizes

name version self size total size
@datadog/native-iast-taint-tracking 1.6.1 14.96 MB 14.97 MB
@datadog/native-appsec 4.0.0 14.83 MB 14.83 MB
@datadog/pprof 4.0.0 8.25 MB 9.1 MB
protobufjs 7.2.4 2.74 MB 6.52 MB
@datadog/native-iast-rewriter 2.1.3 2.23 MB 2.32 MB
@opentelemetry/core 1.14.0 872.87 kB 1.47 MB
@datadog/native-metrics 2.0.0 898.77 kB 1.3 MB
@opentelemetry/api 1.4.1 780.32 kB 780.32 kB
import-in-the-middle 1.4.2 41.4 kB 704.79 kB
msgpack-lite 0.1.26 201.16 kB 281.59 kB
opentracing 0.14.7 194.81 kB 194.81 kB
semver 7.5.4 93.4 kB 123.8 kB
@datadog/sketches-js 2.1.0 109.9 kB 109.9 kB
lodash.sortby 4.7.0 75.76 kB 75.76 kB
lru-cache 7.14.0 74.95 kB 74.95 kB
ipaddr.js 2.1.0 60.23 kB 60.23 kB
ignore 5.2.4 51.22 kB 51.22 kB
int64-buffer 0.1.10 49.18 kB 49.18 kB
istanbul-lib-coverage 3.2.0 29.34 kB 29.34 kB
lodash.uniq 4.5.0 25.01 kB 25.01 kB
limiter 1.1.5 23.17 kB 23.17 kB
retry 0.13.1 18.85 kB 18.85 kB
lodash.kebabcase 4.1.1 17.75 kB 17.75 kB
node-abort-controller 3.1.1 16.89 kB 16.89 kB
lodash.pick 4.4.0 16.33 kB 16.33 kB
jest-docblock 29.7.0 8.99 kB 12.76 kB
crypto-randomuuid 1.0.0 11.18 kB 11.18 kB
diagnostics_channel 1.1.0 7.07 kB 7.07 kB
path-to-regexp 0.1.7 6.78 kB 6.78 kB
koalas 1.0.2 6.47 kB 6.47 kB
methods 1.1.2 5.29 kB 5.29 kB
module-details-from-path 1.0.3 4.47 kB 4.47 kB

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov
Copy link

codecov bot commented Oct 2, 2023

Codecov Report

Merging #3669 (3c6021b) into master (53438db) will increase coverage by 0.27%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3669      +/-   ##
==========================================
+ Coverage   84.61%   84.89%   +0.27%     
==========================================
  Files         225      223       -2     
  Lines        9238     9063     -175     
  Branches       33       33              
==========================================
- Hits         7817     7694     -123     
+ Misses       1421     1369      -52     

see 4 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pr-commenter
Copy link

pr-commenter bot commented Oct 2, 2023

Benchmarks

Benchmark execution time: 2023-10-17 15:11:00

Comparing candidate commit 3c6021b in PR branch conti/report-tested-integrations-and-versions with baseline commit 53438db in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 478 metrics, 14 unstable metrics.

@wconti27 wconti27 marked this pull request as ready for review October 12, 2023 20:00
@wconti27 wconti27 requested a review from a team as a code owner October 12, 2023 20:00
@tlhunter tlhunter changed the title conti/report tested integrations and their tested versions report tested integrations and their tested versions Oct 17, 2023
rochdev
rochdev previously approved these changes Oct 17, 2023
@wconti27 wconti27 enabled auto-merge (squash) October 18, 2023 10:08
@wconti27 wconti27 merged commit 16ab71a into master Oct 18, 2023
102 of 107 checks passed
uurien pushed a commit that referenced this pull request Oct 31, 2023
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
uurien pushed a commit that referenced this pull request Oct 31, 2023
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
This was referenced Oct 31, 2023
uurien pushed a commit that referenced this pull request Nov 3, 2023
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
uurien pushed a commit that referenced this pull request Nov 3, 2023
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
khanayan123 pushed a commit that referenced this pull request Jan 2, 2024
Add tracking of supported integrations and supported integration versions and output data as artifacts during testing
@tlhunter tlhunter deleted the conti/report-tested-integrations-and-versions branch January 19, 2024 22:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants