-
Notifications
You must be signed in to change notification settings - Fork 3.2k
[encoding/googlecloudlogentry] Add support for GCP Cloud DNS Logs #44697
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
constanca-m
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good mostly, a couple of comments
extension/encoding/googlecloudlogentryencodingextension/internal/dnslog/parser.go
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/internal/dnslog/parser.go
Outdated
Show resolved
Hide resolved
...googlecloudlogentryencodingextension/testdata/dnslog/dns_query_no_domain_error_expected.yaml
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
| | Original field | Log record attribute | | ||
| |---|---| | ||
| | `queryName` | `gcp.dns.query.name` | | ||
| | `queryType` | `gcp.dns.query.type` | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| | `queryType` | `gcp.dns.query.type` | | |
| | `queryType` | `dns.question.type` | |
I assume this is the question type https://www.elastic.co/docs/reference/ecs/ecs-dns#field-dns-question-type
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do you think it should be added to semconv?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes I do. I have already logged an issue for it open-telemetry/semantic-conventions#2432
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Leave this PR as draft awaiting for issue resolution.
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/internal/dnslog/parser.go
Outdated
Show resolved
Hide resolved
492951d to
defafc9
Compare
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
extension/encoding/googlecloudlogentryencodingextension/README.md
Outdated
Show resolved
Hide resolved
defafc9 to
4be3dd2
Compare
4be3dd2 to
5a32afb
Compare
Description
This PR adds support for parsing GCP DNS logs.
With this changes, the user will be able to see cloud dns logs reported information in log attributes instead of pasted as a raw json string into the log body, that could cause the user to overlook important info.
Link to tracking issue
Solves #44561
Testing
Added unit and functional tests.
Documentation
Updated README.md