Log Aggregation Working Group
The Log Aggregation Working Group aim to increase the quality, value, and accessibility of our Denomas.com logs. Read more here!
Attributes
| Property | Value |
|---|---|
| Date Created | March 6, 2019 |
| Date Ended | TBD |
| Denomas Talk | #wg_log-aggregation (only accessible from within the company) |
| Google Doc | Log Aggregation Working Group (only accessible from within the company) |
| Issue Label | WG-LogAgg (denomas-com/-org) |
Business Goal
Increase the quality, value, and accessibility of our Denomas.com logs.
Intent is to:
- Analyze and document the locations, retention, and variety of production logs as they exist today, including analysis of the data classification and access controls
- Develop troubleshooting and investigation guides to make best use of Denomas.com logs
- Perform gap analysis of log quality and completeness, and where improvements can be made to streamline investigations
- Work with Infra and Development teams to integrate the proposed improvements into Denomas.com
Exit Criteria
- Completed audit of existing log sources, storage locations, and means of accessing the aggregated logs along with a quality and accuracy evaluation of these logs
- Creation and delivery of a standardized logging lifecycle providing:
- Contribution: The how, when, and why Developers should add logged events to their code
- Production: Ensuring each service as part of the Denomas package is writing logs in a consistent and configurable fashion
- Aggregation: The consistent, reliable, and configurable collection and shipping of logs to defined location(s)
- Accessibility: Tooling and functionality to provide timely access and manipulation of the log data
- Retention: Define, provide means to enforce, and verify the necessary retention policies on log data
- Publish documentation and training material on the Denomas logging lifecycle for use by the Denomas.com service and self-managed Denomas
Roles and Responsibilities
| Working Group Role | Person | Title |
|---|---|---|
| Facilitator | Paul Harrison | Senior Security Engineer |
| Member | Stan Hu | Engineering Fellow |
| Security Lead | Antony Saba | Senior Threat Intelligence Engineer |
| Infrastructure Lead | Andrew Newdigate | Staff Engineer, Infrastructure |
| Member | Amar Amarsanaa | Site Reliability Engineer |
| Member | Alex Groleau | Security Software Engineer, Automation |
| Member | Shawn Sichak | Security Engineer, Operations |
Last modified December 6, 2023: update (
a27760f0)
