Log Management
A hands-on course on log files you import: onboard, parse, time and search them in a Splunk-style platform.
What the course covers
- 0. What log management is — The lifecycle every log goes through, and why each stage is a decision
- 1. Log anatomy and formats — Syslog, JSON, key=value, CSV, Windows events and web server logs, read as bytes
- 2. Time — Event time and index time, zones, the syslog year problem, and clocks that drift
- 3. A tour of log sources — What operating systems, networks, identity providers, clouds and applications record
- 4. Collection and onboarding — Agents, syslog transports and forwarders, and the settings that decide whether data arrives right
- 5. Searching with SPL — Terms, fields, pipes, stats, eval and rex — and how to make a search fast
- 6. Getting logs into Elastic — Agents, Beats, Logstash and ingest pipelines — where each decision lives in the Elastic stack
- 7. Parsing in Elastic: grok, dissect and the mapping — Cutting the message into fields at index time — and what it costs to get it wrong
- 8. Index lifecycle: hot to delete — Data streams, rollover and ILM — how Elastic answers the retention questions indexes.conf answered in Splunk
- 9. Searching Elastic: KQL, Lucene and ES|QL — Three query languages, one bar — what each is for and where the syntax differs
- 10. Graylog: inputs and extractors — How messages get in and how they get fields — the input/extractor model that replaced the pipeline
- 11. Graylog pipelines, streams and search — Rewriting messages in flight, routing them by rule, and the Lucene search underneath it all
- 12. Datadog: agents and log pipelines — Collection by the agent, processing by server-side pipelines, and the @attribute search model
- 13. Datadog: indexes, exclusion filters and rehydration — Which logs stay searchable, which get sampled, and how the archive buys retention without cost
- 14. Dashboards and correlation — A dashboard is a saved question — and the questions that matter span sources
- 15. Alerting: thresholds, suppression and the false-positive economy — A saved search plus a condition plus an action — and the discipline of not crying wolf
- 16. Retention, tiers and compliance — How long to keep it, what it costs, and what an auditor will ask
- 17. Operating the pipeline — and the capstone — Clock skew, dropped events, silent sources, and a final investigation across everything