Log Management

A hands-on course on log files you import: onboard, parse, time and search them in a Splunk-style platform.

About 9 hours · 18 modules · 93 labs · certificate on completion · Security operations

For: analyst, engineer

Skills: log-management, parsing, spl, esql, lucene, timestamps

What the course covers

  1. 0. What log management is — The lifecycle every log goes through, and why each stage is a decision (1 lab)
  2. 1. Log anatomy and formats — Syslog, JSON, key=value, CSV, Windows events and web server logs, read as bytes (6 labs)
  3. 2. Time — Event time and index time, zones, the syslog year problem, and clocks that drift (4 labs)
  4. 3. A tour of log sources — What operating systems, networks, identity providers, clouds and applications record (7 labs)
  5. 4. Collection and onboarding — Agents, syslog transports and forwarders, and the settings that decide whether data arrives right (7 labs)
  6. 5. Searching with SPL — Terms, fields, pipes, stats, eval and rex — and how to make a search fast (12 labs)
  7. 6. Getting logs into Elastic — Agents, Beats, Logstash and ingest pipelines — where each decision lives in the Elastic stack (5 labs)
  8. 7. Parsing in Elastic: grok, dissect and the mapping — Cutting the message into fields at index time — and what it costs to get it wrong (5 labs)
  9. 8. Index lifecycle: hot to delete — Data streams, rollover and ILM — how Elastic answers the retention questions indexes.conf answered in Splunk (4 labs)
  10. 9. Searching Elastic: KQL, Lucene and ES|QL — Three query languages, one bar — what each is for and where the syntax differs (7 labs)
  11. 10. Graylog: inputs and extractors — How messages get in and how they get fields — the input/extractor model that replaced the pipeline (5 labs)
  12. 11. Graylog pipelines, streams and search — Rewriting messages in flight, routing them by rule, and the Lucene search underneath it all (4 labs)
  13. 12. Datadog: agents and log pipelines — Collection by the agent, processing by server-side pipelines, and the @attribute search model (5 labs)
  14. 13. Datadog: indexes, exclusion filters and rehydration — Which logs stay searchable, which get sampled, and how the archive buys retention without cost (4 labs)
  15. 14. Dashboards and correlation — A dashboard is a saved question — and the questions that matter span sources (5 labs)
  16. 15. Alerting: thresholds, suppression and the false-positive economy — A saved search plus a condition plus an action — and the discipline of not crying wolf (4 labs)
  17. 16. Retention, tiers and compliance — How long to keep it, what it costs, and what an auditor will ask (3 labs)
  18. 17. Operating the pipeline — and the capstone — Clock skew, dropped events, silent sources, and a final investigation across everything (5 labs)

Free with an account.

Start for free