CPU
Sample71.8%
Demo-Linux-02
WarningSampledemo-linux-02 · UAT · local/linux · us-east-1 · active
connection 10.0.12.12 · Ubuntu 24.04 LTS · 29d 0h
Memory
Sample82.4%
Disk
Sample64.1%
Network
Sample41.6 Mbps
ingest-worker error rate is elevated
Warning- What is happening
- Error rate 1.8% since 09:55 UTC, p95 940 ms.
- Impact
- ingest-worker on demo-linux-02 (UAT) · backlog replay in progress.
- Possible cause
- Host memory 82.4% and rising; coincident /var/log growth on the same server.
- Recommended next action
- Open Demo-Linux-02, inspect RSS and /var/log, then pause debug logging.
Memory pressure on Demo-Linux-02
Warning- What is happening
- Memory above 80% for 15 minutes (82.4% now).
- Impact
- UAT worker host demo-linux-02 · ingest-worker sharing the machine.
- Possible cause
- Worker RSS climbed after a backlog replay. Swap activity is rising.
- Recommended next action
- Inspect ingest-worker RSS on Demo-Linux-02 and reduce replay concurrency.
Unexpected /var/log growth
Warning- What is happening
- /var/log is 22.4% of disk, 18.6% in 24 hours.
- Impact
- Storage on demo-linux-02 is the fastest-growing path in the sample fleet.
- Possible cause
- Application debug logging left enabled after yesterday’s load test.
- Recommended next action
- Disable debug logging on ingest-worker and re-check /var/log growth.
CPU
Demo-Linux-02 · sample series
Sample
Previous 6h is not in this sample series
- Demo-Linux-02
Memory
Demo-Linux-02 · sample series
Sample
Previous 6h is not in this sample series
- Demo-Linux-02
Disk growth
14-day sample series
At the current sample slope, 90% of estimated capacity (210 GB of 233 GB) is about 18 days away.
Largest directories
Demo-Linux-02 · sample fleet
| Path | Host | Size | Share | Δ 24h |
|---|---|---|---|---|
| /var/lib | Demo-Linux-02 | 42.1 GB | 51% | +1.4% |
| /var/log | Demo-Linux-02 | 18.4 GB | 22% | +18.6% |
| /home | Demo-Linux-02 | 8.2 GB | 10% | +0.3% |
| /tmp | Demo-Linux-02 | 1.1 GB | 1% | -0.8% |
Applications on this host
- ingest-worker
worker · UAT · p95 940 ms
Related alerts
| Severity | Alert | Source | State | Age |
|---|---|---|---|---|
| warning | Memory usage above 80% for 15 minutes | Demo-Linux-02 | firing | 47m ago |
| warning | Disk growth rate elevated on /var/log | Demo-Linux-02 | firing | 2h ago |
| critical | ingest-worker error rate above 1.5% | ingest-worker | acknowledged | 3h ago |
Related incidents
- Memory pressure on Demo-Linux-02
Worker RSS climbed after a backlog replay. Swap activity is rising.
- Unplanned /var/log growth
Application debug logging left enabled after yesterday’s load test.