Troubleshooting & Diagnostics
Common node issues, log analysis, benchmark failures, DOS list recovery, and diagnostic techniques.
Troubleshooting & Diagnostics
Even well-maintained Flux nodes can encounter issues. This guide covers the most common problems, diagnostic techniques, and solutions. For legacy nodes, the Multitoolbox Option 3 (Analyzer & Fixer) should be your first stop. For ArcaneOS nodes, the SAS protocol handles most issues automatically β but understanding the diagnostics helps when manual intervention is needed.
Common Issues & Solutions
Benchmark Failures
Benchmarks run periodically to verify your node's hardware meets tier requirements. Failures result in the node being removed from the network.
| Symptom | Cause | Solution |
|---|---|---|
| Benchmark status: "FAILED" | Hardware below tier threshold | Check RAM/SSD/CPU allocation. For VMs, ensure resources are dedicated (not shared). |
| EPS too low | CPU underperforming | Close competing workloads, check CPU throttling, verify hyperthreading is enabled. |
| Disk write too slow | SSD performance degradation | Check TRIM support, replace aging SSD, or move to a faster storage backend. |
| Benchmark stuck/running | FluxBench process hung | Restart FluxBench: Multitoolbox or `sudo systemctl restart zelcash` on legacy. |
Node on DOS List
The Denial of Service list contains nodes that failed to confirm or passed failed benchmarks. Check your status:
Check Node Status
# Check DOS list status
curl -s http://YOUR_NODE_IP:16127/daemon/getfluxnodestatus | jq .data.status- β’Fix: Ensure daemon is synced, FluxOS is running, and benchmarks pass. The node will automatically rejoin after the next confirmation cycle.
- β’Quick restart: `sudo systemctl restart zelcash && sleep 120 && sudo systemctl restart flux` (legacy only)
Daemon Out of Sync
- β’Check sync status: `curl -s http://localhost:16127/daemon/getinfo | jq .data.blocks`
- β’Compare with network: `curl -s https://api.runonflux.io/daemon/getblockcount | jq .data`
- β’If far behind: Use Multitoolbox Option 5 (Restore Blockchain) to bootstrap
- β’If stuck at a specific height: Reindex with Multitoolbox or `flux-cli reindex`
FluxOS API Not Responding
- β’Check if FluxOS is running: `pm2 list` (should show "flux" as online)
- β’Check logs: `pm2 logs flux --lines 50`
- β’Restart FluxOS: `pm2 restart flux`
- β’If persistent: Reinstall FluxOS via Multitoolbox Option 7
- β’Check port accessibility: `curl -s http://localhost:16127/flux/version`
Docker Issues
- β’Docker not running: `sudo systemctl start docker`
- β’Docker out of disk space: `docker system prune -a` (caution: removes all unused containers and images)
- β’App containers not starting: Check FluxOS logs for deployment errors
- β’Network conflicts: `docker network prune` to clean up stale networks
Log Analysis
Key log locations and how to access them:
| Log | Access Method | API Endpoint |
|---|---|---|
| Daemon log | SSH: ~/.flux/debug.log | GET /flux/daemondebug |
| Daemon log (tail) | SSH: tail ~/.flux/debug.log | GET /flux/taildaemondebug |
| Benchmark log | SSH: ~/.fluxbenchmark/debug.log | GET /flux/benchmarkdebug |
| FluxOS error log | SSH: pm2 logs flux | GET /flux/errorlog |
| FluxOS info log | SSH: pm2 logs flux | GET /flux/infolog |
When seeking help on Discord, always run Multitoolbox Option 3 first and share the output. This gives support volunteers all the diagnostic information they need to help you quickly.
Other articles in Advanced Operations
ArcaneOS Installation Guide
Step-by-step guide to installing ArcaneOS β the hardened OS for PNR-eligible Flux nodes.
Legacy vs ArcaneOS
Feature comparison, migration path, and decision guide for choosing between Legacy and ArcaneOS.
Multitoolbox Reference
Complete reference for all 14 Multitoolbox options β installation, diagnostics, repair, and configuration.
Maintenance Window Deep Dive
Understanding the 480-block confirmation cycle, timing strategies, and monitoring your window status.
FluxOS API Reference
Essential API endpoints for monitoring, automation, and building tools on top of the Flux network.
Backup, Restore & Migration
Back up your node identity, restore from scratch, and migrate between hosts with zero collateral risk.
Multi-Node & Delegate Setup
Run multiple nodes with UPnP, Proxmox Fractus setups, and the P2SH delegate system.