Monitoring Storm

This article will help you get the Storm plugin for sd-agent configured and returning metrics

Installing the storm plugin package

Install the storm plugin on Debian/Ubuntu:

sudo apt-get install sd-agent-storm

Install the storm plugin on RHEL/CentOS:

sudo yum install sd-agent-storm

Read more about agent plugins.

Configuring the agent to collect swap metrics

1. Configure /etc/sd-agent/conf.d/storm.yaml

Configure your Storm REST API host/port

init_config:

instances:
  - server: 'http://localhost:8080'

2. Restart the agent

sudo /etc/init.d/sd-agent restart

or

sudo systemctl restart sd-agent

Verifying the configuration
Execute info to verify the configuration with the following:

sudo /etc/init.d/sd-agent info 

or

/usr/share/python/sd-agent/agent.py info

If the agent has been configured correctly you'll see an output such as:

storm
-----
  - instance #0 [OK]
  - Collected * metrics

You can also view the metrics returned with the following command:

sudo -u sd-agent /usr/share/python/sd-agent/agent.py check storm

Configuring graphs

Click the name of your server from the Devices list in your Server Density account then go to the Metrics tab. Click the + Graph button on the right then choose the storm metrics to display the graphs. The metrics will also be available to select when building dashboard graphs.

Monitored metrics

Metric	Values
storm.bolts.execute_latency Average time to run the execute method of the bolt.	latency / None Type: float
storm.bolts.failed Number of tuples failed by the bolt.	failed / None Type: float
storm.bolts.process_latency Average time of the bolt to ack a message after it was received.	latency / None Type: float
storm.spouts.complete_latency Total latency for processing the message.	latency / None Type: float
storm.spouts.failed Number of messages failed.	failed / None Type: float
storm.topology.stats.acked Number of messages acked in given window.	acked / None Type: float
storm.topology.stats.complete_latency Total latency for processing the message.	latency / None Type: float
storm.topology.stats.failed Number of messages failed in given window.	failed / None Type: float