[In Development] Monitoring Storm

This article will help you get the Storm plugin for sd-agent configured and returning metrics

Installing the storm plugin package

Install the storm plugin on Debian/Ubuntu:

sudo apt-get install sd-agent-storm

Install the storm plugin on RHEL/CentOS:

sudo yum install sd-agent-storm

Read more about agent plugins.

Configuring the agent to collect swap metrics

1. Configure /etc/sd-agent/conf.d/storm.yaml

Configure your Storm REST API host/port

init_config:

instances:
  - server: 'http://localhost:8080'

2. Restart the agent

sudo /etc/init.d/sd-agent restart

or

sudo systemctl restart sd-agent

Verifying the configuration
Execute info to verify the configuration with the following:

sudo /etc/init.d/sd-agent info 

or

/usr/share/python/sd-agent/agent.py info

If the agent has been configured correctly you'll see an output such as:

storm
-----
  - instance #0 [OK]
  - Collected * metrics

You can also view the metrics returned with the following command:

sudo -u sd-agent /usr/share/python/sd-agent/agent.py check storm

Configuring graphs

Click the name of your server from the Devices list in your Server Density account then go to the Metrics tab. Click the + Graph button on the right then choose the storm metrics to display the graphs. The metrics will also be available to select when building dashboard graphs.

Screen_Shot_2018-01-18_at_11.46.12.png

Monitored metrics

Metric Values
storm.bolts.execute_latency

Average time to run the execute method of the bolt.
latency / None
Type: float
storm.bolts.failed

Number of tuples failed by the bolt.
failed / None
Type: float
storm.bolts.process_latency

Average time of the bolt to ack a message after it was received.
latency / None
Type: float
storm.spouts.complete_latency

Total latency for processing the message.
latency / None
Type: float
storm.spouts.failed

Number of messages failed.
failed / None
Type: float
storm.topology.stats.acked

Number of messages acked in given window.
acked / None
Type: float
storm.topology.stats.complete_latency

Total latency for processing the message.
latency / None
Type: float
storm.topology.stats.failed

Number of messages failed in given window.
failed / None
Type: float
Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

Comments

Monday  —  Friday.

10am  —  6pm UK.

Dedicated Support.