Datadog OpenStack Capacity Reporting Plugin

• Updated July 1, 2015


Datadog is a fantastic monitoring as a service company. Install their agent on your host and within seconds metrics are uploaded to their service to begin graphing. Their service can integrate with many popular products, but I have yet to find a plugin to integrate Datadog with one of the most talked about pieces of software today: OpenStack.

Luckily, Datadog is a very extensible product. They provide documentation on how to create your own plugins to upload metrics to their service.

This documentation, combined with the OpenStack APIs, has allowed me to create what I think is the first Datadog OpenStack plugin. Let me know if you have come across other Datadog OpenStack plugins.

What Does It Do?

OpenStack’s Horizon Dashboard is the graphical web front end to the OpenStack services.

Administrative users logged into the Horizon Dashboard can get an overview of how resources are allocated in their OpenStack environment as seen in the following screenshot:

Horizon Administrator Hypervisor View

Those three simple pie charts represent the core resources an OpenStack environment provides: vCPU, Memory, and Disk. On their own, they give a cloud administrator a very quick glance into how much of those core resources are allocated - but, that’s about it.

A cloud administrator will always need an up-to-the-minute view of what core resources are allocated, but what is even more useful is a historical view. With this capability, a cloud administrator can quickly figure out when they need to add more resources to their OpenStack environment.

This is what the first iteration of this plugin does.

Every 20 seconds, the Datadog Agent will run the openstack-capacity-reporting plugin and upload the following metrics to Datadog:

  • Number of running virtual machines
  • Total vCPUs
  • Allocated vCPUs
  • Total Memory
  • Allocated Memory
  • Total Disk
  • Allocated Disk

Those metrics are uploaded on a per compute node basis.

With those metrics available, you can get historical and current time series data of how your core resources are allocated as seen in the following screenshot:

Datadog OpenStack Capacity Reporting Dashboards

Download

You can obtain my Datadog OpenStack Capacity Reporting plugin on GitHub.

As mentioned, this is the first iteration of this plugin. There are many other OpenStack metrics, such as allocated and total Cinder Volume storage, that can be queried.

I encourage you to submit Pull Requests or Fork my plugin to make it that much better.

If you found this post useful, you can help support this site and get something for yourself by signing up for any of the services listed below through the provided links.

The following links are part of affiliate programs, and I will receive a referral payment from any of the services you sign-up for.

  • Read Curated News: Tired of mainstream news? Are you looking for more curated business, finance, and economic news that does not read like it was written by a machine learning algorithm? Then start your day with the Morning Brew, a free email newsletter delivered to your inbox each morning.
  • Get Faster Shipping: Perhaps you're about to order some stuff on Amazon but want to get more value out of the money you would normally pay for shipping. Sign-up for a free, 30-day trial of Amazon Prime to get free two-day shipping, access to thousands of movies and TV shows, and more.
  • Start Investing Now: Are you looking to start investing some of your disposable saved income? Get started by opening an account with Webull, where upon sign-up and opening a brokerage account with an initial deposit of at least $100 you will receive 1 stock valued (subject to change based on normal market movement) between $8 and $1600.

Thanks for reading and take care.