Our next-gen architecture is built to help you make sense of your ever-growing data Watch a 4-min demo video!

Back to All Docs

Amazon Web Services (AWS) CloudWatch Metrics Processing using CloudWatch Metric Stream & Firehose Delivery Stream Amazon Web Services (AWS) CloudWatch Metrics Processing using CloudWatch Metric Stream & Firehose Delivery Stream

Last Updated: Feb. 01, 2023

Amazon CloudWatch monitors your Amazon Web Services (AWS) resources and applications you run on AWS in real time. Use the Coralogix destination to easily forward metrics for your AWS resources to Coralogix using CloudWatch Metric Stream and Firehose Delivery Stream.

This guide demonstrates how to:

  • Use CloudWatch to collect and track metrics and send them to Coralogix
  • Visualize metrics in your Coralogix dashboard
  • Import pre-built dashboards and set up alerts in your Coralogix account

Metrics Collection

There are two ways of sending AWS service metrics to Coralogix:

  • Real-time CloudWatch metrics processing using CloudWatch Metric Stream and Firehose Delivery Stream. Opt for this if you’d like to use a native AWS solution without an agent. Use the Amazon CloudWatch pricing calculator to estimate the costs of this option. The instructions below guide you through this option.
  • Poll CloudWatch metrics using Telegraf. Opt for this if you are already using this shipper or seeking to reduce costs.

Configuration

1. Set up CloudWatch Metric Stream and Firehose Delivery Stream.

2. Identify the AWS services that publish metrics to CloudWatch and their namespaces. Use them in your configuration to collect the metrics.

Note: Namespaces are case-sensitive.

Dashboard

1. Download and import the metric stream version of your RDS dashboard.

2. Download and import the metric stream version of ElastiCache dashboard.

Alerts

Use PromQL to create metrics alerts:

  • RDS CPU utilization above 80%
1avg(amazonaws_com_AWS_RDS_CPUUtilization{DBInstanceIdentifier!=""}) by (DBInstanceIdentifier)
  • RDS Writer CPU utilization above 90%
1avg(amazonaws_com_AWS_RDS_CPUUtilization{DBClusterIdentifier!="",Role="WRITER"}) by (Role,DBClusterIdentifier)
  • ElastiCache miss above 50%
1(sum(amazonaws_com_AWS_ElastiCache_CacheMisses_sum{})/(sum(amazonaws_com_AWS_ElastiCache_CacheHits_sum{})+sum(amazonaws_com_AWS_ElastiCache_CacheMisses_sum{})))*100

Validation

To validate your configuration, access your Coralogix – Grafana dashboard.

1. On the right-hand corner of your dashboard, click on the Grafana drop-down tab.

2. Once you’ve accessed your Coralogix-Grafana dashboard, click on Explore tab in the left-hand browser.

3. Click on the drop-down arrow of the Metrics browser and input RDS (RDS metrics) and ElastiCache (ElastiCache metrics) in the “Select a Metric” column.

Support

Need help?

Our world-class customer success team is available 24/7 to walk you through your setup and answer any questions that may come up.

Feel free to reach out to us via our in-app chat or by sending us an email at [email protected].

On this page