Open the Amazon CloudWatch console at https://console.aws.amazon.com/cloudwatch/
Select Dashboards
in the Navigation pane (left side)
Select Create dashboard
and enter the name MSK-Monitoring
Select Create Dashboard
On the Add to this Dashboard
dialogue, you can choose from various types of graphs. For now, we will select the Line
type and click Configure
Lets graph some metrics!
Click on AWS/Kafka
, then Broker ID, Cluster Name
In the search box enter the name of your Amazon MSK Cluster (ex: MSKCluster
) and press enter. This will limit metrics to that cluster
Enter CpuUser
in the search box and press enter. This will show you only the CpuUser metric for the cluster.
On the left side beside Broker ID
click the empty checkbox to select all the metrics listed
This will update the graph with data from each brokers CPU
At the top beside Untitled Graph
click the pencil and give your graph a name (ex: MSK Cluser CPU (User) utilization)
Click Create widget
in the bottom right corner
Your dashboard will be updated now with a graph containing the CPU utilization of all your brokers! Lets do the same for a few more metrics:
AWS/Kafka
-> Cluster Name
) - after you’ve graphed this one, click ‘Graphed Metrics’ and change the Statistic to Maximum
AWS/KAfka
-> Cluster Name
) - set this to Maximum as wellAWS/KAfka
-> Cluster Name
) - set this to Maximum as wellAWS/KAfka
-> Cluster Name
) - set this to p99AWS/Kafka
-> Broker ID, Cluster Name
) - set this to MaximumAWS/Kafka
-> Broker ID, Cluster Name
) - set this to MaximumAWS/Kafka
-> Broker ID, Cluster Name
) - set this to MaximumAWS/Kafka
-> Broker ID, Cluster Name
) - set this to MaximumAWS/Kafka
-> Broker ID, Cluster Name
) - set this to MaximumYou can add as many graphs as you want, and create multiple dashboards. Try different features, different options, different graph types, etc.