Inspect Flink application logs

When you were running the Flink program locally in IntelliJ, you could obtain (debug) output directly from the IDE. However, we cannot log in to the infrastructure that runs the KDA application to get access to these logs.

In addition to operational metrics, you can configure the Kinesis Data Analytics application to write messages to CloudWatch Logs. This capability seamlessly integrates with common logging frameworks, such as Apache Log4j and the Simple Logging Facade for Java (SLF4J). So it is useful for debugging and identifying the cause of operational issues.

As you have enabled logging for your Kinesis Data Analytics application, the logs are sent to a CloudWatch Logs stream.

  1. On the CloudWatch dashboard, select Add widget

  2. In the dialog, choose the Logs table widget and confirm with Configure

  3. Search for beam-workshop and select the log stream of the KDA application named as: aws/kinesis-analytics/beam-workshop

You will now have two widgets in your dashboard: