Apache Flink on KDA
Introduction
Getting started
...at an AWS event
...on your own
Configure dev environment
Retrieve Windows password
Connect to Windows desktop
Configure Intellij
Ingest events
Create a Kinesis data stream
Replay historic taxi trips
Local Flink development
Execute the Flink program
Debug Flink code
Anatomy of the Flink program
Extend the Flink program
Read parameters
Enable event time
Add time windows and aggregation
Add Elasticsearch sink
Build visualizations
Create Elasticsearch indices
Import Kibana dashboard
Ingest data to Elasticsearch
Deploy to KDA
Build Uber Jar
Create KDA application
Configure KDA application
Start KDA application
Scale and Monitor
Scale the Kinesis stream
Monitor important metrics
Inspect Flink application logs
(Auto)scale the Flink application
Advanced Scaling and Monitoring
Advanced Monitoring
Important Flink Metrics
Launch the CloudWatch Dashboard
Metrics Deep Dive
Advanced Scaling
Getting Started
Advanced Scaling Components
Additional Resources
Flink Dashboard
Accessing the Dashboard
Troubleshooting Using the Flink Web Dashboard
Flink Job Level Insights
Flink Task Level Insights
Cleanup
Cleanup
Apache Beam on KDA
Overview
Getting started
...at an AWS event
...on your own
Configure Dev. Environment
Configure AWS Cloud9
Create Ingestion Infrastructure
Create a Kinesis data stream
Create a Firehose delivery stream
Name and Source
Process Records
Choose a Destination
Configure Settings
Review Settings
Replay historic taxi trips
Deploy Streaming Pipeline
Beam Pipeline Details
Build Beam Pipeline As Jar
Create application
Configure application
Start application
Update application parameters
Beam on KDA
Accessing the Flink Dashboard
Runtime parameters
Temporary credentials
Jackson dependencies
Deploy Batch Pipeline
Configure Beam pipeline
Execute the batch pipeline
Optional: Monitoring and Profiling
Profiling pipelines
Monitor important metrics
Inspect Flink application logs
Cleanup
More Resources
GitHub Project
Have questions?
Privacy
|
Site Terms
| © 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Edit this page
Streaming Analytics Workshop
>
Apache Flink on Amazon Kinesis Data Analytics
>
Advanced Scaling and Monitoring
> Advanced Monitoring
Let’s dive deep into how to monitor the metrics of your Kinesis Data Analytics for Apache Flink Application.
Advanced Monitoring
Let’s dive deep into how to monitor the metrics of your Kinesis Data Analytics for Apache Flink Application.