This library contains various Apache Flink connectors to connect to AWS data sources and sinks. This repository contains various Apache Flink connectors to connect to AWS Kinesis data sources and sinks. Flink maintain backwards compatibility for the Sink interface used by the Firehose Producer. This project is compatible with Flink 1.x, there is no guarantee it will support Flink 2.x should it release in the future. An Apache Flink application is a Java or Scala application that is created with the Apache Flink framework. You author and build your Apache Flink application locally. Applications primarily use either the DataStream API or the Table API. The other Apache Flink APIs are also available for you to use, but they are less commonly used in building streaming applications. The Apache Flink DataStream API programming model is based on two components.
Features
- Write data into a Kinesis Data Stream
- Process the streaming data using Kinesis Data Analytics
- Write the results to a Kinesis Firehose using the FlinkKinesisFirehoseProducer
- Store the data in an S3 Bucket
- You will need to install Java 1.8+ and Maven
- Build using Maven from the project root directory
Project Samples
