Flink Job Listener Run a task After Flink Job is Completed

Flink Job Listener: Run a task After Flink Job is Completed

Hey, Tea Lovers! This post is about how you can do some tasks after the Flink Job is completed or submitted. To do this we will be using Flink Job Listener. There can be many scenarios where you want to do some additional processing after the Flink job is completed. It can be a notification push, some update in the database, or some kind of log you want to do. It鈥檚 up to the requirement. Not only post-job completion, but we sometimes also need to do something after the Job is submitted to the Flink Cluster. ...

July 24, 2021 路 6 min 路 Imran Shaikh
How to Install Apache Flink On Mac OS (2)

How to Install Apache Flink On Ubuntu

Hey, Tea Lovers! In this post, we will be talking about how to install Apache Flink on Ubuntu. It will be a very quick guide We will be installing the latest version of Apache Flink 1.12.1 on Ubuntu 20.04, though it applies to all the versions and possibly any newer one too. For the Installation of Apache Flink on Mac OS check out the post " How to Install Apache Flink On Mac OS". ...

March 14, 2021 路 4 min 路 Imran Shaikh
How to Install Apache Flink On Mac OS (1)

How to Install Apache Flink On Mac OS

Hey, Tea Lovers! In this post, we will be talking about how to install Apache Flink on Mac OS. It will be a very quick guide We will be installing the latest version of Apache Flink 1.12.1, though it applies to all the versions and possibly any newer one too. We have other posts on Flink Installation: Windows: How to Install Apache Flink On Local Windows Ubuntu: How to Install Apache Flink On Ubuntu ...

March 9, 2021 路 6 min 路 Imran Shaikh
How to Select Specific Folders or Files As Input in Flink

How to Select Specific Folders or Files As Input in Flink

Hey, tea lovers! Today I will show you how to specifically select the desired folders or files in Flink Batch Job programmatically. We will discuss when given a root path you can decide which file or folder to read in Flink Batch Job. And why suddenly do I pick up this topic you say? Well, I was working on such a task myself where I needed to read the S3 files which are under folders with dates. Those date folders are in a rolling fashion like , 2021_01_13_1, 2021_01_13_2, 2021_01_13_3 and so on. And in these folders, there were multiple files, so based on the given date I needed to read all those files which are in the given date folder (the folder name should contain the date obviously). ...

February 20, 2021 路 7 min 路 Imran Shaikh