Apache Airflow on Linux VM- Oracle Cloud Infrastructure

Apache Airflow on Linux – VM: Oracle Cloud Infrastructure, available at $44.99, has an average rating of 3, with 46 lectures, 5 quizzes, based on 3 reviews, and has 20 subscribers.

You will learn about Provisioning Oracle Linux Virtual Machine – environment though Oracle Cloud infrastructure Apache Airflow Installation on Oracle Linux and operating the task scheduling through DAG Provisioning Autonomous Oracle Database on OCI Accessing Autonomous Oracle Database though Client (sqlplus) on Linux DAG – Directed Acyclic Graph programs DAG program for Data extract from Autonomous Database with Linux / Unix Shell scripting. Enabling and Provisioning GUI environment in Oracle Linux – Oracle Cloud Infrastructure. This course is ideal for individuals who are IT consultants or ETL developers or Data Engineers It is particularly useful for IT consultants or ETL developers or Data Engineers.

Enroll now: Apache Airflow on Linux – VM: Oracle Cloud Infrastructure

Summary

Title: Apache Airflow on Linux – VM: Oracle Cloud Infrastructure

Price: $44.99

Average Rating: 3

Number of Lectures: 46

Number of Quizzes: 5

Number of Published Lectures: 46

Number of Published Quizzes: 5

Number of Curriculum Items: 51

Number of Published Curriculum Objects: 51

Original Price: ?1,799

Quality Status: approved

Status: Live

What You Will Learn

Provisioning Oracle Linux Virtual Machine – environment though Oracle Cloud infrastructure

Apache Airflow Installation on Oracle Linux and operating the task scheduling through DAG

Provisioning Autonomous Oracle Database on OCI

Accessing Autonomous Oracle Database though Client (sqlplus) on Linux

DAG – Directed Acyclic Graph programs

DAG program for Data extract from Autonomous Database with Linux / Unix Shell scripting.

Enabling and Provisioning GUI environment in Oracle Linux – Oracle Cloud Infrastructure.

Who Should Attend

IT consultants

ETL developers

Data Engineers

Target Audiences

IT consultants

ETL developers

Data Engineers

This course covers three different niche topics on which one can build their technical expertise:

             1. Apache Airflow –Installation and DAG basics & scheduling DAG programs

            2. Linux -VM on Oracle cloud Infrastructure (Provisioning of Oracle Linux – cloud & install Apache airflow & operating it)

            3. Oracle Autonomous Database on Cloud ( Provisioning the DB andunderstand Data extract through Apache airflow task scheduling).

Note : Since Oracle is offering always free tieroption – you can provision Linux VM and Oracle Autonomous DBeven after expiry of 30 days free trial and make your learning more effective at any point of time.

Apache Airflow is an open-source  platform to programmatically author, schedule and monitor workflows.

Apache Airflow  is a fully managed workflow orchestration service that empowers you to author, schedule, and monitor pipelines that span across clouds and on-premises data centers.  Apache Airflow open source project and operated using the Python programming language.

Apache Airflow pipelines are configured as directed acyclic graphs (DAGs) using Python, making it easy for users of any experience level to author and schedule a workflow.

With Cloud Computing gaining significance – Virtualization (Virual Machine)  are gaining momentum and re-defining & optimizing Hardware and Software solutions. In this course you would learn about building a cloud virtual environement through Oracle Linux using Oracle cloud – free tier. This course will present you with sequence of steps towards installation of Apache Airflow on Oracle Cloud Infrastructure and then view them through VNC viewer.

Finally, as we would be using Oracle Cloud Infrastructure, one can create Oracle Autonomous Database quite easily and work towards creating a DAG file, which will be scheduled from Apache airflow towards data extract from Oracle Database, through Linux shell scripting task. This is one of the most common use case for Apache Airflow.

Happy Learning!!

Course Curriculum

Chapter 1: Introduction

Lecture 1: Course Overview

Chapter 2: What is Virtualization in Cloud computing?

Lecture 1: What is Virtualization in Cloud computing?

Chapter 3: Introduction on Apache Airflow

Lecture 1: What is task and why Orchestration is required?

Lecture 2: Use case for Apache Airflow

Lecture 3: Introduction on Apache Airflow

Chapter 4: Getting Oracle Cloud Free Tier Access

Lecture 1: Getting Oracle Cloud free tier access – Part 1

Lecture 2: Getting Oracle Cloud free tier access – Part 2

Chapter 5: Oracle Cloud – Linux (VM) creation and accessing through SSH

Lecture 1: Steps involved in creating Oracle Linux cloud instance and access – Overview

Lecture 2: Creating Private and Public key using Putty Gen

Lecture 3: Creating compartment and VCN in Oracle Cloud Infra(OCI)

Lecture 4: Creating Oracle Linux – Virtual Machine Instance

Lecture 5: Connecting to Oracle Linux Virtual instance through SSH – Putty

Lecture 6: Using SFTP to transfer files to cloud Linux (VM) instance

Chapter 6: Some Basic command line commands

Lecture 1: Basic command line command – Part 1

Lecture 2: Basic command line command – Part 2

Chapter 7: Apache Airflow Architecture Overiew

Lecture 1: Apache Airflow Architecture Overiew

Lecture 2: Single Node Vs Multi Node

Chapter 8: Installation of Apache Airflow on Oracle Cloud Linux(VM)

Lecture 1: Installation of Dependencies

Lecture 2: Installation of Apache Airflow

Lecture 3: Intiating creation of Apache Airflow DB

Lecture 4: Starting Apache Airflow Scheduler and Webserver

Chapter 9: Creation of Linux GUI environment and accessing Apache Airflow through VNC

Lecture 1: The Need for GUI envirroment

Lecture 2: Accessing Oracle Cloud Linux (VM) GUI Overiew

Lecture 3: Steps involved in creating Oracle Linux cloud instance and access – Overview

Lecture 4: Installation of server GUI and tiger VNC server

Lecture 5: Setting VNC access password and configuring VNC service file

Lecture 6: Starting VNC server and firewall entries for VNC server

Lecture 7: Dowloading tigerVNC client -viewer

Lecture 8: SSH client -Putty configuration and port entry

Lecture 9: Accessing Oracle Cloud Linux (VM) GUI

Lecture 10: Accessing Apache Airflow via VNC viewer

Chapter 10: Whats Directed Acyclic Graph (DAG) in Apache Airflow & navigation overiew

Lecture 1: What is Directed Acyclic Graph?

Lecture 2: DAG Program Structure

Lecture 3: Understanding DAG Menu and Navigation

Chapter 11: Creating a DAG program with two tasks

Lecture 1: Creating DAG program

Lecture 2: First Airflow Program Execution

Chapter 12: Data Extract Approach through Autonomous Oracle Database

Lecture 1: Data Extract from Database Overview

Lecture 2: What is Autonomous Database?

Chapter 13: Creating Autonomous Database on Oracle Cloud Infrastrucure

Lecture 1: Creating Autonomous Database on Oracle Cloud Infrastrucure – Part 1

Lecture 2: Creating Autonomous Database on Oracle Cloud Infrastrucure – Part 2

Lecture 3: Accessing Autonomous Database through SQL webclient

Chapter 14: Configuring SQL client on Linux instance to access Oracle Autonomous DB

Lecture 1: SQL plus client install on Oracle Linux instance

Lecture 2: Downloading DB wallet file and accessing autonomous DB

Chapter 15: Modify the DAG script to extract from Database

Lecture 1: Extract Program Review

Lecture 2: Executing the DAG program

Chapter 16: Concluding Remarks

Lecture 1: Bonus Lecture

Instructors

Guha Rajan M., B.Engg, MBA
Founder and CEO – Capstone Solutions, Trainer

Rating Distribution

1 stars: 1 votes

2 stars: 0 votes

3 stars: 1 votes

4 stars: 1 votes

5 stars: 0 votes

Frequently Asked Questions

How long do I have access to the course materials?

You can view and review the lecture materials indefinitely, like an on-demand channel.

Can I take my courses with me wherever I go?

Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don’t have an internet connection, some instructors also let their students download course lectures. That’s up to the instructor though, so make sure you get on their good side!