Apache Airflow on Linux - VM: Oracle Cloud Infrastructure
Apche Airflow on Linux (VM) using Oracle Cloud Infrastructure includes task trigger on Autonomous Oracle DB task extract
What you will learn
Provisioning Oracle Linux Virtual Machine - environment though Oracle Cloud infrastructure
Apache Airflow Installation on Oracle Linux and operating the task scheduling through DAG
Provisioning Autonomous Oracle Database on OCI
Accessing Autonomous Oracle Database though Client (sqlplus) on Linux
DAG - Directed Acyclic Graph programs
DAG program for Data extract from Autonomous Database with Linux / Unix Shell scripting.
Enabling and Provisioning GUI environment in Oracle Linux - Oracle Cloud Infrastructure.
Why take this course?
This course covers three different niche topics on which one can build their technical expertise:
1. Apache Airflow - Installation and DAG basics & scheduling DAG programs
2. Linux -VM on Oracle cloud Infrastructure (Provisioning of Oracle Linux - cloud & install Apache airflow & operating it)
3. Oracle Autonomous Database on Cloud ( Provisioning the DB and understand Data extract through Apache airflow task scheduling).
Note : Since Oracle is offering always free tier option - you can provision Linux VM and Oracle Autonomous DB even after expiry of 30 days free trial and make your learning more effective at any point of time.
Apache Airflow is an open-source platform to programmatically author, schedule and monitor workflows.
Apache Airflow is a fully managed workflow orchestration service that empowers you to author, schedule, and monitor pipelines that span across clouds and on-premises data centers. Apache Airflow open source project and operated using the Python programming language.
Apache Airflow pipelines are configured as directed acyclic graphs (DAGs) using Python, making it easy for users of any experience level to author and schedule a workflow.
With Cloud Computing gaining significance – Virtualization (Virual Machine) are gaining momentum and re-defining & optimizing Hardware and Software solutions. In this course you would learn about building a cloud virtual environement through Oracle Linux using Oracle cloud - free tier. This course will present you with sequence of steps towards installation of Apache Airflow on Oracle Cloud Infrastructure and then view them through VNC viewer.
Finally, as we would be using Oracle Cloud Infrastructure, one can create Oracle Autonomous Database quite easily and work towards creating a DAG file, which will be scheduled from Apache airflow towards data extract from Oracle Database, through Linux shell scripting task. This is one of the most common use case for Apache Airflow.
Happy Learning!!
Content
Introduction
What is Virtualization in Cloud computing?
Introduction on Apache Airflow
Getting Oracle Cloud Free Tier Access
Oracle Cloud - Linux (VM) creation and accessing through SSH
Some Basic command line commands
Apache Airflow Architecture Overiew
Installation of Apache Airflow on Oracle Cloud Linux(VM)
Creation of Linux GUI environment and accessing Apache Airflow through VNC
What's Directed Acyclic Graph (DAG) in Apache Airflow & navigation overiew
Creating a DAG program with two tasks
Data Extract Approach through Autonomous Oracle Database
Creating Autonomous Database on Oracle Cloud Infrastrucure
Configuring SQL client on Linux instance to access Oracle Autonomous DB
Modify the DAG script to extract from Database
Concluding Remarks
Screenshots
Reviews
Charts
Price
Rating
Enrollment distribution
