T-WOCC-IOfficial Google Curriculum
Workflow Orchestration with Cloud Composer
1 dayILTIntermediateLoading...
Overview
Cloud Composer is a fully managed workflow orchestration service built on Apache Airflow. Composer enables you to create, schedule, monitor, and manage workflow pipelines that span across clouds and on-premises data centers.
What You'll Learn
- Explore Apache Airflow and Cloud Composer as workflow orchestration solutions.
- Create and manage Airflow DAGs following best practices.
- Test and debug Airflow DAGs.
- Monitor and observe Airflow DAGs on Cloud Composer.
Who Should Attend
Customers
Prerequisites
Completion of "Building Batch Data Pipelines on Google Cloud" or equivalent knowledge of data analytics and engineering on Google Cloud.
Products Covered
Cloud Composer
Course Modules
1
Introduction to Cloud Composer
Topics
- Data Engineer's need for Workflow Orchestration
- Introduction to Apache Airflow
- Cloud Composer
- Environment Setup
- Using the Composer and Airflow
Learning Outcomes
- Explore Apache Airflow and Cloud Composer.
- Provision Cloud Composer instances.
- Explore the Airflow and Composer UIs.
Activities
Lab: Provisioning Cloud Composer
2
Creating and managing DAGs
Topics
- DAG structure and best practices
- Common operators
- Dependencies, trigger rules, and flow control
- Integration of Airflow and Google Cloud Services
Learning Outcomes
- Write DAGs.
- Explore common Airflow operators.
- Manage triggers, dependencies, and flow control.
- Integrate Airflow with Google Cloud Services.
Activities
Lab: Assembling a Data Processing Workflow
3
Advanced Airflow techniques and best practices
Topics
- Advanced Airflow features
- Debugging DAGs
- Performance and scalability
- Security and Access Control
- Observability and monitoring
Learning Outcomes
- Leverage advanced Airflow features.
- Debug DAGs.
- Observe and monitor your running DAGs.
Activities
Lab: Extending and Monitoring DAGs
Get This Training
No public classes currently scheduled. Express interest below or request private training.
Course Details
- Course Code
- T-WOCC-I
- Duration
- 1 day
- Format
- ILT
- Level
- Intermediate
- Modules
- 3
- Activities
- 3
- Price
- Loading...
Questions About This Course?
Contact us for custom scheduling, group discounts, or curriculum customization.
Contact UsStarting fromLoading...