T-OBQDF-IOfficial Google Curriculum
Orchestrate BigQuery Workloads with Dataform
1 dayILTIntermediateLoading...
Overview
Dataform service for data analysts to develop, test, version control, and schedule complex SQL workflows for data transformation in BigQuery, covering core components, table definitions, documentation, security, assertions, and workflow execution.
What You'll Learn
- Understand the components of Dataform core
- Create tables and views in BigQuery using Dataform
- Document BigQuery tables and views
- Understand BigQuery security settings using Dataform
- Use assertions to validate data in Dataform workflows
- Execute Dataform SQL workflows in an automated fashion
Who Should Attend
Customers
Prerequisites
Knowledge of SQL data analysis and BigQuery as discussed in BigQuery for Data Analysis.
Products Covered
DataformBigQuery
Course Modules
1
Dataform Core Components
Topics
- SQL workflow
- Repositories and workspaces
- Default files and folders
- Compiled graphs
Learning Outcomes
- Understand the components of Dataflow core
2
Table Definitions and Dependencies
Topics
- Declare a data source
- Create a table
- Create an incremental table
- Set partitioning and clustering options
- Create an empty table
- Create an external BigLake table
- Create views and materialized views
- Define dependencies
Learning Outcomes
- Create tables and views in BigQuery using Dataform
3
Document BigQuery Tables and Views
Topics
- Use column descriptions
- Use globally defined JavaScript constants
- Add labels
Learning Outcomes
- Document BigQuery tables and views
Activities
Lab: Build SQL Workflows with Dependencies in Dataform
4
BigQuery Security Settings
Topics
- IAM dataset and table/view access
- Column-level security
- Row-level security
Learning Outcomes
- Understand BigQuery security settings using Dataform
5
Assertions
Topics
- Use built-in assertions
- Create manual assertions
Learning Outcomes
- Use assertions to validate data in Dataform workflows
Activities
Lab: Work with Assertions and BigQuery Security Settings in Dataform
6
SQL Workflow Executions
Topics
- Dataform code lifecycle
- What happens during compilation
- Customize and schedule compilation results
- Execute workflows (UI, Cloud Scheduler, Cloud Composer)
- Logging and monitoring
Learning Outcomes
- Execute Dataform SQL workflows in an automated fashion
Activities
Lab: Automate and Monitor SQL Workflow Executions in Dataform
7
Advanced Use Cases
Topics
- Create a BigLake table after file upload using Cloud Run functions
- Build a Machine Learning pipeline with BigQuery ML
- Work with Slowly Changing Dimensions Type 2
Learning Outcomes
- Explore additional use cases for Dataform
Activities
Lab: Create a BigLake Table with Dataform Using Cloud Run Functions
Get This Training
No public classes currently scheduled. Express interest below or request private training.
Course Details
- Course Code
- T-OBQDF-I
- Duration
- 1 day
- Format
- ILT
- Level
- Intermediate
- Modules
- 7
- Activities
- 4
- Price
- Loading...
Questions About This Course?
Contact us for custom scheduling, group discounts, or curriculum customization.
Contact UsStarting fromLoading...