Section 1 : Introduction
|
Lecture 1 | Welcome | 00:02:12 Duration |
|
Lecture 2 | Preparing for the Google Cloud Professional Data Engineer Exam | 00:03:27 Duration |
Section 2 : Cloud Storage for Data Engineering
|
Lecture 1 | Introduction to Object Storage | 00:07:13 Duration |
|
Lecture 2 | Options for Loading Data | 00:03:45 Duration |
|
Lecture 3 | Access Controls for Cloud Storage | 00:02:15 Duration |
|
Lecture 4 | Lifecycle Policy Management | 00:02:26 Duration |
|
Lecture 5 | Using Cloud Storage Console | 00:05:16 Duration |
|
Lecture 6 | Exercise Cloud Storage | 00:00:13 Duration |
|
Lecture 7 | Solution Cloud Storage | 00:01:40 Duration |
Section 3 : Relational Databases - Cloud SQL
|
Lecture 1 | Introduction to Relational Databases | 00:07:56 Duration |
|
Lecture 2 | When to use Cloud SQL | 00:02:31 Duration |
|
Lecture 3 | Creating a Cloud SQL Database | 00:05:00 Duration |
|
Lecture 4 | Monitoring Cloud SQL | 00:02:13 Duration |
|
Lecture 5 | Exercise Create a Cloud SQL Database | 00:00:31 Duration |
|
Lecture 6 | Solution Create a Cloud SQL Database | 00:02:32 Duration |
Section 4 : Relational Databases - Cloud Spanner
|
Lecture 1 | When to use Cloud Spanner | 00:01:36 Duration |
|
Lecture 2 | Creating a Cloud Spanner Database | 00:03:57 Duration |
|
Lecture 3 | Cloud Spanner Performance Considerations | 00:03:31 Duration |
Section 5 : NoSQL Databases Cloud Firestore
|
Lecture 1 | Introduction to Cloud Firestore & Document Databases | 00:03:02 Duration |
|
Lecture 2 | Entities and Kinds | 00:02:01 Duration |
|
Lecture 3 | Indexing in Cloud Firestore | 00:01:48 Duration |
|
Lecture 4 | Creating Entities | 00:03:56 Duration |
|
Lecture 5 | Querying Entities | 00:02:49 Duration |
|
Lecture 6 | Creating Kinds and Namespaces | 00:02:26 Duration |
|
Lecture 7 | Working with Transactions | 00:01:59 Duration |
|
Lecture 8 | Exercise Create a Kind and Entities | 00:00:28 Duration |
|
Lecture 9 | Solution Creating Kinds and Entities | 00:01:22 Duration |
Section 6 : NoSQL Databases Bigtable
|
Lecture 1 | Introduction to Bigtable and Wide-Column Databases | 00:04:33 Duration |
|
Lecture 2 | Creating a Bigtable Instance | |
|
Lecture 3 | Designing Row-keys for Bigtable | 00:05:33 Duration |
|
Lecture 4 | Query Patterns and Denormalization | 00:04:01 Duration |
|
Lecture 5 | Designing for Time Series Data | 00:04:49 Duration |
Section 7 : Analytical Databases BigQuery Data Management
|
Lecture 1 | Introduction to BigQuery and Analytical Databases | 00:05:18 Duration |
|
Lecture 2 | BigQuery Scalar Datatypes | 00:01:10 Duration |
|
Lecture 3 | BigQuery Nested and Repeated Fields | 00:01:29 Duration |
|
Lecture 4 | Querying Scalars, Nested and Repeated Fields | 00:04:31 Duration |
|
Lecture 5 | Exercise Querying BigQuery Public Datasets | 00:00:28 Duration |
|
Lecture 6 | Solution Querying BigQuery Public Datasets | 00:00:59 Duration |
|
Lecture 7 | Access Controls in BigQuery | 00:01:15 Duration |
|
Lecture 8 | Partitioning Tables | 00:04:43 Duration |
|
Lecture 9 | Clustering Partitioned Tables | 00:01:06 Duration |
|
Lecture 10 | Loading Data into BigQuery | 00:02:49 Duration |
Section 8 : Migrating a Data Warehouse
|
Lecture 1 | Assessing the Current State of a Data Warehouse | 00:03:20 Duration |
|
Lecture 2 | Schema and Data Transfer | 00:03:07 Duration |
|
Lecture 3 | Data Pipelines | 00:01:58 Duration |
|
Lecture 4 | Reporting and Analysis | 00:01:45 Duration |
|
Lecture 5 | Data Governance | 00:02:20 Duration |
Section 9 : Caching Data and Cloud Memorystore
|
Lecture 1 | Using Caching to Improve Performance | 00:04:28 Duration |
|
Lecture 2 | Cloud Memorystore Data Structures | 00:02:02 Duration |
|
Lecture 3 | When to use Cloud Memorystore | 00:04:01 Duration |
Section 10 : Workflows and ETLELT
|
Lecture 1 | Introduction to Cloud Composer | 00:03:24 Duration |
|
Lecture 2 | Cloud Composer Architecture | 00:03:18 Duration |
|
Lecture 3 | Introduction to Cloud Data Fusion | 00:03:21 Duration |
Section 11 : Cloud PubSub and Data Pipelines
|
Lecture 1 | Introduction to Cloud PubSub | 00:00:58 Duration |
|
Lecture 2 | Creating Topics and Subscriptions | 00:02:51 Duration |
|
Lecture 3 | Creating and Reading Messages | 00:02:05 Duration |
|
Lecture 4 | Exercise Create a Topic, Publish Messages, Read Messages | 00:00:40 Duration |
|
Lecture 5 | Solution Create a Topic Publish Message | 00:02:06 Duration |
Section 12 : Cloud Dataflow and Data Pipelines
|
Lecture 1 | Stream and Batch Processing with Cloud Dataflow | 00:03:53 Duration |
|
Lecture 2 | Running a Job in Cloud Dataflow | 00:04:20 Duration |
|
Lecture 3 | Analyzing a Failed Job in Cloud Dataflow | 00:03:04 Duration |
|
Lecture 4 | Monitoring Cloud Dataflow | 00:02:55 Duration |
|
Lecture 5 | Troubleshooting a Cloud Dataflow Pipeline | 00:02:09 Duration |
Section 13 : Cloud Dataproc and Data Pipelines
|
Lecture 1 | Introduction to Cloud Dataproc | 00:03:30 Duration |
|
Lecture 2 | Creating a Cloud Dataproc Cluster | 00:05:52 Duration |
|
Lecture 3 | Monitoring a Cloud Dataproc Cluster | 00:01:39 Duration |
|
Lecture 4 | Using Cloud Storage with Cloud Dataproc |
Section 14 : Special Considerations in Distributed Systems
|
Lecture 1 | Hybrid and multi-cloud computing | 00:03:59 Duration |
|
Lecture 2 | Asychronous Messaging | 00:04:54 Duration |
|
Lecture 3 | Stream Processing | 00:07:45 Duration |
|
Lecture 4 | Data Consistency Models | 00:03:14 Duration |
Section 15 : Monitoring and Logging
|
Lecture 1 | Monitoring and Alerting with Cloud Monitoring | 00:04:24 Duration |
|
Lecture 2 | Logging with Cloud Logging | 00:03:23 Duration |
|
Lecture 3 | Creating an Alert | 00:02:54 Duration |
|
Lecture 4 | Install the Monitoring Agent on a Virtual Machine | 00:04:08 Duration |
Section 16 : Security and Compliance
|
Lecture 1 | Introduction to Identity Access Management | |
|
Lecture 2 | Resource Hierarchy | 00:01:44 Duration |
|
Lecture 3 | Predefined Roles | |
|
Lecture 4 | Custom Roles | 00:03:57 Duration |
|
Lecture 5 | Primitive Roles | 00:01:28 Duration |
|
Lecture 6 | IAM Best Practices | 00:02:11 Duration |
|
Lecture 7 | Ensuring Privacy with Data Loss Prevention API | 00:04:04 Duration |
|
Lecture 8 | Legal Compliance | 00:02:54 Duration |
|
Lecture 9 | Encryption At Rest and In Motion | 00:06:16 Duration |
|
Lecture 10 | Key Management | 00:02:58 Duration |
|
Lecture 11 | Exercise Grant roles to users | 00:00:20 Duration |
|
Lecture 12 | Solution Grant roles to users | 00:00:49 Duration |
Section 17 : Introduction to Machine Learning
|
Lecture 1 | 3 Categories of Machine Learning Problems | 00:03:16 Duration |
|
Lecture 2 | 2 Approaches to Building ML Models | 00:01:05 Duration |
|
Lecture 3 | Symbolic Machine Learning | 00:05:44 Duration |
|
Lecture 4 | Neural Networks and Deep Learning | 00:04:20 Duration |
Section 18 : Building ML Models
|
Lecture 1 | Features and Labels | 00:02:30 Duration |
|
Lecture 2 | Feature Engineering | 00:05:18 Duration |
|
Lecture 3 | Model Building | 00:03:49 Duration |
|
Lecture 4 | Model Evaluation | 00:05:18 Duration |
|
Lecture 5 | Gradient Descent and Backpropagation | 00:07:23 Duration |
|
Lecture 6 | Model Troubleshooting | 00:05:11 Duration |
|
Lecture 7 | Building Models in GCP | |
|
Lecture 8 | Using Pre-built ML Models | 00:02:39 Duration |
Section 19 : Deploying and Monitoring ML Models
|
Lecture 1 | Options for Deploying ML Models | 00:02:48 Duration |
|
Lecture 2 | Using GPUs and TPUs | 00:01:53 Duration |
|
Lecture 3 | Monitoring ML Models | 00:03:09 Duration |
|
Lecture 4 | Bias and Unfairness in ML Models | 00:02:09 Duration |
Section 20 : Analytical Databases BigQuery ML
|
Lecture 1 | Introduction to Machine Learning in BigQuery | 00:03:06 Duration |
|
Lecture 2 | Creating a Regression Model in BigQuery | 00:02:31 Duration |
|
Lecture 3 | Evaluating a Regression Model in BigQuery | 00:01:36 Duration |
|
Lecture 4 | Using Model for Predictions in BigQuery | 00:01:36 Duration |
|
Lecture 5 | Exercise Creating a Model in BigQuery | 00:00:18 Duration |
|
Lecture 6 | Solution Creating an ML Model in BigQuery | 00:00:26 Duration |
Section 21 : Conclusion
|
Lecture 1 | Conclusion and Next Steps | 00:02:55 Duration |