GCP Services
140 items
- Page
GCP Foundations3 items
Before you touch a single service, you need to know why the cloud exists and where you fit in.
- What is Google Cloud Platform, and why organizations choose it
- The data engineer's role in the GCP ecosystem
- Global infrastructure: Regions and Zones, and why they matter for latency, availability, and compliance
You'll learn to: explain GCP's value proposition and navigate its global infrastructure model with confidence.
- Page
Identity & Access Management (IAM)3 items
Access control comes before real services are handed to you. This is how every GCP project stays secure.
- Permissions, Roles, and how they combine (Predefined vs Custom Roles)
- The Least Privilege Principle and why over-permissioning causes real production incidents
- Service Accounts: what they are, why applications need their own identity, and how to name/manage them
You'll learn to: design access policies the way cloud security teams expect, and set up service accounts correctly for any application.
- Page
Cloud Storage (GCS)6 items
The entry point of virtually every data pipeline. This is where raw data lands first.
- Buckets, objects, and folder-structure conventions
- Storage Classes (Standard, Nearline, Coldline, Archive) and cost optimization
- Location types: Region, Dual-Region, Multi-Region
- Bucket-level access control and industry naming standards
- Core
gcloud/gsutiloperations: create, upload, copy, move, delete - IAM roles specific to GCS (Object Viewer, Object Admin, Storage Admin)
You'll learn to: stand up and manage a production-ready data lake layer, and choose the right storage tier for any access pattern.
- Page
BigQuery117 items
The analytical warehouse, where raw data becomes business insight.
- Page
Fundamentals94 items
- Page
Basic SELECT & Filtering6 items
SELECTWHEREORDER BYDISTINCTLIMITColumn aliases
- Page
Operators18 items
- Page
Data Types5 items
Numeric data typesString data typesDate and time data typesBoolean valuesNULL
- Page
Single-Row Functions36 items
- Page
CASE / Conditional Logic2 items
CASEIF
- Page
Character Functions15 items
UPPER()LOWER()INITCAP()SUBSTR()INSTR()LPAD()RPAD()LTRIM()RTRIM()TRIM()CONCAT()REPLACE()TRANSLATE()REVERSE()LENGTH()
- Page
Number Functions5 items
ROUND()TRUNC()MOD()POWER()ABS()
- Page
Date Functions9 items
CURRENT_DATE()DATE_ADD()DATE_SUB()DATE_DIFF()DATE_TRUNC()EXTRACT()LAST_DAY()FORMAT_DATE()PARSE_DATE()
- Page
Conversion Functions2 items
CAST()EXTRACT()
- Page
General / NULL Functions3 items
IFNULL()NULLIF()COALESCE()
- Page
Aggregate Functions & Grouping7 items
- Page
Joins4 items
INNER JOINLEFT JOINRIGHT JOINFULL OUTER JOIN
- Page
Subqueries5 items
Subqueries in SELECTSubqueries in WHERESubqueries in FROMIN subqueries
- Page
Window / Analytical Functions12 items
- Page
CTEs (WITH Clause)1 item
WITHclause
- Page
BigQuery & Table Concepts18 items
- Page
DDL4 items
CREATEALTERDROPTRUNCATE
- Page
DML4 items
INSERTUPDATEDELETEMERGE
- Page
BigQuery Tables4 items
Native TablesTemporary TablesGCS External TablesBigLake Tables
- Page
Views & Materialized Views4 items
ViewsMaterialized ViewsWhen to useWhen not to use
- Page
Partitioning & Clustering2 items
- Partitioning
- Clustering
- Page
BigQuery Optimization5 items
- Selecting only required columns
- Efficient filtering
- Proper join usage
- Avoiding unnecessary data processing
- General BigQuery query optimization practices
You'll learn to: design and query a serverless data warehouse at scale, and write cost-efficient SQL that a senior engineer would approve.
- Page
Cloud Run (Functions & Jobs)3 items
The compute layer. This is where your data actually gets processed.
- Cloud Run Functions: HTTP vs event triggers, scaling behavior, cold starts, IAM roles
- Packaging code with Docker and publishing to Artifact Registry
- Cloud Run Jobs: building the processing layers of a real ETL pipeline (ingestion, raw load, validation, curated transformation, and delivery to downstream systems)
You'll learn to: containerize and deploy serverless data-processing jobs, and understand exactly how a production ETL pipeline is broken into stages.
- Page
Orchestration & Automation Services4 items
Once you have storage and compute, you need something to run them in the right order, automatically.
- Cloud Scheduler: time-based triggering (cron-style automation)
- Eventarc: event-driven triggering (react the moment something happens)
- Pub/Sub: asynchronous messaging and the backbone of streaming pipelines
- Cloud Workflows: orchestrating multi-step pipelines, and how it compares to Airflow/Cloud Composer
You'll learn to: automate an end-to-end pipeline without babysitting it, and choose the right trigger mechanism for any scenario (scheduled, event-driven, or message-based).
- Page
Large-Scale Processing: The Decision Layer1 item
Knowing every tool is less valuable than knowing which one to reach for.
- Cloud Run vs Dataflow vs Dataproc: a practical decision framework based on data volume, complexity, and team skillset
You'll learn to: justify architecture decisions in a design review or interview: not just use a service, but explain why it was the right choice.
- Page
DevOps for GCP3 items
How real teams ship infrastructure and code changes safely.
- Terraform: Infrastructure as Code, core commands (
init,plan,apply) - Git/GitHub branching strategy for multi-environment projects
- CI/CD pipelines: automated build, test, and deployment across dev/QA/prod
You'll learn to: version and deploy cloud infrastructure the way modern engineering teams do, with no manual console clicking in production.
- Terraform: Infrastructure as Code, core commands (
