Chevron Left
返回到 Serverless Data Processing with Dataflow: Develop Pipelines

學生對 Google 云端平台 提供的 Serverless Data Processing with Dataflow: Develop Pipelines 的評價和反饋

21 個評分
6 條評論


In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks....



1 - Serverless Data Processing with Dataflow: Develop Pipelines 的 6 個評論(共 6 個)

創建者 Silviu D E


I really appreciate the knowledge and time that your team has put into these courses. Also looking forward to the 3th course on Dataflow/Beam (meanwhile, I still have some articles/documentation to read). Related on this course, my favorite part: - Windows, watermarks, and triggers; - Sources and Sinks; - Schemas; - Best practices; - SQL (for people that already are using BigQuery this will be a game changer). Also I've noted that Java it's the way to go for full features in Beam/Dataflow (although for me the syntax of python looks way prettier). Also I have a question: with "dataflow sql" you have less features than using java or python ?! Also Google have plans to bootstrap "Dataflow SQL" with more features? Also in 3th course, I hope that we will see more demos/code/case studies/git repos.

創建者 Abhishek V


Found this course very helpful while learning developing pipelines in gcp using dataflow-beam.

創建者 Trung N H


Excellent course focus on Batch and Streaming Pipelines using Google Dataflow

創建者 Mengyang C


Good for an advance engineers

創建者 Dmitry B


This course gives a great overview of the basic building blocks of Apache Beam as well as offers an opportunity to get your hands dirty and use these building blocks to build real data pipelines. I wish there was a continuation of this course to dive deeper into various topics e.g. GroupBy optimizations and advanced streaming.

創建者 Steve V


Too hard, insufficient signposting