Streaming data has been historically complex and expensive to work with. That’s no longer the case with Snowflake’s streaming pipelines capabilities. Together, Snowpipe Streaming and Dynamic Tables (Public Preview) remove the boundary between streaming and batch systems, enabling you to handle streaming and continuous pipelines the same way as your batch pipelines.
In this lab, our instructor will help you follow along to build data pipelines to ingest and transform streaming data. You’ll learn how to:
- Ingest a simulated stream of data using Java client and implement Snowpipe Streaming API
- Handle the Change Data Capture (CDC)
- Create Dynamic Tables in a few lines of SQL and transform incremental data
- Process PII and sensitive data in this lab
講演者
-
Steven Maser
Senior Sales Engineer
Snowflake -
Shiyi Gu
Product Marketing Manager, Data Engineering
Snowflake