SnowPipe on Azure :Creating micro-batch data ingestion pipeline from azure blob storage to Snowflake

#Snowflake #Azure #SnowPipe
This video demonstrates Creating continuous data integration pipeline from azure blob storage to Snowflake. As part of the step-by-step demo, configuration of all azure's snowpipe related services such as Storage account, blob, container, queue, event grids enterprise applications, active directory etc are discussed in detail. Snowflake's stage, integration and snow-pipe commands are explained with all required details.

GitHub Repo of code related to this video - https://github.com/sanjaykattimani/Snowflake-SnowPipe-On-Azure

SnowPipe on AWS - https://www.youtube.com/watch?v=3qS8INSRv4s&list=PLUxVA4dlJgcz90Vbufh6o6p8Rrew-lnE3

Snowflake's documentation of SnowPipe on Azure -https://docs.snowflake.com/en/user-guide/data-load-snowpipe-auto-azure.html


00:00 Introduction & Whats covered in this video
00:50 Introduction to SnowPipe on Azure
01:40 Architecture of components to this demo
03:20 Source files used in this demo
04:25 Azure setup
08:55 Creating Azure SnowPipe integration
10:35 Creating azure event notification
14:00 Create SnowPipe stage in Azure
15:00 Creating SnowPipe
21:20 SnowPipe additional considerations
22:15 Social media links and conclusion


WhatsApp Group - https://bit.ly/snowflakegroup
Follow me on Twitter - https://twitter.com/kattimani
Connect with me on LinkedIn - https://linkedin.com/in/sanjaykattimani

Тэги:

#Snowpipe #snow-pipe #snow_pipe #snowpip #snowflake_data_transfer #azure_snowpipe #snopipe #snowflake_pipe #snowflake_data_pipeline #snowflake_azure #micro_batches #snowflake_microbatch

Скачать видео