Digital Library

Mastering Snowflake Platform Generate, fetch, and automate Snowflake data as a skilled data practitioner (Kelgaonkar, Pooja) (z-library.sk, 1lib.sk, z-lib.sk)

Kelgaonkar, Pooja

Share E-Book
Read Without Registration

Mastering Snowflake Platform Generate, fetch, and automate Snowflake data as a skilled data practitioner (Kelgaonkar, Pooja) (z-library.sk, 1lib.sk, z-lib.sk)

Author Kelgaonkar, Pooja

Data
Language English

No Description

Format PDF
Size 9.9 MB
6
Views
0
Downloads
0.00
Total Donations
(First 20 pages)

Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Page 1
(This page has no text content)
Page 2
(This page has no text content)
Page 3
Mastering Snowflake Platform Generate, fetch, and automate Snowflake data as a skilled data practitioner Pooja Kelgaonkar
Page 4
www.bpbonline.com
Page 5
Copyright © 2024 BPB Online All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor BPB Online or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book. BPB Online has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, BPB Online cannot guarantee the accuracy of this information. First published: 2024 Published by BPB Online WeWork 119 Marylebone Road London NW1 5PU UK | UAE | INDIA | SINGAPORE ISBN 978-93-55519-764 www.bpbonline.com
Page 6
Dedicated to My beloved Parents, Neelkrishna & My Daughter Anvi
Page 7
About the Author Pooja Kelgaonkar is a distinguished figure in the realm of data, standing as one of the Snowflake data superheroes, boasting nearly two decades of experience in the field. She has honed her expertise through diverse roles on various data platforms and distributed systems, emerging as a specialist in data modernization. She is currently serving as a senior data architect at Rackspace Technology in Toronto. As a key data resource, she leads the data implementations, ensuring seamless integration and optimal performance, ultimately contributing to the success and satisfaction of the clients. Her commitment to knowledge extends beyond her professional role, as she is also the founder of an edutech platform. She is a strong advocate for knowledge sharing and community growth. Her commitment is evident in her contributions to the tech community through blogs on Snowflake and Google Cloud Platform (GCP). These insightful articles are regularly featured on Google and Snowflake community pages, solidifying her position as a thought leader. Pooja’s passion for community growth extends beyond the digital arena; she thrives as a public speaker, frequently participating in events, conferences, and tech webinars. Her involvement in these platforms allows her to share her wealth of knowledge and insights, contributing to the collective learning of the community. Pooja’s multifaceted engagement with data, education, and community
Page 8
development showcases a profound commitment to advancing the field and empowering those within it.
Page 9
About the Reviewer Dipika Aher is a passionate data engineer with extensive professional experience in the domain of healthcare and manufacturing. With a skill set that includes Snowflake, DBT, Python, Unix, SQL, AWS, Informatica, Oracle, she is a holder of multiple industry certifications such as the AWS Solutions, Snowflake Certifications and more. She is currently working as part of a development team and has been using cloud technologies to enhance her Snowflake related knowledge. She believes that education is the key to empowering people and creating positive change in the world. She uses her expertise and enthusiasm to inspire and motivate others to pursue their passions and goals in the field of data engineering.
Page 10
Acknowledgement I extend my deepest gratitude to my parents and family, especially my daughter Anvi, for their unwavering support and encouragement throughout the writing of this book. Their constant belief in me has been my greatest motivation. I am grateful to BPB Publications for presenting me the opportunity to author a book on mastering Snowflake. My heartfelt thanks go to the entire BPB team, whose collaboration in both editorial and technical aspects has made this journey an enriching experience. Special acknowledgment goes to my mentor as well as the Snowflake community. They have consistently encouraged me to pursue my aspirations. It is an honor to be part of the Snowflake’s elite group that is committed to continuous knowledge and learning. To all the readers who have shown interest in my book and contributed to its realization, I express my sincere thanks. Your support and encouragement have been truly invaluable in bringing this project to life.
Page 11
Preface Data is continuously evolving and hence the world around it. Many have witnessed the transition from Mainframes to the cloud implementations. It is the need of the moment to have a robust, scalable, performance and cost efficient data platform that cater to the ever growing need of the data applications. In the rapidly evolving landscape of data management, Snowflake stands as a powerful platform, and offers unified experience to the customers. This book is your first step to unlocking its full potential. In this book, you embark on a transformative exploration, blending theoretical insights with practical applications to empower you on your data mastery voyage. Whether you are a newcomer to delve into the world of Snowflake or an experienced practitioner seeking to refine your skills, this guide is crafted to meet you at your current level and propel you forward. As the book unfolds, you will traverse the intricacies of Snowflake architecture, discover its key features, and navigate the nuances of working with different data types. You will continue the journey with a deep dive into advanced concepts such as data security, governance, and collaboration. What sets this guide apart is its relation with real time use cases and references from traditional enterprise data architectures along with hands-on approach. Throughout the chapters, you will find practical exercises, real-time use
Page 12
cases, and reference architectures that bridge the gap between theory and application. Get ready and fasten your seatbelt to embark on a transformative journey with Snowflake. Whether you are aiming to enhance your career, architect data solutions, or simply learn new skills, “Mastering Snowflake Platform” is your trusted companion to get you started. Chapter 1: Getting Started with Snowflake – The first chapter is the foundation of the book, and it covers the history of the Snowflake, the need to implement Snowflake, and how readers can get started with Snowflake. This chapter guides to set up a trial or demo account to be used for various hands-on activities covered in subsequent chapters. This also covers the overview of Snowflake certifications and various community events. Chapter 2: Three Layered Architecture – This chapter helps readers to get started with Snowflake with a detailed view of architecture. This covers the various data platform architecture challenges and how Snowflake helps to overcome most of these challenges. This chapter defines 3 layers of architecture, their distinguishing features and setup. Chapter 3: Data Types, Data Objects and SQL Commands – This chapter focuses on various data types, data objects and SQL commands supported in Snowflake. Snowflake supports ANSI SQL standard. However this chapter guides on DDL, DCL and DML supported in this platform. This chapter also covers unique database objects used and created in Snowflake. Chapter 4: Data Loading and Unloading – Data loading and unloading is one the most important parts of data platform implementation. This chapter guides you to learn native utilities, commands supported by Snowflake. This
Page 13
covers various commands used to load batch and streaming datasets. This also covers data extraction and sharing with consumer groups. Chapter 5: Understanding Streams and Tasks – Change data capture is the most critical part of the data platform implementation. This chapter guides you to streams – Snowflake native objects used for change data capture. This also covers native scheduling and orchestrating objects – Tasks. Chapter 6: Understanding Snowpark – Spark is one of the fastest ways to implement ETL or ELT while implementing data pipelines. This chapter covers Snowpark – which is a native programming language like Spark. It is also a guide on how to understand and implement Snowpark. Chapter 7: Access Control and Managing Users Roles – Access control is one of the key pillars of data governance. This chapter helps to understand various access control implementations in Snowflake. This also covers role and user management, how users are created, roles are created and maintained. This guides to set up the most important pillar of governance. Chapter 8: Data Protection and Recovery – Data protection and recovery is the next pillar of data governance. This chapter guides you to understand data protection mechanisms with Snowflake. This also covers various data recovery options in Snowflake. This chapter helps to define appropriate policies, data masking and using the right data recovery technique when needed. Chapter 9: Snowflake Performance Optimization – This chapter guides to develop an understanding of performance measure, performance optimization techniques and need to implement optimization. This also covers understanding of
Page 14
Snowflake metadata objects that help to measure performance of the platform. Chapter 10: Understanding Snowflake Costing and Utilizations – Cost is the most critical component of platform design, implementation, usage, and maintenance. This chapter guides to develop an understanding of cost measure, cost optimization techniques and need to implement optimization. Chapter 11: Implementing Cost Optimizations – This chapter guides how to implement cost optimizations. This helps to develop an understanding of real time use cases and best practices followed for cost optimizations. Chapter 12: Data Sharing – Data collaborations, data integrations and integrating with consumer applications is essential for business growth and requirements. This chapter guides how to implement data sharing, secure data sharing with Snowflake as well as non-Snowflake consumer groups. This also helps to understand various sharing options available in Snowflake. Chapter 13: Data Cloning – Managing environments like DEV, QA, UAT and PROD becomes challenging when a user wants to develop, test their features with greater data volumes or production datasets. This chapter guides how to setup environments using data cloning features and helps to understand how easy it is to clone and maintain copies, data across environments. Chapter 14: Understanding Snowsight – Earlier Snowflake offered two versions of web based user interfaces – Classic console and Snowsight. Now with latest sign ups, Snowsight is the only UI made available to the users and all earlier accounts migrated to Snowsight. This chapter helps to understand Snowsight features and distinguishing factors
Page 15
of the interfaces. This also covers the intuitive dashboarding feature of Snowsight. Chapter 15: Programming Connectors and Drivers – Snowflake offers various connectors, drivers to work with a set of programming languages. This chapter helps to understand the various connectors and drivers. This also guides to setup sample drivers and Snowflake native command line interface – Snowsql. Chapter 16: Workload Patterns with Snowflake – Snowflake is data on cloud and supports various data implantations. This chapter helps to understand Data Warehouse, Data Lake, Lake house requirements and implementing with Snowflake. This also covers a variety of real time use cases, data architectures for reference. Chapter 17: Introduction to Snowflake’s Advance Features – Snowflake continuously works on their features, releases updates and introduces new features with every release. This chapter helps to understand new features introduced by Snowflake. This also covers a variety of real time use cases for reference.
Page 16
Code Bundle and Coloured Images Please follow the link to download the Code Bundle and the Coloured Images of the book: https://rebrand.ly/xar4q49 The code bundle for the book is also hosted on GitHub at https://github.com/bpbpublications/Mastering- Snowflake-Platform. In case there's an update to the code, it will be updated on the existing GitHub repository. We have code bundles from our rich catalogue of books and videos available at https://github.com/bpbpublications. Check them out! Errata We take immense pride in our work at BPB Publications and follow best practices to ensure the accuracy of our content to provide with an indulging reading experience to our subscribers. Our readers are our mirrors, and we use their inputs to reflect and improve upon human errors, if any, that may have occurred during the publishing processes involved. To let us maintain the quality and help us reach out to any readers who might be having difficulties due to any unforeseen errors, please write to us at : errata@bpbonline.com
Page 17
Your support, suggestions and feedbacks are highly appreciated by the BPB Publications’ Family. Did you know that BPB offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.bpbonline.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at : business@bpbonline.com for more details. At www.bpbonline.com, you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on BPB books and eBooks. Piracy If you come across any illegal copies of our works in any form on the internet, we would be grateful if you would provide us with the location address or website name. Please contact us at business@bpbonline.com with a link to the material. If you are interested in becoming an author If there is a topic that you have expertise in, and you are interested in either writing or contributing to a book, please visit www.bpbonline.com. We have worked with thousands of developers and tech professionals, just like you, to help them share their insights with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea. Reviews Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions. We at BPB can understand what you think about our products, and our authors can see your feedback on their book. Thank you! For more information about BPB, please visit www.bpbonline.com. Join our book’s Discord space Join the book’s Discord Workspace for Latest updates, Offers, Tech happenings around the world, New Release and Sessions with the Authors:
Page 18
https://discord.bpbonline.com
Page 19
Table of Contents 1. Getting Started with Snowflake Introduction Structure Objectives Why Snowflake? History of Snowflake Snowflake certifications Snowflake community Setting up a trial account with Snowflake Connecting to Snowflake Snowflake Web User Interface Classic console Context setting Snowsight Command line interface Download and setup SnowSQL Connecting to Snowflake Conclusion Points to remember Practical Multiple choice questions Answers
Page 20
2. Three Layered Architecture Introduction Structure Objectives Traditional data warehouse challenges Legacy data warehouse challenges Typical data lake challenges Hadoop ecosystem Extended support to NoSQL Snowflake architecture Cloud services layer Authentication and access control Optimizer Metadata storage and management Result cache Security Availability of cloud services layer Uses of cloud services layer Virtual warehouse layer Virtual warehouses: Single and multi-cluster Single cluster warehouses Multi-cluster warehouses Virtual warehouse properties Virtual warehouse sizes Warehouse scaling Scaling up Scaling out Scaling modes Scaling policies
The above is a preview of the first 20 pages. Register to read the complete e-book.

Recommended for You

Loading recommended books...
Failed to load, please try again later

Tip the Site

Scan the WeChat Pay or Alipay code to tip. No login required.

WeChat Pay
Alipay
← Back to List