m Snowflake data services

Key Points

  1. combines a database and data services in the workbench
  2. is this similar to PowerBI with MySQL and ??


References

Reference_description_with_linked_URLs_______________________Notes______________________________________________________________


Snowflake Lab3 gdoc


Snowflake-Cloud-Data-eBook-2020.pdf

snowflake ebook
https://docs.snowflake.com/en/?_ga=2.219649820.485635459
.1589907896-1589449138.1585253434
snowflake docs
https://trial.snowflake.com/snowflake trial - you can do community or enterprise 14 days

snowflake-lab2-buildhandsonlabguide1589843730977.pdf

lab_scripts_OnlineZTS.sql

snowflake lab2 - short version
Snowflake-Cloud-Data-eBook-2020.pdfsnowflake lab x - extended version
snowflake-data-governance-tips-2020.pdfsnowflake data governance concepts

cloud-data-engineering-for-dummies-snowflake. link

cloud-data-engineering-for-dummies-snowflake.pdf file

cloud-data-engineering-for-dummies-snowflake.pdf


snowflake-ai-course-sessions-labs




https://nra84113.us-east-1.snowflakecomputing.com/console#/warehousestrial user jmason900b login
https://app.snowflake.com/us-east-1/nra84113/w27H9YlZaZJ7/chart#querysnowflake dashboard app for jmason900b

https://s3.amazonaws.com/snowflake-workshop-lab/OnlineZTS_LabGuide.pdf

OnlineZTS_LabGuide.pdf

Lab manual - short

https://drive.google.com/file/d/1YX3pbzjFRbOBLN3Gn8WPO7NABXzJt25P/
view?usp=sharing

lab_scripts_OnlineZTS.sql

Lab sql file to load script in worksheets for citibike sample db


guide - getting started with snowflake **


Snowflake books, articles

https://arxiv.org/pdf/1906.09791.pdf

Snowflake - Cloud Data Analytics for Dummies gdrv

Snowflake - Cloud Data Analytics for Dummies





Key Concepts


Snowflake Data Lake EBook v2

https://www.snowflake.com/wp-content/uploads/2022/02/Cloud-Data-Lakes-For-Dummies-2nd-Snowflake-Special-Edition.pdf

Cloud-Data-Lakes-For-Dummies-2nd-Snowflake-Special-Edition.pdf file

Cloud-Data-Lakes-For-Dummies-2nd-Snowflake-Special-Edition.pdf link


Overview
Flowing Data into the Lake
Understanding the Problems with Traditional Data Lakes Acknowledging Interim Solutions: Cloud Object Stores
Reviewing Modern Requirements
Explaining Why You Need a Modern Cloud Data Lake
Looking at Which Industries Use Modern Data Lakes and Why


Planning
Plan Data Lake
Step 1: Review Requirements
Step 2: Migrate or Start Fresh
Step 3: Establish Success Criteria
Step 4: Evaluate Solutions
Step 5: Set Up a Proof of Concept
Step 6: Quantify Value


Snowflake Labs List

https://www.snowflake.com/virtual-hands-on-lab/?mkt_tok=mjuylvjgty0ymjcaaagqmik5iwrg9bq1plhcqgn-bw56lxy6sbya_dvn1dvdfnniuhrdxb4kwlna3uh6z1gzzaux83dfiwrmmuvmulyqy-wpc2kocrib3kdbfg_yxnyef_8exq



Snowflake workbench



Snowflake dashboard app 



snowflake data governance concepts

snowflake-data-governance-tips-2020.pdf

data quality goals include: reliability, consistency, availability, accuracy, utility, efficiency, effectiveness, trust

data governance programs work to implement and manage data quality

benefits of data governance:

  1. improved regulatory compliance
  2. better data security
  3. improved data quality

data governance program steps

  1. create team and design framework
    1. stakeholders and stewards on team
  2. define requirements and policies to support goals
    1. define key use cases -
      1. define data goals, okrs for the use cases
    2. more transparency, trust, provenance, chain of custody, privacy, access controls, discovery, currency, reusability, validations, data management etc
  3. review available tools and skills to support requirements
  4. identify and address gaps
    1. gaps for each policy, procedure, process that is in scope
  5. execute plan
    1. continuous updates based on feedback, results to adjust plan


Snowflake Trial Account


Snowflake Lab on Unstructured Data

Snowflake Lab on Unstructured Data

SnowSQL CLI  installed on the workstation where the lab will be run.


Using an excerpt of the Enron email corpus for learning and exploration purposes, in this hands-on lab, you will learn how to:

  • Access and store unstructured data with internal and external stages
  • Govern unstructured data with role-based access controls
  • Catalog unstructured data using directory tables
  • Perform named entity extraction using a Java UDF
  • Securely share unstructured data



Snowpark - ML AI plugin for Snowflake data usage




cloud-data-engineering-for-dummies-snowflake.pdf file



https://event.on24.com/eventRegistration/console/apollox/mainEvent?&eventid=4658336&sessionid=1&username=&partnerref=&format=fhvideo1&mobile=&flashsupportedmobiledevice=&helpcenter=&key=5E9B10B3E6337BEDAED024C0D20C8498&newConsole=true&nxChe=true&newTabCon=true&consoleEarEventConsole=false&consoleEarCloudApi=false&text_language_id=en&playerwidth=748&playerheight=526&eventuserid=698548854&contenttype=A&mediametricsessionid=603699273&mediametricid=6558740&usercd=698548854&mode=launch



Potential Value Opportunities



Potential Challenges



Candidate Solutions


Introduction
Challenges with Data Lakes
Modernizing with Snowflake
Architecture Patterns with Snowflake
Migration Planning
Summary and Next Steps
About Snowflake

This ebook serves as a comprehensive guide for organizations seeking to modernize their data lakes with Snowflake. From understanding core concepts to mastering migration strategies, each chapter provides guidance from in-house experts to help
you create the necessary data foundation to unlock the full potential of your data with AI.



Step-by-step guide for Example



sample code block

sample code block
 



Recommended Next Steps