m Snowflake data services
Key Points
- combines a database and data services in the workbench
- is this similar to PowerBI with MySQL and ??
References
Reference_description_with_linked_URLs_______________________ | Notes______________________________________________________________ |
---|---|
Snowflake Lab3 gdoc | |
snowflake ebook | |
https://docs.snowflake.com/en/?_ga=2.219649820.485635459 .1589907896-1589449138.1585253434 | snowflake docs |
https://trial.snowflake.com/ | snowflake trial - you can do community or enterprise 14 days |
snowflake lab2 - short version | |
Snowflake-Cloud-Data-eBook-2020.pdf | snowflake lab x - extended version |
snowflake-data-governance-tips-2020.pdf | snowflake data governance concepts |
cloud-data-engineering-for-dummies-snowflake.pdf | |
snowflake-ai-course-sessions-labs | |
https://nra84113.us-east-1.snowflakecomputing.com/console#/warehouses | trial user jmason900b login |
https://app.snowflake.com/us-east-1/nra84113/w27H9YlZaZJ7/chart#query | snowflake dashboard app for jmason900b |
https://s3.amazonaws.com/snowflake-workshop-lab/OnlineZTS_LabGuide.pdf | Lab manual - short |
https://drive.google.com/file/d/1YX3pbzjFRbOBLN3Gn8WPO7NABXzJt25P/ | Lab sql file to load script in worksheets for citibike sample db |
guide - getting started with snowflake ** | |
Snowflake books, articles | |
Snowflake - Cloud Data Analytics for Dummies | |
Key Concepts
Snowflake Data Lake EBook v2
Cloud-Data-Lakes-For-Dummies-2nd-Snowflake-Special-Edition.pdf file
Cloud-Data-Lakes-For-Dummies-2nd-Snowflake-Special-Edition.pdf link
Overview
Flowing Data into the Lake
Understanding the Problems with Traditional Data Lakes Acknowledging Interim Solutions: Cloud Object Stores
Reviewing Modern Requirements
Explaining Why You Need a Modern Cloud Data Lake
Looking at Which Industries Use Modern Data Lakes and Why
Planning
Plan Data Lake
Step 1: Review Requirements
Step 2: Migrate or Start Fresh
Step 3: Establish Success Criteria
Step 4: Evaluate Solutions
Step 5: Set Up a Proof of Concept
Step 6: Quantify Value
Snowflake Labs List
Snowflake workbench
Snowflake dashboard app
snowflake data governance concepts
snowflake-data-governance-tips-2020.pdf
data quality goals include: reliability, consistency, availability, accuracy, utility, efficiency, effectiveness, trust
data governance programs work to implement and manage data quality
benefits of data governance:
- improved regulatory compliance
- better data security
- improved data quality
data governance program steps
- create team and design framework
- stakeholders and stewards on team
- define requirements and policies to support goals
- define key use cases -
- define data goals, okrs for the use cases
- more transparency, trust, provenance, chain of custody, privacy, access controls, discovery, currency, reusability, validations, data management etc
- define key use cases -
- review available tools and skills to support requirements
- identify and address gaps
- gaps for each policy, procedure, process that is in scope
- execute plan
- continuous updates based on feedback, results to adjust plan
Snowflake Trial Account
Snowflake Lab on Unstructured Data
Snowflake Lab on Unstructured Data
SnowSQL CLI installed on the workstation where the lab will be run.
Using an excerpt of the Enron email corpus for learning and exploration purposes, in this hands-on lab, you will learn how to:
- Access and store unstructured data with internal and external stages
- Govern unstructured data with role-based access controls
- Catalog unstructured data using directory tables
- Perform named entity extraction using a Java UDF
- Securely share unstructured data
Snowpark - ML AI plugin for Snowflake data usage
cloud-data-engineering-for-dummies-snowflake. link
cloud-data-engineering-for-dummies-snowflake.pdf file
Potential Value Opportunities
Potential Challenges
Candidate Solutions
THE ESSENTIAL GUIDE TO MODERNIZING DATA LAKES FOR AI WITH SNOWFLAKE. link
Introduction
Challenges with Data Lakes
Modernizing with Snowflake
Architecture Patterns with Snowflake
Migration Planning
Summary and Next Steps
About Snowflake
This ebook serves as a comprehensive guide for organizations seeking to modernize their data lakes with Snowflake. From understanding core concepts to mastering migration strategies, each chapter provides guidance from in-house experts to help
you create the necessary data foundation to unlock the full potential of your data with AI.
Step-by-step guide for Example
sample code block