Mastering Snowflake Solutions: Supporting Analytics and Data Sharing

Description

Intermediate user level Table of Contents About the Author About the Technical Reviewer Acknowledgments Introduction Chapter 1: Snowflake Architecture Technology and Data Are Inseparable Unlocking Business Value Business Agility Is More Important Than Ever All Hail the Cloud! Decisions, Decisions, Decisions! Snowflake Architecture Database Storage Micro Partitions What Is the Benefit of Micro Partitioning? Partitioning in the Pre-Snowflake World Data Clustering Virtual Warehouses Caching Result Cache Local Disk Cache Configuring Virtual Warehouses Number of Clusters Scaling Policy Auto Suspend Query Processing Cloud Services Authentication Infrastructure Management Metadata Management Query Parsing and Execution Access Control Summary Chapter 2: Data Movement Stages External Stages External Tables and Data Lakes Internal Stages User Table Named File Formats The COPY INTO Command COPY INTO Syntax Transformations Data Loading Considerations File Preparation Semistructured Data Dedicated Virtual Warehouses Partitioning Staged Data Loading Data Loading Using the Web UI Unloading Data from Snowflake Bulk vs. Continuous Loading Continuous Data Loads Using Snowpipe Streams and Tasks Change Tracking Using Streams Stream Metadata Columns Tasks Bringing It All Together The Example Scenario Steps Summary Chapter 3: Cloning A Word on Performance Testing Testing with Data Forget the Past! Sensitive Data Why Clone an Object? Working with Clones Which Objects Can Be Cloned? Clone Permissions Bringing It All Together The Example Scenario Steps Summary Chapter 4: Managing Security and Access Control Roles Role Hierarchy Inheritance Objects Extending the Role Hierarchy User and Application Authentication Multi-Factor Authentication MFA Caching Security Assertion Markup Language OAuth Key Pair Authentication Storage Integration Network Policies Option 1: Native Network Security Option 2: Network Policies Option 3: Cloud Service Provider Capabilities Handling PII Data Separately Storing PII Data Removing Data in Bulk Auditing Controlling Access to PII Data Row Access Policies Example Scenario Steps Advanced Snowflake Security Features Future Grants Managed Access Schemas Summary Chapter 5: Protecting Data in Snowflake Data Encryption Encryption Key Management Customer Managed Keys Time Travel Data Retention Periods Querying Historical Data Dropping and Undropping Historical Data Fail-safe Underlying Storage Concepts Temporary and Transient Tables Bringing It All Together Summary Chapter 6: Business Continuity and Disaster Recovery Regions and Availability Zones Data Replication, Failover, and Failback Primary and Secondary Databases Promoting Databases Client Redirect Business Continuity Process Flow Monitoring Replication Progress Reconciling the Process Data Loss Bringing It All Together The Example Scenario Steps Step 1: Configure Replication and Failover Step 2: Select an Account to Replicate the Data to Step 3: Create a Secondary Database on the Replicated Account Step 4: Monitor the Initial Data Refresh Step 5: Schedule Ongoing Data Refreshes Summary Chapter 7: Data Sharing and the Data Cloud The Data Cloud Data Sharing The Data Marketplace Monetization Data Exchange Providers and Consumers What Is a Share? Reader Accounts Using a Dedicated Database for Data Sharing Data Clean Rooms Bringing It All Together The Example Scenario Summary Chapter 8: Programming Creating New Tables Create Table Like Create Table as Select Create Table Clone Copy Grants Stored Procedures User-Defined Functions Scalar Functions Table Functions SQL Variables Transactions Transactions Within Stored Procedures Locking and Deadlocks Transaction Tips Bringing It All Together The Example Scenario Steps Summary Chapter 9: Advanced Performance Tuning Designing Tables for High Performance Data Clustering Clustering Key Pruning Efficiency Clustering Depth Reclustering Designing High-Performance Queries Optimizing Queries Cardinality Materialized Views Search Optimization Service Optimizing Warehouse Utilization Warehouse Utilization Patterns Leveraging Caching Monitoring Resources and Account Usage Resource Monitors Query History Useful References Summary Chapter 10: Developing Applications in Snowflake Introduction to SnowSQL Versions and Updates Config File Authentication Using SnowSQL Data Engineering Java User-Defined Functions Snowpark Data Frames Combining Snowpark and UDFs Connectors Snowflake Connector for Python Querying Data Asynchronous and Synchronous Queries The Query ID Snowflake Connector for Kafka A Solution Architecture Example Summary Index