www.encora.com Open in urlscan Pro
2606:2c40::c73c:671d  Public Scan

Form analysis
2 forms found in the DOM

/hs-search-results

<form action="/hs-search-results">
  <input tabindex="-1" aria-hidden="true" type="text" class="hs-search-field__input nav-search-field" name="term" autocomplete="off" aria-label="Search" placeholder="Search">
  <input tabindex="-1" aria-hidden="true" type="hidden" name="type" value="SITE_PAGE">
  <input tabindex="-1" aria-hidden="true" type="hidden" name="type" value="LANDING_PAGE">
  <input tabindex="-1" aria-hidden="true" type="hidden" name="type" value="BLOG_POST">
  <input tabindex="-1" aria-hidden="true" type="hidden" name="type" value="LISTING_PAGE">
  <button type="submit" class="nav-search-button"> Search </button>
  <a tabindex="-1" aria-hidden="true" href="#" class="nav-search-close">Close</a>
</form>

https://www.encora.com/insights

<form action="https://www.encora.com/insights">
  <input class="text-grey-dark post-search-input search-bg-input" type="text" name="search" placeholder="Search Keyword" aria-label="Search Encora blog...">
</form>

Text Content

We use cookies to offer you a better browsing experience, analyse site traffic,
personalise content and serve targeted ads. We also share information about your
use of our site with our social media, advertising and analytics partners who
may combine it with other information that you've provided to them or they have
collected from your use of their services. Read how we use cookies and how you
can control them in our Cookie Disclosure Policy. By using our site, you consent
to our use of cookies.

If you decline, your information won’t be tracked when you visit this website. A
single cookie will be used in your browser to remember your preference not to be
tracked.

Cookies settings
Accept Decline

Menu
   
 * Home
 * About
   * News
   * Leadership
   * Awards & Recognitions
   * Who We Are
 * Careers
 * Close Menu

Menu
 * 
 * Home
 * Our Services
   * Cloud Services
   * Product Engineering
   * Data Science & Engineering
   * Digital Experience
   * DevSecOps
   * CyberSecurity
   * Quality Engineering
   * Generative AI
 * Our Work
   * Focus Industries
   * Client Success Stories
   * Innovation Accelerators
 * Nearshore
 * Partners
   * Partner Ecosystem
   * Appian
   * AWS
   * Azure
   * Snowflake
 * Insights
   * Featured Insights
   * Latest Articles
   * Technical Blogs
   * Video Blogs
 * About
   * News
   * Leadership
   * Awards & Recognitions
   * Who We Are
 * Careers
 * Contact Us
 * Search Close
 * 
 * Close Menu




INSIGHTS

Encora shares perspectives on emerging insights, challenges, and trends across
the industries in which we work



CREATING A SNOWFLAKE ZERO-COPY CLONE

Talati Adit Anil | January 20, 2023

Zero Copy Cloning means “Copying without actually copying!”

Before we go deeper into this feature of Snowflake, let’s step back and talk
about what Snowflake is.


INTRODUCTION TO SNOWFLAKE

Snowflake is a cloud-based data warehouse that offers a single platform for all
data needs. This includes data warehousing, data lakes, data engineering, data
science, and application development. Additionally, Snowflake offers a “pay as
you go” pricing model, which allows users to only pay for the storage and
computing resources they use. Its architecture is defined on a Shared-disk and
Shared-nothing database architecture and has three architectural layers:

 1. Cloud Services: The coordinator and collection of Services
 2. Query Processing: The brain of the system, where query execution is
    performed using “virtual warehouses”
 3. Database Storage: This physically stores the data in Columnar mode
    
    
    



Source: Snowflake Documentation

 

Snowflake offers a wide variety of features like Near-Zero Administration,
Real-Time Data Collection, recovering objects using undrop, sharing data between
accounts, Storage & Compute isolation, JSON support with SQL, Auto Encryption,
Auto Query Optimization, and the very special feature, Zero Copy Cloning.

Unlock Data Value and Performance with Modern Data Cloud Capabilities


WHAT IS ZERO COPY CLONING?

Cloning is not a new concept, with one of the best examples being - git clone. 

It is a common concept for databases too, like Oracle, DB2, and SQL Server. We
can clone data by copying, which has multiple disadvantages:

 1. Data duplication
 2. Time consuming to replicate data (If the volume is high)
 3. Data sync
 4. Additional storage needs 
    
    


HOW DOES SNOWFLAKE CLONE DATA SO FAST?

In the traditional approach, cloning creates a real copy of the database which
consumes space. 

Snowflake instead, has a wonderful utility called Cloning (they call it Zero
Copy Clone) which can clone a database/table seamlessly with a simple command.
It is very similar to Pointers that are just a reference to another variable;
instead of actually being the variable. When a command is given to clone a
database, it does the following:

 1. Creates the new Database (as Object Name)
 2. All objects underneath the database are created

 

One could expect the data to be held as a “replica.” But it’s not. What
Snowflake smartly does is create a pointer/reference to the source
database/tables from the cloned object. When a user queries a table from the
cloned object, the cloud service simply fetches the data from the actual source,
making the data as up-to-date as possible. 

Snowflake does all this by playing around with the metadata. When you create a
clone for your data, Snowflake, instead of copying data, creates new metadata
information pointing to the data of interest. All these operations are performed
by Snowflake’s global services layer. This means you can literally clone
terabytes of data within seconds without incurring in computation or storage
costs.  

The entire operation has zero cost, hence the name - Zero Copy Clone.

Maximizing the Value of Data with Snowflake


HOW DOES SNOWFLAKE HANDLE UPDATE OPERATIONS?

Once written, Snowflake micro-partitions are immutable and cannot be modified.
 This means, when a user executes an UPDATE operation, instead of finding and
updating the data in place, Snowflake simply creates a new version of the
relevant micro-partitions with the changed data.

Example: 
As a first step, let us create a clone of production data (Table_A) to the stage
environment with just a simple command as shown below:



With the above command, TABLE_A_CLONE is created in the stage environment with
the same data available at the time of running this query in the table named
TABLE_A.  TABLE_A_CLONE is the same as any other table & supports all kinds of
DML and DDL operations. Snowflake’s underlying architecture stores data in
smaller blocks called micro-partitions. So essentially, your clone is just a new
set of metadata that is pointing to the same micro-partitions that holds the
data of Table_A (as depicted below).

 



Now let us say due to activity in the stage environment, some of the data of
table TABLE_A_CLONE gets modified. All this modified data belongs to
Micro-Partition-3 (MP-3). Since the same micro-partition (MP-3) is shared by
Table_A. How does Snowflake deal with this change? It does not copy all
micro-partitions, instead it copies that modified micro-partition alone and
creates a new micro-partition (MP-4) and assigns this one to the stage
environment alone; as this change is owned by TABLE_A_CLONE alone.

Micro-Partitions in Snowflake are immutable, meaning that once created, they
last in the same state until the table is dropped. Hence, the change in stage
environment is captured separately and metadata points to the newly created
micro-partition and updates TABLE_A_CLONE. So, additional storage costs are
levied only for the modified data but not for the complete clone. This change is
depicted as below.




HOW DOES ACCESS CONTROL WORK WITH CLONED OBJECTS?

A cloned object does not automatically get copy privileges from the source
object during cloning. A system administrator, or the owner of the cloned
object, must explicitly grant any required privileges to the newly-created
clone.

However, if the source object is a database or schema, for child objects
contained in the source, the clone replicates all granted privileges on the
corresponding child objects. To create a clone, your current role must have the
following privilege(s) on the source object:

•    Tables: SELECT
•    Pipes, Streams, Tasks: OWNERSHIP
•    Other objects: USAGE

 


ADVANTAGES OF ZERO COPY CLONE

To summarize, here are the key advantages of zero copy cloning:

 1. Almost no additional storage costs for cloning data
 2. No waiting time for cloning data from one environment to another
 3. No need for administrative efforts, as cloning is as simple as a Select
 4. Since data exists only in one place, it’s easy to maintain
 5. Instantly promotes corrected/fixed data to production

 


CONCLUSION

Zero-Copy Cloning can avoid creating multiple development environments in
separate accounts. Until now, the typical development team used to create
separate production, development and test environments, which was costly and
time consuming. Creating on large copies of production tables was a tremendous
task. The alternative offered by companies like Snowflake Zero Copy Cloning can
not only save you time, but it will also save you a lot of money!

 


ABOUT ENCORA

Fast-growing tech companies partner with Encora to outsource product development
and drive growth. Contact us to learn more about our software engineering
capabilities.

Leverage Encora's Partnership with Snowflake.


INSIGHT CONTENT

 * Introduction to Snowflake
   
 * What Is Zero Copy Cloning?
   
 * How Does Snowflake Clone Data So Fast?
   
 * How Does Snowflake Handle Update Operations?
   
 * How Does Access Control Work with Cloned Objects?
   
 * Advantages of Zero Copy Clone
   
 * Conclusion
   
 * About Encora
   


CATEGORIES

 * HiTech
   
 * Product Engineering & Development
   
 * Technical Blog
   
 * Cloud Services
   
 * Cloud Engineering
   
 * Partnership and Snowflake
   


RECENT POSTS

Exploration of techniques to use ChatGPT to generate high-quality test cases.


Choosing the right LLM


Class Components vs Functional Components in React



SHARE THIS POST




FEATURED INSIGHTS

FEATURED



WHAT IS POSTMAN API TEST

Postman is an application used for API testing. It is an HTTP client that tests
HTTP requests, ...

HiTech

Learn More

FEATURED



NATURAL LANGUAGE PROCESSING AND MACHINE LEARNING

Natural Language Processing (NLP) is part of everyday life and it is essential
to our lives at home ...

HiTech

Learn More

FEATURED



5 AXIOMS TO IMPROVE YOUR TEAM COMMUNICATION AND COLLABORATION

Good communication within a team is key to keeping everyone on the right track.
But it can be ...

Digital Learning

Learn More

FEATURED



EXPONENTIAL SMOOTHING METHODS FOR TIME SERIES FORECASTING

Recently, we covered basic concepts of time series data and decomposition
analysis. We started ...

Technical Blog

Learn More


JOIN US!

Explore our Careers portal to get connected with career opportunities in your
area!

Explore Careers

 * Home
 * Our Services
 * Our Work
 * Nearshore
 * Partners
 * Insights
 * About
 * Careers
 * Contact Us

Innovation Acceleration
Headquarters - Scottsdale, AZ 85260
© Encora Digital LLC
letstalk@encora.com

letstalk@encora.com Terms of Use Privacy Policy Cookie Disclosure Policy
Disclaimer Sitemap


word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word word word word word word word word word
word word word word word word word word

mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1
mmMwWLliI0fiflO&1