siliconangle.com Open in urlscan Pro
52.42.53.142 Public Scan

Back to summary

Submitted URL:
http://ridethenarwhal.dremio.com/MzIxLU9EWC0xMTcAAAGECk_QjakjSRjJnhQfac7SsIX8TTncrywuXrd9jnZ3LY8TR8ypyuSiFMvzxIFNuubCw9dd_LA=
Effective URL:
https://siliconangle.com/2022/04/05/dremio-reveals-metadata-operations-helping-orgs-reach-true-data-code-paradigm-awsshow...
Submission: On April 28 via api (April 28th 2022, 5:11:55 pm UTC) from CH — Scanned from DE

Form analysis
6 forms found in the DOM

GET https://siliconangle.com/

<form autocomplete="off" role="search" method="get" class="search-form" action="https://siliconangle.com/">
  <input type="search" class="search-field" placeholder="Search" value="" name="s">
  <button type="submit"><span class="screen-reader-text"><i class="material-icons search-icon">search</i></span></button>
</form>

GET https://siliconangle.com/

<form autocomplete="off" role="search" method="get" class="search-form" action="https://siliconangle.com/">
  <input type="search" class="search-field" placeholder="Search" value="" name="s">
  <button type="submit"><span class="screen-reader-text"><i class="material-icons search-icon">search</i></span></button>
</form>

POST /2022/04/05/dremio-reveals-metadata-operations-helping-orgs-reach-true-data-code-paradigm-awsshowcases2e2/?mkt_tok=MzIxLU9EWC0xMTcAAAGECk_QjWgCwIx5Lc8nT9zLOxf_AOPIA0gMMHP8LXtRP9jKo7iI3Y11JWDbKsVbYpMchrSX_DFRvB9BkhD48ZsY30yQZp3aX2uv9ruUH6HOyb4#gf_1

<form method="post" enctype="multipart/form-data" target="gform_ajax_frame_1" id="gform_1"
  action="/2022/04/05/dremio-reveals-metadata-operations-helping-orgs-reach-true-data-code-paradigm-awsshowcases2e2/?mkt_tok=MzIxLU9EWC0xMTcAAAGECk_QjWgCwIx5Lc8nT9zLOxf_AOPIA0gMMHP8LXtRP9jKo7iI3Y11JWDbKsVbYpMchrSX_DFRvB9BkhD48ZsY30yQZp3aX2uv9ruUH6HOyb4#gf_1">
  <div class="gform_heading">
    <h3 class="gform_title">Send us a News Tip</h3>
  </div>
  <div class="gform_body">
    <ul id="gform_fields_1" class="gform_fields top_label form_sublabel_below description_below">
      <li id="field_1_1" class="gfield gfield_contains_required field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_1_3">Name<span class="gfield_required">*</span></label>
        <div class="ginput_complex ginput_container no_prefix has_first_name no_middle_name has_last_name no_suffix gf_name_has_2 ginput_container_name" id="input_1_1">
          <span id="input_1_1_3_container" class="name_first">
            <input type="text" name="input_1.3" id="input_1_1_3" value="" aria-label="First name" tabindex="50">
            <label for="input_1_1_3">First</label>
          </span>
          <span id="input_1_1_6_container" class="name_last">
            <input type="text" name="input_1.6" id="input_1_1_6" value="" aria-label="Last name" tabindex="52">
            <label for="input_1_1_6">Last</label>
          </span>
        </div>
      </li>
      <li id="field_1_5" class="gfield gfield_contains_required field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_5">Type of Pitch<span class="gfield_required">*</span></label>
        <div class="ginput_container ginput_container_select"><select name="input_5" id="input_1_5" class="medium gfield_select" tabindex="54">
            <option value="" selected="selected" class="gf_placeholder">Consumer or Enterprise?</option>
            <option value="Enterprise">Enterprise</option>
            <option value="Startup News">Startup News</option>
            <option value="Emerging Technology">Emerging Technology</option>
          </select></div>
      </li>
      <li id="field_1_3" class="gfield gfield_contains_required field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_3">Email<span class="gfield_required">*</span></label>
        <div class="ginput_container ginput_container_email">
          <input name="input_3" id="input_1_3" type="text" value="" class="medium" tabindex="55">
        </div>
      </li>
      <li id="field_1_4" class="gfield gfield_contains_required field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_4">What's your story?<span class="gfield_required">*</span></label>
        <div class="ginput_container ginput_container_textarea">
          <textarea name="input_4" id="input_1_4" class="textarea medium" tabindex="56" rows="10" cols="50"></textarea>
        </div>
      </li>
      <li id="field_1_2" class="gfield field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_2">File</label>
        <div class="ginput_container ginput_container_fileupload"><input type="hidden" name="MAX_FILE_SIZE" value="67108864"><input name="input_2" id="input_1_2" type="file" class="medium" aria-describedby="extensions_message" tabindex="57"><span
            id="extensions_message" class="screen-reader-text"></span></div>
      </li>
      <li id="field_1_6" class="gfield gform_validation_container field_sublabel_below field_description_below"><label class="gfield_label" for="input_1_6">Name</label>
        <div class="ginput_container"><input name="input_6" id="input_1_6" type="text" value=""></div>
        <div class="gfield_description">This field is for validation purposes and should be left unchanged.</div>
      </li>
    </ul>
  </div>
  <div class="gform_footer top_label"> <input type="submit" id="gform_submit_button_1" class="gform_button button" value="Submit" tabindex="58"
      onclick="if(window[&quot;gf_submitting_1&quot;]){return false;}  window[&quot;gf_submitting_1&quot;]=true;  "> <input type="hidden" name="gform_ajax" value="form_id=1&amp;title=1&amp;description=&amp;tabindex=49">
    <input type="hidden" class="gform_hidden" name="is_submit_1" value="1">
    <input type="hidden" class="gform_hidden" name="gform_submit" value="1">
    <input type="hidden" class="gform_hidden" name="gform_unique_id" value="">
    <input type="hidden" class="gform_hidden" name="state_1" value="WyJbXSIsIjAzYzI5MmZjOWIzYjhhZmM1ODFhNDMxYzFiY2RjZDI2Il0=">
    <input type="hidden" class="gform_hidden" name="gform_target_page_number_1" id="gform_target_page_number_1" value="0">
    <input type="hidden" class="gform_hidden" name="gform_source_page_number_1" id="gform_source_page_number_1" value="1">
    <input type="hidden" name="gform_field_values" value="">
  </div>
</form>

Name: sa_loginform — POST

<form name="sa_loginform" id="sa_loginform" role="form" method="post">
  <div class="alert alert-danger hidden">...</div>
  <div class="form-group login-username"><label for="sa_user_signin"></label><input type="text" name="sa_user_signin" id="sa_user_signin" class="form-control" placeholder="Username or Email" size="20" required=""></div>
  <div class="form-group login-password"><label for="sa_user_pass"></label><input type="password" class="form-control" name="sa_user_pwd" id="sa_user_pass" placeholder="Password" size="20" required=""></div>
  <div class="checkbox login-remember"><label><input type="checkbox" name="sa_remember" id="sa-remember-me" value="TRUE"> Remember me</label></div><button type="submit" id="sa-login" class="btn btn-default ">LOGIN</button>
  <div class="form-group forgot-pwd">
    <p class="forgot-pwd-link">
      <a href="https://siliconangle.com/wp-login.php?action=lostpassword&amp;redirect_to=https%3A%2F%2Fsiliconangle.com%2F2022%2F04%2F05%2Fdremio-reveals-metadata-operations-helping-orgs-reach-true-data-code-paradigm-awsshowcases2e2%2F">Forgot Password?</a>
    </p>
  </div>
</form>

POST

<form class="sa_registration_form sa_form" role="form" method="post">
  <div class="form-field-wrapper">
    <div class="alert alert-danger hidden">...</div>
    <div class="form-group"><label for="sa_register_user_Login"></label><input name="sa_register_user_login" class="sa_user_login" placeholder="Username" type="text" data-toggle="tooltip" data-placement="top"
        title="Only numbers and lowercase letters allowed" required=""></div>
    <div class="form-group"><label for="sa_register_user_email"></label><input name="sa_register_user_email" class="sa_user_email" placeholder="Email" type="email" required=""></div>
    <div class="form-group"><label for="sa_user_first"></label><input name="sa_register_user_first" class="sa_user_first" placeholder="First name" type="text" required=""></div>
    <div class="form-group"><label for="sa_user_last"></label><input name="sa_register_user_last" class="sa_user_last" placeholder="Last name" type="text" required=""></div>
    <div class="form-group"><label for="password"></label><input name="sa_register_user_pass" class="sa_password" placeholder="Password" type="password" required=""></div>
  </div>
  <div class="recaptcha-wrapper hidden">
    <div class="alert alert-warning hidden">...</div>
    <div class="form-group">
      <div class="g-recaptcha" data-sitekey="6LcyJTMUAAAAAGG1jQUhr9xLgvPaLHuvFrgIuU7E">
        <div style="width: 304px; height: 78px;">
          <div><iframe title="reCAPTCHA"
              src="https://www.google.com/recaptcha/api2/anchor?ar=1&amp;k=6LcyJTMUAAAAAGG1jQUhr9xLgvPaLHuvFrgIuU7E&amp;co=aHR0cHM6Ly9zaWxpY29uYW5nbGUuY29tOjQ0Mw..&amp;hl=de&amp;v=QENb_qRrX0-mQMyENQjD6Fuj&amp;size=normal&amp;cb=qba1ml4hs0b2"
              width="304" height="78" role="presentation" name="a-k3x44rfx95vf" frameborder="0" scrolling="no"
              sandbox="allow-forms allow-popups allow-same-origin allow-scripts allow-top-navigation allow-modals allow-popups-to-escape-sandbox"></iframe></div><textarea id="g-recaptcha-response" name="g-recaptcha-response"
            class="g-recaptcha-response" style="width: 250px; height: 40px; border: 1px solid rgb(193, 193, 193); margin: 10px 25px; padding: 0px; resize: none; display: none;"></textarea>
        </div>
      </div>
    </div>
  </div>
  <div class="form-group"><input class="sign-up" type="submit" value="SIGN UP"><input type="hidden" name="action" value="signup"></div>
</form>

POST

<form class="sa_registration_form sa_form" role="form" method="post">
  <div class="form-field-wrapper">
    <div class="alert alert-danger hidden">...</div>
    <div class="form-group"><label for="sa_register_user_Login"></label><input name="sa_register_user_login" class="sa_user_login" placeholder="Username" type="text" data-toggle="tooltip" data-placement="top"
        title="Only numbers and lowercase letters allowed" required=""></div>
    <div class="form-group"><label for="sa_register_user_email"></label><input name="sa_register_user_email" class="sa_user_email" placeholder="Email" type="email" required=""></div>
    <div class="form-group"><label for="sa_user_first"></label><input name="sa_register_user_first" class="sa_user_first" placeholder="First name" type="text" required=""></div>
    <div class="form-group"><label for="sa_user_last"></label><input name="sa_register_user_last" class="sa_user_last" placeholder="Last name" type="text" required=""></div>
    <div class="form-group"><label for="password"></label><input name="sa_register_user_pass" class="sa_password" placeholder="Password" type="password" required=""></div>
  </div>
  <div class="recaptcha-wrapper hidden">
    <div class="alert alert-warning hidden">...</div>
    <div class="form-group">
      <div class="g-recaptcha" data-sitekey="6LcyJTMUAAAAAGG1jQUhr9xLgvPaLHuvFrgIuU7E">
        <div style="width: 304px; height: 78px;">
          <div><iframe title="reCAPTCHA"
              src="https://www.google.com/recaptcha/api2/anchor?ar=1&amp;k=6LcyJTMUAAAAAGG1jQUhr9xLgvPaLHuvFrgIuU7E&amp;co=aHR0cHM6Ly9zaWxpY29uYW5nbGUuY29tOjQ0Mw..&amp;hl=de&amp;v=QENb_qRrX0-mQMyENQjD6Fuj&amp;size=normal&amp;cb=v13vwaeku0dm"
              width="304" height="78" role="presentation" name="a-cpamixcv9452" frameborder="0" scrolling="no"
              sandbox="allow-forms allow-popups allow-same-origin allow-scripts allow-top-navigation allow-modals allow-popups-to-escape-sandbox"></iframe></div><textarea id="g-recaptcha-response-1" name="g-recaptcha-response"
            class="g-recaptcha-response" style="width: 250px; height: 40px; border: 1px solid rgb(193, 193, 193); margin: 10px 25px; padding: 0px; resize: none; display: none;"></textarea>
        </div><iframe style="display: none;"></iframe>
      </div>
    </div>
  </div>
  <div class="form-group"><input class="sign-up" type="submit" value="SIGN UP"><input type="hidden" name="action" value="signup"></div>
</form>

Text Content

[the voice of enterprise and emerging tech]
 * search
 * Sign In

menu
 * account_circle

 * search

 * Home
 * Cloud
   * Cloud Native
 * AI
 * Security
 * Infra
 * Blockchain
 * Policy
 * Big Data
 * Apps
 * Emerging Tech
 * Iot
 * Women In Tech
 * Wikibon Research
 * Special Reports
 * Video Exclusives
 * CUBE SPECIAL FEATURES
   more_horiz


SHARE
 * 
 * 
 * 
 * 
 * 
 * 

 * 
 * 
 * 
 * 
 * 
 * 

Coverage from SiliconANGLE's livestreaming video studiohelp_outline


UPDATED 15:00 EDT / APRIL 05 2022

BIG DATA


DREMIO REVEALS HOW METADATA OPERATIONS ARE HELPING ORGS REACH A TRUE
DATA-AS-CODE PARADIGM

by Victor Dabrinze

SHARE
 * 
 * 
 * 
 * 
 * 
 * 

 * 
 * 
 * 
 * 
 * 
 * 

Developers are a crucial element in the production and maintenance of digital
products. Whenever they can easily access, manipulate and get creative with the
resources they need, that’s when innovation happens.

Data as code is a paradigm that seeks to expand the frontier for developers, as
well as the technology industry at large. The enterprise has reached a stage in
DevOps where developers are lifting data sets out of production, working them
into code, and subsequently testing them for effectiveness and compatibility.
Basically, data itself is being programmed, and this represents the ideal
concept of data as code, according to Mark Lyons (pictured), vice president of
product management at Dremio Corp.

“You have to do this all through metadata operations so you can control what
version of the data that the individual’s working with and which version of the
data the production systems are seeing, because these data sets are too big,” he
stated.

Lyons spoke with theCUBE industry analyst John Furrier during the AWS Startup
Showcase: “Data as Code — The Future of Enterprise Data and Analytics” event, an
exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They
discussed how metadata operations and platforms like Dremio are helping
companies manage huge datasets. (* Disclosure below.)


EXPANDING AND EXPEDITING THE USE OF DATA

With the data playing field more expansive and easier to access, data engineers,
scientists, analysts and even end-consumers have a lot to gain. In addition to
increased productivity, there’s now room for more groundbreaking experimentation
and the proliferation of use cases.

With the elimination of the need to build entirely new data pipelines, define
new schemas, add columns/data types, etc., engineers, developers and
organizations looking to be data-driven can do a lot more with data at a much
faster pace, according to Lyons. De-risking operations is another benefit to
manipulating data as code, he added.

“You’re not worried about messing up the production system, messing up that
data, having it seen by the end user. With some businesses, data is their
business … going all the way to a consumer, a third party,” Lyons stated.

As time has moved on and with computing becoming more intricate, many mundane
tasks — like iterating artificial intelligence and machine learning algorithms —
have become downright painstaking.

“I think it’s going to change the world, because this stuff was so painful to
do. The data sets had gotten so much bigger as you know, but we were still doing
it in the old way, which was typically moving data around for everyone,” Lyons
explained. “It was copying data down, sampling data and moving data.”

The old paradigm is proving more and more ineffective by the day, and data as
code is set to remediate that.


DATA LAKES ARE COMPLEMENTING, NOT OPPOSING, THE SHIFT

When cloud data lakes came around, distributed file systems like Hadoop and
Snowflake were the mainstay. A few industry analysts even predicted that these
data lakes might not reach their current level of popularity. The technology
showed itself valuable, and now data as code is set to add even more value to
cloud data lakes by overcoming a few of their pressing shortcomings, according
to Lyons.

“The data lakes this time around with the Apache Iceberg table format and what
Dremio’s working on around metadata, these things aren’t going to become data
swamps anymore,” he explained. “They’re actually going to be functional systems
that do inserts and updates into leads. You can see all the commits. You can
time travel them. And all the files are actually managed and optimized so you
have to partition the data.”

With a strong handle on manifest files, the changes happening within files, the
query engines, and other commits, developers are better suited to create a
functional system that isn’t just a “data swamp,” according to Lyons.

There’s a general clamor in the industry for business intelligence tools that
are capable enough to handle the tsunami of data sources businesses have to deal
with, Lyons added.

“From a data sources side, Dremio is very proficient with our Parquet files in
an object store, like we just talked about, but it also can access data in other
relational systems,” he said.

Stay tuned for the complete video interview, part of SiliconANGLE’s and
theCUBE’s coverage of the AWS Startup Showcase: “Data as Code — The Future of
Enterprise Data and Analytics” event.


(* Disclosure: TheCUBE is a paid media partner for the AWS Startup Showcase:
“Data as Code — The Future of Enterprise Data and Analytics” event. Neither
Dremio Corp., the sponsor for theCUBE’s event coverage, nor other sponsors have
editorial control over content on theCUBE or SiliconANGLE.)

PHOTO: SILICONANGLE

--------------------------------------------------------------------------------


A MESSAGE FROM JOHN FURRIER, CO-FOUNDER OF SILICONANGLE:


SHOW YOUR SUPPORT FOR OUR MISSION BY JOINING OUR CUBE CLUB AND CUBE EVENT
COMMUNITY OF EXPERTS. JOIN THE COMMUNITY THAT INCLUDES AMAZON WEB SERVICES AND
AMAZON.COM CEO ANDY JASSY, DELL TECHNOLOGIES FOUNDER AND CEO MICHAEL DELL, INTEL
CEO PAT GELSINGER AND MANY MORE LUMINARIES AND EXPERTS.


JOIN OUR COMMUNITY 

Click here to join the free and open Startup Showcase event.

“TheCUBE is part of re:Invent, you know, you guys really are a part of the
event and we really appreciate your coming here and I know people appreciate
the content you create as well” – Andy Jassy

We really want to hear from you, and we’re looking forward to seeing you at the
event and in theCUBE Club.

Click here to join the free and open Startup Showcase event.

LATEST STORIES

--------------------------------------------------------------------------------



Data security platform startup Veza launches out of stealth with $110M in
funding

Samsung delivers record quarterly revenue on strong memory chip demand

Synopsys buys WhiteHat Security from NTT for $330M

Deepset, creator of the open-source NLP framework Haystack, raises $14M

Hasura's GraphQL Joins allows developers to fetch data from multiple databases
and other sources via a single API

Strategic intelligence platform startup Strider Technologies raises $45M

Data security platform startup Veza launches out of stealth with $110M in
funding

Samsung delivers record quarterly revenue on strong memory chip demand

Synopsys buys WhiteHat Security from NTT for $330M

Deepset, creator of the open-source NLP framework Haystack, raises $14M

Hasura's GraphQL Joins allows developers to fetch data from multiple databases
and other sources via a single API

Strategic intelligence platform startup Strider Technologies raises $45M

prev
next

LATEST STORIES

--------------------------------------------------------------------------------

 * Deepset, creator of the open-source NLP framework Haystack, raises $14M
   
   AI - BY MIKE WHEATLEY . 4 HOURS AGO

 * Hasura's GraphQL Joins allows developers to fetch data from multiple
   databases and other sources via a single API
   
   BIG DATA - BY MIKE WHEATLEY . 5 HOURS AGO

 * Strategic intelligence platform startup Strider Technologies raises $45M
   
   SECURITY - BY DUNCAN RILEY . 15 HOURS AGO

 * Data security platform startup Veza launches out of stealth with $110M in
   funding
   
   SECURITY - BY DUNCAN RILEY . 16 HOURS AGO

 * Samsung delivers record quarterly revenue on strong memory chip demand
   
   INFRA - BY MIKE WHEATLEY . 16 HOURS AGO

 * Synopsys buys WhiteHat Security from NTT for $330M
   
   SECURITY - BY DUNCAN RILEY . 17 HOURS AGO

CUBE EVENT COVERAGE  HELP_OUTLINE

--------------------------------------------------------------------------------



LATEST FROM THECUBE

--------------------------------------------------------------------------------

What to expect at Red Hat Summit 2022: Join theCUBE for live coverage May 10-11
Across the InfiniVerse: Next-gen solid-state array signals Infinidat's next
chapter
Incremental changes add up to major disruptions in cloud culture
Analysts dissect cloud complexities in billing and beyond
Observe poised for growth based on data observability from enterprise apps

DIVE INTO DAVE VELLANTE’S BREAKING ANALYSIS SERIES
help_outline

--------------------------------------------------------------------------------

Does hardware (still) matter?
Dave Vellante's Breaking Analysis: The complete collection
Closing the technology and architectural gaps of data mesh
Ripple effects from the Okta security breach are worse than you think
As danger looms, the C-suite taps the brakes on tech spending

UPCOMING CUBE EVENTS

--------------------------------------------------------------------------------

DELL TECHNOLOGIES WORLD 2022

May 02-06

RED HAT SUMMIT 2022

May 10-12

DOCKERCON 2022

May 10-10

VEEAMON 2022

May 17-19

KUBECON | CLOUDNATIVECON EUROPE 2022

May 18-21
SEE MORE

 *  * PRIVACY POLICY
    * TERMS
    * ABOUT US
    * Sign Up
    * Send us a News tip

 * 2022 SiliconANGLE Media Inc. All rights reserved.

 * JOIN OUR COMMUNITY
   
   * theCUBE
   * Wikibon
   
   

×


SEND US A NEWS TIP

 * Name*
   First Last
 * Type of Pitch*
   Consumer or Enterprise?EnterpriseStartup NewsEmerging Technology
 * Email*
   
 * What's your story?*
   
 * File
   
 * Name
   
   This field is for validation purposes and should be left unchanged.


×
×

SIGN IN

...


Remember me
LOGIN

Forgot Password?

OR

NEW USER? SIGN UP

Continue with Email
...





...


Continue with Social Login
×

SIGN UP

Continue with Email
...





...


Continue with Social Login
×

BIO




ETHICS STATEMENT



×


EXTRACT THE SIGNAL FROM THE NOISE

Like Free Content? Subscribe to follow.

Subscribe



COOKIES

We employ the use of cookies. Find out more.GOT IT!

siliconangle.com Open in urlscan Pro 52.42.53.142 Public Scan

Form analysis 6 forms found in the DOM

GET https://siliconangle.com/

GET https://siliconangle.com/

POST /2022/04/05/dremio-reveals-metadata-operations-helping-orgs-reach-true-data-code-paradigm-awsshowcases2e2/?mkt_tok=MzIxLU9EWC0xMTcAAAGECk_QjWgCwIx5Lc8nT9zLOxf_AOPIA0gMMHP8LXtRP9jKo7iI3Y11JWDbKsVbYpMchrSX_DFRvB9BkhD48ZsY30yQZp3aX2uv9ruUH6HOyb4#gf_1

Name: sa_loginform — POST

POST

POST

Text Content

siliconangle.com Open in urlscan Pro
52.42.53.142 Public Scan

Form analysis
6 forms found in the DOM