www.cio.com Open in urlscan Pro
192.0.66.25  Public Scan

URL: https://www.cio.com/article/190941/what-is-data-architecture-a-framework-for-managing-data.html
Submission: On November 13 via manual from IN — Scanned from US

Form analysis 1 forms found in the DOM

POST

<form method="post" id="rr-single-nl-form">
  <input type="hidden" id="newsletter_signup_nonce" name="newsletter_signup_nonce" value="44965a6e31"><input type="hidden" name="_wp_http_referer" value="/article/190941/what-is-data-architecture-a-framework-for-managing-data.html">
  <div class="newsletter-subscription-small__input">
    <div class="email-field">
      <input type="email" class="email-field__input" id="rr_nl_user_email" name="rr_nl_user_email" placeholder="Enter your email here">
      <div class="email-field__error-message">
        <span>Please enter a valid email address</span>
      </div>
    </div>
  </div>
  <div class="newsletter-subscription-small__button">
    <button class="button" id="rr-single-nl-submit" type="submit" disabled="">Subscribe</button>
  </div>
</form>

Text Content

 * Topics
 * Spotlight: AI in Enterprise
 * Events
 * Newsletters
 * Resources
 * BrandHubs
 * Videos




ABOUT

 * About Us
 * Advertise
 * Contact Us
 * Foundry Careers
 * Reprints
 * Newsletters


POLICIES

 * Terms of Service
 * Privacy Policy
 * Cookie Policy
 * Copyright Notice
 * Member Preferences
 * About AdChoices
 * Your California Privacy Rights


OUR NETWORK

 * Computerworld
 * CSO
 * InfoWorld
 * Network World


MORE

 * Awards
 * Blogs
 * BrandPosts
 * Events
 * Podcasts
 * Videos
 * DEMO
 * Enterprise Buyer’s Guides

Close
 * Analytics
 * Artificial Intelligence
 * Generative AI
 * Business Operations
 * Careers
 * Cloud Computing
 * Data Center
 * Data Management
 * Emerging Technology
 * Enterprise Applications
 * Industry
 * IT Leadership

 * Digital Transformation
 * IT Strategy
 * IT Management
 * Innovation
 * Diversity and Inclusion
 * IT Operations
 * Project Management
 * Networking
 * Security
 * Software Development
 * Vendors and Providers
 * Enterprise Buyer’s Guides

Back
Close


AFRICA

 * Africa


AMERICAS

 * Canada
 * United States


ASIA

 * ASEAN
 * India
 * Middle East
 * 日本 (Japan)
 * 대한민국(Korea)


EUROPE

 * España (Spain)
 * Ireland
 * Italia (Italy)
 * Netherlands
 * United Kingdom


OCEANIA

 * Australia
 * New Zealand

Back
Close
Popular Topics
 * IT Leadership
 * Digital Transformation
 * Innovation

 * Data Analytics & AI
 * Enterprise Applications
 * Diversity and Inclusion

 * Search
 * US-EN

 * Topics
 * Spotlight: AI in Enterprise
 * Events
 * Newsletters
 * Resources
 * BrandHubs
 * Videos
 * About
 * Policies
 * Our Network
 * More

Back


TOPICS

 * IT Leadership
 * Digital Transformation
 * Innovation
 * Data Analytics & AI
 * Enterprise Applications
 * Diversity and Inclusion

Back


ABOUT

 * About Us
 * Advertise
 * Contact Us
 * Foundry Careers
 * Reprints
 * Newsletters

Back


POLICIES

 * Terms of Service
 * Privacy Policy
 * Cookie Policy
 * Copyright Notice
 * Member Preferences
 * About AdChoices
 * Your California Privacy Rights

Back


OUR NETWORK

 * Computerworld
 * CSO
 * InfoWorld
 * Network World

Back


MORE

 * Awards
 * Blogs
 * BrandPosts
 * Events
 * Podcasts
 * Videos
 * DEMO
 * Enterprise Buyer’s Guides



Close Ad

HomeIT LeadershipWhat is data architecture? A framework for managing data
by Thor Olavsrud
 * 
 * 
 * 
 * 
 * 
 * 


WHAT IS DATA ARCHITECTURE? A FRAMEWORK FOR MANAGING DATA

Feature
Jan 24, 2022
AnalyticsData ManagementData Mining
 * 
 * 
 * 
 * 
 * 
 * 

 * 
 * 
 * 
 * 
 * 
 * 





DATA ARCHITECTURE TRANSLATES BUSINESS NEEDS INTO DATA AND SYSTEM REQUIREMENTS
AND SEEKS TO MANAGE DATA AND ITS FLOW THROUGH THE ENTERPRISE.



Credit: Brandon Mowinkel


DATA ARCHITECTURE DEFINITION

Data architecture describes the structure of an organization’s logical and
physical data assets and data management resources, according to The Open Group
Architecture Framework (TOGAF). It is an offshoot of enterprise architecture
that comprises the models, policies, rules, and standards that govern the
collection, storage, arrangement, integration, and use of data in organizations.
An organization’s data architecture is the purview of data architects.


DATA ARCHITECTURE GOALS

The goal of data architecture is to translate business needs into data and
system requirements and to manage data and its flow through the enterprise. Many
organizations today are looking to modernize their data architecture as a
foundation to fully leverage AI and enable digital transformation. Consulting
firm McKinsey Digital notes that many organizations fall short of their digital
and AI transformation goals due to process complexity rather than technical
complexity.


DATA ARCHITECTURE PRINCIPLES

According to Joshua Klahr, vice president of product management, core products,
at Splunk, and former vice president of product management at AtScale, six
principles form the foundation of modern data architecture:


 1. Data is a shared asset. A modern data architecture needs to eliminate
    departmental data silos and give all stakeholders a complete view of the
    company.
 2. Users require adequate access to data. Beyond breaking down silos, modern
    data architectures need to provide interfaces that make it easy for users to
    consume data using tools fit for their jobs.
 3. Security is essential. Modern data architectures must be designed for
    security and they must support data policies and access controls directly on
    the raw data.
 4. Common vocabularies ensure common understanding. Shared data assets, such as
    product catalogs, fiscal calendar dimensions, and KPI definitions, require a
    common vocabulary to help avoid disputes during analysis.
 5. Data should be curated. Invest in core functions that perform data curation
    (modeling important relationships, cleansing raw data, and curating key
    dimensions and measures).
 6. Data flows should be optimized for agility. Reduce the number of times data
    must be moved to reduce cost, increase data freshness, and optimize
    enterprise agility.


DATA ARCHITECTURE COMPONENTS

A modern data architecture consists of the following components, according to IT
consulting firm BMC:

More Videos


0 seconds of 30 secondsVolume 0%


Press shift question mark to access a list of keyboard shortcuts
Keyboard ShortcutsEnabledDisabled
Shortcuts Open/Close/ or ?
Play/PauseSPACE
Increase Volume↑
Decrease Volume↓
Seek Forward→
Seek Backward←
Captions On/Offc
Fullscreen/Exit Fullscreenf
Mute/Unmutem
Decrease Caption Size-
Increase Caption Size+ or =
Seek %0-9


Next Up
DEMO Propelix
14:53
Subtitle Settings
OffAutomated Captions - en-US
Font Color
White

Font Opacity
100%

Font Size
100%

Font Family
Arial

Character Edge
None

Edge Color
Black

Background Color
Black

Background Opacity
50%

Window Color
Black

Window Opacity
0%

Reset
WhiteBlackRedGreenBlueYellowMagentaCyan
100%75%50%25%
200%175%150%125%100%75%50%
ArialCourierGeorgiaImpactLucida ConsoleTahomaTimes New RomanTrebuchet MSVerdana
NoneRaisedDepressedUniformDrop Shadow
WhiteBlackRedGreenBlueYellowMagentaCyan
WhiteBlackRedGreenBlueYellowMagentaCyan
100%75%50%25%0%
WhiteBlackRedGreenBlueYellowMagentaCyan
100%75%50%25%0%

This ad will end in 26
Live
00:04
00:25
00:30







 
 * Data pipelines. A data pipeline is the process in which data is collected,
   moved, and refined. It includes data collection, refinement, storage,
   analysis, and delivery.
 * Cloud storage. Not all data architectures leverage cloud storage, but many
   modern data architectures use public, private, or hybrid clouds to provide
   agility.
 * Cloud computing. In addition to using cloud for storage, many modern data
   architectures make use of cloud computing to analyze and manage data.
 * Modern data architectures use APIs to make it easy to expose and share data.
 * AI and ML models. AI and ML are used to automate systems for tasks such as
   data collection, labeling, etc. At the same time, modern data architectures
   can help organizations unlock the ability to leverage AI and ML at scale.
 * Data streaming. Data streaming is flowing data continuously from a source to
   a destination for processing and analysis in real-time or near real-time.
 * Container orchestration. A container orchestration system such as open-source
   Kubernetes is often used to automate software deployment, scaling, and
   management.
 * Real-time analytics. The goal of many modern data architectures is to deliver
   real-time analytics, the ability to perform analytics on new data as it
   arrives in the environment.


DATA ARCHITECTURE VS. DATA MODELING

According to Data Management Book of Knowledge (DMBOK 2), data architecture
defines the blueprint for managing data assets by aligning with organizational
strategy to establish strategic data requirements and designs to meet those
requirements. On the other hand, DMBOK 2 defines data modeling as, “the process
of discovering, analyzing, representing, and communicating data requirements in
a precise form called the data model.”

While both data architecture and data modeling seek to bridge the gap between
business goals and technology, data architecture is about the macro view that
seeks to understand and support the relationships between an organization’s
functions, technology, and data types. Data modeling takes a more focused view
of specific systems or business cases.




DATA ARCHITECTURE FRAMEWORKS

There are several enterprise architecture frameworks that commonly serve as the
foundation for building an organization’s data architecture framework.

 * DAMA-DMBOK 2. DAMA International’s Data Management Body of Knowledge is a
   framework specifically for data management. It provides standard definitions
   for data management functions, deliverables, roles, and other terminology,
   and presents guiding principles for data management.
 * Zachman Framework for Enterprise Architecture. The Zachman Framework is an
   enterprise ontology created by John Zachman at IBM in the 1980s. The “data”
   column of the Zachman Framework comprises multiple layers, including
   architectural standards important to the business, a semantic model or
   conceptual/enterprise data model, an enterprise/logical data model, a
   physical data model, and actual databases.
 * The Open Group Architecture Framework (TOGAF). TOGAF is an enterprise
   architecture methodology that offers a high-level framework for enterprise
   software development. Phase C of TOGAF covers developing a data architecture
   and building a data architecture roadmap.


MODERN DATA ARCHITECTURE BEST PRACTICES

Modern data architectures must be designed to take advantage of emerging
technologies such as artificial intelligence (AI), automation, internet of
things (IoT), and blockchain. Dan Sutherland, senior director, technology
consulting, Protiviti, says modern data architectures should adhere to the
following best practices:

 * Cloud-native. Modern data architectures should be designed to support elastic
   scaling, high availability, end-to-end security for data in motion and data
   at rest, and cost and performance scalability.
 * Scalable data pipelines. To take advantage of emerging technologies, data
   architectures should support real-time data streaming and micro-batch data
   bursts.
 * Seamless data integration. Data architectures should integrate with legacy
   applications using standard API interfaces. They should also be optimized for
   sharing data across systems, geographies, and organizations.
 * Real-time data enablement. Modern data architectures should support the
   ability to deploy automated and active data validation, classification,
   management, and governance.
 * Decoupled and extensible. Modern data architectures should be designed to be
   loosely coupled, enabling services to perform minimal tasks independent of
   other services.


DATA ARCHITECTURE ROLES

Here are some of the most popular job titles related to data architecture and
the average salary for each position, according to data from PayScale:


 * Data architect: $79K-$160K
 * Project manager: $58K-$129K
 * Solutions architect: $76K-$163K
 * Data engineer: $66K-$132K
 * Data analyst: $45K-$87K
 * Data scientist: $68K-$136K


RELATED CONTENT

 * 
 * feature
   
   BAYER CROP SCIENCE BLENDS GEN AI AND DATA SCIENCE FOR INNOVATIVE EDGE
   
   Bayer’s agricultural division is developing a new AWS-based data science
   platform infused with generative AI capabilities that will help spur ‘novel’
   agricultural solutions.
   By Paula Rooney
   Aug 23, 2024 8 mins
   Agriculture Industry Generative AI Data Science
 * feature
   
   THE TOP 9 DATA ANALYTICS CERTIFICATIONS
   
   With data analysts in high demand, being able to show greater worth can only
   be an advantage in a competitive job market. Here are the certifications that
   will give your career an edge.
   By Thor Olavsrud
   Jul 09, 2024 7 mins
   Certifications Data Mining Data Science
 * news
   
   SAP AND NVIDIA EXPAND PARTNERSHIP TO AID CUSTOMERS WITH GEN AI
   
   SAP is embedding Nvidia’s generative AI foundry service into SAP Datasphere,
   SAP BTP, RISE with SAP, and SAP’s enterprise applications portfolio to equip
   customers with greater and more simplified access to the technology.
   By Thor Olavsrud
   Mar 18, 2024 4 mins
   Generative AI Nvidia SAP
 * feature
   
   DECISION SUPPORT SYSTEMS: DRIVE BETTER DECISION-MAKING WITH DATA
   
   Decision support systems are a subset of business intelligence aimed at
   helping organizations make informed business decisions based on vast troves
   of analyzed data.
   By Thor Olavsrud
   Jan 29, 2024 9 mins
   Data Science

 * PODCASTS
 * VIDEOS
 * RESOURCES
 * EVENTS


SUBSCRIBE TO OUR NEWSLETTER


FROM OUR EDITORS STRAIGHT TO YOUR INBOX

Get started by entering your email address below.
Please enter a valid email address
Subscribe


SHOW ME MORE

PopularArticlesPodcastsVideos
brandpost Sponsored by IDC

BREAKING DOWN SILOS: STRATEGIES FOR CIOS TO FOSTER CROSS-FUNCTIONAL
COLLABORATION

By Serge Findling, IDC adjunct research advisor
Nov 12, 20248 mins
IT Leadership

brandpost Sponsored by Nerdio

HOW TO MITIGATE SOFTWARE LICENSING SURPRISES

By Pete Bartolik
Nov 12, 20244 mins
Cloud ComputingEnterprise ApplicationsIT Leadership

brandpost Sponsored by Rimini Street

HOW DBAS CAN TAKE ON A MORE STRATEGIC ROLE

By Whitney Cwirka
Nov 12, 20244 mins
IT Leadership

podcast

CIO LEADERSHIP LIVE INDIA WITH JOE DIFONZO, CIO, SABRE CORPORATION


Nov 10, 202426 mins
CIOCIO Leadership Live

podcast

CIO LEADERSHIP LIVE WITH SARAH BETADAM, CIO, CISO, NOVANTA


Nov 08, 202424 mins
CIO Leadership Live

podcast

EXTREME NETWORKS’ NABIL BUKHARI ON WHY YOUR AI STRATEGY IS FAILING


Nov 06, 202464 mins
IT Leadership

video

CIO LEADERSHIP LIVE MIDDLE EAST WITH HEAD OF IT SECURITY, COMPLIANCE AND
PROJECTS AT TOTAL ENERGIES


Nov 10, 20249 mins
CIO Leadership Live

video

CIO LEADERSHIP LIVE INDIA WITH JOE DIFONZO, CIO, SABRE CORPORATION


Nov 10, 202426 mins
CIOCIO Leadership Live

video

CIO LEADERSHIP LIVE WITH SARAH BETADAM, CIO, CISO, NOVANTA


Nov 08, 202424 mins
CIO Leadership Live



Sponsored Links

 * Everybody's ready for AI except your data. Unlock the power of AI with
   Informatica
 * Move your business forward with PC’s powered by Snapdragon X Series

About

 * About Us
 * Advertise
 * Contact Us
 * Foundry Careers
 * Reprints
 * Newsletters
 * BrandPosts

Policies

 * Terms of Service
 * Privacy Policy
 * Cookie Policy
 * Copyright Notice
 * Member Preferences
 * About AdChoices
 * Your California Privacy Rights
 * Privacy Settings

Our Network

 * Computerworld
 * CSO
 * Infoworld
 * Network World


 * LinkedIn
 * X
 * Facebook

Copyright © 2024 IDG Communications, Inc.
Go to mobile version











CIO WANTS TO SHOW YOU NOTIFICATIONS

--------------------------------------------------------------------------------

YOU CAN TURN OFF NOTIFICATIONS AT ANY TIME FROM YOUR BROWSER

Accept Do not accept

POWERED BY SUBSCRIBERS