www.cio.com
Open in
urlscan Pro
192.0.66.25
Public Scan
URL:
https://www.cio.com/article/190941/what-is-data-architecture-a-framework-for-managing-data.html
Submission: On November 13 via manual from IN — Scanned from US
Submission: On November 13 via manual from IN — Scanned from US
Form analysis
1 forms found in the DOMPOST
<form method="post" id="rr-single-nl-form">
<input type="hidden" id="newsletter_signup_nonce" name="newsletter_signup_nonce" value="44965a6e31"><input type="hidden" name="_wp_http_referer" value="/article/190941/what-is-data-architecture-a-framework-for-managing-data.html">
<div class="newsletter-subscription-small__input">
<div class="email-field">
<input type="email" class="email-field__input" id="rr_nl_user_email" name="rr_nl_user_email" placeholder="Enter your email here">
<div class="email-field__error-message">
<span>Please enter a valid email address</span>
</div>
</div>
</div>
<div class="newsletter-subscription-small__button">
<button class="button" id="rr-single-nl-submit" type="submit" disabled="">Subscribe</button>
</div>
</form>
Text Content
* Topics * Spotlight: AI in Enterprise * Events * Newsletters * Resources * BrandHubs * Videos ABOUT * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters POLICIES * Terms of Service * Privacy Policy * Cookie Policy * Copyright Notice * Member Preferences * About AdChoices * Your California Privacy Rights OUR NETWORK * Computerworld * CSO * InfoWorld * Network World MORE * Awards * Blogs * BrandPosts * Events * Podcasts * Videos * DEMO * Enterprise Buyer’s Guides Close * Analytics * Artificial Intelligence * Generative AI * Business Operations * Careers * Cloud Computing * Data Center * Data Management * Emerging Technology * Enterprise Applications * Industry * IT Leadership * Digital Transformation * IT Strategy * IT Management * Innovation * Diversity and Inclusion * IT Operations * Project Management * Networking * Security * Software Development * Vendors and Providers * Enterprise Buyer’s Guides Back Close AFRICA * Africa AMERICAS * Canada * United States ASIA * ASEAN * India * Middle East * 日本 (Japan) * 대한민국(Korea) EUROPE * España (Spain) * Ireland * Italia (Italy) * Netherlands * United Kingdom OCEANIA * Australia * New Zealand Back Close Popular Topics * IT Leadership * Digital Transformation * Innovation * Data Analytics & AI * Enterprise Applications * Diversity and Inclusion * Search * US-EN * Topics * Spotlight: AI in Enterprise * Events * Newsletters * Resources * BrandHubs * Videos * About * Policies * Our Network * More Back TOPICS * IT Leadership * Digital Transformation * Innovation * Data Analytics & AI * Enterprise Applications * Diversity and Inclusion Back ABOUT * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters Back POLICIES * Terms of Service * Privacy Policy * Cookie Policy * Copyright Notice * Member Preferences * About AdChoices * Your California Privacy Rights Back OUR NETWORK * Computerworld * CSO * InfoWorld * Network World Back MORE * Awards * Blogs * BrandPosts * Events * Podcasts * Videos * DEMO * Enterprise Buyer’s Guides Close Ad HomeIT LeadershipWhat is data architecture? A framework for managing data by Thor Olavsrud * * * * * * WHAT IS DATA ARCHITECTURE? A FRAMEWORK FOR MANAGING DATA Feature Jan 24, 2022 AnalyticsData ManagementData Mining * * * * * * * * * * * * DATA ARCHITECTURE TRANSLATES BUSINESS NEEDS INTO DATA AND SYSTEM REQUIREMENTS AND SEEKS TO MANAGE DATA AND ITS FLOW THROUGH THE ENTERPRISE. Credit: Brandon Mowinkel DATA ARCHITECTURE DEFINITION Data architecture describes the structure of an organization’s logical and physical data assets and data management resources, according to The Open Group Architecture Framework (TOGAF). It is an offshoot of enterprise architecture that comprises the models, policies, rules, and standards that govern the collection, storage, arrangement, integration, and use of data in organizations. An organization’s data architecture is the purview of data architects. DATA ARCHITECTURE GOALS The goal of data architecture is to translate business needs into data and system requirements and to manage data and its flow through the enterprise. Many organizations today are looking to modernize their data architecture as a foundation to fully leverage AI and enable digital transformation. Consulting firm McKinsey Digital notes that many organizations fall short of their digital and AI transformation goals due to process complexity rather than technical complexity. DATA ARCHITECTURE PRINCIPLES According to Joshua Klahr, vice president of product management, core products, at Splunk, and former vice president of product management at AtScale, six principles form the foundation of modern data architecture: 1. Data is a shared asset. A modern data architecture needs to eliminate departmental data silos and give all stakeholders a complete view of the company. 2. Users require adequate access to data. Beyond breaking down silos, modern data architectures need to provide interfaces that make it easy for users to consume data using tools fit for their jobs. 3. Security is essential. Modern data architectures must be designed for security and they must support data policies and access controls directly on the raw data. 4. Common vocabularies ensure common understanding. Shared data assets, such as product catalogs, fiscal calendar dimensions, and KPI definitions, require a common vocabulary to help avoid disputes during analysis. 5. Data should be curated. Invest in core functions that perform data curation (modeling important relationships, cleansing raw data, and curating key dimensions and measures). 6. Data flows should be optimized for agility. Reduce the number of times data must be moved to reduce cost, increase data freshness, and optimize enterprise agility. DATA ARCHITECTURE COMPONENTS A modern data architecture consists of the following components, according to IT consulting firm BMC: More Videos 0 seconds of 30 secondsVolume 0% Press shift question mark to access a list of keyboard shortcuts Keyboard ShortcutsEnabledDisabled Shortcuts Open/Close/ or ? Play/PauseSPACE Increase Volume↑ Decrease Volume↓ Seek Forward→ Seek Backward← Captions On/Offc Fullscreen/Exit Fullscreenf Mute/Unmutem Decrease Caption Size- Increase Caption Size+ or = Seek %0-9 Next Up DEMO Propelix 14:53 Subtitle Settings OffAutomated Captions - en-US Font Color White Font Opacity 100% Font Size 100% Font Family Arial Character Edge None Edge Color Black Background Color Black Background Opacity 50% Window Color Black Window Opacity 0% Reset WhiteBlackRedGreenBlueYellowMagentaCyan 100%75%50%25% 200%175%150%125%100%75%50% ArialCourierGeorgiaImpactLucida ConsoleTahomaTimes New RomanTrebuchet MSVerdana NoneRaisedDepressedUniformDrop Shadow WhiteBlackRedGreenBlueYellowMagentaCyan WhiteBlackRedGreenBlueYellowMagentaCyan 100%75%50%25%0% WhiteBlackRedGreenBlueYellowMagentaCyan 100%75%50%25%0% This ad will end in 26 Live 00:04 00:25 00:30 * Data pipelines. A data pipeline is the process in which data is collected, moved, and refined. It includes data collection, refinement, storage, analysis, and delivery. * Cloud storage. Not all data architectures leverage cloud storage, but many modern data architectures use public, private, or hybrid clouds to provide agility. * Cloud computing. In addition to using cloud for storage, many modern data architectures make use of cloud computing to analyze and manage data. * Modern data architectures use APIs to make it easy to expose and share data. * AI and ML models. AI and ML are used to automate systems for tasks such as data collection, labeling, etc. At the same time, modern data architectures can help organizations unlock the ability to leverage AI and ML at scale. * Data streaming. Data streaming is flowing data continuously from a source to a destination for processing and analysis in real-time or near real-time. * Container orchestration. A container orchestration system such as open-source Kubernetes is often used to automate software deployment, scaling, and management. * Real-time analytics. The goal of many modern data architectures is to deliver real-time analytics, the ability to perform analytics on new data as it arrives in the environment. DATA ARCHITECTURE VS. DATA MODELING According to Data Management Book of Knowledge (DMBOK 2), data architecture defines the blueprint for managing data assets by aligning with organizational strategy to establish strategic data requirements and designs to meet those requirements. On the other hand, DMBOK 2 defines data modeling as, “the process of discovering, analyzing, representing, and communicating data requirements in a precise form called the data model.” While both data architecture and data modeling seek to bridge the gap between business goals and technology, data architecture is about the macro view that seeks to understand and support the relationships between an organization’s functions, technology, and data types. Data modeling takes a more focused view of specific systems or business cases. DATA ARCHITECTURE FRAMEWORKS There are several enterprise architecture frameworks that commonly serve as the foundation for building an organization’s data architecture framework. * DAMA-DMBOK 2. DAMA International’s Data Management Body of Knowledge is a framework specifically for data management. It provides standard definitions for data management functions, deliverables, roles, and other terminology, and presents guiding principles for data management. * Zachman Framework for Enterprise Architecture. The Zachman Framework is an enterprise ontology created by John Zachman at IBM in the 1980s. The “data” column of the Zachman Framework comprises multiple layers, including architectural standards important to the business, a semantic model or conceptual/enterprise data model, an enterprise/logical data model, a physical data model, and actual databases. * The Open Group Architecture Framework (TOGAF). TOGAF is an enterprise architecture methodology that offers a high-level framework for enterprise software development. Phase C of TOGAF covers developing a data architecture and building a data architecture roadmap. MODERN DATA ARCHITECTURE BEST PRACTICES Modern data architectures must be designed to take advantage of emerging technologies such as artificial intelligence (AI), automation, internet of things (IoT), and blockchain. Dan Sutherland, senior director, technology consulting, Protiviti, says modern data architectures should adhere to the following best practices: * Cloud-native. Modern data architectures should be designed to support elastic scaling, high availability, end-to-end security for data in motion and data at rest, and cost and performance scalability. * Scalable data pipelines. To take advantage of emerging technologies, data architectures should support real-time data streaming and micro-batch data bursts. * Seamless data integration. Data architectures should integrate with legacy applications using standard API interfaces. They should also be optimized for sharing data across systems, geographies, and organizations. * Real-time data enablement. Modern data architectures should support the ability to deploy automated and active data validation, classification, management, and governance. * Decoupled and extensible. Modern data architectures should be designed to be loosely coupled, enabling services to perform minimal tasks independent of other services. DATA ARCHITECTURE ROLES Here are some of the most popular job titles related to data architecture and the average salary for each position, according to data from PayScale: * Data architect: $79K-$160K * Project manager: $58K-$129K * Solutions architect: $76K-$163K * Data engineer: $66K-$132K * Data analyst: $45K-$87K * Data scientist: $68K-$136K RELATED CONTENT * * feature BAYER CROP SCIENCE BLENDS GEN AI AND DATA SCIENCE FOR INNOVATIVE EDGE Bayer’s agricultural division is developing a new AWS-based data science platform infused with generative AI capabilities that will help spur ‘novel’ agricultural solutions. By Paula Rooney Aug 23, 2024 8 mins Agriculture Industry Generative AI Data Science * feature THE TOP 9 DATA ANALYTICS CERTIFICATIONS With data analysts in high demand, being able to show greater worth can only be an advantage in a competitive job market. Here are the certifications that will give your career an edge. By Thor Olavsrud Jul 09, 2024 7 mins Certifications Data Mining Data Science * news SAP AND NVIDIA EXPAND PARTNERSHIP TO AID CUSTOMERS WITH GEN AI SAP is embedding Nvidia’s generative AI foundry service into SAP Datasphere, SAP BTP, RISE with SAP, and SAP’s enterprise applications portfolio to equip customers with greater and more simplified access to the technology. By Thor Olavsrud Mar 18, 2024 4 mins Generative AI Nvidia SAP * feature DECISION SUPPORT SYSTEMS: DRIVE BETTER DECISION-MAKING WITH DATA Decision support systems are a subset of business intelligence aimed at helping organizations make informed business decisions based on vast troves of analyzed data. By Thor Olavsrud Jan 29, 2024 9 mins Data Science * PODCASTS * VIDEOS * RESOURCES * EVENTS SUBSCRIBE TO OUR NEWSLETTER FROM OUR EDITORS STRAIGHT TO YOUR INBOX Get started by entering your email address below. Please enter a valid email address Subscribe SHOW ME MORE PopularArticlesPodcastsVideos brandpost Sponsored by IDC BREAKING DOWN SILOS: STRATEGIES FOR CIOS TO FOSTER CROSS-FUNCTIONAL COLLABORATION By Serge Findling, IDC adjunct research advisor Nov 12, 20248 mins IT Leadership brandpost Sponsored by Nerdio HOW TO MITIGATE SOFTWARE LICENSING SURPRISES By Pete Bartolik Nov 12, 20244 mins Cloud ComputingEnterprise ApplicationsIT Leadership brandpost Sponsored by Rimini Street HOW DBAS CAN TAKE ON A MORE STRATEGIC ROLE By Whitney Cwirka Nov 12, 20244 mins IT Leadership podcast CIO LEADERSHIP LIVE INDIA WITH JOE DIFONZO, CIO, SABRE CORPORATION Nov 10, 202426 mins CIOCIO Leadership Live podcast CIO LEADERSHIP LIVE WITH SARAH BETADAM, CIO, CISO, NOVANTA Nov 08, 202424 mins CIO Leadership Live podcast EXTREME NETWORKS’ NABIL BUKHARI ON WHY YOUR AI STRATEGY IS FAILING Nov 06, 202464 mins IT Leadership video CIO LEADERSHIP LIVE MIDDLE EAST WITH HEAD OF IT SECURITY, COMPLIANCE AND PROJECTS AT TOTAL ENERGIES Nov 10, 20249 mins CIO Leadership Live video CIO LEADERSHIP LIVE INDIA WITH JOE DIFONZO, CIO, SABRE CORPORATION Nov 10, 202426 mins CIOCIO Leadership Live video CIO LEADERSHIP LIVE WITH SARAH BETADAM, CIO, CISO, NOVANTA Nov 08, 202424 mins CIO Leadership Live Sponsored Links * Everybody's ready for AI except your data. Unlock the power of AI with Informatica * Move your business forward with PC’s powered by Snapdragon X Series About * About Us * Advertise * Contact Us * Foundry Careers * Reprints * Newsletters * BrandPosts Policies * Terms of Service * Privacy Policy * Cookie Policy * Copyright Notice * Member Preferences * About AdChoices * Your California Privacy Rights * Privacy Settings Our Network * Computerworld * CSO * Infoworld * Network World * LinkedIn * X * Facebook Copyright © 2024 IDG Communications, Inc. Go to mobile version CIO WANTS TO SHOW YOU NOTIFICATIONS -------------------------------------------------------------------------------- YOU CAN TURN OFF NOTIFICATIONS AT ANY TIME FROM YOUR BROWSER Accept Do not accept POWERED BY SUBSCRIBERS