Data warehouse and other developers have long awaited common metadata management and interchange mechanisms broadly supported by vendors of information supply-chain (ISC) development tools. Such mechanisms would increase productivity by making definitional metadata more reusable and available. As ISC efforts evolve from departmentally instantiated business solutions to integrated, enterprise-level initiatives supporting a new breed of mission-critical business solutions (such as customer relationship management, business process management, enterprise resource management/planning, and supply-chain management), definitional consistency has become a requisite for their success. In the e-commerce world, effective metadata interchange will be necessary to communicate information using the preferred proprietary hierarchies and categories of each enterprises partners, suppliers, and customers. Moreover, by years end the reach of these solutions will extend to as many as 10 times the number of intra-enterprise users compared to last year. (See Meta Groups 1999 Data Warehouse Marketing Trends/Opportunities industry study.) After that, they will reach extra-enterprise users (customers, suppliers, and partners) as well. This new diverse assemblage of end users will require sophisticated means to assist them in navigating information sources and customizing content delivery. Even by 2001, a single metamodel standard will still not be widely accepted nor implemented, but batch metadata interchange mechanisms will abound that broker proprietary format metadata among application development and end-user tools. These interchange facilities, based on XML, will evolve to realtime interoperability in 2002 or 03 to supplant most batch interchange interfaces.
For several years, developers and vendors have glumly watched the two major metadata standards bodies, the Meta Data Coalition and the Object Management Group, jockey to define and promote metamodel and metadata interchange standards. (See Table 1, for a comparison of current standards.) Founding and participating organizations, including extract/transform/load/manage (ETLM) tool vendors, OLAP tool vendors, and major players such as IBM, Microsoft, and Oracle, have strongly promoted their own ideas, many unbefitting to an acceptable industrywide standard for enterprise metadata management.
The recent Object Management Group ratification of the Common Warehouse Model (CWM) specification, however, represents a major step toward improved data, application, and process integration. Enterprises struggling to capture and synchronize data definitions, simplify inter-application data mobility, and track information as it flows through their information supply chain eventually will benefit from metadata standards such as CWM. Through mid-2001, exclusive metadata interchange standards in the data warehouse and analytical application domain (Informaticas MX2, Informixs MetaStage, and the Microstrategy-NetGenesis API, for example) will dissipate in favor of CWM or its opposing Open Information Model (OIM) standard from the Meta Data Coalition. During this time, even the Object Management Groups contributing vendors will struggle to fully implement CWM, instead offering only XMI (CWMs XML data type definition) interchange product features and vendor enablement kits, including libraries of Java interfaces that abstract away direct XMI coding. By 2002, the first fully CWM-based technologies will appear, but customers should remain indifferent to the underlying schema of products as long as the products support accepted metadata interchange standards. (See Meta Group Research Note ADS835, Common Data Models Are for Commoners.) By 2004, robust federated metadata networks will emerge that provide ubiquitous metadata interchange among information supply-chain tools and include publish/subscribe along with traditional repository services, such as impact analysis, devoid of the need for a central metadata repository. (See ADS825, Metadata Maelstrom Sinks Standards and Repositories.)
Metamodel Scope and SupportUnlike MDCs most recent specification released in 1999, CWM is the result of a pragmatic collaborative effort among OMG contributors (including Oracle, IBM, Hyperion, Unysis, and NCR) and a significant cluster of private industries. CWM leverages parts of OIM, although supporters position the two standards distinctly, and both are specified in the Unified Modeling Language. Also, each specifies divergent metadata interchange XML data type definitions. IT professionals must remember that the CWM scope is limited to metadata relevant to data warehousing and analytic applications, while the OIM schema is declared capable of handling knowledge management and business-process constructs. Therefore, enterprises considering panoramic metadata and repository initiatives may find CWM limiting, though more broadly supported. IT shops tending toward one or more of the CWM collaborators may find solace in the ability to create Extended CWM (CWMX) model extensions. Microsoft shops, on the other hand, will find comfort in the OIM specification because Microsoft contributed the original version (which subsequently has been retooled and stripped of platform-specific constructs), and continues to support it via Microsoft Repository. In evolving the metadata specifications through 2002, the standards bodies will include test benches, certification criteria (for both schema and interchange implementation), certification services, and intersections with existing scheduling and transport services that would enable federated metadata networks.
Revamping the Value of Metadata
Metadata management has long been advocated as a critical component of the data warehouse infrastructure, and more recently been branded as beneficial to analytic application users. Meta Groups recent Data Warehouse Scorecard and Cost of Ownership industry study quantified the enormous effect metadata has on the overall success of data warehouse initiatives. (Seventy-five percent of highly successful data warehouse initiatives include formal metadata management facilities.) Still, in the heat of a typical data warehouse battle, rarely is metadata seen on the front line. If the tired, old card catalog analogy fails to get management enthused about the value of metadata, consider the notion that metadata is an enterprises digital DNA. (See Figure 1.) Metadata specifications such as CWM and OIM are tools for expressing the enterprise genome and mapping the relationships among all data, applications, processes, and resources. Such mappings help enterprises understand their infrastructure, architecture, and operations, letting them mutate or be spliced (with business partners or merging businesses) for improved business performance.
Erstwhile metadata nomenclature includes classifications such as technical, business, and operational metadata. These classes, however, fail to speak to the value of metadata. (See Table 2.) In line with the digital DNA theme, Meta Groups research finds that comprehensive metadata solutions comprise:
Definitional metadata that expresses the meaning of enterprise objects (whether they are data, applications, processes, or resources) to ensure their consistent usage and interchange throughout an enterprise and its evolution. Definitional metadata fosters improved understanding of information sources. Navigational metadata that provides links and expresses relationships between enterprise objects to ensure their accessibility and ease of use. Navigational metadata helps locate information as the information supply chain evolves. Administrative metadata that captures the lineage, use, and transformation of enterprise objects over time to ensure their performance and integrity. Administrative metadata builds trust and confidence in information sources. Through 2005, lines continue to blur between enterprises (due to vertical integration and electronic marketplaces), information sources (due to widespread Web-based information portioning), business processes (due to increasingly integrated commerce chains and networks), and applications (due to component-based development and application service providers). A formal understanding of these enterprise objects will enable improved business agility and ensure ongoing survival. For IT organizations, metadata interchange standards will drive improved reuse, freedom of tool choice, and application delivery performance. Emergent metadata standards vary in their applicability, based on an enterprises existing infrastructure and its overall metadata objectives. Even as these standards include rigorous schema definitions, IT organizations should be conscious only of vendor plans for implementing the XML interchange elements of the specification and the breadth of their own metadata management solutions. Line-of-business management must learn to appreciate metadatas importance as the enterprises digital DNA, understanding that a complete enterprise genome mapping will inevitably improve organizational health and longevity.
ALPHABET SOUP METADATA-RELATED ACRONYMS AND DEFINITIONS
Doug Laney (doug.laney@metagroup.com) is vice president of Meta Groups Application Delivery Strategies service, leading Meta Groups industry research of data warehousing, analytic applications, data quality, information architecture, and metadata management.
| Most Popular This Week
IE Weekly Newsletter
Subscribe to the newsletter
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||























