Key Questions to Ask During Master Data Consolidations
Typical master data consolidation starts with combining the operational master records from all the data silos where they exist. The key aspect being, creation of master data indexes to support single view; knowing and asking right questions during this phase can save lot of time and rework.
In an earlier post on this blog, I examined the ways in which we can identify the right sources of Master Data. Once these data sources are identified, next step is to select the right data elements from them, which confront to the definition of master data.
Some of the characteristics of this exercise are –
- Finalizing the core data elements, which constitute the master data entities.
- Classifying and standardizing common attributes, which are managed by individual silo systems and may bear different meanings at the onset but represent same element.
- Identifying the reference data sets (both internal and external) and mapping them to comprehensible list of enterprise wide accessible codes.
- Isolating the known inaccuracies in the data, especially the ones that are causing costly damage.
- Measuring the quality of the data by using data profiling and discovery tools.
- Recognizing and defining complex relationships between key master data entities.
- Determining the fetch mechanism to gather initial and delta changes from variety of data sources.
- Coming up with a strategy to extract data into master data hub using an iterative, repeatable process.
- Creating a framework for fixing duplicated data, error processing and exception handling.
To be able to do all of these activities, we need to have a good understanding of sources of master data. Section below, lists key questions that need to be asked and answered towards addressing aforesaid aspects.
- What are the key entities that the source system manage and require for smooth functioning?
- What are the essential elements that constitute each of the entities listed above?
- What is the business name of a given data element? What does the element mean and what does it represent?
- What is the format and length of each of the data elements? Are rules and logic defined to ensure the values adhere to the definition of the field.
- Is data element a mandatory field? Conditionally required? A derived value? Has a default value?
- If an element is referenced by a code lookup, what are the possible values?
- In case of reference codes, is there a central reference data repository that can manage this data?
- Are there any requirements for logical grouping of the data elements?
- How are different entities linked with each other? What is the cardinality of the relationship?
- How are these master data elements created, read, updated, searched and deleted?
- What are the ways in which data can be extracted from the source? (Replication based, Time Stamp based, Table comparison, Log based etc.)
- What is the frequency in which data can be synchronized to master data hub? Can system support real time invocation of services?
- What is the estimated number of records for initial and delta load? What is the rate of increase year-on-year?
While this list is not exhaustive, it sure gives us a starting point on the right questions to ask during this commonly occurring practice during MDM endeavor.
What do you think? Please share your thoughts via comments.
Image courtesy of twobee/FreeDigitalPhotos.net
COMMENTS
Leave A Comment
RECENT POSTS
Composable Applications Explained: What They Are and Why They Matter
Composable applications are customized solutions created using modular services as the building blocks. Like how...
Is ChatGPT a Preview to the Future of Astounding AI Innovations?
By now, you’ve probably heard about ChatGPT. If you haven’t kept up all the latest...
How MDM Can Help Find Jobs, Provide Better Care, and Deliver Unique Shopping Experiences
Industrial data is doubling roughly every two years. In 2021, industries created, captured, copied, and...
Nice set of questions!
Two things that I try to do in a consolidation context (and in general) are:
1. Thinking about the downstreams systems (those that will consume the consolidated data).
2. Thinking one level beyond the immediate master data publishers/consumers, if this applies. Sometimes, you have a cascade of data going through applications and systems and ultimately into the master data source. The whole cascade should also be looked at.
This leads to extending this list of questions to include more applications than the simple “master data publishers”.
Hi,
Thanks for the article.
How do you choose between deterministic and probabilistic matching during consolidation?
Best regards
[…] of user-friendly, low-code integration tools that help you manage various […]