When integrating data, you want to harmonize data from different sources — your support, sales, loyalty card systems, etc. — to create a unified 360 view of your customer, partner, or patient. That 360 view is your holy grail. It enables your APIs to access the right data to deliver value, whether it’s to improve customer loyalty, deliver better ads, or comply with GDPR related data requests. That 360 view is where the magic happens.

Unfortunately, achieving that 360 view is quite difficult. The traditional approach of buying a dedicated tool for Master Data Management (MDM) is slow and inaccurate. Not to mention the fact that, according to one report, 76% of MDM projects fail.

MarkLogic’s Smart Mastering is different. It provides the ability to master data quickly and automatically. You don’t have to buy an ineffective, siloed MDM system. It leverages the flexibility of our data modeling approach to quickly build your 360 view in the context of everything it knows. It looks at the multi-layered relationships across all of the data and uses fuzzy logic and AI (relevance scoring, database intelligence, and probabilistic algorithms to be specific) to match related records and provide confidence scores. Based on those scores, related records are merged automatically.

Even more cool, MarkLogic’s Smart Mastering also makes it possible to unmerge records if necessary. Because it all happens in the context of an Operational Data Hub, you can still easily access both the raw data and the harmonized, mastered versions. And it keeps the lineage and provenance so you can look back at all of your changes. No other MDM solution does that. Cool. Very cool.

360 Pat Roberts

Making Sense of Person Entities

MDM exists because of common data inconsistencies. It gets especially tricky when dealing with data about human identity, or “Person” entities in the parlance of MDM.

The data for one customer entity, for example, may appear differently across systems because of misspellings, nicknames, or the existence of multiple accounts. A customer appearing as Pat Richards in one system, may be Patricia Richards or Pat Ricardo in another. Or, what appears to be one entity is actually multiple entities — maybe Pat Richards actually has a son or daughter at the same address who, surprisingly enough, is also named Pat Richards.

These challenges with human identity are constantly occurring in business, and traditional Master Data Management (MDM) technology is simply terrible at fixing them. To make sense of it all, you need to re-think your approach to these challenges because without a 360 view, you won’t be able to serve your customers and achieve the business results you want.

Why Does Traditional MDM Fail?

Besides being too simplistic in how they match and merge data, traditional MDM tools run into a whole host of other problems.

  • Slow to implement — Complex data modeling and ETL must all be done up front
  • Too simplistic — Non-AI driven models are riddled with inaccuracies, sometimes as high as 80%
  • No unmerge — Survivorship rules determine which record to keep, and the loser dies forever
  • Weak governance — Provenance timestamps on every table are difficult to model and slow to query
  • More silos — Requires re-engineering to include an MDM tool, operational access, and data warehouse
  • Not trusted — Each additional silo adds another endpoint which adds security risk

Smart Mastering in a MarkLogic Data Hub

The Smarter Approach? Smart Mastering in a Data Hub

MarkLogic was designed as a database for integrating data, and it so happens that it is also very good for doing MDM with Smart Mastering. But, it’s not a separate solution, it’s a feature of the MarkLogic Operational Data Hub that you can leverage as part of the hub.
Secure, Governed

Your data is safe in MarkLogic, the most secure NoSQL database. And it’s well governed because Smart Mastering is designed to maintain the full provenance and lineage of data — as it is mastered. It is essential to your business when dealing with regulations like GDPR, but it’s also helpful in providing great customer service.

Fast, Lightweight

Data integration projects go 5x faster with MarkLogic. You can expect the same agility with Smart Mastering. And, you don’t have to buy some old legacy MDM product that’s prone to failure. Smart Mastering provides out-of-the box rule configurations, a set of APIs, and a visual interface to get you started quickly.

Smart, Automatic

MarkLogic’s Smart Mastering takes the full context of your data in mind as it matches and merges -automatically. It uses a trust based approach to address duplicate, incomplete, and partial entities. It also allows un-merging when mistakes are made (and they always are with MDM).

We are using MarkLogic as our knowledge base so it has a huge dependency around master data management, reference data, and semantic mapping. We are basically using MarkLogic as much as we can because we trust the capabilities and support we get.”

Sema Ustuntas

Mastering Process in the MarkLogic Data Hub

Mastering Process in a MarkLogic Data Hub

With MarkLogic, you get free re-do’s. First, MarkLogic ingests the data as is and allows for agile modeling. Then, it allows for an iterative process of discovery and refinement. So, if you need to redo something like unmerge or change a rule it’s no problem!

Want to See How Smart Mastering Works

Smart Mastering Video Cover

Get Started with Smart Mastering

Github
Data Hub Framework Repo

Get the code

Github
Smart Mastering Repo

Get the code

github
Smart Mastering Demo

Run the Demo

Feature-Rich and Built for the Enterprise

Explore The Features Connect With An Expert

Stay on top of everything Marklogic.

Be the first to know! News, product information, and events delivered straight to your inbox.

Sign Me Up
This website uses cookies.

By continuing to use this website you are giving consent to cookies being used in accordance with the MarkLogic Privacy Statement.

I Accept