Once you have identified a set of records as duplicates, then the next step is to identify the Golden Record (aka master record). How you define this is dependent on your business. This process can be simple, for example, choose the recently updated record, or it can be more complex by having several complicated criteria that are all dependent on each other.
Here are more examples:
- Choose the recently updated record
- Choose the parent company
- Choose the one with the most recent activity
- Choose the one with the latest order
- Choose the one with the largest orders values in the last 12 months
- Choose the one with where the date of birth is older
- Choose the one with an email address
Often the decision is not as simple as one criterion. It is usually a combination of conditions, for example:
- If one record is a parent of another then choose the parent
- If one record has no activity next to it and the other does, then choose the record with the activity
- If both records have activity in the last 12 months then choose the one with the most recent orders
- If both records have activities later than 12 months then choose the one with the most recent activity
As you can see the scenarios can become complex. However, once these have been defined, you can easily program them to select the Golden Record. If any duplicates fail to have a Golden Record selected then you can manually decide which one is the Golden Record. If the criteria are chosen well, then there should only a small percentage left for manual review.
The complexity to creating a program to automate this process will be dependent on how the data is stored. If it’s a single table or file then it’s relatively simple. If it’s a collection of tables linked like this,
then it requires more thought!
Whether the underlying database is simple or complex, the process of identifying a Golden Record is systematic. The main aim is to automate the process, and minimise any manual review.
If you would like further information on Defining a Golden Record then contact Acuate:
|Telephone:||+44 (0) 20 8799 0360|