Duplicate Management is a Velocify™ feature that must be enabled at the client level by an account manager.
Duplicate Management Function
Duplicate Lead Definition
A lead is considered a duplicate when it refers to an individual already existing in your LeadManager account. Different leads can have a lot of overlapping information, but are not duplicates. For example, two different individuals could have the same address, or even the same name, but should not register in the system as duplicates.
Identifying duplicates can be more reliably performed by using information that is unique to a person such as social security number or email address, or a combination of criteria such as first name, last and zip code.
When your system locates duplicate leads, these are removed from the general queue and will not be distributed to users. Duplicate leads will appear in the Duplicate Reconciliation Report.
To avoid false positives, a user must either confirm or deny that the lead is in fact a duplicate lead, i.e., referring to the same individual.
Reasons for Duplicates
One Lead, Many Providers:
A duplicate lead may enter your system if that same lead has been sold by multiple lead providers. This happens when an individual has completed one on-line form and that lead has been sold by multiple lead providers.
When this occurs, you want to identify duplicates so that you can return them to your providers.
One Lead, Many Submissions:
A duplicate lead may enter your system resulting from a single individual who has submitted their information more than once. For example, an individual completes several on-line forms for different lead providers. Or an individual completed an on-line form in the past and has now completed a new form, indicating renewed interested in your product.
When this occurs, you want to identify duplicates so that you can update an existing lead with the most up-to-date information while preserving historical data about your previous interactions with this individual.
Managing Duplicate Leads
To get started Managing duplicate leads, Click Duplicate Management on the Lead Management submenu
Creating a Duplicate Management Program
The first thing you need to do is to create duplicate management program to determine which leads will be checked for duplicates. On the Duplicate Management Page, click the Add New Program button
Give the program a Title
After clicking Save, additional fields and four new tabs will appear:
- Which incoming leads should be checked?
- What are the rules for identifying duplicates
- Auto Reconciliation Rules
- Merge Rules
The Enabled checkbox and Reconciliation radio button will also appear. Leave these with their default values for now and click the Which incoming leads should be checked? Tab
This tab allows you to configure which leads will be checked by this program upon entering your system. Configuration is done by setting filters. Setting filters here is the same process you would use in creating filters for distribution programs or send conditions for emails.
For example, let’s say you want to check all leads from the state of California for duplicates. Here’s how to set a filter that that catches all leads that enter the system with CA in the state field.
Select State from the Column pulldown
Select Equal to from the Operator pulldown
Select CA from the Value pulldown
Click the Add Filter button
Your filter now appears at the bottom of the form. You may add multiple filters. Only leads meeting all these criteria will be checked for duplicates by this program
In this example, the program will only check leads from California as potential duplicates.
Next click the What are the rules for identifying duplicates? Tab
On this tab, you will configure which fields the program will use to identify duplicate leads
Select criteria from the Available Fields list
Click the Add button
Appearing now in the Identify Duplicates By list, these fields will be compared to determine the presence of duplicate leads
Use the filters on this tab to configure which existing leads you want to check against for duplicates
For example if you do not want to check against leads that are in the Closed status, set the filter “Status - Not Equal to - Closed”
When you are done, click the Return to Programs button
The duplicate Program form has two more tabs; the Auto Reconciliation Rules Tab and the Merge Rules Tab. Those will be covered in a later section of this manual that focuses on automating the de-duplication process. To avoid false positives, it is recommended that when getting started with de-duplication, you manually confirm or deny any duplicate leads that have been identified by your duplicate programs.
Back on the Duplicate Management Programs Page
Click the No link in the Enabled column to toggle the value to Yes
How do you know when you have a duplicate lead?
You can Review duplicate leads in real time, by responding to the Duplicate Lead Alert which pops up in real time, when duplicate leads are found. Or you can review duplicates in larger batches by using the Duplicate Reconciliation Report.
Duplicate Lead Alert
When a duplicate is found within your leads, you will see an alert at the top of the Velocify™ screen.
Click the Review Duplicate Lead button to reconcile the duplicate right away. You can also choose to ignore the alert and reconcile the duplicate at a later time using the Duplicate Reconciliation Report. See the Duplicate Reconciliation Report section of this manual for complete instructions on how to use it.
Duplicate Reconciliation Report
Under the Reporting submenu; Hover over Duplicate Reports and click Reconciliation Report
Running the Report
Note that the default settings for this report include “All Campaigns” and "All Duplicate Programs".
To get more targeted results, you can choose combinations of individual campaigns and duplicate programs.
Choose a date range within which you'll search the leads either by clicking in the date range fields or selecting a value from the Range pulldown. In this example leads entering the system today will be checked for duplicates.
Glick the Go button
Leads flagged as duplicates from the selected campaigns and duplicate programs are returned by the report.
Click a leads Compare link to reconcile it.
The Compare Duplicate form
The Compare Duplicate form gives you a side by side comparison between the new lead and the existing lead.
Fields where duplicate information has been found are highlighted
The system has is showing you how it identified these leads as duplicates. But duplicates must be confirmed or denied manually.
If they shared the same name and state, but lived in different cities and had different email addresses, they you would press the Deny Duplicate button. But these individuals share the same name, address, and email address. These are duplicate leads.
Click the Confirm Duplicate button
Parenting and Merging
The next step is to merge these duplicate leads into one. Merging the duplicate leads is done by selecting a Parent or Primary lead which will subsume the other lead. The default option is to Select the Existing Lead as Parent
More about Parenting/Merging
Parenting is a way of merging the leads while establishing which lead you want to serve as the data foundation.
The default selection is to use the existing lead as the parent, which means: The new lead data will be merged into the existing lead but the logs, and information about how the lead has been worked will remain unchanged.
In some cases, the new lead contains newer, more complete information in some or all fields. In this case, you can capture the new lead data while retaining all the lead log information that has accumulated about how the lead has been worked since it first entered your system.
The Parent Lead serves as the data foundation for the new merged lead. To overwrite information from the child lead to the parent lead, click the check box next to the field to copy the data.
You can select an action to be taken on the lead when the duplicates are merged. You may want to take an action that prepares the lead to be returned or that promotes the lead in the users queue.
Click the "Merge Leads and Take Action" button
Comparing Multiple Duplicates
Note that a duplicate management program may flag multiple duplicates for a lead. When this occurs this number will display the number of duplicates found. In that instance, you would click the Prev and Next buttons to view and confirm/deny all duplicates.
Edit View Lead Page
Click the Duplicate Leads radio button on the View/Edit Lead page to see retained copies of leads were merged with this lead.
Confirmed Duplicate Report
Leads that are identified by the system and confirmed by a user as duplicates will appear in the Confirmed Duplicate Report. This report is useful for returning leads. You can also un-confirm leads if you find you have confirmed them as duplicates in error.
Under the Reporting submenu; Hover over Duplicate Reports and click Confirmed Duplicate Report
Run the report with a particular campaign, or lead source, selected.
These leads are all confirmed duplicates purchased from that single provider.
Press the Export to Excel button to generate a spreadsheet of these leads that you can use to return them.
Un-confirming a mistakenly confirmed duplicate
If you find that leads have mistakenly been confirmed as duplicates, you can un-confirm the duplicate relationship, and the leads will again move through the pipeline as two separate individual leads.
To un-confirm leads that were mistakenly confirmed as duplicates, click the Un-Confirm link.
Click the Un-confirm buttonto terminate the duplicate relationship between the leads.
Automating your Duplicate Reconciliation and Merging
If you decide that you do not need to manually confirm or deny every identified duplicate, you can automate the reconciliation and merging of duplicate leads on a by program basis. Meaning that if you are confident that a particular duplicate program is returning only real duplicates, and no false positives, you can set reconciliation and merge rules for that duplicates identified by that program.
Click Duplicate Management on the Lead Management submenu to return to the Duplicate Program page.
Click the Edit link to edit the program
On the Add/Edit Duplicate Program page, Change the Reconciliation radio button from Manual to Automatic
Click the Auto Reconciliation Rules tab
Use this form to define the rules for automatic duplicate reconciliation
The default values on this form will match an identified duplicate with the oldest existing lead and select the existing lead as a parent. You can also specify an action to be taken on duplicates that are automatically reconciled by this program.
The settings on this tab take the step of confirming the identified duplicates. To automate the next step, merging confirmed duplicates, click the Merge Rules tab.
Merge Rules Tab
Use this form to select fields that will be merged when this program reconciles duplicates.
Note that this form affects automatic and manual duplicate reconciliation in slightly different ways.
- Automatic: When a program uses automatic reconciliation the fields added here will be automatically merged.
- Manual: When a program uses manual reconciliation the fields added here will be selected by default at the Parenting/Merging stage of the reconciliation. (See the “Parenting and Merging” section of this document for more information.)
Flagging Leads as Duplicates
In some cases duplicate leads will not be caught by duplicate programs. For example the lead Bill Williams and William Willams may refer to the same person, but will not be caught by a duplicate program. When a user identifies a duplicate they can flag the lead as a duplicate, removing it from the lead queue and causing it to require reconciliation by a manager or admin.
When a user identifies duplicates on the View Leads page
The user right-clicks one of the duplicate leads and selects Flag as Duplicate from the context menu.
When a use flags a lead as a duplicate, a message will pop up, prompting them to input the Lead ID of the duplicate.
When the Lead ID is entered and the Submit button is clicked, they will be prompted to confirm this action. Admins and Managers will have the additional option of clicking Confirm & Reconcile to reconcile the lead right away.
Note that the Flag as Duplicate option can also be accessed by clicking the Options button on the View Edit Lead page.
If a user manually adds a lead to the system which is caught by a duplicate program they will be notified with a pop up alert.
If an admin or manager adds the manually adds a duplicate lead, the alert they receive will have give them the option of reconciling the duplicates right away.
On the Client Settings page, you can determine whom you want to receive Duplicate Lead Program Notifications by clicking the Edit Notification Settings link.
On the Duplicate Program Notifications Settings page select and add the users you want to receive duplicate lead alerts.