Improve data quality with lead de-duplication

The de-duplication feature uses the Case match functionality in Pega Platform™. Using a case match rule in App Studio, a Sales Automation administrator defines the conditions that a lead must meet to identify the lead as a potential duplicate. For example, the following figure shows a Case match rule with three weighted match conditions.

The weight in each condition determines the relative importance of the condition when making the comparisons.

In this case, if the email address or the two other weighted properties in the current lead match an existing lead, the system identifies the lead as a duplicate.

The And weighted conditions sum at least is set to 40. This setting means that if the sum of weighted conditions that evaluate to true is greater than 40, then report the lead as a duplicate.

First, enable the lead de-duplication feature.

Log in to the Sales Automation application as a sales operations user. In the navigation pane of the application, select Administration, and then select SA-Deduplication settings. The following figure shows the settings.

Enable de-duplication for leads. Enables lead de-duplication for leads created manually. You specify the weightage directly when entering the match conditions.

Enable de-duplication for data migration. Enables lead de-duplication for leads imported using the data import wizard. The Weightage for leads bulk imported is set to 80. You can enter a value from 0 to 100. However, setting a very low threshold can cause the system to identify too many leads as potential duplicates. Note that the sum of weighted conditions specified in the case match rule overrides the weightage threshold defined in the De-duplication settings.

A Sales Automation administrator enables a job scheduler that runs nightly to identify duplicate leads. After the de-duplication settings are enabled, the system starts monitoring for duplicates.

You can view duplicates from the Leads landing page. In the navigation pane, select Leads, and then select either the Duplicate business leads or the Duplicate individual leads tab. The list displays any duplicate leads.

Click a lead name to open it. From the Actions menu, click Ignore lead as duplicate to remove the lead from the list of potential duplicates. The lead will no longer be considered a duplicate in future job runs.

From the Actions menu, click Merge lead to merge the lead with the current lead. In the Merge lead task, select Show all duplicate leads and then select any leads displayed, as shown in the following figure.

Click Next to display the next task screen.

To select all the values associated with that record, select the Keep record checkbox for either the master record or the duplicate record, then click Submit to merge the leads.

Pega Sales Automation also warns you of a potential duplicate when you create a lead.

Create a business lead for a customer. On the Leads landing page, click Create lead > Business lead, and then add the contact information for Annabelle as shown in the following figure.

Click Submit. Because there is an existing lead with the same name in the sample data, the Create Business Lead dialog box warns of a potential duplicate lead.

Click Cancel and then click Discard to delete the new lead entry. Click Ignore and continue to return to the Create Business Lead dialog box.

Pega Sales Automation also looks for duplicates when you import leads. For example, after a webinar, you want to create leads for attendees who want to get further product information.

Log In to Pega Sales Automation as a system administrator.

In the navigation pane, click SA Tools > Data Import wizard. In the Import records to field, select either Lead business or Lead individual, then choose the import file.

When the import is completed, review the records. Any possible duplicate leads display on the Validate and Review screen of the wizard. The wizard does not import the potential duplicate leads.