Testing engagement policy conditions using an audience simulation
Archived
4 Tasks
15 mins
Beginner
Pega Customer Decision Hub 8.5
English
Scenario
U+ Bank is currently doing cross-sell on the web by showing various credit cards to its customers.
They want to run an audience simulation to check how many potential actions are filtered out by each component of the policy and discover if a particular criterion is too broad or too narrow for their requirements.
Use the following credentials to log in to the exercise system:
Role |
User name |
Password |
---|---|---|
Decisioning Analyst |
CDHAnalyst |
rules |
Your assignment consists of the following tasks:
Task 1: Check the configurations
Check the Next Best Action Designer configurations that U+ Bank currently uses to present customers with relevant offers.
Task 2: Prepare data set for simulation run
Run the PrepareSampledCustomers_REF data flow to prepare the data set for the simulation run.
Note: The Sampled Customers is not available in a persisted store. To initialize the customer data, first run the PrepareSampledCustomers_REF data flow.
If you already initiated the customer data as part of the previous challenge, you need not perform Task2.
If you already initiated the customer data as part of the previous challenge, you need not perform Task2.
Task 3: Create and execute an engagement policy audience simulation
Create and execute an audience simulation. Use the Sampled Customers data set as the audience and only engagement policy as the simulation scope. Inspect the result of the executed simulation by answering the following questions.
- How many customers pass through the eligibility, applicability, and suitability conditions at the group-level and the action-level?
- How many unique customers qualify for each action?
Task 4: Create and execute an arbitration audience simulation
Create and execute an audience simulation. Use the Sampled Customers data set as the audience and engagement policy and arbitration as the simulation scope. Inspect the result of the executed simulation by answering the following question.
- How many unique customers qualify for each action?
Challenge Walkthrough
Detailed Tasks
1 Check the configurations
- Log in as Decisioning Analyst with username CDHAnalyst and password rules.
- In the navigation pane of Pega Customer Decision Hub, click Next-Best-Action > Designer.
- Navigate through the tabs to see the configurations made to present customers with relevant offers.
2 Prepare data set for simulation run
- In the navigation pane of Pega Customer Decision Hub, click Data > Data Flows.
- Search for and then open the PrepareSampledCustomers_REF data flow to prepare the data set used for simulations. This data is based on a Monte Carlo dataset, which is generated.
Note: The Monte Carlo data set generates a mock data set. As a result, different simulation runs have different results.
- Click Actions > Run.
Note: Notice that the prospect data is populated once the test run is complete.
- Close the data flow Test run window.
3 Create and execute an engagement policy audience simulation
- In Next Best Action Designer, click the Engagement policy tab.
- In the Business structure section, under Sales, click CreditCards
- Click Actions > Audience Simulations.
- Click Create simulation to create a new audience simulation.
- In the Create simulation dialog box, configure the following information.
- Audience: SampledCustomers
- Next-Best-Action scope: Engagement policies only
- Simulation ID prefix: AudienceSimulation_E
- Click Run to execute the simulation.
Question: How many customers pass through the eligibility, applicability, and suitability conditions at the group-level and the action-level? |
- Inspect how the customers are filtered at Next Best Action Designer level for every engagement policy condition.
Tip: 980 customers pass through the eligibility conditions at group and action levels. As the applicability condition does not filter out customers, 980 passes through the group and action levels. There are no group-level suitability conditions defined and hence 733 customers pass through the action-level suitability conditions.
Question: How many unique customers qualify for each action? |
Tip: When a simulation is run with only engagement policy conditions as the scope, the number of customers who qualify for an action are not unique. All customers who qualify for an action are counted. As a result, the total of customers per action does not tally with the Total unique customers count shown in the Next-Best-Action Desinger.
Note: The Monte Carlo data set generates a mock data set. As a result, different simulation runs have different results.
- In the Offers section, open a credit card action (for example, click the Premier Rewards card).
- Click the Engagement policy tab.
- Click Actions > Audience simulation.
- In the Simulation list, select AudienceSimulation_E-1.
- Inspect how the customers are filtered at action level for every engagement policy condition.
4 Create and execute an arbitration audience simulation
- In Next Best Action Designer, click the Engagement policy tab.
- Click CreditCards.
- Click Actions > Audience Simulations.
- Click Create simulation to create a new audience simulation.
- In the Create simulation dialog box, configure the following information.
- Audience: SampledCustomers
- Next-Best-Action scope: Engagement policies and arbitration
- Simulation ID prefix: AudienceSimulation_A
Question: How many unique customers qualify for each action?
- Click Run to execute the simulation.
- Inspect how the customers are filtered at the Next Best Action Designer level for every engagement policy condition.
Tip: When an audience simulation is run with engagement policy and arbitration as the scope, the number of customers who qualify for an action are unique, as only the top offer is considered. As a result, the total number of unique qualifying customers at the next-best-action level adds up to the total number of unique qualifying customers per action.
- In the Offers section, open a credit card action (for example, click the Premier Rewards card).
- Click the Engagement policy tab.
- Click Actions > Audience simulation.
- In the Simulation list, select AudienceSimulation_A-1.
- Inspect how the customers are filtered at action level for every engagement policy condition.
Note: The Monte Carlo data set generates a mock data set. Therefore, different simulation runs will have different results.
- On the right, in the Show population that passed as dlist, select Percentages to see the filtration effect in percentages.