Monitoring adaptive models

3 Aufgaben

10 Min.

Pega Customer Decision Hub '24.2

Pega Customer Decision Hub '25 Pega Customer Decision Hub '24.1 Pega Customer Decision Hub '23 Pega Customer Decision Hub '23 Pega Customer Decision Hub 8.8 Pega Customer Decision Hub 8.7 Pega Customer Decision Hub 8.6 Pega Customer Decision Hub 8.5

Sichtbar für: All users Applies to: Pega Customer Decision Hub '24.2

Anfänger

Englisch

Szenario

The models for the U+Bank implementation of cross-selling on the web of their credit cards have been learning for some time. Your task in this challenge is to inspect the models and report on which predictors are performing well, and which are not.

Use the following credentials to log in to the exercise system:

Role	User name	Password
Data scientist	DataScientist	rules

Your assignment consists of the following tasks:

Task 1: Inspect the adaptive models

Inspect the adaptive models by answering the following questions:

1. Which model requires attention, and what is the performance of this model?
2. What is the performance of the best-performing model?
3. Which banner is the most successful?

Task 2: Inspect the predictors of the models

Inspect the predictors in the models by answering the following questions:

1. Which predictor has the highest performance across all models?
2. Which predictors are not used in any of the models?

Task 3: Inspect a specific adaptive model

Identify the model with the highest performance, then inspect it and answer the following questions:

1. What are the top three predictors used in the model with the highest performance?
2. Which predictor, currently relevant for the adaptive model, has the lowest performance?
3. Which age categories show the highest and lowest interest in this banner?
   Hinweis: The values you see in your exercise environment will differ slightly from the screen shots below.

 

Sie müssen zum Abschließen dieser Challenge Ihre eigene Pega-Instanz starten.

Die Initialisierung kann bis zu 5 Minuten dauern, bitte haben Sie Geduld.

• Anmelden

Challenge-Schritte

Genaue Übungsschritte

1 Inspect the adaptive models

1. On the exercise system landing page, click Pega Infinity™ to access Customer Decision Hub.
2. Log in as a data scientist:
   1. In the User name field, enter DataScientist.
   2. In the Password field, enter rules.
3. In the navigation pane on the left, click Intelligence > Prediction Studio to open the Prediction Studio portal.
4. Click the Predict Web Propensity prediction tile to open the prediction.
5. On the Models tab, in the Propensity to Click section, click Web_Click_Through_Rate_Customer to open the model.
6. On the Monitor > Models tab, inspect the bubble chart.
7. Question - Which model requires attention, and what is the performance of this model?
   1. Hover over the green model in the chart.
      
      Tipp: Note the name of the model and its performance. The StandardCard model with a low performance of 55.14 requires immediate attention.

8. Question - What is the performance of the best-performing model?
   1. Hover over the blue model in the middle of the chart.
      
      Tipp: The best-performing model is PremierRewardsCard with a performance of 81.19
      Hinweis: In this web scenario, the success rate of the model is the click-through rate, the fraction of customers that clicks on the banner.

9. Question - Which banner is the most successful?
   1. Hover over the model with the highest success rate in the chart:
      
      Tipp: The PremierRewardsCard has the highest success rate of 34%.

2 Inspect the predictors of the models

1. Question - Which predictor has the highest performance across all models?
   1. Click the Monitor > Predictors tab.
      
   2. Click the Average performance column header twice to sort by the average performance.
      
      Tipp: The best-performing predictor is CreditScore. This predictor is used in four models because the # Models inactive value is 0.

2. Question - Which predictors are not used in any of the models?
   1. Click the # Models active column header to sort the models in ascending order:
      
      Tipp: The predictors with a # Models active value of 0 are currently not used in any of the models as they are not predictive, for example OrganizationID, or are grouped with another predictor. The default performance threshold is 52.

3 Inspect a specific adaptive model

1. Question - What are the top three predictors used in the model with the highest performance?
   1. Click the Models tab.
   2. Click the Actual performance (AUC) column header twice to sort the list of models in descending order.
   3. Click Model report in the first row.
      
   4. Click the Performance (AUC) column header twice to sort the predictors in descending order.
      
      Tipp: The top three best-performing predictors for this model are CreditScore, AnnualIncome, and Age.

2. Question - Which predictor, that is currently relevant for the adaptive model, has the lowest performance?
   1. Scroll to the bottom of the list.
      
      Tipp: NumInvestmentAccount is the active predictor with the lowest performance of 52.12, which is just above the default cutoff value.

3. Question - Which age categories show the highest and lowest interest in this banner?
   1. Click the Age predictor.
      
      Tipp: The highest interest for this banner is in the bin, that contain the 40-50 year old customers.

---

In dieser Challenge üben Sie, was Sie im folgenden Modul gelernt haben:

• Monitoring adaptive models v8

---

In der folgenden Mission verfügbar:

• AI for 1:1 Customer Engagement v5