Skip to main content

Replacing a predictive model

3 Tasks

10 mins

Visible to: All users
Beginner Pega Customer Decision Hub 8.8 English


U+ Bank uses Pega Customer Decision Hub™ to personalize the credit card offers that a customer receives on its website. The bank makes a proactive retention offer instead of a credit card offer for customers that are likely to leave the bank soon. The bank has recorded historical churn data for its customer base. As a data scientist, you have used this historical data to create a new churn model using an external machine learning application, and now you place the new model in shadow mode in the business operations environment, to monitor its performance.

The revision manager then deploys the change.

Use the following credentials to log in to the exercise system:

Role User name Password
Data scientist DataScientist rules
Revision manager RevisionManager rules

Your assignment consists of the following tasks:

Task 1: Create a validation data set

Use ValidationData to create a data set for model validation.

Task 2: Place the new model in shadow mode

Place the ChurnH20 model in shadow mode in the Predict churn propensity prediction.

Task 3: Deploy the change

As a revision manager, deploy the change.


You must initiate your own Pega instance to complete this Challenge.

Initialization may take up to 5 minutes so please be patient.

Challenge Walkthrough

Detailed Tasks

1 Create a validation data set

  1. On the exercise system landing page, click Pega CRM suite to log in to Customer Decision Hub.
  2. Log in as a data scientist:
    1. In the User name field, enter DataScientist
    2. In the Password field, enter rules.
  3. In Customer Decision Hub, in the navigation pane on the left, click Intelligence > Prediction Studio.
  4. In Prediction Studio, in the navigation pane on the left, click Data > Data sets to view the list of data sets.
  5. On the Data sets page, in the upper-right corner, click New to add a new data set.
  6. Configure the new data set with the following information:
    1. In the Name field, enter ValidationData.
    2. In the Type list, select File.
    3. In the Apply to field, enter or select UBank-CDH-Data-Customer.
      The new data set settings
  7. Click Create to build the data set.
  8. On the File tab of the data set, in the File location section, select Embedded file.
  9. Download the ValidationData data set to your local machine, and then extract the .csv file
  10. In the File Management section, click Upload file.
  11. In the Upload file dialog box, click Choose File.
  12. Select the ValidationData.csv file.
  13. In the Upload file dialog box, click Upload.
  14. In the upper-right corner, click Save.

2 Place the new model in shadow mode

  1. Download the file to your local machine and extract the ChurnH2O.mojo file.
  2. In the navigation pane of Prediction Studio, click Predictions to open the Predictions work area.
  3. Click the Predict Churn Propensity tile to open the prediction.
    The Predict Churn Propensity prediction tile
  4. On the Models tab, in the ChurnPML row, click the More icon, and then select Replace model.
    The More icon to replace a model
    1. In the Replace model dialog box, ensure that Model is selected, and then click Next.
    2. Select the Compare the models check box.
    3. On the Upload tab, in the Select a PMML, H2O MOJO or Pega OXL file section, click Choose File.
    4. Select the ChurnH2O.mojo file, and then click Next.
      The replace model settings
    5. In the Dataset list, select ValidationData.
    6. In the Outcome column list, select Outcome.
      The ValidationData settings
    7. Click Next.
    8. In the Model name field, enter ChurnH20.
    9. Click Replace.
      Note: During the process of replacing the model, the status changes to CONFIGURATION IN PROGRESS, VALIDATION IN PROGRESS, and then READY FOR REVIEW.
  1. In the Churn section, when the status of the ChurnH20 model changes to READY FOR REVIEW, click ChurnH20 (M-2001).
    Where to click to open the analysis
  2. On the Analysis tab, inspect the model comparison.
    The analysis with score distribution
  3. In the upper-right corner, click Evaluate.
  4. In the Evaluate ChurnH20 dialog box, confirm that Approve new candidate model and start shadowing (recommended) is selected.
  5. In the Reason field, enter The new model outperforms the active model, and then click Save to return to the prediction strategy.
  6. Confirm that the ChurnH2O model is in shadow mode.
    The new model in shadow mode
  7. In the lower-left corner, click the user icon and log out.

3 Deploy the change

  1. Log in as a revision manager:
    1. In the User name field, enter RevisionManager
    2. In the Password field, enter rules.
  2. In Customer Decision Hub, in the navigation pane on the left, click Revision Management.
  3. Click Update business rules R-1 to open the revision that is automatically created during the MLOps process.
    The current revision ID
  4. Confirm that the change request Update model 'ChurnH20 (M-1)' is part of the revision.
  5. In the upper-right corner, click Actions > Deploy revision.
  6. In the comment field, enter Revision completed.
    Note: The revision manager has the option to include the ValidationData data set the data scientist created during the MLOPs process as part of the deployment.
    The submit a revision dialog box
  1. Click Deploy to start the deployment process through the Business Change pipeline.
    Note: This process can take up to several minutes.
  1. In the upper-right corner, click Refresh. Repeat until the status changes to TEST & ACTIVATE.
  2. In the page header, click Test or activate this revision.
    The page header
  3. In the Test or activate revision dialog box, click Activate for all operators.
    The test or activate revision settings
  4. Click Submit to close the dialog box.
  5. In the upper-right corner, click Complete revision.
  6. In the Complete revision dialog box, click Submit.
  7. In the upper-right corner, click the user icon and log out.

This Challenge is to practice what you learned in the following Modules:

Available in the following mission:

If you are having problems with your training, please review the Pega Academy Support FAQs.

Did you find this content helpful?

Want to help us improve this content?

We'd prefer it if you saw us at our best.

Pega Academy has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice