Testing Buddy prompts

1. On the exercise system landing page, click Pega Infinity™ to log in as Buddy Manager:
   1. In the Username field, enter BuddyManager
   2. In the Password field, enter rules
2. In the navigation pane of Pega Knowledge Buddy, click Create > Knowledge Buddy.
3. In the Name field, enter EnablementBuddyV2.
4. In the Description field, enter New version of EnablementBuddy with updated prompt.
5. Select the Copy from existing buddy checkbox.
6. In the Existing buddy drop-down list, select EnablementBuddy.

7. Click Submit, then click Submit again to progress to the Configure Prompt step.
8. Click Save for later.
9. In the lower-right corner of Pega Knowledge Buddy, click the EnablementBuddyV2 icon.

10. In the Ask your question here field, enter the first of the following questions and then click Ask. Observe the result, then repeat the process with the other questions.
    1. How do I open an account at U+ Bank?
    2. What are best practices in a contact center?
11. Click Close.
    Note: It is important to ask a series of questions before you introduce changes to the Buddy. This not only enables you to identify potential issues early (if it does not answer correctly at this stage), but also creates a frame of reference – if the Buddy answers your questions correctly now, it should also do so after changes are applied to the prompt.

1. In the top right-hand corner, click Go.

2. In the Instructions field, change You are a customer service representative and I would like you to answer some questions based on the CONTEXT I provide. to You are a learning assistant and I would like you to answer some questions based on the CONTEXT I provide. Do the same with In your answer do not mention you are a customer service representative.
3. In the instructions field, enter:
   • 12. Add a references section to your answer and show a list of references you used in this section.
   • 13. Include titles and URLs in the references section.
   • 14. Use bullet lists in your response where it makes it more readable.
   • 15. Before responding, ensure that you have valid references. Otherwise, reply that you don't know.
   • Your answer should follow this layout:
   • Question
   • Answer
   • References
4. In the Contextual data definitions table, in the SEARCHRESULTS row, click the Actions menu, and then click Edit.

5. In the Response attributes drop-down list, select Title and URL.
6. Select the Advanced settings checkbox.
7. In the Minimum similarity score of matches field, enter 60.
   Note: The minimum similarity score dictates how strict and accurate the search results should be. The lower the number, the more lenient the matching algorithm is.

8. Click Submit, then Save for later.

1. In the lower-right corner of Pega Knowledge Buddy, click the EnablementBuddyV2 Icon.
2. Click Reset.
3. In the Ask your question here field, enter the questions from Task 1, step 10, one by one, then click Ask. Observe if the answers produced by EnablementBuddyV2 include the updated prompt instructions.
   • How do I open an account at U+ Bank?
   • What are best practices in a contact center?
4. Click Close.

1. In the top right-hand corner, click Go.
2. In the Instructions field, replace the current instructions with this JSON format prompt:

{

"instructions": "Respond to the query based on the chunks provided.",

"rules": [

"Use only the CONTEXT you are provided with.",

"In your answer do not mention you are a customer service representative.",

"Do not refer to anyone or anything that is not part of the CONTEXT provided.",

"If you don't know the answer, just say that you don't know.",

"Never make up answers which is not in the CONTEXT provided.",

"Do not mention that you are a customer service representative in your answer.",

"Do not mention the provided context, just answer the question.",

"Add a references section to your answer and show a list of references you used in this section.",

"Include titles and URLs in the references section.",

"Use bullet lists in your response where it makes it more readable.",

"Before responding, ensure that you have valid references. Otherwise, reply that you don't know."

],

"Response layout": {

"Question": "question as you understood",

"Answer": "Answer",

"References": [

{

"Title": "Title",

"URL": "URL"

}

]

}

}

1. Click Save for later.
   Note: As a best practice, do not mix a code format with informal language when writing prompts.

1. In the lower-right corner of Pega Knowledge Buddy, click the EnablementBuddyV2 Icon.
2. Click Reset.
3. In the Ask your question here field, enter the same set of questions (Task 1 step 10 and Task 3 Step 2), then click Ask.
   
   Observe whether the answers produced by EnablementBuddyV2 are influenced by the JSON format of the prompt.