{"id":340,"date":"2019-04-08T01:52:46","date_gmt":"2019-04-08T01:52:46","guid":{"rendered":"http:\/\/freedville.com\/blog\/?p=340"},"modified":"2020-03-03T03:03:53","modified_gmt":"2020-03-03T03:03:53","slug":"testing-strategies-for-chat-and-voice-bots","status":"publish","type":"post","link":"https:\/\/freedville.com\/blog\/2019\/04\/08\/testing-strategies-for-chat-and-voice-bots\/","title":{"rendered":"Testing strategies for chat and voice bots"},"content":{"rendered":"<p>In my original testing series\u00a0<strong><a class=\"row-title\" href=\"http:\/\/freedville.com\/blog\/2016\/12\/04\/cognitive-system-testing-from-a-to-z\/\" aria-label=\"\u201cCognitive System Testing From A to Z\u201d (Edit)\">Cognitive System Testing From A to Z<\/a>\u00a0<\/strong>I described how cognitive systems require a fresh look at testing compared to traditional systems.\u00a0 Cognitive systems are probabilistic, traditional systems are deterministic, and this has implications for how cognitive systems are tested.<\/p>\n<p>As a follow-up I&#8217;ve written several posts on <a href=\"https:\/\/medium.com\/ibm-watson\/\">IBM Watson&#8217;s Medium Blog<\/a> specific to testing chatbots and voicebots.\u00a0 (Voicebot being a chatbot using a voice channel).\u00a0 Those posts are summarized and linked below.<\/p>\n<p><a href=\"https:\/\/medium.com\/ibm-watson\/testing-strategies-for-chatbots-part-1-testing-their-classifiers-20becaf5f211\"><strong>Testing Strategies for Chatbots (Part 1)\u2014 Testing Their Classifiers<\/strong><\/a>.\u00a0 Classifiers are used to figure out what your user actually intends based on what they have &#8216;said&#8217; to the bot.\u00a0 Classifiers need to be tested and continuously improved.<\/p>\n<p><a href=\"https:\/\/medium.com\/ibm-watson\/testing-strategies-for-chatbots-part-2-testing-their-dialog-logic-58e5f0e5548c\"><strong>Testing Strategies for Chatbots (Part 2)\u2014 Testing Their Dialog Logic<\/strong><\/a>.\u00a0 Dialog logic, or routing logic, is at the heart of any chat bot.\u00a0 Classifiers are used to derive intent but routing through a dialog flow includes many additional considerations including conversation context and other state.\u00a0 This routing logic deserves its own testing consideration.<\/p>\n<p><a href=\"https:\/\/medium.com\/ibm-watson\/testing-strategies-for-speech-applications-4aebfedc4b4f\"><strong>Testing Strategies for Speech Applications<\/strong><\/a>.\u00a0 Voice channels introduce new testing complexities.\u00a0 Speech to text testing can be automated by comparing a master transcription of an audio snippet to a model&#8217;s transcription of that same audio.\u00a0 Text to speech testing requires you to listen to synthesized audio to judge its quality.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In my original testing series\u00a0Cognitive System Testing From A to Z\u00a0I described how cognitive systems require a fresh look at testing compared to traditional systems.\u00a0 Cognitive systems are probabilistic, traditional systems are deterministic, and this&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[9,6],"_links":{"self":[{"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/posts\/340"}],"collection":[{"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/comments?post=340"}],"version-history":[{"count":3,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/posts\/340\/revisions"}],"predecessor-version":[{"id":465,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/posts\/340\/revisions\/465"}],"wp:attachment":[{"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/media?parent=340"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/categories?post=340"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/freedville.com\/blog\/wp-json\/wp\/v2\/tags?post=340"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}