{"id":779,"date":"2015-11-16T01:14:25","date_gmt":"2015-11-15T23:14:25","guid":{"rendered":"http:\/\/blog.asym.dk\/?p=779"},"modified":"2015-11-16T01:14:25","modified_gmt":"2015-11-15T23:14:25","slug":"why-the-dichotomy-of-testing-versus-checking-is-the-core-of-our-craft","status":"publish","type":"post","link":"https:\/\/www.asym.dk\/index.php\/2015\/11\/16\/why-the-dichotomy-of-testing-versus-checking-is-the-core-of-our-craft\/","title":{"rendered":"Why the dichotomy of testing versus checking is the core of our craft"},"content":{"rendered":"

Please note: This post is being updated.<\/em>
\nIn his Why the testing\/checking debate is so messy \u2013 a fruit salad analogy<\/a>, my good friend Joep Schuurkes<\/a> posts an absurd dialogue in which two persons become confused because they cannot distinguish between apples and fruit. He claims the dialogue could still happen if apples is replaced with checking and fruit with testing.
\nHe is trying to show that in the same way that apples are a sort of fruit, checking is a sort of testing. And that discussing testing *versus* checking is bullshit.
\nI think Joep is wrong, and I shall discuss why and how here.
\nA little “versus”<\/strong>
\nThe core of the discussion is the little “versus” between testing and checking, which Bolton and Bach insists on. And I insist on it too: It introduces a dichotomy, which is not only important, it is even necessary.
\nAnd it is necessary because it shapes our thoughts about testing.
\nTo be precise, it leads us to think on a conceptual level instead of just an activity level. Once we accept the little \u201dversus\u201d between the two, accept the dichotomy, we can start thinking about our craft<\/em>. We are no longer forced to only think about the activites<\/em> we do.
\nAnd just as important: We can distinguish our craft from something that it is not.
\nIt’s like the way more and more people discriminate between leadership and management. Once you accept that the two are conceptually different, something interesting happens: A whole new understanding of the act of playing \u201dthe boss\u201d reveals itself.
\nIn the same way, when we start discriminating between testing and checking, the way we talk about what we do as testers, change. And we change.
\nA humanistic and value producing view on testing has revealed itself to us through this dichotomy:
\nTesting was, but is no longer…<\/strong>
\nTesting is no longer a necessary evil, only done because programmers are sloppy, don’t read requirements and make mistakes. Instead, testing has become a craft, carried out by humans. A craft that adds value to the product, the organisation and society as a whole.
\nWe are no longer little machines working under detailed instruction. We are testers, and therefore everything we do, our job satisfaction and even the value we produce, depends on this very dichotomy.
\nI will not let the confusion confuse me<\/strong>
\nSo why the confusion? Well, I think the confusion arises because we confuse concepts with activities when we talk our daily, ambigous language.
\nAs a tester, I carry out checks when I test, but when I do, the checks I am doing are elements in the testing and the whole activity is testing, not checking.
\nBut if, on the other hand, I program a computer to run through a number of input combinations to a software program, have my program verify the results by comparing them to something \u201dexpected\u201d, and produce a report of boolean results on the basis of this, the whole activity of running that and distributing the report from the computer program is checking, not testing.
\nHowever, letting this confusion lead us to discard the difference between testing and checking would be a pity. The dichotomy is core to Boltons and Bachs testing philosophy. If I reject it, I have to reject more or less everything they say about testing.
\nAnd worse: I will have to give up my profession.
\n
\nPS: <\/strong>Joep tweeted to me that the only dichotomy he can think of with regards to testing is between good testing and bad testing. To me, the difference between good testing and bad testing is about performance. Good testing produces more knowledge and better knowledge than bad testing. Bad testers can improve and hopefully become good through training.
\nI could imagine a dichotomy for good versus evil testing, though. Evil testing would be testing that knowingly produce incorrect results, doesn’t test, but make up lies, and communicates untrue facts.
\n
\nPPS: <\/strong>Another implication of the idea that there is a dichotomy is that if we for a moment assume that there could be something called \u201dscripted testing\u201d or \u201dautomated testing\u201d, then it would not really be scripted testing or automated testing, as in someone really following a script in deail or something is completely automated by a machine. Then it can only be checking.
\nThis is not because of any definitions of the words checking or testing, but because of the idea of the dichotomy. In other words: It is only when we seperate the two, that they materialise as real concepts.
\nOn the other hand: If someone, who has hired me as a tester, but is not aware of the dichotomy, or who will not accept it, comes to me and says: Please set up an automated test suite, I will accept the order and know that what he really asks me to do is to set up a tool assisted test: A set up, where a tool does checking and I, the tester and user of the tool, evaluates the output of the tool and commuincates the testresults. And adjusts the tool in a forthgoing process.
\nI think Bolton and Bach will \u2013 in their latest terminology – call this \u201dtool assisted exploratory testing\u201d, but the word \u201dexploratory\u201d is really not necessary.<\/p>\n","protected":false},"excerpt":{"rendered":"

Please note: This post is being updated. In his Why the testing\/checking debate is so messy \u2013 a fruit salad analogy, my good friend Joep Schuurkes posts an absurd dialogue in which two persons become confused because they cannot distinguish between apples and fruit. He claims the dialogue could still happen if apples is replaced […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[18,26],"_links":{"self":[{"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts\/779"}],"collection":[{"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/comments?post=779"}],"version-history":[{"count":0,"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts\/779\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/media?parent=779"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/categories?post=779"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/tags?post=779"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}