{"id":119,"date":"2010-03-29T17:00:13","date_gmt":"2010-03-29T16:00:13","guid":{"rendered":"http:\/\/www.smartersoftware.de\/wordpress\/?p=119"},"modified":"2010-03-26T12:35:00","modified_gmt":"2010-03-26T11:35:00","slug":"the-dq-cycle-a-procedure-for-dealing-with-data-quality-issues","status":"publish","type":"post","link":"http:\/\/www.smartersoftware.de\/wordpress\/2010\/03\/the-dq-cycle-a-procedure-for-dealing-with-data-quality-issues\/","title":{"rendered":"The DQ Cycle &ndash; a Procedure for dealing with Data Quality issues"},"content":{"rendered":"<blockquote>\n<p>For German readers: Es gibt eine <a href=\"http:\/\/www.smartersoftware.de\/wordpress\/deutsch\/dq-kreislauf.html\">deutsche Version dieses Blogeintrags<\/a>.<\/p>\n<\/blockquote>\n<p>In the past, I have outlined elements to take into account when starting a DQ initiative. This post describes how to deal with Data Quality issues.<\/p>\n<h2>Some Background<\/h2>\n<p>The <strong>Deming Cycle <\/strong>is an established iterative four-step problem-solving process typically used in business process improvement. It is also know as PDCA for its four phases:<\/p>\n<ul>\n<li>Plan      <br \/>Establish the objectives and processes necessary to deliver expected results. <\/li>\n<li>Do      <br \/>Implement the new processes, often on a small scale if possible. <\/li>\n<li>Check      <br \/>Measure the new processes and compare the results against the expected results. <\/li>\n<li>Act      <br \/>Analyze the differences to determine their cause. Each will be part of either one or more of the PDCA steps. <\/li>\n<\/ul>\n<p><font size=\"1\">(Adapted from the <\/font><a href=\"http:\/\/en.wikipedia.org\/wiki\/PDCA\"><font size=\"1\">wikipedia article on PDCA<\/font><\/a><font size=\"1\">.)<\/font><\/p>\n<h2>Overview<\/h2>\n<p>The <strong>DQ Cycle<\/strong> is an adaption of this general framework to Data Quality. I\u2019ve used this framework at a number of customers with good success. The general idea is pretty simple and easy to follow, but it is an excellent reminder to make sure you\u2019ve crossed all the T\u2019s and dotted all the I\u2019s.<\/p>\n<p>The DQ cycle has the same phases as the Deming cycle. It describes how to deal with a single DQ problem that has been identified. This means that there may be a number of DQ cycles going on at the same time, each cycle dealing with its problem, and each of these cycles may be at different points in the cycle.<\/p>\n<p>As you may have noted, the description started with the term \u201cDQ problem that has been identified\u201d. In order to accommodate this \u201cproblem identification\u201d, there is an additional \u201cInit\u201d phase that kicks off a new DQ cycle:<\/p>\n<p>&#160;<a href=\"http:\/\/www.smartersoftware.de\/\/wordpress\/wp-content\/pics\/TheDQCycleaProcedurefordealingwithDataQu_936F\/DQ_Cycle.jpg\"><img loading=\"lazy\" decoding=\"async\" style=\"border-bottom: 0px; border-left: 0px; display: block; float: none; margin-left: auto; border-top: 0px; margin-right: auto; border-right: 0px\" title=\"DQ_Cycle\" border=\"0\" alt=\"DQ_Cycle\" src=\"http:\/\/www.smartersoftware.de\/\/wordpress\/wp-content\/pics\/TheDQCycleaProcedurefordealingwithDataQu_936F\/DQ_Cycle_thumb.jpg\" width=\"416\" height=\"344\" \/><\/a> <\/p>\n<p>So we end up with these phases:<\/p>\n<ul>\n<li><strong>Init<\/strong>: A new DQ problem is identified <\/li>\n<li><strong>Plan<\/strong>: You analyze the problem and decide on a course of action <\/li>\n<li><strong>Do<\/strong>: The bad data is corrected <\/li>\n<li><strong>Check<\/strong>: You verify that the DQ problem is resolved <\/li>\n<li><strong>Act<\/strong>: You identify and implement measures to prevent the problem from re-occurring <\/li>\n<\/ul>\n<p>These phases will be described in more detail in the following posts.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>For German readers: Es gibt eine deutsche Version dieses Blogeintrags. In the past, I have outlined elements to take into account when starting a DQ initiative. This post describes how to deal with Data Quality issues. Some Background The Deming Cycle is an established iterative four-step problem-solving process typically used in business process improvement. It [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[26],"class_list":["post-119","post","type-post","status-publish","format-standard","hentry","category-english","tag-dqcycle"],"_links":{"self":[{"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/posts\/119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/comments?post=119"}],"version-history":[{"count":8,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/posts\/119\/revisions"}],"predecessor-version":[{"id":125,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/posts\/119\/revisions\/125"}],"wp:attachment":[{"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/media?parent=119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/categories?post=119"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.smartersoftware.de\/wordpress\/wp-json\/wp\/v2\/tags?post=119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}