Activity Based Cost and Data Quality: Codependent Initiatives? Summary Activity Based Costing, or ABC, is an exercise where costs are assigned to business activities required to support critical business operations. While it is often used in support of a business process redesign (BPR) effort, it can also serve an important role in data quality (DQ) initiatives. In order to conduct a data quality initiative, a significant investment is required. ...
What’s an Orphan? An orphan transaction is a transaction in a “child” table without an associated transaction in a “parent” table. For instance, an address record in the Address table without a link to a customer record in the Customer table. Orphaned records lead to various issues in business operations like marketing and business analytics. Challenges orphans pose to the business An address without an associated customer record will pose...
Introduction Data integration is nothing new. Since the concept of data warehousing, data integration has been a major initiative for most large organizations. On the most common obstacles of integrating data into a warehouse has been the fact that assumptions about the state of the source data have been either false or flawed at best. One of the reasons for this is that very little investigation, or data profiling,...
Is Big Data better Data Quality? Big Data is everywhere. Chances are you’ve used a big data solution today. However, are big data solutions delivering big data quality? High Availability versus High Data Quality Typically, Big Data solutions are designed to ensure high availability. High availability is based on the concept that it is more important to collect and store data transactions than it is to determine the uniqueness or accuracy of the...
7 Habits of Highly Effective Data Quality I’ve been reading Stephen Covey’s The 7 Habits of Highly Effective People and I couldn’t help but notice the parallels between effective people and effective data management. In the book Covey discloses that there are principles, centered on self-discipline, that lead to success and fulfillment. Sounds great, right? The seven habits include some ear-cringing buzz words, but let’s take a look at them...
I’m interested to hear the thoughts of my fellow data quality practitioners about the role of data quality, more specifically data profiling, in the data migration process. Vote, leave a comment, whatever … I’m looking for some consensus around the approach. Thanks for taking the time to visit the weblog!William Sharpsharp@thedataqualitychronicle.org
In my opinion, profiling and scoring data is a fundamental part of a sound data quality assessment. I routinely use these processes to build my “current state” report for clients. I recently used Informatica’s Data Quality developer and analyst tools to put together such a package. I am of the opinion that these tools represent the “best in breed” available to do so. The learning curve is not steep,...
Soundex is a useful function for performing data matching While you can use a Soundex function in the process of identifying potential duplicate strings, I don’t recommend it. Here’s why … The algorithm encodes consonants Vowels will not be encoded unless it is the first letter Consonants to the right of a vowel are not coded Similar sounding consonants share the same digit C,G,J,K,Q,S,X,Z are all encoded with the same...
Data Quality is not a technology issue, it’s a business issue Here is my opinion on why people think it is about technology. Business initiatives like MDM/BI/DQ and the like are being presented, sold on, and driven by technology experts. Information technology has carried business forward to the point where we are the chauffeurs for change and progress. Without the ability to integrate new technologies into a business,...
Don't miss it - Subscribe by RSS.
Greenplum on Twitter Data Quality on Twitter