Data Scrubbing

Why Trust Techopedia

What Does Data Scrubbing Mean?

Data scrubbing refers to the procedure of modifying or removing incomplete, incorrect, inaccurately formatted, or repeated data in a database. The key objective of data scrubbing is to make the data more accurate and consistent.

Advertisements

Data scrubbing is a vital strategy for ensuring that databases remain accurate. It is especially important in data-intensive industries, including telecommunications, insurance, banking and retailing. Data scrubbing systematically evaluates data for flaws or mistakes with the help of look-up tables, rules and algorithms.

Data scrubbing is also referred to as data cleansing.

Techopedia Explains Data Scrubbing

Database errors are common, and may originate from the following:

  • Human errors during data entry
  • Database merging
  • Absence of industry-wide or company-specific data standards
  • Aged systems that contain obsolete data

In the past, data scrubbing was performed manually. This not only increased the time required to complete the process, but also made the process much more expensive and prone to errors. This led to the creation of effective data scrubbing tools, which systematically evaluate data for flaws that could not be identified in a manual cleaning process.

Generally, a database scrubbing tool consists of solutions that are ideal for rectifying several specific kinds of mistakes, like locating duplicate records, or replacing missing ZIP codes. Merging erroneous or corrupt data is the most complicated issue. It is even described as the "dirty data" problem because it costs organizations millions of dollars every year. This phenomenon is increasing with the introduction of more complex business environments with more systems and data. Data scrubbing helps organizations tackle such issues by providing powerful data scrubbing tools to identify and eradicate data flaws.

Advertisements

Related Terms

Margaret Rouse
Technology Expert
Margaret Rouse
Technology Expert

Margaret is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical business audience. Over the past twenty years, her IT definitions have been published by Que in an encyclopedia of technology terms and cited in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine, and Discovery Magazine. She joined Techopedia in 2011. Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages.