Tag Archives: structure

How Big Data Changes Data Integration

With Big Data systems now in the mix within most enterprises, those charged with data integration are interested in how their world will soon change. Rest assured, most of the patterns of integration that we deal with today will still be around for years to come.

However, there are some clear trends that data integration managers need to understand, such as:

  • The ability to imply structure to the data at the time of use.
  • The ability to store both structured and unstructured data.
  • The need for faster data integration technology. (more…)
Posted in Big Data, Data Integration | Tagged , , | 1 Comment

Data Quality – An Expanding Ring

I was talking to a customer the other day who is about to embark on a data quality quest.  He asked me to explain my view of a data quality initiative.  I explained to him that data quality is a never ending process.  I said it was like dropping a pebble in the water.  The initial ring is small but slowly expands outward.  The data quality process is similar.  You start small, with one application or one subject area, show some success then look to expand the process with additional applications or subject areas.  Then expand further to additional business units or business functions until you have encompassed the entire enterprise.  Then just when you think you’re done, you need to continue to monitor and repair data because it will degrade over time.

While what I said was true, he said that the business would reject that description out of hand.  Business believes that all IT projects are never ending projects.  It is this thought process that always pitches Business against IT.  Business believes that IT never delivers a finished project.  His analogy is that Data Quality is more like building a building.  It takes a lot of time and effort to get the foundation right, then you need to add the structure, electrical, water, communication, and finishing work.  Then you move in and begin to use the building but you’re not done. (more…)

Posted in Business/IT Collaboration, Data Quality | Tagged , , , , , , , , , , , | 1 Comment