Category Archives: Enterprise Data Management

Do You Have A Strategic Integration Vendor?

If you answered NO, then consider some recent developments which may cause you to re-think your organization’s position. Loraine Lawson in her recent blog Organizations Demanding More from Data Integration Tools writes that “customers are demanding more from their data integration tools” and, by inference, from their integration vendors.  The article goes on to highlight advice from Gartner to “Seek out vendors that support a range of styles.” (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in CIO, Data Integration, Enterprise Data Management, Integration Competency Centers | Leave a comment

Dodd-Frank Legislation and Structured Data Retention

The “Dodd-Frank Wall Street Reform and Consumer Protection Act” has recently been passed by the US federal government to regulate financial institutions. Per this legislation, there will be more “watchdog” agencies that will be auditing banks, lending and investment institutions to ensure compliance. As an example, there will be an Office of Financial Research within the Federal Treasury responsible for collecting and analyzing data. This legislation brings with it a higher risk of fines for non-compliance. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Application ILM, Application Retirement, Big Data, Business Impact / Benefits, Business/IT Collaboration, CIO, Customer Acquisition & Retention, Customer Services, Customers, Data Governance, Data Services, Data Warehousing, Database Archiving, Enterprise Data Management, Financial Services, Governance, Risk and Compliance, Mainframe, Mergers and Acquisitions, Operational Efficiency | Tagged , , , , , , , , , , , , , , , | Leave a comment

Enterprise Applications Myth #1: Apps and Data Live and Die Together

This is the first in a series debunking three common myths about enterprise applications and the data that drives them.

Myth:  Enterprise applications and the data in them live and die together.

Fact:  Applications and data have different lifecycles. Sometimes the life of the data is shorter than the application.  Sometimes it is longer.  Either way, the friction between the two raises the cost and complexity of sustaining your applications.  To get this under control, you have to have a separate approach for managing the data vs. managing the application. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Application ILM, Application Retirement, Database Archiving, Enterprise Data Management | Tagged | Leave a comment

Seven Essential Best Practices For Data Center Consolidation

Data center consolidation is much more than physical movement of servers and infrastructure.  In fact, the facility costs and power savings are just the tip of the opportunity. The biggest benefits come from using the consolidation initiative as a catalyst to rationalize the application portfolio, archive inactive data and establish one version of the truth for the data that is left. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Application ILM, Application Retirement, Cloud Computing, Data Integration, Data Quality, Data Services, Data Warehousing, Enterprise Data Management, Integration Competency Centers | Tagged , , , , , , , , , , | Leave a comment

Hadoop Tuesday Update: ‘Range of Business Solutions Built on Hadoop Continues to Grow’

In enterprises across the globe, from data centers into the executive suites, everyone is asking the same questions: What is Hadoop, and how can it help us with our Big Data challenges?

The groundswell of interest in Hadoop – an open-source software framework that enables applications to run across large arrays of nodes, accessing petabytes’ worth of data – was discussed by James Kobielus, Forrester’s Big Data and Hadoop expert, at the opening session of the Hadoop Tuesday Webinar series, sponsored by Informatica and Cloudera.  (Replay available here.) I had the opportunity to join Jim, along with Julianna DeLua, Enterprise Solution Evangelist for Big Data at Informatica, for a discussion of Hadoop’s growth across the business world.

“Hadoop is in heavy evaluation pretty much everywhere, and that’s only a slight exaggeration,” Jim pointed out. “Hadoop is seen widely now as the next generation of big data processing and storage.”

Hadoop is very much the heart of many of Forrester’s customer inquiries now, “both from users and solution providers,” he added. “They want to take this technology, this new approach, and they want to be able to integrate it more tightly in their operations if they’re users. And into their product portfolios if they’re a solution provider.”

Solution providers are also seeing a great deal of inquiries about Hadoop from enterprise customers – not only from the technical ranks, but from the executive suite as well, Julianna added. “There’s tremendous interest, but also market confusion,” she said. “Our customers have invested a tremendous amount of money, and resources into the existing IT infrastructure. The question is, what does Hadoop do – is this a replacement technology, or is this augmenting our technology?” The answer is that Hadoop is paving the way to analytical capabilities previously not available, she continued. “Tasks that used to take weeks come down to days. With an ability to store and analyze huge amounts of data, the era of sampling is coming to the end. For certain applications such as log analysis, even for network and application-level logs, we’re going from a very limited, average-oriented approach into an all-data type of approach.”

Areas where Hadoop is already providing value include CRM, content management, and sentiment analysis. It is gaining traction among “those that are the C-level sponsors who need to be able to analyze petabytes worth of information streaming in all the time,” Jim said. Log analysis is a particularly strong area as well – perhaps one of the “early killer apps for Hadoop,” he added. “CTOs are looking for the ability to process petabytes worth of log data, in real time. They need  to do root cause analysis of problems across complex networks.”

Forrester’s latest survey research shows about 37% of companies have Hadoop projects underway within their enterprises. There are new types of applications unfolding every day. “We’re also seeing Hadoop in a broad range of other areas, such as doing content ETL and digital media,” Jim said. “Online publishers need to be able to render content, transform it in real time and deliver downstream to a broad range of consumers. The range of Hadoop applications continues to grow, and the range of business solutions built on Hadoop continues to grow.”

In the second Hadoop Tuesday Webcast (October 11th), John Akred of Accenture will be delving into the architectural aspects of Hadoop, as well as its role in enabling Data as a Platform.

Future guests for Hadoop Tuesdays include Matt Aslett of The 451Group (October 18), David Menninger of Ventana Research (October 25),  Omer Trajman of Cloudera (November 15), David Linthicum of Blue Mountain Labs (November 29), Charles Zedlewski of Cloudera and Wei Zheng of Informatica (December 13). Executives from companies that have already implemented Hadoop within their data operations will also be joining us.

FacebookTwitterLinkedInEmailPrintShare
Posted in Big Data, Business Impact / Benefits, CIO, Data Governance, Data Integration, Enterprise Data Management, Informatica Events, Operational Efficiency | Leave a comment

A Big Data Vision in an Information Economy

The big data debate is gathering momentum. Whilst organisations around the world contemplate how best to extract the most value from this data stream, others are contemplating what this trend might mean for society in the future. One example is a recent report on a study conducted by academics in the US, who used millions of news articles from sources around the world to feed a ‘supercomputer,’ charting the deterioration of national sentiment ahead of recent world revolutions.

The implications of such intelligence are rather staggering. Our world is engulfed in a stream of free information; so much so that we have the ability to predict landmarks with the potential to change society, economics and culture. It’s a futuristic vision – and one which will require a great deal of shaping if it were to become a reality. It does however, highlight the power of our information economy, and draw out one of the most important challenges for organisations – making the leap from a controlled data environment to the powerful world of big data.

(more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Big Data, Business Impact / Benefits, Data Integration, Enterprise Data Management | Tagged , | Leave a comment

Action Plan for Hadoop Data Integration: Conclusion of Hadoop Blog Series

checklistI had the opportunity to review and comment on the draft of a new Hadoop technical guide. It’s great to see the published paper: Technical Guide: Unleashing the Power of Hadoop with Informatica. This guide outlines the following five steps to get started with Hadoop from a data integration perspective.

(1) Select the Right Projects for Hadoop Implementation

Choose projects that fit Hadoop’s strengths and minimize its disadvantages. Enterprises use Hadoop in data-science applications for log analysis, data mining, machine learning and image processing involving unstructured or raw data. Hadoop’s lack of fixed-schema works particularly well for answering ad-hoc queries and exploratory “what if” scenarios. Hadoop Distributed File System (HDFS) and MapReduce address growth in enterprise data volumes from terabytes to petabytes and more; and the increasing variety of complex multi-dimensional data from disparate sources. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Data Integration, Enterprise Data Management | Tagged , , , , , | Leave a comment

Keeping Your MDM Initiative Lean

Human behavior studies show that if you are offered a pizza menu with a number of combination offerings as well as “build it yourself” options, you will order more toppings than if presented with a menu that only presents build it yourself.  The same thing for medical tests – if a doctor is presented with a pre-filled in menu of recommended clinical tests for specific diseases (and the option to strike out tests that are not needed) they order more tests than if presented with the same order form but with nothing checked in advance. So what is the relevance for Master Data Management (MDM)? (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Data Governance, Enterprise Data Management, Integration Competency Centers, Master Data Management, Operational Efficiency | Tagged , , , , , , , | 1 Comment

Big Data Have You Flummoxed? Join Our ‘Hadoop Tuesdays’ Webinar Series, Starting This Month

This fall, I have the fantastic privilege of moderating a series of informative Webcasts, called “Hadoop Tuesdays,” co-sponsored by Informatica and Cloudera, on the phenomenon sweeping the data management space known as Hadoop.

Big Data may be the problem, but Hadoop is the answer. Hadoop is an open-source software framework that enables applications to run across large arrays of nodes, accessing petabytes’ worth of data. It was originally created by Doug Cutting to support the open-source Nutch search engine project, which is now part of the Apache Lucene text-search library. ‘Hadoop’ was actually named after Cutting’s son’s toy elephant – a fitting analogy for the Big Data challenges that lie ahead.

The series kicks off on September 22nd with a “TweetJam” over the Twitter network – simply check in at Noon Eastern Time that day with hashtags #Hadoop or #infatj. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Business Impact / Benefits, Business/IT Collaboration, CIO, Data Aggregation, Data Governance, Data Integration, Data Services, Data Warehousing, Enterprise Data Management, Informatica Events, Operational Efficiency | Leave a comment