Topic "Big Data"
Last year, data analytics guru Tom Davenport dismissed the notion that there’s a shortage of data scientist skills. Yes, they were, at one point, as “rare as vegetarian dogs.” Lately, however, while “there may not be a glut of data scientists, but they are much easier to find and hire than they used to be.... more
The 2007-2008 global financial crisis led to multiple regulations created to protect citizens, banks and the economy itself. Dodd-Frank, Markets in Financial Instrument Directive (MiFID) II, BCBS 239 etc. all define numerous principles, guidelines and imperatives that need to be complied with, sometimes at very high costs. But even after spending millions of dollars there... more
Absolutely nobody disputes the potential value of big data. It provides an economic way to ask new analytics questions that we were never able to ask before. And that is possible because we are able to combine new, large, and widely disparate data sets in ways that were never economically possible before. The challenge people are now facing is that it getting harder and harder to show business value.
A Big Metadata Problem “We have 20,000+ known databases in our IT environment, with no idea what is in them”. This was how a meeting with a large enterprise customer started back in 2015. The newly minted CDO of the company was taking stock, only realizing now the enormity of the problem. “Our data analysts... more
At a presentation a couple of months back, I heard Forrester’s Mike Gualtieri talk about an interesting conundrum when it comes to big data analysis – separating correlation from causation. It starts with a human tendency to “fill in the blanks” when it comes to figuring out what data is telling us, and it exposes... more
Informatica World is a unique place to gain knowledge around all things data. In my recent post, I shared key reasons why I’m looking forward to Informatica World 2017. One of these reasons is the chance to learn new Big Data Management skills. Increasing your Big Data Management skills can help your company get ahead,... more
Recent research show that more energy from Sun hits the Earth in an hour than the amount of energy we consume in an entire year. That is in fact unimaginable amount of energy. It reminded me of how every IT organization is dealing with the amount, types and volumes of data and data assets that is... more
Business users always had an insatiable hunger for data. They were already discovering and mashing up data from different sources, aggregating them in excel and presenting PowerPoint analysis in the 1990s, albeit with difficulty. Then technology caught up. Self-service Business Intelligence tools like Tableau, Qlikview and more recently Amazon QuickSight made the aggregating, visualizing and sharing... more
Recently I was speaking to a customer in the financial services industry. He had an interesting requirement. He wanted to classify all data assets in the organization by associating the right semantic label with each data asset. The phrase he used was “classify to completion”. According to him this classification was a key first step in... more
Last week, Prash Chandramohan and I presented a deep dive webinar on Informatica’s Marketing Data Lake to close to 700 attendees. As with any technical demo webinar, we weren’t able to address any questions during our one-hour slot as our focus was to ensure our attendees understood Informatica’s Marketing Data Lake’s key capabilities and features.... more