Tag "Data Lake Management"

Fast and Furious: Designing for the Fast Data Lane: Transporting and Processing Streams

In the earlier post, we discussed the ability for stream processors, such as Informatica VDS, to process events at the edge, in this post we look at how these events are transported to the corporate data center for streaming analytics. As you’re lounging in front of the TV flipping channels you notice a product during... more

Fast and Furious: Designing for the Fast Data Lane Collecting Streams

Switching to the carpool lane can be intimidating especially when you don’t have all the information available to you to safely make the lane change. For example, is the carpool lane open, is my blindspot clear to make the lane change?  How do you efficiently collect bits and pieces of data at the right time... more

Fast and Furious – Shifting from The Slow Data Lane

It’s a sunny afternoon, you’re on the highway with the top down and stuck in traffic. You fumble through your navigation trying to figure out which is the best and fastest route to your destination. You can take the side streets, where you will encounter traffic lights and eventually get to your destination. Alternatively, you... more

10 Customer Questions About Informatica’s Marketing Data Lake

Last week, Prash Chandramohan and I presented a deep dive webinar on Informatica’s Marketing Data Lake to close to 700 attendees. As with any technical demo webinar, we weren’t able to address any questions during our one-hour slot as our focus was to ensure our attendees understood Informatica’s Marketing Data Lake’s key capabilities and features.... more

Big Data’s Easy Button: One-Click Automated Deployment of Informatica Big Data Management on Amazon EMR

Organizations are looking for opportunities to reduce their on-premises datacenter footprint by offloading or extending on-premises applications, data warehouses, big data solutions to the cloud. Cloud deployments increase agility as they allow organizations to rapidly add new capabilities and scale up and down as their needs change. Cloud solutions free up IT resources from supporting... more

Data Lake Management: Maintaining Data Lake Order with “Fish Management”

Every data lake is dynamic and never exactly alike which makes managing a data lake a daunting task. As we discussed in prior blogs, we know what’s in the lake and introduced a variety of fish to the lake, we need to manage a lake efficiently, making sure the water quality is good, weeds are... more

Data Lake Management: Introducing a Variety of “Fish” to Your Lake

You’ve built a data catalog of fish (I’m using fish here as an analogy for data), identifying three categories: Near-shore, bottom-shore and off-shore fish and tagging fish according to various categories. Your catalog also goes one level deep by identifying different levels of plankton! What about introducing new varieties of fishes to the data lake?... more

Data Lake Management: Do You Know the Type of “Fish” You Caught?

“Different types of fish live in a community and when you understand their relationship to each other, you have a better chance of catching what you want.” thompsonadvertisinginc.com You navigated your way to the lake and read up on the fundamentals of fish management and introduced the data lake management principles. As you drove up to... more

Data Lake Management: Poor Architecture Makes “Fishing for Insights” Difficult

It’s tough to fish for insights in a poorly designed Data Lake. When you decide to build a data lake, you first need three things: A strong foundation A design blue print A vision for the final product which end users will consume If done correctly, you end up with a delicious platter of fish. ... more