Tag "Engineering"

Part 1: Add Spark to a Big Data Application with Text Search Capability

Text search is an essential operation in many applications dealing with semi-structured big data. One such application, which many of us know about, deals with program logs, which not only contains data for troubleshooting, but also often, other information helpful for understanding how the application operates under normal conditions, for diagnosing performance characteristics, snapshot of internal... more

Engineering High Performance Data Virtualization with Informatica Data Services

Working on IDS Informatica Data Services (IDS) is a data virtualization software stack built on a new platform that was created from the various shared internals of the venerable PowerCenter. One of the significant reasons for the shift into the new platform (code named ‘Mercury’) was to make it easy to quickly write new ‘plug-in’s... more