Tag Archives: ELT
In a recent webinar, Mark Smith, CEO at Ventana Research and David Lyle, vice president, Product Strategy at Informatica discussed: “Building the Business Case and Establishing the Fundamentals for Big Data Projects.” Mark pointed out that the second biggest barrier that impedes improving big data initiatives is that the “business case is not strong enough.” The first and third barriers respectively, were “lack of resources” and “no budget” which are also related to having a strong business case. In this context, Dave provided a simple formula from which to build the business case:
Return on Big Data = Value of Big Data / Cost of Big Data (more…)
Flipping around traditional ETL (Extract-Transform-Load) on its head is not a new practice. ELT (Extract-Load-Transform), where processing is handled in the database, instead of the ETL server, has been proven to enhance performance in many types of data warehousing deployments.
For example, Oi, a leading telecom provider in Brazil, implemented an enterprise data warehouse (EDW) consolidating information on 36 million customers, speeding response time to customer requests. The right-time EDW also enabled Oi to rapidly launch a successful new service offering, which made it easier for customers to recharge their pre-paid accounts for telecom service.
By implementing ELT with Informatica’s pushdown optimization capabilities for this Teradata data warehouse, Oi accelerated its data warehousing loading process two-fold. This has led to even more timely updates of Oi’s customer information, while lowering costs.
ETL (Extract-Transform-Load) technology has been around for over a decade, and while it rocked the world in the 90’s, it’s considered a bit of a relic nowadays. Data warehousing, the original driver for ETL technology, isn’t considered as sexy anymore. That’s in part why vendors have used different names to broaden this software category and added new capabilities to keep it relevant.
Informatica is no exception. We’re “the Data Integration Company“, where data integration consists of many different capabilities, only one of which is ETL (granted, the ETL piece is the cornerstone for data warehousing and other data integration projects).
And the letters E-T-L themselves have been put in the blender to be reconfigured into newer, fresher concepts. ELT or ETLT incorporates the concept of pushdown optimization, where processing is handled in the database, instead of the ETL server. (For more detail, Rajan Chandras has a good post discussing ETL vs. ELT.) ETQL pulls data quality into the ETL workflow. And I’m sure the permutations will continue.
So, is classic ETL just not relevant anymore? (more…)