Category Archives: Data Synchronization

Big Data Ingestion got you down? I N F O R M A T I C A spells relief

Big Data alike

I have a little fable to tell you…

This fable has nothing to do with Big Data, but instead deals with an Overabundance of Food and how to better digest it to make it useful.

And it all started when this SEO copywriter from IT Corporation walked into a bar, pub, grill, restaurant, liquor establishment, and noticed 2 large crowded tables.  After what seemed like an endless loop, an SQL programmer sauntered in and contemplated the table problem. “Mind if I join you?”, he said?  Since the tables were partially occupied and there were no virtual tables available, the host looked on the patio of the restaurant at 2 open tables.  “Shall I do an outside join instead?” asked the programmer?  The host considered their schema and assigned 2 seats to the space.

The writer told the programmer to look at the menu, bill of fare, blackboard – there were so many choices but not enough real nutrition. “Hmmm, I’m hungry for the right combination of food, grub, chow, to help me train for a triathlon” he said.  With that contextual information, they thought about foregoing the menu items and instead getting in the all-you-can-eat buffer line. But there was too much food available and despite its appealing looks in its neat rows and columns, it seemed to be mostly empty calories.  They both realized they had no idea what important elements were in the food, but came to the conclusion that this restaurant had a “Big Food” problem.

They scoped it out for a moment and then the writer did an about face, reversal, change in direction and the SQL programmer did a commit and quick pivot toward the buffer line where they did a batch insert of all of the food, even the BLOBS of spaghetti, mash potatoes and jello.  There was far too much and it was far too rich for their tastes and needs, but they binged and consumed it all.  You should have seen all the empty dishes at the end – they even caused a stack overflow. Because it was a batch binge, their digestive tracts didn’t know how to process all of the food, so they got a stomach ache from “big food” ingestion – and it nearly caused a core dump – in which case the restaurant host would have assigned his most dedicated servers to perform a thorough cleansing and scrubbing. There was no way to do a rollback at this point.

It was clear they needed relief.  The programmer did an ad hoc query to JSON, their Server who they thought was Active, for a response about why they were having such “big food” indigestion, and did they have packets of relief available.  No response. Then they asked again. There was still no response.  So the programmer said to the writer, “Gee, the Quality Of Service here is terrible!”

Just then, the programmer remembered a remedy he had heard about previously and so he spoke up.  “Oh, it’s very easy just <SELECT>Vibe.Data.Stream from INFORMATICA where REAL-TIME is NOT NULL.”

Informatica’s Vibe Data Stream enables streaming food collection for real-time Big food analytics, operational intelligence, and traditional enterprise food warehousing from a variety of distributed food sources at high scale and low latency. It enables the right food ingested at the right time when nutrition is needed without any need for binge or batch ingestion.

And so they all lived happily ever after and all was good in the IT Corporation once again.

***

If you think you know what this fable is about and want a more thorough and technical explanation, check out this tech talk Here

Or

Download Now and take your first steps to rapidly developing applications that sense and respond to streaming food (or data) in real-time.

 

FacebookTwitterLinkedInEmailPrintShare
Posted in Architects, Big Data, Complex Event Processing, Data Integration, Data Synchronization, Hadoop, Marketplace, Real-Time, Ultra Messaging | Tagged , , , , , , , , , | Leave a comment

Non-Clonetroversial Oracle Data Cloning

Cloning

When the average person hears of cloning, my bet is that they think of the controversy and ethical issues surrounding cloning, such as the cloning of Dolly the sheep, or the possible cloning of humans by a mad geneticist in a rogue nation state. I would also put money down that when an Informatica blog reader thinks of cloning they think of “The Matrix” or “Star Wars” (that dreadful episode II Attack of the Clones).   I did.  Unfortunately.

But my pragmatic expectation is that when Informatica customers think of cloning, they also think of Data Cloning software.  Data Cloning software clones terabytes of database data into a host of other databases, data warehouses, analytical appliances, and Big Data stores such as Hadoop.  And just for hoots and hollers, you should know that almost half of all Data Integration efforts involve replication, be it snapshot or real-time, according to TDWI survey data. Survey also says… replication is the second most popular — or second most used — data integration tool, behind ETL.

ClonewocontroCloning should be easy and very natural. It’s an important part of life (at your job).   However, we can all admit that it is also a process that causes many a headache and ruins many a relationship.

Do your company’s cloning tools work with non-standard types? Know that Informatica cloning tools can reproduce Oracle data to just about anything on 2 tuples (or more).  We do non-discriminatory duplication, so it’s no wonder we especially fancy cloning the Oracle!  (a thousand apologies for the bad “Matrix” pun)

Just remember that data clones are an important and natural component of business continuity, and the use cases span both operational and analytic applications.  So if you’re not cloning your Oracle data safely and securely with the quality results that you need and deserve, it’s high time that you get some better tools.

Send in the Clones

With that in mind, if you haven’t tried to clone before, for a limited time, Informatica is making Fast Clone database cloning trial software product available for a free download. Click here to get it now.

FacebookTwitterLinkedInEmailPrintShare
Posted in data replication, Data Synchronization, Database Archiving, Enterprise Data Management, Marketplace | Tagged , , , , , , , , | Leave a comment

It’s Time to Change the Game for Application Data Integration

This week at Informatica World 2013, the Data Integration Hub (DIH) was announced.  It is the first out-of-the-box application for managing data access and distribution across large and complex infrastructures.  It simplifies application data integration projects through the innovative use of publish and subscribe methods to decouple source and destination applicaitons.  Of course we are very excited about the DIH but why should you be?  Well, let me tell you a story…

(more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in B2B, Data Integration, Data Synchronization, Real-Time, Uncategorized | Tagged , , , , , | Leave a comment

Salesforce.com Recognizes Informatica for Cloud Data Integration

This week we got the news that for the fifth year in a row, Informatica Cloud has won the 2012 Salesforce.com AppExchange Customer Choice Award.  Informatica Cloud Integration for Salesforce was recognized as the winner in the very crowded IT and Administration category, which includes administration and IT, data cleansing, integration, IT management and other applications.These awards are based on the number and quality of customer reviews on the AppExchange.  (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Business Impact / Benefits, Cloud Computing, Customers, Data Quality, Data Synchronization, Marketplace, News & Announcements, PaaS, SaaS | Tagged , , , , , , | Leave a comment

The Importance of User Experience to Cloud Integration Adoption

The Informatica Winter 2013 announcement included the following customer quote:

“The Winter 2013 release will accelerate the time it takes to access, integrate and deliver valuable data in order to meet our business imperatives.”

It was also noted that, “the new Informatica Cloud user interface will make the cloud integration solution even more user friendly.”  There are a number of user experience enhancements with this upgrade, so I sat down with Joshua Vaughn, Principal User Experience Designer for Informatica Cloud, to learn more about the impetus behind the new design and features, what’s on the horizon for the future releases, and why user interface (UI) design is so important for cloud applications.

(more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, Data Synchronization | Tagged , , , , , , , , , , , , , , , | Leave a comment

Informatica Advances Cloud Integration and Data Quality

Informatica Cloud Winter 2013 has arrived. This is the fourteenth release of the company’s award-winning family of cloud integration applications and integration platform as a service (iPaaS),  which has now expanded to include Informatica Cloud Master Data Management (MDM). In this post I’ll provide an overview of the new cloud integration and cloud data quality capabilities. Be sure to register for a 30 day trial and/or attend the release webinar on Thursday to see Informatica Cloud in action.

(more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, Data Integration, Data Migration, Data Quality, Data Synchronization, Enterprise Data Management, Marketplace, Master Data Management, News & Announcements, PaaS, SaaS | Tagged , , , , , , , , , , , , | Leave a comment

Informatica Cloud Summer 2012 Release Advances Integration PaaS

Informatica Cloud integration platform as a serviceToday we announced Informatica Cloud Summer 2012, the latest release of our cloud integration applications and integration platform as a service. With this release our continued focus is on building out the cloud platform, which is ideally suited for hybrid IT organizations seeking to keep up with the rapid pace of software-as-a-service (SaaS) application adoption, while ensuring the highest possible return on data – whether it’s cloud-based, social, mobile or on premises. This week and next we’ll be posting a series of articles that will focus on the growing recognition of the importance of data integration to cloud computing success as well as highlighting a few of the new features that will be available to all Informatica Cloud customers with the August upgrade. But to get started, here’s a brief overview of what’s new.  (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, Data Integration Platform, Data Synchronization, PaaS, SaaS | Tagged , , , , , , , , , , | Leave a comment

A Cloud Connector for Google’s Big Data Analytics

Today Informatica announced that we have joined Google’s Cloud Platform Partner Program, with the introduction of a true cloud-based connector for Google BigQuery. Taking advantage of the power of social media, Google made the announcement through their Developer Blog, noting that the new members of their partner program will, “make it much easier to automatically load data from a broad set of sources, as well as to analyze and visualize the data with spectacular dashboards. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, Data Integration, Data Synchronization, Data Warehousing, PaaS, SaaS | Tagged , , , , , , , , , | Leave a comment