Tag Archives: Cloud Computing

How Parallel Data Loading and Amazon Redshift Redefine Data Warehousing Performance

As Informatica Cloud product managers, we spend a lot of our time thinking about things like relational databases. Recently, we’ve been considering their limitations, and, specifically, how difficult and expensive it is to provision an on-premise data warehouse to handle the petabytes of fluid data generated by cloud applications and social media.  As a result, companies have to often make tradeoffs and decide which data is worth putting into their data warehouse.

Certainly, relational databases have enormous value. They’ve been around for several decades and have served as a bulwark for storing and analyzing structured data. Without them, we wouldn’t be able to extract and store data from on-premise CRM, ERP and HR applications and push it downstream for BI applications to consume.

With the advent of cloud applications and social media however, we are now faced with managing a daily barrage of massive amounts of rapidly changing data, as well as the complexities of analyzing it within the same context as data from on-premise applications. Add to that the stream of data coming from Big Data sources such as Hadoop which then needs to be organized into a structured format so that various correlation analyses can be run by BI applications – and you can begin to understand the enormity of the problem.

Up until now, the only solution has been to throw development resources at legacy on-premise databases, and hope for the best. But given the cost and complexity, this is clearly not a sustainable long-term strategy.

As an alternative, Amazon Redshift, a petabyte-scale data warehouse service in the cloud has the right combination of performance and capabilities to handle the demands of social media and cloud app data, without the additional complexity or expense. Its Massively Parallel Processing (MPP) architecture allows for the lightning fast loading and querying of data. It also features a larger block size, which reduces the number of I/O requests needed to load data, and leads to better performance.

By combining Informatica Cloud with Amazon Redshift’s parallel loading architecture, you can make use of push-down optimization algorithms, which process data transformations in the most optimal source or target database engines. Informatica Cloud also offers native connectivity to cloud and social media apps, such as Salesforce, NetSuite, Workday, LinkedIn, and Twitter, to name a few, which makes it easy to funnel data from these apps into your Amazon Redshift cluster at faster speeds.

If you’re at the Amazon Web Services Summit today in New York City, then you heard our announcement that Informatica Cloud is offering a free 60-day trial for Amazon Redshift with no limitations on the number of rows, jobs, application endpoints, or scheduling. If you’d like to learn more, please visit our Redshift Trial page or go directly to the trial.

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud, Cloud Computing, Cloud Data Integration, Cloud Data Management | Tagged , , , , | Leave a comment

The Three Ingredients of Enterprise Information Management

Information Management

Enterprise Information Management

There is no shortage of buzzwords that speak to the upside and downside of data.  Big Data, Data as an Asset, the Internet of Things, Cloud Computing, One Version of the Truth, Data Breach, Black Hat Hacking, and so on. Clearly we are in the Information Age as described by Alvin Toffler in The Third Wave. But yet, most organizations are not effectively dealing with the risks of a data-driven economy nor are they getting the full benefits of all that data. They are stuck in a fire-fighting mode where each information management opportunity or problem is a one-time event that is man-handled with heroic efforts. There is no repeatability. The organization doesn’t learn from prior lessons and each business unit re-invents similar solutions. IT projects are typically late, over budget, and under delivered. There is a way to break out of this rut. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in CIO, Data Integration, Enterprise Data Management, Integration Competency Centers | Tagged , , , , , , , , , | Leave a comment

It’s the Most Wonderful Time of the Year (If You’re Into Cloud)

It's the Most Wonderful Time of the Year (If You're Into Cloud)

I know it’s far too soon to be thinking of Christmas, but May is the most wonderful time of the year. That’s because it’s Informatica World week and I get the chance to experience the same tingle of anticipation watching the keynotes as I do on Christmas morning just before the big reveal. “You definitely live a sheltered life!” I hear you cry, but it’s true. In years past, Informatica World has proven to be the zenith of events in our cloud calendar, and this year so far, has not disappointed.

Monday

We began on Monday, or “Cloud Day“, with two banner events. The morning kicked off with the convening of the “Informatica Cloud Product Advisory Council,” hosted by the cloud product team.  This exclusive event consisted of a select group of customers who volunteered their time to speak at “Cloud Day.”

Monday afternoon’s session was open to all Informatica World attendees and proved to be a great networking opportunity as industry peers, cloud integration experts and practitioners all mingled. But it didn’t stop there. There were also keynotes delivered by the industry experts on topics such as cloud security and Analytics and Salesforce integration. If you missed cloud day, take a look at Ashwin Viswanth’s entertaining recap here.

Tuesday

The cloud momentum continued on Tuesday with some fabulous breakout sessions. In particular Conde Nast and Informatica held a session that discussed strategies in moving to a hybrid IT architecture. Informatica product management delivered a well-attended “Informatica Cloud 101” session. The day ended with Qualcomm and Inside Track hosting a lively discussion that explained how they use Informatica Cloud to manage data synchronization between Salesforce and other applications.

Wednesday

Wednesday was the day that kept on giving. It was packed full of sessions on the cloud path and highlighted the breadth of the solution. It started with a fantastic case study from the Weather Channel (yes THAT weather channel). They explained what “cloud first” means to them, and in particular how they built a cloud data warehouse with Informatica Cloud that runs on Amazon’s Redshift.

Next came a road map session from the Informatica Cloud Product Management team. This session gave a look at what’s next for the world’s leading cloud data management platform. It focused on the new web-based process designer that will enable integration developers to build real-time process integrations. Next, ConocoPhillips held a session called “Journey to the Internet of Things with PowerCenter and Informatica Cloud”. Conoco Phillips explained how they use PowerCenter and Informatica Cloud to aggregate data from sensor-bearing oil wells across Alaska and Calgary!

Wednesday’s packed Cloud agenda came to a close with a session from Schneider-Electric and Corvisa Cloud who talked about how they use Informatica Cloud Real Time to improve the operational efficiency of their Salesforce.com implementations by leveraging real-time data.

“Phew! That’s a lot of Cloud expertise in one day”, you say. And I would totally agree. That’s goes to show that I wasn’t lying when I said that I’m excited to hear about all things cloud this week. And I’ve only got to Wednesday. For those of you keeping track, there’s still ANOTHER conference day left.

Thursday

Today, Thursday, plays host to the last two cloud sessions. If your business relies on embedding data into your own applications, then you might want to check out “How Embedded iPaaS Can Transform Your Business”. This session is delivered by RMS who are the vendors of a financial trading application. They will explain how they create seamless and secure connections between its cloud-based suite of financial applications and its clients’ on-premise data sources by embedding Informatica Cloud. They will also discuss in detail how they interface with Informatica Cloud’s REST API’s.

The RMS session should provide enough technical meat for anyone, but if not then you should make your way to the last Informatica session of Informatica World 2014 (let’s all give a collective sigh that they week is almost over. AAAAWWWWWWHHHHHH). The honor of presenting the last session goes to the Informatica Cloud product management team. It’s seems as if we’ve come full circle.

The final session is called “Developing Advanced Integrations in the Cloud” and will show how the new cloud designer helps you aggregate and merge multiple data sources, use Vibe Integration Packages, and connect cloud applications to on-premises applications like Oracle EBS and SAP. The Cloud PM team always does fantastic demos, so this session will be worth missing your flight.

Phew, what a week! Hopefully by now you’ve realized why I think May is the “Most Wonderful Time of the Year”. All sign along now… “It’s the most wonderful time of the year. The cloud team is going and everyone’s knowing it’s nearly here… In-form-atica-World. Is nearly here!”

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, Informatica World 2014 | Tagged , , | Leave a comment

When It Comes to Data Integration Skills, Big Data and Cloud Projects Need the Most Expertise

Looking for a data integration expert? Join the club. As cloud computing and big data become more desirable within the Global 2000, an abundance of data integration talent is required to make both cloud and big data work properly.

The fact of the matter is that you can’t deploy a cloud-based system without some sort of data integration as part of the solution. Either from on-premise to cloud, cloud-to-cloud, or even intra-company use of private clouds, these projects need someone who knows what they are doing when it comes to data integration.

linthicum

While many cloud projects were launched without a clear understanding of the role of data integration, most people understand it now. As companies become more familiar with the could, they learn that data integration is key to the solution. For this reason, it’s important for teams to have at least some data integration talent.

The same goes for big data projects. Massive amounts of data need to be loaded into massive databases. You can’t do these projects using ad-hoc technologies anymore. The team needs someone with integration knowledge, including what technologies to bring to the project.

Generally speaking, big data systems are built around data integration solutions. Similar to cloud, the use of data integration architectural expertise should be a core part of the project. I see big data projects succeed and fail, and the biggest cause of failure is the lack of data integration expertise.

The demand for data integration talent has exploded with the growth of both big data and cloud computing. A week does not go by that I’m not asked for the names of people who have data integration, cloud computing and big data systems skills. I know several people who fit that bill, however they all have jobs and recently got raises.

The scary thing is, if these jobs go unfilled by qualified personnel, project directors may hire individuals without the proper skills and experience. Or worse, they may not hire anyone at all. If they plod along without the expertise required, in a year they’ll wonder why the systems are not sharing data the way they should, resulting in a big failure.

So, what can organizations do? You can find or build the talent you need before starting important projects. Thus, now is the time to begin the planning process, including how to find and hire the right resources. This might even mean internal training, hiring mentors or outside consultants, or working with data integration technology providers. Do everything necessary to make sure you get data integration done right the first time.

FacebookTwitterLinkedInEmailPrintShare
Posted in Big Data, Business Impact / Benefits, Data Integration, Operational Efficiency | Tagged , , | Leave a comment

Helping Information Leaders Put Their Potential To Work

During Informatica World in early June, we were excited to announce our new Potential at Work Community.  You can read Jakki Geiger’s blog introducing the Community to learn more about the goals for this great resource.  (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Big Data, Business Impact / Benefits, Business/IT Collaboration, Data Governance, Data Privacy, Data Quality, Enterprise Data Management | Tagged , , , , , , , , , , | Leave a comment

Hybrid IT and the Latest Informatica Cloud Release

In a recent Information Management blog post, Alex Bakker from Saugatuck Technology noted:

“There is an underlying problem facing many, if not most enterprise IT leaders and organizations: these technologies [Cloud, Mobile, Social, Analytics and Integration] have developed much faster than enterprise IT groups and practices have been able to adopt and manage them.”

Sound familiar? Gartner (and others) have referred to the new reality of enterprise IT as Hybrid IT. At Informatica World next month, we have an entire track on this topic.

The good news is a topic that was once considered the “Achilles heel of cloud computing” is increasingly being recognized as the key enabler of cloud success:  integration and data management. With that in mind, Informatica rolled out our Summer 2013 release this week. Here are some highlights and useful resources. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, News & Announcements, PaaS, SaaS | Tagged , , , , , , | 1 Comment

Five Ways You Can Extend PowerCenter with Informatica Cloud – Part 1

In Ashwin Viswanath’s previous blog post, SaaS Data Integration for SaaS Applications, he explained how SaaS applications are much more dynamic than on-premises business applications with new fields and objects added with just a few clicks. This same agility is required when it comes to integrating SaaS applications, which is why it is important to have a hybrid IT strategy for your data integration architecture. Informatica PowerCenter together with Informatica Cloud can help you get started with such a strategy.

 

FacebookTwitterLinkedInEmailPrintShare
Posted in Cloud Computing, IaaS, PaaS, SaaS | Tagged , | Leave a comment

The Year Ahead: Big Data Reveals its Secrets to Both Data Providers and Consumers

In 2012, we began to recognize the presence of Big Data. In 2013, we will act on Big Data in deep and meaningful ways. This is good news for both data providers and consumers, who are no doubt anxious to begin the process of discovery of the new world opening up to them.

Over the coming year, those organizations who take the lead will be those who have people who understand how Big Data insights can be harvested. Outsmarting the competition means attracting and retaining skilled professionals who know how to manage, mine and draw actionable insights from data streaming into their organizations. That means rising demand for not only technical people who know how to manage Big Data sets, but also for people who can translate Big Data insights into business opportunities. Demand will intensify for professionals who understand the power of Big Data – from either the technical or the business side of data management. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Big Data | Tagged , , , , | Leave a comment

2013 Cloud Data Management Predictions

Ok, I know it’s a little late to post 2013 technology predictions, but with so many good ones published already, I figured I’d sandbag a little and not only post a few of my own but also share a few of my favorites so far. For me, it starts with Mary Meeker’s Internet Trends presentation. 2013 is going to be a year of “re-imagining” enterprise software, from social, to mobile, to cloud, to Big Data and Analytics.

I summarized my 2012 predictions in an earlier post and Informatica already posted some great predictions from the world of data. Here are my 2013 cloud data management predictions. (more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in Business/IT Collaboration, CIO, Cloud Computing, Enterprise Data Management, Integration Competency Centers, Master Data Management, PaaS, SaaS | Tagged , , , , , , , , , | 1 Comment

Cloud Integration Predictions – The Year in Review

For the past few years I’ve been posting my cloud integration predictions. It’s always interesting to look back to see what transpired and evaluate where I scored well and where I was off base. Here’s how I did in 2011: 2011 #Cloud Integration Predictions in Review. My 2012 cloud integration predictions centered around Data as a Service, Master Data Management, Business Intelligence and enterprise IT adoption of all flavors of cloud computing. Before I throw my hat into the 2013 predictions ring, here’s a review of 2012.

(more…)

FacebookTwitterLinkedInEmailPrintShare
Posted in CIO, Cloud Computing, Master Data Management, PaaS, SaaS | Tagged , , , , , , , , , , | 4 Comments