Category Archives: Complex Event Processing
Unlike some of my friends, History was a subject in high school and college that I truly enjoyed. I particularly appreciated biographies of favorite historical figures because it painted a human face and gave meaning and color to the past. I also vowed at that time to navigate my life and future under the principle attributed to Harvard professor Jorge Agustín Nicolás Ruiz de Santayana y Borrás that goes, “Those who cannot remember the past are condemned to repeat it.”
So that’s a little ditty regarding my history regarding history.
Forwarding now to the present in which I have carved out my career in technology, and in particular, enterprise software, I’m afforded a great platform where I talk to lots of IT and business leaders. When I do, I usually ask them, “How are you implementing advanced projects that help the business become more agile or effective or opportunistically proactive?” They usually answer something along the lines of “this is the age and renaissance of data science and analytics” and then end up talking exclusively about their meat and potatoes business intelligence software projects and how 300 reports now run their business.
Then when I probe and hear their answer more in depth, I am once again reminded of THE history quote and think to myself there’s an amusing irony at play here. When I think about the Business Intelligence systems of today, most are designed to “remember” and report on the historical past through large data warehouses of a gazillion transactions, along with basic, but numerous shipping and billing histories and maybe assorted support records.
But when it comes right down to it, business intelligence “history” is still just that. Nothing is really learned and applied right when and where it counted – AND when it would have made all the difference had the company been able to react in time.
So, in essence, by using standalone BI systems as they are designed today, companies are indeed condemned to repeat what they have already learned because they are too late – so the same mistakes will be repeated again and again.
This means the challenge for BI is to reduce latency, measure the pertinent data / sensors / events, and get scalable – extremely scalable and flexible enough to handle the volume and variety of the forthcoming data onslaught.
There’s a part 2 to this story so keep an eye out for my next blog post History Repeats Itself (Part 2)
Everyone knows that Informatica is the Data Integration company that helps organizations connect their disparate software into a cohesive and synchronous enterprise information system. The value to business is enormous and well documented in the form of use cases, ROI studies and loyalty / renewal rates that are industry-leading.
Event Processing, on the other hand is a technology that has been around only for a few years now and has yet to reach Main Street in Systems City, IT. But if you look at how event processing is being used, it’s amazing that more people haven’t heard about it. The idea at its core (pun intended) is very simple – monitor your data / events – those things that happen on a daily, hourly, minute-ly basis and then look for important patterns that are positive or negative indicators, and then set up your systems to automatically take action when those patterns come up – like notify a sales rep when a pattern indicates a customer is ready to buy, or stop that transaction, your company is about to be defrauded.
Since this is an Informatica blog, then you probably have a decent set of “muscles” in place already and so why, you ask, would you need 6 pack abs? Because 6 packs abs are a good indication of a strong musculature core and are the basis of a stable and highly athletic body. It’s the same parallel for companies because in today’s competitive business environment, you need strength, stability, and agility to compete. And since IT systems increasingly ARE the business, if your company isn’t performing as strong, lean, and mean as possible, then you can be sure your competitors will be looking to implement every advantage they can.
You may also be thinking why would you need something like Event Processing when you already have good Business Intelligence systems in place? The reality is that it’s not easy to monitor and measure useful but sometimes hidden data /event / sensor / social media sources and also to discern which patterns have meaning and which patterns may be discovered as false negatives. But the real difference is that BI usually reports to you after the fact when the value of acting on the situation has diminished significantly.
So while muscles are important to be able to stand up and run, and good quality, strong muscles are necessary to do heavy lifting, it’s those 6 pack abs on top of it all that give you the mean lean fighting machine to identify significant threats and opportunities amongst your data, and in essence, to better compete and win.
As a Tesla owner, I recently had the experience of calling Tesla service after a yellow warning message appeared on the center console of my car.” Check tire pressure system. Call Tesla Service.” While still on the freeway, I voice dialed Tesla with my iPhone and was in touch with a service representative within minutes.
|Me: A yellow warning message just appeared on my dash and also the center console.
Tesla rep: Yes, I see – is it the tire pressure warning?
Me: Yes – do I need to pull into a gas station? I haven’t had to visit a gas station since I purchased the car.
Tesla rep: Well, I also see that you are traveling on a freeway that has some steep elevation – it’s possible the higher altitude is affecting your car’s tires temporarily until the pressure equalizes. Let me check your tire pressure monitoring sensor in a half hour. If the sensor still detects a problem, I will call you and give further instructions.
As it turned out, the warning message disappeared after ten minutes and everything was fine for the rest of the trip. However, the episode served as a reminder that the world will be much different with the advent of the Internet of Things. Just as humans connected with mobile phones become more productive, machines and devices connected to the network become more useful. In this case, a connected automobile allowed the remote service rep to remotely access vehicle data, read the tire pressure sensor as well as the vehicle location/elevation and was able to suggest a course of action. This example is fairly basic compared to the opportunities afforded by networked devices/machines.
In addition to remote servicing, there are several other use case categories that offer great potential, including:
- Preventative Maintenance – monitor usage data and increase the overall uptime for machines/devices while decreasing the cost of upkeep. e.g., Tesla runs remote diagnostics on vehicles and has the ability to identify vehicle problems before they occur.
- Realtime Product Enhancements – analyze product usage data and deliver improvements quickly in response. e.g., Tesla delivers software updates that improve the usability of the vehicle based on analysis of owner usage.
- Higher Efficiency in Business Operations – analyze consolidated enterprise transaction data with machine data to identify opportunities to achieve greater operational efficiency. e.g., Tesla deployed waves of new fast charging stations (known as superchargers) based upon analyzing the travel patterns of its vehicle owners.
- Differentiated Product/Service Offerings – deliver new class of applications that operate on correlated data across a broad spectrum of sources (HINT for Tesla: a trip planning application that estimates energy consumption and recommends charging stops would be really cool…)
In each case, machine data is integrated with other data (traditional enterprise data, vehicle owner registration data, etc.) to create business value. Just as important to the connectivity of the devices and machines is the ability to integrate the data. Several Informatica customers have begun investing in M2M (aka Internet of Things) infrastructure and Informatica technology has been critical to their efforts. US Xpress utilizes mobile censors on its vast fleet of trucks and Informatica delivers the ability to consolidate, cleanse and integrate the data they collect.
My recent episode with Tesla service was a simple, yet eye-opening experience. With increasingly more machines and devices getting wireless connected and the ability to integrate the tremendous volumes of data being generated, this example is only a small hint of more interesting things to come.
Data is everywhere. It’s in databases and applications spread across your enterprise. It’s in the hands of your customers and partners. It’s in cloud applications and cloud servers. It’s on spreadsheets and documents on your employee’s laptops and tablets. It’s in smartphones, sensors and GPS devices. It’s in the blogosphere, the twittersphere and your friends’ Facebook timelines. (more…)
Join us this year at Informatica World!
We have a great line up of speakers and events to help you become a data driven healthcare organization… I’ve provided a few highlights below:
Participate in the Informatica World Keynote sessions with Sohaib Abbasi and Rick Smolan who wrote “The Human Face of Big Data” — learn more via this quick YouTube video: http://www.youtube.com/watch?v=7K5d9ArRLJE&feature=player_embedded
With more than 100 interactive and in-depth breakout sessions, spanning 6 different tracks, (Platform & Products, Architecture, Best Practices, Big Data, Hybrid IT and Tech Talk), Informatica World is an excellent way to ensure you are getting the most from your Informatica investment. Learn best practices from organizations who are realizing the potential of their data like: Ochsner Health, Sutter Health, UMass Memorial, Qualcomm and Paypal.
Finally, we want you to balance work with a little play… we invite you to network with industry peers at our Healthcare Cocktail Reception on the evening of Wednesday, June 5th and again during our Data Driven Healthcare Breakfast Roundtable on Thursday, June 6th.
See you there!
I joined Informatica five months ago — it didn’t seem like the “I’m new here card” kept things slow for very long and now, being four weeks from HIMSS, I’m in the middle of a familiar flurry activity. Each year, I am reminded that times change, the location changes, where I am working may shift but some things stay the same. At the top of the stay the same list is the passion we all have for healthcare IT… oh, and the familiar faces I look forward to reconnecting with!
Let me tell you a bit about what we have planned for HIMSS 2013. In the coming weeks, we will make exciting product announcements so watch this space. As a precursor, download our latest whitepaper on Healthcare Data Management.
Next, and probably the highlight that I am most excited about, we have one of our customers joining us during the conference. With a prominent NOLA presence, Jonathan Stevenson, Director of Analytics at Ochsner Health System, will be in our booth. Jonathan will share the Ochsner analytics vision and accomplishments. Ochnser relied on the Informatica Platform to migrate data from 38 clinical applications into Epic and then designated Informatica as their enterprise integration platform. As they enter the next phase of their analytics journey, the platform plays a key role in enabling business, clinical and IT collaboration with the ability to streamline development and improve confidence through improved data quality.
We are also excited to increase our booth presence this year and with two partners joining us to exhibit their solutions. The first being HighPoint Solutions and the second being announced closer to the show. Together we will demonstrate joint offerings and examples of innovations in healthcare.
HIMSS would not be complete without social events. One in particular that I want to mention is a meet and greet reception, Monday, March 4th 6:00pm-8:00pm; we are co-sponsoring with dbMotion. If you’d like to attend, contact us via email@example.com. If you can’t meet us at our booth, please let us know and we’ll be happy to arrange a separate time to meet.
Watch this Ochnsner YouTube video and then stop by booth 5005 and learn how Informatica can help you to unlock the potential of your data. Stop by to find out how you can win daily cash prize giveaways.
As always, please feel free to post comments or questions.
The world has gone mobile. Among consumers, the younger generation has grown up connecting via mobile devices rather than computers. In some developing countries, entire societies have skipped over computers directly to their smartphones to connect and interact. More and more enterprises are providing their workforce with mobile devices, or enabling “bring your own device”.
And mobile devices are just a tip of the machine-generated data iceberg. We are experiencing geometric growth in data being generated by machines and devices, ranging from mobile phones and tablets to smart meters to RFID tags to equipment sensors. There are billions of machines creating deluges of real-time data. And most traditional IT systems are simply not equipped to handle this type of big data. (more…)
In this video, Richard Cramer, chief healthcare strategist, and Scott Fingerhut, senior director, product marketing, CEP, Informatica, discuss healthcare and CEP (Complex Event Processing).
Richard and Scott cover the following topics:
- What is CEP;
- How CEP pertains to healthcare;
- How CEP differs from data warehouse analytics;
- What some of the applications of CEP are in the healthcare environment; and,
- Where the opportunities are for companies who have already invested heavily in meaningful use and EHRs.
As the federal government reported an estimated $115 billion in improper payments in Fiscal Year 2011, the impetus to eliminate and recover these funds continues to mount. State governments also struggle with mounting and often embarrassing improper payments with estimated totals approaching $125 billion. (more…)
In this video, Richard Cramer, chief healthcare strategist, Informatica, talks about the opportunities for healthcare organizations to move data forward. He touches on relationship analytics, master data management (MDM), data quality and Complex Event Processing (CEP). He specifically answers the following questions:
- What are some of the major opportunities for healthcare organizations to move data forward?
- What technology is most poised to deliver benefits to healthcare organizations today?
- How can Informatica help healthcare organizations in their quest to deliver proactive medicine?