Tag Archives: Complex Event Processing
Unlike some of my friends, History was a subject in high school and college that I truly enjoyed. I particularly appreciated biographies of favorite historical figures because it painted a human face and gave meaning and color to the past. I also vowed at that time to navigate my life and future under the principle attributed to Harvard professor Jorge Agustín Nicolás Ruiz de Santayana y Borrás that goes, “Those who cannot remember the past are condemned to repeat it.”
So that’s a little ditty regarding my history regarding history.
Forwarding now to the present in which I have carved out my career in technology, and in particular, enterprise software, I’m afforded a great platform where I talk to lots of IT and business leaders. When I do, I usually ask them, “How are you implementing advanced projects that help the business become more agile or effective or opportunistically proactive?” They usually answer something along the lines of “this is the age and renaissance of data science and analytics” and then end up talking exclusively about their meat and potatoes business intelligence software projects and how 300 reports now run their business.
Then when I probe and hear their answer more in depth, I am once again reminded of THE history quote and think to myself there’s an amusing irony at play here. When I think about the Business Intelligence systems of today, most are designed to “remember” and report on the historical past through large data warehouses of a gazillion transactions, along with basic, but numerous shipping and billing histories and maybe assorted support records.
But when it comes right down to it, business intelligence “history” is still just that. Nothing is really learned and applied right when and where it counted – AND when it would have made all the difference had the company been able to react in time.
So, in essence, by using standalone BI systems as they are designed today, companies are indeed condemned to repeat what they have already learned because they are too late – so the same mistakes will be repeated again and again.
This means the challenge for BI is to reduce latency, measure the pertinent data / sensors / events, and get scalable – extremely scalable and flexible enough to handle the volume and variety of the forthcoming data onslaught.
There’s a part 2 to this story so keep an eye out for my next blog post History Repeats Itself (Part 2)
In this video, Richard Cramer, chief healthcare strategist, Informatica, talks about the opportunities for healthcare organizations to move data forward. He touches on relationship analytics, master data management (MDM), data quality and Complex Event Processing (CEP). He specifically answers the following questions:
- What are some of the major opportunities for healthcare organizations to move data forward?
- What technology is most poised to deliver benefits to healthcare organizations today?
- How can Informatica help healthcare organizations in their quest to deliver proactive medicine?
One person’s “real-time” is another person’s “fast enough”. (Or is it vice versa?) I’ve been in the Complex Event Processing (CEP) space for almost five years, and nothing gets this industry more spun up than heated discussions about “feeds and speeds” - the fastest products, the lowest latencies, the greatest event volumes, the most events per second and so on. (more…)
When something is really good, you’ve got to keep using it and last year the award-winning Comedy Central show South Park featured a character called “Captain Hindsight.” I won’t describe it, just watch it and please return to finish reading this blog. Here’s a link to a site with the perfect clip.
You may not know that Complex Event Processing already plays a role in the Super Bowl. Specifically in aiding law enforcement to insure situational awareness for security measures. In 2003, Michael Lewis penned the best seller “Moneyball: The Art of Winning an Unfair Game” which showed the dramatic role information and new analytic approaches can play in fielding a winning baseball team at a (relative) bargain price. It’s only natural for similar thinking to occur in other sports. Here’s five places that CEP can play in the Super Bowl (not all serious).
1) Super Bowl Security – Some agencies already leverage CEP technology to gain situational awareness about activities happening with a close geographic proximity of the big game. Everything from traffic conditions, to shipping logistics & hazardous material routes, to air traffic and regional crime patterns are used to gain a situational threat awareness. (more…)
After much cajoling, I convinced the CEO of North Pole Global to give some insight into how his organization uses CEP to optimize operations and maximize productivity. For years, he’s been unwilling to say a word in fear of giving away a big competitive advantage to his competitors like Hanukkah Harry Inc. and Tooth Fairy Limited. This year, because I’ve been extra good, the big guy has allowed me to ask a few questions, so here goes.
Me: Has anyone actually asked for the Snuggie for Dogs?
Santa: Strangely enough, my wife has requested one but we don’t have a dog.
Me: OK, enough with the warm ups. You are a huge user of CEP. Can you tell me how you were introduced to it?
Santa: My CIO, Shorty McTechie brought it to my attention and to be honest I sat through the first five minutes day dreaming about snicker doodles. I had to interupt him and tell him to get to the point. He said to not think about it as some complex technology but that CEP stood for Complete Elf Productivity. That got my attention for sure. I love the little guys, but sometimes they are stuck in their old ways. I wanted new ideas, new processes and most of all adaptability.
Me: What do you mean by adaptability? (more…)
I can’t believe it. I had a bad experience on a United flight and I’m going to say something nice about them. They did good by me because they were proactive. Have you ever even heard an airline even say “sorry” for a bad experience?
It never happened to me until the other day. Flying back from DC to San Francisco, my armrest audio controls didn’t work and I couldn’t listen and enjoy the inflight entertainment – the movie Eat Pray Love and shows like House. I was frustrated and got even more irate when I thought how hard it might be to lodge a complaint online to the airline. (more…)
Wow! The last three games of the first week all ended in dramatic fashion.
San Diego failed to score a touchdown in the final seconds to tie the game. The Jets lost by one point to the Ravens and in DC, the Redskins avoided a heartbreak when what looked like the winning touchdown for the Dallas Cowboys was waived off because of a holding penalty.
How successful would a team be if the coach did only the following?
- meticulously studied and analyzed the opponents
- prepared a play book
- told all the players the sequence of plays to execute
- then left before the game started and watched it on TV
IE, if the coach ran his team with just a rear-view mirror?
Not very – because football requires responsiveness and constant flexibility. During the course of a game, you have injuries, flukes, odd plays and tons of other things a coach may have never expected. So, a modern coach has to blend the analysis he did prior to game-day with a plethora of real-time event information to make sound decisions based on the situation and capabilities of his team.
Winning football teams do this extremely well. What about companies?
You may have strict customer service processes, but are your customers cookie cutter? Do they all act the same way?
The demand for your product may look consistent when you aggregate and roll-up data, but is it really when you drill into specific demographics? Are you missing out by not being “in the game” with your customers.
Are you being responsive to changes in supply and demand so that your company can appropriately remediate issues.
Maybe your organization doesn’t feel the pressure, but it certainly will. And, here’s the litmus test – if your competitors respond faster to threats and opportunities, how long can you survive and thrive if you don’t keep up?
Check out a great blog post from Gartner analyst Marcus Collins called “Business Insight through Real-Time Analysis on Data in Motion.” Of course, you should also learn about proactive monitoring and operational intelligence from Informatica.