Tag Archives: Collaboration
Adopting Agile may require a cultural shift and in the beginning can be disruptive to an organization. However, as I mentioned in Part 1 of this blog series, Agile Data Integration holds the promise to increase chances of success, deliver projects faster, and reduce defects. Applying Lean principles within your organization can help ease the transition to Agile Data Integration. Lean is a set of principles first explored in the context of data integration by John Schmidt and David Lyle in their book on Lean Integration. First and foremost Lean recommends an organization focus on eliminating waste and optimizing the data integration process from the customers’ perspective. Agile Data Integration maximizes the business value of projects (e.g. Agile BI, Data Warehousing, Big Data Analytics, Data Migration, etc.) because you can get it right the first time by delivering exactly what the business needs when they need it. Break big projects into smaller more manageable deliverables so that you can incrementally deliver value to the business. Agile Data Integration also recommends the following: (more…)
This should be a rhetorical question since the obvious answer is YES, but if an alien from another planet were to observe the behavior of many organizations in regards to business involvement in data quality, the conclusion would be NO. Here are the questions the alien might ask:
- Who makes staff hiring/firing decisions? Line management or HR?
- Who makes investment decisions? Line management or Finance?
- Who is responsible for data decisions? Line management or IT?
The alien observer would quickly determine that Line Management is in charge of managing staff assets and financial assets, but in most organizations it would appear that IT is responsible for managing information assets. Why is this? Has the business abdicated responsibility for information or has IT wrestled it away from line management in some sort of power grab? (more…)
The recent blog post from Forrester Research analysts Clay Richardson and Rob Karel posed an excellent question around synergies between Business Process Management (BPM) and Master Data Management (MDM). Siperian customers have been at the forefront of driving these synergistic requirements that have made the Siperian MDM Hub uniquely suited for bringing together BPM tools such as Lombardi with MDM to enable data governance.
Together with the excellent points made by Clay and Rob, one of the trends we have seen is that most of the integration of MDM and BPM has been focused on the inbound – the creation of master data. But in the outbound – synchronizing master data (from the MDM hub) with downstream systems – BPM has been less leveraged or involved.
Inbound: While an MDM hub automates the merging of a large volume of duplicates, exceptions need to be handled by the data steward in "collaboration" with the data owner/ business user. Additionally, business users are starting to interact with Hub data directly as a “system of entry”, through interfaces like Siperian’s Business Data Director. Both of these inbound scenarios require a “chain of approval” and potentially sophisticated rules for process flow. A BPM tool such as Lombardi integrated with Siperian and leveraging the Hub’s ability to store states (transitional states of records prior to being finally committed to the hub). See a previous blog post The Art of MDM Workflow for more information.
Outbound: Downstream systems that accept the data from the MDM Hub can automatically receive updates through data synchronization. Once the master data is created or updated in the MDM Hub, it can place records onto message queues for EAI style distribution to systems such as CRM/ ERP, allowing those applications to have up-to-date accurate master data. Alternatively, periodic batch exports and updates using ETL can also accomplish this albeit in a non-real time manner. Typically, since there is no human interaction or complex process flow, BPM does not enter into the equation for such processing.
In summary, so far we have seen great use cases for using BPM inbound, not so much on the outbound side. What have been your experiences and do you have situations where you have applied BPM on the outbound?
Just as they say success is 10% inspiration and 90% perspiration, it can also be said that the success of a data integration project is 10% technology and 90% chemistry. And when I say chemistry, I’m not talking about hydrocarbons and nitrates, but the chemistry of people.
The success of any complex data integration depends on how the people that make things happen – the teams of administrators, analysts, managers, end-users, and business partners – can collaborate in establishing the business case, setting requirements, selecting technology, and putting all the pieces together.
However, two of the key players in data integration – analysts and administrators – don’t necessarily see eye to eye, and this is costing enterprises in terms of staff resources and quality. (more…)