The results of the audit process for the X components should include an identification of strengths and weaknesses for each X Factor (component). The Audit Response Plan turns the results from the BI-CMM audit into an action plan for the improvement of business intelligence. The results of the ARP process are the Action Response Plan and a set of X/Y relationship maps. The ARP process includes a step by step process for assessing and prioritizing the improvement actions.
We have identified and described those factors which indicate quality within the Business Intelligence product (Y Factors) as well as those factors which may impact the quality of the product. We have also defined a set of metrics and processes which will allow us to monitor the quality factors and to audit the underlying causes of any quality deviations.
In the Action Response Planning process, we correlate the X Factor Audit results with the product quality factors; and develop a plan to use the monitoring and audit results in the most effective manner for improving the quality of the Business Intelligence product.
The Action Response Plan
In order to use the audit results most effectively, we will need to formulate a plan which includes
Identification of those causal (X) factors which need improvement; those which are effective; as well as, those which are exceeding expectations.
Detailed Actions necessary to correct and/or improve those factors which are identified as ‘needs improvement’ or other factors for which auditors have recommended action.
Develop list of actions recommended to take advantage of any lessons learned from those ‘exceeds expectations’ areas.
Anticipated costs, resources, and time requirements for each Action Response, i.e. project.
Some assessment of the degree of impact of the actions.
Setting of priorities in the implementation of corrective and improvement action response projects.
The Six Sigma Project Portfolio
Develop a project portfolio by grouping the improvement actions into activities and goals which are related and which can be tackled as a single project. Reminder. The definition of a project is - a temporary endeavor with a beginning and an end; creates a unique product, service or result; and is progressively elaborated. The last phrase means that we may not have full clarity or details for the project initially. What we will have are the audit results which show the assessment of the performance of the components. We will also have a set of improvement actions and goals which have been determined by the Action Response Team.
Assessing and Prioritizing the Six Sigma Project list
We have to decide exactly which set of actions and goals to tackle first. How will we do this?
The goals are:
Make the most improvement as fast as possible.
Make that improvement visible and as dramatic as possible
Make the best use of resources
Provide tangible measurable quality improvement
Note - These goals should be overridden if there are other organization requirements.
What do we need to know and do
Identify least cost, most return projects
Identify fastest return project
Determine which critical to quality factors will be impacted by the actions to be taken
What are the risks for each project and how do we assess them.
Project team should
Identify and describe goals
Assess Risks for each project
Determine resource needs, time and expected results for each project
Prioritize the projects
Select the project teams
Launch the project(s)
X/Y Factor Correlations
The Improvement Planning process requires that we understand the relationships between the quality factors (Y) which are monitored for the business intelligence product and the X factors which provide the foundation for creation and management of business intelligence. Each of the X factors are described in individual Chapters 11 through 19. We analyze and rate the effectiveness of each of these factors through the audit process. If there is a quality issue as indicated by the results for one or more of the Y Factors being monitored, then we need to be able to identify the the specific X Factors which are most likely causing the identified problem. In other words, we need to be able to correlate specific quality issues with a limited number of the X factors. This will allow us to focus on making changes in those areas which are most likely to effect improvement in the area of concern.
The audit results will give us some rating of the operational effectiveness, i.e, the capability maturity level, for each X factor. Thus, out of this multitude of X Factors, we define as specifically as possible what are the most probable causes of any quality issues with the Business Intelligence product. This is more complicated than is indicated by the short description here. There are number of things to consider in making some decisions about what is causing identified quality issues. However, the correlation of the Y and X factors are a start. You may have to make some trial changes in the X factor(s) to determine some of the causes.
By first correlating the most likely ‘cause and effect’ factors, we can then apply the audit results to an action response plan which will focus on those areas we wish to treat as a priority.
The X/Y Factor correlations are identified and described in later sections. The Y Factors, which are monitored to assess the quality of the business intelligence product, included in our set of correlations are: Performance, Reliability, Quality of Information, Meets Business Requirements, Format, Velocity, Availability, Comprehension, Support and Training. For each of these Y factors, those X Factors which are most likely to impact that specific aspect (i.e. as represented by the CTQ Y factor) of business intelligence product quality are identified. In each case, some commentary on the rationale for the correlation is described.
Using the X/Y Factor Correlations
Prioritizing the improvement actions. Use the X/Y factor correlations to assist in the planning process. Some quality issues are more critical than others and require more immediate attention. If you can isolate the basic reasons for those specific quality problems, then correction activities can be concentrated on those X Factor corrections.
Use as a guideline, only. In each set of correlations described, the most likely X Factors are identified. However, this is not to say that the remainder of the X Factor categories have no impact on the Y Factor under review. In any case, study the materials as presented and then review your own organization constructs for an expanded view. You may decide that other factors are more likely to impact the Y quality factor under consideration within your organization.
The Relationship Maps: The X/Y Factor Correlations
X Factors: The Organization, People and Business Processes
The Organization, People, and Business Processes. Each of these may be reasonably correlated to any, and all, of the quality (Y) factors. In fact, because of the pervasive nature of these areas, the relevant audit results should be studied, and decisions made for action, prior to any responsive actions for the remainder of the X Factors. Problems in these areas (i.e. the Organization, People, and Business Processes) may mask and/or exacerbate any quality issues from other impacting factors. There also may be common problems which have an influence on multiple aspects of quality for the business intelligence product. Strong consideration should be given to placing a first priority on any corrective actions which are decided necessary in these areas.
X Factors: The Business Intelligence Asset Base
The X/Y Factor Correlations in this section identify the relationships between the Business Intelligence Asset Base components and those Y factors which are specific to the customer who is an end user of the system. (Note: two categories of customers have been described in earlier chapters - the end user and the organization.)
Each of the Y Factors and the relevant metrics for monitoring and accompanying alerts are discussed in the section on X/Y correlations.