| Measuring BI performance | | | | since people have already lost interest. |
| A question often posed by professionals wanting | | | | In terms of usability, people suggest that as long |
| to know how they can tell if their BI solution is | | | | as the system is being used and is easy enough |
| performing well: How do you Measure Business | | | | to use, then it is performing. But just because a |
| Intelligence Performance? There are of course | | | | team is using BI a lot, does this mean it performs |
| many ways to measure performance (take a | | | | better than a team that only use it occasionally? |
| look at our previous post, 30 Business | | | | Or if your system is particularly simple to use, |
| Performance Indicators you can (and should) | | | | does this make it a better than a system that |
| Measure") which generally boil down to tracking | | | | requires help from the IT department? |
| the quantified monetary benefits against the | | | | Quality could refer to the quality of data used |
| system cost. It is also worth noting that each | | | | with the system, the quality of the system itself |
| industry is different and there are measurement | | | | or the quality of the results derived from the BI |
| parameters that are often industry or function | | | | analysis. Data quality can highly affect the |
| specific. | | | | performance of the BI system as well as the |
| Some performance measures | | | | outcome, placing it as a strong measure of |
| Generally, the most common way of measuring | | | | business intelligence performance. |
| business performance requires measurement of | | | | Reliability - everyone wants a reliable BI solution. |
| some type of goal or KPI, whether it is an initial | | | | Something that will give consistent and accurate |
| or newly formed one. This normally ties in nicely | | | | results. A BI solution could be considered as |
| with measuring ROI. Measurement parameters | | | | well-performing if it always delivers what the user |
| could include, but are not limited to: scalability, | | | | wants. But this measure alone is probably not |
| usability, reliability, quality and adoption/usage. | | | | enough to quantify the performance level of a |
| Before implementing a BI solution there are | | | | business intelligence system... |
| normally some key organizational objectives and | | | | Final thoughts |
| KPIs that have been put in place to work | | | | It has been suggested that at the end of the |
| towards. Measuring business intelligence | | | | day, the success of a BI initiative should be |
| performance based on successful completion of | | | | measured in terms of value creation: whether the |
| these goals alone is perhaps a little too rigid, but | | | | BI solution gives the business the tools to get as |
| certainly using them as indicators of BI | | | | much value out of their data as possible, while at |
| performance can be helpful. ROI, often closely | | | | the same time providing valuable insight that can |
| related to an organization's goals, can be used as | | | | be applied to leverage enough money to cover |
| an easily quantifiable measure of BI success, | | | | the cost of implementing the BI solution and |
| making it perhaps the "strongest" measure | | | | make a profit. What we drew from our research |
| available. | | | | into this topic is that there is no standard way of |
| Adoption/usage has the potential be a really good | | | | measuring BI performance: each organization has |
| indicator, if able to be correctly quantified. A | | | | different ways of measuring performance and |
| common problem with this type of parameter is | | | | quantifying success. It is highly likely that |
| that it's sometimes quantified too late on in the | | | | organizations use a combination of several of the |
| measurement process to be able to make any | | | | above measures, as well as others not mentioned |
| constructive changes - for example, if very few | | | | here, to draw conclusions about the performance |
| people are using your BI system, but you don't | | | | levels of their BI solution. |
| know why, it's more a case of too little too late | | | | |