Guide to Implementing Business Intelligence - 2 - Merging and Managing Data

It is often assumed that a data warehouse isalways be aware of what's being used and what
imperative to any business, normally because ITisn't, if it's not being used you need to know why,
departments don't want to report directly offif it's simply a case of staff not having the time
their source systems and they decide they needor understanding it, you need to invest the
a data warehouse.resources to rectify this, or if it's genuinely not
Building a data warehouse can be a large andworking you'll need to find an alternative solution.
costly project so you need to consider what realOnce your users see this technology can make
benefits it could bring to your business, you needtheir job easier, you'll start to see the value in
to think carefully about why you're doing it andyour investment.
what the purpose is.This always works from the opposite perspective
Maybe you can report directly off your sourcetoo, if one of your users are told any requests
system by improving the capacity of that serverwill take several weeks or months to action, they
or that hardware you're using. By duplicating andwill soon stop asking and the technology wont be
just reporting off it, you'll very quickly getbeing used to it's full potential.
management information out to people and itData quality will always cause risk because you're
might be adequate, further more, by doing thispulling data from several systems and from
you'll learn your data, and understand the pitfalls inseveral years and this means the chances are the
it.data has been captured in different ways.
This means that you've already solved a lot ofThere are several steps you can take to ensure
the issues and problems if you do decide to buildthe risk is as minimal as possible starting with
a data warehouse in the future, so when you outexposing the data to the end user as soon as
grow reporting directly off your operationpossible because it's their data and it's them who
systems you can then evolve quite easilyare going to be able to resolve whether the data
because you now have more knowledge intois right or wrong.
building a data warehouse.There are plenty of data quality tools that can
One of the biggest challenges you're likely to facehelp when it comes to automating and cleansing
with business intelligence when it comes tothe data that's been gathered. These tools can
ensuring you merge prospective customers ishelp merge and de-dupe the data and they can
making sure your data is merged and collated touse fuzzy look up logic and look up to catalogues.
give you the right information at the right time.If you have units of measurement across your
Your customer relationship management (CRM)product range, these units can be standardized
system may know who your customers are, butand converted to clean your data automatically.
it might not know when one of your customersThe main challenge here is making sure all the
transacts with you.data is standardized and documented as soon as
This can become even more problematic if youpossible. The different business rules are
have several transactional systems and channelsdocumented and shared and this all falls under the
to market. For example, if you were to take aumbrella of a data governance programme to be
football club that may have it's season ticketmanaged, coordinated, and governed.
holders, then turn style ticket holders and a shop.In most companies it will be the finance
You may not know that a customer broughtdepartment that looks after the planning and
something from the shop even though they'vebudgeting using Excel, meaning it's done outside
got a season ticket, so you'd use a datathe core IT systems. The planning and budgeting
warehouse to pull all that data together giving youis a key part of your information management
a single view of the customer that can be sent tothrough monthly or quarterly forecasting which is
the CRM solution and the marketing campaign canoften feed into the management information
be targeted accordingly.systems.
The problem often lies in ensuring the CRMThese two systems ideally should both be
doesn't already have that information andincorporated into the business intelligence solution
duplicating it, as most CRM systems will containbecause it's a key input. This means the data
duplicate data anyway (with different titles,warehousing, business intelligence reporting
names, addresses etc), you need to ensure theprocess, month end reporting and planning and
tools you are using can integrate that databudgeting are actually interlinked and as such you
effectively from the data warehouse into theneed to structure your programme and you
CRM solution and vise versa as the data comesbusiness intelligence deployments taking them into
back.account.
Another major obstacle your business mayWhen we're doing data warehousing and pulling
encounter when implementing a businessdata from many sources, you often have the
intelligence solution is user adoption - getting yoursame data coming from multiple systems causing
staff to actively analyse the data you're producingissues with duplication and inconsistencies. The
and using the data gathered.data quality, customer data or product data often
Just because the IT department has broughthas to be merged into a master set, often the
some new tools, doesn't mean the rest of yourdata warehouse becomes the master data
staff are going to use them, they might not havemanagement product. It's often ideal if you can
the time, they might not see the benefit to themmanage you master data, and put it in as part of
or they simply may not understand it. This meansyour data governance programme early on in the
as part of implementing a new BI solution, youproject then that will help your BI deployment
need to understand your users and deliver thelater on. This means the your master data will be
information to them in a way that's going toknown, you'll know who controls it and the
make them want to use it too. This needs to beprocedures and principles around managing it.
looked at on an ongoing basis, you need to