Over the last several months, my colleague VP and Research Director Tony Cosentino and I have been assessing vendors and products in the business intelligence market as part of our upcoming Value Index. Tony recently wrote about the swirling world of business analytics, covering many of the dynamics of this industry. He and I have been reviewing the breadth and depth of over 15 of these vendors using our Value Index methodology, which examines the products closely in terms of usability, adaptability, reliability, capability and manageability. As we have gone through this analysis, we see the dashboard as the most common tool for displaying business intelligence. The early forms of dashboards appeared in the 1980s, but in my honest evaluation, today’s dashboards have not gotten much more intelligent in all those years. The graphics have gotten better, and we can interact with charts in what is commonly called visual discovery so you can drill into and page through data to change its presentation. So some progress has been made, but the basic presentation of a number of charts on the screen has not improved significantly and worse yet neither has the usefulness of the charts. Let’s face it: It’s a big mistake to place several bar and pie charts on a screen side by side and assume that business viewers will know what they mean and what is important in them. We cannot assume that individuals in an audience have the ability to interpret charts and draw the right conclusions from them; just being pretty or interactive will not communicate the desired message.
The lack of adoption of business intelligence that includes dashboards is notorious in this industry, and so are the billions of dollars that companies have spent on BI products in the last decade. It is not helpful to make a big statement that the technology has failed; we should look for reasons that have held it back. Here we might start by questioning whether the tools present the right information in a useful form for business people or if organizations have properly configured what tools they have purchased. If the goal is to inform them through dashboards, then maybe we need to make it explicit what the dashboard or collection of charts actually mean. Typically, this means describing in words the issues or priorities that need to be examined further. A little discipline in populating the dashboard could help, such as presenting only the charts that clearly point out issues that need attention and determining which ones to use by applying analytics. If we ask why Microsoft PowerPoint is so popular as a business intelligence tool, we probably would find that the answer is the descriptive text boxes that accompany charts, providing summary sentences or emphasizing specific bullets in a list on the slide. While many people do not like the static nature of Microsoft Excel based charts in presentations or PDF versions of them, they do through human intervention with annotation and commentary provide better explanation of the charts than dashboards are doing today. If we expect our organizations to move beyond personal productivity tools and work in a collaborative enterprise environment with dashboards, we better understand how business intelligence should adapt to the way people work and operate not the other way around. In this case it may not be true that, as the old saying goes, one picture is worth a thousand words but a hundred or so hundred words explaining the relevance of the chart could really help.
Many technology vendors believe they need to provide better context in their dashboards, so they try to align the charts to the geographic area of focus, or to the product line of responsibility or to management key performance indicators to make them more usable. Providing better role-based dashboards that are generated based on the individual’s level of responsibility and the business context is a good first step, though most business intelligence vendors do not provide this level of support. But just presenting charts tuned to the context of the individual’s role that may or may not require action is not enough. We need to prioritize the information and make it like the news, with headlines and stories that people can read to determine if they need to make decisions or take action. Whether you are reading the physical or the digital version of The Wall Street Journal or USA Today, newspapers have survived over the centuries as the main source of what humans read in formats they can comprehend. When is the last time you saw a dashboard that communicated the story of its charts and explained the analytics? Well, once upon a time analytics and logic were applied to generate stories, in the early 1990s in a product called IRI CoverStory. Then it was classified as an expert system that programmatically would create English sentences based on the interpretation of the analytics in a memo that the system created. I would even be happy if we had titles and sub-titles to the charts that were dynamically created and represented something to guide an individual to what the purpose of the chart is to represent. Many of the current business intelligence technologies do not even allow for a free form text box that can be placed besides a chart which is really sad as this is one of the most basic methods used in business today. It would be great if dashboards could make these steps forward and make it easier to understand what is presented, but 20 years later, they have not.
Another thing dashboards need to do is help individuals take action based on the information they receive. My colleague Robert Kugel has written about action-oriented information technology frameworks and how they can help increase the productivity and effectiveness of our workers. To date, most developments of the notion of an action-enabled dashboard have focused on data discovery and supporting root-cause analysis; that can’t match the familiar people type actions that happen in our organization – collaboration through dialogue to address issues and opportunities.
Some of my industry colleagues have written books on dashboards to capitalize on the hype surrounding the topic. It’s about time for a set of books about the death of the dashboard or moving beyond dashboards; the current designs are not advancing the ability to take appropriate action on the information presented or provide the right level of guidance using analytics. We are entering the next wave of discussion on visual discovery, but so far much of this focus is just about using visualization on greater volumes and velocity of data, not making it more useful for the general population of business users. If we want to learn from the disappointing decades of business intelligence deployments, then we should find out what our business users really need to take action and make decisions on the information; delivering prettier charts won’t help. Until then, we are just perpetuating the past, and we know it has not had the best track record in advancing usefulness and adoption of business intelligence and dashboards.
I will follow up on this rant of the state of dashboards by writing about the lack of improvement in the types of metrics and indicators as they relate to overall business analytics, which are another source of the problems that underlie our current methods of delivering and providing access to analytics through business intelligence. We all can do a much better job in meeting the needs of business and truly advancing the usefulness of technology that still holds promise for significantly impacting organizations’ effectiveness.
Regards,
Mark Smith
CEO & Chief Research Officer

Business Exchange
Google+
Klout
Kred
LinkedIn
Plaxo
Twitter
Facebook Fan Page
Ventana Research Website
27 comments
Comments feed for this article
August 22, 2012 at 12:39 pm
Allen Woods
Very interesting article. You are right. I don’t suppose you would like to hear about a better way to do things and take a look at a case study and tools to demonstrate?
August 22, 2012 at 12:54 pm
weckerson
Mark, I think it’s rather comical that you deplore the state of dashboard visualization and then call for adding text and bullet lists to make it look more like a newspaper. Sounds like you want to take visualization back to the stone age.
The only thing wrong with dashboards is the metrics people populate them with, and that’s beyond the realm of vendor-supplied software (but not vendor-supplied or other services.) With the right metrics–meaning ones aligned with key objectives–there is really no discussion about what the metrics mean and how to interpret them, unless executives don’t have a clue about how to lead and communicate what’s important to their department, unit, or company.
In reality, most dashboards contain metrics that most employees already understand and know how to impact, especially operationally oriented dashboards. If they don’t, the dashboards don’t get used, and the owners retool the metrics or scrap the project.
So, dashboard effectiveness has less to do with the state of visualization technology or techniques than the business sense of the people implementing them. Technology can enhance and automate a lot of things, but it can’t overcome brain-dead business people. A tool in the hands of a fool is still just a tool.
August 23, 2012 at 6:26 pm
The Stupidity of KPIs in Business Analytics «
[...] my last rant, on business analytics and the pathetic state of dashboards, I pointed out significant flaws in business intelligence software created by technology providers [...]
August 23, 2012 at 6:28 pm
The Stupidity of KPIs in Business Analytics «
[...] my last rant, on business analytics and the pathetic state of dashboards, I pointed out significant flaws in business intelligence software created by technology providers [...]
August 23, 2012 at 6:45 pm
Closing the Analytics Skills Gap «
[...] to see work done in terms of simplifying tools. We still have a long way to go, as my colleague Mark Smith pointed out earlier this [...]
August 23, 2012 at 6:45 pm
Closing the Analytics Skills Gap «
[...] to see work done in terms of simplifying tools. We still have a long way to go, as my colleague Mark Smith pointed out earlier this [...]
August 24, 2012 at 4:33 pm
Don't Be a Modern BI Dashboard Hater | InsightSquared
[...] Smith, CEO & Chief Research Officer of Ventana Research, laid down in his perspective: “The Pathetic State of Dashboards.” Double [...]
August 25, 2012 at 6:13 pm
Dashboard Agonistes! « BI Professional
[...] Ventana Research CEO Mark Smith has an interesting blog post up with the subtle title “The Pathetic State of Dashboards”. [...]
August 27, 2012 at 2:47 am
Computer Mouses – 3 reasons to hate BI dashboards
[...] Ventana Research’s Mark Smith has something to say about today’s BI dashboards. Basically, they’re “pathetic.“ Why? They’re essentially a bunch of bar charts squeezed onto a page. He provides [...]
August 27, 2012 at 1:38 pm
Robert Woo
Think you’re right on a lot of points. Dashboards have to be a lot more actionable and easier to understand. Saw this articled linked on ZDnet and had to craft a response:
http://www.insightsquared.com/2012/08/dont-be-a-modern-bi-dashboard-hater/
August 27, 2012 at 1:40 pm
roberthwoo
Had to craft a response to defend some BI dashboards out there, especially in the Saas/PaaS space.
http://www.insightsquared.com/2012/08/dont-be-a-modern-bi-dashboard-hater/
August 28, 2012 at 3:32 pm
Rich
Couldn’t agree w/you more…especially on the lack of action-ablility inherent in most BI assets including dashboards. Action-ability may not a very feasible dashboard characteristic at the executive level, but it certainly is at the middle-mgmt/operational level.
September 5, 2012 at 2:05 pm
10 Keys to BI Dashboard Success: Part I | Business Intelligence Blog from arcplan
[...] have been getting a lot of flack lately, especially in blog posts about why they're pathetic or why you should hate them. I get it – dashboards have been a staple of business intelligence [...]
September 6, 2012 at 4:27 am
Big Data without the Big Wait: An interview with Marius Moscovici, CEO of Metric Insights - Social Marketing Fella Social Marketing Fella
[...] his article, “The Pathetic State of Dashboards,” Mark Smith of Ventana Research stresses the importance for BI solution providers to find a way [...]
September 15, 2012 at 12:07 am
Oracle Presents a Taleo Future for Human Capital Management «
[...] that workforce analytics needs to provide more guidance and a profile-based approach – not just showing dashboards with charts or only looking at key performance indicators – but Oracle’s planned improvements for 2013 [...]
September 17, 2012 at 2:06 pm
Oracle Presents a Taleo Future for Human Capital Management «
[...] that workforce analytics needs to provide more guidance and a profile-based approach – not just showing dashboards with charts or only looking at key performance indicators – but Oracle’s planned improvements for 2013 [...]
September 21, 2012 at 7:36 pm
Salesforce Struggles to Deliver on the Dream of Analytics «
[...] said, having lots of charts on the screen with the same color array does not work. If you read my recent rant on the pathetic state of dashboards then you should realize that the current practice of placing a series of charts on a screen is now [...]
September 21, 2012 at 7:37 pm
Salesforce Struggles to Deliver on the Dream of Analytics «
[...] said, having lots of charts on the screen with the same color array does not work. If you read my recent rant on the pathetic state of dashboards then you should realize that the current practice of placing a series of charts on a screen is now [...]
September 26, 2012 at 8:27 am
Nick Patrick
I agree with wreckerson’s point, I’m finding that the key to whether dashboards are deemed successful or not, is less down to numbers/text, whizzy charts or not, but whether the information held within them is relevant for the user base that uses them.
So often I see dashboards containing way too much information for the majority of the audience. Without effectively capturing key requirements for each set of users, whether they be exec, finance, sales etc, you risk losing the buy in from these end users. Subsquently i’ve seen hundreds of examples of nice looking dashboards, that aren’t used, and some poor dashboard examples (in terms of how whizzy the charts look), that are now critical to business success, simple because they highlight the right information to the right people.
If you want to see whizzy dashboards that work effectively with text, in a way like you’ve never thought possible before, then there is no other solution out there quite like Roambi Flow (http://www.roambi.com/flow-overview.html). Some of my clients use this and it really is changing the way they do business.
September 26, 2012 at 8:32 am
Nick Patrick (@smarternick)
I agree with wreckerson’s point, I’m finding that the key to whether dashboards are deemed successful or not, is less down to numbers/text, whizzy charts or not, but whether the information held within them is relevant for the user base that uses them.
So often I see dashboards containing way too much information for the majority of the audience. Without effectively capturing key requirements for each set of users, whether they be exec, finance, sales etc, you risk losing the buy in from these end users. Subsquently i’ve seen hundreds of examples of nice looking dashboards, that aren’t used, and some poor dashboard examples (in terms of how whizzy the charts look), that are now critical to business success, simple because they highlight the right information to the right people.
If you want to see whizzy dashboards that work effectively with text, in a way like you’ve never thought possible before, then there is no other solution out there quite like Roambi Flow (http://www.roambi.com/flow-overview.html). Some of my clients use this and it really is changing the way they do business.
October 19, 2012 at 8:05 pm
Big Data without the Big Wait: An interview with Marius Moscovici, CEO of Metric Insights - bigdatagal.com : bigdatagal.com
[...] his article, “The Pathetic State of Dashboards,” Mark Smith of Ventana Research stresses the importance for BI solution providers to find a way [...]
November 14, 2012 at 3:11 am
The future of dashboards, if any | DBMS 2 : DataBase Management System Services
[...] intelligence dashboards are frequently bashed. I slammed them back in 2006 and 2007. Mark Smith dropped the hammer last August. EIS, the most dashboard-like pre-1990s analytic technology, was [...]
November 20, 2012 at 7:34 pm
Quill Brings a Narrative of Insights to Business Analytics «
[...] time, organizations are dissatisfied with trying to gain insight from dashboards of charts; see “The Pathetic State of Dashboards”. The worst thing wrong with business analytics today is that we are not able to read them [...]
January 4, 2013 at 10:11 pm
Happy New Year: Build on Foundation of Lessons Learned in 2012 «
[...] that this will help organizations improve performance. My title maybe caused some stir – The Pathetic State of Dashboards – but it helped instrument a dialogue on what business needs to see and do with the results of [...]
January 5, 2013 at 6:01 pm
Happy New Year: Build on Foundation of Lessons Learned in 2012 «
[...] that this will help organizations improve performance. My title maybe caused some stir – The Pathetic State of Dashboards – but it helped instrument a dialogue on what business needs to see and do with the results of [...]
February 16, 2013 at 12:11 am
Why Business Intelligence Software is Failing Business «
[...] evaluation criteria for BI technology, outpacing functionality (49%) and even manageability (47%). The pathetic state of dashboards and the stupidity of KPI illustrate some of the obvious ways the software needs to improve for [...]
February 16, 2013 at 12:29 am
Why Business Intelligence Software is Failing Business «
[...] criteria for BI technology, outpacing functionality (49%) and even manageability (47%). The pathetic state of dashboards and the stupidity of KPI illustrate some of the obvious ways the software needs to improve for [...]