Simple QA Testing Dashboard

Dashboard Topic: Quality Assurance Testing Dashboards

Executive Dashboard projects sometime tend towards the complex end of the design spectrum in terms of the numbers of features and bells/whistles in the user interface. It’s good to take a step back now and then to take a look at what users really need to see in their dashboards. I found this great pdf on a low tech QA testing dashboard that brings us back to basics in how a performance dashboard is used. It was presented as part of a keynote speech for a software testing conference.

Take a look at this simple qa dashboard:

Performance Dashboard for QA Testing

It’s important to note that the performance dashboard shown above is meant to be drawn on a whiteboard and used in a room. The author sketches out the typical setup:

Room set up with QA testing dashboard

Here are some key points in using the QA testing dashboard:

The dashboard answers the following main questions:

What is the status of testing?

What are you doing today?

When will you be finished?

Why is it taking so long

Have you tested (insert specific item here) yet?

This dashboard is effective because:

Management has little patience for detailed test status reports

Management doesn’t understand testing

Read the pdf to see the particulars of using this simple dashboard. The low tech approach is startlingly simple and I think it an appropriate exercise to see how it would apply to your particular dashboarding problem.

Tags: Back to Basics Dashboard, QA Dashboard, Quality Assurance Testing Dashboard

Video on the What, Who, How and Why of Enterprise Dashboards

An Enterprise Dashboard Video! This just out –  a Cnet news enterprise dashboards video segment by Shadan Malik, in which he white boards and discusses the basics of the what, who, how and whys of enterprise dashboards.

Well worth the 3 1/2 minutes to watch, this video provides a quick grounding of business intelligence dashboard basics. It’s a great shortcut to getting someone up to speed on the topic of enterprise dashboards or to someone on the IT side who needs to quickly articulate the business value and benefits of enterprise dashboards. The video explains the rationale and advantages of dashboards as well as a look at some implementation issues. I would rate this video as a “much-watch”.

This blog has long mentioned the Shadan Malik book, Enterprise Dashboards, Design and Best Practices for IT, as the only book available that focuses on the implementation of enterprise dashboards. The author has an excellent explanatory style that comes across both in the book and this quick video.

I’m excited by the growing exposure that enterprise dashboards is getting. I strongly believe in the visual orientation, user-centeredness, and business value of dashboards and look forward to their mass adoption as the face of business intelligence. Let’s all do our share in promoting the use of enterprise dashboards.

Shadan Malik Video on Enterprise Dashboards on CNET

Note: If your organization realizes the value of presenting metrics through dashboards but lack the in-house dashboard development knowledge, why not look in to the concept of OEM Dashboards?

Dashboard OEM is a concept where you simply use an off-the-shelf dashboard product such as that from Klipfolio to power your own dashboard project. Think of it as simply “embedded dashboards“.

Homework: Want to see a random sample enterprise dashboard screenshot from the largest collection of dashboards? You sure do!

Also: Who is Shadan Malik?

This from a profile found on the web:

Shadan Malik is the writer of the book Enterprise Dashboards: Design and Best Practices for IT and an architect at iViz Group. WIth 12 years of experience implementing, architecting and deploying business intelligence solutions and a breadth of experience in advance analytics, data warehousing and data visualization, he has worked with dozens of companies to architect and envision dashboard solutions such as scorecards, finance, operations, customer service, quality control and supply chain. He has two pending patents in the area of data visualization for dashboards, and he frequently speaks at various forums on the topic of best practices for enterprise dashboards.

Here is a sample of Mr. Malik’s thinking regarding the use of the “cockpit dashboard” metaphor:

David Nortonand Robert Kaplan draw the analogy between an aircraft dashboard and anorganizational need for similar information tools in their landmark book on the subject of Balanced Scorecards: Skilled pilots are able to process information from a large number of indica-tors to navigate their aircraft. Yet navigating today’s organizations throughcomplex competitive environments is at least as complicated as flying a jet.Why should we believe that executives need anything less than a full batteryof instrumentation for guiding their companies. Managers, like pilots, needinstrumentation about many aspects of their environment and performance tomonitor the journey toward excellent future outcomes.2If we agree that effective management of organizations requires informa-tion tools similar to those required by a pilot for flying an aircraft, we havea useful starting point to describe the basic characteristics of an organiza-tional dashboard. Contrary to the evident simplicity of an information dashboard, deployingan effective dashboard for a large organization is usually no less a complextask than doing the same for a jet. By no means do I mean to undermine thechallenge of developing cockpit dashboards handled by aeronautical engineers, but it would be fair to assume that all aircraft dashboards display the same set of key performance indicators (KPIs), such as the aircraft speed,altitude, direction, wind speed, humidity, fuel status, engine temperature, lat-itude, longitude, and so forth. The various aircraft manufacturers may havedifferent ergonomic designs for their dashboards, but essentially they allhave to deliver to the pilots the same set of KPIs critical for a successfulflight. The same applies to automotive dashboards. This leads to the ease ofreplication whereby an aircraft or automobile manufacturer may replicatethousands of dashboards in an assembly line to equip their aircrafts or cars,as the case may be.However, in contrast to an aircraft or automobile, each organization hasa set of KPIs that differs significantly from those of another organization.Even if two organizations are within the same industry or are close com-petitors, they rarely share an identical set of KPIs. Each organization’s busi-ness and organizational management has evolved differently, and eachdivision within a given organization has separate sets of KPIs relevant toitself. Finance, Supply Chain, Human Resources, Sales and Marketing—they all have their own set of KPIs that result in different types of dash-boards. Although many KPIs are commonplace and standard by definition,such as gross revenue, net profit, gross margin, asset turnover ratio, and soon, each organization has unique nuances of self-management. This diver-sity in evolution and need necessitates conducting a thorough and individu-alized requirements analysis in order to build customized and effectivedashboards for each organization. This provides a sharp contrast to the man-ufacture of thousands of cars and aircrafts with identical dashboards in an assembly-line process.

So who is the Dashboard Spy? No one really knows, but his growing collection of enterprise dashboard screenshots has captured the imagination of the executive dashboarding community. From excel dashboards and custom-built business scorecards, to xcelsius and flex-based visualizations, the dashboard screenshots at enterprise-dashboard.com serve both as nuggets of inspiration and warnings of what not to do on an enterprise dashboard. These hits and misses will enlighten and entertain. Technology-neutral, and always business-driven, the Dashboard Spy website is the place to go to learn about the latest enterprise dashboard implementations.

Email Spam Management Dashboard

A reader who is both an enterprise dashboard enthusiast and professional email spam fighter sent me a screenshot of the dashboard he uses to monitor his email system.  Composed of both chart-based and text portlets, this dashboard nicely summarizes the state of the email system from the perspective of virus and spam management. The left side columns include mail usage statistics (incoming mail, delivered mail, blocked mail and amount of data transferred), blocked mail statistics (virus and spam information), denied mail summary (sender, recipient, or attachment blocked), usage summary and RBL statistics.  For those who don’t know, RBL stands for Realtime Blackhole List, a list of addresses associated with spamming.

The right side of this enterprise dashboard is a visual collection of relevant metrics. KPIs that are graphed include email system activity, top 5 email recipients, top 5 virus recipients and top 5 spam recipients. All in all, a nicely laid out system management dashboard.

Email spam management dashboard

Sales Pipeline Viewer Dashboard Screenshot – Tracking KPIs visually through size, color, height

An excellent example of a well designed Enterprise Dashboard. Tags: Dashboard Design, Business Intelligence User Interface Design, Sales Pipeline Enterprise Dashboards

When certain enterprise dashboards get submitted to the Dashboard Spy dashboard screenshot collection, I know right away that it’s a big winner. For us executive dashboard enthusiasts, a digital dashboard sample is worth returning to again and again for study when the following characteristics are evident: there is a working demo online, there is clearly an understanding of the underlying business processes, the user interface is professionally and wonderfully designed, and there are interesting visual solutions used to solve the puzzle of how to visually impart the business intelligence contained in the data to the business user.

Here is a truly wonderful enterprise dashboard that focuses on tracking the sales pipeline. It’s from visual-io.com and available to try out as a Business Week Interactive Graphic. There is a nice write up in this BW article, Picturing a Better Business.

Take a look at this dashboard screenshot and you’ll see that there are several things going on. The size, color and positioning of the dots represent the sales pipeline KPIs. The Sales Pipeline Viewer lets you track the progress of each sales executive’s potential deals through the sales cycle – from qualification to close. The visual aspects of each dot (representing each potential deal) represent certain facts about the deal. In this screenshot, the size of the dot gives the priority, the color of the dot shows the closing probability and the height of the dot relative to the box it sits in shows the expected revenue. The background is important too. There is the concept of a “heat map” – the more deals in any box, the darker its background. This lets the manager instantly comprehend who is “hot” and who is not (always a challenge in a sales management situation). I guess you can see that the sales big shots are literally “big spots”!

Sales Pipeline Enterprise Dashboard

Homework: Lots to study here. Let this sample dashboard inspire you to learn the underlying disciplines. If you need to brush up on visual design and User Interface issues, this is a great summary for IT and business-side project members – The Elements of Graphic Design: Space, Unity, Page Architecture, and Type. If you need an understanding of the sales process and how to measure it, take a look at these books on measuring sales performance.

So what or who is The Dashboard Spy? As his about page states, The Dashboard Spy is just a guy interested in the design of enterprise dashboards. He could not find any executive dashboard design source books (or even screenshots of real business dashboards) and so set about creating his own. Finally convinced to post his extensive collection of dashboard screenshots online, he was amazed to find how popular it has become. If you have a nice screenshot of a digital dashboard, balanced scorecard, or any business intelligence graphic to share, please send an email to info _at_ dashboardspy.com. Also check out The Dashboard Spy’s favorite books on business dashboards.

Airline Executive Dashboard – Sparklines spark this excel dashboard to a data visualization contest win

Dashboard Topic: Sparklines

During an enterprise dashboard design session, we had a heated discussion of the best way to efficiently show data trends. The project members basically fell into 2 camps. One group wanted a simple excel style spreadsheet approach while the others wanted a rich graphic xcelsius type of interactivity. We were at an impasse for quite a while. The resolution? We went with sparklines! Both groups loved it! We remembered the following post:

Tags: Sparkline graphics, dashboards, Enterprise Dashboard Design, Sparklines, Dashboard Design Contest.

Remember when we discussed the dashboard contest with the scenario about the airline management views of enterprise data? (Use the link to see the previously discussed entry by Dr. Allison). The contest was the Business Intelligence Network’s 2006 Data Visualization Competition judged by Stephen Few, data visualization expert and author of the amazing dashboard book, Information Dashboard Design: The Effective Visual Communication of Data. The competition consisted of five scenario descriptions that covered various business situations. Well Andreas of BonaVistaSystems.com, the winner of the airline management dashboard scenario, proudly wrote me from Germany to tell me about his victory. The main visual difference between the winning entry and other submissions was the use of sparklines allowing for efficient screen use. As he explains:

The task was to develop a dashboard for the executives of an U.S. commercial airline. The dashboard has to allow the executive team to monitor their business and to quickly identify anything that needs attention.

The airline dashboard was designed with Microsoft Excel and BonaVista MicroCharts. The dashboard visualizes about 500 numbers on a single screen. The dashboard looks different because it was designed using effective design principles. It avoids ineffective eye-catchers like speedometers or radial gauges. MicroCharts sparklines and bullet graphs are used as an effective means to put all decision relevant information on a single screen.

Here is the winning dashboard:

Airline Executive Dashboard

If you want, you can really zoom in on this enterprise dashboard and examine it in detail. To check out or test drive the product used to create the excel dashboards and sparklines, use these links provided by Andreas:

http://www.bonavistasystems.com/OnlineDemoReports.html

The dashboard won the Business Intelligence Network’s 2006 Data
Visualization Competition:
http://www.bonavistasystems.com/NewsDataVis_Winner.html

It’s an Excel dashboard that uses MicroCharts for dense information
dashboards:
http://www.bonavistasystems.com/Products_SparkLiner_Dashboards.html

Homework: Do your research on sparklines by starting here. Also, you must review the literature by Edward Tufte, the originator of the concept.

So what or who is The Dashboard Spy? As his about page states, The Dashboard Spy is just a guy interested in the design of enterprise dashboards. He could not find any executive dashboard design source books (or even screenshots of real business dashboards) and so set about creating his own. Finally convinced to post his extensive collection of dashboard screenshots online, he was amazed to find how popular it has become. If you have a nice screenshot of a digital dashboard, balanced scorecard, or any business intelligence graphic to share, please send an email to info _at_ dashboardspy.com. Also check out The Dashboard Spy’s favorite books on business dashboards.

PS: If you find yourself part of an enterprise dashboard effort, you must study Enterprise Dashboards: Design and Best Practices for IT, the only book on actually implementing enterprise dashboards.

Doctor Employee Scorecard for Healthcare Organizations

Dashboards that feature Employee Scorecards serve enterprises on both strategic and operational levels. At the very top, upper management can make sure that human capital is allocated in such a way as to support corporate-level initiatives. For example if this year’s desired big push in a certain product line is not reflected by the proper levels of staffing and projects, then this misalignment is surely indicative of upcoming disappointment. At the operational levels, employees and their managers can check for themselves their alignment with the stated goals. 

The enterprise dashboard screenshot below is from an employee scorecard live demo that is hosted by dashboard vendor idashboards. It’s well worth trying out as there is much interactivity that is coordinated between the various parts of the dashboard. Hovering over a particular section of one of the charts will drive the data in the other views.

The employee scorecard shown here concentrates on the metrics that measure performance of doctors in a healthcare organization such as a hospital or medical practice. The first chart tracks  doctor’s new patients by specialty over time (obviously you want to see whether or not your organization’s growth is proceeding as planned). The next portlet tracks the number of journal articles published (a sign of prestige for your medical institution). Patient satisfaction is tracked as well. Try out the demo to see how user focus is accomodated and drives the user experience.

Doctor performance Dashboard

Tags: Doctor Performance Dashboard, Doctor Employee Scorecard, Enteprise Dashboard Design, Usabilty, Dashboard

Note: You have found a unique resource for research into the new field of Enterprise Dashboards. While there is a lot of vendor-provided information out there regarding this exciting new way to present business intelligence, there is a huge scarcity of screenshots of actual enteprise dashboards that have been implemented. As we in the information technology business all know, real world implementations are the most important thing to study. Enjoy the 837 dashboard screenshots you’ll find here in Volume 1 of The Dashboard Spy on Enterprise Dashboards, a blog about real world enteprise dashboard examples.

Job Requisition Dashboard

Here’s a quick (and fuzzy!) glimpse at a dashboard used by recruiters and HR personnel to match jobs against candidates. It’s a screenshot of page from an Unicru system. That’s a hosted resume management platform company that was bought out last year for $150M. Anyway, here’s the peek at the job requisition dashboard.  The open job has 3 tabs: Overview, Hirer’s Description and Workstyle. Each tab opens a page with various portlets. For example the Overview tab has basic job description elements such as job role, employment type, location, compensation, start date and duration. The other portlets on this enterprise dashboard include Experience (role and industry), Education and Skills. After looking at the job details, the user can initiate the matching action to bring up a list of possible candidates.

Now you Dashboard Spy readers know how recruiters match up your resumes against those enterprise dashboarding jobs – it’s all about automated attribute matching, so keep those keywords in your resumes!

Job Requisition Dashboard

Tags: Recruiter Dashboard, Enterprise Dashboards, Executive Dashboard Design

Dashboard Spy Info: This is another post in the series of business intelligence dashboard studies done by a mysterious individual known only as The Dashboard Spy. No one knows who he is, but his collection of BI Dashboards is becoming quite famous. If you have a business dashboard project that you would like to have featured, send Dash an email at info -at_ enterprise-dashboard.com. Please replace those characters with the @ sign.

The Dashboard Spy Business Intelligence Dashboards Blog

Enterprise Dashboard for Consumer Goods Field Representatives

From enterprise dashboard vendor StayInFront, comes this mockup of a dashboard for a pharmacy field rep for consumer relationship management. Of course, a field representative’s most driving elements are their visiting schedule and their sales targets, so those links and KPIs are featured foremost in this dashboard. The portlets on this enterprise dashboard are titled “My Visit Schedule”, “My Targets”, “Promotions”, “Messages”, “Alerts” and “Competitor Activity”.  The “My Targets” portlet contains the sales metrics of Sales, Calls and Tasks as measured against the criteria of Period to date, Target, % Target achieved, Estimated period end and Estimated Percentage of Target. There is also a graph of sales in the Month to Date of 3 products:

Field Rep CRM Dashboard

Tags: Consumer Goods Field Representative Dashboard, Enterprise Dashboard, Digital Dashboard, Business Intelligence Dashboard

The Dashboard Spy Business Intelligence Dashboards Blog

Difference between Balanced Scorecard and Enterprise Dashboard

A Dashboard Spy reader who is getting involved in a balanced scorecard reporting project asked me the difference between enterprise dashboards and balanced scorecards. He was getting confused between all the different approaches that his team could take. We had an interesting conversation with a couple of interesting screenshots that we passed back and forth. I thought it valuable enough to share with you today.

An interesting webpage on the difference between balanced scorecards and enterprise dashboards can be found here: Dashboards vs. Scorecards.  The page states correctly that the difference lies in the degree of “balanced scorecard formality”, that is, the balance scorecard approach has strict elements:

Components of a True Balanced Scorecard: While both Balanced Scorecards and Dashboards display performance information, a Balanced Scorecard is a more prescriptive format; a true Balanced Scorecard should always include these components: Perspectives (groupings of high-level strategic areas), Objectives (verb-noun phrases pulled from a strategic plan), Measures (also called Metrics or Key Performance Indicators/KPIs), and Stoplight Indicators (red, yellow, or green symbols that provide an at-a-glance view of a Measure’s performance). These specific components help ensure that a Balanced Scorecard is inherently tied to the organization’s critical strategic needs.

They provide the following example of a balanced scorecard dashboard:

Balanced Scorecard Dashboard

This is contrasted against the more loosely defined standard of an enterprise dashboard:

Dashboards – More Loosely Defined. The design of Dashboards, on the other hand, is much more open to interpretation. Most Dashboards are simply a series of graphs, charts, gauges, or other visual indicators that a user has chosen to monitor, some of which may be strategically important, but others of which may not. Even if a strategic link exists, it may not be clear to the person monitoring the Dashboard, since the Objective statements, which explain what achievement is desired, are typically not present on Dashboards.

As an example of a dashboard, the company took a subset of the above balanced scorecard and presented it as a more high-level KPI dashboard. It focuses on presenting a manufacturer’s sales KPIs.

Manufacturing sales KPI dashboard

Tags: Balanced Scorecard vs. Enterprise Dashboard, Manufacturing KPIs and Metrics, Enterprise Dashboard Design, Balanced Scorecard Methodology, Difference between scorecards and dashboards

Dashboard Spy Reader bonus link: Download article from the Harvard Business Review – The Balanced Scorecard – Measures That Drive Performance

The Dashboard Spy Business Intelligence Dashboards Blog

SharePoint Enterprise Dashboard for Professional Services Contract Monitoring

This departmental dashboard is part of the Microsoft SharePoint application templates and is meant for a professional services firm to use in monitoring the contract stage of a professional engagement. Nothing too earth-shattering here. There are only a handful of webparts such as ones for announcements, discussions, forms and links. Of most interest is the listing of milestones for the contractual setup process: Proposal accepted, Contract drafted, Internal legal review complete, Client legal review complete, Client sign-off on contract, Write project charter, communication plan complete, Escalation plan complete, Purchase Order open, and Engagement ready to commence. 

Professional Services contract dashboard

Tag: Contracts Enterprise Dashboard, Professional Services Contract Dashboard, Executive Dashboard
Enterprise Dashboards: Designs & Best Practices for IT

The Dashboard Spy Business Intelligence Dashboards Blog