Enhancing User Experience Through Data Trails and Metrics

UX METRICS
A Game Changer!
Andrea Thompson
The Home Depot
Sr. User Experience
Manager, CUA, CXA,
Servant Leader
As we create and enhance experiences, how do we know
we’ve impacted people’s XP in a positive way?
Agenda
What are we currently measuring?  UX Metrics/Data Storytelling
What are we working towards? UX OKRs?
UX Strategic Influence: Have we validated the intended impact?
Let’s pause and reflect on potential
Data trails in our User’s XP…
What are we currently measuring in the experiences of Primary, secondary and tertiary users?
…texted your Company?
…called Customer
Service?
signed up for
autopay?
…signed up to receive a
product monthly?
…have made a transaction
in store vs online?
Left a 1 out of 5
star rating
…used multiple tools before or
after the new XP because
there’s a gap?
Is there a data trail when a 
customer
Called the Customer
Reservations line?
referred a friend
…received too many
customer calls
…was unaware of
the customer’s
update to their
reservation
…is unable to refund
an auto payment?
…did not know how to use a
new digital solution?
…is unable to fulfill a
customer’s purchase
doesn’t know who
their loyalty
customers are
…used multiple company
tools internally?
Is there a data trail when an 
associate
Has countless in
person customer
interruptions
Are we intentionally
and consistently
collecting user
experience metrics?
Common Research Methods
Quantitative
Qualitative
Are Qual & Quant metrics being
validated over a period of time across
multiple data points?
What story does your User’s ‘Data Footprint’
capture about their XP?
Are we connecting the data footprint trail to other cross-functional experiences?
Build an XP Network with Cross-Functional Partners to discover relative friction
points:
Online Analytics
Data Analysts
GA Analysts
IT Developers
Call Center Representatives
Face-to-Face Associates who help our Users
“Use the right method and
measure the right thing.
Create an intentional
research plan for the
experience.“
We can minimize cognitive bias using data
and not anecdotal stories but real world
measurements
What are the most important
insights to learn during
research?
What is the outcome you are
looking for the research to
accomplish?
Which UX Research method will
work best for the scenario
needed?
Which research metric will
capture accurate insights?
What are we working towards?
Have we identified the Experience’s Vision, Strategy, Measures of
Success?
UX Strategic Metric Staples
Capture creditable “Before” & “After” UX Metrics, Empower Partners with XP
Value Add.
UX OKRs
Define target outcomes
learned from Discovery
/Research.
Measure What Matters: OKRs:
The Simple Idea that Drives
10x Growth by John Doerr
Research Plan
Intentionally use the
right methods and
measure the right
things.
Note: Remember to
include methods to
capture UX OKRs
UX Metrics
Impactful UX Metrics
will start with a
baseline and a
target goal.
Eg. Its difficult to measure
impact without a
baseline to compare it to.
UX OKRs - Moonshots
O (Object = Goal)  S.M.A.R.T Goals
S – Specific
M – Measurable
A – Attainable
R – Relevant
T - Timebound
Eg. Key Result:
Customer satisfaction has
increased when the
Customer Call Center’s
complaint volume has
decreased
from 
5,550 airline  reservation
complaints  per day
to 
less than 250 complaint
calls per day
by 
2023 end of Q4
Did we validate the intended
impact?
How do we know the experience’s strategic goals were accomplished?
UX Strategy
Blueprint Template
Measurements
Challenges
Aspirations
Areas of Focus
Guiding Principles
Activities
Minimize Cognitive Bias by Using Data. Not Simply anecdotal Stories
but Real World XP Metrics.
As UX Practitioners, we typically engage
in an UCD iterative design process but
are we measuring the UX impacts that
we are making?
How do we know that we have
improved an experience for people as
intended?
By opinion, intuition or is it based on
creditable UX Research Metrics?
UX Metrics Tracked: Baseline to Intent
Measure Ease of Use
SUS(System Usability Scale
WCAG (Accessibility Evaluation)
TOT (Time on Task)
UXUM-LITE
Usability Test
SUM (Single Usability Metric)
Measure User Satisfaction
SEQ (Single Ease Question)
Self Reported 1-5 Rating Scale
NPS (Net Promoter Score)
Coding Feedback
Sentiment Analysis
How do we know the XP is seamless, frictionless &
valuable?
Have we connected the XP Data Footprint, are we looking beyond our testscript?
Thank you for using UX Metrics
to strategically create better
people experiences!
An experience has only been improved when the
impact to the experience has been measured!
Slide Note
Embed
Share

Andrea Thompson, a Sr. User Experience Manager at The Home Depot, highlights the importance of measuring and analyzing user experience metrics to understand and improve customer interactions. By investigating data trails from various touchpoints, such as customer sign-ups, interactions with associates, and use of digital solutions, teams can identify areas of improvement and enhance overall user experience. The article emphasizes the significance of collecting and validating both quantitative and qualitative metrics over time, while collaborating with cross-functional partners to create an integrated User Experience Network.

  • User Experience
  • Data Trails
  • Metrics
  • Customer Interactions
  • User Research

Uploaded on Sep 14, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. UX METRICS Andrea Thompson The Home Depot Sr. User Experience Manager, CUA, CXA, Servant Leader A Game Changer!

  2. As we create and enhance experiences, how do we know we ve impacted people s XP in a positive way? Agenda What are we currently measuring? UX Metrics/Data Storytelling What are we working towards? UX OKRs? UX Strategic Influence: Have we validated the intended impact?

  3. Lets pause and reflect on potential Data trails in our User s XP What are we currently measuring in the experiences of Primary, secondary and tertiary users?

  4. Is there a data trail when a customer signed up to receive a product monthly? texted your Company? called Customer Service? signed up for autopay? have made a transaction in store vs online? used multiple tools before or after the new XP because there s a gap? Called the Customer Reservations line? referred a friend Left a 1 out of 5 star rating

  5. Is there a data trail when an associate did not know how to use a new digital solution? received too many customer calls is unable to fulfill a customer s purchase is unable to refund an auto payment? was unaware of the customer s update to their reservation used multiple company tools internally? doesn t know who their loyalty customers are Has countless in person customer interruptions

  6. Common Research Methods Quantitative Qualitative Are we intentionally and consistently collecting user experience metrics? Are Qual & Quant metrics being validated over a period of time across multiple data points?

  7. What story does your Users Data Footprint capture about their XP? Are we connecting the data footprint trail to other cross-functional experiences? Build an XP Network with Cross-Functional Partners to discover relative friction points: Online Analytics Data Analysts GA Analysts IT Developers Call Center Representatives Face-to-Face Associates who help our Users

  8. What are the most important insights to learn during research? Use the right method and measure the right thing. Create an intentional research plan for the experience. What is the outcome you are looking for the research to accomplish? Which UX Research method will work best for the scenario needed? We can minimize cognitive bias using data and not anecdotal stories but real world measurements Which research metric will capture accurate insights?

  9. What are we working towards? Have we identified the Experience s Vision, Strategy, Measures of Success?

  10. Research Plan UX Metrics UX OKRs Intentionally use the right methods and measure the right things. Impactful UX Metrics will start with a baseline and a target goal. Define target outcomes learned from Discovery /Research. Measure What Matters: OKRs: The Simple Idea that Drives 10x Growth by John Doerr Eg. Its difficult to measure impact without a baseline to compare it to. Note: Remember to include methods to capture UX OKRs UX Strategic Metric Staples Capture creditable Before & After UX Metrics, Empower Partners with XP Value Add.

  11. Eg. Key Result: Customer satisfaction has increased when the Customer Call Center s complaint volume has decreased UX OKRs - Moonshots from 5,550 airline reservation complaints per day to less than 250 complaint calls per day O (Object = Goal) S.M.A.R.T Goals S Specific by 2023 end of Q4 M Measurable A Attainable R Relevant T - Timebound

  12. Did we validate the intended impact? How do we know the experience s strategic goals were accomplished?

  13. Areas of Focus Guiding Principles Aspirations UX Strategy Blueprint Template Measurements Challenges Activities

  14. Minimize Cognitive Bias by Using Data. Not Simply anecdotal Stories but Real World XP Metrics. As UX Practitioners, we typically engage in an UCD iterative design process but are we measuring the UX impacts that we are making? Reservation Confirmed How do we know that we have improved an experience for people as intended? Baggage Check Flight Check-in By opinion, intuition or is it based on creditable UX Research Metrics?

  15. UX Metrics Tracked: Baseline to Intent Measure Ease of Use SUS(System Usability Scale Measure User Satisfaction SEQ (Single Ease Question) WCAG (Accessibility Evaluation) Self Reported 1-5 Rating Scale TOT (Time on Task) NPS (Net Promoter Score) UXUM-LITE Coding Feedback Usability Test Sentiment Analysis SUM (Single Usability Metric)

  16. In Person Call Center Social Media Texting Word of Mouth Reviews Ratings Mobile Apps Online How do we know the XP is seamless, frictionless & valuable? Have we connected the XP Data Footprint, are we looking beyond our testscript?

  17. Thank you for using UX Metrics to strategically create better people experiences! An experience has only been improved when the impact to the experience has been measured!

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#