Usability Testing: analyzing data

•

0 likes•373 views

Krista Kennedy

Technology Design

• Compile
• Summarize data
• Analyze data
• Develop recommendations
• Produce the ﬁnal report

Wednesday, March 28, 12

Step 1: Compile

Wednesday, March 28, 12

Get it into a pile.

Wednesday, March 28, 12

Get your piles sorted.

Wednesday, March 28, 12

compile as you test.

Wednesday, March 28, 12

further test the test.

Wednesday, March 28, 12

keep the data legible.

Wednesday, March 28, 12

• Type handwritten notes
• Verify data captures
• Back up ﬁles

Wednesday, March 28, 12

Organize raw data.

Wednesday, March 28, 12

Do whatever it takes to
get it done.

Wednesday, March 28, 12

• lists
• tallies
• matrices
• stories
• structure models
• ﬂow diagrams

Wednesday, March 28, 12

Step 2: summarize

Wednesday, March 28, 12

1. task accuracy

Wednesday, March 28, 12

number of errors made
per task

Wednesday, March 28, 12

• categorize errors by type
• ommission
• commission

Wednesday, March 28, 12

# of participants who performed:

• successfully
• successfully but with some assistance
• assistance types, tasks, products

Wednesday, March 28, 12

Vital Statistics:

Wednesday, March 28, 12

% performing successfully, including those
who needed assistance

• regardless of time limits
• regardless of assistance needed

Wednesday, March 28, 12

If this percentage is
very low, you’ve got a
serious problem.

Wednesday, March 28, 12

% performing successfully

• including those who corrected errors

Wednesday, March 28, 12

% performing successfully within
benchmark

• indicative of efﬁciency

Wednesday, March 28, 12

2. task timings

Wednesday, March 28, 12

summarize
preference data

Wednesday, March 28, 12

Limited choice questions:
• Sum by choice
• Chart trends

Wednesday, March 28, 12

Free-form questions:
• Group into meaningful categories
• Ex: particular screen, doc section, etc.

Wednesday, March 28, 12

Summarize other measures

• Unnecessary returns to main navigation
• Number/type of hints and prompts
• Times site map was accessed
• Points of hesitation (and for how long)

Wednesday, March 28, 12

Summarize by Group/Version

Wednesday, March 28, 12

(see pages 255 - 259)

Wednesday, March 28, 12

3: analyze data

Wednesday, March 28, 12

What didn’t succeed?

Wednesday, March 28, 12

What were the
difﬁculties?

Wednesday, March 28, 12

What were the
error sources?

Wednesday, March 28, 12

Prioritize problems
by severity

Wednesday, March 28, 12

Severity descriptions &
deﬁnitions: p. 262

Wednesday, March 28, 12

Recently uploaded

How to differentiate Sales Cloud and CPQ on first glance might be tricky if you do not know where to look and what to look at. You will know :-) Managing the sales process within Salesforce is a common use case that can be managed with standart Sales Cloud. If you want to do entire quoting process you will find out Salesforce CPQ solution exists. What is then the difference if both can handle selling products? You will see comparison of 10 different features, which Sales Cloud and Salesforce CPQ handle differently. Simple question you will always remember if you should consider using Salesforce CPQ will be a cherry on top.

10 Differences between Sales Cloud and CPQ, Blanka Doktorová

CzechDreamin

How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf

FIDO Alliance

Screen flow is a powerful automation tool that is commonly designed for internal and external users. However, what about the guest users? We will dive into various methods of launching screen flows and understand how to make them publicly accessible, extending their usability to a broader audience. The presentation will also cover the implementation of security layers and highlight best practices for a smooth and protected user experience. Discover the potential of screen flows beyond conventional use and learn how to leverage them effectively.

Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade

CzechDreamin

IoT Analytics Company Presentation May 2024

IoTAnalytics

Agentic RAG What it is its types applications and implementation.pdf

ChristopherTHyatt

The presentation underscores the strategic advantage of treating design systems not just as technical assets but as vital business components that require thoughtful management, robust planning, and strategic alignment with organizational goals. Key Points Covered: - Understanding Design Systems as Business Entities: Conceptualizing design systems as internal business entities can streamline their integration and evolution within a company. - Adoption and Expansion: Elaborating on the importance of tactical adoption across organizational structures, enhancing product suites to cater to user needs and broadening scope to mobile and content authoring solutions. - Data-Driven Development: Utilizing data insights for component development ensures that resources are allocated to create valuable, widely used features. - Financial Modeling for Design Systems: Developing sustainable funding models is crucial for long-term support and success of design systems. - Promoting Internal Buy-In: Stressing on strategies for promoting design systems within the organization to increase engagement and investment from internal stakeholders.

A Business-Centric Approach to Design System Strategy

UXDXConf

Designing inclusive products is not only a social responsibility but also a business imperative. This talk delves into the journey of creating accessible hardware products that cater to diverse user needs. Key Topics Covered: 1. Introduction to Inclusive Design - Importance of accessibility in product design - Overview of Comcast's commitment to making products accessible to a wide audience 2. Case Study: Xfinity Large Button Voice Remote - Initial challenges and the evolution of the product - User research and feedback that shaped the design - Key features of the final product and their benefits 3. Designing for Diverse Needs - Understanding human-centered design and its historical context - The impact of designing for people with disabilities on overall product quality - Examples from other industries, such as architecture and industrial design 4. Integrating Accessibility from the Beginning - The cost and efficiency benefits of designing for accessibility from the start - The process of embedding accessibility as a core trait rather than an optional feature 5. Real-World Impact and Continuous Improvement - Insights from in-home studies with users having assistive needs - How continuous feedback and iterative design lead to better products - The role of inclusive research and development practices

Designing for Hardware Accessibility at Comcast

UXDXConf

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf

FIDO Alliance

New customer? New industry? New cloud? New team? A lot to handle! How to ensure the success of the project? Start it well! I've created the 3 areas of focus at the beginning of the project that helped me in multiple roles (BA, PO, and Consultant). Learn from real-world experiences and discover how these insights can empower you to deliver unparalleled value to your customers right from the project's start.

Powerful Start- the Key to Project Success, Barbara Laskowska

CzechDreamin

What's New in Teams Calling, Meetings and Devices April 2024

Stephanie Beckett

Welcome to UiPath Test Automation using UiPath Test Suite series part 2. In this session, we will cover API test automation along with a web automation demo. Topics covered: Test Automation introduction API Example of API automation Web automation demonstration Speaker Pathrudu Chintakayala, Associate Technical Architect @Yash and UiPath MVP Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

UiPath Test Automation using UiPath Test Suite series, part 2

DianaGray10

Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)

Julian Hyde

Speed Wins: From Kafka to APIs in Minutes

confluent

Automation is transforming industries by streamlining operations and reducing costs. However, the success of automated systems hinges not only on their functionality but also on the user experience (UX). This talk, "The UX of Automated Processes," delves into the intricate relationship between automation and UX, providing a comprehensive guide to designing intuitive and effective automated systems. Key Topics Covered: 1. Introduction to Automated UX: * Understanding the importance of UX in automated systems * Real-world example: Robotic beer dispensers at a music festival 2. Step-by-Step Process for Enhancing Automated UX: * Step 0: Identifying main workflows and happy paths * Step 1: Conducting contextual inquiries to understand current user practices and edge cases * Step 2: Prioritizing issues and solutions through collaborative ideation sessions * Step 3: Prototyping and usability testing for both software and hardware 3. Prototyping and Testing: * Methods for simulating automated processes * Importance of user feedback in refining automated systems 4. Designing for Support Users: * Crafting the experience for support personnel who manage edge cases * Ensuring effective communication and issue prioritization for support users

The UX of Automation by AJ King, Senior UX Researcher, Ocado

UXDXConf

PLAI - Acceleration Program for Generative A.I. Startups

Stefano

ScyllaDB has the potential to deliver impressive performance and scalability. The better you understand how it works, the more you can squeeze out of it. But before you squeeze, make sure you know what to monitor! Watch our experienced Postgres developer work through monitoring and performance strategies that help him understand what mistakes he’s made moving to NoSQL. And learn with him as our database performance expert offers friendly guidance on how to use monitoring and performance tuning to get his sample Rust application on the right track. This webinar focuses on using monitoring and performance tuning to discover and correct mistakes that commonly occur when developers move from SQL to NoSQL. For example: - Common issues getting up and running with the monitoring stack - Using the CQL optimizations dashboard - Common issues causing high latency in a node - Common issues causing replica imbalance - What a healthy system looks like in terms of memory - Key metrics to keep an eye on This isn’t “Death-by-Powerpoint.” We’ll walk through problems encountered while migrating a real application from Postgres to ScyllaDB – and try to fix them live as well.

Optimizing NoSQL Performance Through Observability

ScyllaDB

Intrigued by why some of the world's largest companies (Netflix, Google, Cisco, Twitter, Uber etc) are using gRPC? In this demo based talk we delve into the world of gRPC in .Net, what it does and why we should use it. We compare the interface with both Rest and graphQL. We will show you how to implement grpc server-side in .net and in the web. Finally, I will show you how the tooling helps you deliver powerful interfaces and interact with them quickly and simply.

Demystifying gRPC in .Net by John Staveley

John Staveley

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

FIDO Alliance

We're living the AI revolution and Salesforce is adapting and bring new value to their customers. Einstein products are evolving rapidly and navigating their limitations, language support, and use cases can be challenging. Let's make review of what Einstein product are available currently, what are the capabilities and what can be used for in CEE region and how Rossie.ai can help to learn Salesforce speak Czech. We will explore the Einstein roadmap and I will make a short live demo (based on your vote) of some Einstein feature.

AI revolution and Salesforce, Jiří Karpíšek

CzechDreamin

Explore the core of Salesforce success in 'Salesforce Adoption – Metrics, Methods, and Motivation.' We will discuss essential metrics, effective methods to drive adoption, and the driving force behind user engagement and explore strategies for onboarding, training, and continuous support that empower users to navigate the platform seamlessly. By leveraging these tools, you can effectively measure adoption against your company’s goals and create an environment where users not only adopt Salesforce but actively contribute to its ongoing success.

Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom

CzechDreamin

Recently uploaded (20)

10 Differences between Sales Cloud and CPQ, Blanka Doktorová

How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf

Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade

IoT Analytics Company Presentation May 2024

Agentic RAG What it is its types applications and implementation.pdf

A Business-Centric Approach to Design System Strategy

Designing for Hardware Accessibility at Comcast

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf

Powerful Start- the Key to Project Success, Barbara Laskowska

What's New in Teams Calling, Meetings and Devices April 2024

UiPath Test Automation using UiPath Test Suite series, part 2

Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)

Speed Wins: From Kafka to APIs in Minutes

The UX of Automation by AJ King, Senior UX Researcher, Ocado

PLAI - Acceleration Program for Generative A.I. Startups

Optimizing NoSQL Performance Through Observability

Demystifying gRPC in .Net by John Staveley

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

AI revolution and Salesforce, Jiří Karpíšek

Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom

Usability Testing: analyzing data

1. • Compile • Summarize data • Analyze data • Develop recommendations • Produce the ﬁnal report Wednesday, March 28, 12

2. Data Analysis Wednesday, March 28, 12

3. next 2 weeks: Wednesday, March 28, 12

4. Wednesday, March 28, 12

5. Wednesday, March 28, 12

6. Step 1: Compile Wednesday, March 28, 12

7. Wednesday, March 28, 12

8. Get it into a pile. Wednesday, March 28, 12

9. Get your piles sorted. Wednesday, March 28, 12

10. Ideally: Wednesday, March 28, 12

11. compile as you test. Wednesday, March 28, 12

12. further test the test. Wednesday, March 28, 12

13. keep the data legible. Wednesday, March 28, 12

14. • Type handwritten notes • Verify data captures • Back up ﬁles Wednesday, March 28, 12

15. Organize raw data. Wednesday, March 28, 12

16. Do whatever it takes to get it done. Wednesday, March 28, 12

17. • lists • tallies • matrices • stories • structure models • ﬂow diagrams Wednesday, March 28, 12

18. Wednesday, March 28, 12

19. Wednesday, March 28, 12

20. Wednesday, March 28, 12

21. Wednesday, March 28, 12

22. Goal: Wednesday, March 28, 12

23. Wednesday, March 28, 12

24. Step 2: summarize Wednesday, March 28, 12

25. 1. task accuracy Wednesday, March 28, 12

26. number of errors made per task Wednesday, March 28, 12

27. • categorize errors by type • ommission • commission Wednesday, March 28, 12

28. # of participants who performed: • successfully • successfully but with some assistance • assistance types, tasks, products Wednesday, March 28, 12

29. Vital Statistics: Wednesday, March 28, 12

30. % performing successfully, including those who needed assistance • regardless of time limits • regardless of assistance needed Wednesday, March 28, 12

31. If this percentage is very low, you’ve got a serious problem. Wednesday, March 28, 12

32. % performing successfully • including those who corrected errors Wednesday, March 28, 12

33. % performing successfully within benchmark • indicative of efﬁciency Wednesday, March 28, 12

34. 2. task timings Wednesday, March 28, 12

35. Wednesday, March 28, 12

36. summarize preference data Wednesday, March 28, 12

37. Limited choice questions: • Sum by choice • Chart trends Wednesday, March 28, 12

38. Free-form questions: • Group into meaningful categories • Ex: particular screen, doc section, etc. Wednesday, March 28, 12

39. Summarize other measures • Unnecessary returns to main navigation • Number/type of hints and prompts • Times site map was accessed • Points of hesitation (and for how long) Wednesday, March 28, 12

40. Summarize by Group/Version Wednesday, March 28, 12

41. (see pages 255 - 259) Wednesday, March 28, 12

42. 3: analyze data Wednesday, March 28, 12

43. What didn’t succeed? Wednesday, March 28, 12

44. Wednesday, March 28, 12

45. What were the difﬁculties? Wednesday, March 28, 12

46. What were the error sources? Wednesday, March 28, 12

47. Prioritize problems by severity Wednesday, March 28, 12

48. Severity descriptions & deﬁnitions: p. 262 Wednesday, March 28, 12