Designing Across Senses by Christine W. Park, John Alderman -- Read -- Imperial Library of Trantor

Index

Praise for Designing Across Senses [Preface]

What Is This Book About? Who Should Read This Book

How This Book Is Organized

Part I: New Human Factors Part II: Multimodal Design

Why Write a Book About Multimodal Design Acknowledgments

1. Returning to Our Senses

If a Tree Falls in the Forest… The Sound of Violence Experience Is Physical People Have Modalities Devices Have Modes Human Modalities + Device Modes = Interfaces Physical Information: The New Data Sensing, Understanding, Deciding, and Acting: The New Human Factors

Sensing Understanding and Deciding Acting

Focus: The New Engagement Multimodality Makes a Wider Range of Human and Product Behaviors Possible How Multimodality Affects Design

Creating Usability Creating Delight, Trust, and Love

Multimodal Design Is Cross-Disciplinary Summary

2. The Structure of Multimodal Experiences

The Human Slice of Reality: Umwelt and Sensibility Assembling Multimodal Experiences: Schemas and Models The Building Blocks of Multimodal Experience Summary

3. Sensing

The Three Main Categories of Stimuli

Electromagnetic Chemical Mechanical

Defining the Senses: Dimension, Resolution, and Range Sensory Focus: Selecting, Filtering, and Prioritizing Information Reflexes Our Senses and Their Unique Properties Vision

Visual Interfaces

Hearing Auditory Interfaces Touch (Somatosensory or Tactile Abilities)

Haptic Interfaces (Tactile, Proprioceptive, and Vestibular)

Smell (Olfactory Ability)

Olfactory Interfaces

Taste (Gustatory Ability)

Gustatory Interfaces

Sixth Senses and More

Time and Rhythm Proprioception and the Vestibular System

Summary

4. Understanding and Deciding

The Foundations of Understanding: Recognition, Knowledge, Skills, and Narratives Aware and Non-Aware: Fast and Slow Thinking Agency: Balancing Self-Control and Problem Solving Motivation, Delight, Learning, and Reward: Creating Happiness Summary

5. Acting

About Anthropometrics

The Origin of Anthropometrics

Task Performance Nonverbal Communication Precision Versus Strength Inferring Versus Designating Intent Summary

6. Modalities and Multimodalities

Modalities: How We Use Our Senses

Types of Modalities

We Shape Our Modalities, and They Shape Us Attributes and Abilities of Modalities Applying Modalities to Design Multimodalities Trusted Version and Performance Optimization

Validation Integration A Single Prioritized Sense or Many Together?

Across one main sense Across multiple senses

How Multimodality Shapes Our Activities and Experiences

Attributes and Abilities of Multimodalities

Focus Flow Sequence Simultaneity Shift Transition Substitution Translation Proficiency

Common Categories of Multimodalities

Basic abilities Orientation and scanning Hand–eye coordination (visuo-haptic integration) Social interaction Performance and athletics Cognition and analysis

Applying Multimodality to Design

Maintaining Focus Respecting Cognitive Load Overcoming Barriers with Substitutions and Translations Shifts, Interruptions, and Flow

Maintaining focus

Reinforce Pace Block

Dealing with interruptions

Safety exits Ease of re-entry Off-switch

Allowing shifts

Social or ecosystem norms Priming

Feedback and Validation Body language and physical engagement

Summary

7. The Opportunity: Transforming Existing Products and Developing New Ones

Key Applications of IoT: Monitor, Analyze and Decide, Control and Respond

Functional Categories Monitor Analyze and Decide Control and Respond

“Disruptive” Technologies

Removing Sound—And Putting It Back Mapping Apps Know Who Is in the Driver’s Seat

Beginning Inquiry

Workflow to Identify Opportunities

Assessing user needs Assessing user context Assessing changes to existing product modes

Summary

8. The Elements of Multimodal Design

Using Physical Information Constructing Knowledge, Interactions, and Narratives Summary

9. Modeling Modalities and Mapping User Experiences

Behaviors Shared Between Users and Devices Demanding Contexts and Complex Interactions Call for Alignment Experience Maps and Models for Multimodality

Different Maps Cover Different Scopes and Details

Key Considerations of Multimodal Design

Modalities and Senses Focus Level of Focus and Engagement Depth Continuity Sequence Shifts Flow and Habits Interruptions Substitutions Specialized Integration Knowledge and Skill Key Contexts in Multimodal Experiences

Physical and environmental context Social and institutional context Device and information context

Example Maps and Models

Experience Map: Transitional Flow Ecosystem Map Context Map Focus Model Storyboards and Keyframing

Orienter Establisher Initial Prolongation Peak Release

Update as Needed

Summary

10. Form Factors and Configurations

Creating Multimodal Properties Configuring Interface Modes Mapping Modal Behaviors to Modal Technologies

Vision Dominant Activities Immersive Activities: Screen-Based Experiences and VR Augmented or Auxiliary Activities: Visual Indicators for Peripheral Information Augmented Reality Versus Augmented Products: Visual Arrays of Control and Choice Automated Visual Capabilities Creating Focal Experiences with Audio and Speech Personal Sound Experiences Social Experiences: Broadcast Conversation Experiences: Speech Creating Haptic Experiences

Summary

11. Ecosystems

Device Ecosystems Information Ecosystems Physical Ecosystems Social Ecosystems Specialized Ecosystems Cloud Architectures: Distributing Resources Through Connectivity Ecosystem and Architecture: Applying Ecosystem Resources to Multimodal Design Sensing Experiences: Answering the Door—A Doorbell, Ring, and the August Lock Understanding and Deciding Experiences: Determining Distance—a Pedometer, Apple Watch, and Lyft App Acting Experiences: Writing and Drawing—A Pencil, a Tablet, and the Apple Pencil Summary

12. Specifying Modalities: States, Flows, Systems, and Prototypes

Introduction: A Prototype Is a Custom Measuring Tool Practice Makes Perfect The Media of Multimodal Products: Information and Interactions, Understandings and Behaviors The Product Development Process for Multimodal Products Defining Design Requirements

User Goals, Scenarios and Storyboards, and Use Cases Pseudocode and Swimlane Logic Flows

Specifying Multimodalities

Synchronous and Asynchronous Modes Parallel and Integrated Modes Input/Output MAP

Summary

13. Releasing Multimodal Products: Validation and Learning

Release Is About Process Alpha Release

Organizing alpha Learning from Alpha

Beta Release

Organizing Beta Learning from Beta

Public Release

Validation and Feedback

Important metrics Feedback methods

The Out-of-the-Box Experience Summary

A. Further Reading B. Glossary Index

← Prev
Back
Next →

← Prev
Back
Next →