Programming for Mixed Reality with Windows 10, Unity, Vuforia and UrhoSharp, First Edition by Borycki, Dawid -- Read -- Imperial Library of Trantor

Index

Cover Page Title Page Copyright Page Dedication Page Contents at a Glance Contents About the Author Introduction

Audience and Expected Skills Tools and Required Hardware Organization of This Book Conventions About the Companion Content Acknowledgments Errata and Book Support Stay in Touch

Part I Fundamentals

Chapter 1 Introduction to Windows Mixed Reality

Virtual, Augmented, and Mixed Reality

Virtual Reality Augmented Reality Mixed Reality

Windows Mixed Reality Hardware

Microsoft HoloLens Immersive Headsets

Mixed Reality in Windows 10 Summary

Chapter 2 Development Tools

Universal Windows Platform Adaptive Coding and Target Device Families .NET Core and .NET Native Microsoft DirectX Unity The Mixed Reality Toolkit Vuforia UrhoSharp Summary

Chapter 3 Configuring the Development Environment, Emulators, and Hardware

Setting Up the Development Environment

Windows 10 Visual Studio 2017 Unity Editor Vuforia UrhoSharp HoloLens Emulator Mixed Reality Simulator

HelloWorld Project Deploying Apps to the HoloLens Emulator

Using the Emulator HoloLens Device Portal

Running Apps in the Mixed Reality Simulator Summary

Part II Developing 2D UWP Apps

Chapter 4 UWP Basics

XAML and UI Data Binding and the Model–View–ViewModel Software Architecture Pattern Implementing Data Binding Using Converters Notifying the Binding about Changes to Source Properties Adapting a View to the Platform Summary

Chapter 5 Media Controls

Displaying Images Capturing Video

Camera Capture Face Detection

Audio

Playing Sounds Speech Synthesis Speech Recognition

Summary

Chapter 6 Microsoft Cognitive Services

Exploring Microsoft Cognitive Services Implementation of the Vision Assistant

Computer Vision API Client Bing Web Search API Client UI Declaration Initializing the ViewModel

Supporting Voice Commands

Speech Recognizer and Recognition Constraints Responding to Voice Commands

Summary

Chapter 7 Communicating with Devices

Socket Communication Implementation

Accelerometer Reading Common ViewModel Provider Consumer

Testing the Solution Summary

Part III Developing 3D Apps

Chapter 8 3D Graphics Fundamentals

Pixels, Voxels, and Coordinate Systems Vertices, Primitives, and Polygons Viewing Transformations Quaternions and Rotations Shaders and Lighting Textures and Materials Particle Systems Glossary of Terms Summary

Chapter 9 Unity Basics

The Unity Editor

Understanding Game Objects and Components Configuring Your Unity ID and Signing In Creating a New Project The Toolbar The Hierarchy Window Scene View The Inspector Window The Project Window

Creating Scenes

Working with 3D Objects Using Materials Applying Prefabs Adding a Wind Zone

Building and Deploying the Project

Building the Project Deploying to Immersive Headsets Deploying to a HoloLens Using Holographic Emulation

Mixed Reality Toolkit for Unity 3D Models Summary

Chapter 10 Physics and Scripting

Rigidbody Colliders

3D Primitive Colliders Mesh Colliders Using Colliders

Physic Material Scripting

Creating the Can Pyramid Creating a Script Script Structure

Ray Casting

Understanding Ray Casting Using Ray Casting to Detect Cans in the Scene

Projectiles Collision Detection, Triggers, and Explosions

Adding Spike Balls to the Scene Creating a Script to Blow Up the Projectile

Object Tagging Handling Mixed Reality Input

Motion Controllers InteractionSourceState InteractionSource InteractionSourcePose InteractionManager Events Putting It All Together Testing the App

Dynamic Scene Adjustment Debugging

Drawing Rays Attaching the Visual Studio Debugger to Unity

Unity C# Projects Deploying the Project to the Hololens Emulator Summary

Chapter 11 Animations and Navigation

Animations

Adding Assets and Creating the Scene Creating and Configuring the Animator Controller Animator Properties Animation Clips Script Audio Effects

Navigation and Pathfinding

The Nav Mesh Agent Component The Navigation Mesh Component Pathfinding

Custom Animations

Creating a Custom Animation Clip Animation Toolbar FPS and Curves Adding Custom Animations to Other Objects

Summary

Chapter 12 Understanding HoloLens-Specific Features

Configuring Gaze Input

Creating the Cursor Configuring the Cursor Implementing the Gaze Script Handling Messages

Supporting Voice Commands

Creating a Singleton Class Building the Recognizer

Gestures

Configuring the Scene and Project Settings with the Mixed Reality Toolkit Adding the GazeManager Script Adding the GestureHandler Script and GestureRecognizer Class Testing the App

Spatial Mapping

Creating a Spatial-Mapping Renderer Creating a Spatial-Mapping Collider Spatial-Mapping Prefab Hologram Placement

Mixed Reality Toolkit Interfaces Summary

Chapter 13 An AI-Powered 3D App

Configuring Project and Scene Settings

Exploring the Mixed Reality Camera Prefab Creating Quad and 3DTextPrefab Objects

Setting Up Photo Capture

Initializing PhotoCapture Taking Photos Releasing the PhotoCapture Object App Capabilities

Using the Computer Vision API from MCS

Installing HttpClient Building the VisionApiClient Script

Billboarding and Tag-Along Summary

Chapter 14 Attaching Holograms to Real Objects with Vuforia

Creating the Project and Adding the AR Camera Prefab Adding the Image Prefab for the Image Target

Adding a Hologram to the Target Testing the App Adding a Text Description Implementing Extended Tracking

Implementing Augmented Navigation

Using the DefaultTrackableEventHandler Script Preparing the Scene Implementing the Patrolling Script Testing the App

Adding a Custom Image Database

Obtaining a Vuforia Developer License Key Creating a Database Adding a Target Downloading the Database and Importing It into Unity Selecting the Custom Image Target Configuring for HoloLens

Summary

Chapter 15 UrhoSharp

Setting Up the Project Implementing the Entry Point Adding Primitive Components and Materials Handling the Gaze

Indicating Gaze Direction Raycasting

Adding Gestures and Actions

Tap Double-tap Manipulation

Applying Physics

RigidBody CollisionShape Detecting and Handling Collisions Projectiles

Spatial Mapping Summary

Index

← Prev
Back
Next →

← Prev
Back
Next →