Sound and Sonification Design for Interactive Learning Tools

Sound

What sounds do we hear every day? What sounds do we hear when we use technology? And, how do we rely on them to inform our decisions throughout the day? We’ll cover categories of sound types and terminology.

Sound Design

Module 2 introduces specific mappings and sound characteristics that we can rely on to convey information. We’ll introduce terminology for simple mappings like pitch, timbre, reverberation, and many more. Then we’ll move on to more complex audio mappings, and design considerations for layering sounds in interactive learning tools.

Evaluation

For sound designs, it’s important to understand how your users are interpreting and thinking about the mappings. This module will cover the measurements and question types to consider for evaluation, the different types of evaluations, and how to analyze the data generated in the process. Then, we’ll discuss how to make changes to a sound design using what we learned from evaluations.

Prototyping

Module 4 will introduce different prototyping and design methods for making sounds. We’ll go through a variety of tools that you can use to make sounds, and where to find other sounds you might want to use. We’ll introduce some programmatic ways of creating sounds and discuss how to embed the sounds into prototypes.

Designing Sounds and Sonifications

In this module we review best practices. These will come from previous research and also our own work. We’ll review the full process we suggest for successful sound design. This will also be your chance to put all of your skills into practice, and start using the full process to work on a sound design from end to end.

Putting It All Together

Module 6 will review the content across all lessons, and consider ways for you to integrate the different steps together -- brainstorming designs, planning an evaluation, deciding on an analysis plan, and redesigning. We’ll also review how you can get involved in future projects.