By Diane Brauner on May 10, 2021
Sonification is the use of non-speech audio to convey information or perceptualize data. In a nutshell, sounds have meaning. For decades, sonification has been an advanced tool for students who are blind or low vision, particularly for math; tools such as talking graphing calculators use sonification to provide information about graphs. Sonification is being used by professionals in STEM fields to access and interpret data, such as astronomers studying exoplanets. In recent years, new sonification tools have been and continue to be created; and, sonification is being applied to a variety of tasks. Sonfication is being used by everyone: from preschoolers to seasoned professionals - people with and without vision.
Benefits of Sonification for Users Who are Blind or Low Vision
- Independence: Sonification enables users who are blind or low vision to access information
- Speed: Using sonification is a faster process than exploring a tactile graph
- Sonification can be applied to make digital materials accessible (and easily sharable)
- Sonification is used to get a quick overview (such as a trend of a chart) before diving into the content; enables the user to 'scan' information quickly
- Sonification allows for free exploration, not bound by visual representations and frameworks
*From the World Sonification Chat group (WSC)
Advancements in technology are driving new applications for sonification, which in turn, is making sonification an important technology skill for students who are blind or visually impaired. How can sonification be applied to tasks for students who are blind or low vision?
- Ability to follow a sonified line on a touch screen device
- Access graph and chart information
- Access map information
- Access science data
- Access space data
Recently, there has been an organized interest in introducing sonification to young BLV students in age-appropriate activities, through simple apps. Just like other tech skills are introduced early, sonification should be introduced early and progressively grow as the student moves from elementary, middle and high school courses.
This Sonification Summary Page contains a list of and links to Paths to Technology posts about sonification. The Sonification Summary Page will be updated as more posts are published.
General Sonification Posts
- Sonification: Sounds with Meaning Activity Examples of sonified line charts and what they mean. (Using SAS Graphics Accelerator software)
- Sonification The Diagram Center, a leading research and development center dedicated to making images accessible, published an article about sonification: what it is, why it is beneficial and how it can be used in the classroom.
- Discovering Sonification Information and video which introduces sonfication, Sonification World Chat group, and Ballyland Sonoplanet. Ballyland Sonoplanet is an app currently under development geared for young BLV students which introduces sonification technology skills/concepts using engaging science content.
Math-Related Sonification Posts
-
Exploring Math with Desmos: Getting Started Desmos is an advanced talking graphing calculator mobile app and website. Desmos is an embedded tool on the digital SAT, PSAT, ACT, NWEA Map Growth tests and many state assessments.
- Test approved Graphing Calculator App
- Desmos Audio Tracing: Introducing Sonified Graphs: A videoed lesson introducing sonified graphs to a second grade student.
- Create Embosser Ready Graphs Directly from Desmos
- Graphing for Blind Students Tutorial: A video tutorial on creating and using graphs using Desmos and a screen reader.
-
SAS Graphics Accelerator Summary Page List of and links to Paths to Technology posts about SAS Graphics Accelerator - divided into SAS Graphics Accelerator Maps and SAS Graphics Accelerator Charts and Graphs. SAS Graphics Accelerator makes digital charts, graphs and maps accessible and includes sonification. There are more than 50 SAS Graphics posts on Paths to Technology; a couple a popular lessons for students are:
- Charts and Graphs Skills Review: Chart types are: bar chart, line chart, pie chart and series plot
- Choosing a Habitable Planet: Data Analysis Activity A lesson designed for students which uses sonified data to complete the activities.
- Activity: Reading Bar Charts Using Fun Facts About Planets A lesson designed for students to introduce students to sonified bar charts.
Space-Related Sonification Posts
- Chandra X-Ray Observatory Posts:
-
Space Telescope Science Institute Astronify:
- Hearing the Sound of Light: Using sonfication to listen to a star's brightness changing over time. (First post about interpreting a light curve).
- Discovering Exoplanets Using Sonification The second post to teach student astronomers how to interpret light curves. (Decoding the sound of a planet orbiting a faraway star, second post.)
- Musical Fingerprints of Wobby Stars The third post is about pulsating or star vibrations - called asteroseismology.
- Reach for the Stars: An Accessible Astronomy Textbook Reach for the Stars iBook has interactive, sonified images; the post includes a video that demonstrates some of the interactive images.
-
SAS Graphics Accelerator Posts with Space Activities
- Charts and Graphs Skills Review: Chart types are: bar chart, line chart, pie chart and series plot
- Choosing a Habitable Planet: Data Analysis Activity A lesson designed for students which uses sonified data to complete the activities.
- Activity: Reading Bar Charts Using Fun Facts About Planets A lesson designed for students to introduce students to sonified bar charts.
Coding-Related Sonification Posts
-
CodeQuest: A Free APH App Introduces CodeQuest, a simple coding concept app which uses sonification.
- Teaching CodeQuest App to Students who are Visually Impaired
- Learn How to Code Being a Blind Kid: Video #1 CodeQuest A student shares how she uses CodeQuest (beta version).
- Hidden Resources: Collaborative AT Projects with Universities CodeQuest initially began as a proof-of-concept app. It includes videos of the CodeQuest and the 3D printer CodeQuest characters)
O&M-Releated Sonification Posts
-
Map Explore: New O&M Game! O&Ms can create accessible digital maps in this app using Google Maps. The maps automatically generate streets which are sonified, allowing students to trace the streets on an iPad or Android tablet. The streets are announced along with the customized tags.
- Map Explore: Sneak Peak a New O&M Game: Explains the need for developing a mental map and introduces sonified streets in a video tutorial.
Misc. Sonification Posts
- Adventures of Karna: Multisensory App! (iOS app game that includes puzzles with images that use sonification and haptics)
Proof-of-Concept Apps (not yet publicly released)
- Sonitunes (Digital Lines App): University AT Project Sonitunes is a proof-of-concept app (currently not available publicly). Sonitunes takes a variety of educational classroom skills and makes these digital activities accessible through sonification for young students. (A video of the Sonitunes app is embedded into this post.)
-
Cosmic Numbers: Accessible Number Line App Semester 2 Cosmic Numbers is a proof-of-concept accessible number line app with 8 number line skills games. (Note: This version of Cosmic Numbers does NOT use sonified number lines; however, sonifying the lines would make this app even better!)
- Teaching Number Line Math Skills Part 3: Accessible App This is the first post about the first version of Cosmic Numbers.
Specific Tablets with Sonification
-
Vital: Exploring Accessible Digital Graphics Vital is a tablet and app combination that includes educational activities with haptics and sonification.
- Vital: Creating Accessible Digital Images A tool to create interactive digital images with haptics, sonification and text-to-speech using Vital's tablet and app.
-
Feelif: Digital Games and Digital Education An introduction to Feelif, an Android tablet loaded with educational games which incorporate haptics and sonification.
- Feelif Draw Drawing games that use sonification to indicate different lines and areas of the drawing and different sounds assigned to teach color.
- Feelif Creator: Review Introductory to various Feelif games with embedded videos.
- Feelif Memory Game Feelif's introductory video and information about their product.
