ECE research team introduces unique wearable audio data set

ECE News

Allie Arp, CSL
5/17/2019 11:42:54 AM

Story Highlights

Team lead Ryan Corey and a mannequin, both of which were covered with 80 microphones during the research.
Team lead Ryan Corey and a mannequin, both of which were covered with 80 microphones during the research.
Researchers studying wearable listening technology now have a new data set to use, thanks to ECE ILLINOIS graduate student Ryan Michael Corey and his team. Debuting at the International Conference on Acoustics, Speech, and Signal Processing Team lead Ryan Corey and a mannequin, both of which were covered with 80 microphones during the research.

(ICASSP) this week, the first-of-its-kind wearable microphone impulse response data set is invaluable to audio research for two reasons: First, the data includes up to 80 microphones instead of the usual two showing how is heard on different parts of the body, and second, the data is available for free under an open-access license.

“We believe hearing aids, smart headphones and all listening devices would work better if they had a lot of microphones, but most products only have two,” said Corey. “There isn’t data out there for more than that. Even the work that has been done with more didn’t include open-access data sets.”

The data set consists of more than 8,000 acoustic impulse responses measured at 80 different position on the body. The 80 microphones were tested on five different hat/headphone styles and with six different types of clothing. The sound in the recordings came from 24 different directions to simulate noisy crowds.

Microphones were placed on 80 different places on a mannequin and sound was played from 24 different directions to create the data set.
Microphones were placed on 80 different places on a mannequin and sound was played from 24 different directions to create the data set.
The group, including Corey’s adviser, ECE ILLINOIS Professor Andrew Singer, and former undergraduate student Naoki Tsuda, spent weeks placing 80 microphones all over a mannequin and Corey himself in the CSL Augmented Listening Laboratory. They then recorded acoustic impulse responses to study the acoustics of the body and whether or not clothes plays a difference in how microphones pick up noise. The collected data is used by the team in the paper being presented at ICASSP this week, but they wanted the data to go farther.

“We’ve been frustrated when trying to use data sets that aren’t open,” said Corey. “Wearable arrays are important and more people should research it. Having this data out there will make it more convenient to do so.”

Recordings with many different hats, headphones and clothing styles are included within the data collected by the researchers.
Recordings with many different hats, headphones and clothing styles are included within the data collected by the researchers.
Future researchers can use the data to simulate wearable microphone arrays with different numbers of microphones at different points on the body. Many humans are already wearing multiple devices with microphones, and this data could help take advantage of that. Engineers can use it to design new products and study performance tradeoffs for different applications. A few of the potential applications for the data include augmented reality, speech recognition, and acoustic event detection, among others. Without the data set created by the CSL team, each researcher would have to build their own prototypes and test them, which is time-consuming and expensive.

The presentation takes place on Tuesday, May 14, in Brighton, UK. Singer, Fox Family Professor in Electrical and Computer Engineering, and Corey hope the presentation will raise awareness of the dataset, encourage others to use it, and give them to opportunity to receive feedback.

“This is the best-attended conference for audio signal processing, so I’ll be able to introduce the data set to a lot of researchers who could potentially take advantage of it, build on it, and give us feedback for future improvement,” said Corey.

The data set is available under a Creative Commons Attribution License at the University of Illinois Library’s Illinois Data Bank archives. Corey also has written about the dataset on the lab’s blog. Singer is also affiliated with the CSL and the Beckman Institute

 

Check out the original article on the CSL site

Media Contact

Todd Sweet

Director of Communications
1066 ECE Building
(217) 333-5943
tmsweet@illinois.edu

Ryann Monahan

Communications Coordinator
1066 ECE Building
(217) 300-6658
ryann@illinois.edu

Have a news story idea? Submit it here: go.ece.illinois.edu/News

The ECE ILLINOIS news item submission form will help increase the visibility of ECE ILLINOIS. Submissions can include ongoing or published research, new funding, awards, student or faculty highlights, and anything else new and interesting in ECE ILLINOIS. This could be for a press release, feature article, podcast, video, social media post, or the Illinois News Bureau.