Posted in | News | Biomimetic Robotics

Robotic Frog Helps Test How Female Frogs Integrate Audio-Visual Signals

If you've ever heard the boisterous courtship sounds being made at night by male frogs gathered around a pond or "watering hole" to attract mates, you may have noticed some communication similarities to those of humans enjoying a loud night out at a cocktail party or bar—that familiar cacophony with everyone essentially shouting over each other to be heard.

This upper image shows a robotic túngara frog, while the bottom image is of a live frog. The robotic túngara frog has an inflatable vocal sac, which is used to test hypotheses about how female frogs integrate audio-visual signals. Credit: Barrett Klein/Ryan Taylor/Salisbury University

At the 167th meeting of the Acoustical Society of America, to be held May 5-9, 2014 in Providence, Rhode Island, Ryan C. Taylor, an associate professor in the Department of Biological Sciences at Salisbury University in Maryland, will describe how his work studying how frogs communicate—aided by a robotic frog—is addressing some long-standing basic questions about how evolutionary processes shape the diversity of communication systems.

Female frogs, for example, express strong mating preferences for particular properties of male vocalizations, but exactly how they're able to identify individual callers within the noisy chorus environment remains unclear.

One possible answer is that the females are relying on a combination of acoustic and visual cues.

"Although vocalizations are required for mate attraction, the inflating 'throat pouch,' otherwise known as a vocal sac, produced by males during 'calling,' plays a significant role in attracting a mate," explained Taylor. "Females pay attention to the timing of the sound they hear and the vocal sac movement they can see. If these two cues don't match closely in time and space, females reject the signal."

Taylor and colleagues found that by rearranging the timing of call notes and vocal sac movements to sandwich the vocal sac between two call notes, they were able to restore the attractiveness of the call—even though it was completely unnatural.

From a basic biological perspective, "this suggests that the female frog's brain provides the basis for the evolution of male courtship signals," Taylor said. "If the female brain is permissive enough to render unnatural signals attractive, then random mutations in male signals can evolve. Certain new signal combinations would become acceptable to females, which would allow males to mate and pass along those traits."

But perhaps the most surprising aspect of Taylor's research is the finding that frogs respond to variations in audio-visual signals—somewhat analogous to human lip readers at noisy cocktail parties.

"In noisy environments, humans often rely on lip reading to improve speech comprehension," Taylor said. "Humans can, however, be fooled by changes in patterns of the speaker's lip movements—known as the 'McGurk Effect.' If you play a sound, but artificially change the way lips move, listeners hear a different sound—although the sound itself hasn't actually changed."

This demonstrates that the "human brain conducts a rather powerful integration of both sight and sound to generate our perceptions of speech," he noted. "Amazingly, frogs with substantially less sophisticated brains seem to conduct a similar type of audio-visual integration."

Taylor and his colleagues hope their work with frogs may help improve our understanding of how the human brain integrates multiple streams of sensory information to generate coherent perceptions of speech.

"The fact that frogs respond so strongly to variations in audio-visual cues suggests there may be some fundamental audio-visual processing that occurs in the vertebrate brain—meaning that frogs could provide a model system for better understanding audio-visual integration as it occurs in other animals, as well as humans," Taylor said.

Next up, Taylor and colleagues plan to explore the role of water ripples in the communication system of the túngara frog. "The full extent of waterborne ripples in this communication system remains unknown, so we're currently developing experiments to study how ripples are integrated with auditory and visual modes of communication," he said.

Presentation #1aAB4, "Cross-modal integration and non-linear relationships: What can frogs tell us about solving cocktail party problems?" by Ryan C. Taylor will be at 9:00 a.m. ET on Monday May 5, 2014 in Ballroom B of the Rhode Island Convention Center.

Source: http://acousticalsociety.org/

Tell Us What You Think

Do you have a review, update or anything you would like to add to this news story?

Leave your feedback
Your comment type
Submit

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.