ANI
09 Dec 2022, 00:25 GMT+10
Washington [US], December 8 (ANI): A new study has revealed that audio cues can not only help us recognise objects but can even alter our visual perception.
The study was published in the journal, 'Psychological Science'.
It suggests that these kinds of audio cues can not only help us to recognize objects more quickly but can even alter our visual perception. That is, pair birdsong with a bird and we see a bird -- but replace that birdsong with a squirrel's chatter, and we're not quite so sure what we're looking at.
"Your brain spends a significant amount of energy to process the sensory information in the world and to give you that feeling of a full and seamless perception," said lead author Jamal R. Williams (University of California, San Diego) in an interview.
"One way that it does this is by making inferences about what sorts of information should be expected," he added.
Although these 'informed guesses' can help us to process information more quickly, they can also lead us astray when what we're hearing doesn't match up with what we expect to see, said Williams, who conducted this research with Yuri A. Markov, Natalia A. Tiurina (Ecole Polytechnique Federale de Lausanne), and Viola S. Stormer (University of California, San Diego and Dartmouth College).
"Even when people are confident in their perception, sounds reliably altered them away from the true visual features that were shown," Williams said.
In their first experiment, Williams and colleagues presented 40 participants with figures that depicted two objects at various stages of morphing into one another, such as a bird turning into a plane. During this visual discrimination phase, the researchers also played one of two types of sounds -- a related sound (in the bird/plane example, birdsong or the buzz of a plane) or an unrelated sound like that of a hammer hitting a nail.
Participants were then asked to recall which stage of the object morph they had been shown. To show what they recalled, they used a sliding scale that, in the above example, made the object appear more bird or more plane-like. Participants were found to make their object-morph selection more quickly when they heard related (versus unrelated) sounds and to shift their object-morph selection to more closely match the related sounds that they heard.
"When sounds are related to pertinent visual features, those visual features are prioritized and processed more quickly compared to when sounds are unrelated to the visual features. So, if you heard the sound of a birdsong, anything bird-like is given prioritized access to visual perception," Williams explained. "We found that this prioritization is not purely facilitatory and that your perception of the visual object is actually more bird-like than if you had heard the sound of an airplane flying overhead."In their second experiment, Williams and colleagues explored whether this effect was specific to the visual-discrimination phase of perceptual processing or, alternatively, if sounds might instead shape visual perception by influencing our decision-making processes. To do so, the researchers presented 105 participants with the same task, but this time they played the sounds either while the object morph was on screen or while participants were making their object-morph selection after the original image had disappeared.
As in the first experiment, audio input was found to influence participants' speed and accuracy when the sounds were played while they were viewing the object morph, but it had no effect when the sounds were played while they reported which object morph they had seen.
Finally, in the third experiment with 40 participants, Williams and colleagues played the sounds before the object morphs were shown. The goal here was to test whether audio input may influence visual perception by priming people to pay more attention to certain objects. This was also found to have no effect on participants' object-morph selections.
Taken together, these findings suggest that sounds alter visual perception only when audio and visual input occur at the same time, the researchers concluded.
"This process of recognizing objects in the world feels effortless and fast, but in reality, it's a very computationally intensive process," Williams said. "To alleviate some of this burden, your brain is going to evaluate information from other senses." Williams and colleagues would like to build on these findings by exploring how sounds may influence our ability to locate objects, how visual input may influence our perception of sounds, and whether audiovisual integration is an innate or learned process. (ANI)Get a daily dose of Memphis Sun news through our daily email, its complimentary and keeps you fully up to date with world and business news as well.
Publish news of your business, community or sports group, personnel appointments, major event and more by submitting a news release to Memphis Sun.
More InformationMADRID, Spain: Liverpool footballer Diogo Jota and his younger brother, André Silva, have died in a car accident in Spain. Spanish...
LONDON, U.K.: An unrelenting heatwave sweeping across Europe has pushed early summer temperatures to historic highs, triggering deadly...
President Donald Trump's plans to build a space-based Golden Dome missile defense shield have drawn immediate criticism from China,...
NEW YORK CITY, New York: Paramount has agreed to pay US$16 million to settle a lawsuit brought by U.S. President Donald Trump over...
LONDON, U.K.: British Prime Minister Keir Starmer won a vote in Parliament this week to move ahead with changes to the country's welfare...
WASHINGTON, D.C.: President Donald Trump will meet Israeli Prime Minister Benjamin Netanyahu at the White House on Monday. President...
FRANKLIN, Tennessee: Hundreds of thousands of Nissan and Infiniti vehicles are being recalled across the United States due to a potential...
REDMOND, Washington: Microsoft is the latest tech giant to announce significant job cuts, as the financial strain of building next-generation...
LONDON UK - U.S. stock markets were closed on Friday for Independence Day. Global Forex Markets Wrap Up Friday with Greeback Comeback...
SANTA CLARA, California: Nvidia came within a whisker of making financial history on July 3, briefly surpassing Apple's all-time market...
SACRAMENTO, California: California's multibillion-dollar farms are facing a growing crisis—not from drought or pests, but from a sudden...
WASHINGTON, D.C.: President Donald Trump says the United States could soon reach a trade deal with India. He believes this deal would...