Interspecies Gesture Recognition Across Domains

    Gestures play a crucial role in communication, serving as movements that complement speech both temporally and semantically. Through their unique forms of movement, gestures not only represent speech but also contribute to the understanding of both the speaker and the audience, influencing memory capabilities. The effectiveness of gestures hinges on the audience and speakers' reliance on their clarifying and memory-enhancing capabilities. In today's diverse society, where a standard language is absent even among a singular species, gestures become paramount in providing communication cues globally. 

    In a world where there is no standard language among a species, gesture is paramount to giving people communication cues worldwide. As there is no common language between a singular species, it is no wonder that there is no common language that exists in an interspecies manner. The study of gestures becomes immensely powerful in such scenarios. In the science journal "Language Proficiency Impacts the Benefits of Co-Speech Gesture for Narrative Understanding Through a Visual Attention Mechanism," Dr. Wakefield et al. explore the significance of gesture and language in terms of bettering the understanding of individuals between two language barriers. They study the modulating effects of language proficiency on the utility of communicative gestures. To accomplish this task they directed 17 Polish-English children (ages 6-8) to watch videos with scripted gestures, while their eye movements were tracked. They were then asked to recall the premise of the videos in great detail while their gestures were later tracked and coded. They determined that matching gestures were significant in assisting with specific recall. They also determined that visual attention also played a crucial role in the children's ability to recall. 

    The importance of gestures extends beyond human communication to interspecies interactions. Within the article “Humans Can Recognize and understand chimpanzee and bonobo gestures,” data reveals that intentional gesture communication outside of the human language exists. Many of these gestures are expressed by non-human apes, including distantly related apes such as chimpanzees and orangutans. The article speaks of a study that found that humans who visually fixate on the animal's gestures are able to understand the gestures with an over 50% accuracy rate. Providing the participants with additional information as to what the ape was doing, something that would often be divulged in language, made the number of correct gestures interpreted exponentially greater. 

    In conclusion, the study's results highlight the vital role of gestures in both interhuman and interspecies communication. Just as gestures enhance speech across different human languages, they prove indispensable in bridging communication gaps between species.

References:   

    Science X. (2023, January 24). Humans can recognize and understand chimpanzee and bonobo gestures. Phys.org; Phys.org. https://phys.org/news/2023-01-humans-chimpanzee-bonobo-gestures.html

    

    Towards a great ape dictionary: Inexperienced humans understand common nonhuman ape gestures, PLoS

Biology (2023). DOI: 10.1371/journal.pbio.3001939

    

    Zielinski, N., & Wakefield, E. M. (2021). Language Proficiency Impacts the Benefits of Co-Speech Gesture for Narrative Understanding Through a Visual Attention Mechanism. Proceedings of the Annual Meeting of the Cognitive Science Society, 43(43). https://escholarship.org/uc/item/63r5d3qq

Gesture Utilization Across Species Lines

Gesture is a common utilization in speech, to describe and elaborate on what is being said verbally. It may even come so naturally to us that we don’t realize the extent of the impact it has on our communication. In children, gestures are subconsciously used to enhance memory and learning in the long term. It is believed that the mental mechanisms of learning, speech, and gesture are all related to each other in intricate and important ways.

For the research article “Language Proficiency Impacts the Benefits of Co-Speech Gesture for Narrative Understanding Through a Visual Attention Mechanism” by Natalia Zielinski and Elizabeth Wakefield, a study was completed that tested how much the addition of gesture benefitted a listener, based on age and language proficiency. The subjects, 17 bilingual children between the ages of six and eight, were read a story in one of two languages -- English or Polish -- which was accompanied by no gesture, matched gesture, or mismatched gesture. Matched gesture is redundant with speech, essentially repeating what was said, but in gesture. Mismatched gesture is gesture that provides additional information to what was said, rather than information found in the speech. The children were then asked to reproduce the story points, which produced quantifiable recall scores. The results of the study show that all of the children, who were reported as being more proficient in English, remembered the most English story points without gesture, and the most Polish story points were remembered when in conjunction with matched gesture. In the language with lower proficiency, the kids used the gesture to help determine the meaning of what was being said. This shows that gesture deeply benefits language learning.

In a New York Times article recently released called “The Animals Are Talking. What Does It Mean?” by Sonia Shah, a very similar idea is addressed. An important part of the article addresses Cat Hobaiter, a scientist who works with great apes, some of our closest living relatives, and studies the gestures of her subjects. In the gestures recorded between the great apes she studies, a decently high amount are actually legible to us humans. Hobaiter has used her study techniques on pre-verbal children, toddlers of one or two years of age, and found 40-50 matching gestures that indicated the same, or very similar meanings between species. She also put videos of ape gestures online for adult humans to try to decode or define, and the correct responses from people was found at a rate “significantly higher than expected by chance”, as Hobaiter and her fellows reported in a paper for PLOS Biology.

Though these articles address different species, and different reasons for gesture, they match in the idea that gesture is subconscious, and has legitimate meaning in use. Whether gesture is the main source of communication, or just an additional resource, research from around the world is concluding that gesture plays an important role in communication.




Sources

Shah, Sonia. “The Animals Are Talking. What Does It Mean?” The New York Times, The New York Times, 20 Sept. 2023, www.nytimes.com/2023/09/20/magazine/animal-communication.html.




Zielinski, N., & Wakefield, E. M. (2021). Language Proficiency Impacts the Benefits of Co-Speech Gesture for Narrative Understanding Through a Visual Attention Mechanism. Proceedings of the Annual Meeting of the Cognitive Science Society, 43(43). https://escholarship.org/uc/item/63r5d3qq

Don’t Overthink It: Could Higher Executive Functions Inhibit Foreign Language Ability?

It is well known that children are much better at learning languages than adults. After all, it is exceedingly rare for one to master a language to the extent of one’s native one, thinking and dreaming in one learned later in life. Nelson Mandela famously said, “If you talk to a man in a language he understands, that goes to his head. If you talk to him in his language, that goes to his heart.”

One paper sought to compile research on this very topic, finding many interesting details about bilingualism and brain development (Berken et al., 2017). One such finding is that the first few months are crucial in phoneme (the sounds of a language) acquisition, and that the speaking of various sounds and babbles in a tongue that will grow to be indistinguishable to that of a native speaker solidify as early as one year of age.

The exact reason that humans lose this ability to take on a new language like our native one is unknown, and there are many possible explanations. One may be simple necessity and opportunity, that as infants we both require learning the language around us to communicate basic needs and have little else to do or devote brain power towards. A common theory is that young children’s minds are especially malleable, and that the increased neuroplasticity that comes with youth is why learning languages becomes increasingly difficult as one ages.

A recent study, however, hints at an entirely different conclusion. The University of Liverpool conducted a study that focused on the language ability of non-native speakers, comparing sober participants to those who consumed a low-dose of alcohol (Renner et al., 2017). Surprisingly, despite controlling for a placebo effect and finding no change in self-reported language ability, native speakers of the language in question blindly tended to rate those in the alcohol consuming group with significantly higher conversational scores!

This surely came as a surprise. Alcohol is well-known for inhibiting what are known as ‘executive functions’, things such as memory, attention, comprehension, alertness, and pronunciation. This is why we picture a forgetful, sleepy, inattentive, slurring person when we imagine somebody who has had a lot to drink. While the study was notably a small amount of alcohol- comparable to a pint of beer for an average man- it seems counterintuitive that even slight inhibition of the previously mentioned functions would result in better performance in speaking a foreign language. Many of the things we consider ‘executive functions’ are things we consider key to speaking a learned language. What could be the cause of this finding?

The study admittedly offers that the anxiety suppressing effects of alcohol could be the source of the findings. A small amount of alcohol tends to make most people more social and less nervous, which could have resulted in more casual and natural language. While this is likely partially to blame for the findings, I suggest something else. That the suppression of these executive functions is precisely what allows for better language abilities rather than being a side-effect that is overcome by alcohol’s more social effects.

While it’s true that memory recall and pattern recognition are what comes to mind when we think about a foreign language, it’s important to recognize that it may not be that way for an infant- those most adept at learning languages of all humans (broadly). An infant is not an acute pattern recognizing and alert genius; they wield a still developing brain that even at its best is much less intelligent than a heavily intoxicated adult. The mentioned study implies that partially inhibiting these executive functions allows the human mind to take a step closer to its natural language-learning state; more of a blank canvas than refined machinery.

It’s hard to say what this could mean for the future of language education and instruction if these findings are supported, particularly if the anxiety reducing effects of alcohol can be controlled for. Should students in high-school Spanish take a shot of vodka before their lesson? No, probably not. But it is worth exploring the fact that the logical, pattern based method with which we teach and learn languages is very different from how an infant naturally learns, and that a more immersive, less analytical method may lead to better and faster results. Maybe it’s time we started learning with our hearts instead of our heads. But maybe it also means that shotgunning a White Claw before your next foreign language final isn’t as bad of an idea as it might seem.

References

Berken, J. A., Gracco, V. L., & Klein, D. (2017). Early bilingualism, language attainment, and brain development. Neuropsychologia, 98, 220-227. https://doi.org/10.1016/j.neuropsychologia.2016.08.031

Renner, F., Kersbergen, I., Field, M., & Werthmann, J. (2017). Dutch courage? Effects of acute alcohol consumption on self-ratings and observer ratings of foreign language skills. Journal of Psychopharmacology, 32(1), 116-122. https://doi.org/10.1177/0269881117735687