Tuesday, November 5, 2024
12.8 C
New York

New Machine Learning Software can Imitate Human Emotional Response

Disney Research engineers have developed a machine learning software that can evaluate the various and complex emotional responses of movie audiences based on their faces.The software utilizes an algorithm called factorized variational auto-encoders, or FVAEs, and was developed in coordination with researchers from Caltech and Simon Fraser University.


Usually, variational auto-encoders automatically transcribe the complex images they collect into numbers and is sometimes called latent encoding or representation. But this new FVAEs from the university partners’ also add metadata, that is additional information about the data itself.

When it comes to understanding faces, the FAVEs breaks down each expression by assigning a number to certain features then connects that number to matching expressions at other times or different expressions occurring at the same time. For example, one number may represent a small smile, while a different number is assigned to a wider smile, and a separate number is for whatever the eyes are doing.


To gather the data, four infrared cameras were installed in a 400 seat theater during 150 showings of various Disney movies. They captured 68 separate features per face for a total of over 3000 total viewers equaling about 16 million unique images.

According to Peter Carr, a Disney Research scientist, the new software is incredibly accurate so that with sufficient information it can actually predict an audience’s’ reaction after only a few moments of observation. However, the ultimate goal of such software doesn’t stop at the movie theater. Yisong Yue, a professor in Caltech’s Division of Engineering and Applied Science, would like to utilize the software as part of a complete AI that can understand human visual cues, like body language, to aid in caring for the elderly, when pain or discomfort may not explicitly be stated.


For Disney’s part, the software can be used for modeling any collection of objects after observation. For example, after analyzing differing trees moving in the wind, the information from FVAEs can help make animated trees more realistic.

Research Paper

More News to Read

Hot this week

Brooklyn Defendants Charged in Rideshare Hacking Scheme: Jailbroken Phones Used to Exploit Uber

Brooklyn federal court has charged two defendants, Eliahou Paldiel...

Detecting Defects in Next-Generation Computer Chips: The Future of TMD-Based Semiconductors

As technology advances, the demand for smaller, more powerful...

Merging Galaxies in the Early Universe: The Birth of a Monster Galaxy

Astronomers have recently observed a fascinating event in the...

Topics

Brooklyn Defendants Charged in Rideshare Hacking Scheme: Jailbroken Phones Used to Exploit Uber

Brooklyn federal court has charged two defendants, Eliahou Paldiel...

Detecting Defects in Next-Generation Computer Chips: The Future of TMD-Based Semiconductors

As technology advances, the demand for smaller, more powerful...

Merging Galaxies in the Early Universe: The Birth of a Monster Galaxy

Astronomers have recently observed a fascinating event in the...

NASA’s Roman Space Telescope to Uncover Galactic Fossils and Dark Matter Mysteries

NASA’s Roman Space Telescope is set to transform our...

Black Myth: Wukong – A Game that Gamers Love Despite Media Backlash

In a gaming industry increasingly influenced by social agendas,...

Gravitational Waves Reveal a ‘Supercool’ Secret About the Big Bang

In 2023, physicists made a groundbreaking discovery that could...

Related Articles

Popular Categories

Send this to a friend