May 21, 2024

Out of head movement, lip commands make VR interaction easier

We all know that VR technology can't be worn away from the head. In the process of playing, we must rely on the movement of the head to change the position of the virtual environment. However, in this way, the user can play for a long time, otherwise it is easy to cause fatigue of the head rotation. Now we can play VR in another way, and the lip interaction makes the VR interaction easier.

Researchers at the University of New York at Binghamton University have recently developed a new technology that allows users to interact in a virtual reality environment with a mouth-to-mouth format.

Out of head movement, lip commands make VR interaction easier

As we all know, virtual reality heads can bring users a realistic immersive experience. However, the current wearing method of the head is covering the top of the user's face, hindering the entire face recognition. To solve this problem, Lijun Yin, a professor of computer science at Binghamton University, and his team developed another system that interacts as a collaborative medium for virtual reality.

Yin’s team tested the app among a group of students. When the user wears the headline, it is a simple game in front of it. The purpose of the game is to let the user control the character to walk in the forest and eat as much cake as possible. The user needs to turn around to select the game process, use the mouth to move and smile to eat the target cake. The system describes and classifies the user's mouth shape and achieves a high correct recognition rate. In addition, the system has been actually demonstrated and subsequently validated in virtual reality applications.

“We want this system to be used by more people than just one person. Just like interviewing or communicating on Skype, suppose the system can make you feel as if you are in the same space, so that you can be more Intimate contact, and computer programs can effectively scan your facial expressions and copy them to make them look real," Yin said.

Yin said: "The virtual world exists not only for games. For example, health care can use VR to help disabled people, military or physiotherapists can also do some training that can't be done in real life. The experience is more realistic."

Although the technology is still in the prototype stage, Yin believes that this technology has broad application prospects.

Encoder

Optical Rotary Sensor,Custom Encoder,Optical Encoder 6Mm Shaft,Handwheel Pulse Generator

Jilin Lander Intelligent Technology Co., Ltd , https://www.jllandertech.com