Virtual reality man-machine interaction method

By combining the virtual reality human-computer interaction method with the YOLO model and the OpenPose model, the problem of insufficient naturalness and immersion in the traditional interaction method in the virtual reality environment is solved, and the user's hand movements are accurately recognized and real-time response is achieved, enhancing the interactiveness and immersion of virtual reality.

CN119690249APending Publication Date: 2025-03-25BEIJING INSTITUTE OF GRAPHIC COMMUNICATION
0 Cites 3 Cited by

Patent Information

Application Number
CN202411904702.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-23
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

Traditional human-computer interaction methods lack naturalness and immersion in virtual reality environments, and there are problems of real-time, accuracy and robustness in hand movement recognition.

Method used

Using a virtual reality human-computer interaction method combining the YOLO model and the OpenPose model, the user's hand movements are collected through the camera, the YOLO model is used to detect the hand area and extract the area of ​​interest, and the key point information of the hand movements is extracted using the OpenPose model, and real-time processing and analysis are performed to identify the user's hand movement intentions, and the status of the virtual environment is adjusted according to the intention.

Benefits of technology

It realizes accurate recognition and real-time response to user's hand movements, provides an intuitive and natural interactive experience, enhances the immersion and interactivity of virtual reality, and significantly improves recognition accuracy and robustness.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of man-machine interaction, in particular to a virtual reality man-machine interaction method. The method comprises the following steps: S1, designing an interactive interface conforming to a virtual environment; s2, collecting hand actions of a user through a camera; s3, performing real-time processing and analysis on the hand action of the user through a key point detection OpenPose model, and identifying the intention of the hand action of the user; and S4, adjusting the state of the virtual environment according to the intention of the hand action of the user. According to the invention, by combining the YOLO model and the OpenPose model, accurate recognition and real-time response to the hand action of the user are realized. Static features (such as joint angles and palm normals) and dynamic features (such as motion trails, speeds and accelerated speeds) of hand actions are comprehensively utilized, so that visual and natural interaction experience is provided. The user can complete operations such as'grabbing 'and'pointing' through visual gestures, additional equipment is not needed, and the immersion and interactivity of virtual reality are enhanced.
Need to check novelty before this filing date? Find Prior Art