Motion sensing game interactive method and system based on deep learning and big data

Abstract

The invention discloses a motion sensing game interactive method and system based on deep learning and big data, and belongs to the technical field of man-machine interaction. The method includes the steps of I, collecting a motion video sample dataset; II, establishing a deep convolutional neural network model, and training the same offline; III, using the deep convolutional neural network model. The system comprises a deep convolutional neural network offline training module, a real-time man-machine interaction module, and a deep network model online optimization module based on big data. Common cameras are used in real time to acquire game operation videos of game players, high-level semantic characteristics of motion via are extracted via a deep convolutional neural network, limb movements are judged and converted into actual control data for a game target, and the game target can be controlled to move correspondingly the same as the player via the player's limbs.

Description

technical field [0001] The invention discloses a somatosensory game interaction method and system based on deep learning and big data, belonging to the technical field of human-computer interaction. Background technique [0002] Somatosensory game is a new type of electronic game that can be operated and felt through changes in the player's body movements. Compared with traditional electronic game systems that rely on mouse, keyboard, gamepad and other devices as interactive media, somatosensory games use the recognition of players' "body movements" as an interactive method. Traditional electronic games require players to sit in front of the game equipment for a long time, which is not conducive to physical and mental health. In somatosensory games, players send all instructions to the game through their bodies, and the body dances with the game without any restraint, which greatly enriches the player's game immersion. It gives players an excellent somatosensory experience,...

AI Technical Summary

Problems solved by technology

Traditional electronic games require players to sit in front of the game equipment for a long time, which is not conducive to physical and mental health. In somatosensory games, players send all instructions to the game through their bodies, and the body dances with the game without any restraint, which greatly enriches the player's game immersion. sense, giving players an excellent somatosensory experience, and can also exercise while playing games and entertainment

[0003] At present, somatosensory games have the following implementation methods: 1. Microsoft's XBOX 360 uses kinect 3D cameras to collect player's body and bone information to identify players' body movements, which has high recognition accuracy but expensive equipment; 2. Wearable or handheld sensors Collect the player's body information to identify the player's body movements. This implementation requires the player to wear or hold the sensor, which may cause discomfort to the player and affect the player's experience

All in all, these somatosensory games have strict requirements on hardware equipment, complex configuration environment, and high game costs, which are not conducive to the popularization and promotion of somatosensory games.

Images