Camera shooting and large screen interaction processing method, device and system

Abstract

The invention provides a camera shooting and large-screen interaction processing method, device and system. The method comprises the following steps: acquiring a real-time limb recognition image and alarge-screen display image; mapping the limb identification image to a large-screen display image and identifying an operation instruction; identifying a first feature region corresponding to a feature limb part of the limb identification image in the large-screen display image; acquiring an eye movement recognition image of an operator in real time; mapping the eye movement recognition image toa large-screen display image; identifying a second feature region corresponding to an eye movement identification part of the eye movement identification image in the large-screen display image; if the first feature region and the second feature region are located in the same operation region in a large-screen display image, outputting an effective instruction and the operation instruction, wherein the operation area is an area pre-divided according to a real-time large-screen display image.

Description

technical field [0001] The present application relates to the technical field of screen interaction, in particular to a method, device and system for processing camera and large screen interaction. Background technique [0002] At present, operation demonstrations based on large-screen displays have been widely used in classrooms, meeting rooms, and command rooms in education, business, and military fields, and large-screen display systems have developed rapidly. [0003] As a commonly used large-screen display system tool, optical touch screens such as touch-screen projection equipment mainly obtain instructions for operating large-screen display images by recognizing body movements of the human body. However, during the use of related equipment, part of the body movements of the operator are for controlling the large screen, but some of them have nothing to do with the control of the large screen, so some of the instructions obtained by recognizing body movements are inval...

AI Technical Summary

Problems solved by technology

However, during the use of related equipment, part of the body movements of the operator are for controlling the large screen, but some of them have nothing to do with the control of the large screen, so part of the instructions obtained by recognizing human body movements are invalid, but the system cannot recognize them. These invalid instructions lead to frequent misoperations by operators in the process of using related equipment

For example, the system recognizes the action of clicking with the arm toward the large screen as a click instruction, but when the operator does not need to click but uses the action of clicking with the arm toward the large screen, the system will still recognize that the click instruction has been received and respond to the large screen. Operate the content displayed on the screen, resulting in misoperation

Images