System and method for mapping blocked area

Abstract

A system and method for mapping an occluded area. The invention solves the problem of finger occlusion of content displayed on a touch screen or of content depicted on a touch pad, as well as occlusion of the point at which the finger contacts the touch screen, when a user is manipulating a touch pad, touch screen, or other such device. The invention also solves the problem of some system-level virtual buttons occluding content of a window under said buttons. The invention mainly makes use of such means as creating mapping areas and mapping the contact point of a finger. Through the use of mapping areas to dynamically map and display content in an area covered by a finger or by a virtual button, the invention solves the occlusion problem currently present in the art.

Description

technical field [0001] The invention belongs to the man-machine interaction control system and method, mainly used for controlling handheld computers, such as smart phones, tablet computers, intelligent portable testers, etc., and can also be used for remote control of general desktop computers, set-top boxes, smart TVs and other equipment device. Background technique : [0002] Existing devices such as desktops, notebooks, and handheld computers are all graphical interface displays, and all support multi-window display and multi-task execution. In this way, there will be display conflicts between multiple windows; and Conflict coordination when operators perform multitasking. The present invention is designed to resolve such conflicts. [0003] Among the control methods for controlling handheld computers, there is such a control method, which uses the gyroscope in the handheld computer to monitor the operator's rotation posture of the handheld computer, thereby controlli...

AI Technical Summary

Problems solved by technology

However, when manipulating the virtual buttons on the touch screen, it is impossible to obtain these feedback information through touch. In this way, if the operator does not often observe the position of the finger on the virtual button, it is difficult to ensure that the finger is in the correct position. operate

It should be noted that at this point, the virtual mouse system based on dynamic sensing has obvious disadvantages compared with the traditional touch screen control method, because the pointer, finger, and button of the traditional touch screen are trinity, while the virtual mouse system based on dynamic sensing In the virtual mouse system, the pointer and the button are separated, which requires the operator's eyes to constantly move between the pointer and the virtual button, which will cause obvious discomfort to the operator

[0005]2. The finger blocks the virtual mouse button. As mentioned above, the operator needs to constantly observe the relative position of the finger and the virtual mouse button when operating the virtual mouse button. can be operated correctly, but the finger itself blocks the button. When the system has only one virtual mouse button, the operator can roughly guess the position of the button through the reference objects around the button, but when the system has multiple virtual mouse buttons and interact with each other When they are closely arranged together, the operation becomes very difficult. In fact, there are similar difficulties in the operation of the traditional touch screen. There are two ways to solve it. One is to distribute the screen objects that can be triggered as much as possible. Sparse, the trigger object should be as large as possible; the second is to make an extended crosshair on the touch point of the finger and move with the movement of the finger, and always keep the intersection point of the crosshair coincident with the touch point of the finger, so that the operator can pass The part of the crosshair extending out of the finger occlusion area is used to infer the position of the contact point of the finger

[0006]3. The virtual button window itself blocks a part of the display content, and opening up a virtual mouse button area on the screen of mobile phones, tablet computers and other devices will inevitably occupy a certain amount of space. Screen space, which requires other programs to coordinate with it and avoid displaying its content in this area. However, it is obviously impossible for many application developers to follow a certain rule to modify their programs.

Considering that the tablet often changes the direction of holding, sometimes it is held horizontally, sometimes it is held vertically, and the position of the virtual mouse button needs to be changed accordingly. The solution to this problem becomes more complicated.

Images