Unlock instant, AI-driven research and patent intelligence for your innovation.

A visual, operable and non-substantial touch screen system

A touch screen, non-physical technology, applied in the field of human-computer interaction, can solve the problems of not realizing virtualization, not considering how users observe virtual output, unnatural use, etc.

Inactive Publication Date: 2011-12-07
FUDAN UNIV
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, they have a common disadvantage: using unnatural
This invention can solve the problem of using direct human input, but it does not take into account how the user observes the virtual output, but uses an ordinary display screen for output, and does not realize virtualization at the output level

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A visual, operable and non-substantial touch screen system
  • A visual, operable and non-substantial touch screen system
  • A visual, operable and non-substantial touch screen system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0086] Embodiment 1: Realize the operation of Windows programs on the virtual touch screen as an example.

[0087] This embodiment shows how the present invention can replace a common touch screen to operate a computer.

[0088] When using, the user wears the head-mounted display and the two network cameras fixed on it, and places the calibration reference object at the same time. After running the system on the computer, the user can see a virtual touch screen appearing next to the calibration reference object through the head-mounted display, with the interface of the Windows program on it. When the user clicks on the virtual touch screen with the index finger, the touch screen will perform corresponding operations. For example, when the user presses the icon with the index finger and then lifts it up to complete a click operation, the icon is selected; when the user presses the icon, the fingertip remains on the plane of the virtual touch screen and moves, and the icon wil...

Embodiment 2

[0113] Embodiment 2: Multi-touch photo browsing on the virtual touch screen

[0114] This example shows the multi-touch function of the present invention.

[0115] After the user wears the device and starts up the computer system, he can see multiple photos displayed on the virtual touch screen. When the user drags the center of the photo left and right with the index finger of the right hand, the photo will be switched; when the user drags the upper left and lower right corners of the photo with the index finger of the left and right hands at the same time, the photo will be zoomed according to the positions of the two fingers.

[0116] In this example, when performing fingertip recognition, the largest and second largest connected regions are taken as the hand region, and the fingertip on the left side of the plane is considered as the left fingertip, and the fingertip on the right side of the plane is the right fingertip.

[0117] For each photo, set a square area in the c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of human-computer interaction, and is a visually operable non-physical touch screen system. The system is composed of a computer, two network cameras, a head-mounted display, and a calibration reference object. The object calibrates a virtual touch screen. The user can observe the real world including the virtual touch screen through the head-mounted display, and can directly operate the touch screen without the entity by hand. The present invention adopts two cameras to collect images in real time. According to the image input by the camera, the computer system performs spatial calibration and fingertip position and action recognition with the cooperation of the calibration reference object, and synthesizes corresponding images. The head-mounted display outputs the image containing the virtual touch screen to the user, and the user directly observes the feedback of the virtual touch screen through the head-mounted display. The invention can be used in the field of human-computer interaction, and is especially suitable as a portable computer or a human-computer interaction device of a multimedia interactive experience system.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a visual and operable touch screen system. Background technique [0002] In many virtual reality systems, users use data gloves, stylus, and three-dimensional mouse to operate instead of mouse and keyboard. They can adapt to the requirements of spatial positioning in the virtual reality system and expand the form of operation. However, they have a common disadvantage: unnatural use. When users use these devices, some have to wear heavy equipment, and some have to be connected to data cables that limit the range of motion. [0003] The anthropomorphism of computer systems represented by virtual reality and the miniaturization, portability, and embedding of computers represented by handheld computers and smart phones are two important development trends of current computers. The GUI technology is the bottleneck affecting their development. Therefo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/042
Inventor 许景禧沈一帆
Owner FUDAN UNIV