Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Blink detection-based smart handset photographing system and method

A technology for smart phones and mobile phones, which is applied to the parts of TV systems, computer parts, character and pattern recognition, etc. It can solve problems such as difficult implementation, complicated implementation methods, and difficulty in applying mobile phone shooting systems, etc., to achieve easy implementation and accurate The effect of high precision and simple realization method

Inactive Publication Date: 2017-04-19
XIDIAN UNIV
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage of this method is that the infrared image of the eyeball is required, so an infrared camera is required to acquire the image, and the final design of the head-mounted device is complicated and difficult to implement on a mobile phone
The disadvantage of this method is that it is necessary to locate the pupil of the human eye and judge the line of sight, and the implementation method is cumbersome and complicated.
The system of this patent is a human-computer interaction system based on line-of-sight judgment, which mainly includes the acquisition of frame images, human eye area detection, pupil center positioning, system calibration, line-of-sight tracking, and control command transmission. In the human eye, the pupil center is positioned, and the focus judgment is realized stably on the electronic device through the camera, and the control command is issued by blinking or closing the eyes. The disadvantage of this system is that the pupil center needs to be positioned, and the system Calibration and eye-tracking, the implementation method is complicated, it is difficult to apply to the realization of the mobile phone shooting system
[0005] The main disadvantage of the above two methods is that the blink detection equipment is complicated, and the infrared image of the human eye is required, or the pupil of the human eye needs to be positioned to judge the line of sight. Realize

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Blink detection-based smart handset photographing system and method
  • Blink detection-based smart handset photographing system and method
  • Blink detection-based smart handset photographing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] The present invention is a kind of smart mobile phone photographing system based on blink detection, see figure 1, including a mode setting module, an image acquisition module, an eye blink detection module, an instruction sending module, a shooting module and a voice prompt module. Wherein, the mode setting module is connected with the shooting module data, and sets the shooting mode of the shooting module. The shooting modes include Selfie mode and normal shooting mode, and the module is directly implemented through the mobile phone camera APP. In the present invention, the image acquisition module collects the face image of the photographer, and collects the facial image of the photographer through the front camera of the mobile phone. After collecting the facial image of the photographer, the facial image of the photographer is input into the blink The detection module performs blink detection. The blink detection module performs blink detection on the input photogr...

Embodiment 2

[0043] The overall composition of the smart phone camera system based on blink detection is the same as that in Embodiment 1, wherein the blink detection module is sequentially connected to the human eye area detection submodule, the edge contour extraction submodule and the blink judgment submodule in the direction of data flow, see figure 2 , each sub-module is described as follows:

[0044] The human eye area detection sub-module performs human eye detection on the m face images transmitted by the image acquisition module, and detects the human eye area. In this embodiment, the ASM human eye detection algorithm is used. The human eye sample images in the internal storage device, for example, 50 sample images, construct the shape model of the human eye area by selecting a certain number of human eye contour feature points in the human eye sample images. In this example, the sample human eye The selection number of contour feature points is 21. At the same time, according t...

Embodiment 3

[0048] The present invention is also a smart phone camera method based on blink detection, which is realized on a smart phone camera system based on blink detection, see image 3 , including the following steps:

[0049] (1) Shooting mode setting is completed by the mode setting module, and the mobile phone shooting mode is directly set by the mobile phone camera APP. The mobile phone shooting mode includes two modes of Selfie and common shooting. The normal shooting mode is to shoot by the rear camera of the mobile phone. In the present invention , the two shooting modes are represented by two different signals. In this example, the signal 0 is used to represent the Selfie mode, and the signal 1 is used to represent the normal shooting mode. After the shooting mode is set, the signal representing the shooting mode is sent to the shooting module. The shooting mode setting is set before shooting.

[0050] (2) Acquisition of face image sequence. The front camera of the mobile ph...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a blink detection-based smart handset photographing system and a method thereof, and mainly solves the problems in the prior art that existing contact type handsets are inconvenient to operate in some cases and the non-contact man-machine interaction manner is hard to be applied to the handset photographing operation. The method comprises the steps of setting the photographing mode of a handset to be a self-timer mode or a common mode; collecting the image sequence of a human face of a photographer by a front-facing camera of the handset, detecting an human eye area, extracting an edge profile, and detecting the occurrence of blinking actions; upon detecting the occurrence of continuous blinking actions, sending a photographing instruction to an instruction sending module; sending the photographing instruction to a photographing module by the instruction sending module; according to the above preset photographing mode of the handset, controlling the camera of the handset to conduct the photographing operation by the photographing module; and indicating the completion of the photographing operation in the form of voices after the photographing process. The invention provides a novel method for controlling the photographing operation based on blinking actions. Based on the method, the convenience of the handset photographing operation is improved. Meanwhile, the photographing function can be realized without the manual operation. Therefore, both the self-timer function of the photographer and the photographing function for other people by the photographer are realized.

Description

technical field [0001] The invention belongs to the technical field of mobile phone photographing, and further relates to the initiation of photographing in smartphone photographing, in particular to a system and method for photographing smartphones based on blink detection. For taking photos with smartphones. Background technique [0002] Nowadays, smart phones are very popular, and taking pictures is a very important and frequently used function in smart phones. The traditional human-computer interaction method of controlling the mobile phone to take pictures is mainly contact type. This method usually starts the camera to complete the shooting when the mobile phone detects a touch screen or a button is pressed, which is inconvenient to operate in some cases. With the rapid development of electronic information technology, there are currently some non-contact human-computer interaction methods, mainly through voice or eye movements to control mobile phones, but there are ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N5/232H04N5/225H04M1/725G06K9/46G06K9/00
CPCH04M1/72403G06V40/20G06V40/193G06V40/18G06V10/44H04N23/45H04N23/57H04N23/611H04N23/80
Inventor 那彦刘强强陈建春
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products