Blink detection-based smart handset photographing system and method

A technology for smart phones and mobile phones, which is applied to the parts of TV systems, computer parts, character and pattern recognition, etc. It can solve problems such as difficult implementation, complicated implementation methods, and difficulty in applying mobile phone shooting systems, etc., to achieve easy implementation and accurate The effect of high precision and simple realization method

CN106572304AInactive Publication Date: 2017-04-19XIDIAN UNIV
5 Cites 12 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2017-04-19
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The present invention discloses a blink detection-based smart handset photographing system and a method thereof, and mainly solves the problems in the prior art that existing contact type handsets are inconvenient to operate in some cases and the non-contact man-machine interaction manner is hard to be applied to the handset photographing operation. The method comprises the steps of setting the photographing mode of a handset to be a self-timer mode or a common mode; collecting the image sequence of a human face of a photographer by a front-facing camera of the handset, detecting an human eye area, extracting an edge profile, and detecting the occurrence of blinking actions; upon detecting the occurrence of continuous blinking actions, sending a photographing instruction to an instruction sending module; sending the photographing instruction to a photographing module by the instruction sending module; according to the above preset photographing mode of the handset, controlling the camera of the handset to conduct the photographing operation by the photographing module; and indicating the completion of the photographing operation in the form of voices after the photographing process. The invention provides a novel method for controlling the photographing operation based on blinking actions. Based on the method, the convenience of the handset photographing operation is improved. Meanwhile, the photographing function can be realized without the manual operation. Therefore, both the self-timer function of the photographer and the photographing function for other people by the photographer are realized.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of mobile phone photographing, and further relates to the initiation of photographing in smartphone photographing, in particular to a system and method for photographing smartphones based on blink detection. For taking photos with smartphones. Background technique

[0002] Nowadays, smart phones are very popular, and taking pictures is a very important and frequently used function in smart phones. The traditional human-computer interaction method of controlling the mobile phone to take pictures is mainly contact type. This method usually starts the camera to complete the shooting when the mobile phone detects a touch screen or a button is pressed, which is inconvenient to operate in some cases. With the rapid development of electronic information technology, there are currently some non-contact human-computer interaction methods, mainly through voice or eye movements to control mobile phones, but there are ...

Examples

Embodiment 1

[0035] The present invention is a kind of smart mobile phone photographing system based on blink detection, see figure 1, including a mode setting module, an image acquisition module, an eye blink detection module, an instruction sending module, a shooting module and a voice prompt module. Wherein, the mode setting module is connected with the shooting module data, and sets the shooting mode of the shooting module. The shooting modes include Selfie mode and normal shooting mode, and the module is directly implemented through the mobile phone camera APP. In the present invention, the image acquisition module collects the face image of the photographer, and collects the facial image of the photographer through the front camera of the mobile phone. After collecting the facial image of the photographer, the facial image of the photographer is input into the blink The detection module performs blink detection. The blink detection module performs blink detection on the input photogr...

Embodiment 2

[0043] The overall composition of the smart phone camera system based on blink detection is the same as that in Embodiment 1, wherein the blink detection module is sequentially connected to the human eye area detection submodule, the edge contour extraction submodule and the blink judgment submodule in the direction of data flow, see figure 2 , each sub-module is described as follows:

[0044] The human eye area detection sub-module performs human eye detection on the m face images transmitted by the image acquisition module, and detects the human eye area. In this embodiment, the ASM human eye detection algorithm is used. The human eye sample images in the internal storage device, for example, 50 sample images, construct the shape model of the human eye area by selecting a certain number of human eye contour feature points in the human eye sample images. In this example, the sample human eye The selection number of contour feature points is 21. At the same time, according t...

Embodiment 3

[0048] The present invention is also a smart phone camera method based on blink detection, which is realized on a smart phone camera system based on blink detection, see image 3 , including the following steps:

[0049] (1) Shooting mode setting is completed by the mode setting module, and the mobile phone shooting mode is directly set by the mobile phone camera APP. The mobile phone shooting mode includes two modes of Selfie and common shooting. The normal shooting mode is to shoot by the rear camera of the mobile phone. In the present invention , the two shooting modes are represented by two different signals. In this example, the signal 0 is used to represent the Selfie mode, and the signal 1 is used to represent the normal shooting mode. After the shooting mode is set, the signal representing the shooting mode is sent to the shooting module. The shooting mode setting is set before shooting.

[0050] (2) Acquisition of face image sequence. The front camera of the mobile ph...