Imaging apparatus, control method for imaging apparatus, and storage medium

Abstract

The present disclosure relates to an image pickup apparatus, a control method for the image pickup apparatus, and a storage medium. Provided is an image pickup apparatus capable of suppressing reading of a two-dimensional code that is not desired by a user without the user expending time and labor to operate when the two-dimensional code is present within a photographing angle of view. The image pickup apparatus includes an obtaining unit configured to obtain an image, a first detection unit configured to detect a specific subject from the image, a second detection unit configured to detect an identifier from the image, a reading unit configured to read predetermined information from the identifier, and a processing unit configured to perform processing based on the predetermined information. The processing unit is configured to selectively perform the processing based on a distance from a center of a photographing angle of view of the obtained image to a region in which the specific subject is detected and a distance from the center of the photographing angle of view of the obtained image to a region in which the identifier is detected.

Description

Technical Field

[0001] This invention relates to a camera device, a control method for the camera device, and a storage medium. Background Technology

[0002] In recent years, by using cameras installed on smartphones, tablet PCs (personal computers), and other devices to read QR codes, it has become easy to access web pages or detailed information. These QR codes are optical codes printed on advertisements, instruction manuals, production management documents in factories, etc. Japanese Patent Application Publication No. 2007-318775 discloses a technology that switches the shooting process based on the subject, such as a natural image or a QR code, and recognizes the QR code in the captured image when switching to QR code shooting. Furthermore, in recent years, smartphones have also become capable of recognizing both human faces and QR codes.

[0003] However, in the technology disclosed in Japanese Patent Application Publication No. 2007-318775, when reading a QR code, the settings must be changed to switch to QR code scanning mode. Furthermore, in the normal shooting mode of recent smartphones, when both a human face and a QR code are recognized, the QR code will be read even if the user intends to photograph the face. Therefore, in order to photograph a human face without recognizing a QR code, it is necessary to switch to portrait mode. Summary of the Invention

[0004] The present invention provides a camera device, a control method for the camera device, and a storage medium, wherein the camera device can suppress the reading of unwanted QR codes when a QR code exists within the field of view (hereinafter referred to as "shooting angle") without requiring the user to spend time and effort to operate it.

[0005] Therefore, the present invention provides a camera device comprising: an acquisition unit configured to acquire an image; a first detection unit configured to detect a specific subject from the image; a second detection unit configured to detect an identifier from the image; a reading unit configured to read predetermined information from the identifier; and a processing unit configured to perform processing based on the predetermined information, wherein the processing unit is configured to selectively perform the processing based on the distance from the center of the shooting angle of the acquired image to the region where the specific subject is detected and the distance from the center of the shooting angle of the acquired image to the region where the identifier is detected.

[0006] According to the present invention, when a QR code exists within the shooting perspective, reading of unwanted QR codes can be suppressed without requiring the user to spend time and effort to operate.

[0007] Further features of the invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0008] Figure 1A This is a front view showing the appearance of a smartphone according to an embodiment of the present invention, and Figure 1B This is a rear view showing the appearance of a smartphone according to an embodiment of the present invention.

[0009] Figure 2 This is a block diagram illustrating a schematic configuration of a smartphone according to an embodiment of the present invention.

[0010] Figure 3A , Figure 3B , Figure 3C , Figure 3D , Figure 3E and Figure 3F This is an example of an image displayed on a monitor when the image is captured by the rear camera.

[0011] Figure 4 This is a flowchart illustrating the operation control according to a first embodiment of a smartphone.

[0012] Figure 5 This is a flowchart illustrating the operation control according to a second embodiment of a smartphone.

[0013] Figure 6 This is a flowchart illustrating the operation control according to a third embodiment of a smartphone. Detailed Implementation

[0014] The invention will now be described in detail below with reference to the accompanying drawings, which illustrate embodiments of the invention.

[0015] Here, although a smartphone is used as an example of a camera device according to the present invention, the camera device according to the present invention is not limited to a smartphone.

[0016] Figure 1A This is a front view showing the appearance of a smartphone 100 according to an embodiment of the present invention, and Figure 1B This is a rear view showing the appearance of the smartphone 100.

[0017] Display 105, touch panel 106a, speaker 112b, front-facing camera 115, and home button 106e are arranged on the front (first side) of smartphone 100. Note that touch panel 106a is arranged to overlap with display 105.

[0018] Audio output terminal 112a is located on the bottom surface of smartphone 100. A power button 106b, a volume up button 106c, and a volume down button 106d are located on the side of smartphone 100. A rear camera 114 is located on the back (second side) of smartphone 100. The rear camera 114 is a multi-lens camera including a telephoto camera 114a, a standard camera 114b, and an ultra-wide-angle camera 114c. It should be noted that the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c in the rear camera 114... Figure 1B The arrangement shown is an example, and the arrangement of the telephoto camera 114a, standard camera 114b, and ultra-wide-angle camera 114c in the rear camera 114 can be different. (The following will be combined with the illustration...) Figure 2 The block diagram illustrating the schematic configuration of the smartphone 100 is used to describe the functions of the various components included in the smartphone 100.

[0019] Figure 2 This is a block diagram illustrating a schematic configuration of a smartphone 100. The smartphone 100 includes a CPU (Central Processing Unit) 201, a memory 202, a non-volatile memory 203, a display 105, a gesture detection unit 213, an operation unit 106, a storage medium I / F (interface) 207, an external I / F 209, a communication I / F 210, and an audio output unit 112. Additionally, the smartphone 100 includes a rear camera 114, a front camera 115, a rear camera image processing unit 214, and a front camera image processing unit 215. The various components included in the smartphone 100 are configured to connect to an internal bus 150 and are capable of exchanging data with each other via the internal bus 150.

[0020] CPU 201 is a control unit for overall control of smartphone 100 and is configured with at least one processor or circuit. Memory 202 is, for example, RAM (Random Access Memory). Non-volatile memory 203 stores image data, audio data, other data, various programs for CPU 201 to operate, etc. Non-volatile memory 203 is configured with, for example, flash memory or ROM (Read-Only Memory). CPU 201 controls the operation of various components of smartphone 100 overall by expanding the programs stored in non-volatile memory 203 on the working area of ​​memory 202.

[0021] Display 105 is a display device such as a liquid crystal display (LCD) or an organic EL (electroluminescent) display. Display 105 displays captured images or GUI (graphical user interface) screens under the control of CPU 201. For example, CPU 201 generates display control signals according to a program and controls various components of smartphone 100 to generate image (video) signals for displaying predetermined information on display 105, and outputs the image (video) signals to display 105. Display 105 displays video based on the image signals output from various components of smartphone 100. Additionally, images captured by the front camera 115 or rear camera 114, which serve as acquisition units for obtaining images, can be displayed on display 105 (live view images). In other words, the user can take photos while viewing the live view images displayed on display 105.

[0022] The operation unit 106 includes a touch panel 106a, a power button 106b, a volume up button 106c, a volume down button 106d, and a home button 106e. The touch panel 106a is planarly configured and superimposed on the display 105, detecting touch operations on the display surface (operation surface) of the display 105 and outputting the contact position of the touch operation as coordinate information to the CPU 201. Furthermore, a keyboard or icons displayed on the display 105 are used as the operation unit 106 by operating the touch panel 106a.

[0023] It should be noted that any type of touch panel, such as resistive film touch panels, capacitive touch panels, surface acoustic wave touch panels, infrared touch panels, electromagnetic induction touch panels, image recognition touch panels, and optical sensor touch panels, can be used as touch panel 106a. Furthermore, the method for detecting touch operations on touch panel 106a can be a method based on actual contact (i.e., when actual contact exists) (contact-type detection method), or a method based on proximity (i.e., when proximity exists) (non-contact-type detection method).

[0024] The power button 106b is used to switch the display 105 on / off, and also to switch the smartphone 100 on / off by pressing it continuously for a certain period of time (e.g., 3 seconds), i.e., by a long press. The volume up button 106c and volume down button 106d are used to adjust the volume output from the audio output unit 112. When the volume up button 106c is pressed, the output volume increases, and when the volume down button 106d is pressed, the output volume decreases. Additionally, in the camera standby state, the volume up button 106c and volume down button 106d serve as shutter buttons to indicate when to take a picture. It should be noted that the user of the smartphone 100 can set specific functions to be performed, such as simultaneously pressing the power button 106b and volume down button 106d, or rapidly pressing the volume down button 106d several times.

[0025] The home button 106e is an operational component that causes the display 105 to show the home screen, which is the startup screen of the smartphone 100. By pressing the home button 106e when various applications have been launched and used on the smartphone 100, the user can temporarily close the various launched applications and display the home screen. It should be noted that although the home button 106e is shown here as a button that can be physically pressed, it is not limited to this and can also be a button displayed on the display 105 and functioning in the same way through touch operation.

[0026] The audio output unit 112 includes an audio output terminal 112a and a speaker 112b. The speaker 112b outputs audio of moving images, audio of music data, operation sounds, ringtones, and various notification sounds, etc. The audio output terminal 112a is a terminal (so-called a headphone jack) that outputs audio signals to headphones, earphones, or external speakers, etc. When an audio output device such as headphones is not connected to the audio output terminal 112a, audio is output from the speaker 112b. It should be noted that audio output can be performed via wireless communication, etc. For example, audio can be output to a speaker or headphones (headphones) using Bluetooth (registered trademark).

[0027] Storage medium 208 is, for example, a memory card attached to the main body of smartphone 100 or an internal storage device built into smartphone 100. Storage medium I / F 207 is an interface for reading data from and writing data to storage medium 208 under the control of CPU 201. External I / F 209 is an interface for communicatively connecting smartphone 100 to external devices via a connection cable or wireless communication and for inputting / outputting video and audio signals, etc. Communication I / F 210 is an interface for connecting to a communication network such as the Internet 211.

[0028] The posture detection unit 213 detects the posture of the smartphone 100 relative to the direction of gravity, as well as the pitch and rotation of the smartphone 100 relative to the yaw, roll, and pitch axes. Based on the detection signals from the posture detection unit 213, it can be determined whether the smartphone 100 is in a horizontal or vertical posture, whether the display 105 is facing up or down, and whether the smartphone 100 is in a tilted posture. At least one of an accelerometer, gyroscope, magnetometer, orientation sensor, and altitude sensor can be used as the posture detection unit 213, and multiple sensors can be combined to serve as the posture detection unit 213.

[0029] In the rear camera 114, the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c each have a lens and an image sensor (image sensor). The telephoto camera 114a has a longer focal length than the standard camera 114b, and by using the telephoto camera 114a, it is possible to magnify and capture subjects at a greater distance than when using the standard camera 114b. Furthermore, the ultra-wide-angle camera 114c has a shorter focal length than the standard camera 114b, and therefore, by using the ultra-wide-angle camera 114c, it is possible to capture a wider range than when using the standard camera 114b. In other words, the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c have shorter focal lengths in this order, and therefore have a wider field of view. The front camera 115 includes, for example, a zoom lens having a focal length corresponding to that of the standard camera 114b.

[0030] In embodiments of the present invention, the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c are each provided with a lens having a mechanism for optical magnification to a predetermined magnification. However, the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c are not limited thereto; the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c may have a zoom function that enables continuous changing of the shooting angle between the telephoto side and the wide-angle side, or may be provided with a mechanism that allows the user to change the magnification.

[0031] It should be noted that the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c can perform shooting operations (video recording operations) simultaneously. Furthermore, two cameras selected by the user from the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c can also perform shooting operations simultaneously. Additionally, only one camera selected by the user from the telephoto camera 114a, the standard camera 114b, and the ultra-wide-angle camera 114c can also perform shooting operations.

[0032] Both the live view image obtained by the rear camera 114 and the live view image obtained by the front camera 115 can be displayed on the monitor 105. At this time, by operating the touch panel 106a, one can select which lens (camera) captured the video through to be displayed on the monitor 105. For example, if the telephoto camera 114a is selected, a video magnified more than that captured by the standard camera 114b can be displayed on the monitor 105. Furthermore, if the standard camera 114b is selected, a video with a wider angle than that captured by the telephoto camera 114a and a greater magnification than that captured by the ultra-wide-angle camera 114c can be displayed on the monitor 105. Furthermore, if the ultra-wide-angle camera 114c is selected, a video with a wider angle than both the telephoto camera 114a and the standard camera 114b can be displayed on the monitor 105. It should be noted that, generally, the rear camera 114 is typically used to photograph the scene in front of the user's eyes, and the front camera 115 is typically used to photograph the user (the photographer) themselves, i.e., it is typically used for so-called selfies.

[0033] Under the control of CPU 201, the front camera image processing unit 215 performs various image processing and subject recognition processing on the images (videos) captured by the front camera 115. Under the control of CPU 201, the rear camera image processing unit 214 performs various image processing and subject recognition processing on the images (videos) captured by the rear camera 114. Furthermore, the rear camera image processing unit 214 performs decoding processing, which involves detecting the characteristics of a QR code (described later), determining whether the QR code exists, and then obtaining information associated with the QR code. The decoding processing will be described later in conjunction with a description of a QR code (registered trademark). Furthermore, although a QR code is described as an example in embodiments of the present invention, the invention is not limited thereto, and may be a one-dimensional barcode or a pattern, as long as it is a graphic image representing an identifier.

[0034] The rear camera image processing unit 214 includes a telephoto camera image processing unit 214a, a standard camera image processing unit 214b, and an ultra-wide-angle camera image processing unit 214c. The telephoto camera image processing unit 214a processes images captured by the telephoto camera 214a. Similarly, the standard camera image processing unit 214b processes images captured by the standard camera 114b, and the ultra-wide-angle camera image processing unit 214c processes images captured by the ultra-wide-angle camera 114c.

[0035] Furthermore, although a camera image processing unit corresponding to each of the three lenses (three cameras) of the rear camera 114 is provided in the embodiments of the present invention, the present invention is not limited to this configuration. For example, one camera image processing unit may be provided for two of the three lenses (two cameras), and another camera image processing unit may be provided for the remaining lens (remaining camera). Alternatively, one camera image processing unit may be provided for all three lenses (three cameras).

[0036] The rear camera image processing unit 214 and the front camera image processing unit 215 are also capable of performing various image processing operations on images stored in the non-volatile memory 203 or storage medium 208, video signals obtained via external I / F 209, or images obtained via communication I / F 210. The various image processing operations performed by the rear camera image processing unit 214 and the front camera image processing unit 215 include A / D (analog-to-digital) conversion processing, D / A (digital-to-analog) conversion processing, image data encoding processing, compression processing, decoding processing, zooming in / out processing (size adjustment processing), noise reduction processing, and color conversion processing.

[0037] It should be noted that the rear camera image processing unit 214 and the front camera image processing unit 215 can each be configured as dedicated circuit blocks for performing specific image processing. Alternatively, the rear camera image processing unit 214 and the front camera image processing unit 215 can be integrated into a single processing block and configured to process video acquired through each lens (each camera) via parallel processing or time-division processing. Furthermore, depending on the type of image processing, instead of the rear camera image processing unit 214 and the front camera image processing unit 215, the CPU 201 can also perform image processing according to a program.

[0038] Here, QR codes will be described. A QR code is a code that displays information in both horizontal and vertical directions. In contrast, a one-dimensional code (e.g., a barcode) displays information only in the horizontal direction. QR codes include matrix QR codes and stacked QR codes; QR codes are typical matrix QR codes, and PDF417 is a typical stacked QR code. QR codes can contain more information than one-dimensional codes, and in particular, QR codes can store not only numbers but also multiple language data such as alphabetic characters and Chinese characters. Furthermore, unlike other QR codes, QR codes do not require a dedicated reading device and can be read using a camera (digital camera) installed in a mobile phone or smartphone. It should be noted that "reading a QR code" refers to the process of detecting the QR code from an image obtained by the camera, performing the decoding process described later, and displaying the result of the decoding process on the display 105.

[0039] In recent years, QR codes have been actively printed and displayed on advertisements, instruction manuals, and other media (including both print and digital media). For example, by reading a QR code, users can easily access the web page associated with it and obtain information. Even if a portion of the QR code cannot be read or is misread, the QR code is resistant to dirt and deformation because redundant codes are added to correct the error. Leveraging this feature, QR codes are also widely used in production facilities such as manufacturing plants for production line management.

[0040] Furthermore, as electronic payments expand to replace cash payments, the use of QR code payments, a type of electronic payment, is increasing, where QR codes are read by smartphones (electronic information terminals). Therefore, electronic information terminals need technical support to ensure the smooth reading of QR codes during QR code payments.

[0041] QR codes are roughly square patterns formed by vertically and horizontally arranged small square cells (see e.g., see [link to QR code]). Figure 3A , 3B (Symbols 3C, 3D, 3E, and 3F). Various symbols such as numbers, alphabetic characters, and Chinese characters are encoded, and QR codes are generated by combining the units and their arrays. It should be noted that currently, there exist QR codes with a range of vertical units × horizontal units, increasing in increments of 4 units from 21 × 21 to 177 × 177. As the number of units increases, more information can be stored in the QR code (retained by the QR code itself).

[0042] A pattern called a cut-out symbol is arranged at the three corners of a QR code symbol. Camera applications installed in smartphones and other devices identify QR codes by detecting these cut-out symbols in a captured image. Specifically, the camera application detects the cut-out symbols in the captured image and determines the size of the QR code based on the detected cut-out symbols. The camera application then detects the distribution pattern of cells within the detected QR code size and decrypts the detected distribution pattern to read the information held by the QR code. This series of processes—detecting the cut-out symbols from the captured image, detecting the distribution pattern of cells, and reading the information—is called decoding.

[0043] In the smartphone 100, based on the cutout symbol, the CPU 201 not only recognizes the QR code and detects its size, but also detects its tilt and deformation. Additionally, the CPU 201 determines whether the QR code is within the shooting range (camera range) by recognizing the cutout symbol.

[0044] It should be noted that in order to correctly read the information contained in a QR code, it is necessary to accurately photograph (capture) the distribution pattern formed by the units of the QR code. However, when photographing (capture) a QR code using a smartphone 100, sometimes the distribution pattern of the units cannot be accurately identified due to reasons such as the smartphone 100's camera (usually the rear camera 114) being too far away from the QR code or the shooting position being dark. In such cases, since it is possible that the QR code cannot be decoded and the information cannot be read correctly from the QR code, it is necessary to clearly and accurately photograph (capture) the distribution pattern of the units and obtain a captured image.

[0045] The first embodiment will be described. In the first embodiment, when a specific subject and a QR code exist within the shooting angle of the smartphone 100, a control method for automatically determining whether to read the QR code based on the position of the specific subject and the position of the QR code will be described. It should be noted that in the embodiments of the present invention, the front camera image processing unit 215 or the rear camera image processing unit 214 is used as a first detection unit to detect the specific subject from the image. In addition, the front camera image processing unit 215 or the rear camera image processing unit 214 is also used as a second detection unit to detect identifiers from the image. Furthermore, the CPU 201 is used as a reading unit to read predetermined information from the identifier, a processing unit to perform processing based on the predetermined information, a comparison unit, and a control unit.

[0046] In the various control methods according not only to the first embodiment but also to the second and third embodiments described later, it is assumed that the QR code can be photographed (captured) without any problems when a QR code (specifically, a QR code) is present within the camera's field of view. Furthermore, as an example, it is assumed that the subject is a human face. It should be noted that a QR code is an example of an identifier. Examples of situations where a specific subject and a QR code are present within the shooting angle include images obtained when photographing posters or instruction manuals. In this case, since a rear camera 114 is typically used, it is assumed here that the photography (capture) is performed by a standard camera 114b. However, a telephoto camera 114a or an ultra-wide-angle camera 114c can be used instead of the standard camera 114b.

[0047] Figure 3A , Figure 3B , Figure 3C , Figure 3D , Figure 3E and Figure 3F This is a view showing an example of an image displayed on the display 105 when the rear camera 14 is taking a picture. (When describing...) Figures 4 to 6 When creating a flowchart, it will be appropriately described. Figure 3A , Figure 3B , Figure 3C , Figure 3D , Figure 3E and Figure 3F The image shows details of the example.

[0048] Figure 4 This is a flowchart illustrating the operation control according to a first embodiment of the smartphone 100. The operation of the smartphone 100 is achieved by the CPU 201 expanding a predetermined program stored in the non-volatile memory 203 on the memory 202 and controlling the operation of the various components of the smartphone 100 as a whole. Figure 4 The S number in the flowchart indicates the individual processes (steps).

[0049] First, the camera application is launched on the smartphone 100, and in the S400, the CPU 201 drives the standard camera 114b to acquire a captured image (live view image) and enters a shooting standby state. However, it is not limited to the camera application, but can also be a shooting standby state when the QR code reading function of an application used for decoding QR codes is activated.

[0050] In S401, CPU 201 determines whether a subject resembling an optical code image (i.e., a QR code) has been detected in the captured image by the standard camera image processing unit 214b. If CPU 201 determines that no subject resembling a QR code has been detected ("No" in S401), CPU 201 proceeds the processing to S407. On the other hand, if CPU 201 determines that a subject resembling a QR code has been detected ("Yes" in S401), CPU 201 proceeds the processing to S402.

[0051] In S402, CPU 201 determines whether a human face has been detected from the captured image by the standard camera image processing unit 214b. If CPU 201 determines that a human face has been detected (yes in S402), CPU 201 proceeds the processing to S403.

[0052] In S403, CPU 201 compares the position of the QR code detected in S401 with the position of the human face detected in S402, and determines whether the distance from the center of the shooting viewpoint to the human face is equal to or greater than the distance from the center of the shooting viewpoint to the QR code. If CPU 201 determines that the distance from the center of the shooting viewpoint to the human face is shorter than the distance from the center of the shooting viewpoint to the QR code ("No" in S403), CPU 201 proceeds the processing to S404. It should be noted that in the first embodiment, CPU 201 compares the distance from the center of the QR code region (hereinafter referred to as "QR code region") to the center of the shooting viewpoint with the distance from the center of the human face region (hereinafter referred to as "human face region") to the center of the shooting viewpoint. However, the first embodiment is not limited to this; instead of the center of the QR code region and the center of the human face region, the determination in S403 can be performed by comparing the distance from the vertex of the QR code region furthest from the center of the shooting viewpoint to the center of the shooting viewpoint with the distance from the vertex of the human face region furthest from the center of the shooting viewpoint to the center of the shooting viewpoint.

[0053] In S404, CPU 201 performs various controls on the human face area detected in S402, such as AE (auto exposure) control, WB (white balance) control, and AF (auto focus) control, and then advances the processing to S407. Figure 3A An example of an image display shown on display 105 when S404 is executed is shown. Figure 3AAs shown, since the face 301 is located closer to the center of the shooting view than the QR code 303, the CPU 201 displays a detection box 302 for the face 301. It should be noted that when processing proceeds from S404 to S407, a release process for storing the captured image as image data can be performed, but its description will be omitted.

[0054] If the CPU 201 determines in S402 that no human face has been detected (in S402 it is "No"), and if the CPU 201 determines in S403 that the distance from the center of the shooting viewpoint to the human face is equal to or greater than the distance from the center of the shooting viewpoint to the QR code (in S403 it is "Yes"), the CPU 201 advances the processing to S405.

[0055] In S405, CPU 201 performs decoding to obtain information associated with the QR code, and then proceeds the processing to S406. Figure 3B An example of an image display shown on display 105 when S405 is executed is shown. Figure 3B As shown, since the QR code 303 is located closer to the center of the shooting angle than the face 301, the CPU 201 displays a detection box 302 for the QR code 303.

[0056] In S406, CPU 201 performs processing using the result obtained from the decoding process in S405, that is, using the information associated with the QR code. In the first embodiment, when the information associated with QR code 303 is a URL indicating the destination of a web page, CPU 201 accesses the URL indicating the destination of the web page according to the web browser application and controls the display of the web page on the screen of display 105. Furthermore, similar to... Figure 3C In the dialog box 306 shown, the CPU 201 can display the URL associated with the QR code 303, access the URL associated with the QR code 303, and display a screen asking the user whether they want to switch from the display of the live view image in the shooting standby state to the display of the web page. When the CPU 201 detects a touch on the "Open" guide 304, the CPU 201 accesses the URL and controls the display of the web page on the display 105. On the other hand, when a touch on the "Retrieve" guide 305 is detected, since this is usually a situation where the user does not want to switch to the display of the web page or the user wants to read the QR code again, the CPU 201 causes the smartphone 100 to return to the shooting standby state. As a result, the display of the display 105 returns to, for example, the live view image displayed in the shooting standby state. Figure 3A The image shown.

[0057] Furthermore, in the first embodiment, dialog box 306 is displayed as a confirmation screen asking the user whether they want to access the URL or switch to a web page. On the other hand, after reading the QR code (after the decoding process has finished), the web page can be automatically opened and displayed on display 105 by accessing the URL indicated by the information held by the QR code without displaying a confirmation screen. Furthermore, the user can arbitrarily set whether to display a confirmation screen or quickly open the web page without displaying a confirmation screen. Additionally, as a result of the decoding process performed in S405, if the read QR code holds text information rather than a URL, the text information held by the QR code is displayed in dialog box 306.

[0058] In embodiments of the present invention, although a configuration for reading various information by using an application capable of reading various QR codes has been described, it is also assumed that an application that only reads QR codes containing specific information is used. When using an application capable only of reading specific QR codes, firstly, even if a QR code other than the specific QR code enters the shooting view, the QR code other than the specific QR code will not be recognized, and in this case, the shooting standby state continues. On the other hand, even if a QR code is detected from the captured image, decoding processing may not be possible in some cases, and in such cases, it is expected that an error indicating that it cannot be read will be displayed in dialog box 306.

[0059] Furthermore, in S406, as a process using the information associated with the QR code, CPU 201 can perform, for example, payment processing instead of displaying a web page. CPU 201 controls the display of the information required for the payment process on the screen of display 105 according to the payment application. At this time, the information associated with QR code 303 may indicate that the store is the payment destination, or it may indicate the type of payment service provider and the corresponding payment application.

[0060] In S407, CPU 201 determines whether the shooting standby state has ended. Examples of situations in which the shooting standby state has ended include performing an operation to terminate the camera application, and as a result of the decoding process performed in S405, the display on monitor 105 changes to a screen other than the shooting standby screen, such as a web page.

[0061] If the CPU 201 determines that the shooting standby state has not ended (in S407, this is "No"), the CPU 201 returns the processing to S401. On the other hand, if the CPU 201 determines that the shooting standby state has ended (in S407, this is "Yes"), the CPU 201 terminates the current processing (operation control according to the first embodiment of the smartphone 100).

[0062] As described above, according to the first embodiment, when both the human (hereinafter referred to as "human") and the QR code are within the shooting viewpoint, priority is given to the one closer to the center of the shooting viewpoint, and processing corresponding to the one closer to the center of the shooting viewpoint is performed. As a result, reading of QR codes that the user does not want can be prevented, thereby enabling comfortable shooting.

[0063] A second embodiment will be described. In the second embodiment, when a QR code and (one or more) human faces are present within the shooting perspective, a control method will be described that automatically determines whether to read the QR code based on the number and size of (one or more) human faces and the size of the QR code.

[0064] Figure 5 This is a flowchart illustrating the operation control according to a second embodiment of the smartphone 100. The operation of the smartphone 100 is achieved by the CPU 201 expanding a predetermined program stored in the non-volatile memory 203 on the memory 202 and controlling the operation of the various components of the smartphone 100 as a whole. Figure 5 The flowchart shows the various processes (steps) indicated by the S-encoding.

[0065] because Figure 5 The processing of S500 to S502 and S504 to S507 in the flowchart and Figure 4 The processes in S400 to S402 and S404 to S407 in the flowchart are the same, so their descriptions will be omitted.

[0066] If the CPU determines that a QR code and (one or more) human faces exist within the shooting view ("Yes" in S501 and "Yes" in S502), the CPU 201 proceeds to S503. In S503, the CPU 201 determines whether the size (area) of the detected human face region is smaller than the size (area) of the detected QR code region, and whether the number of detected human faces is less than a predetermined value (hereinafter referred to as the "default value"). If the CPU 201 determines that the size of the human face region is equal to or greater than the size of the QR code region, or the number of human faces is equal to or greater than the default value ("No" in S503), the CPU 201 presumes that the user does not expect to read the QR code and proceeds to S504. On the other hand, if the CPU 201 determines that the size of the human face region is smaller than the size of the QR code region, and the number of human faces is less than the default value ("Yes" in S503), the CPU 201 presumes that the user expects to read the QR code and proceeds to S505.

[0067] Figure 3D An example of display on display 105 is shown when the size of the human face area is larger than the QR code, and Figure 3E An example of display on display 105 is shown when the number of detected human faces is greater than the default value (here, the default value = 1). In these cases, QR code reading is not performed, and camera preparation is performed in S504.

[0068] As described above, according to the second embodiment, when the person and the QR code are within the shooting viewpoint, based on the comparison between the size and number of the person's face and the QR code, it is determined whether the user intends to be photographed or intends to read the QR code. As a result, reading of the QR code that the user does not intend to read can be prevented, thus making shooting more comfortable.

[0069] Furthermore, in the second embodiment, in the determination of S503, two determination conditions are used: a first determination condition comparing the size of the human face with the size of the QR code, and a second determination condition comparing the number of human faces with a default value, to determine whether to perform facial imaging (photography) or QR code decoding. In this case, the condition for proceeding to S504 becomes more lenient, while the condition for proceeding to S505 becomes more stringent. However, the second embodiment is not limited to this; whether to perform facial imaging (photography) or QR code decoding can be determined solely by the first determination condition, or solely by the second determination condition.

[0070] A third embodiment will be described. In the third embodiment, control will be described for reading a QR code and changing the display of the QR code reading result based on the detection result of the human face when a human face and a QR code are present in the shooting viewpoint. Figure 6 This is a flowchart illustrating the operation control according to a third embodiment of the smartphone 100. The operation of the smartphone 100 is achieved by the CPU 201 expanding a predetermined program stored in the non-volatile memory 203 on the memory 202 and controlling the operation of the various components of the smartphone 100 as a whole. Figure 6 The flowchart shows the various processes (steps) indicated by the S-encoding.

[0071] because Figure 6 The processes S600 to S603 and S606 in the flowchart are respectively related to Figure 4 The processes S400, S401, S405, S402, and S407 in the flowchart are the same, so their descriptions will be omitted.

[0072] If the CPU 201 determines in S603 that a human face is present within the shooting view (in S603, this is "yes"), the CPU 201 proceeds the processing to S604. In S604, the CPU 201 displays the decoding result obtained through the decoding process in S602 on the display 105 at a small size, and then proceeds the processing to S606. Figure 3F An example of display on display 105 is shown when a QR code is read and a human face is present within the shooting perspective. Furthermore, although the decoding result is displayed at a small size on display 105 here, the decoding result can be configured not to be displayed.

[0073] If, in S603, the CPU 201 determines that there is no human face within the shooting view (in S603, this is "No"), the CPU 201 proceeds the processing to S605. In S605, the CPU 201 displays the decoding result obtained through the decoding process in S602 on the display 105 at a large size, and then proceeds the processing to S606. In this case, the display example on the display 105 is similar to... Figure 3C The example shown is a display example.

[0074] As described above, according to the third embodiment, when the person and the QR code are within the shooting viewpoint, by displaying the decoding result of the QR code in a small size, even if the user reads the QR code that is not expected by the user, it can prevent the user from not seeing the main subject (person) that the user wants to shoot. As a result, it becomes possible to shoot comfortably.

[0075] Although the present invention has been described in detail based on preferred embodiments, the invention is not limited to these specific embodiments, and various embodiments are included in the invention without departing from its spirit. Furthermore, the above embodiments illustrate only one embodiment of the invention, and various embodiments may be appropriately combined.

[0076] For example, the smartphone 100 may have the judgment function of S403 in the first embodiment and the judgment function of S503 in the second embodiment. However, in this case, the judgment results of S403 and S503 may be presumed to be opposite. For example, there may be a situation where the distance from the center of the shooting angle to the QR code is short, but the size of the human face is larger than the QR code. Even in this case, it is possible to shoot (video) or read a QR code on a specific subject by pre-determining which of the judgments in S403 and S503 is prioritized as the default setting, or by pre-determining which of the judgments in S403 and S503 is prioritized through user settings.

[0077] For example, in the above embodiments, the application of the present invention to a smartphone 100 has been described. However, the imaging device according to the present invention includes an electronic device comprising a display and an imaging component, and the present invention can be applied to, for example, tablet PCs, PDAs (personal digital assistants), and digital cameras. Needless to say, according to the electronic device to which the present invention can be applied, the components constituting the operating parts for operating the electronic device will have the same characteristics as... Figure 2 The operation unit 106 shown has different configurations. Furthermore, as a configuration related to the video output of the electronic device according to the invention, an external monitor can be used as a display (display device), and an interface for outputting video signals to be displayed on the display can be provided.

[0078] Other embodiments

[0079] The embodiments of the present invention can also be implemented by providing software (programs) that perform the functions of the above embodiments to a system or device via a network or various storage media, and the computer or central processing unit (CPU) or microprocessor unit (MPU) of the system or device reads and executes the program.

[0080] While the invention has been described with reference to exemplary embodiments, it should be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the appended claims should be accorded the broadest interpretation to cover all such modifications and equivalent structures and functions.

[0081] This application claims the benefit of Japanese Patent Application 2021-188047, filed on November 18, 2021, the entire contents of which are incorporated herein by reference.

Claims

1. A camera device, comprising: The acquisition unit is configured to acquire an image and then enter a shooting standby state; A first detection unit is configured to detect a human face from the image in the shooting standby state; A second detection unit is configured to detect an identifier from the image in the shooting standby state; A reading unit is configured to read predetermined information from the identifier in the shooting standby state; A processing unit is configured to perform processing based on the predetermined information in the shooting standby state; as well as A control unit is configured to control the display of the image acquired by the acquiring unit on the screen during the shooting standby state. The control unit is configured to control the display of the results of the processing on the screen. The identifier is a QR code. Its features are, The processing unit is configured to selectively perform the processing based on the distance from the center of the shooting angle of the acquired image to the region where the human face is detected and the distance from the center of the shooting angle of the acquired image to the region where the identifier is detected. The processing unit is configured to decode the QR code detected by the second detection unit to obtain the result of the processing. When the first detection unit detects the human face, the control unit is configured to control the display of the results of the processing in a small size. If the first detection unit does not detect the human face, the control unit is configured to control the display of the results of the processing in a large size.

2. A control method for a camera device, comprising: The acquisition step is used to obtain the image, and then enters the shooting standby state; A detection step is used to detect an identifier from the image in the shooting standby state; The reading step is used to read predetermined information from the identifier in the shooting standby state; The processing steps are used to perform processing based on the predetermined information in the shooting standby state; as well as A control step is used to control the display of the image obtained in the acquisition step on the screen during the shooting standby state. In the control step, control is performed to display the result of the processing on the screen, and The identifier is a QR code. Its features are, In the processing step, the processing is selectively performed based on the distance from the center of the captured image's viewing angle to the region where the human face is detected, and the distance from the center of the captured image's viewing angle to the region where the identifier is detected. In the processing step, the QR code is decoded to obtain the result of the processing. If, in another detection step, the human face is detected while the camera is in standby mode, control is executed in the control step to display the result of the processing at a small size. In the other detection step, if the human face is not detected in the shooting standby state, the control step performs control to display the result of the processing in a large size.

3. A non-transitory computer-readable storage medium storing a program that, when run on a computer, causes the computer to perform the control method for a camera device according to claim 2.

4. A computer program product comprising a program for running on a computer to cause the computer to perform the control method for a camera device according to claim 2.

Images