Imaging apparatus, control method, and program

Abstract

To propose a resolution method to a user in the case where a detection result that stripes appearing in an image can be reduced even if a flicker detection processing is executed a plurality of times canot be obtained.SOLUTION: An imaging apparatus includes: imaging means for generating an image by imaging a subject; detection means for executing flicker detection processing to the image; and control means for proposing information in regard to an imaging method of the subject so that a predetermined result can be obtained by the flicker detection processing. The control means proposes the information in the case where the number of times that the flicker detection processing is executed becomes a predetermined times or more due to a result that a predetermined result canot be obtained by the flicker detection processing.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a flicker detection process for an imaging device. [Background technology]

[0002] In recent years, the opportunities to capture displays have increased with the spread of VFX (Visual Effects), etc. When a display has a light source that repeatedly blinks at a frequency of several hundred to several thousand Hz (flicker light source), stripes due to fluctuations in luminance may appear in the image captured from the display due to the influence of the exposure timing of the image sensor, etc.

[0003] Some imaging devices are equipped with a flicker detection function that detects the period (flicker frequency) of stripes that appear in an image captured from a display equipped with a flicker light source. The flicker detection function detects the frequency of flicker that appears in an image captured from a display equipped with a flicker light source, and calculates the shutter speed as a shooting parameter for reducing stripes that appear in the image. The flicker detection function may not be able to detect a flicker frequency suitable for reducing stripes that appear in the image due to the relationship between the blinking direction of the flicker light source on the display and the imaging direction (scanning direction) of the image sensor.

[0004] Patent Document 1 describes a technique for detecting the presence or absence of flicker before shooting, and displaying a warning if it is determined that flicker is present. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 10-126683 Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, even if the flicker detection process cannot detect a flicker frequency suitable for reducing stripes appearing in an image, the user can recognize the presence or absence of flicker. On the other hand, if the flicker detection function cannot detect a flicker frequency suitable for reducing stripes appearing in an image due to the relationship between the blinking direction of the flicker light source in the display and the imaging direction (scanning direction) of the image sensor, it may be possible to detect a flicker frequency suitable for reducing stripes appearing in an image by changing the attitude (orientation) of the imaging device (i.e., the image sensor) relative to the detection target (for example, rotating from horizontal to vertical). However, if the user is not aware of such a solution, it is not possible to detect a flicker frequency suitable for reducing stripes appearing in an image even if the flicker detection process is repeatedly executed.

[0007] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to realize a technology that can present a solution to a user when a detection result that can reduce stripes that appear in an image is not obtained even after performing flicker detection processing multiple times. [Means for solving the problem]

[0008] In order to solve the above problems and achieve the object, the imaging device of the present invention has an imaging means for imaging a subject to generate an image, a detection means for performing a flicker detection process on the image, and a control means for presenting information relating to a method of imaging the subject so that a predetermined result is obtained by the flicker detection process, and the control means presents the information when the number of times the flicker detection process has been performed exceeds a predetermined number of times because the predetermined result is not obtained by the flicker detection process. Effect of the Invention

[0009] According to the present invention, when a detection result capable of reducing stripes appearing in an image cannot be obtained even after executing flicker detection processing multiple times, a solution can be presented to the user. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an imaging apparatus according to an embodiment of the present invention. [Diagram 2] 4 is a flowchart illustrating a control process according to the first embodiment. [Diagram 3] 10 is a flowchart illustrating a control process according to the second embodiment. [Figure 4] FIG. 13 is a diagram illustrating an example of a form in which a solution is presented by a message. [Diagram 5] FIG. 13 is a diagram illustrating an example of a solution presented by animation. [Figure 6] FIG. 13 is a diagram illustrating an example of a form in which a solution is presented by OSD. [Figure 7] FIG. 13 is a diagram illustrating an example of a form in which a solution is presented by an icon. [Figure 8] FIG. 13 is a diagram illustrating an example of a solution presented by an external device. [Figure 9] FIG. 13 is a diagram illustrating a method for canceling the presentation of a solution. [Figure 10] FIG. 2 is a diagram illustrating a first example of presenting a situation suitable for flicker detection processing. [Figure 11] FIG. 13 is a diagram illustrating a second example of presenting a situation suitable for flicker detection processing. [Figure 12] FIG. 4 is a diagram illustrating an example of a rotation direction of the imaging device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0012] [Embodiment 1] An embodiment in which the imaging device of the present invention is applied to a digital camera equipped with a flicker detection function will be described below.

[0013] The imaging device is not limited to a digital camera, but may be an electronic device equipped with an imaging function, such as a smartphone, which is a type of mobile phone, or a tablet terminal.

[0014] First, the configuration and functions of the imaging device of this embodiment will be described with reference to FIG.

[0015] FIG. 1 is a block diagram showing the configuration of an image capturing apparatus 100 according to the present embodiment.

[0016] In this embodiment, the imaging device 100 includes various components, which will be described below, built into a main body case that constitutes a housing.

[0017] The imaging unit 101 includes an image sensor that converts an optical image formed via an optical system (not shown) into an electric signal, and an A / D converter that converts an analog electric signal generated by the image sensor into a digital signal. There may be a plurality of imaging units 101. In this case, the plurality of imaging units may be configured to be oriented in different directions and switch between an out-camera that captures a subject and an in-camera that captures a photographer. Alternatively, the plurality of imaging units may be provided for capturing images in the same direction and be configured to be switchable depending on the focal length of the corresponding optical system or the purpose of the image capture.

[0018] The image processing unit 102 performs predetermined resizing, trimming, color conversion, and distortion correction on the image data (including a live view image) generated by the imaging unit 101, and outputs the result to the image output unit 105. The image processing unit 102 also recognizes a person's face as a subject in the image, and notifies the system control unit 115. Furthermore, the image processing unit 102 can perform flicker detection on the image data generated by the imaging unit 101.

[0019] The codec 103 encodes the image data processed by the image processing unit 102 using a video compression format such as MPEG2 or H.264 and records it on a recording medium as a video file, or decodes the video file read from the recording medium 108 and outputs it to the image output unit 105.

[0020] The OSD drawing unit 104 renders various display elements for presenting to the user items such as character strings and icons representing the state and settings of the imaging device 100, AF frames and markers, and solutions described later, in accordance with control instructions from a system control unit 115 described later. After rendering, the OSD drawing unit 104 outputs the data to an image output unit 105 as OSD (On Screen Display) data.

[0021] The image output unit 105 superimposes the image data processed by the image processing unit 102, the image data decoded by the codec 103, and the OSD data output from the OSD drawing unit 104 to generate an image signal for display, and outputs it to the display unit 106.

[0022] The display unit 106 is a display device such as a liquid crystal panel or an organic EL panel that displays the image signal acquired from the image output unit 105. The display unit 106 may be provided in plurality, or may be an external device connected to the imaging device 100.

[0023] The touch detection unit 107 is a touch panel that is integrally configured with the display unit 106. The touch detection unit 107 can detect a touch operation by a user on the surface (touch detection surface) of the display unit 106, and notifies the system control unit 115 of an operation instruction corresponding to the detected touch operation.

[0024] The recording medium 108 is a storage device to which image data encoded by the codec 103 can be written and from which the encoded image data and associated data can be read. The recording medium 108 is a memory card or hard disk detachable from the imaging device, or a flash memory or hard disk built into the imaging device.

[0025] The operation unit 109 is an operation member such as a push button or a slide switch, and inputs various operation instructions according to user operations to the system control unit 115. The operation unit 109 includes, for example, a home button, a power button, and a volume button.

[0026] The attitude detection unit 110 detects the angle (photographing direction of a subject) that is the horizontal or vertical tilt of the imaging device 100, and notifies the system control unit 115 of the detected angle information. The position detection unit 111 detects the current position of the imaging device 100 (photographing position of a subject), and notifies the system control unit 115 of the detected position information.

[0027] The communication unit 112 allows the imaging device 100 to communicate with an external device such as a smartphone. The communication unit 112 is capable of network communication using, for example, mobile communication such as 4G or 5G, wireless communication such as wireless LAN, a wireless communication method such as peer-to-peer, or a wired communication method such as a Universal Serial Bus (USB) cable or a High-Definition Multimedia Interface (HDMI) (registered trademark) cable. Furthermore, the communication unit 112 can output an image signal received from the image output unit 105 to the outside.

[0028] The system memory 113 is a RAM or the like, into which constants and variables for the operation of the system control unit 115, programs read from the non-volatile memory 114, and the like are loaded.

[0029] The non-volatile memory 114 is an electrically erasable and recordable EEPROM, flash memory, etc. The non-volatile memory 114 stores constants for the operation of the system control unit 115, programs, model information of the imaging device 100, etc. The program in this embodiment refers to a program for executing the flowcharts described later in Fig. 2 and Fig. 3. The non-volatile memory 114 also stores image data such as moving images and still images as display elements for presenting the solutions described later.

[0030] The system control unit 115 includes a processor such as a CPU that performs calculation processing and control processing related to the imaging device 100. The system control unit 115 executes programs stored in the nonvolatile memory 114 to realize each process of the flowcharts described later in Fig. 2 and Fig. 3. The system control unit 115 also reads model information from the nonvolatile memory 114 and transmits it to an external device via the communication unit 112. The system control unit 115 also controls the imaging device 100 based on position information and control commands received from the external device via the communication unit 112.

[0031] Furthermore, the system control unit 115 can execute flicker detection processing using the image processing unit 102. The flicker detection processing of this embodiment is processing for automatically detecting the frequency of flicker appearing in an image captured of a detection target such as a display equipped with a flicker light source, and calculating a shutter speed as an imaging parameter for reducing stripes appearing in the image due to the flicker.

[0032] The flicker detection process of this embodiment is a process of calculating a shutter speed as a shooting parameter for reducing stripes that appear in an image due to flicker, but is not limited to this and may also be a process of applying a gain to an image to reduce unevenness.

[0033] <Control processing> Next, the control process of the first embodiment will be described with reference to FIG. 2 to FIG.

[0034] In embodiment 1, a solution is presented to the user depending on the number of times the flicker detection process has been performed, which is based on the difference between the flicker frequency detected by the Nth (N is a natural number greater than or equal to 2) flicker detection process and the flicker frequency detected by the N-1th flicker detection process.

[0035] In the following, a control process will be described in which the Nth time (N is a natural number equal to or greater than 2) is the current time and the N-1th time is the previous time.

[0036] FIG. 2 is a flowchart illustrating a control process for presenting a solution to a user when a flicker frequency that can obtain a shutter speed for reducing stripes appearing in an image cannot be detected even after performing the flicker detection process multiple times.

[0037] 2 is realized by the system control unit 115 loading a program stored in the non-volatile memory 114 into the system memory 113, executing the program, and controlling each component of the imaging device 100. The process in FIG. 2 is started in response to a GUI (Graphical User Interface) such as a menu screen displayed on the display unit 106 or a user operation via the operation unit 109. The same applies to FIG. 3 described later.

[0038] In step S201, system control unit 115 stores the number of re-execution times β of the flicker motion detection process in system memory 113, initializes the value of β to 0, and proceeds to step S202.

[0039] In step S202, system control unit 115 stores the cumulative number of executions α of the flicker detection process in system memory 113, initializes the value of α to 0, and proceeds to step S203.

[0040] In step S203, system control unit 115 determines whether or not to end the process. System control unit 115 determines whether or not the user has performed an operation to end the process via operation unit 109. If system control unit 115 determines to end the process, it ends the process, and if it determines not to end the control process, it proceeds to step S204.

[0041] In step S204, system control unit 115 waits until flicker detection processing is started, and if it is determined that flicker detection processing has been started, system control unit 115 advances the process to step S205.

[0042] In step S205, system control unit 115 executes flicker detection processing. System control unit 115 detects the frequency of flicker appearing in the image and stores it in system memory 113. After that, system control unit 115 starts measuring time T until the next start of flicker detection processing, and proceeds to step S206.

[0043] In step S206, system control unit 115 accesses system memory 113, increments the cumulative number of executions α of the flicker detection process (α→α+1), and proceeds to step S207.

[0044] In step S207, system control unit 115 accesses system memory 113 and determines whether or not the cumulative number of executions α of the flicker detection process is equal to or greater than 2. If system control unit 115 determines that the cumulative number of executions α of the flicker detection process is less than 2, it returns the process to step S203, and if it determines that the cumulative number of executions α is equal to or greater than 2, it proceeds to step S208.

[0045] In step S208, system control unit 115 determines whether or not the time T that has elapsed since the completion of the previous flicker detection process until the start of the current flicker detection process is equal to or less than a predetermined time. The predetermined time T0 is, for example, 30 seconds. If system control unit 115 determines that the time T that has elapsed since the completion of the previous flicker detection process until the start of the current flicker detection process is equal to or less than the predetermined time, it proceeds to step S209, and if it determines that the time T exceeds the predetermined time, it returns to step S203.

[0046] In step S209, the system control unit 115 accesses the system memory 113 and determines whether the frequency of the flicker detected by the previous flicker detection process and the frequency of the flicker detected by the current flicker detection process have a first relationship. The first relationship is a case where the fluctuation rate of the frequency of the flicker detected by the current flicker detection process with respect to the frequency of the flicker detected by the previous flicker detection process is equal to or less than a predetermined value. The fluctuation rate of the frequency of the flicker detected by the current flicker detection process with respect to the frequency of the flicker detected by the previous flicker detection process is calculated as a ratio of the difference between the frequency of the flicker detected by the current flicker detection process and the frequency of the flicker detected by the previous flicker detection process with respect to the frequency of the flicker detected by the previous flicker detection process. In this embodiment, the predetermined value is set to a fixed value of 5%, taking into consideration errors that may occur due to the accuracy of the flicker detection process. Since the detection accuracy can be improved by a method such as increasing the number of times the flicker frequency is detected, the value may be changed depending on the detection accuracy. If system control unit 115 determines that the rate of change of the frequency of the currently detected flicker relative to the frequency of the previously detected flicker is equal to or less than a predetermined value, it proceeds to step S210, and if it determines that the rate of change exceeds the predetermined value, it returns to step S203.

[0047] In step S210, system control unit 115 accesses system memory 113, increments the number of re-execution times β of the flicker detection process (β→β+1), and the process proceeds to step S211.

[0048] In step S211, system control unit 115 accesses system memory 113 and determines whether or not the number of re-execution times β of the flicker detection process is equal to or greater than a predetermined number. The predetermined number of times β0 is, for example, 3 times. If system control unit 115 determines that the number of re-execution times β of the flicker detection process is equal to or greater than the predetermined number, the process proceeds to step S212, and if system control unit 115 determines that the number of re-execution times β is less than the predetermined number, the process returns to step S203.

[0049] In step S212, the system control unit 115 determines that a detection result capable of reducing stripes appearing in an image has not been obtained even after performing the flicker detection process multiple times. A detection result capable of reducing stripes appearing in an image is a flicker frequency suitable for reducing stripes appearing in an image, and is a flicker frequency at which a shutter speed for reducing stripes appearing in an image due to flicker can be obtained. Then, the system control unit 115 executes a process of presenting a solution to the user, and ends the process. The system control unit 115 notifies the user of a solution when a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected by displaying it on the display unit 106.

[0050] 4 to 8 show examples of a method of presenting a solution to a user when a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected. In this embodiment, an example will be described in which a solution for changing the attitude of the imaging device 100 (attitude of the image sensor) with respect to the detection target is notified to the user by the display unit 106 as information regarding an imaging method for the detection target subject. Note that the presentation methods of Figs. 4, 5, 6, 7, and 8 may be implemented in appropriate combination.

[0051] The light emission methods of the light source equipped in the display include a batch lighting method in which multiple light sources are turned on at the same time, and a sequential lighting method in which multiple light sources are turned on in a vertical or horizontal direction in sequence.In addition, the imaging methods of the image sensor include a global shutter method in which the entire screen is exposed (scanned) at the same time, and a rolling shutter method in which blocks of several lines are exposed sequentially in the vertical or horizontal direction.

[0052] When a display in which the light source blinks in a sequential lighting manner is imaged using a rolling shutter method, the exposure timing and the blinking timing of the display interfere with each other, and the flicker frequency may not be detected accurately. Thus, in this embodiment, an example will be described in which, when a flicker frequency suitable for reducing stripes appearing in an image cannot be detected due to the relationship between the blinking direction of the flicker light source and the imaging direction (scanning direction) of the image sensor, the user is notified of a solution to rotate the orientation of the image sensor 90° with respect to the subject to be detected (from horizontal to vertical).

[0053] Fig. 4 illustrates an example of a form in which a solution is presented by a message. In the example of Fig. 4, a message for urging the user to rotate the imaging device 100 by 90° and perform flicker detection processing is displayed on the display unit 106. The system control unit 115 reads the message from the non-volatile memory 114 and displays it on the display unit 106. Note that the content of the message is not limited to the example of Fig. 4, and any content may be used as long as it is possible to urge the user to rotate the imaging device 100 by 90° and perform flicker detection processing.

[0054] Further, in the example of FIG. 4, the difference between the angle when the imaging device 100 performed the previous flicker detection and the angle when the message is displayed is displayed on the display unit 106. The system control unit 115 reads the angle of the imaging device 100 from the system memory 113, calculates the difference between the angle when the imaging device 100 performed the previous flicker detection and the angle when the message is displayed, and displays it on the display unit 106. A screen 401 in FIG. 4(a) illustrates an example of a message display notifying a state in which the user has not rotated the camera from the angle when the previous flicker detection was performed. A screen 402 in FIG. 4(b) illustrates an example of a message display notifying a state in which the user has rotated the camera angle by 10°. Note that the angle information may have any content as long as it is possible to notify the difference between the angle when the previous flicker detection was performed and the angle when the message is displayed. Furthermore, when the system control unit 115 determines that the angle difference is within a predetermined range, the system control unit 115 changes the color of the message notifying the angle information as shown in a screen 403 in FIG. 4(c) and displays it on the display unit 106. For example, the predetermined range is 70° or more and 110° or less. Note that the method is not limited to the example of screen 403 in FIG. 4C, and any method may be used as long as it is possible to notify the user that the angle difference is within a predetermined range.

[0055] FIG. 5 illustrates an example of a form in which a solution is presented by animation. In the example of FIG. 5, an animation for urging a user to rotate the posture of the imaging device 100 by 90° and perform a flicker detection process is displayed on the display unit 106. The system control unit 115 reads the animation from the non-volatile memory 114 and displays it on the display unit 106. The animation transitions in the order of image 501, image 502, image 503, and image 504. The transition of image 501, image 502, and image 503 indicates that the imaging device 100 rotates by 90°. Also, image 504 indicates the execution status of a user operation to start a flicker detection process. In the animation of this embodiment, the imaging device 100 rotates in the right direction, but it may rotate in the left direction. Note that the content of the animation is not limited to the example of FIG. 5, and any content may be used as long as it can urge a user to rotate the imaging device 100 by 90° and perform a flicker detection process.

[0056] FIG. 6 illustrates an example of a form in which a solution is presented by an OSD. In the example of FIG. 6, a part of the OSD displayed on the display unit 106 is rotated by 90 degrees to prompt the user to rotate the posture of the imaging device 100 by 90 degrees to perform flicker detection processing. The system control unit 115 reads the OSD from the non-volatile memory 114, rotates it by 90 degrees, and displays it on the display unit 106. An image 601 shows a live view displayed on the display unit 106. A bar 602 superimposed on the live view is a slide bar that accepts a user operation to adjust the shutter speed. A button 603 is a button that accepts a user operation to start the flicker detection processing. A screen 604 in FIG. 6(a) shows a display state before a solution is presented to the user. When the system control unit 115 determines that a solution needs to be presented to the user, the bar 602 and the button 603, which are part of the GUI, are rotated by 90 degrees, as in a screen 605 in FIG. 6(b) or a screen 606 in FIG. 6(c). The display state may be changed from screen 605 in Fig. 6(b) or screen 606 in Fig. 6(c) to screen 604 in Fig. 6(a). In addition, in this embodiment, an example is shown in which bar 602 and button 603 are rotated as part of the OSD, but other OSD may be rotated.

[0057] FIG. 7 illustrates an example of a form in which a solution is presented by an icon. In the example of FIG. 7, an icon for urging the user to rotate the posture of the imaging device 100 by 90 degrees and perform flicker detection processing is displayed on the display unit 106. The system control unit 115 reads the icon from the non-volatile memory 114 and displays it on the display unit 106. An image 701 shows a live view displayed on the display unit 106. An icon 702 is an icon indicating that the imaging device 100 is rotated by 90 degrees. When the system control unit 115 determines that it is necessary to present a solution to the user, the icon 702 is displayed on the display unit 106. Note that the shape of the icon is not limited to the example of FIG. 7, and any shape may be used as long as it is possible to urge the user to rotate the imaging device 100 by 90 degrees and perform flicker detection processing.

[0058] FIG. 8 illustrates an example of a form in which a solution is presented by an external device. In the example of FIG. 8, the imaging device 100 is communicably connected to an external device 801 such as a smartphone by the communication unit 112, and a message for urging the user to rotate the posture of the imaging device 100 by 90 degrees and perform flicker detection processing is displayed on the display unit 802 of the external device 801. When the system control unit 115 determines that it is necessary to present a solution to the user, the communication unit 112 transmits a message and a display command to the external device 801. The external device 801 displays a message on the display unit 802 of the external device 801 according to the display command received from the imaging device 100. Note that the content of the message is not limited to the example of FIG. 8, and any content may be used as long as it is possible to urge the user to rotate the imaging device 100 by 90 degrees and perform flicker detection processing.

[0059] FIG. 9 illustrates a method of canceling the presentation of the solution. FIG. 9(a) illustrates a state in which a message for urging the user to rotate the imaging device 100 by 90° and perform the flicker detection process is displayed on the display unit 106. FIG. 9(b) illustrates a state in which the imaging device 100 is rotated 90° to the right from the state of FIG. 9(a). FIG. 9(c) illustrates a state in which the imaging device 100 is rotated 90° to the left from the state of FIG. 9(a). When the system control unit 115 determines that the imaging device 100 has changed from the state of FIG. 9(a) to the state of FIG. 9(b) or FIG. 9(c), the system control unit 115 cancels the message 901 that was displayed in the state of FIG. 9(a). Note that the content of the message may be content that urges the user to increase the imaging range of the subject to be detected and perform the flicker detection process as described later in FIG. 10. Note that, although an example of canceling the message has been described in this embodiment, the target to be canceled is not limited to the message.

[0060] FIG. 10 illustrates a first form of presenting a situation suitable for flicker detection processing. In the example of FIG. 10, when the user rotates the imaging device 100 by 90 degrees, a message is displayed on the display unit 106 to prompt the user to perform flicker detection processing by enlarging the imaging range of the subject 1001 when a part of the subject 1001 to be detected is not included in the imaging angle of view. FIG. 10(a) illustrates a state in which the imaging device 100 is imaging the subject 1001 to be detected. FIG. 9(b) illustrates a state in which a message 1002 is displayed on the display unit 106 to prompt the user to rotate the imaging device 100 by 90 degrees and perform flicker detection processing while the imaging device 100 is imaging the subject 1001 to be detected. FIG. 9(c) illustrates a state in which the imaging device 100 is rotated by 90 degrees from the state of FIG. 9(b). The message 1003 is a content that prompts the user to perform flicker detection processing by enlarging the imaging range so that the whole of the subject 1001 to be detected is included in the imaging angle of view. As shown in FIG. 9(c), when the imaging range of the subject 1001 to be detected is small, the flicker frequency suitable for reducing stripes appearing in the image may not be detected by the flicker detection process. In such a case, the user who is presented with the message 1003 can detect the flicker frequency suitable for reducing stripes appearing in the image by enlarging the imaging range of the subject 1001 to be detected and capturing the image as shown in FIG. 9(d). Note that the content of the message is not limited to the example in FIG. 10, and any content may be used as long as it is possible to urge the user to enlarge the imaging range of the subject 1001 to be detected and perform the flicker detection process. Also, although an example of notifying a message has been described in this embodiment, the form of presentation is not limited to a message.

[0061] FIG. 11 illustrates a second form of presenting a situation suitable for flicker detection processing. In the example of FIG. 11, when the imaging device 100 cannot be rotated because the imaging device 100 is fixed to the outside, a message is displayed on the display unit 106 to prompt the user to rotate the subject to be detected by 90° and perform the flicker detection processing. In this case, the user notifies the system control unit 115 via the operation unit 109 or the like whether the imaging device 100 can be rotated. When the system control unit 115 determines that the imaging device 100 cannot be rotated based on the user's operation and determines that it is necessary to present a solution to the user, the imaging device 100 displays a message on the display unit 106 to prompt the user to rotate the subject to be detected by the imaging device 100 by 90° and perform the flicker detection processing. Note that, although an example of notifying a message has been described in this embodiment, the form of presentation is not limited to a message.

[0062] Fig. 12 illustrates directions in which the attitude of the imaging device 100 can be changed. As illustrated in Fig. 12, three axes, namely, the vertical direction, the horizontal direction, and the front-rear direction, which are orthogonal to each other with the imaging device 100 at the center, are defined as a pitch axis 1201, a yaw axis 1202, and a roll axis 1203. In this embodiment, it is assumed that the imaging device 100 is rotated with the roll axis 1203 as a reference, as indicated by an arrow 1204. Note that, although the imaging device 100 is rotated clockwise as indicated by the arrow 1204, it may be rotated counterclockwise.

[0063] According to the above-described embodiment 1, when a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected and the number of times that the flicker detection process has been executed exceeds a predetermined number, a solution can be presented to the user.

[0064] [Embodiment 2] Next, the control process of the second embodiment will be described with reference to FIG.

[0065] In embodiment 2, a solution is presented to the user depending on the number of times the flicker detection process is executed, which is based on the difference between the angle of the imaging device (image sensor) in the Nth (N is a natural number greater than or equal to 2) flicker detection process and the angle of the imaging device (image sensor) in the N-1th flicker detection process.

[0066] In this embodiment, the angle of the imaging device (image sensor) is the horizontal or vertical rotation angle of the imaging device around a roll axis 1203, as indicated by an arrow 1204 in FIG.

[0067] In the following, a control process will be described in which the Nth time (N is a natural number equal to or greater than 2) is the current time and the N-1th time is the previous time.

[0068] FIG. 3 is a flowchart illustrating a control process for presenting a solution to a user when a flicker frequency that can obtain a shutter speed for reducing stripes appearing in an image cannot be detected even after executing the flicker detection process multiple times.

[0069] The configuration of the imaging device of the second embodiment is similar to that of Fig. 1 of the first embodiment. In addition, the manner in which a solution to be presented to a user when a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected and the method of canceling the presentation of the solution are similar to those of Figs. 4 to 11 of the first embodiment.

[0070] The processing in steps S301 to S304 is similar to the processing in steps S201 to S204 in FIG.

[0071] In step S305, the system control unit 115 detects the angle of the image capturing device 100 using the attitude detection unit 110, stores the detected angle in the system memory 113, and proceeds to step S306.

[0072] The processing in steps S306 to S309 is similar to the processing in steps S205 to S208 in FIG.

[0073] In step S310, the system control unit 115 accesses the system memory 113 and determines whether or not the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process have a second relationship. The second relationship is a case where the difference between the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process is equal to or less than a predetermined angle. The predetermined angle is, for example, 30°. If the system control unit 115 determines that the difference between the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process is equal to or less than the predetermined angle, the system control unit 115 advances the process to step S311, and if the difference exceeds the predetermined angle, the system control unit 115 returns the process to step S303.

[0074] The processing in steps S311 to S313 is similar to the processing in steps S210 to S212 in FIG.

[0075] According to the above-mentioned second embodiment, when a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected and the number of times that the flicker detection process has been executed exceeds a predetermined number, a solution can be presented to the user.

[0076] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0077] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention.

[0078] The disclosure of this specification includes the following imaging device, control method, and program. [Configuration 1] 1. An imaging device, comprising: An imaging means for capturing an image of a subject and generating an image; A detection means for performing a flicker detection process on the image; a control means for presenting information regarding a method of capturing an image of a subject so that a predetermined result is obtained by the flicker detection process; The imaging device, wherein the control means presents the information when the number of times the flicker detection process has been executed exceeds a predetermined number of times due to a failure to obtain a predetermined result by the flicker detection process. [Configuration 2] The imaging device described in configuration 1, characterized in that the control means presents the information when a predetermined relationship exists between the frequency of the flicker detected by the Nth (N is a natural number greater than or equal to 2) flicker detection process and the frequency of the flicker detected by the N-1th flicker detection process, and when the number of times the flicker detection process has been performed is equal to or greater than the predetermined number of times. [Configuration 3] The imaging device described in configuration 2, wherein the predetermined relationship is a first relationship in which the rate of change of the flicker frequency detected by the Nth flicker detection process (N is a natural number greater than or equal to 2) relative to the flicker frequency detected by the N-1th flicker detection process (N is a natural number greater than or equal to 2) is less than or equal to a predetermined value. [Configuration 4] The imaging device described in configuration 3, characterized in that the control means presents the information when the time from the completion of the (N-1)th flicker detection process to the start of the Nth flicker detection process is less than or equal to a predetermined time, the first relationship is satisfied, and the number of times the flicker detection process has been executed is equal to or greater than the predetermined number of times. [Configuration 5] The imaging device described in configuration 1, characterized in that the control means presents the information when a difference between an angle of the imaging device with respect to the subject in an Nth (N is a natural number greater than or equal to 2) flicker detection process and an angle of the imaging device with respect to the subject in an N-1th flicker detection process has a predetermined relationship, and the number of times the flicker detection process has been performed is equal to or greater than the predetermined number of times. [Configuration 6] The imaging device described in configuration 5, wherein the specified relationship is a second relationship in which a difference between an angle of the imaging device with respect to the subject in an Nth (N is a natural number greater than or equal to 2) flicker detection process and an angle of the imaging device with respect to the subject in an N-1th flicker detection process is less than or equal to a specified angle. [Configuration 7] The imaging device described in configuration 6, characterized in that the control means presents the information when the time from the completion of the (N-1)th flicker detection process to the start of the Nth flicker detection process is less than or equal to a predetermined time, the second relationship is satisfied, and the number of times the flicker detection process has been executed is equal to or greater than the predetermined number of times. [Configuration 8] 8. The imaging device according to any one of configurations 1 to 7, wherein the control means cancels presentation of the information when the imaging method of the subject is changed in accordance with the presented information. [Configuration 9] The imaging device according to any one of configurations 1 to 8, wherein the control means presents information prompting a user to increase an imaging range of the subject when an imaging method of the subject is changed in accordance with the presented information. [Configuration 10] the predetermined result is a shooting parameter of the imaging device for reducing stripes appearing in an image due to flicker detected by the flicker detection process, 10. The imaging device according to any one of configurations 1 to 9, wherein the information is a solution for when the shooting parameters cannot be obtained by the flicker detection process. [Configuration 11] the imaging method of the subject is a posture of the imaging device when imaging the subject, 11. The imaging device according to configuration 10, wherein the information is information that prompts a user to rotate the attitude of the imaging device by a predetermined angle with respect to the subject and execute the flicker detection process. [Configuration 12] 12. The imaging device according to any one of configurations 1 to 11, wherein the information is displayed as a message on a display unit of the imaging device. [Configuration 13] 12. The imaging device according to any one of configurations 1 to 11, wherein the information is displayed as an animation on a display unit of the imaging device. [Configuration 14] 12. The imaging device according to any one of configurations 1 to 11, wherein the information is displayed as an icon on a display unit of the imaging device. [Configuration 15] 12. The imaging device according to any one of configurations 1 to 11, wherein the information is displayed on an external device communicably connected to the imaging device. [Configuration 16] The imaging device according to any one of configurations 1 to 12, characterized in that the information includes information representing a difference between an angle at the orientation of the imaging device in the previous flicker detection process and an angle at the current orientation of the imaging device. [Configuration 17] The imaging device described in any one of configurations 1 to 12, characterized in that the information includes a notification that a difference between an angle at the orientation of the imaging device in the previous flicker detection process and an angle at the current orientation of the imaging device is within a predetermined range. [Configuration 18] the imaging method of the subject is a posture of the imaging device when imaging the subject, The imaging device described in configuration 1, characterized in that, when the attitude of the imaging device cannot be changed, the control means presents information for changing the attitude of the subject so that the specified result is obtained by the flicker detection processing. [Configuration 19] 19. The imaging device according to any one of configurations 1 to 18, wherein the subject is a display equipped with a light source that repeatedly blinks at a predetermined cycle. [Configuration 20] A control method for an imaging device, comprising: The imaging device includes: An imaging means for capturing an image of a subject and generating an image; A detection means for performing a flicker detection process on the image, The control method includes: a step of presenting information regarding a method of capturing an image of a subject so that a predetermined result is obtained by the flicker detection process; A control method characterized in that, in the step, when the number of times the flicker detection process has been performed exceeds a predetermined number of times because a predetermined result has not been obtained by the flicker detection process, the information is presented. [Configuration 21] A program for causing a computer to function as the imaging device according to any one of claims 1 to 19. [Explanation of symbols]

[0079] 100: imaging device, 101: imaging section, 102: image processing section, 104: OSD drawing section, 110: attitude detection section, 111: position detection section, 112: communication section, 115: system control section

Claims

1. 1. An imaging device, comprising: An imaging means for capturing an image of a subject and generating an image; A detection means for performing a flicker detection process on the image; a control means for presenting information regarding a method of capturing an image of a subject so that a predetermined result is obtained by the flicker detection process; The imaging device, wherein the control means presents the information when the number of times the flicker detection process has been executed exceeds a predetermined number of times due to a failure to obtain a predetermined result by the flicker detection process.

2. The imaging device described in claim 1, characterized in that the control means presents the information when a predetermined relationship exists between the frequency of the flicker detected by the Nth (N is a natural number greater than or equal to 2) flicker detection process and the frequency of the flicker detected by the N-1th flicker detection process, and when the number of times the flicker detection process has been performed is equal to or greater than the predetermined number of times.

3. The imaging device described in claim 2, characterized in that the specified relationship is a first relationship in which the rate of change of the flicker frequency detected by the Nth flicker detection process (N is a natural number greater than or equal to 2) relative to the flicker frequency detected by the N-1th flicker detection process (N is a natural number greater than or equal to 2) is less than or equal to a specified value.

4. The imaging device described in claim 3, characterized in that the control means presents the information when the time from the completion of the (N-1)th flicker detection process to the start of the Nth flicker detection process is less than or equal to a predetermined time, the first relationship is satisfied, and the number of times the flicker detection process has been performed is greater than or equal to the predetermined number of times.

5. The imaging device described in claim 1, characterized in that the control means presents the information when a difference between an angle of the imaging device with respect to the subject in an Nth (N is a natural number greater than or equal to 2) flicker detection process and an angle of the imaging device with respect to the subject in an N-1th flicker detection process has a predetermined relationship, and when the number of times the flicker detection process has been performed is equal to or greater than the predetermined number of times.

6. The imaging device described in claim 5, characterized in that the specified relationship is a second relationship in which a difference between an angle of the imaging device with respect to the subject in an Nth (N is a natural number greater than or equal to 2) flicker detection process and an angle of the imaging device with respect to the subject in an N-1th flicker detection process is less than or equal to a specified angle.

7. The imaging device described in claim 6, characterized in that the control means presents the information when the time from the completion of the (N-1)th flicker detection process to the start of the Nth flicker detection process is less than or equal to a predetermined time, the second relationship is satisfied, and the number of times the flicker detection process has been performed is greater than or equal to the predetermined number of times.

8. 2. The imaging apparatus according to claim 1, wherein the control means cancels presentation of the information when the imaging method for the subject is changed in accordance with the presented information.

9. 2. The imaging apparatus according to claim 1, wherein the control means presents information to prompt the user to increase the imaging range of the subject when the imaging method of the subject is changed in accordance with the presented information.

10. the predetermined result is a shooting parameter of the imaging device for reducing stripes appearing in an image due to flicker detected by the flicker detection process, 2. The imaging apparatus according to claim 1, wherein the information is a solution for when the shooting parameters cannot be obtained by the flicker detection process.

11. the imaging method of the subject is a posture of the imaging device when imaging the subject, The imaging apparatus according to claim 10 , wherein the information is information that prompts a user to rotate the attitude of the imaging apparatus by a predetermined angle with respect to the subject and then execute the flicker detection process.

12. The imaging device according to claim 1 , wherein the information is displayed as a message on a display unit of the imaging device.

13. The imaging device according to claim 1 , wherein the information is displayed as an animation on a display unit of the imaging device.

14. The imaging device according to claim 1 , wherein the information is displayed as an icon on a display unit of the imaging device.

15. The imaging apparatus according to claim 1 , wherein the information is displayed on an external device communicably connected to the imaging apparatus.

16. 2 . The imaging device according to claim 1 , wherein the information includes information representing a difference between an angle of the imaging device in a previous orientation in the flicker detection process and an angle of the imaging device in a current orientation.

17. 2. The imaging device according to claim 1, wherein the information includes a notification that a difference between an angle of the imaging device in a previous orientation in the flicker detection process and an angle of the imaging device in a current orientation is within a predetermined range.

18. the imaging method of the subject is a posture of the imaging device when imaging the subject, 2. The imaging device according to claim 1, wherein, when the attitude of the imaging device cannot be changed, the control means presents information for changing the attitude of the subject so that the specified result is obtained by the flicker detection processing.

19. 2. The imaging device according to claim 1, wherein the subject is a display having a light source that repeatedly blinks at a predetermined interval.

20. A control method for an imaging device, comprising: The imaging device includes: An imaging means for capturing an image of a subject and generating an image; A detection means for performing a flicker detection process on the image, The control method includes: a step of presenting information regarding a method of capturing an image of a subject so that a predetermined result is obtained by the flicker detection process; A control method characterized in that, in the step, when the number of times the flicker detection process has been performed exceeds a predetermined number of times because a predetermined result has not been obtained by the flicker detection process, the information is presented.

21. A program for causing a computer to function as the imaging device according to any one of claims 1 to 19.

Images