Image pickup apparatus, control method, storage medium, and program product

Abstract

The invention relates to an imaging apparatus, a control method, a storage medium, and a program product. The image capturing apparatus includes: an image capturing unit that captures an image of a subject; a detection unit that performs flicker detection processing on the image; and a control unit that presents information relating to an imaging method of the subject such that the flicker detection process obtains a predetermined result. In a case where a predetermined result cannot be obtained due to the flicker detection process, the control unit presents information in a case where the number of times the flicker detection process has been executed is greater than a predetermined number of times.

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method, a storage medium and a program product, and in particular to flicker detection processing of an imaging device. Background Art

[0002] In recent years, opportunities to capture images of displays have increased with the popularity of visual effects (VFX), etc. In the case where a display is equipped with a light source that repeatedly turns on and off at a cycle of several hundred Hz to several kilohertz (a flickering light source), stripes corresponding to brightness fluctuations may occur in the image captured of the display due to the influence of the exposure timing of the image sensor, etc.

[0003] Some imaging devices are equipped with a flicker detection function for detecting the period (flicker frequency) of streaks that appear in an image captured of a display equipped with a flickering light source, etc. The flicker detection function detects the flicker frequency that appears in an image captured of a display having a flickering light source, and calculates a shutter speed as an imaging parameter to reduce streaks that appear in the image. Due to the relationship between the flickering direction of the flickering light source in the display and the imaging direction (scanning direction) of the image sensor, there are cases where the flicker detection function cannot detect a flicker frequency that is suitable for reducing streaks that appear in the image.

[0004] Japanese Patent Laid-Open No. 10-126683 describes detecting the presence of flicker before imaging and displaying a warning if it is determined that flicker exists.

[0005] In Japanese Patent Laid-Open No. 10-126683, even in the case where the flicker detection process cannot detect the flicker frequency suitable for reducing the stripes appearing in the image, the user can still recognize the presence of flicker. On the other hand, in the case where the flicker detection function cannot detect the flicker frequency suitable for reducing the stripes appearing in the image due to the relationship between the flicker direction of the flickering light source in the display and the camera direction (scanning direction) of the image sensor, the posture (orientation) of the camera device (i.e., the image sensor) relative to the detection object can be changed (for example, the image sensor is rotated from the horizontal direction to the vertical direction), which can detect the flicker frequency suitable for reducing the stripes appearing in the image. However, in the case where the user is unaware of this solution, the flicker detection process cannot detect the flicker frequency suitable for reducing the stripes appearing in the image even when the flicker detection process is repeatedly performed. Summary of the invention

[0006] The present invention provides an imaging device, comprising: an imaging unit, which captures an image of a subject; a detection unit, which performs flicker detection processing on the image; and a control unit, which presents information related to a method of imaging the subject so that the flicker detection processing obtains a predetermined result, wherein the control unit presents the information in the case where the flicker detection processing cannot obtain the predetermined result or the flicker detection processing has been executed more than a predetermined number of times.

[0007] The present invention provides a control method for a camera device, wherein the camera device includes a camera unit for capturing an image of a subject and a detection unit for performing a flicker detection process on the image, the control method comprising the following steps: presenting information related to the camera method of the subject so that the flicker detection process obtains a predetermined result, wherein the presenting step presents the information in the case where the flicker detection process cannot obtain the predetermined result or the flicker detection process has been executed more than a predetermined number of times.

[0008] The present invention provides a computer-readable storage medium storing a program for causing a computer to execute the control method as described above.

[0009] The present invention provides a program product including a program for causing a computer to execute the control method described above.

[0010] According to the present invention, it is possible to present a user with a solution to a situation where a flicker detection result suitable for reducing streaks appearing in an image cannot be obtained even when flicker detection processing is performed multiple times.

[0011] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a block diagram showing the configuration of an image pickup apparatus according to the first embodiment.

[0013] Figure 2 is a flowchart showing a control process according to the first embodiment.

[0014] Figure 3 is a flowchart showing a control process according to the second embodiment.

[0015] FIG. 4A to FIG. 4C Shows how the solution would look like if presented through messages.

[0016] Figure 5 Shows what the solution would look like through animation.

[0017] FIG. 6A to FIG. 6CShows what the solution looks like through OSD presentation.

[0018] Figure 7 Shows what the solution looks like when presented through icons.

[0019] Figure 8 Shows what the solution looks like when presented through an external device.

[0020] 9A to 9C A method for cancelling presentation of a solution is shown.

[0021] FIG. 10A to FIG. 10D A first appearance is shown presenting a situation suitable for flicker detection processing.

[0022] Fig.11 is a diagram showing a second appearance presenting a situation suitable for flicker detection processing.

[0023] Fig.12 Shows the rotation direction of the camera device. DETAILED DESCRIPTION

[0024] Embodiments will be described in detail below with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. Multiple features are described in the embodiments, but are not limited to inventions requiring all such features, and multiple such features may be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar configurations, and redundant descriptions thereof are omitted.

[0025] First embodiment

[0026] An embodiment applied to an image pickup apparatus of a digital camera equipped with a flicker detection function is described below.

[0027] The imaging device is not limited to a digital camera, but may be, for example, an electronic device having an imaging function, such as a smartphone, a type of mobile phone, or a tablet device.

[0028] First, refer to Figure 1 , the configuration and functions of the imaging apparatus according to the present embodiment will be described.

[0029] Figure 1 is a block diagram showing the configuration of the imaging apparatus 100 .

[0030] In the present embodiment, the imaging apparatus 100 has respective components described later built into a main body case forming a housing.

[0031] The imaging unit 101 includes an image sensor that converts an optical image formed by an optical system not shown in the figure into an electrical signal, and an A / D converter that converts an analog electrical signal generated by the image sensor into a digital signal. There may be a case where a plurality of imaging units 101 are equipped with the imaging device 100. In this case, the plurality of imaging units may be oriented in different directions and may be configured to be switchable, such as an outer camera for capturing an image of a subject and an inner camera for capturing an image of a photographer. The plurality of imaging units may be provided for imaging in the same direction and may be configured to be switchable according to the focal length of the corresponding optical system and the purpose of imaging.

[0032] The image processing unit 102 performs predetermined resizing, cropping, color conversion, and distortion correction processing on the image data (including the live view image) generated by the imaging unit 101, and outputs the processed image data to the image output unit 105. In addition, the image processing unit 102 recognizes a human face as a subject in the image, and notifies the system control unit 115 of the recognition result. Furthermore, the image processing unit 102 may perform flicker detection on the image data generated by the imaging unit 101.

[0033] The codec 103 encodes the image data processed by the image processing unit 102 in a video compression format such as MPEG2 or H.264, and records the encoded image data as a video file on a recording medium, or decodes the video file read from the recording medium 108, and outputs the decoded image data to the image output unit 105.

[0034] The OSD rendering unit 104 renders items such as character strings and icons indicating the status and settings of the imaging apparatus 100, an AF frame and a mark, and various display elements for presenting a solution described later to the user according to a control instruction from the system control unit 115 described later. After rendering them, the OSD rendering unit 104 outputs the rendered data as on-screen display (OSD) data to the image output unit 105.

[0035] The image output unit 105 superimposes the image data processed by the image processing unit 102 , the image data decoded by the codec 103 , and the OSD data output from the OSD rendering unit 104 to generate an image signal for display and outputs it to the display unit 106 .

[0036] The display unit 106 has a display device such as a liquid crystal panel or an organic EL panel for displaying an image signal obtained from the image output unit 105. The display unit 106 may have a plurality of display units, or the display unit 106 may be an external device connected to the imaging apparatus 100.

[0037] The touch detection unit 107 is a touch panel formed integrally with the display unit 106. The touch detection unit 107 can detect a user touch operation on the surface (touch detection surface) of the display unit 106 and notify the system control unit 115 of an operation instruction corresponding to the detected touch operation.

[0038] The recording medium 108 is a storage device capable of writing image data encoded by the codec 103 and reading recorded encoded image data and accompanying data. The recording medium 108 is a memory card or a hard disk that can be attached to or detached from the imaging apparatus 100, or a flash memory or a hard disk built into the imaging apparatus 100.

[0039] The operation unit 109 is an operation member such as a push button or a slide switch, which inputs various operation instructions in response to user operations to the system control unit 115. The operation unit 109 includes, for example, a home button, a power button, and a volume button.

[0040] The posture detection unit 110 detects an angle (a direction in which a subject is photographed) which is a horizontal or vertical inclination of the imaging apparatus 100, and notifies the system control unit 115 of the detected angle information. The position detection unit 111 detects the current position (the imaging position of the subject) of the imaging apparatus 100, and notifies the system control unit 115 of the detected position information.

[0041] The communication unit 112 enables the camera 100 to communicate with an external device such as a smartphone. The communication unit 112 enables network communication through, for example, mobile communications such as 4G and 5G, wireless communications such as a wireless local area network (LAN), wireless communication methods such as point-to-point, and wired communication methods such as a universal serial bus (USB) cable and a high-definition multimedia interface (HDMI (registered trademark)) cable or other wired communication methods. In addition, the communication unit 112 can output the image signal received from the image output unit 105 to the external device.

[0042] The system memory 113 is a RAM or the like, into which constants and variables used for the operation of the system control unit 115 and programs read from the nonvolatile memory 114 are loaded.

[0043] The nonvolatile memory 114 is an electrically erasable and recordable EEPROM or flash memory. The nonvolatile memory 114 stores constants, programs, and information about the model of the imaging apparatus 100 used for the operation of the system control unit 115. The program in this embodiment is used to execute the operation to be performed later in Figure 2 and Figure 3The nonvolatile memory 114 also stores image data such as moving images and still images as display elements for presenting a solution described later.

[0044] The system control unit 115 is equipped with a processor such as a CPU, which performs calculations and control processing related to the imaging apparatus 100. The system control unit 115 executes a program stored in the nonvolatile memory 114 to realize the image capturing apparatus 100 later. Figure 2 and Figure 3 The system control unit 115 also reads the model information from the nonvolatile memory 114 and transmits the model information to the external device via the communication unit 112. The system control unit 115 also controls the imaging apparatus 100 based on the position information and control commands received from the external device via the communication unit 112.

[0045] The system control unit 115 can also perform flicker detection processing through the image processing unit 102. The flicker detection processing of the present embodiment automatically detects the frequency of flicker appearing in an image in which a detection object (such as a display equipped with a flickering light source) is captured, and calculates a shutter speed as an imaging parameter for reducing streaks appearing in the image due to the flicker.

[0046] The flicker detection process of this embodiment is a process of calculating the shutter speed as an imaging parameter to reduce streaks appearing in an image due to flicker, but is not limited to this process and may be a process of applying a gain to reduce irregularities to an image.

[0047] Control Processing

[0048] Next, refer to Figures 2 to 11 The control process according to the first embodiment is described.

[0049] In a first embodiment, a solution is presented to a user based on the number of executions of a flicker detection process based on the difference between a flicker frequency detected by an Nth flicker detection process (N is a natural number greater than or equal to 2) and a flicker frequency detected by an N-1th flicker detection process.

[0050] The following describes control processing in a case where the Nth time (N is a natural number greater than or equal to 2) is this time and the N-1th time is the previous time.

[0051] Figure 2 1 is a flowchart showing control processing for presenting a solution to a user in a case where the flicker detection processing cannot detect a flicker frequency at which a shutter speed for reducing streaks appearing in an image can be obtained even after the flicker detection processing is performed a plurality of times.

[0052] Figure 2The processing in the above is realized by the system control unit 115 loading the program stored in the nonvolatile memory 114 into the system memory 113 and executing the program to control the respective components of the imaging apparatus 100. In response to a graphical user interface (GUI) such as a menu screen displayed on the display unit 106 or a user operation via the operation unit 109, the image capturing apparatus 100 is started. Figure 2 This also applies to the processing described later. Figure 3 .

[0053] In step S201 , the system control unit 115 stores the number of times β that the flicker detection process has been re-executed in the system memory 113 , initializes the value of β to 0, and proceeds to step S202 .

[0054] In step S202 , the system control unit 115 stores the total number of times α that the flicker detection process has been executed in the system memory 113 , initializes the value of α to 0, and proceeds to step S203 .

[0055] In step S203, the system control unit 115 determines whether to terminate the process. The system control unit 115 determines whether the user performs an operation to terminate the process via the operation unit 109. If the system control unit 115 determines that the process is terminated, the system control unit 115 terminates the process, and if the system control unit 115 determines that the control process is not terminated, the system control unit 115 advances the process to step S204.

[0056] In step S204 , the system control unit 115 waits until the flicker detection process starts, and if the system control unit 115 determines that the flicker detection process has started, the system control unit 115 advances the process to step S205 .

[0057] In step S205, the system control unit 115 executes flicker detection processing. The system control unit 115 detects the flicker frequency appearing in the image and stores it in the system memory 113. Then, the system control unit 115 starts measuring the time T until the next flicker detection processing is started, and advances the processing to step S206.

[0058] In step S206 , the system control unit 115 accesses the system memory 113 , increments the total number of times α that the flicker detection process has been executed (α→α+1), and advances the process to step S207 .

[0059] In step S207, the system control unit 115 accesses the system memory 113 to determine whether the total number of times α that the flicker detection process has been executed is two or more times. In a case where the system control unit 115 determines that the total number of times α that the flicker detection process has been executed is less than two times, the system control unit 115 returns the process to step S203, and in a case where the system control unit 115 determines that the total number of times α that the flicker detection process has been executed is two or more times, the system control unit 115 advances the process to step S208.

[0060] In step S208, the system control unit 115 determines whether the time T that has elapsed between the completion of the previous flicker detection process and the start of the current flicker detection process is less than a predetermined time. The predetermined time T0 is, for example, 30 seconds. In the case where the system control unit 115 determines that the time T that has elapsed from the completion of the previous flicker detection process to the start of the current flicker detection process is less than or equal to the predetermined time, the system control unit 115 advances the process to step S209, and in the case where the system control unit 115 determines that the time T is greater than the predetermined time, the system control unit 115 returns the process to step S203.

[0061] In step S209, the system control unit 115 accesses the system memory 113 to determine whether the flicker frequency detected by the previous flicker detection process and the flicker frequency detected by the current flicker detection process have a first relationship. The first relationship is a case where the rate of change of the flicker frequency detected by the current flicker detection process relative to the flicker frequency detected by the previous flicker detection process is less than a predetermined value. The rate of change of the flicker frequency detected by the current flicker detection process relative to the flicker frequency detected by the previous flicker detection process is the ratio of the flicker frequency detected by the current flicker detection process relative to the flicker frequency detected by the previous flicker detection process. The rate of change of the flicker frequency detected by the current flicker detection process relative to the flicker frequency detected by the previous flicker detection process is calculated as the ratio of the difference between the flicker frequency detected by the current flicker detection process and the flicker frequency detected by the previous flicker detection process. In the present embodiment, the predetermined value is a fixed value of 5% in consideration of the error that may occur due to the accuracy of the flicker detection process. This value can be changed according to the detection accuracy because the detection accuracy can be improved by increasing the number of flicker frequency detection times. When the system control unit 115 determines that the rate of change of the flicker frequency detected by the current flicker detection processing relative to the flicker frequency detected by the previous flicker detection processing is less than a predetermined value, the system control unit 115 causes the processing to enter step S210, and when the system control unit 115 determines that the rate of change of the flicker frequency detected by the current flicker detection processing relative to the flicker frequency detected by the previous flicker detection processing is greater than a predetermined value, the system control unit 115 causes the processing to return to step S203.

[0062] In step S210 , the system control unit 115 accesses the system memory 113 , increments the number of times β that the flicker detection process has been re-executed (β→β+1), and advances the process to step S211 .

[0063] In step S211, the system control unit 115 accesses the system memory 113 to determine whether the number of times β that the flicker detection process has been re-executed is not less than the predetermined number of times β0. The predetermined number of times β0 is, for example, three times. In a case where the system control unit 115 determines that the number of times β that the flicker detection process has been re-executed is not less than the predetermined number of times β0, the system control unit 115 advances the process to step S212, and in a case where the system control unit 115 determines that the number of times β that the flicker detection process has been re-executed is less than the predetermined number of times β0, the system control unit 115 returns the process to step S203.

[0064] In step S212, the system control unit 115 determines that a detection result capable of reducing the streaks appearing in the image is not obtained even after executing the flicker detection processing a plurality of times. The detection result capable of reducing the streaks appearing in the image is a flicker frequency suitable for reducing the streaks appearing in the image and a flicker frequency that enables a shutter speed for reducing the streaks appearing in the image due to the flicker to be obtained. Then, the system control unit 115 performs a process of presenting a solution to the user and terminates the process. The system control unit 115 notifies the user by displaying a solution for the case where a flicker frequency suitable for reducing the streaks appearing in the image due to the flicker cannot be detected on the display unit 106.

[0065] FIG. 4A to FIG. 8 The present embodiment shows an appearance in which a solution to a case where a flicker frequency suitable for reducing streaks that appear in an image due to flicker cannot be detected is presented to the user. This embodiment will describe an example in which the display unit 106 notifies the user of a solution to change the posture of the imaging device 100 relative to the detection object (the posture of the image sensor relative to the detection object) as information related to the imaging method of the object to be detected. The above-mentioned examples may be appropriately combined. FIG. 4A to FIG. 4C , Figure 5 , FIG. 6A to FIG. 6C , Figure 7 and Figure 8 The presentation method in .

[0066] There are two types of light source lighting methods used in displays: a batch lighting method in which multiple light sources are turned on at the same timing; and a sequential lighting method in which multiple light sources are turned on sequentially in the vertical or horizontal direction. The image sensor's imaging method includes a global shutter method, in which the entire screen is exposed (scanned) at the same timing, and a rolling shutter method, in which blocks of several rows are sequentially exposed in the vertical or horizontal direction.

[0067] In the case of using a rolling shutter method to capture images of a display whose light source turns on and off in a sequential lighting method, there may be a case where the flicker frequency cannot be accurately detected due to interference between the exposure timing and the timing of turning on and off of the display. In this case, the present embodiment notifies the user of a solution of rotating the orientation of the image sensor by 90 degrees (rotating it from horizontal to vertical) relative to the subject to be detected when the flicker frequency suitable for reducing the stripes appearing in the image cannot be detected due to the relationship between the flickering direction of the flickering light source and the imaging direction (scanning direction) of the image sensor.

[0068] FIG. 4A to FIG. 4C shows how the solution will look like when presented with messages. FIG. 4A to FIG. 4C In the example of FIG. 1 , a message is displayed on the display unit 106 to guide the user to rotate the imaging apparatus 100 by 90 degrees to perform flicker detection processing. The system control unit 115 reads the message from the nonvolatile memory 114 and displays it on the display unit 106. The content of the message is not limited to FIG. 4A to FIG. 4C , and any content may be used as long as the user can be guided to rotate the imaging apparatus 100 90 degrees and perform flicker detection processing.

[0069] In addition, FIG. 4A to FIG. 4C In the example of , the difference between the angle when the previous flicker detection process was performed in the imaging apparatus 100 and the angle when the message was displayed is displayed on the display unit 106. The system control unit 115 reads the angle of the imaging apparatus 100 from the system memory 113, calculates the difference between the angle when the previous flicker detection process was performed and the angle when the message was displayed, and displays it on the display unit 106. Figure 4A Screen 401 in FIG. 4 shows a message display notifying the user that the camera has not been rotated from the angle at which the previous flicker detection process was performed. Figure 4B Screen 402 in FIG. 4 shows a message display notifying the user that the user has rotated the camera angle by 10 degrees. The angle information may be anything as long as the difference between the angle at the time of the previous flicker detection processing and the angle at the time of the message display can be notified. In the case where the system control unit 115 determines that the difference between the angles is within a predetermined range, such as Figure 4CAs shown in the screen 403 in FIG. 1 , the system control unit 115 changes the color of the message notifying the angle information and displays it on the display unit 106. For example, the predetermined range is not less than 70 degrees and not more than 110 degrees. Note that the notification method is not limited to Figure 4C As shown in the example of screen 403 in FIG. 1 , any notification method may be applied as long as the user can be notified that the angle difference is within a predetermined range.

[0070] Figure 5 shows what the solution will look like through animation. Figure 5 In the example of , an animation is displayed on the display unit 106 to guide the user to rotate the posture of the camera 100 90 degrees to perform flicker detection processing. The system control unit 115 reads the animation from the non-volatile memory 114 and displays it on the display unit 106. The animation transitions in the order of image 501, image 502, image 503, and image 504. The transition of image 501, image 502, and image 503 indicates that the camera 100 has rotated 90 degrees. In addition, image 504 indicates the execution status of the user operation to start the flicker detection processing. In this animation, the camera 100 is rotated to the right, but it can also be rotated to the left. The content of the animation is not limited to Figure 5 , and any content may be used as long as the user can be guided to rotate the imaging apparatus 100 90 degrees and perform flicker detection processing.

[0071] FIG. 6A to FIG. 6C shows what the solution looks like through OSD presentation. FIG. 6A to FIG. 6C In the example of , a part of the OSD displayed on the display unit 106 is rotated 90 degrees to guide the user to rotate the posture of the imaging apparatus 100 90 degrees to perform flicker detection processing. The system control unit 115 reads the OSD from the nonvolatile memory 114, rotates it 90 degrees, and displays it on the display unit 106. An image 601 indicates a live view displayed on the display unit 106. A bar 602 superimposed on the live view is a slide bar that accepts a user operation to adjust the shutter speed. A button 603 is a button that accepts a user operation to start flicker detection processing. Fig. 6A Screen 604 in FIG. 1 shows a display state before a solution is presented to the user. In the case where the system control unit 115 determines that it is necessary to present a solution to the user, such as Figure 6B In the picture 605 or Figure 6C As shown in the screen 606 in FIG. 1 , the bar 602 and button 603 as part of the GUI are rotated 90 degrees. The display status can be changed from Figure 6B Screen 605 or Figure 6C The screen 606 changes to Fig. 6AAlthough this example shows the bar 602 and button 603 rotating as part of the OSD, other OSDs may also rotate.

[0072] Figure 7 shows how the solution will look like when presented as an icon. Figure 7 In the example of , an icon is displayed on the display unit 106 to guide the user to rotate the posture of the camera 100 by 90 degrees to perform flicker detection processing. The system control unit 115 reads the icon from the nonvolatile memory 114 and displays it on the display unit 106. Image 701 indicates the live view displayed on the display unit 106. Icon 702 is an icon indicating that the camera 100 is to be rotated by 90 degrees. In the case where the system control unit 115 determines that it is necessary to present a solution to the user, the icon 702 is displayed on the display unit 106. The shape of the icon is not limited to Figure 7 The shape is not the example in the figure, but may be any shape as long as it can guide the user to rotate the imaging apparatus 100 90 degrees to perform flicker detection processing.

[0073] Figure 8 shows how the solution looks like when presented through an external device. Figure 8 In the example of , the camera apparatus 100 is connected to an external device 801 such as a smartphone to enable communication with the external device 801 through the communication unit 112, and a message is displayed on the display unit 802 of the external device 801 to guide the user to rotate the posture of the camera apparatus 100 by 90 degrees to perform flicker detection processing. When the system control unit 115 determines that it is necessary to present a solution to the user, the message and the display command are sent to the external device 801 through the communication unit 112. The external device 801 displays the message on the display unit 802 of the external device 801 according to the display command received from the camera apparatus 100. The content of the message is not limited to Figure 8 , and any content may be used as long as the user can be guided to rotate the imaging apparatus 100 90 degrees and perform flicker detection processing.

[0074] 9A to 9C Shows how to cancel solution presentation. Fig.9A A state is shown in which a message is displayed on the display unit 106 to guide the user to rotate the imaging apparatus 100 90 degrees to perform flicker detection processing. Fig. 9B The imaging device 100 is shown Fig.9A The state in is rotated 90 degrees to the right. Fig. 9C The imaging device 100 is shown Fig.9A The system control unit 115 determines that the imaging device 100 has been rotated 90 degrees to the left. Fig.9A The status shown changes to Fig. 9Bor Fig. 9C In the case of the status shown, the system control unit 115 cancels the Fig.9A Message 901 is displayed in the state shown. FIG. 10A to FIG. 10D As described in, the content of the message can guide the user to increase the imaging range of the object to be detected and perform flicker detection processing. Although the example of canceling the message is explained in the present embodiment, the object to be canceled is not limited to the message.

[0075] FIG. 10A to FIG. 10D A first appearance is shown presenting a situation suitable for flicker detection processing. FIG. 10A to FIG. 10D In the example of FIG. 1 , when the user rotates the imaging apparatus 100 by 90 degrees and a part of the subject 1001 to be detected is not in the imaging angle of view, a message is displayed on the display unit 106 to guide the user to increase the imaging range of the subject 1001 and perform flicker detection processing. A message is displayed on the display unit 106 to guide the user to increase the imaging range of the subject 1001 and perform flicker detection processing. Fig. 10A The state in which the imaging apparatus 100 is imaging a subject 1001 to be detected is shown. Fig. 10B A state is shown in which a message 1002 is displayed on the display unit 106 to guide the user to rotate the imaging apparatus 100 by 90 degrees to perform flicker detection processing while the imaging apparatus 100 is imaging a subject 1001 to be detected. Fig. 10C The imaging device 100 is shown Fig. 10B The state in the image is rotated 90 degrees. Message 1003 guides the user to perform flicker detection processing by increasing the camera range so that all the objects 1001 to be detected are included in the viewing angle. Fig. 10C As shown, when the imaging range of the object 1001 to be detected is small, the flicker frequency suitable for reducing the stripes appearing in the image due to flicker cannot be detected. In this case, the user presented with the message 1003 can Fig. 10D As shown, the imaging range of the object 1001 to be detected is increased and an image is captured to detect a flicker frequency suitable for reducing the stripes appearing in the image. The content of the message is not limited to FIG. 10A to FIG. 10D The example in , and any content can be used as long as it can guide the user to increase the imaging range of the subject 1001 to be detected and perform flicker detection processing. In addition, although an example of a notification message is described in this embodiment, the appearance presented is not limited to the message.

[0076] Fig.11 A second appearance is shown presenting a situation suitable for flicker detection processing. Fig.111 shows a case where, in a case where the imaging apparatus 100 cannot be rotated due to being fixed to the outside or other reasons, a message is displayed on the display unit 106 to guide the user to rotate the subject to be detected by 90 degrees for flicker detection processing. In this case, the user notifies the system control unit 115 via the operation unit 109 or the like whether the imaging apparatus 100 can be rotated. In a case where the system control unit 115 determines that the imaging apparatus 100 cannot be rotated based on the user operation and it is necessary to present a solution to the user, the system control unit 115 guides the user to rotate the subject to be detected being photographed by the imaging apparatus 100 by 90 degrees for flicker detection processing through the message displayed on the display unit 106. Although an example of a notification message is described in the present embodiment, the appearance of presentation is not limited to a message.

[0077] Fig.12 1 and 2 show directions in which the posture of the imaging apparatus 100 can be changed. Fig.12 As shown in FIG. 1 , three orthogonal vertical axes, horizontal axes, and front-rear axes centered on the camera 100 are a pitch axis 1201, a yaw axis 1202, and a roll axis 1203. In this embodiment, it is assumed that the camera 100 rotates relative to the roll axis 1203 as indicated by an arrow 1204. In the arrow 1204, the rotation is clockwise, but it may also be counterclockwise.

[0078] According to the first embodiment described above, in the case where the flicker detection process has been executed more than a predetermined number of times because a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected, a solution can be presented to the user.

[0079] Second embodiment

[0080] Next, refer to Figure 3 The control process according to the second embodiment is described.

[0081] In the second embodiment, a solution is presented to the user according to the number of executions of the flicker detection process based on the difference between the angle of the camera (image sensor) in the Nth (N is a natural number greater than 2) flicker detection process and the angle of the camera (image sensor) in the N-1th flicker detection process. A solution is presented to the user.

[0082] The angle of the camera (image sensor) is Fig.12 The arrow 1204 in FIG. 1 shows the horizontal or vertical rotation angle of the camera device around the roll axis 1203 .

[0083] The following describes control processing in a case where the Nth time (N is a natural number greater than or equal to 2) is this time and the N-1th time is the previous time.

[0084] Figure 3 1 is a flowchart showing control processing for presenting a solution to a user when the flicker detection processing cannot detect a flicker frequency at which a shutter speed for reducing streaks appearing in an image can be obtained even after the flicker detection processing is performed a plurality of times.

[0085] The configuration of the imaging apparatus in the second embodiment is similar to that in the first embodiment. Figure 1 The method of presenting the appearance of a solution to the user and canceling the presentation of the solution when the flicker frequency suitable for reducing the stripes appearing in the image due to the flicker cannot be detected is the same as that of the first embodiment. FIG. 4A to FIG. 11 Same as in.

[0086] The processing of steps S301 to S304 is similar to that of the first embodiment. Figure 2 The processing of steps S201 to S204 in is similar.

[0087] In step S305 , the system control unit 115 detects the angle of the imaging apparatus 100 by the posture detection unit 110 , stores it in the system memory 113 , and advances the process to step S306 .

[0088] The processing of steps S306 to S309 is similar to that of the first embodiment. Figure 2 The processing of steps S205 to S208 in is similar.

[0089] In step S310, the system control unit 115 accesses the system memory 113 to determine whether the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process have a second relationship. The second relationship is a case where the difference between the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process is less than a predetermined angle. The predetermined angle is, for example, 30 degrees. In a case where the system control unit 115 determines that the difference between the angle of the imaging device 100 in the current flicker detection process and the angle of the imaging device 100 in the previous flicker detection process is less than the predetermined angle, the system control unit 115 causes the process to proceed to step S311. In a case where the system control unit 115 determines that the difference between the angles is greater than the predetermined angle, the system control unit 115 causes the process to return to step S303.

[0090] The processing of steps S311 to S313 is similar to that of the first embodiment. Figure 2 The processing of steps S210 to S212 in is similar.

[0091] According to the second embodiment described above, in the case where the flicker detection process has been executed more than a predetermined number of times because a flicker frequency suitable for reducing stripes appearing in an image due to flicker cannot be detected, a solution can be presented to the user.

[0092] Other embodiments

[0093] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0094] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A camera device, comprising: A camera unit that captures an image of a subject; a detection unit that performs flicker detection processing on the image; as well as a control unit that presents information related to an imaging method of a subject so that the flicker detection process obtains a predetermined result, Wherein, in the case where the flicker detection process cannot obtain the predetermined result or the flicker detection process has been executed a number of times greater than a predetermined number of times, the control unit presents the information.

2. The imaging device according to claim 1, wherein: When the flicker frequency detected by the Nth flicker detection process and the flicker frequency detected by the N-1th flicker detection process have a predetermined relationship, and the flicker detection process has been executed a number of times greater than or equal to the predetermined number, the control unit presents the information, where N is a natural number greater than or equal to 2.

3. The imaging device according to claim 2, wherein: The predetermined relationship is a first relationship in which a rate of change of a flicker frequency detected by an Nth flicker detection process relative to a flicker frequency detected by an N-1th flicker detection process is less than a predetermined value.

4. The imaging device according to claim 3, wherein: The control unit presents the information when the time from the completion of the N-1th flicker detection processing to the start of the Nth flicker detection processing is less than the predetermined time, and when the rate of change of the flicker frequency has the first relationship and the number of times the flicker detection processing has been executed is greater than the predetermined number of times.

5. The imaging device according to claim 1, wherein: The information is presented when there is a predetermined relationship between the difference between the angle of the imaging device relative to the subject in the Nth flicker detection process and the angle of the imaging device relative to the subject in the N-1th flicker detection process, and when the flicker detection process has been executed a number of times greater than or equal to the predetermined number, where N is a natural number greater than or equal to 2.

6. The imaging device according to claim 5, wherein: The predetermined relationship is a second relationship in which a difference between an angle of the imaging device relative to the subject in the Nth flicker detection process and an angle of the imaging device relative to the subject in the N-1th flicker detection process is less than a predetermined angle.

7. The imaging device according to claim 6, wherein: The control unit presents the information when the time from the completion of the N-1th flicker detection processing to the start of the Nth flicker detection processing is less than the predetermined time, and when the difference between the angles of the camera devices has the second relationship and the flicker detection processing has been executed more than the predetermined number of times.

8. The imaging device according to claim 1, wherein: The control unit cancels presentation of the information in a case where the imaging method of the object has been changed according to the presented information.

9. The imaging device according to claim 1, wherein: The control unit presents information for guiding a user to increase an imaging range of the object in a case where the imaging method of the object has been changed according to the presented information.

10. The imaging device according to claim 1, wherein The predetermined result is an imaging parameter of the imaging device for reducing streaks that appear in the image due to flicker detected by the flicker detection process, and The information is a solution to the situation where the flicker detection process cannot obtain the imaging parameters.

11. The imaging device according to claim 10, wherein: The imaging method of the subject is the posture of the imaging device when capturing an image of the subject, and The information is information for guiding the user to rotate the posture of the imaging apparatus by a predetermined angle relative to the object to execute the flicker detection process.

12. The imaging device according to any one of claims 1 to 11, wherein: The information is displayed on a display of the imaging device as at least one of a message, an animation, and an icon.

13. The imaging device according to any one of claims 1 to 11, wherein: The information is displayed on an external device connected to the imaging device to be able to communicate with the imaging device.

14. The imaging device according to any one of claims 1 to 11, wherein: The information includes information indicating a difference between an angle taken at the posture of the imaging apparatus in a previous flicker detection process and an angle taken at the current posture of the imaging apparatus.

15. The imaging device according to any one of claims 1 to 11, wherein: The information includes a notification that a difference between an angle at which the posture of the imaging apparatus in a previous flicker detection process is adopted and an angle at which the current posture of the imaging apparatus is adopted is within a predetermined range.

16. The imaging device according to claim 1, wherein The imaging method of the subject is the posture of the imaging device when capturing an image of the subject, In a case where the posture of the imaging apparatus cannot be changed, the control unit presents information for changing the posture of the object so that the flicker detection process can obtain the predetermined result.

17. The imaging device according to any one of claims 1 to 11, wherein: The subject is a display having a light source that repeatedly turns on and off in a predetermined cycle.

18. A control method for an imaging device, the imaging device comprising an imaging unit for capturing an image of a subject and a detection unit for performing flicker detection processing on the image, the control method comprising the following steps: presenting information related to the imaging method of the subject so that the flicker detection process obtains a predetermined result, Wherein, in the case where the flicker detection process cannot obtain the predetermined result or the flicker detection process has been executed more than a predetermined number of times, the presenting step presents the information.

19. A computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 18.

20. A program product comprising a program for causing a computer to execute the control method according to claim 18.

Images