Imaging device

Abstract

To provide an imaging device that can more intuitively communicate the status of multiple cameras to the user. [Solution] When the evaluation value of the shooting state corresponding to one or all of the functions of AF, AE, motion vector, horizontal state, AWB, and flicker is higher or lower than a threshold, the notification means that notifies the shooting state corresponding to that evaluation value is listed as a candidate for change, and the notification means listed as a candidate for change is changed to a notification means with a higher priority.

Description

Technical Field

[0001] The present invention relates to an imaging device that notifies the shooting state.

Background Art

[0002] Conventionally, a technology for notifying a user from a camera by vibration has been known. In Patent Document 1, a technology is disclosed in which a camera holding a vibration unit conveys the shooting state to the user by the amplitude, frequency, and time of vibration in a situation where the situation of a subject cannot be visually recognized on a display unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a need for a technology that can convey the shooting state to the user more intuitively.

[0005] An object of the present invention is to provide an imaging device that can convey the shooting state to the user more intuitively.

Means for Solving the Problems

[0006] Evaluation value acquisition means for acquiring an evaluation value of a shooting state corresponding to any one or all of functions of AF, AE, motion vector, horizontal state, AWB, and flicker from the data acquired by a sensor, and when the evaluation value acquired by the evaluation value acquisition means is higher or lower than a certain threshold value, a notification means that notifies the shooting state corresponding to the evaluation value is listed as a change candidate, and the notification means listed as the change candidate is configured to be changed to a notification means with a higher priority.

Effects of the Invention

[0007] This invention can communicate the shooting status to the user more intuitively. [Brief explanation of the drawing]

[0008] [Figure 1] Hardware configuration diagrams of imaging devices in Examples 1 and 3 [Figure 2] Processing flow diagram of the imaging device in Example 1 [Figure 3] Hardware configuration diagram of the imaging device in Example 2 [Figure 4] Processing flow diagram of the imaging device in Example 2 [Figure 5] Processing flow diagram of the imaging device in Example 3 [Modes for carrying out the invention]

[0009] Examples of the application of the present invention are described below.

[0010] <Example 1> An example of an imaging device to which the present invention is applied will be described.

[0011] Figure 1 shows the hardware configuration of an imaging device that realizes the present invention.

[0012] The imaging sensor 101 is a CCD image sensor or a CMOS image sensor, which converts light from the subject into an electrical signal to obtain image data.

[0013] The developing unit 102 performs processing such as displaying the image captured by the imaging sensor 101 on the display unit 127.

[0014] The recording unit 103 is a storage element such as an SD card or flash memory, and records the recorded image processed by the developing unit 102.

[0015] The AF evaluation value acquisition unit 104 acquires information necessary for AF (autofocus) control, such as contrast and phase difference, from the image captured by the image sensor 101.

[0016] The AF control unit 105 performs AF control of the imaging device 1 based on the information acquired by the AF evaluation value acquisition unit 104.

[0017] The AE evaluation value acquisition unit 106 acquires evaluation values necessary for AE (auto exposure) control from the image captured by the imaging sensor 101.

[0018] The AE control unit 107 performs AE control of the imaging device 1 based on the evaluation values acquired by the AE evaluation value acquisition unit 106.

[0019] The motion vector acquisition unit 108 acquires the motion vector of the subject from the image captured by the imaging sensor 101.

[0020] The subject blur evaluation value acquisition unit 109 acquires an evaluation value of the blur amount of the subject based on the motion vector acquired by the motion vector acquisition unit 108.

[0021] The horizontal position evaluation value acquisition unit 110 acquires an evaluation value of how much the imaging device 1 is tilted from the horizontal position based on the image captured by the imaging sensor 101 and the tilt of the imaging device 1 acquired by the gyro sensor 111.

[0022] The gyro sensor 111 acquires the tilt of the imaging device 1.

[0023] The AWB evaluation value acquisition unit 112 acquires evaluation values necessary for AWB (auto white balance) control from the image captured by the imaging sensor 101.

[0024] The AWB control unit 113 performs AWB control based on the evaluation values acquired by the AWB evaluation value acquisition unit 112.

[0025] The flicker evaluation value acquisition unit 114 acquires an evaluation value of how much flicker is present from the image captured by the imaging sensor 101. The evaluation values acquired by the AF evaluation value acquisition unit 104, the AE evaluation value acquisition unit 106, the subject blur evaluation value acquisition unit 109, the horizontal position evaluation value acquisition unit 110, the AWB evaluation value acquisition unit 112, and the flicker evaluation value acquisition unit 114 are collectively referred to as internal evaluation values.

[0026] The audio input unit 115 acquires ambient sounds and wind noises from around the imaging device 1.

[0027] The temperature input unit 116 acquires the ambient temperature around the imaging device 1.

[0028] The external status acquisition unit 117 recognizes the type of sound acquired from the audio input unit 115 and quantifies the volume of each type of sound. It also quantifies the temperature acquired from the temperature input unit 116. Furthermore, based on the optical information of the lens of the imaging device 1 received from the system control unit 119, it quantifies the degree to which the optical system of the imaging device 1 is zoomed in. Each evaluation value quantified by the external status acquisition unit 117 is called an external evaluation value.

[0029] The notification means selection unit 118 selects, from the evaluation values ​​acquired by each of the aforementioned evaluation means, which shooting state of each function of the imaging device 1 will be notified by which notification means, such as vibration, temperature, sound, or display. Here, each evaluation means is, for example, the AF evaluation value acquisition unit 104, the AE evaluation value acquisition unit 106, the subject blur evaluation value acquisition unit 109, the horizontal position evaluation value acquisition unit 110, the AWB evaluation value acquisition unit 112, and the flicker evaluation value acquisition unit 114. Here, the shooting state is, for example, the focus state, exposure state, subject blur state, tilt, white balance, flicker occurrence state, etc. Furthermore, the external situation acquisition unit 117 selects, from the evaluation values ​​of each external situation quantified, which notification means will have its usage frequency reduced.

[0030] The system control unit 119 sends optical information of the lens of the imaging device 1 to the external status acquisition unit 117. It also sends threshold values ​​for determining whether each evaluation value is appropriate or inappropriate to the notification means selection unit 118.

[0031] The vibration control unit 120 controls the vibration unit 121 according to the selection result of the notification means selection unit 118. The vibration unit 121 vibrates under the control of the vibration control unit 120 and notifies the user of the shooting status.

[0032] The temperature control unit 122 controls the temperature output unit 123 according to the selection result of the notification means selection unit 118.

[0033] The temperature output unit 123 notifies the user of the shooting status by changing the temperature under the control of the temperature control unit 122.

[0034] The voice control unit 124 controls the voice output unit 125 according to the selection result of the notification means selection unit 118.

[0035] The audio output unit 125 emits sound under the control of the audio control unit 124 to notify the user of the shooting status.

[0036] The display control unit 126 controls the display unit 127 according to the selection result of the notification means selection unit 118.

[0037] The display unit 127 displays images processed by the development unit 102, and also displays information on the screen under the control of the display control unit 126, and notifies the user of the shooting status.

[0038] Hardware used to notify the user of the imaging status of the imaging device 1 through the five senses, such as vibration, temperature, sound, and display (represented by symbols 120-127), is called notification means. Hardware that notifies the imaging status through smell or taste may be added to the notification means.

[0039] The user instruction acquisition unit 128 is hardware such as buttons or joysticks attached to the imaging device itself, or remote devices located away from the imaging device, and acquires instructions from the user through the operation of these devices.

[0040] Figure 2 shows the processing flow diagram for Example 1. This processing flow starts when the user turns on the power to the imaging device 1.

[0041] In step S201, the notification means selection unit 118 sets which notification means will notify which shooting state, according to a pre-configured assignment. Each notification means will notify only one shooting state.

[0042] In step S202, the external status acquisition unit 117 acquires external evaluation values ​​from the audio, sound, and optical system information of the surroundings of the imaging device 1 acquired from the audio input unit 115, the temperature input unit 116, and the system control unit 119.

[0043] In step S203, the notification means selection unit 118 compares the evaluation value of how much the optical system is zoomed in, acquired by the external situation acquisition unit 117, with a preset threshold to determine whether or not it is zoomed in. If it is determined that it is zoomed in, the unit proceeds to step S204; otherwise, it proceeds to step S205.

[0044] In step S204, the notification means selection unit 118 reduces the frequency of use of the vibration unit 121.

[0045] In step S205, the notification means selection unit 118 increases the frequency of use of the vibration unit 121.

[0046] In step S206, the notification means selection unit 118 determines whether the ambient brightness evaluation value acquired by the external situation acquisition unit 117 is lower than a preset threshold. If it is determined to be lower, the unit proceeds to step S207; otherwise, it proceeds to step S208.

[0047] In step S207, the notification means selection unit 118 reduces the frequency of use of the vibration unit 121.

[0048] In step S208, the notification means selection unit 118 increases the frequency of use of the vibration unit 121.

[0049] In step S209, the notification means selection unit 118 determines whether the evaluation value of the ambient sound level acquired by the external situation acquisition unit 117 is greater than or equal to a preset threshold. If it is determined to be greater, the process proceeds to step S210; otherwise, it proceeds to step S211.

[0050] In step S210, the notification means selection unit 118 reduces the frequency of use of the audio output unit 125.

[0051] In step S211, the notification means selection unit 118 increases the frequency of use of the audio output unit 125.

[0052] In step S212, the notification means selection unit 118 determines whether the ambient temperature evaluation value acquired by the external conditions acquisition unit 117 is higher or lower than a preset threshold. If it is determined to be higher or lower, the unit proceeds to step S213; otherwise, it proceeds to step S214.

[0053] In step S213, the notification means selection unit 118 reduces the frequency of use of the temperature output unit 123.

[0054] In step S214, the notification means selection unit 118 increases the frequency of use of the temperature output unit 123.

[0055] In step S215, the AF evaluation value acquisition unit 104, AE evaluation value acquisition unit 106, subject blur evaluation value acquisition unit 109, horizontal position evaluation value acquisition unit 110, AWB evaluation value acquisition unit 112, and flicker evaluation value acquisition unit 114 each acquire internal evaluation values.

[0056] In step S216, the notification means selection unit 118 compares the evaluation value acquired by the AF evaluation value acquisition unit 104 with a preset threshold to determine whether or not the camera is out of focus. If the camera remains out of focus for a certain period of time or longer, the process proceeds to step S217; otherwise, the process proceeds to step S218.

[0057] In step S217, the notification means selection unit 118 determines that it is necessary to change the notification means currently notifying the focus status to another notification means, and adds the focus status to the list of notification means change candidates.

[0058] In step S218, the notification means selection unit 118 compares the evaluation value acquired by the AE evaluation value acquisition unit 106 with a preset threshold to determine whether the exposure is over or under. If the over or under exposure condition persists for a certain period of time or longer, the process proceeds to step S219; otherwise, it proceeds to step S220.

[0059] In step S219, the notification means selection unit 118 determines that it is necessary to change the notification means currently notifying the exposure status to another notification means, and adds the exposure status to the list of candidates for notification means change.

[0060] In step S220, the notification means selection unit 118 compares the evaluation value acquired by the subject blur evaluation value acquisition unit 109 with a preset threshold to determine whether subject blur has occurred. If the subject blur condition persists for a certain period of time or longer, the process proceeds to step S221; otherwise, the process proceeds to step S222.

[0061] In step S221, the notification means selection unit 118 determines that it is necessary to change the notification means currently notifying the subject blur state to another notification means, and adds the subject blur state to the list of candidates for notification means change.

[0062] In step S222, the notification means selection unit 118 compares the evaluation value acquired by the horizontal position evaluation value acquisition unit 110 with a preset threshold to determine whether it is tilted from the horizontal state. If the tilted state from the horizontal state continues for a certain period of time or longer, the unit proceeds to step S223; otherwise, it proceeds to step S224.

[0063] In step S223, the notification means selection unit 118 determines that it is necessary to change the notification means currently notifying the tilt state to another notification means, and adds the tilt state to the list of candidates for notification means change.

[0064] In step S224, if the notification means selection unit 118 has identified only one shooting state as a candidate for changing the notification means up to this step, proceed to step S225; otherwise, proceed to step S226.

[0065] In step S225, the notification means selection unit 118 changes the notification means for the shooting status that it has listed as a candidate for change to a different notification means. One example of a method of change is to rank the notification means and change to the notification means with the next highest rank after the current notification means. For example, if the notification means are set in order of highest rank as display, sound, temperature, and vibration, and the notification means for the shooting status that is listed as a candidate for change is temperature, then the notification means for that shooting status will be changed to sound. If the notification means for the shooting status that was originally sound will be changed to the temperature notification means. If there is a notification means whose usage frequency has been reduced by any of steps S204, S207, S210, or S213, the notification means for the shooting status that is listed as a candidate for change will not be changed to the notification means whose usage frequency has been reduced, but will be changed to a different notification means. To explain using the example of ranking the notification means mentioned above, suppose the target of the notification means for the shooting status that is listed as a candidate for change is sound. However, if the frequency of voice usage decreases due to step S210, the notification method will be changed from voice to a higher-priority display. The notification method for the shooting status, which was originally a display, will be changed to a temperature notification method.

[0066] In step S226, the notification means for the multiple candidate shooting states are changed according to a predetermined priority order. The priority order can be determined by setting the order in advance, or by assigning a higher priority to each shooting state the further its evaluation value is from the threshold used to determine that state. For example, suppose the candidate shooting states for changing the notification means are in focus, subject blur, and tilt. If the priority order of these shooting states is subject blur, in focus, and tilt, then the notification means for subject blur will be changed first. After that, the notification means for the in-focus state and then the tilt state will be changed in that order. The method for changing the notification means is the same as in step S225.

[0067] In step S227, based on the results of the changes to the notification means for each shooting state, the notification means selection unit 118 sends a command to the vibration control unit 120, temperature control unit 122, sound control unit 124, and display control unit 126 to perform notification control for the shooting state assigned to them. Upon receiving the command, the vibration control unit 120, temperature control unit 122, sound control unit 124, and display control unit 126 control the vibration unit 121, temperature output unit 123, sound output unit 125, and display unit 127, respectively, to provide notification for the shooting state assigned to them.

[0068] In step S228, if the user performs the operation to end shooting, this process flow ends. Otherwise, it returns to step S202.

[0069] <Example 2> An imaging device according to Embodiment 2 of the present invention will now be described. Figure 3 shows the hardware configuration of the imaging device 3 that realizes the present invention. Hardware with the same reference numerals as in Figure 1 is the same as the hardware that constitutes the imaging device 1 of Embodiment 1. Embodiment 2 differs from Embodiment 1 in that it does not have an audio input unit 115, a temperature input unit 116, or an external condition acquisition unit 117.

[0070] Figure 4 shows the processing flow diagram for Example 2. The next step in this processing flow is the same as the next step in Figure 2 of Example 1.

[0071] Steps S401, S402, S403, S404, S405, S406, S407, S408, S409, S410, S412, S413, S414, S415 of this processing flow • S201, S215, S216, S217, S218, S219, S220, S221, S222, S223, S224, S225, S226, S227 of Example 1 In other words, this processing flow differs from the processing flow in Figure 2 of Example 1 in that it does not have the following step in Figure 2 of Example 1, namely the acquisition of external evaluation values ​​and the configuration to change the frequency of use of each notification means based on the external evaluation values.

[0072] <Example 3> Another embodiment of an imaging device to which the present invention is applied will be described. The hardware configuration of Embodiment 3 of the imaging device realizing the present invention is shown in Figure 1 and is the same as that of Embodiment 1.

[0073] Figure 5 shows the processing flow diagram for Example 3. The next step in this processing flow is the same as the next step in Figure 2 of Example 1.

[0074] Steps S501, S502, S503, S504, S505, S506, S507, S508, S509, S510, S512, S513, S514, S515 Step S201, S201, S203, S204, S205, S206, S207, S208, S209, S210, S211, S212, S213, S214, S215 The following explanation will focus on the differences between the processing flow in Example 1 and that shown in Figure 2.

[0075] In step S516, the notification means for each shooting state is changed according to the usage frequency of each notification means set in steps S504, S505, S507, S508, S510, S511, S513, and S514. One example of a method of changing the means is to assign the most frequently used notification means to the shooting state with the highest priority. For example, suppose the shooting states are prioritized in the following order: focus, exposure, motion blur, and tilt, and the notification means are used in the following order in the following order: display, temperature, sound, and vibration. In this case, the notification means are changed so that focus is indicated by a display, exposure by temperature, motion blur by sound, and tilt by vibration.

[0076] You can pre-determine the priority of shooting conditions in user settings or similar configurations.

[0077] If there are multiple notification methods whose usage frequency has been increased, the usage frequency of the method that is further from the threshold after normalizing the evaluation values ​​used to determine which method to increase in usage frequency will be increased.

[0078] If there are multiple notification methods whose usage frequency has been reduced, the usage frequency of the one that is further from the threshold after normalizing the evaluation value used to determine which method to reduce usage frequency will be reduced.

[0079] In step S517, based on the results of the changes to the notification means for each shooting state, the notification means selection unit 118 sends a command to the vibration control unit 120, temperature control unit 122, sound control unit 124, and display control unit 126 to perform notification control for the shooting state assigned to them. Upon receiving the command, the vibration control unit 120, temperature control unit 122, sound control unit 124, and display control unit 126 control the vibration unit 121, temperature output unit 123, sound output unit 125, and display unit 127, respectively, to provide notification for the shooting state assigned to them.

[0080] In step S518, if the user performs the operation to end the shooting process, this process flow ends. Otherwise, the process returns to step S502.

[0081] <Other examples> The operation described using the flowchart in the above embodiment can be modified in the order of the steps to achieve the same objective.

[0082] The present invention can also be realized by performing the following process: that is, software (program) that realizes the functions of the above-described embodiment is supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage medium storing the program constitute the present invention.

[0083] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist. [Explanation of symbols]

[0084] 1. Imaging device 101 Imaging sensor 118 Notification means selection unit

Claims

1. An evaluation value acquisition means that acquires evaluation values ​​of the shooting state corresponding to one or all of the functions of AF, AE, motion vector, horizontal state, AWB, and flicker from the data acquired by the sensor, When the evaluation value acquired by the evaluation value acquisition means is higher or lower than a threshold, the notification means that notifies the shooting state corresponding to that evaluation value is listed as a candidate for change, and the notification means listed as a candidate for change is changed to a notification means with a higher priority.

2. The imaging apparatus according to claim 1, characterized in that the selection means changes a notification means listed as a candidate for change to a notification means with a higher priority according to the priority order of a plurality of notification means.

3. The imaging apparatus according to claim 1, characterized in that the selection means sets a higher priority for the corresponding shooting state the further away the value is from the threshold value of the evaluation value acquired by the plurality of evaluation value acquisition means.

4. The imaging device according to claim 1, characterized in that, when there are multiple candidate notification means, the selection means changes the notification means that notifies the shooting state in order from the shooting state with the highest priority according to the priority of the shooting states.

5. The imaging device according to claim 1, characterized in that the notification means notifies the user of the shooting status by any or all of the following: vibration, temperature, sound, display, smell, taste.

6. The imaging device according to claim 1, characterized in that the selection means selects which notification means to assign to each shooting state according to the external evaluation value acquired by the external status acquisition means.

7. The imaging device according to claim 6, characterized in that the external condition acquisition means acquires evaluation values ​​of any or all of the outside temperature, ambient sound, and optical information of the lens.

8. The imaging apparatus according to claim 7, characterized in that the selection means lowers the priority of the corresponding notification means when the external evaluation value acquired by the plurality of external status acquisition means is higher or lower than a certain threshold.

9. The imaging apparatus according to claim 7, characterized in that the selection means sets a lower priority for the corresponding notification means the further the external evaluation value acquired by the plurality of external status acquisition means is from a certain threshold.

Images