Imaging apparatus, control method thereof, and storage medium

Abstract

Provided is an imaging device, a control method thereof, and a storage medium. An imaging device includes: an imaging unit configured to capture an image of a subject; a search unit configured to search for a subject that is an imaging target of the imaging unit; and a reception unit configured to receive a change instruction for changing the imaging target from a subject currently being captured by the imaging unit without specifying a change target subject, wherein the search unit searches for another subject in a case where the change instruction is received.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an imaging device capable of automatically capturing an image of a subject. BACKGROUND

[0002] In recent years, a life log camera that repeatedly captures images on a regular basis and an imaging device that automatically captures an image of a surrounding have been proposed. Such an imaging device aims to capture an image of a scene desired by a user by automatically capturing an image of a subject without the user being aware of it. Japanese Patent Application Publication No. 2019-117375 discusses an imaging device capable of capturing an image of a subject by automatically performing a pan driving and a tilt driving.

[0003] However, the imaging device discussed in Japanese Patent Application Publication No. 2019-117375 automatically performs a pan driving and a tilt driving, and thus does not necessarily capture an image of a subject desired by a user. SUMMARY

[0004] An imaging device includes an imaging unit configured to capture an image of a subject, a search unit configured to search for a subject as an imaging target to be captured by the imaging unit, and a reception unit configured to receive a change instruction for changing the imaging target from a subject currently being captured by the imaging unit without specifying a target imaging target to be changed, wherein, in a case where the change instruction is received, the search unit searches for another subject.

[0005] A control method of an imaging device, the control method including: capturing an image of a subject; searching for a subject as an imaging target to be captured in the capturing; receiving a change instruction for changing the imaging target without specifying a target imaging target to be changed; and in a case where the change instruction is received, searching for another subject.

[0006] A non-transitory storage medium storing a program for causing an imaging device to execute a control method, the control method including: capturing an image of a subject; searching for a subject as an imaging target to be captured in the capturing; receiving a change instruction for changing the imaging target without specifying a target imaging target to be changed; and in a case where the change instruction is received, searching for another subject.

[0007] Further features of the present disclosure will become apparent from the following description of example embodiments with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0008] Figure 1A An example appearance of an imaging device according to a first example embodiment is shown, and Figure 1A An operation of an imaging device according to the first example embodiment is shown.

[0009] Figure 2 A configuration of an imaging device according to the first example embodiment is shown.

[0010] Figure 3 A configuration of a communication system including the imaging device and an external device according to the first example embodiment is shown.

[0011] Figure 4 A configuration of the external device according to the first example embodiment is shown.

[0012] Figure 5 is a flowchart showing an automatic imaging processing according to the first example embodiment.

[0013] Figures 6A to 6D A region division in a captured image according to the first example embodiment is shown.

[0014] Figure 7 is a flowchart showing a voice recognition processing according to the first example embodiment.

[0015] Figure 8 is a flowchart showing a subject change processing according to the first example embodiment.

[0016] Figure 9 is a flowchart showing a processing for determining an initial position of a subject search processing according to the first example embodiment.

[0017] Figure 10 is a flowchart showing an imaging processing after the subject change according to the first example embodiment.

[0018] Figure 11 is a flowchart showing a subject change processing according to the second example embodiment.

[0019] Figure 12 is a flowchart showing a subject change processing according to the third example embodiment. DETAILED DESCRIPTION

[0020] Example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0021] The following example embodiments are considered to be illustrative examples for implementing the present disclosure, and can be corrected or modified as needed in accordance with the configuration of the device according to the present disclosure and other various conditions. The example embodiments can be appropriately combined.

[0022] <Configuration of Imaging Device>

[0023] The first example embodiment will be described. Figure 1A and 1BA configuration of an image pickup apparatus according to a first example embodiment is shown.

[0024] Figure 1A The illustrated image pickup apparatus 101 is provided with an operation member including a power switch capable of turning on and off a power supply. The operation member includes a touch panel.

[0025] The lens barrel 102 is a housing including an optical lens group and an image sensor. The lens barrel 102 is attached to the image pickup apparatus 101. The tilt rotation unit 104 and the pan rotation unit 105 are rotation mechanisms capable of rotationally driving the lens barrel 102 with respect to the fixed unit 103. The tilt rotation unit 104 is, for example, a motor capable of rotating the lens barrel 102 in the tilt direction Figure 1B The pan rotation unit 105 is, for example, a motor capable of rotating the lens barrel 102 in the pan direction Figure 1B The pan rotation unit 105 is, for example, a motor capable of rotating the lens barrel 102 in the pan direction Figure 1B The Y axis is a rotation axis of the pan rotation unit 105. According to the present example embodiment, Figure 1B The positive direction of the Z axis is a front direction of the image pickup apparatus 101.

[0026] The angular velocity meter 106 and the acceleration meter 107 are, for example, a gyro sensor and an acceleration sensor, respectively, and are arranged on the fixed unit 103 of the image pickup apparatus 101. The image pickup apparatus 101 detects a vibration of the image pickup apparatus 101 based on a velocity measured by the angular velocity meter 106 and the acceleration meter 107. By rotationally driving the tilt rotation unit 104 and the pan rotation unit 105 based on the detected vibration of the image pickup apparatus 101, the image pickup apparatus 101 generates an image corrected for a shake and a tilt of the lens barrel 102.

[0027] Figure 2 is a block diagram showing a configuration of the image pickup apparatus 101 according to the present example embodiment.

[0028] The first control unit 223 includes a processor (for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, and a micro processing unit (MPU)) and a memory (for example, a dynamic random access memory (DRAM) and a static random access memory (SRAM)). The first control unit 223 performs various processes to control the respective blocks of the image pickup apparatus 101 and control data transmission between the blocks. The first control unit 223 is an example of a control unit and a determination unit.

[0029] The nonvolatile memory 216, which is a data recordable and erasable memory, stores constants and programs used for the operation of the first control unit 223.

[0030] The zoom unit 201 is an optical lens group including a zoom lens that performs zoom magnification. The zoom drive control unit 202 is a control unit that controls the drive of the optical lens of the zoom unit 201. The focus unit 203 is an optical lens group that performs focus adjustment.

[0031] The focus drive control unit 204 controls the drive of the optical lens of the focus unit 203. In the imaging unit 206, an image sensor receives incident light through each optical lens group and outputs information related to a charge corresponding to the amount of light as analog image data to the image processing unit 207. The zoom unit 201, the zoom drive control unit 202, the focus unit 203, the focus drive control unit 204, and the imaging unit 206 are included in the lens barrel 102.

[0032] The image processing unit 207 performs distortion correction, white balance adjustment, color interpolation processing, and other image processing on the image data input from the imaging unit 206 and outputs digital image data. The image recording unit 208 converts the digital image data output from the image processing unit 207 into an image file format such as a Joint Photographic Experts Group (JPEG) format and a moving image file format such as a Moving Picture Experts Group (MPEG) format. The digital image data thus generated is sent to the memory 215 and the video output unit 217 (described below). In the case where the digital image data recorded in the memory 215 is recorded to the recording medium 221, the first control unit 223 outputs the digital image data to the recording / reproducing unit 220.

[0033] The lens barrel rotation drive unit 205 drives the tilt rotation unit 104 and the pan rotation unit 105 to drive the lens barrel 102 in the tilt direction and the pan direction, respectively. The lens barrel rotation drive unit 205 is an example of a drive unit.

[0034] The device shake detection unit 209 includes, for example, an angular velocity meter 106 for detecting the angular velocity in the 3-axis direction of the imaging device 101 and an accelerometer 107 for detecting the acceleration in the 3-axis direction of the imaging device 101. The device shake detection unit 209 calculates the rotation angle and the offset amount of the imaging device 101 on the basis of the signals detected by the angular velocity meter 106 and the accelerometer 107.

[0035] The audio input unit 213 having a plurality of microphones performs analog-digital (AD) conversion on the audio signals input from the microphones and outputs the digital signals thus generated to the audio processing unit 214.

[0036] The audio processing unit 214 can detect a sound direction on a plane on which a plurality of microphones are installed. The detected sound direction can be used for search and automatic photographing (described below). The audio processing unit 214 can further detect a specific audio command. The present exemplary embodiment uses two different specific audio commands: a trigger word and a command word. The trigger word is a command that functions as a trigger for starting recognition of the command word. For example, the trigger word is a command that includes a specific keyword such as "OK, camera" spoken by a user. The command word is a command for instructing the imaging device 101 to perform predetermined processing. Examples of the predetermined processing include still image capturing processing, moving image capturing start processing, moving image capturing end processing, sleep processing, subject change processing, and automatic photographing processing. The command word includes different keywords for each processing, such as "capture still image" for still image capturing processing and "capture moving image" for moving image capturing start processing. These audio commands are pre-recorded in the memory 215 of the imaging device 101. The imaging device 101 can be configured to register, in addition to the pre-recorded audio commands, an audio command issued by a user for performing arbitrary processing.

[0037] The audio processing unit 214 performs optimization processing, encoding processing, and other audio processing on the input audio signal. The audio signal processed by the audio processing unit 214 is sent by the first control unit 223 to the memory 215. The memory 215 temporarily records data input from the image recording unit 208 and the audio signal input from the audio processing unit 214. In the case where the audio signal is recorded, the first control unit 223 outputs the audio signal from the memory 215 to the recording / reproducing unit 220.

[0038] The recording / reproducing unit 220 records image data, audio signals, and other imaging-related control data to a recording medium 221. The recording medium 221 can be a recording medium built in the imaging device 101 or a removable recording medium. The recording medium 221 can record image data, audio signals, and other various types of data. According to the present exemplary embodiment, the recording medium 221 has a larger capacity than the nonvolatile memory 216. For example, the recording medium 221 includes a hard disk, an optical disk, a magneto-optical disk, a recordable compact disk (CD-R), a recordable digital versatile disk (DVD-R), a magnetic tape, a nonvolatile semiconductor memory, a flash memory.

[0039] The recording / reproducing unit 220 can read (reproduce) image data, audio signals, various data, and programs recorded in the recording medium 221. In the case of reproducing image data and audio signals recorded in the recording medium 221, the first control unit 223 operates as follows. The first control unit 223 outputs the image data and audio signals read by the recording / reproducing unit 220 to the image processing unit 207 and the audio processing unit 214, respectively. The image processing unit 207 and the audio processing unit 214 decode the image data and the audio signals, respectively. The image processing unit 207 and the audio processing unit 214 output the decoded signals to the video output unit 217 and the audio output unit 218, respectively.

[0040] The second control unit 211 controls power to be supplied to the first control unit 223. For example, the second control unit 211 includes a processor (e.g., a CPU, a microprocessor, and a micro processing unit (MPU)) and a memory (e.g., a DRAM and an SRAM). According to the present exemplary embodiment, the second control unit 211 is provided separately from the first control unit 223 that controls the entire main system of the image pickup apparatus 101.

[0041] The first power supply unit 210 and the second power supply unit 212 supply power to operate the first control unit 223 and the second control unit 211, respectively. According to the present exemplary embodiment, the power supplied by the first power supply unit 210 is greater than the power supplied by the second power supply unit 212. According to the present exemplary embodiment, the first power supply unit 210 and the second power supply unit 212 are selected in accordance with the power to be supplied. For example, the first power supply unit 210 is a switch for supplying power to the first control unit 223. The second power supply unit 212 is a lithium battery or an alkaline dry battery. When a power switch on the image pickup apparatus 101 is pressed, power is supplied to the second control unit 211, and then power is supplied to the first control unit 223. The first control unit 223 can control the first power supply unit 210 to turn off the supplied power to the first control unit 223. Even when power is not supplied to the first control unit 223, the second control unit 211 operates to acquire information from the device shake detection unit 209 and the audio processing unit 214. The second control unit judges whether or not to activate the first control unit 223 based on such input information. In the case where the second control unit 211 judges to activate the first control unit 223, the second control unit 211 controls the first power supply unit 210 to supply power to the first control unit 223. According to the present exemplary embodiment, the first power supply unit 210 and the second power supply unit 212 supply power from a battery. More specifically, the image pickup apparatus 101 is also a portable terminal.

[0042] The audio output unit 218 outputs an audio signal such as an electronic shutter sound from a speaker built in the image pickup apparatus 101 at the time of image pickup. The light emitting diode (LED) control unit 224 controls an LED on the image pickup apparatus 101 to be lit or blinked in a preset pattern at the time of image pickup.

[0043] The video output unit 217 includes, for example, a video output terminal, and outputs an image signal for video display to an external display connected thereto. The audio output unit 218 and the video output unit 217 can be an interface of one integrated terminal such as a terminal similar to a terminal or the like.

[0044] The communication unit 222 is an interface that performs communication between the image pickup apparatus 101 and an external device. More specifically, the communication unit 222 transmits and receives data such as an audio signal and image data. In a case where the communication unit 222 receives a control signal such as image pickup start, image pickup end, pan driving, tilt driving, and zoom driving related to image pickup, the first control unit 223 drives the image pickup apparatus 101 in accordance with the received control signal. The communication unit 222 includes a wireless communication module. Examples of the wireless communication module include an infrared communication module, a communication module, a wireless local area network (LAN) communication module, a wireless universal serial bus (USB), and a global positioning system (GPS) receiver.

[0045] The subject detection unit 225 reads image data output from the image processing unit 207 from the memory 215, and performs subject recognition of a person and an object. For example, in order to recognize a person, the subject detection unit 225 detects a face of a subject. A pattern for subject face judgment is registered in advance in the image pickup apparatus 101. The pattern is given an identifier for distinguishing each subject. In the subject face detection process, the subject detection unit 225 detects a face of a subject by detecting a position coinciding with the pattern for judging a face of a subject included in a captured image. The subject detection unit 225 can distinguish each person among a plurality of registered persons.

[0046] The subject detection unit 225 also simultaneously calculates reliability indicating a probability with respect to the detected face of the subject. For example, the reliability is calculated on the basis of the size of a face region in an image and coincidence with a face pattern. The subject detection unit 225 performs pattern matching on a face of a subject in an image to detect face information including whether a detected face is smiling, whether eyes are open, and a face orientation. The method for detecting face information is not limited to pattern matching. Known technologies including use of deep learning are applicable. The subject detection unit 225 is an example of a detection unit.

[0047] In the object recognition processing, the subject detection unit 225 judges whether the subject coincides with a pattern registered in advance to recognize the object. In addition, the subject detection unit 225 can recognize the object by extracting a feature amount of the subject using a histogram of a tone or a saturation in the captured image.

[0048] The above-described method enables the first control unit 223 to detect the subject based on the captured image data via the subject detection unit 225.

[0049] <Configuration of system with external device>

[0050] Figure 3 An example of a wireless communication system including an image pickup device 101 and a smart device 301 is shown. The image pickup device 101 is, for example, a digital still camera. The smart device 301 is, for example, a smartphone including a Bluetooth communication module and a wireless LAN communication module.

[0051] According to the present exemplary embodiment, the image pickup device 101 and the smart device 301 can communicate with each other via two different communication paths. One is a communication path 302 based on a wireless LAN conforming to the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard series, and the other is a communication path 303 such as Bluetooth Low Energy based on a master-slave relationship between a master and a slave. The wireless LAN and the Bluetooth Low Energy are examples of communication methods. A case where each communication device has at least two different communication functions is assumed. For example, if one communication function based on a relationship between a master and a slave can control another communication function, other communication methods can be used. Without loss of generality, it is assumed that first communication such as a wireless LAN is capable of communicating at a higher communication rate than second communication such as Bluetooth Low Energy, and at least one of the second communication has lower power consumption and a shorter communication distance than the first communication.

[0052] <Configuration of external device>

[0053] The configuration of the smart device 301 as an example of an external communication device will be described below with reference to Figure 4 The smart device 301 is a smartphone or a mobile phone. In other words, the smart device 301 is a portable terminal.

[0054] The smart device 301 includes, for example, a wireless LAN control unit 401 for wireless LAN communication, a Bluetooth Low Energy control unit 402 for Bluetooth Low Energy communication, and a public line control unit 406 for public wireless communication. The smart device 301 also includes a packet transmission / reception unit 403.

[0055] The wireless LAN control unit 401 performs radio frequency (RF) control, communication processing, and various controls for wireless LAN communication conforming to the IEEE 802.11 standard series, for example. The wireless LAN control unit 401 also performs protocol processing related to wireless LAN communication. The Bluetooth low energy control unit 402 performs RF control, communication processing, and various controls for Bluetooth low energy communication. The Bluetooth low energy control unit 402 also performs protocol processing related to Bluetooth low energy communication. The public line control unit 406 performs RF control, communication processing, and various controls for public wireless communication. The public line control unit 406 also performs protocol processing related to public wireless communication. The public wireless communication conforms to, for example, the International Multimedia Telecommunication (IMT) standard and the Long Term Evolution (LTE) standard. The packet transmission / reception unit 403 performs processing for performing at least one of packet transmission and packet reception related to wireless LAN communication, Bluetooth low energy communication, and public wireless communication. The following will describe the present exemplary embodiment on the premise that the smart device 301 performs at least one of packet transmission and packet reception in communication. However, a communication format other than packet switching, such as line switching, is also applicable.

[0056] The smart device 301 according to the present exemplary embodiment also includes a control unit 411, a recording unit 404, a GPS reception unit 405, a display unit 407, an operation unit 408, an audio input / audio processing unit 409, and a power supply unit 410. The control unit 411 controls the entire smart device 301 by executing, for example, a program recorded in the recording unit 404. The recording unit 404 records, for example, a program to be executed by the control unit 411, parameters required for communication, and other various information. In a case where the control unit 411 executes a program recorded in the recording unit 404, various operations of the smart device 301 (described below) are realized.

[0057] The power supply unit 410 supplies electric power to each unit of the smart device 301. The display unit 407 has a function of outputting information that can be visually recognized by using a liquid crystal display (LCD) and an LED and outputting sound from a speaker, and displays and outputs various information. The operation unit 408 includes, for example, a button for receiving a user's operation of the smart device 301. The display unit 407 and the operation unit 408 can be configured by a common member such as a touch panel.

[0058] The audio input / audio processing unit 409 includes, for example, a microphone, and performs voice recognition processing on an audio signal input from the microphone. The audio input / audio processing unit 409 can recognize a user's operation on the imaging device 101 by voice recognition. In the voice recognition processing, the audio input / audio processing unit 409 recognizes an audio command spoken by the user based on an audio signal input from the microphone by using a dedicated application. The smart device 301 can register the audio command for instructing the audio processing unit 214 of the imaging device 101 to perform a specific processing to the imaging device 101 via the communication path 302.

[0059] The GPS 405 analyzes a GPS signal received from a satellite to estimate a current position (longitude and latitude information) of the smart device 301. In a case where the estimated current position is within a preset range (within a predetermined radial range) such as a home, the smart device 301 notifies the imaging device 101 of information on the current position via the Bluetooth low energy control unit 402. The imaging device 101 can use the current position as a parameter for automatic imaging and automatic editing (as described below).

[0060] If the current position changes or deviates from the preset range, the smart device 301 notifies the imaging device 101 of movement information via the Bluetooth low energy control unit 402. The imaging device 101 can use the movement information as a parameter for automatic imaging and automatic editing. The smart device 301 can estimate the current position of the smart device 301 based on information on a wireless network present around by using a Wi-Fi positioning system (WPS).

[0061] As described above, the smart device 301 exchanges data with the imaging device 101 in communication via the wireless LAN control unit 401 and the Bluetooth low energy control unit 402. For example, the imaging device 101 and the smart device 301 transmit and receive data such as an audio signal and image data. The smart device 301 can also transmit setting information related to imaging of the imaging device 101 to the imaging device 101. The smart device 301 can also transmit position information and a control signal related to the imaging processing of the imaging device 101 to the imaging device 101.

[0062] <Automatic imaging processing>

[0063] The automatic imaging processing refers to processing performed by the first control unit 223 to judge an imaging timing and automatically capture an image of a subject. In the automatic imaging processing, the first control unit 223 repeats a sequence of automatically capturing an image of a subject in a case where it is judged that a preferable still or moving image can be captured, or in a case where a certain period of time has elapsed. This function enables the imaging device 101 to capture a preferable scene and an unintentional change of a subject that is unexpected during a routine operation even if the user does not manually perform imaging.

[0064] Figure 5 is a flowchart illustrating the automatic imaging processing of the imaging device 101 according to the present exemplary embodiment.

[0065] When the user turns on the power switch of the imaging device 101, the processing of the flowchart starts. According to the present exemplary embodiment, a wireless connection is established between the imaging device 101 and the smart device 301. The user can perform various operations on the imaging device 101 through a dedicated application on the smart device 301. When the first control unit 223 controls the respective units of the imaging device 101, the processing of each step in the following flowchart is implemented.

[0066] In step S501, the first control unit 223 judges whether or not the automatic imaging processing is stopped. The deactivation of the automatic imaging processing will be described below in the description of the voice recognition processing (described below). If the automatic imaging processing is stopped (YES in step S501), the first control unit 223 waits until the deactivation of the automatic imaging processing is released. More specifically, if the automatic imaging processing is stopped, the processing in step S501 is repeated until the deactivation of the automatic imaging processing is released. On the other hand, if the automatic imaging processing is not stopped (NO in step S501), the processing proceeds to step S502.

[0067] In step S502, the first control unit 223 instructs the image processing unit 207 to perform image processing on a signal captured by the imaging unit 206 to generate an image for subject recognition. The first control unit 223 also controls the subject detection unit 225 to perform subject recognition such as person recognition and animal recognition based on the generated image for subject recognition. For example, in performing the subject recognition, the first control unit 223 prestores a pattern for judging a subject, and judges the subject based on coincidence between the prestored pattern and a pattern included in the image for subject recognition via the subject detection unit 225. The first control unit 223 judges the subject and detects a position of the subject in a field of view.

[0068] In step S503, the first control unit 223 calculates an image blur correction amount. More specifically, the first control unit 223 calculates an absolute angle of the imaging device 101 based on the angular velocity and acceleration information acquired by the device blur detection unit 209. Then, the first control unit 223 obtains an image stabilization angle for moving the pitch rotation unit 104 and the pan rotation unit 105 in the direction of the angle for canceling the absolute angle, and recognizes this image stabilization angle as the image blur correction amount.

[0069] In step S504, the first control unit 223 performs subject search processing. The subject search processing includes the following processing:

[0070] (1) Region division

[0071] Region division will be described below with reference to Figures 6A to 6C to Figures 6A to 6C Region division is performed on a sphere with the position of the imaging device 101 as the origin O. With reference to the example in Figure 6A , the regions are divided at intervals of 22.5 degrees in the pitch and pan directions.

[0072] In the case where region division is performed as shown in Figure 6A , as the pitch angle increases from 0 degrees, the circumference in the horizontal direction and the area of one region decrease. Therefore, as shown in Figure 6B , in the case where the pitch angle is 45 degrees or more, the imaging device 101 according to the present exemplary embodiment sets the region range in the horizontal direction to an angle larger than 22.5 degrees.

[0073] Region in the field of view angle of an image captured by the imaging device 101 will be described below with reference to Figure 6C and 6D The axis 1301 represents a reference direction of the imaging direction of the imaging device 101, and region division is performed with reference to this reference direction. The axis 1301 is, for example, the imaging direction when the imaging device 101 is activated or a direction predetermined as a reference direction of the imaging direction. The region 1302 is a field of view angle region of an image captured by the imaging unit 206. Figure 6D An example of live view captured by the imaging unit 206 in the region 1302 is shown. In the field of view angle of the live view in Figure 6D , the image region is divided into regions 1303 to 1318 based on the region division shown in Figure 6C .

[0074] (2) Calculation of importance level for each region

[0075] The imaging device 101 calculates the importance level indicating the priority in the subject search according to the state of the subject existing in the region and the scene state of the region for each divided region as described above. For example, the importance level according to the subject state is calculated based on the number of subjects existing in the region, the face size of the subject, the face orientation of the subject, the probability of face detection of the subject, the facial expression of the subject, and the person recognition result of the subject. The importance level according to the scene state is calculated based on the general object recognition result, the scene judgment result such as a blue sky, backlight, and evening landscape, the sound level and voice recognition result of sound from the direction of the region, and the movement detection information in the region, for example.

[0076] For example, if the face of the subject is registered, the first control unit 223 increases the importance level of the region in which the face of the registered subject is detected. For example, the face of the subject is recorded in the nonvolatile memory 216 as a pattern for judging the subject. In a case where the importance level of the region in which the face of the subject is detected is increased, when a predetermined period of time elapses or when a predetermined number of images are captured, the first control unit 223 returns the importance level of the region to the previous importance level.

[0077] (3) Determination of search region

[0078] The first control unit 223 determines the importance level for each region as described above, and then determines to selectively perform the subject search in the region having a high importance level. Then, the first control unit 223 calculates the pan angle and tilt angle required to capture an image of one of the regions having a high importance level.

[0079] In step S505, the first control unit 223 performs pan driving and tilt driving. More specifically, the first control unit 223 calculates a pan driving amount and a tilt driving amount based on the image blur correction amount calculated in step S504 and the pan angle and the tilt angle. Then, the first control unit 223 controls the driving of the pan rotation unit 105 and the tilt rotation unit 104 via the lens barrel rotation driving unit 205 based on the calculated pan driving amount and tilt driving amount, respectively. According to the present exemplary embodiment, the first control unit 223 detects the subject in the region having a high importance level in step S505, and starts the subject imaging by driving.

[0080] In step S506, the first control unit 223 controls the zoom unit 201 to perform zoom driving. For example, the first control unit 223 drives the zoom according to the state of the subject on which imaging is started in step S505. For example, if the face of the subject is imaged in the field angle with a very small size, the first control unit 223 controls the zoom unit 201 to perform zoom in the telephoto direction so that the face of the subject is imaged in the field angle with a suitable size (larger). On the other hand, if the face of the subject is imaged in the field angle with a very large size, the first control unit 223 controls the zoom unit 201 to perform zoom in the wide-angle direction so that the face of the subject is imaged in the field angle with a suitable size (smaller). Performing zoom control in this way makes it possible to maintain a state suitable for tracking the subject.

[0081] Although in steps S504 to S506, the above-described method performs subject search by pan, tilt, and zoom driving, it is also possible to perform subject search by using an imaging system that performs imaging in all directions at once using a plurality of wide-angle lenses. In this case, the entire processing load is too great to use all signals obtained by imaging in all directions as input images to perform image processing such as subject detection. Therefore, in this case, the first control unit 223 is configured to crop a part of the images obtained by imaging in all directions, and then perform subject search processing within the range of the cropped images.

[0082] In this configuration, similarly to the above-described method, the first control unit 223 calculates the importance level for each region, changes the cropping position based on the importance level, and judges (as described below) automatic imaging.

[0083] This makes it possible to perform high-speed subject search while limiting the power consumption of image processing.

[0084] In step S507, the first control unit 223 judges whether to perform automatic imaging.

[0085] The judgment of whether to perform automatic imaging will be described below. The first control unit 223 judges whether to perform automatic imaging based on whether the imaging score exceeds a predetermined value. The imaging score is a parameter used to judge whether to perform automatic imaging. The score is added to the imaging score in accordance with the subject detection state and the passage of time. Assume that an example case is designed in which automatic imaging is performed when the imaging score exceeds 2000 points. In this case, the imaging score is initially 0 points, and from the timing at which the automatic imaging mode is entered, the score is added to the score as time passes. For example, the imaging score is increased at a rate such that the imaging score reaches 2000 points within 120 seconds. In this case, if 120 seconds elapse without detecting a subject, the score reaches 2000 points by the addition of points due to the passage of time, and imaging is performed. In a case in which a subject having a high priority is detected during the passage of time, 1000 points are added to the score. For example, a subject having a high priority is a subject among the subjects registered in the imaging device 101 that is set as an object to be preferentially photographed by the user. In a state in which a subject having a high priority is detected, the imaging score is more likely to reach 2000 points, and thus the frequency of imaging can increase.

[0086] For example, in a case in which a smile of a subject is recognized, 800 points are added to the score. Such smile-based addition of points is performed even for a subject that does not have a high priority. The present exemplary embodiment will be described below around an example case in which the score for the smile-based addition of points is the same regardless of whether the subject has a high priority. However, the present disclosure is not limited to this. For example, the score to be added when a smile of a subject having a high priority is detected can be higher than the score to be added when a smile of a subject that does not have a high priority is detected. The addition of points in this way makes it possible to perform imaging that is more in line with the user's intentions. In a case in which the score exceeds 2000 points due to the addition of points caused by changes in these facial expressions (emotions) of the subject, automatic imaging is performed. Even if the score does not exceed 2000 points by the addition of points caused by changes in facial expressions, the score reaches 2000 points within a short time by the addition of points due to the subsequent passage of time.

[0087] The score addition due to the passage of time will be described below with reference to an example case in which the score is added linearly over time, for example, the score reaches 2000 points within 120 seconds (i.e., 2000 / 120 points are added to the score per second). However, the present disclosure is not limited to this. As another example of the score addition method, the score is added to the score until the timing of 110 seconds out of 120 seconds, and it is possible that 200 points are added to the score per second in the subsequent 10 seconds (the timing from 110 seconds to 120 seconds). Increasing the imaging score in this way makes it possible to prevent the imaging score from reaching the imaging trigger score regardless of the priority due to the score addition caused by the facial expression change of the subject. In the score addition method for increasing the imaging score linearly over time, the score has already been added over a long period of time. Therefore, in this case, the subject having a low priority reaches the imaging trigger score even with the score addition due to the facial expression change to smile, and thus the degree of priority is relatively difficult to be reflected. On the other hand, in the case where the score addition due to the facial expression change is low, the timing of the facial expression change can be missed. Since this score addition method needs to be avoided, the score is added to the score until the timing of 110 seconds. With this score addition method, the score is added to the score of the subject having a low priority until the timing of 110 seconds. On the other hand, since 1000 points are added to the score when the subject having a high priority is detected, at least 1000 points are added to the score even if the score addition due to the passage of time is performed until the timing of 110 seconds.

[0088] In this way, in the case where the score addition due to the facial expression change is performed, the subject having a low priority is less likely to cause the score to reach the imaging trigger score compared to the subject having a high priority, thereby allowing the priority to function to a greater extent. Although the score addition due to the facial expression change has been described above as an example, the criteria for the score addition are not limited to this. Other examples of the criteria for the score addition include the timing at which the voice becomes louder and the timing at which the body language becomes larger. In order to allow the degree of priority to function with respect to these criteria, it is necessary to provide the above-described difference in the score addition method.

[0089] Even if the imaging score does not exceed 2000 points through the action of the subject, the imaging is performed at the timing of 120 seconds over time. This means that there is no possibility that the imaging is not performed at all within a certain period of time.

[0090] If a subject is detected during the bonus period, the timing at which the photographing score is started to be increased can be made to come earlier in 120 seconds. More specifically, for example, in a case where a subject with a high priority is detected at a timing of 60 seconds, 1000 points are added to the score, but the photographing score does not exceed 2000 points. However, in this case, the first control unit 223 can start to linearly increase the photographing score when 30 seconds have passed from the detection of the subject, instead of adding points until a timing of 110 seconds. Alternatively, the first control unit 223 can start to linearly increase the photographing score 20 seconds before the timing of 120 seconds, instead of 10 seconds before the timing of 120 seconds. Increasing the photographing score in this way increases the likelihood of photographing a subject with a high priority, making it easier to implement photographing in accordance with the user's intention.

[0091] When automatic photographing is performed, the photographing score is reset to 0 points. Automatic photographing is not performed until the photographing score exceeds 2000 points again.

[0092] The judgment of whether or not to perform automatic photographing is performed as described above. If the first control unit 223 judges to perform automatic photographing (Yes in step S507), the processing proceeds to step S508. On the other hand, if the first control unit 223 judges not to perform automatic photographing (No in step S507), the processing returns to step S501.

[0093] In step S508, the first control unit 223 performs photographing processing. The photographing processing includes, for example, still image photographing and moving image photographing.

[0094] The automatic photographing processing of the imaging device 101 according to the present exemplary embodiment has been described above. The above-described processing for automatically photographing an image of a subject enables the imaging device 101 to photograph a still or moving image of a scene desired by the user without a photographing instruction from the user.

[0095] <Voice recognition processing>

[0096] Figure 7 is a flowchart showing voice recognition processing of the imaging device 101 according to the present exemplary embodiment.

[0097] The processing of this flowchart is started when the audio input / audio processing unit 409 detects an audio signal input from a microphone. The processing of this flowchart is performed in parallel with the automatic photographing processing in Figure 5 The present exemplary embodiment will be described below centering on an example in which the automatic photographing processing in Figure 5 The processing of this flowchart is started when the audio input / audio processing unit 409 detects an audio signal input from a microphone during the performance of the automatic photographing processing in The processing is implemented when the first control unit 223 executes a program recorded in the nonvolatile memory 216.

[0098] In step S701, the first control unit 223 determines whether a trigger word has been detected. The trigger word refers to a start command for starting audio command recognition in which a specific audio instruction is given to the video recording device 101. In a case where the user gives an audio instruction to the video recording device 101, the user speaks a command word after the trigger word to instruct the video recording device 101 to recognize the command word. In a case where the trigger word is detected (YES in step S701), the processing proceeds to step S702. On the other hand, in a case where the trigger word is not detected (NO in step S701), the first control unit 223 repeats the processing in step S701 until the trigger word is detected.

[0099] In step S702, the first control unit 223 stops the automatic video recording processing. According to the present exemplary embodiment, in a case where the first control unit 223 detects the trigger word, the first control unit 223 enters a command word waiting state and stops the automatic video recording processing. Stopping the automatic video recording processing refers to, for example, pausing the execution of the subject search or the video recording processing using the pan drive, the tilt drive, and the zoom drive. The purposes of stopping the automatic video recording include reducing the processing load and responding quickly to the command word instruction given by the user after the trigger word. The purposes of stopping the automatic video recording also include enabling the video recording to be performed in a direction desired by the user. For example, in a case where the user attempts to give a video recording instruction by using an audio instruction, it is assumed that the user speaks the trigger word at a timing at which the user desires the video recording. However, if the first control unit 223 does not stop the automatic video recording even after the video recording device 101 detects the trigger word, a certain cause is assumed. More specifically, by the time the command word after the trigger word, which is a video recording instruction, is received, the video recording direction of the video recording device 101 has changed from the video recording direction at the time of receiving the trigger word. More specifically, if the first control unit 223 does not stop the automatic video recording even when the trigger word is detected, it is difficult to perform the video recording in a direction according to the user's intention. Therefore, the video recording device 101 stops the pan drive and the tilt drive when the trigger word is detected. This enables the state in which the video recording device 101 is oriented in a direction desired by the user to be maintained.

[0100] In step S703, the first control unit 223 outputs a detection sound for notifying the user that the trigger word has been detected.

[0101] In step S704, the first control unit 223 determines whether a command word is detected after the trigger word. If the command word is detected (YES in step S704), the processing proceeds to step S706. On the other hand, if the command word is not detected (NO in step S704), the processing proceeds to step S705.

[0102] In step S705, the first control unit 223 determines whether or not a predetermined time has elapsed since the trigger word was detected and the command word standby mode was entered. If the predetermined time has elapsed (YES in step S705), the processing returns to step S701. In step S701, the first control unit 223 exits the command word standby state and enters the trigger word standby state. In this case, the first control unit 223 also restarts the automatic imaging processing. On the other hand, if the predetermined time has not elapsed (NO in step S705), the processing returns to step S704. In step S704, the first control unit 223 repeats the processing until the command word is detected.

[0103] In step S706, the first control unit 223 determines whether or not the detected command word is a still image capturing command. The still image capturing command is used to instruct the imaging device 101 to perform an imaging processing and a recording processing of a still image. In a case where the detected command is determined to be a still image capturing command (YES in step S706), the processing proceeds to step S707. On the other hand, in a case where the detected command is determined not to be a still image capturing command (NO in step S706), the processing proceeds to step S708.

[0104] In step S707, the first control unit 223 performs a still image capturing processing. More specifically, the image processing unit 207 converts a signal captured by the imaging unit 206 into a JPEG format, and the image recording unit 208 records the signal in the recording medium 221.

[0105] In step S708, the first control unit 223 determines whether or not the detected command word is an object change command. The object change command is, for example, the keyword "capture other person". In a case where the detected command is determined to be an object change command (YES in step S708), the processing proceeds to step S709. On the other hand, in a case where the detected command is determined not to be an object change command (NO in step S708), the processing proceeds to step S710.

[0106] In step S709, the first control unit 223 performs an object change processing. Immediately before this step is executed, the first control unit 223 is capturing an image of an object. The object change processing will be described in detail below.

[0107] In step S710, the first control unit 223 determines whether the detected command is a moving image recording start command. The moving image capturing command is a command for instructing the image pickup apparatus 101 to perform a moving image capturing process and a recording process. If the detected command is determined to be the moving image recording start command (YES in step S710), the process proceeds to step S711. On the other hand, if the detected command is determined not to be the moving image recording start command (NO in step S710), the process proceeds to step S712.

[0108] In step S711, the first control unit 223 starts moving image capturing by using the image pickup unit 206 and records the captured moving image data in the recording medium 221. During the moving image data recording, the first control unit 223 keeps maintaining the automatic image pickup stop state without performing the subject search.

[0109] In step S712, the first control unit 223 determines whether the detected command word is a moving image recording stop command. If the detected command is determined to be the moving image recording stop command (YES in step S712), the process proceeds to step S713. On the other hand, if the detected command is determined not to be the moving image recording stop command (NO in step S712), the process proceeds to step S714.

[0110] In step S713, the first control unit 223 stops the subject image pickup by the image pickup unit 206 and the moving image data recording to the recording medium 221 to complete the moving image data recording.

[0111] In step S714, the first control unit 223 performs a process corresponding to the other command word. For example, the first control unit 223 performs a process for a command word for instructing the image pickup apparatus 101 to perform pan driving and tilt driving in a user-specified direction, and a process for a command word for instructing the image pickup apparatus 101 to change various image pickup parameters such as exposure correction of the image pickup apparatus 101.

[0112] In steps S715 and S716, the first control unit 223 performs a process for restarting the automatic image pickup stopped in step S702. For example, the first control unit 223 performs a process from the process in step S502 Figure 5 of the flowchart illustrated in Fig. 7.

[0113] The voice recognition process of the image pickup apparatus 101 according to the present exemplary embodiment has been described.

[0114] The subject change process in step S709 in Fig. 7 will now be described. Figure 7

[0115] ​<Subject change processing>

[0116] Figure 8 is a flowchart illustrating subject change processing according to the present exemplary embodiment. The processing of each step in the flowchart is implemented when the first control unit 223 executes a program stored in the nonvolatile memory 216. The processing of each step in the following flowchart is implemented when the first control unit 223 controls each unit of the imaging device 101. The processing of this flowchart corresponds to the processing in step S709 of the flowchart in Figure 7

[0117] In step S801, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 to drive the imaging direction of the lens barrel 102 to a direction to be the initial position of the subject search. The processing for determining the direction to be the initial position of the subject search will be described below with reference to Figure 9 Figure 6C In step S802, when the imaging direction of the lens barrel 102 is directed toward the direction to be the initial position, the first control unit 223 starts the subject search. In the subject search, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 so that the imaging direction of the lens barrel 102 is directed toward a direction to be the end position of the subject search. In the description of this flowchart, the direction to be the end position is a direction produced by rotating the direction of the axis 1301 in

[0118] Figure 6C

[0119] In step S803, the first control unit 223 determines whether the subject detection unit 225 has detected a subject. If it is determined that a subject has been detected (YES in step S803), the processing proceeds to step S804. On the other hand, if it is determined that no subject has been detected (NO in step S803), the processing proceeds to step S811.

[0120] In step S804, the first control unit 223 suspends the subject search. For example, the first control unit 223 suspends the driving of the tilt rotation unit 104 and the pan rotation unit 105.

[0121] ​​​​In step S805, the first control unit 223 photographs the detected subject in step S803. The first control unit 223 records the photographed image data in the recording medium 221.

[0122] In step S806, the first control unit 223 acquires information about the photographed subject. Examples of the information about the subject include whether the face of the subject is registered in the imaging device 101, the priority of the subject, and the face of the subject.

[0123] In step S807, the first control unit 223 determines the importance score of the subject based on the information about the subject acquired in step S806. The importance score refers to a parameter used by the first control unit 223 to determine the subject to be photographed after the search for changing the subject is completed. The importance score is different from the importance level used to determine the search area. For example, a subject of a subject set by a user to have a high priority can be estimated as a subject the user wants to photograph. Therefore, the subject has a relatively high importance score. In contrast, a subject not registered in the imaging device 101 is not necessarily a subject the user wants to photograph. Therefore, the subject has a relatively low importance score. If a subject registered in the imaging device 101 has no priority setting, the subject has an intermediate importance score. More specifically, the first control unit 223 can determine a subject having a high importance score as a subject the user wants to photograph.

[0124] According to the present exemplary embodiment, the first control unit 223 determines the importance score of a subject having a facial expression to be higher than the importance score of a subject having an expressionless face. For example, the importance score of a subject having a smile is higher than the importance score of a subject having an expressionless face. For example, a crying face of a child can be an expression a parent of the child wants to photograph. Therefore, the first control unit 223 sets the importance score of a subject having a crying face to be higher than the importance score of a subject having an expressionless face.

[0125] According to the present exemplary embodiment, the first control unit 223 determines the importance score also based on the size of the eyes of the detected subject. For example, the first control unit 223 determines the importance score of a subject whose eyes are detected to be higher than the importance score of a subject whose eyes cannot be recognized due to the eyes being closed. For example, the first control unit 223 determines the importance score of a subject having eyes open to be higher than the importance score of a subject having relatively small detected eyes, such as half-open eyes. According to the present exemplary embodiment, in this way, the first control unit 223 determines the importance score based on the size of the eyes of the detected subject.

[0126] According to the present exemplary embodiment, the first control unit 223 determines the importance score based on the orientation of the subject's face as well. For example, the first control unit 223 determines the importance score of a subject whose front face is completely detected to be higher than that of a subject whose face is partially detected, such as a side face.

[0127] According to the present exemplary embodiment, the first control unit 223 determines the final importance score of the subject by calculating the sum of the importance scores of the information about the subject. According to the present exemplary embodiment, the first control unit 223 determines the importance score of a subject having a high priority to be higher than that of other subjects having no priority set. More specifically, in a case where a subject having a high priority and other subjects having no priority set are detected, the first control unit 223 determines the subject having a high priority to be the subject to be photographed after the subject change processing is completed.

[0128] In step S808, the first control unit 223 determines whether the importance score of the subject determined in step S807 is the highest importance score among the importance scores determined since the processing of the flowchart started. For example, the first control unit 223 determines whether the importance score is the highest importance score among the importance scores determined since the processing of the flowchart started. In a case where the importance score is determined to be the highest (YES in step S808), the processing proceeds to step S809. On the other hand, in a case where the importance score is determined not to be the highest (NO in step S808), the processing proceeds to step S810.

[0129] In step S809, the first control unit 223 records the imaging direction of the lens barrel 102 at the time when the subject determined to have the highest importance score in step S808 is detected. For example, the first control unit 223 records the angle of the tilt direction in the memory 215 as the imaging direction of the lens barrel 102. According to the present exemplary embodiment, the direction of the axis 1301 shown in Fig. 13 is recorded in the memory 215 as the initial value of the imaging direction of the lens barrel 102. The first control unit 223 also records the information about the subject together with the imaging direction of the lens barrel 102 in the memory 215. In a case where the imaging direction of the lens barrel 102 and the information about the subject have already been recorded, the first control unit 223 overwrites the imaging direction of the lens barrel 102 and the information about the subject. Figure 6C

[0130] In step S810, the first control unit 223 restarts the subject search. For example, the first control unit 223 restarts the driving of the tilt rotation unit 104 and the pan rotation unit 105.

[0131] ​In step S811, the first control unit 223 determines whether the subject search is completed. For example, the first control unit 223 determines whether the imaging direction of the lens barrel 102 is toward a direction to be the end position. In a case where the imaging direction is toward a direction to be the end position, the first control unit 223 determines that the subject search is completed. On the other hand, in a case where the imaging direction is not toward a direction to be the end position, the first control unit 223 determines that the subject search is not completed. If the subject search is determined to have been completed (Yes in step S811), the process proceeds to step S812. On the other hand, if the subject search is determined to have not been completed (No in step S811), the process returns to step S803. In step S803, the first control unit 223 continues the subject search. Since the end position is the same as the direction to be the initial position as described above in the description of step S802, the process of this step is the same as the process of determining whether the imaging direction of the lens barrel 102 has made one revolution since the start of the subject search. As described above in the description of step S805, in a case where a subject is detected during the subject search, the first control unit 223 captures an image of the detected subject and then records information about the subject. More specifically, in a case where it is determined that the subject search has been completed in this step, the first control unit 223 performs the subject search for the entire circumference to change the subject, captures images of each subject present around and records the images. This enables the imaging device 101 to capture an image of at least one subject that the user wishes to capture. The subject to be captured includes a person who issues a subject change instruction via the audio input. When the process in step S809 is repeated, information about a subject that is determined to have the highest importance score among the subjects appearing in the entire circumference is recorded in the memory 215.

[0132] In step S812, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 to capture an image of the subject that is determined to have the highest importance score. More specifically, the first control unit 223 controls the driving of these units so that the imaging direction of the lens barrel 102 is the imaging direction at the time when the subject that is determined to have the highest score in step S808 is detected. The first control unit 223 also determines the subject to be captured on the basis of the information about the subject that is last recorded in step S809. After the process in this step, the first control unit 223 performs a process for capturing an image of the subject. The process for capturing an image of the subject will be described below with reference to FIG. 8B. Figure 10

[0133] ​If the subject is not detected in the subject change processing, the first control unit 223 performs automatic imaging processing. If the subject is not detected in the subject change processing, it is assumed that there is no subject around the imaging device 101. At the same time, since the subject change instruction is issued by the user, it is assumed that the user wants the imaging device 101 to take an image of the subject.

[0134] Therefore, the first control unit 223 performs automatic imaging processing. If a new subject approaches the imaging device 101, the first control unit 223 immediately detects the subject and takes an image of the subject. This enables the first control unit 223 to shorten the period during which the subject is not taken and automatically perform imaging in accordance with the user's intention. If the subject is not detected in the subject change processing, the processing in step S809 is not performed. Therefore, the reference direction of the imaging device 101 recorded in the memory 215 is not overwritten. Therefore, in step S812, the imaging device 101 is oriented toward the reference direction of the imaging device 101. Then, after the imaging device 101 is oriented toward the reference direction of the imaging device 101, the first control unit 223 performs automatic imaging processing.

[0135] The subject change processing of the imaging device 101 according to the present exemplary embodiment has been described above.

[0136] In the subject change processing of the imaging device 101 according to the present exemplary embodiment, the imaging device 101 searches for a subject present around the imaging device 101. For example, even if the imaging device 101 is tracking a subject that the user does not want to take, the user can issue an instruction as a trigger to cancel the tracking and search for another subject.

[0137] The imaging device 101 also receives an instruction such as "take a picture of another person" or the like from the user without specifying the change target imaging object, and searches for another subject while maintaining the automatic imaging attribute. The user can simply instruct the imaging device 101 to take an image of a desired subject by issuing a subject change instruction, to eliminate the need to specify the position and name of the desired imaging object.

[0138] The first control unit 223 can perform the subject change processing when the subject change instruction is received from the smart device 301. In this case, when the user operates the dedicated application on the smart device 301, the smart device 301 sends a control signal for changing the subject to the imaging device 101. Then, the first control unit 223 starts the subject change processing when the control signal is received.

[0139] Although the first control unit 223 searches for the subject to change the subject over the entire circumference of the imaging device 101 in the present exemplary embodiment, the search range can be narrowed. For example, in a case where the imaging device 101 is installed in a corner of a room, the first control unit 223 can search for the subject in a range other than a range close to a wall of the room in the subject change processing. For example, in a case where the imaging range of the imaging device 101 is limited to 180 degrees, the first control unit 223 performs the subject search in a limited range in the subject change processing. Thus, the first control unit 223 can search for the subject based on the surrounding state of the imaging device 101 and the preset imaging range in the subject change processing.

[0140] Figure 9 is a flowchart illustrating processing for determining a direction used as an initial position of a subject search in the subject change processing according to the present exemplary embodiment. The processing of each step in the flowchart is implemented when the first control unit 223 executes a program stored in the nonvolatile memory 216. The processing of each step in the following flowchart is implemented when the first control unit 223 controls each unit of the imaging device 101. The processing of this flowchart corresponds to the processing in step S801 in the flowchart of Figure 8

[0141] In step S901, the first control unit 223 determines whether the current imaging direction of the lens barrel 102 is the right-hand side or the left-hand side of the central direction. For example, with reference to Figure 6C , the central direction refers to the direction of the axis 1301, the right-hand side refers to a 180-degree range in the clockwise direction from the direction of the axis 1301, and the left-hand side refers to a 180-degree range in the counterclockwise direction from the direction of the axis 1301. In this case, the direction to be the right end and the direction to be the left end overlap. The right end can be set to an arbitrary direction in the 180-degree range in the clockwise direction from the central direction. Similarly, the left end can be set to an arbitrary direction in the 180-degree range in the counterclockwise direction from the central direction.

[0142] In a case where it is determined that the current imaging direction of the lens barrel 102 is the left-hand side (NO in step S901), the processing proceeds to step S902. In step S902, the first control unit 223 sets the initial position of the subject search to the left end and sets the end position of the subject search to the right end. In this case, the first control unit 223 controls the lens barrel rotation drive unit 205 to perform the subject search by rotating in the clockwise direction from the left end.

[0143] ​On the other hand, in a case where it is determined that the current photographing direction of the lens barrel 102 is the right-hand side (Yes in step S901), the processing proceeds to step S903. In step S903, the first control unit 223 sets the initial position of the subject search to the right end, and sets the end position of the subject search to the left end. In this case, the first control unit 223 controls the lens barrel rotation drive unit 205 to rotate from the right end in the counterclockwise direction to perform the subject search.

[0144] The processing for determining the direction to be the initial position of the subject search in the subject change processing according to the present exemplary embodiment has been described.

[0145] In this way, the first control unit 223 sets the direction to be the initial position of the subject search in the subject change processing to the direction having a small rotation angle in the pan direction.

[0146] In step S801, the imaging device 101 can determine the direction to be the initial position of the subject change processing regardless of the current photographing direction of the lens barrel 102. For example, the imaging device 101 determines the direction to be the initial position in the subject change processing to be the direction to be the right end. In this case, the imaging device 101 determines the direction to be the end position in the subject change processing to be the direction to be the left end.

[0147] The imaging device 101 can recognize the instruction for changing the photographing direction of the imaging device 101 as a subject change command such as "look right" and "look left". In a case where such a command is used, the user needs to grasp the position of the subject the user wants to photograph before the instruction is issued. However, the search range of the imaging device 101 can be limited to the direction of the desired subject, so that the subject can be changed more efficiently.

[0148] In a case where the change instruction such as "look right" and "look left" for changing the photographing direction of the imaging device 101 is recognized as a subject change command, the first control unit 223 recognizes the direction to be the initial position of the subject search as the direction at the time when the subject change command is recognized. Then, the first control unit 223 performs the subject search processing in the direction included in the change instruction. In this case, the end position of the subject search processing is the end in the direction included in the change instruction. For example, for the change instruction "look right", the end (the end position of the subject search processing) is the right end. For example, for the change instruction "look left", the end (the end position of the subject search processing) is the left end.

[0149] <Photographing processing after subject change>

[0150] The image capturing process after the subject change will now be described.

[0151] Figure 10 is a flowchart illustrating the image capturing process after the subject change according to the present exemplary embodiment. The processing of this flowchart is executed after step S812. The processing of each step in this flowchart is realized when the first control unit 223 executes the program stored in the nonvolatile memory 216.

[0152] In step S1001, the first control unit 223 determines whether a subject has been detected in the above-described subject change processing. In the case where it is determined that a subject has been detected (Yes in step S1001), the processing proceeds to step S1003. On the other hand, in the case where it is determined that a subject has not been detected (No in step S1001), the processing proceeds to step S1002.

[0153] In step S1002, the first control unit 223 controls the lens barrel rotation drive unit 205 to drive the lens barrel 102 to the initial position. This initial position is, for example, a direction to be the initial position of the subject search.

[0154] In step S1003, the first control unit 223 controls the lens barrel rotation drive unit 205 so that the image capturing direction of the lens barrel 102 is directed toward Figure 8 the image capturing direction recorded in step S809.

[0155] Subsequently, the first control unit 223 restricts the image capturing direction to a range including the image capturing direction recorded in step S809 and narrower than the subject search range in the subject search processing until the processing in step S1007 is started. Thus, the first control unit 223 can keep the subject photographed in the subject change processing as the main subject within the angle of view. Setting the range in the image capturing direction in this way enables the first control unit 223 to perform image capturing while adjusting the angle of view to obtain a preferred composition.

[0156] In step S1004, the first control unit 223 determines whether the subject determined to have the highest importance score in step S812 has been detected in the image capturing direction recorded in Figure 8 step S809. If the first control unit 223 determines that the subject determined to have the highest importance score has been detected (Yes in step S1004), the processing proceeds to step S1005. On the other hand, if the first control unit 223 determines that the subject determined to have the highest importance score has not been detected (No in step S1004), the processing proceeds to step S1007.

[0157] In step S1005, the first control unit 223 captures an image of the subject detected in step S1004, and then records the captured image data in the recording medium 221.

[0158] In step S1006, the first control unit 223 determines whether or not a predetermined period of time has elapsed since the processing in step S1004 was performed. The predetermined period of time is, for example, 5 or 10 minutes. In the case where it is determined that the predetermined period of time has not elapsed (NO in step S1006), the processing returns to step S1004. In step S1004, the first control unit 223 continues to detect the subject judged to have the highest importance score in step S812. On the other hand, in the case where it is determined that the predetermined period of time has elapsed (YES in step S1006), the processing proceeds to step S1007.

[0159] In step S1007, the first control unit 223 stops detecting the subject judged to have the highest importance score in the direction of the captured image recorded in step S809 of Figure 8 , and returns to the normal automatic captured image processing. Further, the first control unit 223 resets the direction of the captured image recorded in step S809 of Figure 8 , and the restriction on the range of the direction of the captured image from the processing in step S1003. More specifically, the reference direction is overwritten to the memory 215, and the subject search range returns to 360 degrees in the automatic captured image processing after the processing in step S1007. As a result of performing the automatic captured image processing, the first control unit 223 can continue to capture an image of the subject judged to have the highest importance score that is currently being captured.

[0160] The captured image processing of the captured image device 101 after the subject is changed has been described above.

[0161] In this way, the first control unit 223 performs a subject search when a subject change instruction is received from the user, and then captures an image of the subject judged to have the highest importance score. This enables the captured image device 101 to continue to capture an image of the subject estimated to be a subject that the user wants to capture.

[0162] Although in this flowchart, the first control unit 223 determines whether or not a predetermined period of time has elapsed in step S1006, the first control unit 223 can also determine whether or not a predetermined number of times of captured image has been performed. The predetermined number of times is, for example, 5 or 10. In the case where the first control unit 223 determines that the predetermined number of times of captured image has been performed (YES in step S1006), the processing proceeds to step S1007. On the other hand, in the case where the first control unit 223 determines that the predetermined number of times of captured image has not been performed (NO in step S1006), the processing returns to step S1004.

[0163] As described above, the image pickup apparatus 101 performs the subject search when receiving the subject search instruction from the user, automatically detects the subject that the user wants to photograph, and photographs the image of the subject. This enables the image pickup apparatus 101 to realize the automatic image pickup in accordance with the user's intention.

[0164] The present exemplary embodiment has been described above with respect to the case where the first control unit 223 receives the instruction for performing the subject change processing in the state where the automatic image pickup processing is being performed. However, even in the state where the automatic image pickup processing is not being performed, the first control unit 223 can receive the instruction for performing the subject change processing. Even in this case, the first control unit 223 photographs the image of the subject in accordance with the image pickup processing after the subject change, and then starts the automatic image pickup processing. It is assumed that the user who issued the subject change instruction wants the image pickup apparatus 101 to keep photographing the image of the subject detected in the subject change processing. Alternatively, in the case where the first control unit 223 receives the subject change instruction in the state where the automatic image pickup processing is not being performed, the first control unit 223 can not start the automatic image pickup processing after photographing the image of the subject in accordance with the image pickup processing after the subject change. It is assumed that the user who issued the subject change instruction can want the image pickup apparatus 101 to photograph the image of the subject detected in the subject change processing to some extent, and can not intend to perform the subsequent automatic image pickup. Furthermore, in the case where the first control unit 223 receives the subject change instruction in the state where the automatic image pickup processing is not being performed, the first control unit 223 can be set as to whether to start the automatic image pickup processing after photographing the image of the subject in accordance with the image pickup processing after the subject change. The user issues the instruction for setting whether to start the automatic image pickup processing from the smart device 301 to the image pickup apparatus 101. This enables the image pickup apparatus 101 to respond to an arbitrary situation that the user wants.

[0165] According to the second exemplary embodiment, the image pickup apparatus 101 performs the subject change processing that focuses on changing the subject to be photographed. The present exemplary embodiment aims at making it easier for the user to photograph the image of the subject that the user wants to photograph, by preferentially photographing the image of the other subject compared to the subject being photographed immediately before the start of the subject change processing. The configurations of the image pickup apparatus 101 and the smart device 301 are similar to those according to the first exemplary embodiment.

[0166] Figure 11 is a flowchart that shows the subject change processing according to the second exemplary embodiment. When the first control unit 223 controls the respective units of the image pickup apparatus 101, the processing of each step in the following flowchart is realized. The processing of this flowchart corresponds to the processing in step S709 of the flowchart in Figure 7 ​

[0167] In step S1101, the first control unit 223 records information about a subject that is currently being photographed. For example, the first control unit 223 records an identifier indicating a subject that is being photographed at the time of reception of a subject change instruction as information about the subject. Hereinafter, a subject that is being photographed in step S1101 is referred to as an initial subject. According to the present exemplary embodiment, the first control unit 223 selects only one initial subject. For example, in a case where two different subjects are detected in the angle of view, the first control unit 223 selects either one of the two subjects as the initial subject, and then records the subject. In this case, the first control unit 223 selects the initial subject in consideration of criteria such as the size of the subject in the angle of view, the proximity of the subject to the center of the angle of view, and the proximity of the subject to the focus point, and the like, in relation to the initial subject selection.

[0168] The processes in steps S1102 to S1107 are similar to those in steps S802 to S806, respectively, and thus redundant descriptions thereof will be omitted. Figure 8

[0169] In step S1108, the first control unit 223 determines whether the subject detected in step S1104 is the initial subject. For example, the first control unit 223 detects whether the subject detected in step S1104 is the initial subject by referring to the identifier indicating the subject that is being photographed at the time of reception of the subject search instruction recorded in the information about the subject. In a case where the subject detected in step S1104 is determined to be the initial subject (YES in step S1108), the process proceeds to step S1109. On the other hand, in a case where the subject detected in step S1104 is determined not to be the initial subject (NO in step S1108), the process proceeds to step S1110.

[0170] In step S1109, the first control unit 223 determines the importance score of the subject detected in step S1104 to be the minimum value. More specifically, in this step, the first control unit 223 determines that the importance score of the initial subject is lower than the importance scores of the subjects other than the initial subject. For example, the first control unit 223 sets a negative fixed value that does not appear in the regular importance score calculation. Alternatively, the first control unit 223 sets a fixed value that is smaller than the minimum value among the values that can be obtained based on the priority, the facial expression, the eye size, the face orientation, and the other information.

[0171] More specifically, in this step, the first control unit 223 does not calculate the importance score. This enables the imaging device 101 to photograph an image of a subject other than the initial subject after the subject change processing.​

[0172] The processes in steps S1110 to S1115 are similar to those in steps S807 to S812 in Figure 8 , respectively, and thus redundant descriptions thereof will be omitted.

[0173] The subject change processing of the imaging device 101 according to the present exemplary embodiment has been described.

[0174] In this way, the first control unit 223 can make it easier to take an image of a subject other than the initial subject in the subject change processing by determining the importance score of the initial subject to be the minimum value.

[0175] In a case where the subject first detected in the subject change processing is the initial subject, the first control unit 223 records the orientation of the initial subject in the imaging direction recording processing in step S1112. This enables the first control unit 223 to take an image of the initial subject even if no subject other than the initial subject is found, so that it is possible to avoid a case where no subject is taken after the subject change processing.

[0176] When the processing of the flowchart in Figure 11 is ended, the first control unit 223 deletes the identifier indicating the subject being taken at the time of receiving the subject search instruction, which is recorded as information related to the initial subject. When the first control unit 223 starts the subsequent automatic imaging processing, the importance score of the initial subject is determined on the basis of a criterion similar to that for other subjects.

[0177] Although in the present exemplary embodiment, the first control unit 223 determines the importance score of the initial subject to be the minimum value to take an image of a subject other than the initial subject, other methods for determining the importance score are also applicable. For example, the first control unit 223 can make it easier to take an image of a subject other than the initial subject by unconditionally adding a predetermined value to the importance score of the subject other than the initial subject.

[0178] According to a third exemplary embodiment, the imaging device 101 takes a moving image during the subject search processing in the subject change processing. The third exemplary embodiment aims to enable the imaging device 101 to take an image of a subject that the user wants to take more reliably than in a case where a still image is taken in the subject change processing by taking a moving image in the subject change processing. The configurations of the imaging device 101 and the smart device 301 are similar to those according to the first exemplary embodiment.

[0179] Figure 12is a flowchart showing the subject search processing according to the third illustrative embodiment. The processing of the respective steps in this flowchart is implemented when the first control unit 223 executes the program stored in the nonvolatile memory 216. The processing of the respective steps in the following flowchart is implemented when the first control unit 223 controls the respective units of the image pickup apparatus 101. The processing of this flowchart corresponds to the processing of the respective steps in the flowchart of Figure 7 the processing in step S709 in the flowchart.

[0180] In step S1201, the first control unit 223 determines whether a moving image or a still image is picked up in the subject change processing. For example, in the subject change processing, the first control unit 223 determines whether a still image or a moving image is set to be picked up. The user can change this setting by using the smart device 301. In a case where it is determined that a moving image is to be picked up (YES in step S1201), the processing proceeds to step S1202. On the other hand, in a case where it is determined that a still image is to be picked up (NO in step S1201), the processing proceeds to step S1213. In step S1213, the first control unit 223 performs the processing of the flowchart shown in Figure 8 .

[0181] In step S1202, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 to drive the image pickup direction of the lens barrel 102 to a direction that is to be an initial position of the subject search. For example, the first control unit 223 drives the tilt rotation unit 104 and the pan rotation unit 105 so that the image pickup direction of the lens barrel 102 coincides with the direction of the axis 1301 in Figure 6C .

[0182] In step S1203, the first control unit 223 starts recording a moving image.

[0183] In step S1204, when the image pickup direction of the lens barrel 102 is directed toward a direction that is to be an initial position (the direction of the axis 1301 in Figure 6C ), the first control unit 223 starts the subject search. In the subject search, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 so that the image pickup direction of the lens barrel 102 is directed toward a direction that is to be an end position of the subject search. According to the present illustrative embodiment, for example, the image pickup direction of the lens barrel 102 is controlled to make one revolution in the clockwise direction along a plane parallel to the horizontal plane from the direction of the axis 1301 in Figure 6C . In this case, the direction of the end position of the subject search coincides with the initial position (the direction of the axis 1301 in Figure 6CThe direction of the axis 1301 in the image is the same as the direction of the axis 1301 in the image. The processing in steps S1205 to S1212 after this step is the processing in the subject search.

[0184] In step S1205, the first control unit 223 determines whether the subject detection unit 225 has detected a subject. If it is determined that a subject has been detected (YES in step S1205), the processing proceeds to step S1206. On the other hand, if it is determined that a subject has not been detected (NO in step S1205), the processing proceeds to step S1210.

[0185] In step S1206, the first control unit 223 acquires information about the photographed subject. Examples of the information about the subject include whether the face of the subject is registered in the imaging device 101, the priority of the subject, the face of the subject, and whether the subject is the same as the subject photographed at the time of receiving the subject change instruction.

[0186] In step S1207, the first control unit 223 determines the importance score of the subject based on the information about the subject acquired in step S1206. The importance score refers to a parameter used by the first control unit 223 to determine the subject to be photographed after the search for changing the subject is completed. The importance score is different from the importance level used to determine the search region. For example, a subject of a subject set by the user to have a high priority can be estimated to be a subject the user wants to photograph. Therefore, this subject has a high importance score. In contrast, a subject not registered in the imaging device 101 is not necessarily a subject the user wants to photograph. Therefore, this subject has a low importance score. If a subject registered in the imaging device 101 has no priority setting, this subject has an intermediate importance score. More specifically, the first control unit 223 can determine a subject having a high importance score to be a subject the user wants to photograph.

[0187] According to the present exemplary embodiment, the first control unit 223 determines the importance score of a subject having a facial expression to be higher than the importance score of a subject having an expressionless face. For example, the importance score of a subject having a smile is higher than the importance score of a subject having an expressionless face. For example, a crying face of a child can be an expression a parent of the child wants to photograph. Therefore, the first control unit 223 sets the importance score of a subject having a crying face to be higher than the importance score of a subject having an expressionless face. According to the present exemplary embodiment, it is assumed that the importance score of a subject having a high priority is higher than the importance score of a subject having a facial expression such as a smile. According to the present exemplary embodiment, the first control unit 223 determines the importance score by calculating the sum of the importance scores for these pieces of information about the subject.

[0188] In step S1208, the first control unit 223 determines whether the importance score of the subject determined in step S1207 is the highest importance score among the importance scores determined since the processing of this flowchart started. For example, the first control unit 223 determines whether the importance score is the highest importance score among the importance scores determined since the processing of this flowchart started. If the importance score is determined to be the highest (YES in step S1208), the processing proceeds to step S1209. On the other hand, if the importance score is determined not to be the highest (NO in step S1208), the processing proceeds to step S1210.

[0189] In step S1209, the first control unit 223 records the imaging direction of the subject determined to have the highest importance score in step S1208. For example, the first control unit 223 records the angle of the pan direction in the memory 215 as the imaging direction of the lens barrel 102. According to the present exemplary embodiment, the initial value of the imaging direction at the start of the processing of this flowchart is the direction to be the initial position of the subject search. The first control unit 223 also records the information about the subject in the memory 215 together with the imaging direction of the lens barrel 102. In the case where the imaging direction of the lens barrel 102 and the information about the subject have already been recorded, the first control unit 223 overwrites the imaging direction of the lens barrel 102 and the information about the subject.

[0190] In step S1210, the first control unit 223 determines whether the subject search is completed. For example, the first control unit 223 determines whether the imaging direction of the lens barrel 102 is toward the direction to be the end position. If the imaging direction is toward the direction to be the end position, the first control unit 223 determines that the subject search is completed. On the other hand, if the imaging direction is not toward the direction to be the end position, the first control unit 223 determines that the subject search is not completed. If the subject search is determined to have been completed (YES in step S1210), the processing proceeds to step S1211. On the other hand, if the subject search is determined to have not been completed (NO in step S1210), the processing returns to step S1205. In step S1205, the first control unit 223 continues the subject search.

[0191] In step S1211, the first control unit 223 stops recording the moving image, and records the moving image data in the recording medium 221.

[0192] In step S1212, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 to capture an image of the subject judged to have the highest importance score. More specifically, the first control unit 223 controls the driving of these units so that the imaging direction of the lens barrel 102 coincides with the imaging direction at the time when the subject judged to have the highest score in step S808 is detected. The first control unit 223 also determines the subject to be captured on the basis of the information on the subject last recorded in step S1209. After the processing in this step, the first control unit 223 performs processing for capturing an image of the subject. The processing for capturing an image of the subject is similar to the processing of the flowchart shown in FIG. 8 according to the first example embodiment. Figure 10

[0193] The subject change processing of the imaging device 101 according to the present example embodiment has been described.

[0194] By capturing a moving image in this way in the subject change processing, the imaging device 101 can more reliably capture an image of the subject the user wants to capture compared to the case where a still image is captured in the subject change processing.

[0195] [Other Example Embodiments]

[0196] The present disclosure can also be realized by a computer of a system or apparatus reading out and executing the program recorded on a storage medium to function in accordance with the above-described example embodiment, when the program is provided via a network or the like. Further, the present disclosure can be realized by a circuit such as ASIC according to the present disclosure.

[0197] The present disclosure is not limited to the above-described example embodiments, but can be modified and configured in various ways without departing from the spirit and scope thereof. Different inventions can be formed by appropriately combining a plurality of configuration elements disclosed in the above-described example embodiments. For example, some configuration elements can be deleted from the overall configuration elements according to the example embodiments. Further, configuration elements of different example embodiments can be appropriately combined.

[0198] Other Embodiments

[0199] Embodiments of the present disclosure can also be realized by a method for providing a software (program) that causes a computer, or a CPU or MPU to function in accordance with the above-described embodiment to a system or an apparatus by a network or various recording media, and then allowing the computer, or the CPU or MPU to read and execute the program.

[0200] ​While the present disclosure has been described with reference to example embodiments, it is to be understood that the disclosure is not limited to the disclosed example embodiments. The scope of the claims is to be construed in the broadest sense allowable to encompass all such modifications and equivalent structures and functions.

Claims

1. An image pickup apparatus comprising: an image pickup unit configured to take an image of a subject; a search unit configured to search for a subject to be a pickup target of the image pickup unit; a reception unit configured to receive a change instruction for changing the pickup target from a subject currently being taken by the image pickup unit without specifying a change target; and a control unit configured to automatically determine whether a subject to be the pickup target and another subject are set as the pickup target under the same criteria at the time of receiving the change instruction, and to control an automatic pickup process for automatically taking an image of the determined pickup target, wherein the search unit searches for another subject in a case where the change instruction is received, wherein the search unit performs the search over the entire circumference of the image pickup apparatus in a case where the search is started in the case where the change instruction is received, and wherein the control unit starts the automatic pickup process in a case where the search for a subject change started in the case where the change instruction is received does not detect a subject.

2. The image pickup apparatus according to claim 1, further comprising a determination unit configured to determine another subject as the pickup target preferentially compared to a subject to be the pickup target at the time of receiving the change instruction in the search started in the case where the change instruction is received.

3. The apparatus according to claim 2, wherein The determination unit calculates an importance of each subject based on face information of the detected subject, and determines the pickup target based on the importance in the search started in the case where the change instruction is received.

4. The apparatus according to claim 3, wherein The determination unit calculates the importance of the subject based on a priority set by a user, a facial expression of the subject, an eye size of the subject, and a face orientation of the subject.

5. The apparatus according to claim 3, wherein The determination unit determines another subject as the pickup target preferentially by lowering the importance of the subject being taken at the time of receiving the change instruction lower than the importance of another subject in the search started in the case where the change instruction is received.

6. The image pickup apparatus according to claim 1, further comprising a first recording unit configured to record a direction of image pickup of the image pickup unit during the search by the search unit, wherein The image pickup unit is directed toward a direction recorded by the first recording unit in a case where the search started in the case where the change instruction is received is completed.

7. The apparatus according to claim 6, wherein The image pickup unit repeatedly takes an image of a detected subject until a predetermined period of time elapses or until a predetermined number of images of subjects have been taken in a case where a subject is detected in the direction recorded by the first recording unit.

8. The apparatus according to claim 6, wherein The search unit automatically starts a search for automatically taking an image of a subject in a case where a subject is not detected in the direction of the image pickup direction recorded by the first recording unit.

9. The apparatus according to claim 1, wherein The image pickup unit takes a still image of a detected subject in the search started in the case where the change instruction is received in a case where a subject is detected.

10. The apparatus according to claim 1, wherein The image pickup unit takes a moving image in the search started in the case where the change instruction is received.

11. The apparatus according to claim 1, wherein In a search started upon receipt of the change instruction, the search unit causes the imaging direction of the imaging unit to be directed toward a predetermined direction different from the imaging direction of the imaging unit at the time of receipt of the change instruction, and starts the search.

12. The apparatus according to claim 11, wherein The search unit determines the predetermined direction in accordance with the imaging direction of the imaging unit at the time of receipt of the change instruction.

13. The apparatus according to claim 1, wherein The search unit determines a search range for searching for a subject in accordance with a direction included in the change instruction from a position at the time of receipt of the change instruction.

14. The apparatus of claim 1, further comprising a microphone, wherein, The reception unit receives the change instruction by analyzing an audio signal input from the microphone.

15. The imaging apparatus according to claim 1, further comprising a drive unit configured to drive the imaging direction of the imaging unit in the search processing by the search unit.

16. A control method of an imaging apparatus, the control method comprising: imaging an image of a subject; searching for a subject as an imaging target to be imaged in the imaging; receiving a change instruction for changing the imaging target without specifying a change target imaging target; searching for another subject upon receipt of the change instruction; and automatically determining whether to set the subject as the imaging target and the other subject at the time of receipt of the change instruction as the imaging target under the same criterion, and controlling an automatic imaging process for automatically imaging an image of the determined imaging target, wherein the search is performed over the entire circumference of the imaging apparatus in a case where the search is started upon receipt of the change instruction, and wherein the automatic imaging process is started in a case where no subject is detected in the search for a subject change started upon receipt of the change instruction.

17. A non-transitory storage medium storing a program for causing an imaging apparatus to execute a control method, the control method comprising: imaging an image of a subject; searching for a subject as an imaging target to be imaged in the imaging; receiving a change instruction for changing the imaging target without specifying a change target imaging target; searching for another subject upon receipt of the change instruction; and automatically determining whether to set the subject as the imaging target and the other subject at the time of receipt of the change instruction as the imaging target under the same criterion, and controlling an automatic imaging process for automatically imaging an image of the determined imaging target, wherein the search is performed over the entire circumference of the imaging apparatus in a case where the search is started upon receipt of the change instruction, and wherein the automatic imaging process is started in a case where no subject is detected in the search for a subject change started upon receipt of the change instruction.

18. A computer program product comprising computer program instructions which, when executed by a computer, implement the control method of claim 16.

Images