Imaging apparatus, imaging system, method for controlling imaging apparatus, and program

By communicating with other devices to evaluate and adjust focus, the imaging device ensures even capture of multiple subjects, addressing the challenge of uneven photography results and subject omission.

JP2024164703APending Publication Date: 2024-11-27CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023080375
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27

AI Technical Summary

Technical Problem

Existing imaging devices struggle to capture multiple subjects effectively, often missing non-tracking targets or focusing too narrowly on specific subjects, leading to uneven photography results and reduced success in obtaining good photos.

Method used

An imaging device that communicates with other devices to evaluate and recalibrate the importance levels of tracking subjects based on received evaluation values, adjusting its focus and composition to ensure even capture of multiple subjects.

Benefits of technology

This approach allows for appropriate photography of multiple subjects by adjusting focus and composition based on communication with other devices, reducing the likelihood of missing subjects and improving overall photographic quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164703000001_ABST
    Figure 2024164703000001_ABST
Patent Text Reader

Abstract

To provide an imaging apparatus that, in photographing a plurality of subjects to be tracked together with the other imaging apparatus, can appropriately photograph the plurality of subjects.SOLUTION: An imaging apparatus (101) has: imaging means (206) that acquires first image data while tracking a first subject; acquisition means (207) that acquires a first evaluation value of the first subject from the first image data; receiving means (222) that, through communication with the other imaging apparatus tracking the first subject, receives a second evaluation value of the first subject acquired from second image data acquired by the other imaging apparatus; and control means (223) that, when the second evaluation value is larger than the first evaluation value, changes weighting related to the first image data to re-calculate the first evaluation value.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging device, an imaging system, a control method for an imaging device, and a program. [Background technology]

[0002] Conventionally, imaging devices are known that can acquire images according to user preferences, such as by tracking a subject, without user operation. Patent Document 1 discloses an imaging device that can acquire information such as the face, features, or physical changes of a subject from captured image information, and can automatically capture a specific subject with a focus on the acquired information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-106694 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the configuration disclosed in Patent Document 1, when there are multiple subjects, the shooting range is determined with the tracking target subject at the center. As a result, subjects that are not the tracking target may be outside the shooting range and not be photographed, or subjects may be photographed small in an attempt to fit all subjects within the shooting range.

[0005] In addition, in an imaging system using multiple imaging devices, it is necessary to determine the shooting range and subject for each imaging device and change or set the shooting conditions. Therefore, even if you want to shoot the subjects evenly, the shooting results may vary. Also, if you focus on a specific subject, even if other subjects are in good condition, they will not be photographed, which may reduce the success rate of taking good photos, which can be cumbersome.

[0006] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, an object of the present invention is to provide an imaging device capable of appropriately capturing images of multiple subjects when capturing images of multiple subjects to be tracked together with another imaging device. [Means for solving the problem]

[0007] An imaging device as one aspect of the present invention has an imaging means for acquiring first image data while tracking a first subject, an acquisition means for acquiring a first evaluation value of the first subject from the first image data, a receiving means for receiving a second evaluation value of the first subject acquired from second image data acquired by another imaging device tracking the first subject through communication with the other imaging device, and a control means for changing a weighting for the first image data and recalculating the first evaluation value if the second evaluation value is greater than the first evaluation value.

[0008] Other objects and features of the present invention will be described in the following embodiments. Effect of the Invention

[0009] According to the present invention, it is possible to provide an imaging device capable of appropriately capturing images of a plurality of subjects as tracking targets when capturing images of the plurality of subjects together with another imaging device. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a schematic diagram of an imaging device in each embodiment. [Diagram 2] FIG. 2 is a block diagram of an imaging device in each embodiment. [Diagram 3] FIG. 2 is a configuration diagram of an imaging device and an external device in each embodiment. [Figure 4] FIG. 4 is a block diagram of an external device in each embodiment. [Diagram 5] 4 is a flowchart showing a basic operation of the imaging device in each embodiment. [Figure 6] FIG. 4 is an explanatory diagram of area division within a captured image in each embodiment. [Figure 7]FIG. 2 is an explanatory diagram of a neural network in each embodiment. [Figure 8] 6 is a flowchart showing a method in which an image capture device in the first embodiment recalculates an importance level from communication with another image capture device. [Figure 9] FIG. 11 is an explanatory diagram of an example of a recalculation process of an importance level in the first embodiment. [Figure 10] FIG. 11 is an explanatory diagram of an example of a recalculation process of an importance level in the first embodiment. [Figure 11] FIG. 11 is an explanatory diagram of an example of a recalculation process of an importance level in the first embodiment. [Figure 12] 11A to 11C are explanatory diagrams of an operation of changing an imaging direction due to a recalculation process of an importance level in the first embodiment. [Figure 13] 10 is a flowchart showing an operation of an imaging device according to a second embodiment when the imaging device receives power information of another imaging device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0012] (First embodiment) <Configuration of imaging device> First, a schematic configuration of an image capturing device 101 according to a first embodiment of the present invention will be described with reference to Fig. 1(a) and (b). Fig. 1(a) and (b) are explanatory diagrams of the image capturing device 101 according to this embodiment, Fig. 1(a) is a schematic diagram of the image capturing device 101, and Fig. 1(b) is an explanatory diagram of the definition of an axis based on the position of a fixed part 103 of the image capturing device 101.

[0013] The imaging device 101 has an operating member capable of operating a power switch, etc. In this embodiment, the operating member is, for example, a power button, but may be an operating member capable of performing operations such as tapping, flicking, or swiping on a touch panel. A lens barrel 102, which is a housing including a group of photographing lenses for capturing images and an imaging element, is attached to the imaging device 101.

[0014] The imaging device 101 has a rotation mechanism including a tilt rotation unit 104 and a pan rotation unit 105 that can rotate the lens barrel 102 relative to a fixed part 103. The tilt rotation unit 104 is a motor drive mechanism that can rotate the lens barrel 102 in the pitch direction shown in Fig. 1(b). The pan rotation unit 105 is a motor drive mechanism that can rotate the lens barrel 102 in the yaw direction. In this way, the lens barrel 102 can rotate in two axial directions.

[0015] Both the angular velocity meter 106 and the accelerometer 107 are mounted on the fixed portion 103 of the imaging device 101. The imaging device 101 detects the vibration (shake angle) of the imaging device 101 based on the output signals from the angular velocity meter 106 and the accelerometer 107, and drives the tilt rotation unit 104 and the pan rotation unit 105 to rotate in accordance with the detected shake angle. This makes it possible to correct the shake or tilt of the lens barrel 102, which is a movable part.

[0016] Next, the internal configuration of the imaging device 101 will be described with reference to Fig. 2. Fig. 2 is a block diagram of the imaging device 101. The first control unit (control means) 223 has a processor (e.g., a CPU, a GPU, a microprocessor, or an MPU) and a memory (e.g., a DRAM or an SRAM). The processor and memory of the first control unit 223 execute various processes to control each block of the imaging device 101, and also control data transfer between each block. The non-volatile memory (EEPROM) 216 stores constants, programs, etc. for the operation of the first control unit 223.

[0017] The zoom unit 201 includes a zoom lens that changes magnification. The zoom drive control unit 202 drives and controls the zoom unit 201. The focus unit 203 includes a lens that adjusts focus. The focus drive control unit 204 drives and controls the focus unit 203.

[0018] In the imaging section (imaging means) 206, an imaging element receives light incident through each lens group, and outputs charge information according to the amount of light as analog image data to an image processing section (acquisition means) 207. The image processing section 207 applies image processing such as distortion correction, white balance adjustment, and color interpolation processing to the digital image data output by A / D conversion, and outputs the digital image data after the processing. The digital image data output from the image processing section 207 is converted into a recording format such as JPEG format by an image recording section 208, and is transmitted to a memory 215 or a video output section 217 described later.

[0019] The lens barrel rotation drive unit 205 drives the tilt rotation unit 104 and the pan rotation unit 105 to drive the lens barrel 102 in the tilt direction and the pan direction. The device vibration detection unit 209 has, for example, an angular velocity meter (gyro sensor) 106 that detects the angular velocity of the imaging device 101 in three axial directions, or an accelerometer (acceleration sensor) 107 that detects the acceleration of the device in three axial directions. The device vibration detection unit 209 calculates the rotation angle of the device or the shift amount of the device based on the detected signal.

[0020] The audio input unit 213 acquires an audio signal around the imaging device 101 from a microphone provided in the imaging device 101, performs analog-to-digital conversion, and transmits the signal to the audio processing unit 214. The audio processing unit 214 performs audio-related processing such as optimization of the input digital audio signal. The audio signal processed by the audio processing unit 214 is then transmitted to the memory 215 by the first control unit 223. The memory 215 temporarily stores the image signal and audio signal obtained by the image processing unit 207 and the audio processing unit 214.

[0021] The image processing unit 207 and the audio processing unit 214 read out the image signal and the audio signal temporarily stored in the memory 215, and encode the image signal and the audio signal to generate a compressed image signal and a compressed audio signal. The first control unit 223 transmits these compressed image signal and compressed audio signal to the recording and reproducing unit 220.

[0022] The recording and reproducing unit 220 records the compressed image signal, compressed audio signal, and other control data related to shooting generated by the image processing unit 207 and audio processing unit 214 on the recording medium 221. When the audio signal is not compression-encoded, the first control unit 223 transmits the audio signal generated by the audio processing unit 214 and the compressed image signal generated by the image processing unit 207 to the recording and reproducing unit 220 to record them on the recording medium 221.

[0023] The recording medium 221 may be a recording medium built into the imaging device 101 or a removable recording medium. The recording medium 221 can record various data such as compressed image signals, compressed audio signals, and audio signals generated by the imaging device 101, and a medium with a larger capacity than the nonvolatile memory 216 is generally used. For example, the recording medium 221 includes any type of recording medium such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, and a flash memory.

[0024] The recording and reproducing unit 220 reads (plays) the compressed image signal, compressed audio signal, audio signal, various data, and programs recorded on the recording medium 221. Then, the first control unit 223 transmits the read compressed image signal and compressed audio signal to the image processing unit 207 and audio processing unit 214. The image processing unit 207 and audio processing unit 214 temporarily store the compressed image signal and compressed audio signal in the memory 215, decode them in a predetermined procedure, and transmit the decoded signals to the video output unit 217 and audio output unit 218.

[0025] The audio input unit 213 is, for example, a plurality of microphones mounted on the imaging device 101. The audio processing unit 214 detects the direction of a sound on a plane on which the plurality of microphones are installed. The detected direction of the sound is used for searching or automatic shooting, which will be described later. The audio processing unit 214 also detects a specific audio command. The audio command may be a plurality of commands registered in advance, or a configuration in which a user can register a specific audio in the imaging device. Also, sound scene recognition may be performed. In the sound scene recognition, a sound scene is determined by a network that has been trained by machine learning based on a large amount of audio data in advance. For example, a network for detecting a specific scene such as "cheers are being raised," "claps are being made," or "a voice is being uttered" is set in the audio processing unit 214. Then, when a specific sound scene or a specific audio command is detected, a detection trigger signal is output to the first control unit 223 or the second control unit 211.

[0026] The second control unit 211 is a control unit provided separately from the first control unit 223 that controls the entire main system of the imaging device 101, and controls the power supply of the first control unit 223. The first power supply unit 210 and the second power supply unit 212 supply power for operating the first control unit 223 and the second control unit 211, respectively. When a power button provided on the imaging device 101 is pressed, power is first supplied to both the first control unit 223 and the second control unit 211. However, as described later, the first control unit 223 is controlled to turn off its own power supply to the first power supply unit 210. Even while the first control unit 223 is not operating, the second control unit 211 operates, and information is input from the device vibration detection unit 209 and the audio processing unit 214. The second control unit 211 performs a determination process of whether or not to start the first control unit 223 based on various input information. When the second control unit 211 determines to start up the first control unit 223, it instructs the first power supply unit 210 to supply power.

[0027] The audio output unit 218 outputs a preset audio pattern from a speaker built into the imaging device 101, for example, during shooting. The LED control unit 224 controls a preset lighting and blinking pattern of an LED provided in the imaging device 101, for example, during shooting. The video output unit 217 has, for example, a video output terminal, and transmits an image signal to display a video on a connected external display or the like. The audio output unit 218 and the video output unit 217 may be one combined terminal, for example, an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal. The learning processing unit 219 uses a neural network and a machine learning algorithm to perform learning according to the user's preferences.

[0028] The communication unit (receiving means, transmitting means) 222 communicates between the imaging device 101 and an external device. The communication unit 222 transmits or receives data such as an audio signal, an image signal, a compressed audio signal, or a compressed image signal. The communication unit 222 also receives control signals related to imaging, such as imaging start and end commands, pan / tilt and zoom drive, and drives the imaging device 101 according to instructions from an external device that can communicate with the imaging device 101. The communication unit 222 also transmits or receives information such as various parameters related to learning processed by the learning processing unit 219 between the imaging device 101 and the external device. The communication unit 222 is, for example, a wireless communication module such as an infrared communication module, a Bluetooth (registered trademark) communication module, a wireless LAN communication module, a Wireless USB, or a GPS receiver.

[0029] <Configuration with external communication devices> Next, a wireless communication system between the imaging device 101 and the external device 301 will be described with reference to Fig. 3. Fig. 3 is a configuration diagram of the imaging device 101 and the external device 301. The imaging device 101 is a digital camera having a photographing function, and the external device 301 is a smart device including a Bluetooth (registered trademark) communication module or a wireless LAN communication module, but this embodiment is not limited to this.

[0030] The imaging device 101 and the external device 301 are capable of communication 302 by wireless LAN conforming to the IEEE802.11 series of standards, and communication 303 having a master-slave relationship between a control station and a slave station, such as Bluetooth (registered trademark) Low Energy (BLE). Note that wireless LAN and BLE are examples of communication methods, and other communication methods may be used as long as each communication device has two or more communication functions and, for example, one communication function that communicates in the relationship between a control station and a slave station can control the other communication function.

[0031] Next, the configuration of the external device (smart device) 301 will be described with reference to Fig. 4. Fig. 4 is a block diagram of the external device 301. The external device 301 has, for example, a wireless LAN control unit 401 for wireless LAN, a BLE control unit 402 for BLE, and a public line control unit 406 for public wireless communication. The external device 301 also has a packet transmission / reception unit 403.

[0032] The wireless LAN control unit 401 performs wireless LAN RF control, communication processing, and drivers that perform various controls of wireless LAN communication compliant with the IEEE802.11 standard series, and performs protocol processing related to wireless LAN communication. The BLE control unit 402 performs BLE RF control, communication processing, and drivers that perform various controls of BLE communication, and performs protocol processing related to BLE communication.

[0033] The public line control unit 406 performs RF control of public wireless communication, communication processing, drivers for performing various controls of public wireless communication, and protocol processing related to public wireless communication. The public wireless communication complies with, for example, the International Multimedia Telecommunications (IMT) standard or the Long Term Evolution (LTE) standard.

[0034] The packet transceiver 403 performs processing for performing at least one of transmitting and receiving packets related to communication by wireless LAN and BLE and public wireless communication. Note that in this embodiment, the external device 301 is described as a smart device that performs at least one of transmitting and receiving packets in communication, but other communication formats such as circuit switching may be used in addition to packet switching.

[0035] The external device 301 also includes, for example, a control unit 411, a storage unit 404, a GPS receiving unit 405, a display unit 407, an operation unit 408, a voice input voice processing unit 409, and a power supply unit 410. The control unit 411 controls the entire external device 301 by, for example, executing a control program stored in the storage unit 404. The storage unit 404 stores, for example, a control program executed by the control unit 411 and various information such as parameters necessary for communication. Various operations described below are realized by the control unit 411 executing the control program stored in the storage unit 404. The power supply unit 410 supplies power to the external device 301.

[0036] The display unit 407 has a function of outputting visually recognizable information such as an LCD or an LED, or a function of outputting sound such as a speaker, and displays various information. The operation unit 408 is, for example, a button or the like that accepts an operation of the external device 301 by a user. Note that the display unit 407 and the operation unit 408 may be configured by a common member such as a touch panel.

[0037] The voice input voice processing unit 409 may be configured to acquire voice uttered by the user from, for example, a general-purpose microphone built into the external device 301, and acquire an operation command from the user through voice recognition processing. Also, a voice command uttered by the user is acquired via a dedicated application in the smart device. Then, the voice command can be registered as a specific voice command to be recognized by the voice processing unit 214 of the imaging device 101 through communication 302 by wireless LAN.

[0038] The GPS (Global Positioning System) 405 receives a GPS signal notified from a satellite, analyzes the GPS signal, and estimates the current position (longitude and latitude information) of the external device 301. Alternatively, the position may be estimated based on information of a wireless network present in the vicinity using a WPS (Wi-Fi Positioning System) or the like. When the acquired current GPS position information is located within a position range (within a range of a predetermined radius) set in advance, the moving information is notified to the imaging device 101 via the BLE control unit 402, and used as a parameter for automatic shooting described later. Also, when there is a position change of a predetermined amount or more in the GPS position information, the moving information is notified to the imaging device 101 via the BLE control unit 402, and used as a parameter for automatic shooting described later.

[0039] As described above, the imaging device 101 and the external device 301 exchange data with each other through communication using the wireless LAN control unit 401 and the BLE control unit 402. For example, data such as audio signals, image signals, compressed audio signals, and compressed image signals are transmitted or received. In addition, the external device 301 issues operational instructions such as shooting an image of the imaging device 101, transmits voice command registration data, or notifies the detection of a predetermined position or notifies a change in location based on GPS position information. In addition, the external device 301 transmits and receives learning data via a dedicated application in the external device 301.

[0040] In this embodiment, the external device 301 is not limited to a smart device. For example, the external device 301 may be a device specialized for voice input, omitting the display unit 407 or the operation unit 408. In this device, the voice uttered by the user is acquired from the above-mentioned microphone, and the user's operation command is acquired by voice recognition processing, and notified to the imaging device 101. In addition, the device may have voice recognition, a communication function with the cloud, and a news reading function using a speaker. In addition, the device may have a function of outputting sound of searched items using a search engine, and a dialogue system function.

[0041] <Basic operation of the imaging device> Next, the basic operation of the imaging device 101 in this embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the basic operation of the imaging device 101.

[0042] First, in step S501, the image processing unit 207 generates an image that has been image-processed for subject detection based on a signal captured by the imaging unit 206. Subject detection, such as human and object detection, is performed from the generated image (image recognition processing). When detecting a person, the face or human body of the subject is detected. In face detection processing, a pattern for determining a person's face is predefined, and a portion that matches the pattern included in the captured image can be detected as a human face image. In addition, a reliability indicating the likelihood that the subject's face is present is also calculated at the same time, and the reliability is calculated from, for example, the size of the face area in the image and the degree of match with the face pattern. Similarly, in object recognition, an object that matches a pre-registered pattern can be recognized.

[0043] There is also a method of extracting a characteristic subject by using a histogram of hue, saturation, etc. in a captured image. With respect to an image of a subject captured within a shooting angle of view, a distribution derived from a histogram of the hue, saturation, etc. is divided into a plurality of sections, and a process of classifying the captured image for each section is executed. For example, a histogram of a plurality of color components is created for the captured image, and the image is divided into sections according to the mountain-shaped distribution range, and the captured image is classified into areas belonging to the same combination of sections, and the image area of ​​the subject is recognized. By calculating an evaluation value for each image area of ​​the recognized subject, the image area of ​​the subject with the highest evaluation value can be determined as the main subject area. Also, a subject to be detected may be learned in advance using Convolutional Neural Networks (CNN), and CNN may be applied to face recognition and object recognition. With the above method, each subject information can be obtained from the imaging information.

[0044] Next, in step S502, the image processing unit 207 performs a subject search process. The subject search includes the following processes.

[0045] (1) Area division (2) Calculation of importance level for each area (3) Determining the search area The subject search process will be described below in order.

[0046] (1) Area division First, the area division will be described with reference to Fig. 6(a) to (d). Fig. 6(a) to (d) are explanatory diagrams of area division in a captured image. As shown in Fig. 6(a), the area is divided all around the position (origin O) of the image capture device 101 as the center. In the example of Fig. 6(a), the tilt direction and the pan direction are each divided at 22.5 degrees. When divided as shown in Fig. 6(a), as the tilt angle of the image capture device 101 moves away from 0 degrees, the circumference in the horizontal direction becomes smaller and the area becomes smaller. Therefore, as shown in Fig. 6(b), when the tilt angle is 45 degrees or more, the horizontal area range is set to be larger than 22.5 degrees.

[0047] Figures 6(c) and (d) show examples of area division within the shooting angle of view. Axis 601 is the direction of the imaging device 101 at the time of initialization, and area division is performed with this direction angle as the reference position. 602 indicates the angle of view area of ​​the image being captured, and an example of the image at that time is shown in Figure 6(d). Within the image captured within the angle of view, the image is divided into areas as shown by 611 to 626 in Figure 6(d) based on the area division.

[0048] (2) Calculation of importance level for each area For each area divided as described above, an importance level (evaluation value) indicating the priority of searching is calculated according to the subject existing in the area and the scene situation of the area. The importance level based on the situation of the subject is calculated based on, for example, the number of people existing in the area, the size of the person's face, the face direction, the certainty of face detection, the person's expression, and the person's personal authentication result. The importance level according to the situation of the scene is, for example, a general object recognition result, a scene discrimination result (blue sky, backlight, evening scene, etc.), the sound level or voice recognition result from the direction of the area, and motion detection information within the area. In addition, when a shooting area is specified by a user, the importance level of an area located in an unspecified area is fixed to a minimum value so that each imaging device performs a search and framing operation within the specified shooting area. This sets it so that searching in the direction of that area is not performed.

[0049] With only the above conditions, unless there is a change in each area, the area with the highest importance level will be the same, and as a result, the area to be searched will not change. Therefore, the importance level is changed according to past shooting information. Specifically, the importance level of an area that has been designated as a search area for a predetermined period of time may be lowered, or the importance level of an area where shooting has been performed in step S509 described later may be lowered for a predetermined period of time. However, the importance level of an area where the user has not designated a shooting area is not changed and is maintained at the minimum value.

[0050] (3) Determining the search area After the importance level of each area is calculated as described above, the area with the highest importance level is determined as the search target area, and the pan / tilt search target angle required to capture the search target area in the field of view is calculated.

[0051] 5, first control unit 223 performs pan / tilt drive using lens barrel rotation drive unit 205. First control unit 223 calculates the pan / tilt drive amount by adding the drive angle at control sampling based on the pan / tilt search target angle. Lens barrel rotation drive unit 205 then controls the drive of tilt rotation unit 104 and pan rotation unit 105 based on the calculated pan / tilt drive amount.

[0052] Next, in step S504, the first control unit 223 performs zoom driving by controlling the zoom unit 201 using the zoom drive control unit 202. Specifically, the first control unit 223 performs zoom driving according to the state of the search target subject determined in step S502. For example, when the search target subject is a person's face, if the face on the image is too small, it may be below the minimum detectable size and may not be detected, resulting in loss of sight. In such a case, the size of the face on the image is controlled to be larger by zooming to the telephoto side. On the other hand, if the face on the image is too large, the subject is likely to fall out of the angle of view due to the movement of the subject or the imaging device itself. In such a case, the size of the face on the screen is controlled to be smaller by zooming to the wide-angle side. By performing zoom driving in this way, a state suitable for tracking the subject can be maintained.

[0053] As described above, the imaging unit 206 acquires image data (first image data) while tracking a specific subject (first subject). Note that in steps S502 to S504, a method of performing subject search by pan-tilt driving and zoom driving has been described, but subject search may also be performed by an imaging system that uses multiple wide-angle lenses to capture images in all directions at once. In the case of an omnidirectional imaging device, if all signals obtained by imaging are used as input images and image processing such as subject detection is performed, a huge amount of processing is required. Therefore, a configuration is adopted in which a part of an image is cut out and a subject search process is performed within the cut-out image range. As in the above-mentioned method, the importance level for each area is calculated, the cut-out position is changed based on the importance level, and automatic shooting is determined as described later. This makes it possible to reduce power consumption through image processing and perform high-speed subject search.

[0054] If the tracking subject is specified manually, or if the camera is set to automatically detect and track a specific subject, the above-mentioned search operation is not performed. The camera performs pan / tilt driving to keep the specified subject in a specified position on the screen (for example, near the center of the screen), and zoom driving to make the subject a specified size.

[0055] Next, in step S505, the first control unit 223 recalculates the importance level for each area based on the position, angle, and distance information from the other imaging device to the subject, or the highest importance level information, by recalculating the importance level from communication with the other imaging device, which will be described later. If the area with the highest importance level has been changed by the recalculation, the process returns to step S503 and repeats. If the area with the highest importance level has not been changed or if it is determined that the tracking subject is different, the process proceeds to step S506.

[0056] Next, in step S506, the first control unit 223 determines whether or not a manual shooting instruction has been given. If it is determined that a manual shooting instruction has been given, the process proceeds to step S509. On the other hand, if it is determined that a manual shooting instruction has not been given, the process proceeds to step S507. At this time, the manual shooting instruction may be given by pressing the shutter button, by lightly tapping the imaging device housing with a finger or the like (tapping), by inputting a voice command, or by an instruction from an external device. The shooting instruction by tapping operation is a shooting instruction method in which, when a user taps the imaging device housing, the device shaking detection unit 209 detects continuous high-frequency acceleration in a short period of time and uses this as a shooting trigger. The voice command input is a shooting instruction method in which, when a user utters a password (for example, "take a picture") instructing a predetermined shooting, the voice processing unit 214 recognizes the voice and uses this as a shooting trigger. The instruction from the external device is a shooting instruction method in which, for example, a shutter instruction signal transmitted via a dedicated application from a smartphone or the like connected to the imaging device by wireless communication is used as a shooting instruction signal.

[0057] In step S507, the first control unit 223 performs an automatic shooting determination. In the automatic shooting determination, a determination is made as to whether or not shooting is to be performed. The determination as to whether or not automatic shooting is to be performed is made based on the following two determinations. The first is to make a determination to perform automatic shooting if the importance level exceeds a predetermined value based on either the importance level by area obtained in step S502 or the importance level by area recalculated in step S505.

[0058] The second is judgment based on a neural network. Figure 7 shows an example of a network using a multilayer perceptron as an example of a neural network. A neural network is used to predict an output value from an input value, and by learning an input value and a model output value for that input in advance, it is possible to estimate an output value that follows the model learned for a new input value.

[0059] In Fig. 7, 701 and its vertically arranged circles are neurons in the input layer, 703 and its vertically arranged circles are neurons in the hidden layer, and 704 is a neuron in the output layer. Arrows such as 702 indicate connections connecting each neuron. In a decision based on a neural network, features based on the subject captured in the current angle of view and the state of the scene and image capture device are given as input to the neurons in the input layer, and a value is obtained as an output from the output layer after calculation based on the forward propagation rule of the multilayer perceptron. If the output value is equal to or greater than a threshold, a decision is made to perform automatic shooting.

[0060] The subject features include the current zoom magnification, general object recognition results in the current angle of view, face detection results, the number of faces in the current angle of view, the degree of smiling face / closed eyes, face angle, face recognition ID number, gaze angle of the subject, etc. Other features that may be used include the scene determination results, time elapsed since the previous image was captured, current time, GPS location information and the amount of change from the previous image capture location, current audio level, the person speaking, whether or not there is applause or cheering, etc.

[0061] In addition, vibration information (acceleration information, state of the imaging device), environmental information (temperature, air pressure, illuminance, humidity, amount of ultraviolet light), etc. may also be used. These features are converted into numerical values ​​within a specified range and given to each neuron in the input layer as a feature quantity. Therefore, the number of neurons in the input layer required is equal to the number of features used. Note that, in judgments based on this neural network, the output value can be changed by changing the connection weights between each neuron, and the judgment results can be adapted to the learning results.

[0062] After it is determined whether to perform automatic shooting, the shooting mode is then determined. Based on the state of the surrounding subject detected in step S501, it is determined whether to perform still image shooting or video shooting. For example, if the subject (person) is stationary, still image shooting is performed, and if the subject is moving, video shooting or continuous shooting is performed. The determination may be made using a neural network. In addition, it is also possible to manually change the settings of the imaging device using a dedicated application, and it is also possible to specify that only still images are to be shot, that only videos are to be shot, or that both are to be recorded.

[0063] Next, in step S508, if it is determined that a decision to shoot has been made by the automatic shooting decision in step S507 (if it is determined that automatic shooting is ON), the process proceeds to step S509. On the other hand, if it is not determined that automatic shooting is ON, the shooting mode process (this flow) is terminated.

[0064] In step S509, the first control unit 223 starts shooting. At this time, shooting is started using the shooting method determined in step S507. At this time, autofocus control is performed by the focus drive control unit 204. In addition, exposure control is performed using an aperture control unit, a sensor gain control unit, and a shutter control unit (not shown) so that the subject has appropriate brightness. Furthermore, after shooting, the image processing unit 207 performs various known image processing such as auto white balance processing, noise reduction processing, gamma correction processing, etc. to generate an image.

[0065] In the case of video shooting, as described in steps S501 to S504, framing operations are performed by pan / tilt and zoom drive based on subject detection even during shooting and recording. Search may be performed based on the importance level divided into areas as in the above-mentioned method, or large search operations may be prohibited during video. In addition, a specific subject may be registered, and video may be shot while tracking the registered subject by pan / tilt and zoom within a specified shooting area so as to keep the registered subject near the center of the screen.

[0066] Next, in step S510, the first control unit 223 uses the image processing unit 207 to perform editing processing such as processing the image generated in step S509 or adding it to the video. Specific examples of image processing include trimming processing based on a person's face or focus position, image rotation processing, HDR (high dynamic range) effect, bokeh effect, color conversion filter effect, etc. Image processing may be performed by generating multiple images based on the image generated in step S509 through a combination of the above processes and storing them separately from the image generated in step S509. Furthermore, video processing may be performed by adding a captured video or still image to the generated edited video while applying special effects such as slide, zoom, and fade.

[0067] Next, in step S511, the first control unit 223 updates the past shooting information. Specifically, the number of shots for each area described in the explanation of step S507, the number of shots for each person registered in personal authentication, the number of shots for each subject recognized by general object recognition, and the number of shots for each scene in scene determination that correspond to the image shot this time are incremented by one.

[0068] <Recalculation of importance level based on communication with other imaging devices> Next, a method for recalculating the importance level based on information acquired by the imaging device 101 of this embodiment through communication with another imaging device will be described with reference to Fig. 8. Fig. 8 is a flowchart showing a method for the imaging device 101 to recalculate the importance level from communication with another imaging device. Note that in this embodiment, an example of an operation in which imaging device A receives information from imaging device B and recalculates the importance level will be described, but imaging device B may receive information from imaging device A and recalculate the importance level. Alternatively, there may be three or more imaging devices communicating with each other, and various modifications and changes are possible within the scope of the gist of this embodiment.

[0069] Furthermore, the process of recalculating the importance level based on communication with other imaging devices may be set to be performed automatically when imaging devices equipped with the function of this embodiment are installed within a communication range, or may be started by a user operation of the external device 301. Even if multiple imaging devices are installed within a communication range, if the communication setting is OFF, each imaging device operates independently without performing the process of recalculating the importance level based on communication with other imaging devices.

[0070] 9(a)-(c) through 12(a)-(c) are examples for explaining the flowchart of Fig. 8, and show an example of the operation when imaging device A receives information from imaging device B and recalculates the importance level. Consider a case where multiple imaging devices are installed to surround a subject within a range where they can communicate with each other, and the imaging devices perform automatic framing photography while driving and controlling the tilt rotation unit 104, pan rotation unit 105, and zoom unit 201 based on the communication results.

[0071] First, in step S801, the image processing unit 207 of the imaging device A (imaging device 101) acquires the highest importance level a from the importance levels by area acquired in step S502 and the corresponding area information. That is, the image processing unit 207 acquires an evaluation value (first evaluation value) of a specific subject (first subject) from the first image data acquired by the imaging device A. FIG. 9(c) is an example showing the arrangement of the imaging devices A and B and the positional relationship with the subject when viewed from above in the direction of gravity. FIG. 9(a) shows the shooting range of the imaging device A, and FIG. 9(b) shows the shooting range of the imaging device B. At this time, the imaging device A detects people in the areas 920 and 922 by face detection processing. Also, based on the size of the subject and the distance information to the subject, the area 920 is calculated to have the highest importance level because the person in the area 920 is closer to the imaging device A. Since the imaging device A calculates the area 920 to have the highest importance level, it acquires the importance level and area information of the area 920.

[0072] Next, in step S802, the imaging device A communicates with another imaging device (imaging device B) via the communication unit 222. Then, the imaging device A acquires the distance from the imaging device B to the subject, the optical axis azimuth angle, and subject detection information (object detection information, face information, and feature information such as hue and saturation in the image).

[0073] Next, in step S803, the imaging device A judges whether the imaging device B is tracking the same subject as the subject being tracked by the imaging device A based on the distance to the subject of the imaging device B, the optical axis azimuth angle, and the subject detection information obtained in step S802. If it is judged that the subjects are the same, the process proceeds to step S804. In step S804, the imaging device A additionally acquires information of the highest importance level b from the imaging device B via the communication unit 222. That is, the imaging device A receives an evaluation value (second evaluation value) of the specific subject (first subject) acquired from image data (second image data) acquired by the imaging device B through communication with the imaging device B (another imaging device) that is tracking the specific subject (first subject). On the other hand, if it is not judged that the subjects are the same, the process ends this flow and proceeds to judgment of a manual shooting instruction in step S506.

[0074] 9(b), imaging device B calculates area 941 as the area with the highest importance, and is tracking the same subject as imaging device A. Therefore, imaging device A determines that it is tracking the same subject based on the distance to the subject, the optical axis azimuth angle, and the subject detection information received from imaging device B, and receives an importance level b for area 941 from imaging device B.

[0075] Next, in step S805, the imaging device A judges whether the importance level a of the imaging device A acquired in step S801 is greater than the importance level b of the imaging device B acquired in step S804 (a>b). If it is judged that a>b, the imaging device A can capture the characteristics of the subject better than the imaging device B. Therefore, the imaging device A ends this flow to continue capturing images without changing the tracking target area, and proceeds to the judgment of the manual shooting instruction in step S506. On the other hand, if it is judged that a≦b, the imaging device B can capture the characteristics of the subject better than the imaging device A. Therefore, the imaging device A leaves the subject capturing in the current tracking target area to the imaging device B, and allows the imaging device A to move to capturing another subject. That is, if the second evaluation value is greater than the first evaluation value, the imaging device A can change to track a second subject different from the first subject. This allows the imaging device A to capture the subjects evenly without being biased toward a specific subject, and there is a high possibility of obtaining a better overall shooting result, so the imaging device A proceeds to step S806.

[0076] In step S806, imaging device A changes the weighting of the importance level of each area and recalculates to calculate the importance level a'. That is, when the second evaluation value (importance level b) is greater than the first evaluation value (importance level a), the first control unit 223 of imaging device A changes the weighting for the first image data and recalculates the first evaluation value. For example, the importance level of area 920 may be lowered, or the importance levels of areas 911-926 excluding area 920 may be raised. When the recalculation of importance level a' is completed, the process proceeds to step S807.

[0077] In step S807, it is determined whether the importance level a' recalculated in step S806 is greater than a tracking threshold (reliability threshold, predetermined threshold). Even if imaging device A searches for another subject while leaving the shooting of the current tracking target area to imaging device B in step S805, there may be cases where there is no notable subject in another area. The tracking threshold is set to prevent imaging device A from searching an area with few features in such a situation. If it is determined that the importance level a' is greater than the tracking threshold, the process proceeds to step S808. On the other hand, if it is determined that the importance level a' is equal to or less than the tracking threshold, this flow ends and the process proceeds to determining whether to issue a manual shooting instruction in step S506.

[0078] A detailed description will be given with reference to Figs. 10(a)-(c). Figs. 10(a)-(c) show a case where the face of the subject in area 1022 is in a direction that does not appear in the image capturing device A, as compared with Figs. 9(a)-(c). In this case, it is conceivable that the importance level a' after recalculation does not exceed the tracking threshold in all areas 1011-1026, due to the subject's face in area 1022 not being visible. In such a case, this flow is terminated without reflecting the result of recalculation, and the process proceeds to manual shooting instruction determination in step S506 based on the importance level a before recalculation. Note that, as the reliability threshold, a value previously stored in memory 215 at the time of shipment may be used, or an input value from external device 301 by the user may be reflected. Also, the image capturing device A may automatically calculate the threshold based on the above-mentioned neural network.

[0079] In step S808, imaging device A determines whether the area with the highest importance level has been changed as a result of the recalculation in step S806. If it is determined that the area with the highest importance level has been changed, the process proceeds to step S809. In step S809, imaging device A changes the search target area based on importance level a'. Then, the process returns to step S503, and the imaging device A performs driving so that the search target area changed based on importance level a' is captured in the angle of view. On the other hand, if it is determined that the area with the highest importance level has not been changed, the process ends and the process proceeds to determining whether to issue a manual shooting instruction in step S506.

[0080] A detailed description will be given using Fig. 11(a) to (c) as an example. Fig. 11(a) to (c) show a case where one subject is in a position hidden behind the other subject, as opposed to Fig. 9(a) to (c). At this time, in step S806, a process is performed to lower the importance level of area 1120, or to raise the importance levels of areas 1111 to 1126 excluding area 1120. However, because one subject is in a blind spot, even if a recalculation is performed, area 1120 is calculated to have the highest importance level. In such a case, it is determined that the area with the highest importance level will not be changed.

[0081] Next, an operation when it is determined that the area with the highest importance level has been changed will be described with reference to Figs. 9(a)-(c) and 12(a)-(c). In the state of Figs. 9(a)-(c), if the importance level of area 1020 is lowered by recalculating the importance level, or the importance levels of areas 1011-1026 other than area 1020 are raised, area 922 is calculated to have the highest importance level. In such a case, area 922 is set as the search target area, and imaging device A performs pan-tilt driving so that area 922 is positioned approximately at the center of the shooting range. Figs. 12(a)-(c) show the state after the search target area is changed from Figs. 9(a)-(c) and imaging device A performs pan-tilt driving. Since imaging device A has changed the shooting range by pan-tilt driving, imaging device A tracks the subject with area 1221 as the search target area.

[0082] According to this embodiment, even if multiple imaging devices are installed and multiple subjects to be photographed exist, framing adjustment and photographing can be performed automatically without missing the subjects. In addition, in this embodiment, an example is described in which multiple imaging devices 101 having pan / tilt and zoom as shown in FIG. 1 are used, but the present invention is not limited to this. For example, an imaging device having zoom without pan / tilt, or an imaging device having pan / tilt without zoom may be used. In addition, as a part of the imaging devices, an imaging device with a fixed focal length without zoom or pan / tilt may be used. In addition, an omnidirectional imaging device having multiple imaging elements and a wide-angle optical system and photographing all directions at once may be used.

[0083] 9(a)-(c) through 12(a)-(c) show the case where a plurality of imaging devices are installed to surround a subject within a range where they can communicate with each other, and the imaging devices perform automatic framing photography based on the communication results, but the present invention is not limited to this. For example, a plurality of imaging devices may be arranged side by side in a direction perpendicular to the direction of gravity, or in the same direction as the direction of gravity.

[0084] Second embodiment <Operation when receiving power information> Next, a second embodiment of the present invention will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the operation when imaging device A receives power information of another imaging device (imaging device B). Fig. 13 differs from Fig. 8 in that steps S1301 and S1302 are added. Other flows in Fig. 13 are similar to Fig. 8, and therefore descriptions thereof will be omitted. Note that in this embodiment, as in the first embodiment, imaging device A and imaging device B can be interchanged, or three or more imaging devices may be used.

[0085] First, in step S1301, the imaging device A acquires information on the remaining battery level (battery remaining information) from the imaging device B via the communication unit 222. Next, in step S1302, the imaging device A determines whether or not the remaining battery level of the imaging device B is equal to or greater than a predetermined level. If it is determined that the remaining battery level is equal to or greater than the predetermined level, the process proceeds to step S801. On the other hand, if it is determined that the remaining battery level is less than the predetermined level, the process ends this flow and proceeds to manual shooting instruction determination in step S506. Thus, in this embodiment, the imaging device A determines whether or not to continue tracking the first subject depending on the remaining battery level of the imaging device B. Note that the processes from step S801 onwards are similar to those in the first embodiment, and therefore their description will be omitted.

[0086] In each embodiment, when the second evaluation value is greater than the first evaluation value, the imaging device A changes the weighting of the first image data and recalculates the first evaluation value, but is not limited to this. When the second evaluation value is greater than the first evaluation value, the imaging device A may change the tracking subject so as to track a second subject that shows the second highest evaluation value (the evaluation value next highest to the first evaluation value) among the multiple evaluation values ​​in the first image data.

[0087] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0088] According to each embodiment, even if multiple imaging devices are installed and the shooting conditions are changed or set by determining the range and subject to be shot by each imaging device, the hassle of missing the subject can be reduced. Therefore, according to each embodiment, it is possible to provide an imaging device that can appropriately shoot multiple subjects when shooting multiple subjects to be tracked together with another imaging device. In addition, it is possible to provide an imaging system including such an imaging device and the other imaging devices, a control method for the imaging device, and a program.

[0089] The disclosure of each embodiment includes the following configurations and methods.

[0090] (Configuration 1) an imaging means for acquiring first image data while tracking a first object; an acquisition means for acquiring a first evaluation value of the first object from the first image data; a receiving means for receiving a second evaluation value of the first object acquired from second image data acquired by another imaging device tracking the first object through communication with the other imaging device; and a control means for changing a weighting for the first image data and recalculating the first evaluation value when the second evaluation value is greater than the first evaluation value. (Configuration 2) an imaging means for acquiring first image data while tracking a first object; an acquisition means for acquiring a first evaluation value of the first object from the first image data; a receiving means for receiving a second evaluation value of the first object acquired from second image data acquired by another imaging device tracking the first object through communication with the other imaging device; and a control means capable of changing the tracking speed so as to track a second subject different from the first subject when the second evaluation value is greater than the first evaluation value. (Configuration 3) 3. The imaging device according to configuration 1 or 2, wherein the first evaluation value is the highest evaluation value among a plurality of evaluation values ​​obtained for each of a plurality of regions of the first image data. (Configuration 4) The imaging device described in configuration 3, characterized in that when the second evaluation value is greater than the first evaluation value, the control means changes a weighting for at least one of the multiple areas and recalculates the first evaluation value with the changed weighting. (Configuration 5) The imaging device described in configuration 4, characterized in that when the second evaluation value is greater than the first evaluation value, the acquisition means reduces the weighting for an area among the multiple areas in which the first subject is present. (Configuration 6) The imaging device described in configuration 4 or 5, characterized in that when the second evaluation value is greater than the first evaluation value, the acquisition means increases the weighting for an area among the multiple areas other than the area in which the first subject exists. (Configuration 7) The control means If the recalculated first evaluation value is smaller than a predetermined threshold, tracking the first object; 7. The imaging device according to any one of configurations 4 to 6, wherein, when the recalculated first evaluation value is greater than the predetermined threshold value, a second subject different from the first subject is tracked. (Configuration 8) the first evaluation value is the highest evaluation value among a plurality of evaluation values ​​obtained for each of a plurality of regions of the first image data, The imaging device described in configuration 2, characterized in that, when the second evaluation value is greater than the first evaluation value, the control means tracks the second subject that has the second highest evaluation value among the multiple evaluation values. (Configuration 9) 9. The imaging apparatus according to any one of configurations 1 to 8, wherein the control means performs subject tracking by pan / tilt driving. (Configuration 10) 10. The imaging apparatus according to any one of configurations 1 to 9, wherein the control means performs subject tracking by zoom driving. (Configuration 11) the receiving means receives information regarding a remaining battery level of the other imaging device from the other imaging device; 11. The imaging device according to any one of configurations 1 to 10, wherein the control means determines whether or not to continue tracking the first subject depending on the remaining battery power. (Configuration 12) The control means If the remaining battery charge is less than a predetermined charge, continuing to track the first object; 12. The imaging device according to configuration 11, wherein when the remaining battery charge is greater than the predetermined charge, it is possible to change to tracking a second subject different from the first subject. (Configuration 13) An imaging system having a first imaging device and a second imaging device capable of communicating with the first imaging device, 13. An imaging system, wherein the first imaging device or the second imaging device is an imaging device according to any one of configurations 1 to 12. (Method 1) acquiring a first evaluation value of a first object from first image data acquired while tracking the first object; acquiring a second evaluation value of the first object from second image data acquired by another imaging device that is tracking the first object through communication with the other imaging device; and if the second evaluation value is greater than the first evaluation value, changing a weighting for the first image data and recalculating the first evaluation value. (Method 2) acquiring a first evaluation value of a first object from first image data acquired while tracking the first object; acquiring a second evaluation value of the first object from second image data acquired by another imaging device that is tracking the first object through communication with the other imaging device; and if the second evaluation value is greater than the first evaluation value, changing the focus to track a second subject different from the first subject. (Configuration 14) A program for causing a computer to execute the method for controlling an imaging device according to the method 1 or 2.

[0091] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0092] 101 Imaging device 206 Imaging unit (imaging means) 207 Image processing unit (acquisition means) 222 Communication unit (receiving means) 223 First control unit (control means)

Claims

1. an imaging means for acquiring first image data while tracking a first object; an acquisition means for acquiring a first evaluation value of the first object from the first image data; a receiving means for receiving a second evaluation value of the first object acquired from second image data acquired by another imaging device tracking the first object through communication with the other imaging device; and a control means for changing a weighting for the first image data and recalculating the first evaluation value when the second evaluation value is greater than the first evaluation value.

2. an imaging means for acquiring first image data while tracking a first object; an acquisition means for acquiring a first evaluation value of the first object from the first image data; a receiving means for receiving a second evaluation value of the first object acquired from second image data acquired by another imaging device tracking the first object through communication with the other imaging device; and a control means for changing the tracking speed so as to track a second subject different from the first subject when the second evaluation value is greater than the first evaluation value.

3. 3. The imaging device according to claim 1, wherein the first evaluation value is the highest evaluation value among a plurality of evaluation values ​​obtained for each of a plurality of regions of the first image data.

4. The imaging device according to claim 3, characterized in that, when the second evaluation value is greater than the first evaluation value, the control means changes a weighting for at least one of the plurality of regions and recalculates the first evaluation value with the changed weighting.

5. The imaging device according to claim 4 , wherein the acquisition means reduces the weighting for an area among the plurality of areas in which the first subject is present when the second evaluation value is greater than the first evaluation value.

6. The imaging device according to claim 4, characterized in that, when the second evaluation value is greater than the first evaluation value, the acquisition means increases the weighting for an area among the plurality of areas other than the area in which the first subject is present.

7. The control means If the recalculated first evaluation value is smaller than a predetermined threshold, tracking the first object; 5. The imaging apparatus according to claim 4, wherein, when the recalculated first evaluation value is greater than the predetermined threshold value, a second subject different from the first subject is tracked.

8. the first evaluation value is the highest evaluation value among a plurality of evaluation values ​​acquired for each of a plurality of regions of the first image data, 3. The imaging device according to claim 2, wherein the control means tracks the second subject having the second highest evaluation value among the plurality of evaluation values ​​when the second evaluation value is greater than the first evaluation value.

9. 3. The imaging apparatus according to claim 1, wherein the control means performs subject tracking by pan / tilt driving.

10. 3. The imaging apparatus according to claim 1, wherein the control means performs subject tracking by zoom driving.

11. the receiving means receives information regarding a remaining battery level of the other imaging device from the other imaging device; 3. The imaging apparatus according to claim 1, wherein the control means determines whether or not to continue tracking the first subject depending on the remaining battery power.

12. The control means If the remaining battery charge is less than a predetermined charge, continuing to track the first object; 12. The imaging apparatus according to claim 11, wherein when the remaining battery charge is greater than the predetermined amount, a change to tracking of a second subject different from the first subject is made possible.

13. An imaging system having a first imaging device and a second imaging device capable of communicating with the first imaging device, 3. An imaging system, wherein the first imaging device or the second imaging device is the imaging device according to claim 1.

14. acquiring a first evaluation value of a first object from first image data acquired while tracking the first object; acquiring a second evaluation value of the first object from second image data acquired by another imaging device that is tracking the first object through communication with the other imaging device; and if the second evaluation value is greater than the first evaluation value, changing a weighting for the first image data and recalculating the first evaluation value.

15. acquiring a first evaluation value of a first object from first image data acquired while tracking the first object; acquiring a second evaluation value of the first object from second image data acquired by another imaging device that is tracking the first object through communication with the other imaging device; and if the second evaluation value is greater than the first evaluation value, changing the focus to track a second subject different from the first subject.

16. 16. A program for causing a computer to execute the method for controlling an imaging apparatus according to claim 14.

Citation Information

Patent Citations

  • Imaging apparatus and control method of the same

    JP2019106694A