Imaging system, imaging apparatus and method for controlling the same, and program

The imaging device addresses the issue of failed shots by associating subjects with wearable devices to dynamically adjust focus and shutter speed, reducing motion blur and ensuring clear images.

JP2024164514AInactive Publication Date: 2024-11-27CANON KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023080050
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing imaging technologies using non-image sensors from wearable devices for automatic photography often result in failed shots due to subjects moving out of focus or motion blur, as the imaging device adjusts aperture or focus based on inaccurate sensing signals.

Method used

An imaging device that includes a storage means to associate subjects with wearable devices, determines a main subject, receives non-image information from multiple devices, and sets appropriate imaging conditions to reduce failures by adjusting focus, shutter speed, and aperture based on movement and distance information.

Benefits of technology

Reduces the occurrence of blurred or out-of-focus images by dynamically adjusting imaging settings based on real-time data from wearable devices, ensuring clearer photographs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164514000001_ABST
    Figure 2024164514000001_ABST
Patent Text Reader

Abstract

To reduce faulty photographing when an imaging apparatus performs automatic photographing by using non-image information from devices worn on a plurality of subjects.SOLUTION: A camera 101 comprises: a lens barrel 103 that has an imaging unit 206; a memory 215 that stores a plurality of subjects and wearable devices 102 worn on the plurality of subjects in association with each other; a communication unit 222 that receives non-image information transmitted from the plurality of wearable devices 102; and a first control unit 223 that determines a main subject to be photographed from the plurality of subjects, and sets a condition for the imaging unit 206 to pick up an image of the determined main subject on the basis of the non-image information transmitted from the wearable device 102 associated with the main subject.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging system, an imaging device, and a control method and program thereof, and in particular to a technology for reducing failed photography by using a sensing signal acquired from a wearable device or the like worn by a subject during automatic photography by an imaging device. [Background technology]

[0002] There are known techniques for controlling image capture by an imaging device based on sensing signals from non-image sensors such as acceleration sensors and motion sensors. For example, Patent Document 1 discloses a technique for controlling automatic image capture by an imaging device located away from a wearable device using sensing signals from a non-image sensor included in the wearable device. Patent Document 2 discloses a technique for controlling image capture of each subject by an imaging device based on sensing signals from non-image sensors included in devices worn by each of the subjects. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-72673 A [Patent Document 2] JP 2016-82356 A Summary of the Invention [Problem to be solved by the invention]

[0004] The techniques disclosed in the above Patent Documents 1 and 2 have a problem that the following types of failed photography are likely to occur. For example, if the subject moves while the imaging device is adjusting the aperture or focus based on a sensing signal from a non-image sensor of a device worn by the subject, the subject may be photographed without being in focus. Also, if the shutter speed setting of the imaging device is not suitable for the movement of the subject, the image may contain motion blur. Therefore, there is a demand for reducing such failed photography.

[0005] The present invention aims to provide a technique for reducing failed photographs when performing automatic photographing with an imaging device using sensing signals from non-image sensors possessed by devices worn by each of a plurality of subjects. [Means for solving the problem]

[0006] The imaging device of the present invention is characterized in that it comprises an imaging means, a storage means for storing a plurality of subjects in association with a device worn by each of the plurality of subjects, a determination means for determining a main subject to be photographed from the plurality of subjects, a receiving means for receiving non-image information detected in each of the plurality of devices and transmitted from the plurality of devices, and a control means for setting the imaging conditions for the determined main subject by the imaging means based on the non-image information transmitted from the device associated with the main subject. Effect of the Invention

[0007] According to the present invention, it is possible to reduce failed photographs when performing automatic photographing with an imaging device by using non-image information from devices worn by each of a plurality of subjects. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the configuration of an imaging system according to a first embodiment. [Diagram 2]2 is a block diagram showing a schematic configuration of an imaging device (camera) and a wearable device that configure the imaging system of FIG. 1. [Diagram 3] FIG. 2 is a schematic diagram showing an example of a scene captured by the imaging system; [Figure 4] 11 is a flowchart of the operation of the wearable device. [Diagram 5] 4 is a flowchart of an automatic photographing operation of the camera. [Figure 6] 13 is a flowchart of the process of S510. [Figure 7] FIG. 11 is a block diagram showing a schematic configuration of an imaging system according to a second embodiment. [Figure 8] 8 is a schematic diagram showing an example of the configuration of the imaging system of FIG. 7. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, an imaging system will be described that performs automatic imaging using an imaging device (hereinafter, referred to as a "camera") by linking the camera with a wearable device, which is an example of a device worn by each of a plurality of subjects to be photographed.

[0010] First Embodiment FIG. 1 is a diagram showing an example of the configuration of an imaging system according to the first embodiment. FIG. 1(a) shows a simplified example of the configuration of an imaging system 100 according to the first embodiment. The imaging system 100 is configured by connecting a plurality of wearable devices 102_1 to 102_n (n: an integer equal to or greater than 2) worn by a plurality of subjects (not shown) respectively to a camera 101 so as to be able to communicate with each other via wireless communication. In the following description, when there is no particular need to distinguish between the wearable devices 102_1 to 102_n, they will be referred to as "wearable devices 102."

[0011] Camera 101 automatically captures images of multiple subjects that differ in distance to camera 101, movement, etc. Although details will be described later, camera 101 determines a main subject to be captured from the multiple subjects. Camera 101 then captures an image of the main subject under imaging conditions suitable for the main subject, based on non-image information ("sensing signal" described later) detected by a non-image sensor included in wearable device 102 worn by the main subject.

[0012] In this embodiment, the non-image sensor refers to a sensor other than an image sensor such as a CMOS sensor. The wearable device 102 may include an image sensor, but the image capturing function of the image sensor is not used in this embodiment. Specific examples of non-image sensors will be described later.

[0013] 1(b) is a schematic diagram of an imaging system 100 in which a camera 101 and two wristwatch-type (wrist-type) wearable devices 102_1 and 102_2 are connected by wireless communication. For example, Wi-Fi (registered trademark) or Bluetooth (registered trademark) is used for wireless communication between the camera 101 and the wearable devices 102_1 and 102_2, but the invention is not limited to these.

[0014] In this embodiment, a wristwatch-type wearable device 102 is illustrated, but the wearable device 102 may be any device that can be worn by the subject to be photographed. In this embodiment, a description will be given assuming a person as the subject, but in this case, examples of the wearable device 102 include wristwatch-type devices, wristband-type devices that can be worn on the upper body (including the face), earphone-type devices, eyeglass-type devices, and pin badge-type devices. Furthermore, the wearable device 102 may be held by the subject (in the hand). The subject is not limited to a person, and may also be a pet animal such as a dog or a cat.

[0015] The camera 101 includes a lens barrel 103, a fixed portion 108, an angular velocity meter 106 (gyro sensor), an accelerometer 107, another fixed portion 108, and a rotation drive mechanism. The rotation drive mechanism is made up of a tilt rotation unit 104 and a pan rotation unit 105.

[0016] The lens barrel 103 is a housing including a group of photographing lenses and an image sensor, which are imaging means, and is attached to a fixed part 108 via a rotation drive mechanism. The tilt rotation unit 104 rotates the lens barrel 103 in a pitch direction relative to the fixed part 108, and the pan rotation unit 105 rotates the lens barrel 103 in a yaw direction relative to the fixed part 108. The tilt rotation unit 104 and the pan rotation unit 105 are driven by a lens barrel rotation drive part 205 (see FIG. 2(a)), which is a motor drive mechanism. In this way, the lens barrel 103 is rotatable in the direction of one or more axes. The pitch direction, yaw direction, and X, Y, and Z axes are defined with respect to the fixed part 108.

[0017] The angular velocity meter 106 and the accelerometer 107 are mounted on the fixed part 108. The angular velocity meter 106 detects the angular velocity of the camera 101 in each of the X-axis direction, the Y-axis direction, and the Z-axis direction. The accelerometer 107 detects the acceleration of the camera 101 in each of the X-axis direction, the Y-axis direction, and the Z-axis direction. The angular velocity meter 106 and the accelerometer 107 detect the vibration of the camera 101, and the tilt rotation unit 104 and the pan rotation unit 105 are rotated based on the detected shaking angle. This makes it possible to correct the shake and tilt of the lens barrel 103, which is a movable part. Although not shown, the camera 101 is equipped with a display device equipped with a touch panel for setting imaging conditions, and various operation members such as a power button and a four-way button.

[0018] FIG. 2 is a block diagram showing a schematic configuration of the camera 101 and the wearable device 102. FIG. 2(a) shows a schematic configuration of the camera 101. The camera 101 includes a first control unit 223, a non-volatile memory 216, a zoom unit 201, a zoom drive control unit 202, a focus unit 203, a focus drive control unit 204, an imaging unit 206, an image processing unit 207, an image recording unit 208, and a memory 215. The camera 101 also includes a video output unit 217, an audio input unit 213, an audio processing unit 214, a learning processing unit 219, a recording and reproducing unit 220, a recording medium 221, a lens barrel rotation drive unit 205, a device shaking detection unit 209, a second control unit 211, a first power supply unit 210, and a second power supply unit 212. The camera 101 further includes an audio output unit 218, an LED control unit 224, a video output unit 217, a communication unit 222, and a GPS sensor 225.

[0019] The first control unit 223 is composed of a processor (e.g., a CPU, a GPU, a microprocessor, an MPU, etc.) and a memory such as a RAM (e.g., a DRAM, an SRAM, etc.). The non-volatile memory 216 is a memory such as an EEPROM that can be electrically erased and stored, and stores constants and programs for the operation of the first control unit 223. The first control unit 223 controls the overall operation of the camera 101 by the processor expanding a predetermined program stored in the non-volatile memory 216 into its own memory. The first control unit 223, the details of which will be described later, determines the imaging conditions based on the sensing signal received from the wearable device 102 and the results of luminance distribution analysis and subject region detection by the image processing unit 207 of the image acquired by the imaging unit 206.

[0020] The zoom unit 201 is held inside the lens barrel 103, and has a zoom lens that performs a variable magnification operation. The zoom drive control unit 202 receives commands from the first control unit 223 and controls the drive of the zoom unit 201. The focus unit 203 is held inside the lens barrel 103, and has a focus lens that performs focus adjustment. The focus drive control unit 204 receives commands from the first control unit 223 and controls the drive of the focus unit 203.

[0021] The imaging unit 206 has an imaging element (not shown) such as a CMOS sensor, and an A / D converter that converts an analog electrical signal output from the imaging element into a digital image signal. In the camera 101, the imaging unit 206 is a component of the lens barrel 103, but the camera 101 may be configured with a lens barrel and a camera body, with the lens barrel detachable from the camera body and the imaging unit 206 provided on the camera body.

[0022] Light passing through the lens barrel 103 and entering the imaging unit 206 forms an image on the imaging surface of the imaging element, which photoelectrically converts the optical image formed on the imaging surface to generate an analog electrical signal, and the A / D converter converts the analog electrical signal into a digital image signal and outputs it to the image processing unit 207. The image processing unit 207 performs image processing such as distortion correction, white balance adjustment, and color interpolation processing on the digital image signal transmitted from the imaging unit 206 to generate image data, and outputs it to the image recording unit 208 and the first control unit 223. The image recording unit 208 converts the image data transmitted from the image processing unit 207 into a recording format such as JPEG format, and outputs it to the memory 215 and the video output unit 217.

[0023] The audio input unit 213 has multiple microphones (not shown) provided on the camera 101, collects audio around the camera 101 using the microphones, A / D converts the collected audio signal to generate a digital audio signal, and transmits it to the audio processing unit 214. The audio processing unit 214 performs audio-related processing such as optimization processing of the input digital audio signal to generate audio data, and transmits the generated audio data to the first control unit 223. The first control unit 223 transmits the audio data acquired from the audio processing unit 214 to the memory 215.

[0024] The memory 215 temporarily stores the image data and audio data obtained by the image processing unit 207 and the audio processing unit 214. The image processing unit 207 and the audio processing unit 214 read out the image data and audio data temporarily stored in the memory 215 and perform encoding or the like on the image data and audio data, respectively, to generate compressed image data and compressed audio data. The first control unit 223 then transmits the compressed image data and compressed audio data to the recording and reproducing unit 220.

[0025] The recording and reproducing unit 220 records the compressed image data and compressed audio data generated by the image processing unit 207 and the audio processing unit 214, other control data related to shooting, and the like, on the recording medium 221. The recording and reproducing unit 220 also reads (reproduces) various data such as the compressed image data and compressed audio data recorded on the recording medium 221, and transmits them to the first control unit 223. The first control unit 223 transmits the compressed image data received from the recording and reproducing unit 220 to the image processing unit 207, and transmits the compressed audio data to the audio processing unit 214. The image processing unit 207 and the audio processing unit 214 temporarily store the compressed image data and compressed audio data in the memory 215, decode them in a predetermined procedure, and transmit the decoded signals to the video output unit 217 and the audio output unit 218, respectively.

[0026] Recording medium 221 may be built into camera 101 or may be removable, and records various data such as compressed image data and compressed audio data generated by camera 101. A medium having a larger capacity than non-volatile memory 216 is generally used as recording medium 221, and examples of such media include semiconductor memory such as flash memory (memory card), a hard disk, and an optical disk.

[0027] The lens barrel rotation drive unit 205 drives the tilt rotation unit 104 and the pan rotation unit 105 to drive the lens barrel 103 in the tilt direction and the pan direction, as described with reference to FIG. 1(b). The device vibration detection unit 209 includes an angular velocity meter 106 and an accelerometer 107. The first control unit 223 calculates the rotation angle and shift amount of the lens barrel 103 based on an output signal corresponding to the angular velocity and acceleration detected by the device vibration detection unit 209. The GPS sensor 225 acquires GPS information of the camera 101.

[0028] The second control unit 211 controls the power supply of the first control unit 223 that performs the overall control of the camera 101. The first power supply unit 210 supplies power for operating the first control unit 223, and the second power supply unit 212 supplies power for operating the second control unit 211. When a power button provided on the main body of the camera 101 is operated to turn on the power of the camera 101, power is first supplied to both the first control unit 223 and the second control unit 211. However, the first control unit 223 is controlled to immediately turn off the power supply to the first power supply unit 210. Even while the first control unit 223 is not operating, the second control unit 211 operates, and information from the device vibration detection unit 209 and the audio processing unit 214 is input to the second control unit 211. The second control unit 211 performs a process of determining whether or not to start the first control unit 223 based on various input information, and when it is determined to start the first control unit 223, it instructs the first power supply unit 210 to supply power to the first control unit 233. In this embodiment, the first power supply unit 210 is a battery. The second power supply unit 212 may be a battery, or may be a power supply supplied from a household power source, a commercial power source, a generator, or the like via an adapter or the like.

[0029] The audio output unit 218 has a speaker (not shown) and outputs audio obtained by decoding audio data. The learning processing unit 219 performs machine learning for performing sound scene recognition and imaging scene recognition. The LED control unit 224 causes an LED (not shown) provided in the camera 101 to emit light in a preset lighting / blinking pattern, for example, during shooting. The video output unit 217 has a video output terminal and outputs an image signal for displaying an image on an external device such as a display (not shown) connected to the camera 101. Note that the audio output unit 218 and the video output unit 217 may be a single combined terminal (for example, an HDMI (registered trademark) terminal).

[0030] The communication unit 222 is a wireless communication module such as an infrared communication module, a Bluetooth communication module, a wireless LAN communication module, or a Wireless USB. The communication unit 222 transmits and receives various data such as audio data, image data, compressed audio data, compressed image data, and the like, imaging start / end commands, and control signals related to imaging such as pan / tilt / zoom drive between the camera 101 and an external device (not shown). The communication unit 222 also transmits and receives information such as various parameters related to machine learning processed by the learning processing unit 219 between the external device. The first control unit 223 can perform imaging control according to a control signal received from the external device via the communication unit 222, and can also transmit information such as imaging conditions and control results to the external device via the communication unit 222.

[0031] 2(b) is a block diagram showing a schematic configuration of the wearable device 102. The wearable device 102 has a communication module 131, a power module 132, an external interface 133, a sub-camera 134, a main camera 135, a light 136, a control unit 138, a ROM 151, and a RAM 152. The wearable device 102 also has a touch screen display 141, a switch 144, an acceleration sensor 146, a depth sensor 147, and a GPS sensor, and the touch screen display 141 has a liquid crystal display 142 and a touch screen 143.

[0032] Control unit 138 is, for example, a CPU, and reads out a control program for each block of wearable device 102 from ROM 151 and loads it in RAM 152, thereby controlling the overall operation of each block of wearable device 102. ROM 151 is a non-volatile memory (for example, an EEPROM or the like) that can be electrically erased and stored, and stores operation programs for each block of wearable device 102 and parameters necessary for the operation of each block. RAM 152 is a rewritable volatile memory, and is used for loading programs executed by control unit 138 and the like, and for temporarily storing data generated by the operation of each block of wearable device 102.

[0033] The communication module 131 communicates in accordance with a predetermined wireless communication standard such as IEEE802.11 Wi-Fi, Bluetooth, or NFC. The communication module 131 only needs to support at least one of the wireless communication standards, and as described above, in this embodiment, the wearable device 102 and the camera 101 are connected to each other so that they can communicate with each other via Wi-Fi or Bluetooth. The communication module 131 transmits sensing signals from the acceleration sensor 146 and the depth sensor 147 to the camera 101.

[0034] The acceleration sensor 146 detects the direction and magnitude of acceleration acting on the wearable device 102 in three orthogonal axial directions (X, Y, and Z directions) and outputs the acceleration (m / s 2 ) as the amount of movement. Depth sensor 147 measures the distance from wearable device 102 (subject) to camera 101. Known methods can be used for distance measurement, one of which is to irradiate infrared rays, light, ultrasonic waves, etc. toward camera 101 and measure the time it takes to receive a reflected wave from camera 101. Another method for distance measurement is to detect the position of wearable device 102 and the distance from wearable device 102 as a transmitter to camera 101 as a receiver using Bluetooth, which is one of the wireless communication standards. GPS sensor 148 acquires GPS information of wearable device 102 (position information of the subject wearing wearable device 102) and transmits it to camera 101.

[0035] Power supply module 132 includes a rechargeable battery such as a lithium ion battery or a nickel metal hydride battery, and supplies power to each block of wearable device 102. External interface 133, sub-camera 134, main camera 135, and light 136 may be well-known devices, and are not directly related to the present invention, so description thereof will be omitted. In this embodiment, the imaging functions of sub-camera 134 and main camera 135 are not used.

[0036] Next, an example of the operation of the camera 101 and the wearable device 102 in the imaging system 100 will be described. FIG. 3 is a schematic diagram showing an example of a scene captured by the imaging system. The subjects A to D are respectively equipped with wearable devices 102_1 to 102_4, and are assumed to move and stand still asynchronously, and the wearable devices 102_1 to 102_4 detect information regarding the motion of the subjects A to D. The camera 101 automatically captures the subjects A to D while switching the main subject. At that time, the camera 101 receives sensing signals from the wearable devices 102_1 to 102_4, and determines imaging conditions based on the received sensing signals. The sensing signals sent by the wearable device 102 are specifically motion information of the subjects A to D, distance information to the subjects A to D, GPS information of the subjects A to D, and the like.

[0037] 3 is, for example, a play or musical in which subjects A to D are actors playing roles while moving within a certain range on stage. For ease of explanation, it is assumed that camera 101 is installed in a predetermined position and automatically captures subjects A to D while fixed. Note that the motion information of subjects A to D includes movement motions in which the geographical positions of the subject and camera 101 change relatively (regardless of whether the subject is stationary in a fixed position or moving its body) and motions in which the subject moves its body without changing its geographical position.

[0038] 4 is a flowchart of the operation of wearable device 102. Each process (step) indicated by an S number in this flowchart is realized by control unit 138 expanding a predetermined program stored in ROM 151 into RAM 152 and controlling the operation of each block of wearable device 102.

[0039] When the wearable device 102 is powered on, in S401 the control unit 138 performs a standby operation for receiving sensing signals from the acceleration sensor 146 and the depth sensor 147 in order to detect distance information and movement information of the subject.

[0040] In S402, the control unit 138 acquires a detection signal by the acceleration sensor 146 indicating the direction and magnitude of the acceleration acting on the wearable device 102 as information indicating the movement of the subject wearing the wearable device 102.

[0041] In S403, control unit 138 measures the time t taken for infrared light or the like emitted from an internal transmitter of depth sensor 147 to be reflected by camera 101 and bounce back. Then, control unit 138 calculates subject distance ds from the subject wearing wearable device 102 to camera 101 using the measured time t and the speed of light c, according to the following formula 1. Note that subject distance ds can also be calculated from GPS information acquired by camera 101 and GPS information acquired from wearable device 102, but since GPS information is not used here, it is excluded from the flowchart.

[0042]

number

[0043] In S404, the control unit 138 controls the communication module 131 to transmit the subject movement information and distance information (subject distance ds) calculated in S402 and S403 to the camera 101, and then ends this process. Note that the processes of S402 to S404 are executed at regular time intervals.

[0044] Next, a description will be given of the flow of automatic photography processing by camera 101. Fig. 5 is a flowchart of the automatic photography processing by camera 101. Each process (step) indicated by an S number in this flowchart is realized by the processor of first control unit 223 expanding a predetermined program stored in non-volatile memory 216 into the RAM of first control unit 223 and controlling the operation of each block of camera 101.

[0045] 3 (hereinafter referred to as "photographing scene X"), other photographing scenes will be mentioned as appropriate. It is assumed that the facial images of subjects A to D in photographing scene X and information (such as product ID) identifying the wearable devices 102_1 to 102_4 worn by subjects A to D are associated with each other and registered in the camera 101. It is assumed that the same value is set as the photographing priority for subjects A to D ("frequency parameter" to be described later), and that the photographing order at the start of automatic photographing is provisionally set to the order of subjects A, B, C, D, A, B, ....

[0046] Furthermore, it is assumed that a connection via wireless communication has been established between camera 101 and the multiple wearable devices 102 before the process of S501 starts, and that the process described with reference to Fig. 4 has been executed in wearable device 102. The process of S501 starts when a photographer (user) operates an operating member of camera 101 or gives an instruction to start automatic shooting to first control unit 223 from an external device via communication unit 222.

[0047] In S501, the first control unit 223 determines the state of the camera 101. The first control unit 223 determines the current vibration / movement state of the camera 101 based on the angular velocity and acceleration information acquired by the device vibration detection unit 209. For the photographed scene X, as described above, the camera 101 is installed and fixed in a predetermined position, so the device vibration detection unit 209 does not detect the angular velocity or acceleration, and therefore it is determined that the camera 101 is in a "static shooting state."

[0048] On the other hand, for example, a scene may be envisioned in which camera 101 is attached to a moving object such as a crane used for filming a movie (moving image) to film an actor wearing wearable device 102. In this case, since shaking detection unit 209 detects a certain amount of angular velocity and / or acceleration and there is a high probability that the movement of the position of camera 101 can be confirmed from GPS information, it is determined to be in a "moving state." Also, if there is no change in the position of camera 101 but shaking is detected, it is determined to be in a "handheld state."

[0049] In S502, the first control unit 223 calculates the image shake compensation amount of the camera 101. The first control unit 223 calculates the absolute angle of the camera 101 based on the angular velocity and acceleration information acquired by the device shake detection unit 209, and calculates an image shake compensation angle for driving the tilt rotation unit 104 and the pan rotation unit 105 in an angular direction that cancels the absolute angle as the image shake compensation amount. Since the camera 101 in the shooting scene X is in a stationary shooting state, the image shake compensation amount calculated in S502 is substantially zero (0), and image shake compensation control is not required. When the camera is moving or handheld, image shake compensation control is performed with the calculated image shake compensation amount.

[0050] In S503, the first control unit 223 reads the frequency parameter. The frequency parameter is a setting value indicating the priority of automatic photography. For subjects for which the same frequency parameter value is set, a provisional photography order is set. For photography scene X, as described above, the same value is set for the frequency parameters of subjects A to D, and the photography order is set to subjects A, B, C, D, A, B, .

[0051] In S504, the first control unit 223 performs subject search by image recognition processing using the image processing unit 207. Specifically, under the control of the first control unit 223, the image processing unit 207 performs image processing on the imaging signal output from the imaging unit 206 to generate an image for subject detection, detects people and objects from the generated image for subject detection, and searches for a subject to be photographed.

[0052] In the case of photographing scene X, the facial images of subjects A to D are registered in the camera 101, and the first subject to be photographed is set to be subject A. In the first S504, subject A is detected by comparing the facial pattern of the person detected from the subject detection image with the facial pattern of subject A registered in advance and calculating the degree of match, etc.

[0053] In S505, the first control unit 223 performs pan / tilt driving as necessary, changes the shooting direction, and attempts to detect the main subject. If the subject to be shot (hereinafter referred to as the "main subject", and the main subject at the time of the first S505 in the case of shooting scene X is subject A) is detected in the immediately preceding S504, this step can be omitted. On the other hand, if the main subject is not detected in the immediately preceding S504, the first control unit 223 controls the driving of the tilt rotation unit 104 and the pan rotation unit 105 via the lens barrel rotation driving unit 205 at a predetermined search angle. When the tilt rotation unit 104 and the pan rotation unit 105 are driven, the image processing unit 207 performs face recognition processing on the image obtained from the imaging unit 206, thereby attempting to detect the main subject. A predetermined angle can be used as the predetermined search angle.

[0054] In this embodiment, the characteristic control performed by camera 101 based on the sensing signal acquired from wearable device 102 worn by the subject is to determine the imaging conditions for main shooting (S608) described later. However, the search angles of tilt rotation unit 104 and pan rotation unit 105 may be set based on information transmitted from wearable device 102 worn by the main subject, which makes it possible to efficiently search for the main subject.

[0055] Note that a configuration may be adopted in which one or more cameras (imaging devices) equipped with a wide-angle lens or a camera (imaging device) capable of omnidirectional imaging is installed separately from camera 101, the main subject is searched for from images acquired by these search cameras, and the search results are transmitted to camera 101. Camera 101 can detect the main subject by performing pan / tilt drive based on information from the search cameras.

[0056] In S506, the first control unit 223 controls the zoom unit 201 as necessary to perform zoom driving. If the face of the main subject in the image becomes smaller and falls below the minimum detectable size, the main subject will be lost, so the first control unit 223 controls the zoom to the telephoto side to increase the size of the face of the main subject in the image. Conversely, if the face of the main subject in the image is too large, the main subject will be more likely to fall out of the angle of view due to the movement of the subject or camera 101, so the first control unit 223 controls the zoom to the wide-angle side to decrease the size of the face of the main subject on the screen. By performing zoom control in this manner, it is possible to maintain a state suitable for tracking the main subject.

[0057] In S507, first control unit 223 executes an image capturing process for the main subject. Details of the image capturing process in S507 will be described later.

[0058] In S508, the first control unit 223 refers to the shooting end conditions related to the shooting time and the number of shot images set before the start of automatic shooting, and judges whether the shooting end conditions have been reached. Examples of cases in which the shooting end conditions have been reached and the automatic shooting ends include the following first to fourth examples. The first example is a case in which the number of shot images for each of a plurality of subjects reaches a preset value, and the next shooting candidate (next main subject) is not determined in S609 described later. The second example is a case in which a predetermined shooting time has ended. The third example is a case in which there is a shortage of free space for saving the shot images in the recording medium 221. The fourth example is a case in which the user inputs to stop continuous shooting via the operation member of the camera 101 or via the communication unit 222. If the first control unit 223 judges that the shooting end conditions have been reached (YES in S508), it terminates the automatic shooting process, and if it judges that the shooting end conditions have not been reached (NO in S508), it executes the process of S501.

[0059] 6 is a flowchart showing details of the photographing process of S507. In S601, the first control unit 223 starts preparatory photographing. Specifically, the first control unit 223 drives the focus lens to focus on the main subject area. In the first S601 for photographing scene X, since subject A has been captured within the photographing angle of view by S506, focusing operation on the face of subject A is performed.

[0060] Also, in S601, the image processing unit 207 calculates the average brightness of the main subject region including the in-focus region. Then, based on the obtained calculation result, the first control unit 223 determines the shutter speed, ISO sensitivity, aperture value F, etc. so that the main subject region has a preset brightness value. At that time, in this embodiment, it is assumed that automatic shooting is performed in aperture priority mode. Therefore, the value of aperture value F that was previously set by the user is maintained as much as possible, and the shutter speed and ISO sensitivity are changed to maintain proper exposure. However, the aperture value F is changed as necessary.

[0061] In this embodiment, while performing image recognition so that at least the face of the main subject is captured, subject tracking is performed by zoom driving or pan / tilt driving as necessary. When taking a picture so that the upper body or the whole body is captured, zoom driving or pan / tilt driving is performed by detecting the body part, but these controls can be performed using known technology and are not the gist of the present invention, so explanations are omitted.

[0062] In S602, the first control unit 223 calculates the depth of field DOF based on the settings of the camera 101 at that time, and temporarily stores the calculation result in a RAM (or memory 215) provided in the first control unit 223. The depth of field DOF can be calculated by the following formula 2 using the aperture value F, focal length f, subject distance a, and permissible circle of confusion d specific to the camera 101 that are set when S602 is executed.

[0063]

number

[0064] In S603, first control unit 223 calculates threshold value TH_M for determining the movement of the main subject based on the settings of camera 101, and temporarily stores the calculation result in RAM (or memory 215) provided in first control unit 223. Threshold value TH_M can be found from the following formula 3 using reference value H (μm) of the image plane movement amount of the main subject and shutter speed T (s) of camera 101 at this point in time. For example, assume that the reference value of the image plane movement amount is set to 30 μm in 35 mm conversion, and shutter speed T is set to 1 / 60 s. In this case, if the sensing signal from acceleration sensor 146 of wearable device 102 worn by the main subject is 72 mm / s, 2 If the difference is greater than , the main subject is determined to be moving, regardless of the change in position.

[0065]

number

[0066] In S604, the first control unit 223 receives the subject's movement information V(n) and distance information L(n), which are sensing signals transmitted from the wearable device 102 worn by the main subject, via the communication unit 222, and stores them in the memory 215. 'n' is the identification number of the wearable device 102 (in the case of photographed scene X, n=1, 2, 3, 4). For example, when subject A is the main subject in photographed scene X, the camera 101 receives the sensing signal from the wearable device 102_1 and stores it in the memory 215.

[0067] In S605, the first control unit 223 determines a value of the DOF flag for the main subject. Based on the distance information L(n) of the main subject acquired in S604, the focal position of the camera 101, and the depth of field DOF calculated in S602, the first control unit 223 determines whether the main subject is within the range of the depth of field DOF of the camera 101. A value indicating the determination result is assigned to the DOF flag. Note that the focal position of the camera 101 indicates the distance from the main subject focused on by the camera 101 to the imaging plane of the camera 101, and corresponds to the subject distance a in the above formula 2.

[0068] In determining whether the main subject is within the range of the depth of field DOF, first, the subject distance a used when the depth of field DOF was calculated in S602 and the corresponding depth of field DOF are read from the RAM (or memory 215) included in the first control unit 223. Then, it is determined whether the distance information L(n) acquired in S604 satisfies the following formula 4.

[0069] When first control unit 223 determines that the following formula 4 is satisfied, it determines that the main subject is within the range of the depth of field DOF, and sets the value of the DOF flag to '1'. On the other hand, when first control unit 223 determines that the following formula 4 is not satisfied, it determines that the main subject is outside the range of the depth of field DOF, and sets the value of the DOF flag to '0'. First control unit 223 associates (links) the determined DOF flag value with the identification number n of the main subject, and stores it in RAM (or memory 215) provided in first control unit 223.

[0070]

number

[0071] In S606, first control unit 223 determines the value of a motion flag (hereinafter referred to as "MV flag") for the main subject. Specifically, first control unit 223 determines whether the main subject is moving or stationary based on the motion information V(n) of the main subject acquired in S604 and the threshold value TH_M calculated in S603. First control unit 223 determines whether motion information V(n) satisfies the following formula 5 or not, and if it is determined that the following formula 5 is satisfied, it determines that the main subject is stationary and sets the value of the MV flag of the main subject to '0'. On the other hand, if it is determined that the following formula 5 is not satisfied, it determines that the main subject is moving and sets the value of the MV flag of the main subject to '1'. First control unit 223 associates the determined MV flag value with the identification number n of the main subject and stores it in the RAM (or memory 215) provided in first control unit 223.

[0072]

number

[0073] In S607, first control unit 223 analyzes the DOF flag and MV flag of the main subject to determine the imaging conditions. Specifically, the combination of the DOF flag value (0,1) and the MV flag value (0,1) is classified into four categories. First control unit 223 determines which of the four categories the combination of the DOF flag value and the MV flag value of the main subject belongs to.

[0074] Here, four categories classified according to combinations of the DOF flag value and the MV flag value, and an example of setting the imaging conditions for each category will be described.

[0075] The case where 'DOF flag = 0 and MV flag = 0' is a first category. A main subject belonging to the first category is considered to be stationary within the range of the depth of field DOF of the camera 101. The case where 'DOF flag = 0 and MV flag = 1' is a second category. A main subject belonging to the second category is considered to be moving within the range of the depth of field DOF of the camera 101. The case where 'DOF flag = 1 and MV flag = 0' is a third category. A main subject belonging to the third category is considered to be stationary outside the range of the depth of field DOF of the camera 101. The case where 'DOF flag = 1 and MV flag = 1' is a fourth category. A main subject belonging to the fourth category is considered to be moving outside the range of the depth of field DOF of the camera 101.

[0076] In this embodiment, regardless of which of the first to fourth categories the main subject belongs to, the imaging conditions of the camera 101 are determined for the purpose of capturing an image in focus on the main subject while suppressing blurring and shaking. For this reason, at least one of the drive of the focus lens and the setting of the shutter speed is set as a control item. When it is necessary to adjust the exposure level and S / N ratio of the captured image in conjunction with these control items, the settings of the ISO sensitivity, noise reduction, sharpness, etc. are changed without changing the aperture value F as much as possible.

[0077] If the main subject belongs to the first category, the main subject is stationary within the range of the depth of field DOF, so the focus lens is not driven and the shutter speed is not changed, and the process proceeds to S608.

[0078] If the main subject belongs to the second category, the main subject is moving within the range of the depth of field DOF, so the focus lens is not driven, the shutter speed is increased (the exposure time is shortened), and the ISO sensitivity is increased as necessary to adjust the exposure, and the process proceeds to S608. For example, the first control unit 223 calculates a shutter speed that does not cause blurring based on the motion information V(n) of the main subject. Specifically, the shutter speed S2 is calculated by the following formula 6 using the motion information V(n) and a reference value H (μm) of the amount of image plane movement that is recognized as blurring.

[0079] In order to reduce blurring, the shutter speed S2 is set to a value shorter than the shutter speed S previously set in the camera 101. In this embodiment, the camera 101 operates in aperture priority mode, so that the value specified by the user must be given priority for the aperture value F. Therefore, the first control unit 223 adjusts the underexposure caused by the change in the shutter speed by converting it into an amplification gain of the ISO sensitivity using the following formula 7, for example, so that underexposure does not occur.

[0080]

number

[0081] If the main subject belongs to the third category, since the main subject is stationary outside the range of the depth of field DOF, the focus lens is driven, the imaging conditions are changed as necessary, and the process proceeds to S608. The first control unit 223 calculates the difference between the distance information L(n) of the main subject and the subject distance a corresponding to the focal position of the camera 101 at that time by the following formula 8, and drives the focus lens so that the main subject is in focus. At this time, the image processing unit 207 analyzes the captured image and determines whether or not the exposure level of the captured image has become excessive or insufficient due to the change in the focal position. If it is determined that the exposure level of the captured image has become excessive or insufficient, the first control unit 223 maintains the aperture value F as much as possible and adjusts the shutter speed and / or ISO sensitivity so that the exposure level is appropriate.

[0082]

number

[0083] If the main subject belongs to the fourth category, the main subject moves outside the range of the depth of field DOF, so the focus lens is driven and the imaging conditions are changed. In the fourth category, the position of the main subject may continue to change in the depth direction, so the first control unit 223 changes the aperture value F to a larger value so that the main subject fits within the range of the depth of field even if the main subject moves. Note that while the aperture value F is being changed, the first control unit 223 does not perform the actual shooting in the next S608 because there is a possibility that blurring may remain in the main subject, and performs the actual shooting in the next S608 after the change of the aperture value F is completed. Also, if the main subject belongs to the fourth category, the first control unit 223 calculates a shutter speed at which the main subject is not blurred based on the movement information V(n) and changes to the obtained shutter speed. The method of changing the shutter speed and the associated change of the ISO sensitivity for exposure adjustment can be performed in the same manner as in the case of the second category.

[0084] In S608, the first control unit 223 performs actual shooting of the main subject, that is, shooting under shooting conditions adjusted in S607 according to the category to which the main subject belongs. The number of images shot in S608 may be a fixed number (regardless of whether it is a single or multiple) regardless of which category the main subject belongs to among the first to fourth categories, or may be changed for each category. For example, when the main subject belongs to the first and third categories in which it is determined that the main subject is stationary, it is assumed that there is little possibility that the shot image will be blurred or blurred, so one image (one shot (it is not necessary that only the main subject is shot)) may be shot. However, even when the main subject belongs to the first and third categories, there is a possibility that the main subject may suddenly move, so a predetermined number of images may be shot continuously. When the main subject belongs to the second or fourth category in which it is determined that the main subject is moving, it is desirable to shoot a predetermined number of images continuously, and this is expected to reduce failed shooting with blurred or blurred images.

[0085] The number of captured images in S608 is counted for each subject by a captured image counter, and the count value is stored in a RAM (or memory 215) provided in first control unit 223. Then, in S608, first control unit 223 further increments and updates the count value stored in association with identification number n of the main subject by the number of captured images of the main subject in S608, and stores it.

[0086] In S609, the first control unit 223 determines the subject with the smallest count value of the number of captured images as the next capture candidate (next main subject). If there are subjects with the same count value, the next main subject is determined according to the capture order set in advance. For example, after the first capture of subject A in the capture scene X, the count values ​​of subjects B, C, and D are all the same, zero (0), so subject B is determined to be the next main subject.

[0087] It is assumed that the next main subject will be the same as the current main subject. In this case, the subject with the second smallest count value may be set as the next main subject. In addition, when the main subjects of the first and third categories are set to be captured in one shot and the main subjects of the second and fourth categories are set to be captured in a predetermined number of images, there is a possibility that the subjects may be divided into those for which one-shot photography is mainly performed and those for which continuous photography is mainly performed. In this case, if the subject with the smallest count value is determined as the next subject, the interval between the photographing of the subject for which continuous photography is mainly performed will be long, so the next main subject may be determined without changing the photographing order set in advance, regardless of the count value.

[0088] In S610, first control unit 223 sends a control signal via communication unit 222 to wearable device 102 worn by the next main subject determined in S609. An example of the control signal at this time is a command signal for increasing the frequency of information acquisition by various sensors of wearable device 102 and information transmission to camera 101. Because the number of captured images of the next main subject is small, by increasing the frequency of information acquisition from wearable device 102 worn by the next main subject, it becomes possible to image the next main subject under more appropriate conditions.

[0089] When the process of S610 ends, the first control unit 223 performs the determination process of S507. As described above, when the shooting end condition of S507 is satisfied, the automatic shooting ends. If the shooting end condition of S507 is not satisfied, the next main subject determined in S609 is searched for in S504 and imaged in S507. Note that after the process returns from S508 to S501, the process of S503 is omitted.

[0090] As described above, in this embodiment, camera 101 determines the imaging conditions for the main subject by using information about the movement of the main subject acquired from wearable device 102 worn by the main subject and information about the distance to camera 101. This makes it possible to capture images with reduced blurring and shaking, thereby reducing failed images.

[0091] In the above embodiment, the same value is set for the shooting priority (frequency parameter) of the subjects A to D in the shooting scene X. This makes it possible to obtain the shot images of the subjects A to D equally. On the other hand, for example, for the subjects A to D, the subject A is the main character, and the subjects B to D are supporting characters, and there is a case where the number of shot images of the main subject A is desired to be increased. If, for example, options of "low", "medium", and "high" are prepared as the frequency parameters, the number of shot images of the main character can be made greater than that of the supporting characters by setting the frequency parameter of the main character to "high" and the frequency parameters of the multiple supporting characters to "low" (or "medium"). In this case, in S609, control may be performed to determine the next main subject so that the count value of the number of shot images of the subjects B to D is about 30% (or 60%) of the count value of the number of shot images of the subject A.

[0092] The automatic photographing by the camera 101 described with reference to FIG. 5 and FIG. 6 may be supplemented with the following first to third controls (executed in parallel). The first control is a control that provides a predetermined time interval between the photographing process of S507 and the start of the next photographing process of S507. The second control is a control that alternately photographs an image mainly of the face, an image mainly of the upper body, and an image mainly of the whole body when the same subject becomes the main subject in sequence. The third control is a control that photographs a person who is the main subject while capturing another person (e.g., at least one of subjects B to D in the photographing scene X) who is adjacent to the main subject (e.g., subject A in the photographing scene X) and may become the main subject, within the photographing angle of view. In this case, the person who is the main subject and another person are detected in S504, and sensing signals are received from the wearable devices worn by these people in S507, and it is determined whether these people belong to the same category or not. If these people belong to the same category, the main shooting in S608 is performed under imaging conditions suitable for that category, and the number of images captured of each of these people is counted. On the other hand, if these people do not belong to the same category, the main shooting in S608 is performed under imaging conditions suitable for the category to which the main subject belongs, and the number of images captured of other people is not counted.

[0093] <Second embodiment> Fig. 7 is a block diagram showing a schematic configuration of an imaging system 150 according to the second embodiment. The imaging system 150 is configured by connecting a camera 101 and a plurality of wearable devices 102_1 to 102_n worn by a plurality of subjects to an external server 700 so as to be able to communicate with the external server 700. Fig. 8 is a schematic diagram showing the configuration of the imaging system 150, showing a state in which the camera 101 and two wristwatch-type wearable devices 102_1 and 102_2 are connected to the external server 700 via wireless communication.

[0094] The external server 700 is an example of an information processing device, and includes a control unit 701, a ROM 702, a RAM 703, an image processing unit 704, a storage unit 705, an analysis processing unit 706, and a communication unit 707. In the external server 700, the control unit 701 acquires motion information and distance information of the subject from the multiple wearable devices 102 via the communication unit 707, and the analysis processing unit 706 analyzes the acquired information. The control unit 701 of the external server 700 determines the imaging conditions of the camera 101 based on the analysis results by the analysis processing unit 706, generates a control signal for the camera 101 to image the main subject under the determined imaging conditions, and transmits the generated control signal to the camera 101. As a result, the camera 101 performs imaging according to the control signal received from the external server 700. When a predetermined time has elapsed after transmitting the control signal to the camera 101, the control unit 701 of the external server 700 determines the next main subject, assuming that imaging has been performed by the camera 101. However, this is not limited to the above, and the camera 101 may perform shooting in accordance with a control signal received from the external server 700, and then notify the external server 700 of the shooting results, and the external server 700 may receive the notification from the camera 101 and determine the next main subject.

[0095] The functions of the other blocks in the external server 700 in this embodiment are equivalent to the functions of the blocks in the camera 101 described with reference to Fig. 2(a), and therefore a description thereof will be omitted. Also, the camera 101 and the wearable device 102 are similar to those in the first embodiment, except that the connection destination for wireless communication is the external server 700, and therefore a description thereof will be omitted. The contents of the process that the external server 700 executes to analyze various information acquired from the wearable device 102 and control moving image capture under the imaging conditions of the camera 101 are similar to the process of the camera 101 in the first embodiment, and therefore a description thereof will be omitted.

[0096] The control signal for the camera 101 may be generated by the analysis processing unit 706 instead of the control unit 701. The imaging system 150 according to the second embodiment configured as described above can achieve the same effects as the imaging system 100 according to the first embodiment.

[0097] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An imaging device comprising: an imaging means; a storage means for storing a plurality of subjects in association with a device worn by each of the plurality of subjects; a determination means for determining a main subject to be photographed from the plurality of subjects; a receiving means for receiving non-image information detected in each of the plurality of devices and transmitted from the plurality of devices; and a control means for setting imaging conditions for the determined main subject by the imaging means based on the non-image information transmitted from the device associated with the main subject. (Configuration 2) The imaging device according to configuration 1, wherein the non-image information includes at least one of information on the movement of the main subject and information on the distance from the main subject to the imaging device. (Configuration 3) The imaging device according to Configuration 2, further comprising a classification means for classifying characteristics of the main subject into a first category in which the main subject is deemed to be stationary within the range of the depth of field of the imaging means, a second category in which the main subject is deemed to be moving within the range of the depth of field, a third category in which the main subject is deemed to be stationary outside the range of the depth of field of the imaging means, and a fourth category in which the main subject is deemed to be moving outside the range of the depth of field based on non-image information from a device associated with the main subject. (Configuration 4) The imaging device described in Configuration 3, characterized in that when the main subject belongs to the first category, the control means does not move a focus lens provided in the imaging means and does not change the shutter speed, when the main subject belongs to the second category, does not move the focus lens, sets a shorter shutter speed and increases the ISO sensitivity, when the main subject belongs to the third category, drives the focus lens to focus on the main subject, and when the main subject belongs to the fourth category, drives the focus lens to focus on the main subject and changes the aperture value to a larger value. (Configuration 5) The imaging device described in Configuration 3 or 4, characterized in that the control means does not change the aperture value of the imaging means when the main subject belongs to the first category, the second category, or the third category. (Configuration 6) The imaging device described in configuration 4 or 5, characterized in that the imaging means has a focus lens, and the control means, when the main subject belongs to the third category or the fourth category, determines whether or not the exposure level has been caused to be excessive or insufficient by driving the focus lens, and adjusts at least one of the shutter speed and ISO sensitivity so that the exposure level is appropriate if it is determined that the exposure level has been caused to be excessive or insufficient. (Configuration 7) An imaging device as described in any one of configurations 1 to 6, further comprising a counting means for counting the number of captured images of each of the plurality of subjects, and wherein the determination means determines the subject having the least number of captured images from among the plurality of subjects excluding the main subject as the next main subject. (Configuration 8) The imaging device described in Configuration 7, characterized in that the control means sends a command signal to a device associated with the next main subject to increase the frequency of transmitting non-image information from that device to the imaging device. (Configuration 9) An imaging device as described in any one of configurations 1 to 8, comprising a detection means for detecting the main subject from an image obtained by the imaging means, and a drive means for changing the shooting direction by the imaging means, wherein the control means drives the drive means to perform tracking to capture the main subject within the shooting angle of view of the imaging means. (Configuration 10) The imaging device according to configuration 9, wherein the control means drives the drive means to search for the main subject when the detection means is unable to detect the main subject within the shooting angle of view. (Configuration 11) A program for causing a computer to function as each of the means of the imaging device according to any one of configurations 1 to 10. (Configuration 12) An imaging system having an imaging device and a plurality of devices attached to each of a plurality of subjects, wherein the device comprises an acquisition means for acquiring non-image information of the subject wearing the device, and a transmission means for transmitting the non-image information to the imaging device, and the imaging device comprises an imaging means, a receiving means for receiving non-image information transmitted from the plurality of devices, a memory means for storing the plurality of subjects in association with the device worn by each of the plurality of subjects, a determination means for determining a main subject to be photographed from the plurality of subjects, and a control means for setting the imaging conditions for the determined main subject by the imaging means based on the non-image information transmitted from the device associated with the main subject. (Configuration 13) An imaging system having an imaging device equipped with an imaging means, a plurality of devices attached to each of a plurality of subjects, and an information processing device connected to the imaging device and the plurality of devices so as to be able to communicate with the imaging device, wherein the device comprises an acquisition means for acquiring non-image information of the subject wearing the device, and a transmission means for transmitting the non-image information to the information processing device, and the information processing device comprises a receiving means for receiving the non-image information transmitted from the plurality of devices, a storage means for storing the plurality of subjects in association with the device worn by each of the plurality of subjects, a determination means for determining a main subject to be photographed from the plurality of subjects, a setting means for setting imaging conditions for the determined main subject by the imaging means based on the non-image information transmitted from the device associated with the main subject, and a transmission means for transmitting the imaging conditions to the imaging device, wherein the imaging device comprises a control means for controlling the imaging means to image the main subject under the imaging conditions received from the information processing device. (Method 1) A control method for an imaging device, comprising the steps of: storing a plurality of subjects in association with a device worn by each of the plurality of subjects; determining a main subject to be photographed from the plurality of subjects; receiving non-image information detected in each of the plurality of devices and transmitted from the plurality of devices; setting imaging conditions for the determined main subject by an imaging means based on the non-image information transmitted from the device associated with the main subject; and imaging the main subject by the imaging means under the imaging conditions.

[0098] Although the present invention has been described in detail above based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0099] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0100] 100,150 Imaging system 101 Imaging device (camera) 102 Wearable Devices 103 Telescope tube 131 Communication Module 138 Control Unit 146 Acceleration Sensor 147 Depth Sensor 223 First Control Section 203 Focus Unit 206 Imaging unit 207 Image Processing Unit 222 Communications Department 700 External Server 701 Control Unit 706 Analysis Processing Section

Claims

1. An imaging means; A storage means for storing a plurality of subjects and a device worn by each of the plurality of subjects in association with each other; A determination means for determining a main subject of a photographing target from the plurality of subjects; a receiving means for receiving non-image information detected in each of the plurality of devices and transmitted from the plurality of devices; and a control unit that sets imaging conditions for the determined main subject by the imaging unit based on non-image information transmitted from a device associated with the main subject.

2. The imaging device according to claim 1 , wherein the non-image information includes at least one of information regarding a movement of the main subject and information regarding a distance from the main subject to the imaging device.

3. 3. The imaging device according to claim 2, further comprising a classification means for classifying the characteristics of the main subject into a first category in which the main subject is deemed to be stationary within the range of the depth of field of the imaging means, a second category in which the main subject is deemed to be moving within the range of the depth of field, a third category in which the main subject is deemed to be stationary outside the range of the depth of field of the imaging means, and a fourth category in which the main subject is deemed to be moving outside the range of the depth of field, based on non-image information from a device associated with the main subject.

4. The control means When the main subject belongs to the first category, the focus lens of the imaging means is not moved and the shutter speed is not changed; If the main subject belongs to the second category, the focus lens is not moved, the shutter speed is set to a shorter value, and the ISO sensitivity is increased; If the main subject belongs to the third category, the focus lens is driven to focus on the main subject; 4. The imaging apparatus according to claim 3, wherein, when the main subject belongs to the fourth category, the focus lens is driven to bring the main subject into focus, and an aperture value is changed to a larger value.

5. 5. The imaging apparatus according to claim 3, wherein the control means does not change an aperture value of the imaging means when the main subject belongs to the first category, the second category, or the third category.

6. The imaging means has a focus lens, The imaging device described in claim 4 or 5, characterized in that when the main subject belongs to the third category or the fourth category, the control means determines whether or not the exposure level has been caused to be excessive or insufficient by driving the focus lens, and if it is determined that the exposure level has been caused to be excessive or insufficient, adjusts at least one of the shutter speed and ISO sensitivity so that the exposure level is appropriate.

7. a counting unit for counting the number of captured images of each of the plurality of subjects, 3. The imaging apparatus according to claim 1, wherein the determining unit determines, from among the plurality of subjects excluding the main subject, a subject having the smallest number of captured images as the next main subject.

8. 8. The imaging device according to claim 7, wherein the control means transmits a command signal to a device associated with the next main subject to increase the frequency with which the device transmits non-image information to the imaging device.

9. a detection means for detecting the main subject from an image obtained by the imaging means; a driving means for changing a photographing direction of the imaging means, 3. The imaging apparatus according to claim 1, wherein the control means drives the driving means to perform tracking so as to capture the main subject within a photographing angle of view of the imaging means.

10. 10. The imaging apparatus according to claim 9, wherein the control means drives the drive means to search for the main subject when the detection means is unable to detect the main subject within the photographing angle of view.

11. A control method for an imaging device, comprising: storing a plurality of subjects and a device worn by each of the plurality of subjects in association with each other; determining a main subject of a photographing target from the plurality of subjects; receiving non-image information detected at and transmitted from each of the plurality of devices; setting an imaging condition for the determined main subject by an imaging means based on non-image information transmitted from a device associated with the main subject; and a step of causing the imaging means to image the main subject under the imaging conditions.

12. A program for causing a computer to function as each of the means of the imaging apparatus according to claim 1.

13. An imaging device; a plurality of devices attached to each of a plurality of subjects, The device comprises: An acquisition means for acquiring non-image information of a subject wearing the device; a transmitting means for transmitting the non-image information to the imaging device, The imaging device includes: An imaging means; a receiving means for receiving non-image information transmitted from the plurality of devices; a storage means for storing the plurality of subjects and a device worn by each of the plurality of subjects in association with each other; A determination means for determining a main subject of a photographing target from the plurality of subjects; and a control unit that sets imaging conditions for the determined main subject by the imaging unit based on non-image information transmitted from a device associated with the main subject.

14. An imaging device including an imaging means; A plurality of devices each attached to a plurality of subjects; An imaging system including the imaging device and an information processing device communicably connected to the plurality of devices, The device comprises: An acquisition means for acquiring non-image information of a subject wearing the device; a transmitting means for transmitting the non-image information to the information processing device, The information processing device includes: a receiving means for receiving non-image information transmitted from the plurality of devices; a storage means for storing the plurality of subjects and a device worn by each of the plurality of subjects in association with each other; A determination means for determining a main subject of a photographing target from the plurality of subjects; a setting unit that sets an image capturing condition of the determined main subject by the image capturing unit based on non-image information transmitted from a device associated with the main subject; a transmission means for transmitting the imaging conditions to the imaging device, The imaging device includes: an imaging system comprising: a control unit that controls the imaging unit so as to image the main subject under the imaging conditions received from the information processing device;

Citation Information

Patent Citations

  • System, device and control method

    JP2016072673A

  • Electronic apparatus and program

    JP2016082356A