Imaging apparatus

Abstract

To automatically track a subject to perform panoramic photographing when automatic photography is performed using an imaging apparatus with a pan / tilt mechanism.SOLUTION: A processing method for automatic panoramic photographing in an imaging apparatus capable of automatically operating in a pan direction, which detects position information of a subject to determine whether the subject has moved, and automatically starts panoramic photographing when the movement of the subject is slower than the pan speed of the imaging apparatus.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an imaging device.

Background Art

[0002] In recent years, cameras that automatically take pictures without the user performing a shooting operation have been put into practical use. For example, there are life log cameras that automatically repeat shooting at regular intervals, and automatic shooting cameras that appropriately control panning, tilting, and zooming and automatically recognize surrounding subjects for shooting.

[0003] When recognizing a subject in such an automatic shooting camera, it is common to detect a person's face and use detection information such as its size and position. However, for example, when trying to shoot a scene where a child is playing with a toy, the child may be so engrossed in the toy that they do not raise their face, resulting in the child's face not being detected and the timing of automatic shooting being missed.

[0004] As another method for detecting a subject, there is a method of detecting the direction of an RFID (Radio Frequency Identifier) tag held by the subject. As a technique for detecting and shooting a subject using an RFID tag, Patent Document 1 and Patent Document 2 disclose a method of detecting the direction of an RFID tag held by a subject and maintaining the state in which the camera faces the direction of the subject. Further, Patent Document 2 discloses a method of directing the camera toward the direction of a wireless tag held by a subject and performing shooting when the subject is detected.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, when performing automatic shooting using an imaging device having a pan-tilt mechanism, there is a problem that the subject can be shot only at a certain angle of view.

[0007] An object of the present invention is to provide an imaging device capable of automatically tracking a subject and shooting a panoramic image when performing automatic shooting using an imaging device having a pan-tilt mechanism.

Means for Solving the Problems

[0008] In order to solve the above problems, the imaging device of the present invention includes imaging means for imaging a subject, rotation means for rotating the imaging means in the pan direction, detection means for detecting the position of the subject, and when it is detected by the detection means that the position of the subject has moved, comparison means for comparing the moving speed of the subject with the pan speed of the rotation means, and control means for controlling to start panoramic shooting when it is determined by the comparison means that the moving speed of the subject is slower than the pan speed of the rotation means.

Effects of the Invention

[0009] According to the present invention, it is possible to provide an imaging device capable of automatically tracking a subject and shooting a panoramic image using an imaging device having a pan-tilt mechanism.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Mode for Carrying Out the Invention

[0011] Hereinafter, preferred embodiments of the present invention will be described in detail based on the accompanying drawings.

[0012] Note that the embodiments described below are examples of means for realizing the present invention, and may be appropriately modified or changed depending on the configuration and various conditions of the apparatus to which the present invention is applied.

[0013] Also, the respective embodiments can be appropriately combined.

[0014] (Example 1) FIG. 1 is a diagram schematically showing the imaging device in Example 1.

[0015] As shown in FIG. 1(a), the imaging device 101 is provided with an operation member (hereinafter referred to as a power button, which may be an operation such as a tap, flick, or swipe on a touch panel) that can perform an on / off operation of a power switch. Further, the imaging device 101 includes a housing 102 including a photographing lens group and an imaging element, and is configured such that the housing 102 can be rotationally driven with respect to a fixed portion 103 by a rotation mechanism.

[0016] FIG. 1(b) shows the axis definition at the position of the fixing part 103. The tilt rotation unit 104 in FIG. 1(a) is a motor drive mechanism that rotates the housing 102 in the pitch direction shown in FIG. 1(b). The pan rotation unit 105 is a motor drive mechanism that rotates the housing 102 in the yaw direction shown in FIG. 1(b). With these mechanisms, the housing 102 can be rotated in one or more directions.

[0017] An angular velocity meter 106 and an accelerometer 107 are mounted on the fixing part 103 of the imaging device 101. Then, based on the angular velocity meter 106 and the accelerometer 107, the vibration (swing angle) of the imaging device 101 is detected, and the tilt rotation unit 104 and the pan rotation unit 105 are driven based on the detected swing angle. Thus, a configuration is provided to correct the shake or inclination of the movable housing 102.

[0018] Here, in the first embodiment, the drive of the pan rotation unit 105 has a rotation limit due to mechanical constraints and is rotatable within a predetermined range. Note that in the second and third embodiments described later, examples where there is no mechanical limit in the drive of the pan rotation unit 105 are described.

[0019] FIG. 2 is a block diagram showing the configuration of the imaging device according to this embodiment. The first control unit 223 consists of a processor (for example, CPU, GPU, microprocessor, MPU, etc.) and a memory (for example, DRAM, SRAM, etc.). These execute various processes to control each block of the imaging device 101 and control data transfer between each block. The non-volatile memory (EEPROM) 216 is an electrically erasable and recordable memory, and stores constants, programs, etc. for the operation of the first control unit 223.

[0020] The zoom unit 201 includes a zoom lens that optically magnifies the optical image formed on the imaging element of the imaging unit 206. The zoom drive control unit 202 drives and controls the zoom unit 201. The focus unit 203 includes a lens for focus adjustment. The focus drive control unit 204 drives and controls the focus unit 203.

[0021] In the imaging unit 206, an imaging element receives an optical image incident through each lens group, and outputs analog image data based on charges generated according to the amount of the light. The output analog image data is converted into digital image data by an A / D converter. The image processing unit 207 applies image processing such as distortion correction, white balance adjustment, and color interpolation processing to the digital image data, and outputs the digital image data after the application. The digital image data output from the image processing unit 207 is converted into a recording format such as the JPEG format by the image recording unit 208, and is transmitted to the memory 215 and the video output unit 217 described later.

[0022] The housing rotation drive unit 205 drives the tilt rotation unit 104 and the pan rotation unit 105 to drive the housing 102 in the tilt direction and the pan direction. In the present First Embodiment, the drive of the pan rotation unit 105 has a rotation limit due to mechanical constraints, and it is assumed that the pan rotation is possible within a predetermined range up to the limit. In Second Embodiment and Third Embodiment described later, examples in which there is no mechanical limit in the drive of the pan rotation unit are described.

[0023] The device shake detection unit 209 includes, for example, an angular velocity meter (gyro sensor) 106 that detects the angular velocity of the imaging device 101 in three axial directions, and an accelerometer (acceleration sensor) 107 that detects the acceleration of the device in three axial directions. The device shake detection unit 209 calculates the rotation angle of the device, the shift amount of the device, etc. based on the detected signals.

[0024] The voice input unit 213 acquires voice signals around the imaging device 101 from a microphone provided in the imaging device 101, converts them into digital signals, and transmits them to the voice processing unit 214. The voice processing unit 214 performs voice-related processing such as normalization processing of the input digital voice signals. Then, the voice signals processed by the voice processing unit 214 are transmitted to the memory 215 by the first control unit 223. The memory 215 temporarily stores the image signals and voice signals obtained by the image processing unit 207 and the voice processing unit 214.

[0025] The image processing unit 207 and the audio processing unit 214 read out the image signal and the audio signal temporarily stored in the memory 215, perform encoding and the like, and generate a compressed image signal and a compressed audio signal. The first control unit 223 transmits these compressed image signals and compressed audio signals to the recording and reproducing unit 220.

[0026] The recording and reproducing unit 220 records the compressed image signal, the compressed audio signal, and other control data related to shooting generated by the image processing unit 207 and the audio processing unit 214 on the recording medium 221. Also, when the audio signal is not compressed and encoded, the first control unit 223 transmits the audio signal generated by the audio processing unit 214 and the compressed image signal generated by the image processing unit 207 to the recording and reproducing unit 220 for recording on the recording medium 221.

[0027] The recording medium 221 may be a recording medium built in the imaging device 101 or a removable recording medium. The recording medium 221 can record various data such as the compressed image signal, the compressed audio signal, and the audio signal generated by the imaging device 101, and a medium with a larger capacity than the non-volatile memory 216 is generally used. For example, the recording medium 221 includes recording media of all types such as hard disks, optical disks, magneto-optical disks, CD-Rs, DVD-Rs, magnetic tapes, non-volatile semiconductor memories, and flash memories.

[0028] The recording and reproducing unit 220 reads out and reproduces the compressed image signal, the compressed audio signal, the audio signal, various data, and the program recorded on the recording medium 221. Then, the first control unit 223 transmits the read compressed image signal and compressed audio signal to the image processing unit 207 and the audio processing unit 214. The image processing unit 207 and the audio processing unit 214 temporarily store the compressed image signal and the compressed audio signal in the memory 215, decode them according to a predetermined procedure, and transmit the decoded signals to the video output unit 217 and the audio output unit 218.

[0029] The voice input unit 213 is equipped with a microphone and inputs voice. The voice processing unit 214 detects several pre-registered voice commands. When a specific voice command is detected, it outputs a detection trigger signal to the first control unit 223 and the second control unit 211.

[0030] A second control unit 211 provided separately from the first control unit 223 that controls the entire main system of the imaging device 101 controls the power supply to the first control unit 223. The first power supply unit 210 and the second power supply unit 212 supply power to operate the first control unit 223 and the second control unit 211, respectively.

[0031] When the power button provided on the imaging device 101 is pressed, power is first supplied to both the first control unit 223 and the second control unit 211. However, as will be described later, the first control unit 223 is controlled to turn off its own power supply to the first power supply unit 210. Even while the first control unit 223 is not operating, the second control unit 211 is operating, and information from the device shake detection unit 209 and the voice processing unit 214 is input. The second control unit performs a determination process as to whether or not to start the first control unit 223 based on various input information, and is configured to give a power supply instruction to the first power supply unit when it is determined to start.

[0032] The voice output unit 218 outputs a preset voice pattern from a speaker built into the imaging device 101, for example, during shooting.

[0033] The LED control unit 224 controls the LED provided on the imaging device 101, for example, during shooting, with a preset lighting and blinking pattern.

[0034] The video output unit 217 consists of, for example, a video output terminal and transmits an image signal to display a video on a connected external display or the like. Also, the voice output unit 218 and the video output unit 217 may be a combined single terminal, for example, a terminal such as an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal.

[0035] The communication unit 222 communicates between the imaging device 101 and an external device, and transmits and receives data such as voice signals, image signals, compressed voice signals, and compressed image signals. Further, it receives control signals related to shooting, such as shooting start and end commands, pan-tilt, and zoom drive, and drives the imaging device 101 according to instructions from an external device capable of mutual communication with the imaging device 101.

[0036] In addition, information such as various parameters related to learning processed by the learning processing unit 219 described later is transmitted and received between the imaging device 101 and the external device. The communication unit 222 is, for example, a wireless communication module such as an infrared communication module, a Bluetooth communication module, a wireless LAN communication module, WirelessUSB, or a GPS receiver.

[0037] The subject detection unit 225 reads the image data output by the image processing unit 207 from the memory 215 and performs subject recognition of a person, an object, or the like. When recognizing a person, it detects the face or body of the subject. In the face detection process, a pattern for determining a person's face is predefined, and a location in the captured image that matches the pattern can be detected as the person's face image, and an identifier for distinguishing one person from another is also assigned.

[0038] In addition, a reliability indicating the likelihood of the subject being a face is calculated at the same time, and the reliability is calculated from, for example, the size of the face region in the image, the degree of matching with the face pattern, and the like. Similarly, by performing pattern matching within the face image, it is also possible to detect face information such as whether the detected face is a smiling face, whether the eyes are open, and the orientation of the face.

[0039] Note that the method for detecting face information is not limited to pattern matching, and known techniques such as a method using deep learning can be used. Similarly, for object recognition, an object that matches a pre-registered pattern can be recognized.

[0040] There are also methods of extracting subject features using the histogram of hue, saturation, etc. in the captured image. In this case, regarding the image of the subject captured within the shooting angle of view, the distribution derived from the histogram of its hue, saturation, etc. is divided into a plurality of sections, and a process of classifying the captured image for each section is executed.

[0041] For example, histograms of a plurality of color components are created for the captured image, divided within the peak-shaped distribution range, the images captured in the regions belonging to the same combination of sections are classified, and the image region of the subject is recognized. By calculating an evaluation value for each recognized image region of the subject, it is possible to determine the image region of the subject with the highest evaluation value as the main subject region. By the above method, each subject information can be obtained from the imaging information.

[0042] The RFID receiving unit 226 includes at least three antennas for receiving the radio waves transmitted by the RFID tag, and can extract the information transmitted by the RFID tag from the received radio waves. Also, the RFID receiving unit 226 can detect the position of the RFID tag by using the principle of trilateration or the like based on the intensity of the radio waves received by each antenna and the difference in the received time.

[0043] FIG. 3 is a diagram showing a configuration example of a communication system between the imaging device 101 and the RFID tag 601.

[0044] The imaging device 101 is a digital camera having a photographing function. Also, the RFID tag 601 is configured to connect an antenna for transmitting and receiving radio waves to an IC chip capable of reading and writing data. Information corresponding to the usage can be written into the IC chip and used.

[0045] The imaging device 101 and the RFID tag 601 can communicate by a communication method 602 such as a radio wave method called the UHF band or an electromagnetic induction method called the HF band, and various information written in the IC chip can be transmitted from the RFID tag 601 to the imaging device 101.

[0046] In addition, the RFID tag 601 can also transmit information representing the intensity of the radio wave transmitted by the RFID tag, called RSSI (Received Signal Strength Indicator). Then, the imaging device 101 can calculate the distance to the RFID tag 601 based on the relationship between the RSSI and the intensity of the actually received radio wave.

[0047] Next, a method for shooting a panoramic image will be described with reference to FIGS. 4 and 5. FIG. 4 is an operation flowchart for generating a panoramic image. The processing in each step of the flowchart in FIG. 4 is realized by the first control unit 223 executing a program stored in the non-volatile memory 216. FIG. 5 is a diagram showing area division during panoramic image generation, and here it shows the entire range where panoramic shooting is possible.

[0048] When panoramic shooting is started, in step S701, the number of shootings, the shooting angle, and the panoramic image size are determined. As an example, the case where the panoramic image size is set to 24000 pixels horizontally × 3000 pixels vertically will be described. Assuming that the number of pixels of the imaging element of this camera of the imaging device 101 is 6000 pixels horizontally × 4000 pixels vertically, as shown in FIG. 5, shooting will be performed 5 times.

[0049] In step S703, an image is acquired without changing the shooting direction of the housing 102. 802 in FIG. 5 indicates the shooting direction of the housing 102 for shooting the image 801 of the first shooting range.

[0050] In step S704, the image 801 acquired in step S703 is converted into data for a panoramic image. This conversion can be performed according to the following formula, which is also generally known in map projection methods. When the conversion process in step S704 is completed, the process proceeds to step S705. x = (Rsinλcosψ) / (sinψsinψ0 + cosψcosψ0cosλ) y = {R(sinψcosψ0 - cosψsinψ0cosλ)} / (sinψsinψ0 + cosψcosψ0cosλ) x, y: Coordinates on the captured image ψ, θ: Polar coordinates corresponding to the coordinates on the panoramic image ψ0: Tilt angle λ: Difference between the pan angle and the θ angle R: A constant that varies depending on the panoramic image size and the camera's field of view angle

[0051] In step S705, it is determined whether the shooting of the entire area corresponding to the image size of the panoramic shooting (shooting from image 801 to image 806 in FIG. 5) has been completed. If not, the process proceeds to step S702. In step S702, the orientation of the lens barrel 102 is changed, and the process proceeds to step S703.

[0052] In step S703, the next image 803 is shot. Here, in order to generate a panoramic image, it is necessary to shoot 5 times while changing the shooting direction (shooting angle of view) by changing the orientation of the lens barrel 102. Therefore, steps S702, S703, S704, and S705 are repeated until the 5 shootings are completed, and images 804, 805, and 806 are shot.

[0053] In step S705, when the shooting in the entire area of the panoramic shooting is completed, the process proceeds to step S706.

[0054] In step S706, the 5 captured images 801, 803, 804, 805, and 806 are combined and synthesized like image 807 to generate a panoramic image 808.

[0055] Next, FIG. 6 is a diagram showing how a panoramic image is generated by synthesizing an image in which only one frame of a person as a subject is captured.

[0056] In FIG. 6, an example is shown in which a subject who is a person is photographed in the first image 901, and a panoramic image is generated by synthesizing the second and subsequent images 902 to 905 in which only the scenery is photographed. That is, when the moving speed of the subject, which is a person, in the pan direction is high, a panoramic image is generated by synthesizing the images in which the subject, which is a person, is photographed in each frame as shown in FIG. 5. On the other hand, when the moving speed of the subject, which is a person, is low, a panoramic image is generated by synthesizing the image in which the subject, which is a person, is photographed only in the first frame as shown in FIG. 6. Note that the panoramic image 906 shown in FIG. 6 is generated by performing a synthesis process on the images 901 to 905 as described in FIG. 5.

[0057] As described above, in the generated panoramic image, the horizontal coordinate and the vertical coordinate of a point in an image are in a proportional relationship with the pan / tilt angles when shooting centering on that point, and when one point is selected, the pan / tilt angles can be obtained by simple calculation. Note that the panoramic shooting in this embodiment is premised on only the case where the housing 102 is moved in the pan direction, but it is not limited thereto.

[0058] The imaging device 101 operates in two modes: a panoramic shooting mode and a normal shooting mode. When the movement of the subject is detected, it operates in the panoramic shooting mode, and when the movement of the subject is not detected, it operates in the normal shooting mode.

[0059] FIG. 7 is a flowchart showing the automatic panoramic shooting process in the first embodiment. The processes in each step of this flowchart are realized by the first control unit 223 executing a program stored in the nonvolatile memory 216.

[0060] First, when the power of the imaging device 101 is turned on, the process proceeds to step S301.

[0061] In step S301, the subject detection unit 225 detects the position of the subject. Here, the position of the subject may be detected using the information received from the RFID tag 601. Also, it is possible to determine whether to set the zoom position of the imaging device 101 to wide-angle or telephoto based on the position information of the subject, and change the zoom position by driving the zoom unit 201 to perform shooting.

[0062] If the position of the subject is detected in step S301, the process proceeds to step S302. If the position of the subject is not detected, the process of step S301 is repeated.

[0063] In step S302, it is determined whether the subject has moved a predetermined distance in a certain direction. Here, the movement of the subject may also be detected using the information received from the RFID tag 601.

[0064] The subject detection unit 225 reads out the image data output by the image processing unit 207 from the memory 215 that temporarily holds it, and performs subject recognition of a person, an object, etc. Also, the subject detection unit 225 calculates the moving direction and moving distance of the recognized person or object. Furthermore, it is possible to calculate the moving directions and moving distances of a plurality of subjects.

[0065] If it is determined in step S302 that the subject has moved a predetermined distance in a certain direction, the process proceeds to step S303.

[0066] In step S303, the moving speed of the subject is compared with the panning speed of the imaging device 101, and it is determined whether the moving speed of the subject is slower than the panning speed of the imaging device 101 based on the comparison result.

[0067] Specifically, when there is a rigid body of a rectangular parallelepiped (X, Y, Z) on the x, y, and z axes, assume that it rotates with an angular velocity ω around the vector Xex + Yey + Zez as the rotation axis. At this time, assume that ex, ey, and ez are basic vectors, and hereinafter, vectors are represented by ":".

[0068] Since the angular velocity vector is a vector with magnitude ω in the direction of Xex + Yey + Zez, ω := ω(Xex + Yey + Zez) / √(X^2 + Y^2 + Z^2). The velocity and acceleration are obtained by v := ω × (Xex + Yey) and a := ω × v. Therefore, it is possible to compare the moving speed of the subject calculated by the subject detection unit 225 with v := ω × (Xex + Yey) and determine whether the moving speed of the subject is slower than the pan speed of the imaging device 101 based on the comparison result.

[0069] If it is determined in step S303 that the moving speed of the subject is slower than the pan speed of the imaging device 101, the process proceeds to step S304. If it is determined that the moving speed of the subject is equal to or higher than the pan speed of the imaging device 101, the process proceeds to step 307 to end the shooting.

[0070] In step S304, automatic panoramic shooting of the subject is started, and the imaging device 101 is controlled to perform a pan operation in the direction in which the subject has moved. That is, the first control unit 223 controls the pan rotation unit 105 of the housing rotation drive unit 205 to rotate in the direction in which the subject has moved, and the pan rotation unit 105 rotates the housing 102 in the direction in which the subject has moved.

[0071] Next, the process proceeds to step S305 to determine whether the imaging device 101 has been panned to a position (field angle) where shooting is impossible. If the imaging device 101 has not been panned to a position where shooting is impossible, the process returns to step S304 to continue the automatic panoramic shooting. If it is determined that the imaging device 101 has been panned to a position where shooting is impossible, the process proceeds to step S306.

[0072] In step S306, the automatic panoramic shooting is ended, and a panoramic image is generated.

[0073] As described above, according to the first embodiment, it is possible to automatically track a subject and shoot a panoramic image using the imaging device 101 having a pan-tilt mechanism.

[0074] (Embodiment 2) In the second embodiment, an example in which panoramic shooting of a single subject is automatically executed when the shooting mode is set to the automatic panoramic shooting mode will be described.

[0075] FIG. 8 is a flowchart showing the automatic panoramic shooting process in the second embodiment. The processing in each step of this flowchart is realized by the first control unit 223 executing a program stored in the non-volatile memory 216.

[0076] First, when the power of the imaging device 101 is turned on, the process proceeds to step S401.

[0077] In step S401, it is determined whether the shooting mode of the imaging device 101 is set to the automatic panoramic shooting mode. If it is set to the automatic panoramic shooting mode in step S401, the process proceeds to step S402.

[0078] Here, it is assumed that the number of vertical and horizontal pixels of the completed panoramic image has also been determined. If it is not set to the automatic panoramic shooting mode, the process of step S401 is repeated until it is set to the automatic panoramic shooting mode. If it is not set to the automatic panoramic shooting mode within a predetermined time, it is assumed to operate in the normal shooting mode.

[0079] In step S402, it is determined whether to start shooting. If it is determined to start shooting, the process proceeds to step S403.

[0080] In step S403, the position of the subject is detected by the subject detection unit 225. Here, the position of the subject may be detected using the information received from the RFID tag 601. Also, based on the distance information to the subject, it is possible to determine whether to set the zoom position of the imaging device 101 to wide angle or telephoto, and change the zoom position by driving the zoom unit 201 to perform shooting. The distance to the subject can be calculated by the imaging device 101 based on the relationship between the RSSI and the actually received radio wave intensity up to the RFID tag 601.

[0081] If the position of the subject is detected in step S403, the process proceeds to step S404. If the position of the subject is not detected, the process of step S403 is repeated.

[0082] In step S404, it is determined whether the subject is moving in a certain direction and can be tracked. Here, the movement of the subject may also be detected using the information received from the RFID tag 601. The imaging device 101 is provided with at least three antennas for receiving the radio waves transmitted from the RFID tag. And based on the time difference of the radio waves received by each antenna, it is possible to detect the position of the RFID tag using the principle of trilateration or the like. By performing multiple detections, the moving distance of the subject can be calculated. The method for determining whether tracking is possible is as described in the first embodiment.

[0083] If it is determined in step S404 that the subject can be tracked, the process proceeds to step S405.

[0084] In step S405, the moving speed of the subject is compared with the panning speed of the imaging device 101 to determine whether the moving speed of the subject is slower than the panning speed of the imaging device 101. If it is determined that the moving speed of the subject is slower than the panning speed of the imaging device 101, the process proceeds to step S407. If it is determined in step S405 that the moving speed of the subject is equal to or greater than the panning speed of the imaging device 101, the process proceeds to S406 to end the shooting.

[0085] In step S407, automatic panoramic shooting of the subject is started, and the imaging device 101 is controlled to perform a panning operation in the direction in which the subject has moved.

[0086] Next, the process proceeds to step S408 to determine whether shooting has been performed up to the set recording pixel count for automatic panoramic shooting. The recording pixel count for automatic panoramic shooting is assumed to be set in advance at the start of shooting. If shooting has not been performed up to the recording pixel count for automatic panoramic shooting, automatic panoramic shooting is continued. If it is determined that shooting has been performed up to the recording pixel count for automatic panoramic shooting, the process proceeds to step S409.

[0087] In step S409, the automatic panoramic shooting is terminated, and a panoramic image is generated.

[0088] As described above, according to the second embodiment, when the shooting mode of the imaging device 101 having the pan-tilt mechanism is set to the automatic panoramic shooting mode, the subject can be automatically tracked to perform panoramic image shooting. Further, if the shooting mode is not set to the automatic panoramic shooting mode, shooting is performed in a normal shooting operation.

[0089] (Embodiment 3) In Embodiment 3, an example in which panoramic shooting of a plurality of subjects is automatically executed when the shooting mode is set to the automatic panoramic shooting mode will be described.

[0090] FIG. 9 is a flowchart showing the automatic panoramic shooting process in Embodiment 3. The processing in each step of this flowchart is executed by the first control unit 223 executing a program stored in the non-volatile memory 216.

[0091] First, when the power of the imaging device 101 is turned on, the process proceeds to S501.

[0092] In step S501, it is determined whether or not the shooting mode of the imaging device 101 is set to the automatic panoramic shooting mode. If it is set to the automatic panoramic shooting mode in step S501, the process proceeds to step S502.

[0093] Here, it is assumed that the number of vertical and horizontal pixels of the completed panoramic image has also been determined. Further, if it is not set to the automatic panoramic shooting mode, the process of step S501 is repeated until it is set to the automatic panoramic mode. If it is not set to the automatic panoramic shooting mode within a predetermined time, it is assumed that the operation is performed in the normal shooting mode.

[0094] In step S502, it is determined whether or not to start shooting. If it is determined to start shooting, the process proceeds to step S503.

[0095] In step S503, the subject detection unit 225 detects the position of the subject. Here, the position of the subject may be detected using the information received from the RFID tag 601. Also, based on the distance information to the subject, it is possible to determine whether to set the zoom position of the imaging device 101 to wide angle or telephoto, and change the zoom position by driving the zoom unit 201 to perform shooting. The distance to the subject can be calculated by the imaging device 101 based on the relationship between the RSSI and the intensity of the actually received radio wave up to the RFID tag 601.

[0096] If the position of the subject is detected in step S503, the process proceeds to step S504. If the position of the subject is not detected, the process of step S503 is repeated.

[0097] In step S504, it is determined whether a plurality of subjects are moving in a certain direction and can be tracked. Here, the movement of the subject may also be detected using the information received from the RFID tag 601. The imaging device 101 is provided with at least three antennas for receiving the radio waves transmitted from the RFID tag. Then, based on the time difference of the radio waves received by each antenna, the position of the RFID tag can be detected using the principle of trilateration or the like. By performing multiple detections, the moving distance of the subject can be calculated. The method for determining whether tracking is possible is as described in the first embodiment.

[0098] If it is determined in step S504 that a plurality of subjects can be tracked, the process proceeds to step S505.

[0099] In step S505, the moving speeds of a plurality of subjects are compared with the panning speed of the imaging device 101, and based on the comparison result, it is determined whether the moving speeds of the plurality of subjects are slower than the panning speed of the imaging device 101. If it is determined in step S505 that the moving speeds of the plurality of subjects are slower than the panning speed of the imaging device 101, the process proceeds to step S506. Also, if it is determined in step S505 that the moving speeds of the plurality of subjects are equal to or higher than the panning speed of the imaging device 101, the process proceeds to step S508 described later.

[0100] In step S506, automatic panoramic shooting of a plurality of subjects is started, and the imaging device 101 is controlled to perform a panning operation in the direction in which the plurality of subjects have moved.

[0101] Next, the process proceeds to step S510, and it is determined whether shooting has been performed up to the set recording pixel count for automatic panoramic shooting. The recording pixel count for automatic panoramic shooting is assumed to be set in advance at the start of shooting. If shooting has not been performed up to the recording pixel count for automatic panoramic shooting, automatic panoramic shooting is continued. Also, if it is determined that shooting has been performed up to the recording pixel count for automatic panoramic shooting, the process proceeds to step S511.

[0102] In step S511, automatic panoramic shooting is terminated, and a panoramic image is generated.

[0103] If it is determined in step S504 that it is impossible to track a plurality of subjects, the process proceeds to step S507.

[0104] In step S507, it is determined whether there is a subject that can be tracked among the plurality of subjects. Here, whether there is a subject that can be tracked is determined using the information transmitted from the RFID tag.

[0105] If it is determined in step S507 that there is no subject that can be tracked, the process returns to S503 again to detect the position information of the subject. Also, if it is determined in step S507 that there is a subject that can be tracked, the process proceeds to step S508.

[0106] In step S508, the moving speed of the subject that can be tracked is compared with the panning speed of the imaging device 101, and based on the comparison result, it is determined whether the moving speed of the subject is slower than the panning speed of the imaging device 101. If it is determined in step S508 that the moving speed of the subject is slower than the panning speed of the imaging device 101, the process proceeds to step S509. Also, if it is determined in step S508 that the moving speed of the subject is equal to or higher than the panning speed of the imaging device 101, the process proceeds to step S512 to end the shooting.

[0107] In step S509, automatic panoramic shooting of the subject is started, and the imaging device 101 is controlled to perform a panning operation in the direction in which the subject has moved.

[0108] Next, the process proceeds to step S510 to determine whether shooting has been performed up to the set recording pixel count for automatic panoramic shooting. If shooting has not been performed up to the recording pixel count for automatic panoramic shooting in S510, automatic panoramic shooting is continued. If it is determined in S510 that shooting has been performed up to the recording pixel count for automatic panoramic shooting, the process proceeds to step S511 to end the panoramic shooting and generate a panoramic image.

[0109] As described above, according to the third embodiment, when the shooting mode of the imaging device 101 having a pan-tilt mechanism is set to the automatic panoramic shooting mode, it is possible to automatically track a plurality of subjects and perform panoramic image shooting. Also, if the shooting mode is not set to the automatic panoramic shooting mode, shooting is performed by a normal shooting operation.

[0110] As described above, the preferred embodiments of the present invention have been described, but the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.

[0111] (Other Embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or apparatus to read and execute the program. It can also be realized by a circuit (for example, an ASIC) that realizes one or more functions.

Explanation of Signs

[0112] 101 Imaging device 102 Housing 103 Fixing part 104 Tilt rotation unit 105 Pan rotation unit 205 Housing rotation drive unit 206 Imaging unit 225 Subject detection unit

Claims

1. imaging means for imaging a subject; rotating means for rotating the imaging means in the pan direction; detecting means for detecting the position of the subject; comparing means for comparing the moving speed of the subject and the pan speed of the rotating means when it is detected by the detecting means that the position of the subject has moved; control means for controlling to start panoramic shooting when it is determined by the comparing means that the moving speed of the subject is slower than the pan speed of the rotating means based on the comparison result; An imaging device comprising the same.

2. The imaging device according to claim 1, wherein the detecting means detects the position of the subject by an RFID tag.

3. The imaging device according to claim 1 or 2, wherein the control means controls to change the zoom position of the imaging means and perform shooting according to the position of the subject detected by the detecting means.

4. The imaging device according to claim 1 or 2, wherein the control means controls to end panoramic shooting by the imaging means when the limit of the operation in the pan direction is reached.

Images