Camera system, imaging method, and computer program

Abstract

To enable detection of the direction from a camera to a speaker even when the camera and a microphone are arranged without measuring the mount positions of the camera and the microphone in advance.SOLUTION: A camera system includes a first imaging device having a wide-angle imaging range and a second imaging device capable of changing the angle of view. The first imaging device includes a sound collection unit for detecting sound, a sound source detection unit for obtaining position information of a sound source, a first wireless tag unit for obtaining position information of a wireless tag placed in an imaging range, a wireless tag identification unit for identifying a designated wireless tag based on the position information of the sound source and the position information of the wireless tag, and a transmission unit for transmitting identification information that identifies the designated wireless tag. The second imaging device includes a receiving unit for receiving the identification information, a second wireless tag unit for obtaining the position information of the wireless tag, an angle-of-view determination unit for determining the angle of view at which the designated wireless tag is imaged, and a change unit for changing the angle of view of the second imaging device.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an imaging device and the like used in video conferences and the like. [Background technology]

[0002] 2. Description of the Related Art Video conference systems for remote meetings use camera systems that detect the direction of a speaker with a microphone and point a camera in the speaker's direction to capture the speaker's image. If the microphone and camera are in the same position, the direction detected by the microphone will directly determine the pan and tilt angles of the camera. However, the camera is often attached near the TV monitor and the microphone is placed in the center of the conference table. When the microphone and camera are placed in different positions like this, even if the direction of the speaker is detected by the microphone, it is not possible to determine the pan and tilt of the camera.

[0003] Patent Document 1 discloses a method of measuring the positional relationship between a microphone and a camera in advance, and then setting the pan and tilt angles of the camera based on the direction of the sound detected by the microphone. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-151471 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, with the technology described in Patent Document 1, the positions of the microphone and the camera must be measured every time the camera and microphone are installed, which places a heavy burden on the user preparing for a video conference. Camera systems that detect the direction of a speaker using a microphone built into the camera and then zoom in on the speaker are also available on the market. However, the range of detection for the direction of the voice in this type of camera system is only a radius of about 2 to 3 meters, so they are only used in small-scale meetings.

[0006] An object of the present invention is to enable detection of the direction of a speaker from a camera even when the installation positions of the camera and microphone are arranged without measuring them in advance. [Means for solving the problem]

[0007] In order to solve the above problem, a camera system in one embodiment of the present invention includes a first imaging device having a wide-angle imaging range, and a second imaging device capable of changing an angle of view within the imaging range, the first imaging device including a sound collection unit that detects sound emitted within the imaging range, a sound source detection unit that obtains position information of a sound source relative to the first imaging device based on detection information from the sound collection unit, a first wireless tag unit that detects a plurality of wireless tags arranged within the imaging range and obtains position information of the plurality of wireless tags relative to the first imaging device, and a sound source detection unit that detects a plurality of wireless tags arranged within the imaging range and obtains position information of the plurality of wireless tags relative to the first imaging device. the second imaging device comprises a radio tag identification unit which identifies a designated radio tag placed in the vicinity of the designated radio tag, and a transmitting unit which transmits identification information which identifies the designated radio tag, and the second imaging device comprises a receiving unit which receives the identification information of the designated radio tag, a second radio tag unit which detects the designated radio tag based on the identification information of the designated radio tag and obtains positional information of the multiple radio tags relative to the second imaging device, a field of view determination unit which obtains the positional information of the designated radio tag based on the identification information and determines the field of view for imaging the designated radio tag, and a changing unit which changes the field of view of the second imaging device based on a command from the field of view determination unit. Effect of the Invention

[0008] According to the present invention, even if the installation positions of the camera and microphone are arranged without measuring them in advance, the direction of the speaker can be detected from the camera. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of installation of a camera system 5 according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram showing the configuration of a camera system 5. [Diagram 3] FIG. 1 is a diagram showing a camera 10. [Figure 4] FIG. 2 is a block diagram showing the functions of the camera 10. [Diagram 5] 2 is a block diagram showing the hardware configuration of a control unit 33. FIG. [Figure 6] FIG. [Figure 7] FIG. 2 is a block diagram showing the functions of a camera 50. [Figure 8] 2 is a block diagram showing the functions of a wireless tag 80. FIG. [Figure 9] 1A to 1C are diagrams illustrating the principle of a direction calculation process. [Figure 10] 1A and 1B are diagrams illustrating the principle of distance calculation processing. [Figure 11] FIG. 4 is a flowchart illustrating an imaging method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0011] [Videoconferencing system 1] FIG. 1 is a diagram showing an example of installation of a camera system 5 according to an embodiment of the present invention. FIG. 2( a ) is a schematic diagram showing the configuration of the camera system 5 .

[0012] A video conference system 1 according to an embodiment of the present invention is placed in a conference room H in an office or the like. The conference room (room) H is equipped with a table T and multiple chairs C. The video conference system 1 includes a conference monitor M, a microphone N, a camera system 5, and the like. A conference monitor M is placed near a table T to display the remote conference participants. A microphone N is placed on the top of the table T to detect the voice of a conference participant (speaker P) sitting in a chair C. The camera system 5 includes cameras 10 and 50 and a plurality of wireless tags 80. The cameras 10 and 50 are disposed, for example, on the upper edge of a conference monitor M, respectively. The wireless tags 80 are placed at different locations within the imaging ranges of the cameras 10 and 50. That is, the wireless tags 80 are placed at predetermined intervals so as not to overlap each other. For example, they are placed on the floor F or wall W of the conference room H. A plurality of wireless tags 80 are attached to the top (back surface, etc.) of a table T or the seat or back of a chair C. Furthermore, each conference participant (enterer, speaker P) may carry a wireless tag 80.

[0013] Furthermore, the video conference system 1 includes a server device 3 and a network 4. A plurality of camera systems 5 (including a conference monitor M and a microphone N) are connected to the server device 3 via the network 4. A video conference (transmission and reception of images and audio, etc.) is then held between the camera systems 5 located in remote locations.

[0014] The server device 3 provides a service for controlling video conferences. The server device 3 is capable of communicating with cameras 10 and 50, which will be described later, via a network 4. The cameras 10 and 50 and the server device 3 each transmit various commands to other devices (not shown) via the network 4, and when a command is received, the cameras 10 and 50 and the server device 3 transmit a response to the device that transmitted the command. The server device 3 is an example of an information processing device such as a personal computer (PC).

[0015] The network 4 is composed of a plurality of routers, switches, cables, etc. that meet communication standards such as Ethernet (registered trademark). The network 4 may be of any communication standard, scale, or configuration as long as it can perform communication between the cameras 10 and 50 and the server device 3. For example, the network 4 may be configured by the Internet, a wired LAN (Local Area Network), a wireless LAN, a WAN (Wide Area Network), or the like. The cameras 10 and 50 may be surveillance cameras that support PoE (Power Over Ethernet (registered trademark)), and may be supplied with power via a LAN cable.

[0016] [Camera System 5] The camera system 5 includes cameras 10 and 50 and a plurality of wireless tags 80. The cameras 10 and 50 and the server device 3 are capable of communicating with each other via a network 4. The cameras 10 and 50 and the wireless tags 80 are also capable of communicating with each other via wireless communication. The camera 10 is a network camera that generates video data and transmits it via the network 4. The camera 10 is an omnidirectional camera or a fish-eye camera that can capture images in all directions around it. The camera 50 is similar to the camera 10. The camera 50 is a camera that captures images in one direction compared to the camera 10. The camera 50 is equipped with a zoom function, and therefore is capable of capturing an image of a subject (speaker P) that is farther away than the camera 10. The camera system 5 may include a plurality of cameras other than the cameras 10 and 50.

[0017] FIG. 2B is a diagram showing wireless tag units (base stations) 15 and 55 built into the cameras 10 and 50. As shown in FIG. The wireless tag unit (first wireless tag unit) 15 and the wireless tag unit (second wireless tag unit) 55 are small wireless devices capable of wireless communication, and can obtain the direction and distance (position information) of the wireless tag 80. The wireless tag units 15, 55 are incorporated as wireless units 35, 65 inside the cameras 10 and 50. The wireless tag units 15, 55 may be arranged in the vicinity of the cameras 10, 50 and may communicate with the cameras 10, 50.

[0018] (Camera 10) FIG. 3 is a diagram showing the camera 10. As shown in FIG. 3(A), camera (first imaging device) 10 has an imaging unit 11 and a microphone 20. Also, camera 10 has a wireless tag unit 15 built in as a wireless unit . The imaging unit 11 is, for example, a camera having a fixed wide-angle imaging range, such as an omnidirectional imaging camera, and has a lens and an imaging element such as a CCD or CMOS. The microphone (sound collector) 20 is a sound sensor that detects the sound (voice) emitted from a speaker (sound source) P. 3B, microphone 20 is made up of eight microphone sensors 21 to 28, which are evenly arranged along the outer periphery of camera 10. Microphone 20 is incorporated into camera 10 as a sound collecting unit 37. The number of microphone sensors 21 to 28 is not limited to eight, and may be increased or decreased.

[0019] FIG. 4 is a block diagram showing the functions of the camera 10. The camera 10 has an imaging section 31, an image processing section 32, a control section 33, a communication section , a wireless section 35, a storage section , a sound collection section 37, and a sound processing section . The imaging section 31 drives and controls the imaging unit 11. The imaging section 31 images a subject (speaker P) according to an imaging range (angle of view) determined by a lens setting or the like of the imaging unit 11, and generates a video signal by photoelectric conversion. The image processing unit 32 performs predetermined image processing and compression encoding processing on the video signal generated by the imaging unit 31 to generate video data. The control unit 33 controls the imaging unit 31 and the image processing unit 32 based on imaging conditions set by a user or automatically determined imaging conditions. The imaging conditions include imaging gain conditions, gamma conditions, dynamic range conditions, exposure conditions, focus conditions, and the like.

[0020] FIG. 5 is a block diagram showing the hardware configuration of the control unit 33. As shown in FIG. The control unit 33 includes a CPU 41, a ROM 42, and a RAM 43. The control unit 33 comprehensively controls each component of the camera 10 and sets various parameters and the like. The control unit 33 analyzes a camera control command received from the server device 3 or the like via the network 4, and performs processing according to the camera control command. The control unit 33 instructs the image processing unit 32 to adjust image quality, to control zoom and focus, to perform pan-tilt operations, and to combine and transmit audio data and video data. The control unit 33 executes a computer program stored in the ROM 42 or the RAM 43. The RAM 43 has a storage area for the computer program executed by the control unit 33, a work area during execution of the computer program, a data storage area, and the like.

[0021] The control unit 33 receives the identification information of the wireless tag 80 and the direction and distance data of the wireless tag 80 from the wireless unit 35, and stores them in the memory unit 36. The control unit 33 transmits the identification information of the specified wireless tag 80S to the camera 50 via the communication unit 34 (or the wireless unit 35). The control unit (sound source detection unit, wireless tag identification unit) 33 determines the direction and distance of the sound source (speaker P) based on the voice signals detected by the two microphones 21, 22, etc. The method of calculating the direction and distance will be described later.

[0022] Returning to FIG. 4, the communication section (transmission section) 34 receives the audio data transmitted by the camera 10 via the network 4, and outputs the received data to the control section 33 after performing appropriate packet processing. The communication unit 34 receives commands from the camera 10, and transmits a response to the received command to the camera 10. The communication unit 34 transmits video data to the server device 3 via the network 4. The communication unit 34 receives camera control commands transmitted by the server device 3, and outputs the commands to the control unit 33 after performing appropriate packet processing, etc. The communication unit 34 transmits a response to the command received from the server device 3 to the server device 3.

[0023] The wireless section 35 is the wireless tag section 15 (see FIG. 2(b)). The wireless unit 35 transmits and receives the identification information of the wireless tag 80 through wireless communication using electromagnetic waves with the wireless tag 80, detects the direction and distance of the wireless tag 80, and then outputs the direction and distance to the control unit 33. The method of calculating the direction and distance will be described later. The identification information of the wireless tag 80 is an identification number that is registered when the wireless unit 35 (wireless tag unit 15) and each wireless tag 80 are paired.

[0024] The memory unit 36 ​​stores the identification information of the wireless tag 80 received from the wireless unit 35 and information for associating the direction and distance data of the wireless tag 80 with each other.

[0025] Sound collector 37 is made up of microphone 20, each of which is composed of electrodes such as a diaphragm and a fixed plate. Sound collector 37 changes the distance between the electrodes in response to the vibration of the diaphragm caused by sound pressure, and the voltage fluctuates to convert sound into an electrical sound signal (detection information). The sound collector 37 may include an amplifier for amplifying the voltage of the audio signal.

[0026] The audio processing unit 38 performs audio processing and compression encoding processing on the audio signal generated by the sound collection unit 37 to generate audio data. The control unit 33 controls the sound collection unit 37 and the sound processing unit 38 based on the sound input conditions set by the user or automatically determined sound input conditions. The sound input conditions include a volume gain condition, a sound frequency characteristic condition, a sound directional condition, a sound directional range condition, and the like.

[0027] (Camera 50) FIG. 6 is a diagram showing a camera 50. As shown in FIG. The camera (second imaging device) 50 has an imaging unit 51. The camera 50 also has a wireless tag unit 55 built in as a wireless unit 65. The imaging unit 51 is a so-called pan-tilt-zoom camera, and the angle of view within the imaging range of the camera 50 can be changed. The imaging unit 51 has a lens, an imaging element such as a CCD or a CMOS, and driving parts such as a motor for rotating and moving the lens.

[0028] FIG. 7 is a block diagram showing the functions of the camera 50. As shown in FIG. The camera 50 has an imaging unit 61 , an image processing unit 62 , a control unit 63 , a communication unit 64 , a wireless unit 65 , a storage unit 66 , and a drive unit 67 .

[0029] The imaging section 61 drives and controls the imaging unit 51. The imaging section 61 images a subject (speaker P) according to an imaging range (angle of view) determined by lens settings and the like, and generates a video signal by photoelectric conversion. The image processing unit 62 performs predetermined image processing and compression encoding processing on the video signal generated by the imaging unit 61 to generate video data. The control unit 63 controls the imaging unit 61 and the image processing unit 62 based on imaging conditions set by a user or automatically determined imaging conditions. The imaging conditions include imaging gain conditions, gamma conditions, dynamic range conditions, exposure conditions, focus conditions, and the like.

[0030] Similar to the control unit 33, the control unit 63 includes a CPU 41, a ROM 42, and a RAM 43 (see FIG. 5). The control unit 63 comprehensively controls each component of the camera 50 and sets various parameters, etc. The control unit 63 analyzes a camera control command received from the server device 3 or the like via the network 4 and performs processing according to the camera control command. The control unit 63 instructs the image processing unit 62 to adjust image quality, to control zoom and focus, to perform pan-tilt operation, and to combine and transmit audio data and video data. The control unit 63 executes a computer program stored in the ROM 42 or the RAM 43. The RAM 43 has a storage area for the computer program executed by the control unit 63, a work area during execution of the computer program, a data storage area, and the like.

[0031] The control unit (angle of view determination unit) 63 receives the identification information of the wireless tag 80 and the data on the direction and distance of the wireless tag 80 from the wireless unit 65, and compares (searches) it with the identification information of the wireless tag 80S received from the camera 50. In this way, the control unit 63 also identifies the wireless tag 80S and its position information (direction, distance). Then, the control unit 63 determines the angle of view for capturing an image of the wireless tag 80S by the imaging unit 51 based on the position information (direction, distance) of the wireless tag 80S. Furthermore, the control unit 33 instructs the angle of view to the driving unit 67. Specifically, the control unit 33 instructs the driving unit 67 to perform pan, tilt, and zoom operations and to perform focus control.

[0032] The communication unit (receiving unit) 64 receives the audio data transmitted by the camera 50 via the network 4, performs appropriate packet processing, and then outputs the data to the control unit 63. The communication unit 64 receives commands from the camera 50, and transmits a response to the received command to the camera 50. The communication unit 64 transmits video data to the server device 3 via the network 4. The communication unit 64 receives camera control commands transmitted by the server device 3, and outputs the command to the control unit 63 after performing appropriate packet processing, etc. The communication unit 64 also transmits a response to the command received from the server device 3 to the server device 3.

[0033] The wireless section 65 is the wireless tag section 55 (see FIG. 2(b)). The wireless unit 65 transmits and receives identification information of the wireless tag 80 through wireless communication using electromagnetic waves with the wireless tag 80, and after determining the direction and distance (position information) of the wireless tag 80, outputs it to the control unit 63. The method of calculating the direction and distance will be described later. The identification information of the wireless tag 80 is an identification number registered when the wireless unit 65 (wireless tag unit 55) and each wireless tag 80 are paired.

[0034] The memory unit 66 stores the identification information of the wireless tag 80 received from the camera 10, and stores information for associating the identification information of the wireless tag 80S received from the wireless unit 65 with the direction and distance data of the wireless tag 80.

[0035] The driving section (changing section) 67 changes the angle of view (imaging range) by moving the lens of the imaging unit 51 in an arbitrary direction. The driving section 67 rotates or moves the lens etc. at a specified rotation speed or movement amount based on a command from the control section 63. This changes the pan (horizontal direction), tilt (vertical direction), and zoom (enlargement / reduction) of the imaging unit 51, and changes the angle of view (imaging range).

[0036] (Radio tag section 15, 35, radio tag 80) FIG. 8 is a block diagram showing the functions of the wireless tag units 15 and 35 and the wireless tag 80. As shown in FIG. The wireless tag units 15 and 35 and the wireless tag 80 each include a control unit 91 , a transmitting / receiving unit 92 , a wireless antenna 93 , and a storage unit 94 .

[0037] The control unit 91 of the wireless tag unit 15, 35 (wireless unit 35, 65) transmits and receives identification information of the wireless tag 80 through wireless communication using electromagnetic waves with the wireless tag 80, and obtains the direction and distance (position information) of the wireless tag 80. The method of calculating the direction and distance will be described later. Then, the control unit 91 communicates with the cameras 10 and 50 to transmit and receive the transmission and reception setting data, the identification information of the wireless tag 80, the position information (direction, distance) of the wireless tag 80, and data necessary for wireless communication.

[0038] The control unit 91 of the wireless tag 80 communicates with the wireless tag units 15 and 35 to transmit and receive setting data, identification information of the wireless tag 80, and data necessary for wireless communication.

[0039] The control unit 91, like the control units 33 and 63, includes a CPU 41, a ROM 42, and a RAM 43 (see FIG. 5). The control unit 91 sets various parameters for wireless communication, etc. The control unit 91 executes a computer program stored in the ROM 42 or the RAM 43. The RAM 43 has a storage area for the computer program executed by the control unit 91, a work area during execution of the computer program, a storage area for data, etc.

[0040] The transmitter / receiver 92 modulates and demodulates data in accordance with transmission / reception settings, such as the radio frequency, transmission power, and modulation method, determined for wireless communication. The wireless antenna 93 converts between an electric signal and an electromagnetic wave. The wireless tag units 15 and 35 have, as an example, a plurality of wireless antennas 93. The wireless tag units 15 and 35 have, for example, two wireless antennas 93, but may have only one. The wireless tag 80 has one wireless antenna 93, but may have a plurality of wireless antennas. When the frequency range to be handled is wide, a plurality of radio antennas with different characteristics may be arranged, in which case separate radio antennas may be provided.

[0041] The storage unit 94 stores setting values ​​relating to wireless transmission and reception, identification information of wireless tags, and setting values ​​for connection with the outside by the control unit 91. Representative examples of wireless standards, communication technologies, and frequency bands that the wireless tag units 15, 35 and the wireless tag 80 handle include wireless LAN, Bluetooth, UWB (Ultra Wide Band), and LPWA (Low Power Wide Area).

[0042] (Direction calculation process) FIG. 9 is a diagram for explaining the principle of the direction calculation process. The direction calculation process is a process for calculating the direction of a sound source from the time difference of the voices (sounds) detected by the microphone 20 (microphone sensors 21-28). The direction of a sound source may be calculated from the sound pressure level of the sounds detected by the microphone sensors 21-28.

[0043] FIG. 9A shows how sound from a sound source P (speaker P) reaches the microphone sensor 21 and the microphone sensor 22 from a direction at an angle θ. The microphone sensor 21 and the microphone sensor 22 are disposed at a distance D2 apart. In this case, the difference L between the distance between the sound source P and the microphone sensor 21 and the distance between the sound source P and the microphone sensor 22 is expressed by the following equation. L = D2 × cosθ (1)

[0044] Furthermore, if the speed of sound is V and the time difference between the sound reaching the microphone sensors 21 and 22 is T, the angle θ between the line formed by the two microphone sensors 21 and 22 and the line formed by the sound source and microphone sensor 22 is expressed by the following equation. cosθ=L / D2=(T×V) / D2 (2)

[0045] Figure 9(B) shows the values ​​of L and θ with respect to the time difference T. D2 = 50 mm, V = 346.75 m / s. For example, when T = 144 μs, L = 50 mm, θ = 0 deg. When T = 139 μs, L = 48 mm, θ = 15 deg. In this manner, the angle θ can be obtained from the time difference T, and the direction of the sound source P from the microphones 21 and 22 can be calculated.

[0046] The same applies to the direction calculation process in the wireless tag units 15, 55 and the wireless tag 80. The sound source P corresponds to the wireless tag 80, and the microphone sensors 21, 22 correspond to the wireless tag units 15, 55. In addition, in direction calculation using the microphone sensors 21, 22, the speed V is the speed of sound, whereas in the wireless tag units 15, 55 and the wireless tag 80, the speed of radio waves (electromagnetic waves) is approximately the same as the speed of light.

[0047] (Distance calculation process) FIG. 10 is a diagram for explaining the principle of the distance calculation process. The distance calculation process is a surveying method that uses trigonometry and geometry to measure angles from the known positions of the microphone sensors 21 to 28 to a point to be measured, thereby determining the position of the point.

[0048] It shows how sound from a sound source (speaker P) reaches two different microphone pairs (microphone sensors 21, 22 and microphone sensors 23, 24). θ1 to θ4 are angles θ calculated by the direction calculation process described above. The distance between the microphone sensors 21 and 22 (first microphone pair) is D12, and the length of the line segment obtained by drawing a perpendicular line from P to a straight line passing through the microphone sensors 21 and 22 is L12. In this case, the distance D12 is expressed by the following equation. D12 = (L12 / tan θ1) + (L12 / tan θ2) Therefore, the distance L12 is expressed by the following equation. L12=D12 / ((1 / tanθ1)+(1 / tanθ2))

[0049] By this calculation method, the distance L12 is found, and the distance L12 is the distance from the camera 10 to the speaker P. By performing similar calculations for a second microphone pair (microphone sensors 23, 24) that is in a coordinate system different from that of the first microphone pair (microphone sensors 23, 24), the three-dimensional coordinates of the sound source P relative to the camera 10 can be obtained.

[0050] The same applies to the distance calculation process in the wireless tag units 15, 55 and the wireless tag 80. The sound source P corresponds to the wireless tag 80, and the microphone sensors 21, 22 correspond to the wireless tag units 15, 55. In addition, in distance calculation using the microphone sensors 21, 22, the speed V is the speed of sound, whereas in the wireless tag units 15, 55 and the wireless tag 80, the speed of radio waves (electromagnetic waves) is approximately the same as the speed of light.

[0051] [Imaging method] FIG. 11 is a flow chart showing an imaging method. The imaging method according to an embodiment of the present invention includes a sound collection process S10, a sound source detection process S20, a first wireless tag detection process S30, a wireless tag identification process S40, a transmission process S50, a reception process S60, a second wireless tag detection process S70, a field of view determination process S80, and a change process S90. By executing a computer program stored in the ROM 42 or the RAM 43, each unit of the camera system 5 is controlled by the computer (CPU 41) and an imaging method is implemented.

[0052] In the sound collection step S10, among the microphones 20 provided in the camera 10, two or more microphone sensors (for example, microphone sensors 21 and 22) detect input of sound.

[0053] In the sound source detection step S20, the control unit 33 uses the audio signals from the microphone sensors 21 and 22 to calculate the direction and distance of the sound source (speaker P). The direction of the sound source is calculated by the above-mentioned direction calculation process from the time difference between the sounds input to the microphone sensors 21 and 22. The distance to the sound source is calculated by the above-mentioned distance calculation process.

[0054] In the first wireless tag detection step S30, the camera 10 detects a plurality of wireless tags 80, and calculates the direction and distance from the camera 10 to each of the wireless tags 80.

[0055] In the wireless tag identification process S40, based on the position information (direction, distance) of the sound source, a wireless tag (designated wireless tag) 80S arranged at a position closest to the position is selected from the multiple wireless tags 80. In other words, the designated wireless tag 80S in the vicinity of the sound producer P is selected.

[0056] In the transmission step S50, the identification information of the wireless tag 80S is transmitted to the camera 50. The method of transmission to the camera 50 may be through network communication by the communication unit 34, or through wireless communication by the wireless unit 35.

[0057] In the receiving step S60, the camera 50 receives the identification information of the wireless tag 80S.

[0058] In the second wireless tag detection step S70, the camera 50 detects a plurality of wireless tags 80, and calculates the direction and distance from the camera 50 to each of the wireless tags 80.

[0059] In the angle of view determination step S80, a wireless tag 80S having the same identification information as the identification information is searched for, and the direction and distance of the wireless tag 80S from the camera 50 are obtained. Then, the pan and tilt setting values ​​of the camera 50 are determined from the direction of the wireless tag 80S, and the zoom setting value is determined from the distance of the wireless tag 80S. In other words, the angle of view for capturing an image of the designated wireless tag 80S by the camera 50 is determined.

[0060] In the changing step S90, the control unit 63 controls the driving of the driving unit 67 to operate the imaging unit 51 in panning, tilting, and zooming.

[0061] In this way, in the imaging method, the wireless tag 80S closest to the speaker P detected by the camera 10 is selected, and the camera 50 is directed in the direction of the selected wireless tag 80S. As a result, even if the positions of the cameras 10 and 50 have not been decided, the camera 50 can pan, tilt, and zoom in the direction of the speaker P to capture an appropriate image.

[0062] The disclosure of this embodiment includes the following configurations. (Configuration 1) A first imaging device having a wide-angle imaging range; a second imaging device capable of changing an angle of view within the imaging range; Equipped with The first imaging device is A sound collecting unit that detects sounds generated in the imaging range; a sound source detection unit that determines position information of a sound source relative to the first imaging device based on detection information from the sound collection unit; a first wireless tag unit that detects a plurality of wireless tags arranged in the imaging range and obtains position information of the plurality of wireless tags relative to the first imaging device; a wireless tag identification unit that identifies a designated wireless tag located near the sound source based on the position information of the sound source and the position information of the plurality of wireless tags; a transmitter for transmitting identification information for identifying the designated wireless tag; Equipped with The second imaging device is a receiving unit for receiving the identification information of the designated wireless tag; a second wireless tag unit that detects the designated wireless tag based on the identification information of the designated wireless tag and obtains position information of the plurality of wireless tags relative to the second imaging device; a view angle determination unit that acquires position information of the designated wireless tag based on the identification information and determines a view angle for capturing an image of the designated wireless tag; a change unit that changes the angle of view of the second imaging device based on a command from the angle of view determination unit; A camera system comprising: (Configuration 2) The camera system according to claim 1 , wherein the sound collection unit has a plurality of microphones. (Configuration 3) The camera system according to claim 2 , wherein the sound source detection unit determines a direction of the sound source relative to the first imaging device based on sounds detected by the plurality of microphones. (Configuration 4) 4. The camera system according to claim 3, wherein the sound source detection unit determines a direction of the sound source relative to the first imaging device based on a time difference or a sound pressure level of the sounds detected by the plurality of microphones. (Configuration 5) 3. The camera system according to claim 2, wherein the sound source detection unit determines a distance of the sound source from the first imaging device based on sounds detected by the plurality of microphones and distances to the plurality of microphones. (Configuration 6) The camera system according to claim 5 , wherein the sound source detection unit determines three-dimensional coordinates of the sound source relative to the first imaging device by using two different microphone pairs among the plurality of microphones. (Configuration 7) the first wireless tag unit and the second wireless tag unit each have a plurality of wireless antennas; 2. The camera system according to claim 1, wherein directions of the plurality of wireless tags relative to the first wireless tag unit or the second wireless tag unit are determined based on a time difference or a level of radio waves received by the plurality of wireless antennas. (Configuration 8) 2. The camera system according to claim 1, wherein the identification information is an identification number registered when the first wireless tag unit and the second wireless tag unit are paired with the plurality of wireless tags. (Configuration 9) 2. The camera system according to claim 1, wherein the plurality of wireless tags are attached to a floor or a wall of a room in which the first imaging device and the second imaging device are installed. (Configuration 10) 2. The camera system according to claim 1, wherein the plurality of wireless tags are attached to tables or chairs arranged in a room in which the first imaging device and the second imaging device are installed. (Configuration 11) The camera system according to claim 1 , wherein the plurality of wireless tags are carried by a person entering a room in which the first imaging device and the second imaging device are installed. (method) A first imaging device having a wide-angle imaging range; a second imaging device capable of changing an angle of view within the imaging range; An imaging method for controlling a camera system comprising: a sound collection step of detecting a sound emitted in the imaging range; a sound source detection process for determining position information of a sound source relative to the first imaging device based on detection information from the sound collection process; a first wireless tag detection step of detecting a plurality of wireless tags arranged in the imaging range and obtaining position information of the plurality of wireless tags relative to the first imaging device; a wireless tag identification process for identifying a designated wireless tag disposed near the sound source based on the position information of the sound source and the position information of the plurality of wireless tags; a transmission step of transmitting identification information for identifying the designated wireless tag from the first imaging device; a receiving step of receiving identification information of the designated wireless tag by the second imaging device; a second wireless tag detection step of detecting the designated wireless tag based on the identification information of the designated wireless tag and obtaining position information of the plurality of wireless tags relative to the second imaging device; a view angle determination step of acquiring position information of the designated wireless tag based on the identification information and determining a view angle for capturing an image of the designated wireless tag; changing the angle of view of the second imaging device to the determined angle of view; The imaging method comprises: (Computer Program) A computer program for controlling each part of the camera system of any one of configurations 1 to 11 by a computer.

[0063] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0064] 1. Video conferencing system 3. Server equipment 4. Network 5 Camera System 10 Camera (first imaging device) 15 Wireless tag section (first wireless tag section) 20 Microphone (sound collection unit) 21~28 Microphone sensor 33 Control unit (sound source detection unit, wireless tag identification unit) 34 Communication unit (transmission unit) 35 Radio Section 37 Sound collection section (sound collection section) 41 CPU (Computer) 50 Camera (second imaging device) 55 Wireless tag unit (second wireless tag unit) 63 Control unit (angle of view determination unit) 64 Communication unit (receiving unit) 65 Radio Section 67 Drive unit (changed part) 80 Radio Tags 80S designated wireless tag 91 Control Unit 93 Radio Antenna H Conference Room (Room) F Floor W wall T Table C. Chair M Conference Monitor N Microphone P Speaker (sound source, person entering the room)

Claims

1. A first imaging device having a wide-angle imaging range; a second imaging device capable of changing an angle of view within the imaging range; Equipped with The first imaging device is A sound collecting unit that detects sounds generated in the imaging range; a sound source detection unit that determines position information of a sound source relative to the first imaging device based on detection information from the sound collection unit; a first wireless tag unit that detects a plurality of wireless tags arranged in the imaging range and obtains position information of the plurality of wireless tags relative to the first imaging device; a wireless tag identification unit that identifies a designated wireless tag located near the sound source based on the position information of the sound source and the position information of the plurality of wireless tags; a transmitter for transmitting identification information for identifying the designated wireless tag; Equipped with The second imaging device is a receiving unit for receiving the identification information of the designated wireless tag; a second wireless tag unit that detects the designated wireless tag based on the identification information of the designated wireless tag and obtains position information of the plurality of wireless tags relative to the second imaging device; a view angle determination unit that acquires position information of the designated wireless tag based on the identification information and determines a view angle for capturing an image of the designated wireless tag; a change unit that changes the angle of view of the second imaging device based on a command from the angle of view determination unit; A camera system comprising:

2. The camera system according to claim 1 , wherein the sound collection unit has a plurality of microphones.

3. The camera system according to claim 2 , wherein the sound source detection unit determines a direction of the sound source relative to the first imaging device based on sounds detected by the plurality of microphones.

4. The camera system according to claim 3 , wherein the sound source detection unit determines a direction of the sound source relative to the first imaging device based on a time difference or a sound pressure level of the sounds detected by the plurality of microphones.

5. The camera system according to claim 2 , wherein the sound source detection unit determines a distance of the sound source from the first imaging device based on sounds detected by the plurality of microphones and distances to the plurality of microphones.

6. The camera system according to claim 5 , wherein the sound source detection unit determines three-dimensional coordinates of the sound source relative to the first imaging device by using two different microphone pairs among the plurality of microphones.

7. the first wireless tag unit and the second wireless tag unit each have a plurality of wireless antennas; The camera system according to claim 1 , further comprising: determining directions of the plurality of wireless tags relative to the first wireless tag unit or the second wireless tag unit based on a time difference or a level of radio waves received by the plurality of wireless antennas.

8. The camera system according to claim 1 , wherein the identification information is an identification number registered when the first wireless tag unit and the second wireless tag unit are paired with the plurality of wireless tags.

9. The camera system according to claim 1 , wherein the plurality of wireless tags are attached to a floor or a wall of a room in which the first imaging device and the second imaging device are installed.

10. The camera system according to claim 1 , wherein the plurality of wireless tags are attached to tables or chairs arranged in a room in which the first imaging device and the second imaging device are installed.

11. The camera system according to claim 1 , wherein the plurality of wireless tags are carried by people entering a room in which the first imaging device and the second imaging device are installed.

12. A first imaging device having a wide-angle imaging range; a second imaging device capable of changing an angle of view within the imaging range; An imaging method for controlling a camera system comprising: a sound collection step of detecting a sound emitted in the imaging range; a sound source detection process for determining position information of a sound source relative to the first imaging device based on detection information from the sound collection process; a first wireless tag detection step of detecting a plurality of wireless tags arranged in the imaging range and obtaining position information of the plurality of wireless tags relative to the first imaging device; a wireless tag identification process for identifying a designated wireless tag disposed near the sound source based on the position information of the sound source and the position information of the plurality of wireless tags; a transmission step of transmitting identification information for identifying the designated wireless tag from the first imaging device; a receiving step of receiving identification information of the designated wireless tag by the second imaging device; a second wireless tag detection step of detecting the designated wireless tag based on the identification information of the designated wireless tag and obtaining position information of the plurality of wireless tags relative to the second imaging device; a view angle determination step of acquiring position information of the designated wireless tag based on the identification information and determining a view angle for capturing an image of the designated wireless tag; changing the angle of view of the second imaging device to the determined angle of view; The imaging method comprises:

13. A computer program for controlling each unit of the camera system according to any one of claims 1 to 11 by a computer.

Images