Imaging control device, control method, and program

Abstract

To reduce the amount of user operation and to enable transmission of appropriate images from among images received from a plurality of imaging devices.SOLUTION: An imaging control device that processes images received from multiple imaging devices includes acquisition means that acquires information about the distance between a subject and the multiple imaging devices on the basis of wireless signals transmitted from the multiple imaging devices, selection means that selects images received from the multiple imaging devices on the basis of the information about the distance between the subject and the multiple imaging devices acquired by the acquisition means, and transmission means that transmits the image selected by the selection means.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an imaging control device, a control method therefor, and a program. [Background technology]

[0002] Multi-angle streaming technology, which distributes video from multiple viewpoints by switching between cameras, has been known for some time. While video switching is typically performed by a dedicated operator, in recent years, there have been cases where the streamer operates the system themselves, thereby acting as both the operator and the subject. For example, when multiple cameras are deployed for multi-angle streaming at outdoor leisure activities such as camping, the operator must take the time and effort of switching between the screens while checking the video to be distributed. In this way, it is not easy to perform the switching operation when the operator is also the subject.

[0003] Patent document 1 discloses a surveillance screen display control device that uses image recognition to determine the direction in which a subject moves as a movement line, and determines the display order of surveillance camera images in order of the shortest distance between the subject and the intersection of that movement line and the direction in which the surveillance camera is facing. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-145730 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the monitoring screen display control device of Patent Document 1 has a problem in that it is not possible to display an appropriate image because the moving line of the subject cannot be obtained when the subject is not captured on the monitoring camera. The present invention has been made in consideration of the above-mentioned problems, and aims to reduce user operations and enable transmission of appropriate images from among images received from multiple imaging devices. [Means for solving the problem]

[0006] The present invention is an imaging control device that processes images received from multiple imaging devices, and is characterized by having an acquisition means that acquires information about the distance between a subject and the multiple imaging devices based on wireless signals transmitted from the multiple imaging devices, a selection means that selects images received from the multiple imaging devices based on the information about the distance between the subject and the multiple imaging devices acquired by the acquisition means, and a transmission means that transmits the image selected by the selection means. [Effects of the Invention]

[0007] The present invention aims to reduce the amount of user operation and to enable transmission of appropriate images from among images received from a plurality of imaging devices. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system and a distribution system. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of a smartphone. [Figure 3] FIG. 1 illustrates an example of the configuration of an imaging device. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of a smartphone. [Figure 5] FIG. 2 is a diagram illustrating an example of the configuration of a Bluetooth communication unit. [Figure 6] A figure showing an example of the configuration of advertising information as direction information. [Figure 7] FIG. 10 is a diagram for explaining a method for estimating the direction of an imaging device. [Figure 8] FIG. 1 is a diagram for explaining an outline of distance estimation by triangulation. [Figure 9] FIG. 2 is a diagram illustrating the positional relationship between a subject and an imaging device according to the first embodiment. [Figure 10] 10 is a flowchart illustrating an example of processing by a smartphone. [Figure 11] FIG. 10 is a diagram illustrating an example of video data displayed on a smartphone. [Figure 12] FIG. 10 is a diagram illustrating the positional relationship between a subject and an imaging device according to a second embodiment. [Figure 13] 10 is a flowchart illustrating an example of processing by a smartphone. [Figure 14] FIG. 10 is a diagram illustrating an example of video data displayed on a smartphone. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of the configuration of an imaging system 10 and a distribution system 100. As shown in FIG. The imaging system 10 is configured so that a smartphone 200 as an imaging control device and a plurality of imaging devices 300 (300A to 300C) as external devices can communicate with each other via wired or wireless connections. When the smartphone 200 and the plurality of imaging devices 300A to 300C are wirelessly connected, communication is established by connecting them directly via P2P or via an IP network.

[0010] The imaging devices 300A to 300C transmit captured video data to the smartphone 200. The video data includes audio data in addition to video data and still image data. The video data may also include audio analysis data, subtitle data, etc. Here, the imaging devices 300A to 300C will be described as transmitting video data to the smartphone 200.

[0011] The smartphone 200 converts the video data received from the imaging devices 300A to 300C into a data format suitable for distribution either directly or after image processing and the like, and transmits the converted data to the distribution system 100. At this time, the smartphone 200 selects from which of the multiple imaging devices 300A to 300C connected thereto the video data received from which to transmit to the distribution system 100.

[0012] The distribution system 100 is a service or system that simultaneously distributes video data received from a smartphone 200 to multiple viewers. The distribution system 100 distributes video data in various genres, such as entertainment, promotion, training, and outdoor leisure, depending on the purpose and use.

[0013] FIG. 2 is a diagram illustrating an example of the configuration of the smartphone 200. As shown in FIG. Here, the case where the imaging control device is a smartphone 200 will be described, but the imaging control device is not limited to this case, and may be an information processing device such as a tablet device with a wireless function, a personal computer, or the like.

[0014] The control unit 201 controls each unit of the smartphone 200 in accordance with input signals and a program described later. Note that instead of the control unit 201 controlling the entire device, the entire device may be controlled by having multiple pieces of hardware share the processing.

[0015] The imaging unit 202 converts the subject light imaged by the lens included in the imaging unit 202 into an electrical signal, performs noise reduction processing, etc., and outputs the digital data as image data. The captured image data is stored in a buffer memory, and then the control unit 201 performs a predetermined calculation on the data and records it on the recording medium 214.

[0016] The nonvolatile memory 203 is an electrically erasable and recordable nonvolatile memory. The nonvolatile memory 203 stores an OS (operating system), which is basic software executed by the control unit 201, and applications (programs) that work with the OS to realize applied functions. The nonvolatile memory 203 also stores applications for communicating with the image capture devices 300A to 300C.

[0017] The working memory 204 is used as a buffer memory for temporarily storing image data captured by the imaging unit 202, as an image display memory for the display unit 206, as a working area for the control unit 201, and the like. The operation unit 205 is used to receive instructions from the user for the smartphone 200. The operation unit 205 includes, for example, a power button that the user uses to instruct the smartphone 200 to power on / off, a touch panel formed on the display unit 206, and the like.

[0018] The display unit 206 displays image data, displays characters for interactive operations, etc. Note that the smartphone 200 is not limited to having the display unit 206, but may be connected to the display unit 206 and have at least a display control function for controlling the display of the display unit 206.

[0019] The communication unit 207 is a communication interface for connecting to an external device, and is configured to include one or more communication circuits or communication modules. The communication unit 207 of this embodiment performs wireless communication in accordance with, for example, the IEEE802.11x (x is b, a, g, n, ac, etc.) standard under the control of the control unit 201. In this embodiment, the communication unit 207 is used for communication with a public network or external devices (image capture devices 300A to 300C) via a wireless LAN access point (hereinafter, AP), which is an external device. Here, the public network is a public computer network that cannot be directly accessed by the communication unit 207, such as the Internet. The communication unit 207 may be any unit capable of communicating with the image capturing devices 300A to 300C, and may include, for example, an infrared module, a wireless communication module such as Wireless USB, etc. Furthermore, the communication unit 207 may be a wired communication module for wired connection such as a USB cable, HDMI (registered trademark), or IEEE1394.

[0020] The Bluetooth communication unit 208 includes, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, and a communication controller. The Bluetooth communication unit 208 realizes short-range wireless communication in accordance with the IEEE802.15 standard (Bluetooth (registered trademark)) by outputting modulated wireless signals from the antenna and demodulating wireless signals received by the antenna. The Bluetooth communication unit 208 can control the establishment and termination of communication by treating communication using the Bluetooth Low Energy (BLE) communication method and communication using the Bluetooth Classic communication method as separate communications. Both Bluetooth Low Energy communication and Bluetooth Classic communication use the 2.4 GHz frequency band. The smartphone 200 of this embodiment can transmit and receive data to and from the imaging devices 300A to 300C via the Bluetooth communication unit 208. The Bluetooth communication unit 208 of this embodiment is compatible with the Bluetooth 5.1 standard, which will be described later.

[0021] The sensor unit 209 detects the state of the smartphone 200 and various pieces of information about the surroundings of the smartphone 200. Specifically, the sensor unit 209 includes a magnetic sensor, an electromagnetic wave sensor, and the like. The magnetic sensor detects information about the orientation of the smartphone 200. The electromagnetic wave sensor detects information about the reception strength of radio waves received by the communication unit 207 or the Bluetooth communication unit 208.

[0022] Public network communication unit 211 is an interface used when performing public wireless communication. A user can make a call with another device via public network communication unit 211. A call can be realized by control unit 201 inputting and outputting audio signals via microphone 212 and speaker 213. Public network communication unit 211 is an antenna, and control unit 201 can connect to a public network via the antenna. Note that a single antenna can be used as both communication unit 207 and public network communication unit 211.

[0023] The recording medium 214 is a recording medium such as a memory card for recording captured image data, and is configured from a semiconductor memory, a magnetic disk, or the like.

[0024] FIG. 3 is a diagram showing an example of the configuration of the imaging device 300. As shown in FIG. Here, the case where the imaging device 300 is a camera will be described, but the present invention is not limited to this case, and the imaging device 300 may be a smartphone, tablet device, or the like with a wireless function. The imaging device 300 includes a control unit 301, an imaging unit 302, a non-volatile memory 303, a working memory 304, an operation unit 305, a display unit 306, a communication unit 307, a Bluetooth communication unit 308, and a sensor unit 309. Each component of the imaging device 300 has the same basic function as each component of the smartphone 200, and therefore detailed description thereof will be omitted. The sensor unit 309 detects the state of the imaging device 300 and various types of information about the surroundings of the imaging device 300. Specifically, the sensor unit 309 includes a magnetic sensor, etc. The magnetic sensor detects information about the orientation of the imaging device 300 (information about the imaging direction).

[0025] FIG. 4 is a diagram illustrating an example of the functional configuration of the smartphone 200. As shown in FIG. Smartphone 200 has video data receiving units 401A to 401C, direction information receiving units 402A to 402C, distance acquisition unit 403, selection unit 404, generation unit 405, and transmission unit 406. The functional configuration of smartphone 200 shown in Fig. 4 is configured by control unit 201 executing an application (program) recorded in non-volatile memory 203. Furthermore, data processing shown in Fig. 4 is realized by control unit 201 executing read / write using working memory 204.

[0026] The video data receiving units 401A to 401C receive video data from the imaging devices 300A to 300C connected via the communication unit 207. An example of the format of the data received by the video data receiving units 401A to 401C is the RTMP format. The video data receiving units 401A to 401C output the received video data to the generation unit 405. Here, the smartphone 200 has video data receiving units 401A to 401C that receive video data from the imaging devices 300A to 300C, respectively, but may have a single video data receiving unit that receives video data from the imaging devices 300A to 300C. The video data received from the imaging devices 300A to 300C is recorded in the working memory 204 in association with identification information of the imaging devices 300A to 300C.

[0027] The orientation information receiving units 402A to 402C receive orientation information of the imaging devices 300A to 300C from the imaging devices 300A to 300C via the Bluetooth communication unit 208. The orientation information receiving units 402A to 402C output the received orientation information to the distance acquisition unit 403. Here, the smartphone 200 has orientation information receiving units 402A to 402C that receive orientation information from the imaging devices 300A to 300C, respectively, but may have a single orientation information receiving unit that receives orientation information from the imaging devices 300A to 300C. The orientation information received from the imaging devices 300A to 300C is recorded in the working memory 204 in association with the identification information of the imaging devices 300A to 300C.

[0028] Distance acquisition unit 403 acquires information about the distance between smartphone 200 and each of imaging devices 300A to 300C based on the direction information from imaging devices 300A to 300C. A specific method for acquiring the distance information will be described later with reference to Figs. 5 to 8. Distance acquisition unit 403 outputs information about the distance between smartphone 200 and each of imaging devices 300A to 300C to selection unit 404.

[0029] The selection unit 404 selects a video to be transmitted to the distribution system 100 based on the distance information output from the distance acquisition unit 403. Specifically, the selection unit 404 selects a video received from the imaging device that is closest in distance between the smartphone 200 and each of the imaging devices 300A to 300C. The selection unit 404 outputs information about the selected video to the generation unit 405.

[0030] Based on the video information output from the selection unit 404, the generation unit 405 generates video data by combining the video data output from the video data receiving units 401A to 401C. The transmitting unit 406 transmits the video data generated by the generating unit 405 to the distribution system 100 (and the display unit 206).

[0031] The format of data input and output is not limited to the functional configuration of smartphone 200 shown in Fig. 4. For example, the format of video data is not limited to a format corresponding to the output format of imaging devices 300A-300C and a format receivable by distribution system 100, and can be changed as appropriate depending on the decoding and encoding processing speed and video quality characteristics.

[0032] Next, a method by which the smartphone 200 acquires information about the distance between the smartphone 200 and each of the imaging devices 300A to 300C will be described. Here, the Bluetooth 5.1 standard includes a direction detection function. That is, the Bluetooth 5.1 standard allows a receiving device to estimate the direction in which a transmitting device is located based on a signal transmitted by the transmitting device. For example, the receiving device can estimate the direction in which a transmitting device is located based on BLE advertisement information transmitted by the transmitting device. Below, a method for estimating the direction in which imaging devices 300A to 300C are located relative to smartphone 200 will be described with reference to FIGS. 5 to 8.

[0033] FIG. 5 is a diagram showing an example of the configuration of the Bluetooth communication unit 208 of the smartphone 200 and the Bluetooth communication unit 308 of the imaging device 300. As shown in FIG. The Bluetooth communication unit 208 of the smartphone 200 has antennas 501 to 503, and the Bluetooth communication unit 308 of the imaging device 300 has antennas 504 to 506. The number of antennas that the Bluetooth communication units 208 and 308 have is not limited, and may have, for example, only one or two antennas, or four or more antennas. The number of antennas that the Bluetooth communication unit 208 has may be different from the number of antennas that the Bluetooth communication unit 308 has. In FIG. 5, the antennas of the Bluetooth communication units 208 and 308 are arranged in a straight line, but this is not limited to this, and the antennas may be arranged two-dimensionally on a plane or three-dimensionally.

[0034] 6 is a diagram showing an example of the configuration of advertising information as direction information transmitted from the imaging devices 300A to 300C. The Bluetooth communication unit 308 of the imaging device 300 periodically transmits advertising information. The smartphone 200 requests a connection based on the advertising information received by the Bluetooth communication unit 208, whereby the smartphone 200 and the imaging device 300 are connected. Furthermore, the smartphone 200 can detect the direction of the imaging device 300 relative to the smartphone 200 based on the advertising information. The availability information includes a preamble 601, an access address 602, a PDU 603, a CRC 604, and a constant tone extension (CTE 605).

[0035] The preamble 601 is data for clock synchronization when the smartphone 200 receives the advertisement information of the imaging device 300 . The Access-Address 602 is data for frame synchronization when the smartphone 200 receives advertisement information from the imaging device 300 . The PDU 603 is the actual data portion of the advertising information transmitted by the image capture device 300. The advertising information is composed of a header and a payload, and the payload includes the device name, connection information, Tx Power, and identification information of the communication device. The header and payload, which are the advertising information, are included in the PDU 603. The CRC 604 is an error detection code value used when the PDU 603 is communicated. The CTE 605 is data used to estimate the direction of the image capture device 300 relative to the smartphone 200.

[0036] The methods by which the smartphone 200 estimates the direction of the imaging device 300 are classified into a method when the Bluetooth communication unit 208 (receiving side) has multiple antennas and a method when the Bluetooth communication unit 308 (transmitting side) has multiple antennas. In this embodiment, a method for estimating the direction of the imaging device 300 when the Bluetooth communication unit 208 (receiving side) has multiple antennas will be described with reference to FIG.

[0037] 7, the angle of arrival of radio waves received by Bluetooth communication unit 208 is estimated based on the phase difference of the radio waves when they arrive at each antenna, using multiple antennas 501 and 502 of Bluetooth communication unit 208 on the receiving side. Hereinafter, the angle of arrival may be referred to as AoA 701. 7, the Bluetooth communication unit 308 transmits advertising information by a radio frame (AoA Radio Signal 701) using the antenna 504. The radio frame here is a radio frame as shown in FIG. 6. However, the radio frame is not limited to this and may be a conventional radio frame or a radio frame of another format such as a radio frame conforming to the Classic Bluetooth standard. Furthermore, a radio frame including information other than advertising information may be used for direction estimation. The Bluetooth communication unit 208 receives radio frames by multiple antennas (both antennas 501 and 502). At this time, it is assumed that the inter-antenna distance 703 between the antennas 501 and 502 is d1 and the AoA 701 is θ. In this case, the radio wave received by the antenna 501 is received at a distance that is d1×cos(θ) longer than the radio wave received by the antenna 502. Therefore, if the wavelength of the radio wave is λ, the phase of the radio wave received by the antenna 501 is different from the phase of the radio wave received by the antenna 502. ψ1=2π×(d1×cos(θ) / λ)...Equation (1) Here, ψ1 is the difference between the phase of the radio wave received by antenna 502 and the phase of the radio wave received by antenna 501. From equation (1), AoA 701 is θ=arccos((ψ1×λ) / (2π×d1))...Equation (2) Therefore, the smartphone 200 can estimate the direction of the imaging device 300 by performing a calculation such as that in equation (2).

[0038] By estimating the direction of the image capturing device 300, the distance to the image capturing device 300 can be estimated from the direction of the image capturing device 300 by triangulation. 8 is a diagram for explaining an outline of estimating distance by triangulation. Here, the distance between antenna 800A and antenna 800C is distance A801, the distance between antenna 800B and antenna 800C is distance B802, and the distance between antenna 800A and antenna 800B is distance D803. Furthermore, if the angles of the direction that can be estimated by the above-mentioned equations (1) and (2) are angles θ1804 and θ2805, the relationship of equation (3) holds. A / sinθ1=B / sinθ2=D / sin(180°-(θ1+θ2))...Equation (3) Since the distance D803 between the antennas 800A and 800B is a fixed value, the distance A801 ​​and the distance B802 can be calculated from the formula (3).

[0039] Here, if it is assumed that smartphone 200 has antennas 800A and 800B, and imaging device 300 has antenna 800C, distance A801 ​​and distance B802 correspond to the distance from smartphone 200 to imaging device 300. Therefore, the distance from smartphone 200 to imaging device 300 can be estimated by triangulation from the direction of imaging device 300. Note that the smartphone 200 may have a first antenna 800A, a second antenna 800B, and a third antenna. In this case, the angle θ1 804 may be calculated from the phase difference between the radio waves received by the first antenna 800A and the second antenna 800B, and the angle θ2 805 may be calculated from the phase difference between the radio waves received by the second antenna 800B and the third antenna.

[0040] First Embodiment Next, we will explain the process in which smartphone 200 acquires information on the distance between smartphone 200 and multiple imaging devices 300, selects the video of the imaging device 300 that is closest to smartphone 200, and transmits it to distribution system 100 (and display unit 206). 9 is a diagram showing the positional relationship between subject 900 and imaging devices 300A to 300C. FIG. 9 shows an example in which imaging devices 300A to 300C are arranged facing different imaging directions, and subject 900 is holding smartphone 200. Here, of imaging devices 300A to 300C, imaging device 300A is located closest to subject 900. Furthermore, imaging devices 300A to 300C have angles of view 901A to 901C, respectively. Here, subject 900 is included within angle of view 901A of imaging device 300A and angle of view 901C of imaging device 300C.

[0041] Fig. 10 is a flowchart showing an example of processing by the control unit 201 of the smartphone 200. The flowchart in Fig. 10 starts when the control unit 201 executes an application (program) recorded in the non-volatile memory 203 in response to a user's operation to start the application.

[0042] In S1000, the control unit 201 (orientation information receiving units 402A to 402C) of the smartphone 200 receives orientation information from each imaging device 300 via the Bluetooth communication unit 208. In addition, the control unit 201 (video data receiving units 401A to 401C) of the smartphone 200 receives video data captured by each imaging device 300 via the communication unit 207. In S1001, the control unit 201 (distance acquisition unit 403) of the smartphone 200 acquires information on the distance between the smartphone 200 and each of the image capturing devices 300 by calculating it based on the received direction information. Therefore, in Fig. 9, the distance between the smartphone 200 carried by the subject 900 and the image capturing device 300A, the distance between the smartphone 200 and the image capturing device 300B, and the distance between the smartphone 200 and the image capturing device 300C are acquired.

[0043] In S1002, the control unit 201 (selection unit 404) of the smartphone 200 selects information on the video captured by the imaging device 300 located closest among the distances between the smartphone 200 and each imaging device 300. Therefore, in Fig. 9, the video captured by the imaging device 300A located closest to the subject 900 is selected.

[0044] In S1003, the control unit 201 (generation unit 405) of the smartphone 200 generates video data based on information about the selected video. Furthermore, the control unit 201 (transmission unit 406) of the smartphone 200 transmits the generated video data to the distribution system 100. In this embodiment, the control unit 201 generates video data by synthesizing the videos so that the display size of the selected video is larger than the display size of the unselected video. Furthermore, the control unit 201 transmits the generated video data to the display unit 206 for display, thereby enabling the user (subject 900) carrying the smartphone 200 to check the video data transmitted to the distribution system 100. The flowchart of Figure 10 is periodically executed by the control unit 201 of the smartphone 200, and the image captured by the imaging device 300 that is closest to the smartphone 200 at the current time is selected.

[0045] 11 is a diagram showing an example of video data displayed on the screen of display unit 206. Here, there are multiple display areas 1101A to 1101C, with display area 1101A being larger than display areas 1101B and 1101C, and display areas 1101B and 1101C being superimposed on display area 1101A.

[0046] Display area 1101A displays an image captured by imaging device 300A that is closest to smartphone 200. Therefore, subject 900 is displayed large in display area 1101A. Display area 1101B displays an image captured by imaging device 300B that is located away from smartphone 200. Here, subject 900 is not displayed in display area 1101B because subject 900 is not included in angle of view 901B of imaging device 300B shown in FIG. Display area 1101C displays an image captured by imaging device 300C that is distant from smartphone 200. Here, although subject 900 is included in angle of view 901C of imaging device 300C shown in Fig. 9, subject 900 is displayed small in display area 1101C because the distance between subject 900 and imaging device 300C is large.

[0047] In addition, if the subject 900 carrying the smartphone 200 moves and the image capturing device 300 closest to the smartphone 200 is replaced, the image captured by the image capturing device 300 that is now closest to the smartphone 200 will be switched and displayed in the display area 1101A.

[0048] As described above, in this embodiment, an image of the imaging device 300 that is closest to the smartphone 200 carried by the subject 900 is selected from among the imaging devices 300A to 300C, and image data to be displayed in the display area 1101A is generated. Therefore, an image in which the subject 900 is displayed large is automatically selected, which reduces the user's operations and enables appropriate images to be transmitted.

[0049] Furthermore, in this embodiment, instead of recognizing the subject from the video, the video of the imaging device 300 that is closest to the smartphone 200 is selected from among the imaging devices 300A to 300C. Therefore, even if the subject is not included in the angle of view of the specific imaging device, if the specific imaging device is closest to the subject, the video of the specific imaging device is selected, so that it is possible to transmit a video in which the subject fades in after fading out, for example.

[0050] (Second embodiment) Next, a process will be described in which the smartphone 200 selects the video of the imaging device 300 that is closest to the smartphone 200 from among the imaging devices 300 whose angle of view includes the subject, and transmits the video to the distribution system 100. In this embodiment, in addition to information on the distance between the imaging devices 300, information on the imaging direction of the imaging devices 300 is acquired to determine whether the imaging device 300 includes the subject within its angle of view.

[0051] Fig. 12 is a diagram showing the positional relationship between subject 1200 and imaging devices 300A to 300C. In Fig. 12, the same components as those in Fig. 9 are given the same reference numerals and descriptions thereof will be omitted as appropriate. Here, an example is shown in which, of imaging devices 300A to 300C, imaging device 300B is located closest to subject 1200, and subject 1200 is holding smartphone 200. Furthermore, subject 1200 is included within angle of view 901C of imaging device 300C, but is not included within angle of view 901A of imaging device 300A or angle of view 901B of imaging device 300B.

[0052] Fig. 13 is a flowchart showing an example of processing by the control unit 201 of the smartphone 200. The flowchart in Fig. 13 starts when the control unit 201 executes an application (program) recorded in the non-volatile memory 203 in response to a user's operation to start the application.

[0053] In S1300, the control unit 201 (orientation information receiving units 402A to 402C) of the smartphone 200 receives orientation information from each imaging device 300 via the Bluetooth communication unit 208. In addition, the control unit 201 (video data receiving units 401A to 401C) of the smartphone 200 receives video data captured by each imaging device 300 via the communication unit 207. In S1301, the control unit 201 (orientation information receiving units 402A to 402C) of the smartphone 200 receives orientation information of the imaging devices 300 from each imaging device 300 via the Bluetooth communication unit 208. Here, the orientation information is information on the imaging direction of the imaging device 300. If the upper side in FIG. 12 is north, the imaging direction of imaging device 300A is east, the imaging direction of imaging device 300B is south-southeast, and the imaging direction of imaging device 300C is north-northeast. Note that the imaging device 300 can acquire orientation information from the sensor unit 309 and can transmit the orientation information together with the orientation information, for example.

[0054] In S1302, the control unit 201 (selection unit 404) of the smartphone 200 identifies, from among the image capturing devices 300, an image capturing device 300 that includes a subject within its angle of view. Specifically, the control unit 201 identifies the imaging device 300 that includes the subject within its angle of view based on information on the direction of each imaging device positioned relative to the smartphone 200 and information on the orientation of each imaging device 300 (information on the imaging direction).

[0055] Here, the information on the direction of each imaging device 300 located relative to the smartphone 200 includes the direction. The control unit 201 can identify the direction of each imaging device 300 located relative to the smartphone 200 based on the information on the orientation of the smartphone 200 and the information on the direction of each imaging device 300. The information on the orientation of the smartphone 200 can be acquired from the sensor unit 209, and the information on the direction of each imaging device 300 can be acquired from the above-mentioned formula (2). The control unit 201 can identify the direction (bearing) of each imaging device 300 located relative to the smartphone 200 (subject 1200) by applying the information on the direction of each imaging device 300 to the information on the orientation of the smartphone 200. In FIG. 12, it is identified that imaging device 300A is located north, imaging device 300B is located west, and imaging device 300C is located south relative to the subject 1200.

[0056] Next, control unit 201 identifies the imaging devices 300 whose imaging directions are opposite to the directions of the imaging devices 300 positioned relative to smartphone 200 as imaging devices 300 whose imaging angles include subject 1200. In FIG. 12, imaging device 300C is located south of smartphone 200, and the imaging direction of imaging device 300C is north-northeast (roughly north), so they are almost opposite, and therefore imaging device 300C is identified as the imaging device 300 whose angle of view includes subject 1200. On the other hand, imaging device 300A is located north of smartphone 200, and the imaging direction of imaging device 300A is east, so they are not opposite. Similarly, imaging device 300B is located west of smartphone 200, and the imaging direction of imaging device 300B is south-southeast, so they are not opposite.

[0057] The control unit 201 can identify the position of each imaging device 300 by adding information about the distance between the smartphone 200 and each imaging device 300 acquired in S1303. This can improve the accuracy of identifying an imaging device 300 whose angle of view includes the subject 1200. Furthermore, the control unit 201 may acquire information about the lens of each imaging device 300 (such as the focal length of the lens) and information about the imaging conditions, along with, for example, the orientation information. By acquiring the lens information and imaging conditions for each imaging device 300, the control unit 201 can calculate the angle of view for each imaging device 300, thereby improving the accuracy of identifying an imaging device 300 whose angle of view includes the subject 1200.

[0058] In S1303, the control unit 201 (distance acquisition unit 403) of the smartphone 200 acquires information on the distance between the smartphone 200 and each imaging device 300 by calculating it based on the received direction information.

[0059] In S1304, the control unit 201 (selection unit 404) of the smartphone 200 selects information on video captured by the imaging device 300 that is closest to the smartphone 200, among the imaging devices 300 that include the subject 1200 within their angle of view. Therefore, in Fig. 12, the video captured by the imaging device 300C that includes the subject 1200 within its angle of view is selected.

[0060] In S1305, control unit 201 (generation unit 405) of smartphone 200 generates video data based on information about the selected video. Furthermore, control unit 201 (transmission unit 406) of smartphone 200 transmits the generated video data to distribution system 100. Furthermore, by transmitting the generated video data to display unit 206 and displaying it, a user (subject 1200) carrying smartphone 200 can check the video data being transmitted to distribution system 100.

[0061] 14 is a diagram showing an example of video data displayed on the screen of display unit 206. Here, there are multiple display areas 1401A to 1401C, with display area 1401A being larger than display areas 1401B and 1401C, and display areas 1401B and 1401C being superimposed on display area 1401A.

[0062] Display region 1401A displays an image captured by imaging device 300C, which is closest to smartphone 200 among imaging devices 300 that include subject 1200 within their angle of view. Therefore, subject 1200 is displayed in display region 1401A. Display region 1401B displays an image captured by imaging device 300A, whose angle of view does not include subject 1200. Here, since angle of view 901A of imaging device 300A shown in FIG. 12 does not include subject 1200, display region 1401B does not display subject 1200. Display region 1401C displays an image captured by imaging device 300B, whose angle of view does not include subject 1200. Here, since angle of view 901B of imaging device 300B shown in FIG. 12 does not include subject 1200, display region 1401C does not display subject 1200.

[0063] In this manner, in this embodiment, of the imaging devices 300 that include the subject 1200 within their angle of view, the image of the imaging device 300 that is closest to the smartphone 200 is selected, and video data to be displayed in the display area 1401A is generated. Therefore, since the image that includes the subject 1200 is automatically selected, it is possible to transmit an appropriate image.

[0064] In the present embodiment, the imaging devices 300 that include the subject 1200 within the angle of view for capturing images are identified based on the orientation of the imaging devices 300 relative to the smartphone 200 and the imaging direction of the imaging devices 300, but this is not limited to this. The control unit 201 of the smartphone 200 may identify the imaging devices 300 that include the subject 1200 within the angle of view by recognizing the subject 1200 (for example, the face of the subject 1200) from the images captured by the imaging devices 300.

[0065] <Third embodiment> In the first and second embodiments, the case where information on the distance to the imaging device 300 is acquired by triangulation based on the direction of the imaging device 300 has been described, but the present invention is not limited to this case. The control unit 201 of the smartphone 200 may acquire information on the distance to each imaging device 300 from information on the radio wave reception strength and information on the radio wave transmission power when direction information is received from each imaging device 300 via the Bluetooth communication unit 208. Note that the information on the radio wave reception strength can be acquired from the sensor unit 209 of the smartphone 200, and the information on the radio wave transmission power can be acquired together with the direction information, for example. Furthermore, the control unit 201 of the smartphone 200 may acquire information about the distance to the imaging device 300 based on a distance measurement function of UWB (Ultra-Wide Band). Furthermore, the control unit 201 of the smartphone 200 may acquire information about the distance to the imaging device 300 based on a function of measuring distance using a received signal strength indicator (RSSI).

[0066] <Fourth embodiment> In the first and second embodiments, the subject is described as a person, but the subject may also be a moving object such as an animal or a vehicle. If the subject is not a person, the same implementation as in the above-described embodiments can be achieved by attaching a communication device capable of communicating with smartphone 200 to the moving subject. The communication device can be, for example, a wearable device capable of transmitting and receiving data, and moves as the subject moves. 10, the control unit 201 of the smartphone 200 receives, from the communication device, the direction information that the communication device has received from each imaging device 300. The control unit 201 also receives video data captured by each imaging device 300.

[0067] In S1001, the control unit 201 of the smartphone 200 calculates information about the distance between the communication device and each imaging device 300 based on the received direction information. The control unit 201 has received information about the distance between the antennas of the communication devices from the communication devices in advance. Note that the communication devices themselves may calculate the information about the distance between the communication device and each imaging device 300. In this case, the control unit 201 of the smartphone 200 receives information about the distance between the communication device and each imaging device 300 calculated by the communication device from the communication device.

[0068] In S1002, the control unit 201 of the smartphone 200 selects information on the video captured by the imaging device 300 that is closest among the imaging devices 300 and the communication device. In S1003 , the control unit 201 of the smartphone 200 generates video data based on the information of the selected video, and transmits the generated video data to the distribution system 100 . In this way, in this embodiment, even if the subject does not have the smartphone 200, an appropriate video can be transmitted.

[0069] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a recording medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0070] While the present invention has been described in detail above based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various modifications within the scope of the present invention are also included in the present invention. In addition, parts of the above-described embodiments may be combined as appropriate.

[0071] In the above-described embodiments, the control unit 201 of the smartphone 200 generates video data by combining a selected video and a non-selected video, but the present invention is not limited to this. For example, the control unit 201 may generate video data using only the selected video.

[0072] The disclosure of the present embodiment also includes the following configurations. (Configuration 1) An imaging control device that processes images received from a plurality of imaging devices, an acquisition unit that acquires information about distances between a subject and the plurality of imaging devices based on wireless signals transmitted from the plurality of imaging devices; a selection unit that selects images received from the plurality of image capture devices based on information about the distance between the subject and the plurality of image capture devices acquired by the acquisition unit; a transmitting unit that transmits the image selected by the selecting unit. (Configuration 2) 2. The imaging control device according to configuration 1, wherein the selection means selects the video received from an imaging device that is closer to the subject than from an imaging device that is farther from the subject. (Configuration 3) 2. The imaging control device according to configuration 1, wherein the selection means selects the image received from the imaging device that is closest to the subject among the plurality of imaging devices. (Configuration 4) The imaging control device according to any one of configurations 1 to 3, wherein the selection means selects the images received from the plurality of imaging devices based on information about the distance between the imaging device that includes the subject within its imaging angle and the subject. (Configuration 5) The imaging control device according to configuration 4, wherein the selection means identifies an imaging device that includes the subject within an angle of view for imaging, based on the direction of the imaging device positioned relative to the subject and the imaging direction of the imaging device. (Configuration 6) The imaging control device according to configuration 5, wherein the selection means identifies the direction of the imaging device positioned relative to the subject based on information about the orientation of the imaging control device and information about the direction of the imaging device obtained from a phase difference between multiple wireless signals received for each imaging device. (Configuration 7) The imaging control device according to any one of configurations 4 to 6, wherein the selection means identifies an imaging device whose imaging direction is opposite to the direction of the imaging device positioned relative to the subject as an imaging device whose imaging angle includes the subject. (Configuration 8) The imaging control device according to any one of configurations 1 to 7, wherein the acquisition means calculates information about a distance between the subject and the imaging device based on a phase difference between a plurality of wireless signals received by each imaging device. (Configuration 9) 9. The imaging control device according to configuration 8, wherein the acquisition means calculates information about the distance between the subject and the imaging device based on a phase difference between radio signals received via a plurality of antennas. (Configuration 10) the plurality of antennas includes a first antenna and a second antenna; The imaging control device according to configuration 9, wherein the acquisition means calculates information about the distance between the subject and the imaging device based on information about the direction of the imaging device relative to the first antenna, information about the direction of the imaging device relative to the second antenna, and information about the distance between the first antenna and the second antenna. (Configuration 11) The imaging control device according to any one of configurations 1 to 7, wherein the acquisition means acquires information about the distance between the subject and the imaging device based on at least one of a Bluetooth 5.1 direction detection function, a UWB distance measurement function, and a distance measurement function using an RSSI received signal. (Configuration 12) a generating means for generating video data; the generating means generates video data by combining the videos so that the display size of the video selected by the selecting means is larger than the display size of the video not selected by the selecting means; 12. The imaging control device according to any one of configurations 1 to 11, wherein the transmitting means transmits the video data generated by the generating means. (Configuration 13) The imaging control device according to configuration 12, wherein the generating means generates video data by synthesizing the video so that the video not selected by the selecting means is superimposed on the video selected by the selecting means. (Configuration 14) a receiving means for receiving wireless signals transmitted from the plurality of imaging devices via a communication device moving together with the subject; 14. The imaging control device according to any one of configurations 1 to 13, wherein the distance between the subject and the plurality of imaging devices is the distance between the communication device and the plurality of imaging devices. (Method 1) A control method for an imaging control device that processes images received from a plurality of imaging devices, comprising: an acquisition step of acquiring information about distances between a subject and the plurality of imaging devices based on wireless signals transmitted from the plurality of imaging devices; a selection step of selecting images received from the plurality of imaging devices based on information on the distance between the subject and the plurality of imaging devices acquired in the acquisition step; a transmitting step of transmitting the video selected in the selecting step. (Program 1) A program for causing a computer to function as each means of the imaging control device described in any one of configurations 1 to 14. [Explanation of symbols]

[0073] 10: Imaging system 100: Distribution system 200: Smartphone (imaging control device) 201: Control unit 207: Communication unit 208: Bluetooth communication unit 300 (300A to 300C): Imaging device

Claims

1. An imaging control device that processes images received from a plurality of imaging devices, an acquisition unit that acquires information about distances between a subject and the plurality of imaging devices based on wireless signals transmitted from the plurality of imaging devices; a selection unit that selects images received from the plurality of image capture devices based on information about the distance between the subject and the plurality of image capture devices acquired by the acquisition unit; a transmitting unit that transmits the image selected by the selecting unit.

2. 2. The imaging control device according to claim 1, wherein the selection means selects the video received from an imaging device that is closer to the subject than from an imaging device that is farther from the subject.

3. 2. The imaging control device according to claim 1, wherein the selection means selects the image received from the imaging device that is closest to the subject among the plurality of imaging devices.

4. 2. The imaging control device according to claim 1, wherein the selection means selects the images received from the plurality of imaging devices based on information about the distance between the imaging device that includes the subject within its imaging angle and the subject.

5. 5. The imaging control device according to claim 4, wherein the selection means identifies an imaging device that includes the subject within its angle of view based on the direction of the imaging device relative to the subject and the imaging direction of the imaging device.

6. The imaging control device according to claim 5, characterized in that the selection means identifies the direction of the imaging device located relative to the subject based on information about the orientation of the imaging control device and information about the direction of the imaging device obtained from a phase difference between multiple wireless signals received for each imaging device.

7. 7. The imaging control device according to claim 5, wherein the selection means identifies an imaging device whose imaging direction is opposite to the direction of the imaging device positioned relative to the subject as an imaging device whose imaging angle includes the subject.

8. The imaging control device according to claim 1 , wherein the acquisition unit calculates information about the distance between the subject and the imaging device based on a phase difference between a plurality of radio signals received by each imaging device.

9. 9. The imaging control device according to claim 8, wherein the acquisition unit calculates information about the distance between the subject and the imaging device based on a phase difference between radio signals received via a plurality of antennas.

10. the plurality of antennas includes a first antenna and a second antenna, The imaging control device according to claim 9, characterized in that the acquisition means calculates information about the distance between the subject and the imaging device based on information about the direction of the imaging device relative to the first antenna, information about the direction of the imaging device relative to the second antenna, and information about the distance between the first antenna and the second antenna.

11. 2. The imaging control device according to claim 1, wherein the acquisition means acquires information about the distance between the subject and the imaging device based on at least one of a Bluetooth 5.1 direction detection function, a UWB distance measurement function, and a distance measurement function using an RSSI received signal.

12. a generating means for generating video data; the generating means generates video data by combining the videos so that the display size of the video selected by the selecting means is larger than the display size of the video not selected by the selecting means; 2. The imaging control device according to claim 1, wherein the transmitting means transmits the video data generated by the generating means.

13. 13. The imaging control device according to claim 12, wherein the generating means generates video data obtained by combining the video images so that the video image not selected by the selecting means is superimposed on the video image selected by the selecting means.

14. a receiving means for receiving wireless signals transmitted from the plurality of imaging devices via a communication device moving together with the subject; 2. The imaging control device according to claim 1, wherein the distance between the subject and the plurality of imaging devices is the distance between the communication device and the plurality of imaging devices.

15. A control method for an imaging control device that processes images received from a plurality of imaging devices, comprising: an acquisition step of acquiring information about distances between a subject and the plurality of imaging devices based on wireless signals transmitted from the plurality of imaging devices; a selection step of selecting images received from the plurality of imaging devices based on information on the distance between the subject and the plurality of imaging devices acquired in the acquisition step; a transmitting step of transmitting the video selected in the selecting step.

16. A program for causing a computer to function as each of the means of the imaging control device according to claim 1.

Images