Communication system, communication method, and sound collection unit

Abstract

Provided are a communication system, a communication method, and a sound collection unit that can reduce the labor required for laying communication cables, reduce wireless output, or expand the range in which sound information or video information can be obtained. In a communication system (10), an editing device (400) switches or mixes sound information acquired by each microphone (310) of a plurality of sound collection units (300) and outputs the information. Each wireless router (350) of the plurality of sound collection units (300) forms a mesh network (60). Sound information signals from the microphones (310) are transmitted from each sound collection unit (300) to the editing device (400) via the mesh network (60).

Description

[Technical field]

[0001] The present invention relates to a communication system, a communication method, and a sound collection unit, and more particularly to a communication system, a communication method, and a sound collection unit that can be suitably used for live broadcasts of sports, music, and the like. [Background technology]

[0002] Systems that can be used for live broadcasts of sports, music, and the like have been developed (for example, Patent Documents 1 and 2). Patent Document 1 aims to provide a program providing system and a program providing method that can provide a video from a viewpoint desired by a user (

[0014] , Abstract). In order to achieve the aim, a program providing system, which is a first embodiment of the invention according to Patent Document 1 (Abstract), is configured to include a program production device (1), a communication line carrier device (2), and a user terminal (3). The communication line carrier device (2) and the user terminal (3) are connected via a communication line network (100). Video data captured from a plurality of different directions of a subject captured by the program production device (1) is distributed to the communication line network (100) by the communication line carrier device (2) as different channels for each video data. The user terminal (3) selects and displays a channel that is distributing a video desired by the user from among the programs (channels) distributed to the communication line network (100).

[0003] Patent Document 1 also shows a configuration for broadcasting baseball games (

[0072] to

[0075] ,

[0092] , Figures 7 and 11). In this configuration, television cameras (A to I) are positioned at multiple points within a baseball field (

[0072] , Figure 7). The images (a to i) captured by the television cameras (A to I) are each recorded independently as images on video tapes (a1 to i1) and sent to editing equipment (

[0073] ).

[0004] Furthermore, Patent Document 1 shows a configuration for distributing a play (

[0082] to

[0089] , Fig. 9). In this configuration, television cameras (A to D) and CCD cameras (E to G) are used at multiple points within the performance area (

[0082] , Fig. 9). The images (a to g) captured by the television cameras (A to D) and CCD cameras (E to G) are recorded on video tapes (a3 to g3) respectively and sent to editing equipment (

[0086] ).

[0005] In Patent Document 1, during live broadcasting, video data from a television camera and a CCD camera (program production device (1)) is transmitted to a communication line carrier device (2) via a high-speed digital communication line (

[0051] ,

[0090] ).

[0006] The objective of Patent Document 2 is to appropriately identify scenes and cut-out ranges using an analysis engine (

[0005] ). To achieve this objective, the information processing device of Patent Document 2 (abstract) is equipped with a control unit that performs a first control process and a second control process. The first control process determines an analysis engine for scene detection from a plurality of analysis engines based on scene detection information for scene detection in an input video. The second control process determines an analysis engine for obtaining second result information related to a scene from a plurality of analysis engines based on scene-related information about the scene obtained as first result information by the analysis engine determined in the first control process.

[0007] Also, in Patent Document 2, video and still image data captured by one or more imaging devices arranged in a stadium (100) is transmitted to a broadcast van (101) located near the stadium (100) (

[0027] , FIG. 1). The broadcast van (101) is equipped with antenna equipment used for transmitting and receiving data, a CCU (Camera Control Unit) that controls the imaging devices, a switcher that switches between the imaging devices used for broadcasting and recording, and a monitor device for checking the images (

[0028] ). The video and image data (broadcast video data) created in the broadcast van (101) is transmitted to, for example, a broadcasting system (102) owned by a broadcasting company. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2001-309342 A [Patent Document 2] International Publication No. 2021 / 241430 Summary of the Invention [Problem to be solved by the invention]

[0009] As described above, Patent Document 1 discloses a configuration for distributing images using multiple video cameras (television cameras and CCD cameras) in a baseball stadium, a performance arena, etc. (for example, Abstract,

[0072] to

[0075] ,

[0082] to

[0089] ,

[0092] , Fig. 7, Fig. 9, Fig. 11). In addition, during live broadcasting, video data from the television cameras and CCD cameras (program production device (1)) is transmitted to the communication line carrier device (2) via a high-speed digital communication line (

[0051] ,

[0090] ).

[0010] Incidentally, in the case of high-end broadcasting equipment for live broadcasting, the video camera and microphone are often separate (not integrated). In such cases, an operator is assigned to each of the video camera and microphone, and they move and operate the video camera and microphone separately. In such cases, communication cables may be used for data communication, and the broadcaster (the video camera operator and the microphone operator) must take great effort in laying the communication cables. In this regard, Patent Document 1 only discloses the use of high-speed digital communication lines. In addition, Patent Document 1 only mentions video data (video information), and does not make any special mention of audio data (audio information). The same is true of Patent Document 2.

[0011] As described above, in Patent Document 2, data is transmitted from one or more imaging devices in a stadium (100) to a broadcast van (101) (

[0027] , FIG. 1). If data transmission from imaging devices (video cameras) or microphones used in sports stadiums, concert venues, etc. to a broadcast van were to be performed by direct wireless communication, this could lead to an increase in wireless output or a restriction on the range in which sound or video information can be obtained.

[0012] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a communication system, a communication method, and a sound collection unit that can reduce the effort required for running communication cables, or reduce wireless output or expand the range in which sound information or video information can be obtained. [Means for solving the problem]

[0013] A communication system according to an aspect of the present invention includes: A plurality of sound collection units each including a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal to the outside; an editing device that has a communication device that communicates with the wireless router to receive the sound information signal and edits and outputs the sound information; The present invention provides The editing device switches or mixes the sound information acquired by each microphone and outputs the information, The wireless routers of the plurality of sound collection units form a mesh network, The sound information signal is transmitted from each sound collection unit to the editing device via the mesh network. It is characterized by:

[0014] According to the present invention, the sound information signal indicating the sound information acquired by the microphone of each sound collection unit is transmitted to the editing device via a mesh network including the wireless router of each sound collection unit. This makes it possible to transmit sound information from the microphone to the editing device without a communication cable connecting each microphone to the editing device. This makes it possible to reduce the effort required for laying communication cables.

[0015] Furthermore, compared to direct wireless communication between each microphone and the editing device, wireless communication between each sound collection unit and the editing device via a mesh network makes it possible to suppress wireless output or expand the range in which sound information can be obtained.

[0016] Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the wireless routers, it is possible to transmit sound information acquired by microphones other than the microphone paired with that wireless router to the editing device, thereby improving the robustness of the communication system.

[0017] The communication system may include a plurality of video cameras that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device via a communication cable or wireless communication. The plurality of microphones may be used separately from the plurality of video cameras. The editing device may switch the video information acquired by each video camera and output it together with the sound information. This makes it possible to output the sound information and the video information in association with each other even when the microphones and the video cameras are used separately (without being integrated) in a configuration using a mesh network with a wireless router of a sound collection unit (particularly common in high-end applications).

[0018] The communication system may further include a time lag correction unit that corrects a time lag of each sound information signal based on a delay amount of the sound information signal reaching the editing device from each sound collection unit, thereby making it possible to reduce discomfort caused by the time lag when a viewer (a person receiving the sound information edited by the editing device) perceives the sound information.

[0019] The time lag correction unit may transmit a ping signal to each wireless router and determine the amount of delay of each sound information signal based on a response signal from each wireless router. The time lag correction unit may also correct the time lag of each sound information signal based on the determined amount of delay. This makes it possible to correct the time lag without performing special processing on the wireless router side.

[0020] Alternatively, each wireless router may assign a time stamp to the sound information signal that it relays. The time offset correction unit may correct the time offset of each sound information signal based on the time stamp assigned to the sound information signal. This makes it easy to correct the time offset even if the signal transmission path in the mesh network changes.

[0021] Alternatively, the time lag correction unit may impart a delay amount, which is a fixed value set for each wireless router, to the sound information signal for each wireless router. In this way, once each delay amount, which is a unique value, is set, time lag correction becomes possible without performing special processing in each wireless router or editing device.

[0022] Each of the wireless routers constituting the mesh network may be disposed at a position where the sound information signal can be transmitted to at least two other wireless routers, excluding the wireless router that directly communicates with the editing device. This allows communication via the mesh network even if a communication error occurs in one of the wireless routers relaying the sound information signal (excluding the wireless router that directly communicates with the editing device).

[0023] A communication method according to another aspect of the present invention includes the steps of: a plurality of node units each including a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal to the outside; an editing device that has a communication device that communicates with the router to receive the peripheral information signal and edits and outputs the peripheral information; A communication method utilizing a communication system comprising: A mesh network is formed by the routers of the plurality of node units, The peripheral information signal is transmitted from each node unit to the editing device via the mesh network. It is characterized by:

[0024] According to the present invention, a peripheral information signal indicating peripheral information (including audio information or video information) acquired by a peripheral sensor of each node unit is transmitted to an editing device via a mesh network including a router of each node unit. As a result, compared to a case where each peripheral sensor communicates directly with the editing device, communication between each node unit and the editing device via the mesh network makes it possible to suppress the output of the peripheral information signal or to expand the range in which peripheral information can be acquired.

[0025] Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the routers, it is possible to transmit peripheral information acquired by peripheral sensors other than the peripheral sensor paired with that router to the editing device, thereby improving the robustness of the communication system.

[0026] A sound collecting unit according to yet another aspect of the present invention includes: a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information; a wireless router for externally transmitting the sound information signal; The present invention provides The wireless router forms a mesh network together with the wireless routers of the other sound collecting units, The wireless router relays the sound information signal received from the wireless router of the other sound collection unit toward the editing device via the mesh network. It is characterized by this.

Effect of the Invention

[0027] According to the present invention, it is possible to reduce the labor of laying communication cables, or to reduce wireless output, or to expand the acquisition range of sound information or video information.

Brief Description of the Drawings

[0028] [Figure 1] It is a configuration diagram schematically showing a communication system according to an embodiment of the present invention. [Diagram 2] It is a schematic configuration diagram of the second sensor group of the embodiment. [Diagram 3] It is a perspective view schematically showing the appearance of the sound collection unit included in the second sensor group of the embodiment. [Figure 4] It is a configuration diagram schematically showing each component of the relay vehicle of the embodiment. [Diagram 5] It is a diagram showing an example of the arrangement of the video camera, microphone, and the relay vehicle of the embodiment in a baseball field. [Figure 6] It is a flowchart of the new sound collection unit connection determination process executed by the editing device of the embodiment. [Figure 7] It is a flowchart showing a rough control of the sound collection unit in the embodiment.

Mode for Carrying Out the Invention

[0029] A. One Embodiment <A-1. Configuration> [A-1-1. Overall Configuration] 1 is a simplified configuration diagram of a communication system 10 according to an embodiment of the present invention. The communication system 10 broadcasts (particularly live broadcasts) baseball games and the like held at a baseball stadium 90. The communication system 10 has a first sensor group 20, a second sensor group 30, a broadcast van 40, and a broadcast center facility 50.

[0030] The first sensor group 20 includes a plurality of video cameras 200 as first peripheral sensors or image sensors. The second sensor group 30 includes a plurality of microphones 310 as second peripheral sensors or sound sensors. The broadcast van 40 processes image information signals (video signals) from the plurality of video cameras 200 and sound information signals from the plurality of microphones to broadcast the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center facility 50. The broadcast center facility 50 broadcasts the broadcast signal received from the broadcast van 40 as is or after processing it.

[0031] [A-1-2. First sensor group 20] As described above, the first sensor group 20 includes a plurality of video cameras 200 as first surrounding sensors or image sensors. The video cameras 200 acquire surrounding video information and output a video information signal (video signal) indicating the video information. Although three video cameras 200 are illustrated in FIG. 1, the number of the video cameras 200 may be other than the above (for example, any of 4 to 50). In this embodiment, each video camera 200 is connected to a relay van 40 (or an editing device 400 described later) by a communication cable 202. The video information signal (video signal) indicating the video information acquired by the video camera 200 is transmitted to the relay van 40 via the communication cable 202. Although only one communication cable 202 is illustrated in FIG. 1 for simplification, it should be noted that in reality, a communication cable 202 is arranged between each video camera 200 and the relay van 40. Furthermore, as described later, the video camera 200 may perform wireless communication with the relay van 40.

[0032] [A-1-3. Second sensor group 30] FIG. 2 is a schematic diagram of the second sensor group 30 of this embodiment. FIG. 3 is a perspective view showing a simplified appearance of a sound collection unit 300 included in the second sensor group 30 of this embodiment. As described above, the second sensor group 30 includes a plurality of microphones 310 as second peripheral sensors or sound sensors. More specifically, the second sensor group 30 has a plurality of sound collection units 300 each having a microphone 310. Note that each sound collection unit 300 (microphone 310) of this embodiment is not integrated with the video camera 200. It is also possible to integrate the video camera 200 and the sound collection unit 300 (microphone 310).

[0033] 2, in addition to the microphone 310, the sound collection unit 300 has an analog / digital converter 320 (hereinafter referred to as "A / D converter 320"), a sound collection unit control unit 330, a sound collection unit storage unit 340, a wireless router 350, and a battery 360. The wireless router 350 is also referred to as a sensor-side router 350 to distinguish it from a wireless router 412 (FIG. 4) of the editing device 400 described later. Note that in FIG. 2, these components are illustrated only in the lower left sound collection unit 300, but the other sound collection units 300 have the same configuration.

[0034] The microphone 310 acquires surrounding sound information and outputs an analog sound information signal indicating the sound information. The A / D converter 320 converts the analog sound information signal from the microphone 310 into a digital sound information signal. The sound collection unit control unit 330 controls the entire sound collection unit 300. For example, the sound collection unit control unit 330 performs a predetermined signal processing on the digital sound information signal from the A / D converter 320, and transmits it to the relay vehicle 40 via the wireless router 350 of the same sound collection unit 350 as itself and the wireless router 350 of the other sound collection unit 300. In addition to transmitting the sound information signal, the sound collection unit control unit 330 also performs a predetermined transmission and reception with the editing device 400 (details will be described later with reference to FIG. 7, etc.). The sound collection unit storage unit 340 stores a program executed by the sound collection unit control unit 330, data used by the sound collection unit control unit 330, and the like.

[0035] The wireless router 350 performs a predetermined routing process by wireless communication. Specifically, the wireless router 350 of this embodiment performs dynamic routing process. The wireless router 350 of each sound collection unit 300 performs dynamic routing process, and the second sensor group 30 forms a mesh network 60 (FIG. 2). Therefore, the sound information signal is transmitted from each sound collection unit 300 to the editing device 400 of the relay van 40 via the mesh network 60.

[0036] Therefore, the wireless router 350 transmits the sound information signal (already processed by the sound collection unit control unit 330) of the sound collection unit 300 to which it belongs to the relay vehicle 40 via the wireless router 350 of the other sound collection unit 300 based on the routing table. Also, the wireless router 350 relays the sound information signal received from the wireless router 350 of the other sound collection unit 300 to the editing device 400 via the mesh network 60 based on the routing table. The wireless router 350 may have its own control unit and storage unit for performing the above-mentioned processing and the like.

[0037] The wireless router 350 of this embodiment performs communication over a communication distance of, for example, 50 to 100 m and at a communication speed of, for example, 10 to 500 Mbps. The communication distance and communication speed of the wireless router 350 can be appropriately selected.

[0038] The battery 360 supplies power to each part of the sound collection unit 300 .

[0039] 3, in sound collection unit 300, A / D converter 320, control circuit 370 (sound collection unit control unit 330, sound collection unit storage unit 340, and wireless router 350), and battery 360 are housed inside housing 380. Also, microphone 310 is disposed above top cover 381 of housing 380. Signal lines, power lines, etc. are omitted in FIG. 3.

[0040] Although FIG. 1 illustrates three microphones 310 and FIG. 2 illustrates seven microphones 310 (sound collection units 300), the number of microphones 310 (sound collection units 300) may be any other number (e.g., 2, 4 to 6, or 8 to 50).

[0041] [A-1-4. Broadcast vehicle 40] 4 is a schematic diagram showing the components of the broadcast van 40 of this embodiment. As described above, the broadcast van 40 edits and processes the video information (video information) from the multiple video cameras 200 and the audio information from the multiple microphones to broadcast the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center facility 50.

[0042] The relay van 40 has an editing device 400 (FIG. 4) that edits and outputs image information (video information) from multiple video cameras 200 and audio information from multiple microphones. The editing device 400 has functions such as a switcher. The editing device 400 has a communication unit 410, an operation input unit 420, an editing control unit 430, an editing storage unit 440, and an information output unit 450.

[0043] The communication unit 410 performs various communications between the editing device 400 and the outside, and includes a video signal input unit 411, a wireless router 412, and a broadcast antenna 413. The video signal input unit 411 is an input interface for a video information signal (video signal) from the video camera 200, and includes a plurality of input terminals (not shown). The wireless router 412 communicates with the sensor side router 350 constituting the mesh network 60, and receives a video information signal (video signal) and a sound information signal. The wireless router 412 is also referred to as an editing device side router 412 to distinguish it from the sensor side router 350 of the sound collection unit 300. The broadcast antenna 413 transmits a broadcast signal indicating the video information and sound information edited by the editing device 400 to a home television (not shown) or the like, and broadcasts the broadcast content to each home or the like.

[0044] The operation input unit 420 receives operation input from a user for editing work of video information and audio information, and includes a plurality of operation switches 421. The operation switches 421 can include switches for selecting (switching) video information and / or audio information, zooming in / out of video, playback, adjusting volume, displaying a plurality of videos on one screen, mixing audio information, and the like.

[0045] The editing control unit 430 controls the entire editing device 400. The editing control unit 430 switches between the video information acquired by each video camera 200 and the audio information acquired by each microphone 310, and outputs the switched video information as broadcast content. At this time, the video information from the multiple video cameras 200 may be included together on one screen. Also, audio information from the multiple microphones 310 may be mixed. Furthermore, effect processing of the video or audio (insertion of text information, processing of audio, etc.) may be performed. The broadcast signal including the edited broadcast content (video information and audio information) can be broadcast to each home, etc. via the broadcast antenna 413, and can also be transmitted to the broadcast center facility 50 via the broadcast antenna 413 (or wireless router 412).

[0046] The editing control unit 430 of this embodiment includes a time lag correction unit 431 that determines the amount of delay of the sound information signal from each sound collection unit 300 to the editing device 400 and corrects the time lag of each sound information signal. Specific processing of the time lag correction unit 431 will be described in detail with reference to FIG. 6.

[0047] The editing memory unit 440 stores various types of information in the editing device 400. For example, the editing memory unit 440 stores the programs executed by the editing control unit 430 and the data used by the editing control unit 430. The data here includes the broadcast content after editing by the editing control unit 430. Also, the editing memory unit 440 may store the video information and / or audio information before editing. The information output unit 450 outputs various types of information to the user of the editing device 400. The information output unit 450 includes one main monitor 451 and a plurality of sub-monitors 452. Each of the main monitor 451 and the sub-monitors 452 has a display device (such as a liquid crystal panel) not shown in the figure, a speaker, etc. The main monitor 451 can output the video information and audio information of the broadcast content after editing. The sub-monitor 452 outputs the video information (and audio information) before editing.

[0048] Note that the basic configuration of each part of the editing device 400 can be the same as that of Patent Document 1 or Patent Document 2.

[0049] [A-1-5. Broadcast Center Facility 50] The broadcast center facility 50 (Fig. 1) broadcasts the broadcast signal received from the relay vehicle 40 as it is or after processing. Also, the broadcast center facility 50 may upload the broadcast signal to a distribution server not shown in the figure and distribute it to each household, etc. in the form of video-on-demand from the distribution server via the Internet.

[0050] [A-2. Control and Operations] [A-2-1. Overall Flow] Next, various controls in the communication system 10 of the present embodiment and the operations therefor will be described. Hereinafter, the arrangement operations of the first sensor group 20, the second sensor group 30, and the relay vehicle 40, the operations and controls when the first sensor group 20, the second sensor group 30, and the relay vehicle 40 are started up, and the operations and controls during normal use of each part will be described.

[0051] [A-2-2. Arrangement Operations of Each Part] Fig. 5 shows an example of the arrangement of the video camera 200, microphone 310, and broadcast vehicle 40 of this embodiment in a baseball stadium 90. In the example of Fig. 5, an operator carries the video camera 200 and the microphone 310 to each of the arrangement points A to L (hereinafter also referred to as "points A to L"). In addition, the broadcast vehicle 40 is arranged at a predetermined position outside the baseball stadium 90 (outside the first base side stand in the example of Fig. 5).

[0052] As described above, in this embodiment, video camera 200 is connected to editing device 400 via communication cable 202, so the operator of video camera 200 needs to lay down communication cable 202 (as will be described later, video camera 200 can also be a wireless system). On the other hand, microphone 310 is a wireless system, so the operator of microphone 310 simply carries sound collection unit 300 (FIG. 3) to each of points A to L to complete the arrangement.

[0053] Each wireless router 350 (sensor side router 350) arranged at each of the points A to L to configure the mesh network 60 (FIG. 2) is arranged at a position where it can transmit a sound information signal to at least two other wireless routers 350. The number of sensor side routers 350 that directly communicate with the relay van 40 (editing device side router 412 of the editing device 400) may be one or more.

[0054] [A-2-3. Operation and control of each part at start-up] (A-2-3-1. Operation and control at start-up of broadcast van 40) The broadcast vehicle 40 turns on the power of the editing device 400 at a predetermined timing (for example, when the placement of the broadcast vehicle 40 is completed). This enables the communication unit 410 of the editing device 400 to communicate with the video camera 200 and the sound collection unit 300 (input of video information signals and sound information signals) (standby state). At this time, the editing device side router 412 starts dynamic routing processing. That is, the editing device side router 412 periodically monitors whether a sensor side router 350 (another node) exists around itself, and updates the routing table each time. The editing device side router 412 also starts a new sound collection unit connection determination process.

[0055] Fig. 6 is a flowchart of a new sound collecting unit connection determination process executed by the editing device 400 of this embodiment. The new sound collecting unit connection determination process determines whether or not a new sound collecting unit 300 is connected to the editing device 400 (or the mesh network 60) (step S11 in Fig. 6), and performs predetermined processes (S12 to S15) when the connection is determined (S11: TRUE). Further details of the new sound collecting unit connection determination process will be described later in association with Fig. 7.

[0056] (A-2-3-2. Operation and control at start-up of video camera 200) When the editing device 400 is in a power-on state and the video camera 200 whose arrangement has been completed is powered on, a video information signal from the video camera 200 is input to the communication section 410 (video signal input section 411) of the editing device 400 via the communication cable 202, and the video information is displayed on one of the sub-monitors 452. In the initial setting, an input terminal (not shown) of the video signal input section 411 is associated with the sub-monitor 452. Therefore, the corresponding sub-monitor 452 is determined depending on the input terminal to which the communication cable 202 is connected. Note that the correspondence between the input terminal of the video signal input section 411 and the sub-monitor 452 may be switchable by operating the operation switch 421.

[0057] Furthermore, the video information displayed on the main monitor 451 is selected according to the initial settings. For example, when only the video information signal of one video camera 200 is input to the editing device 400, the video information corresponding to the video information signal is displayed on the main monitor 451. When the video information signals of multiple video cameras 200 are input to the editing device 400, the video information corresponding to the video information signal input to a preset input terminal of the video signal input unit 411 is displayed on the main monitor 451. During normal use, the video information displayed on the main monitor 451 is switched by operating the operation switch 421.

[0058] (A-2-3-3. Operation and control at start-up of the sound collection unit 300) (A-2-3-3-1. Overview) 7 is a flowchart showing an outline of the control of the sound collection unit 300 in this embodiment. When a power switch (not shown) of the sound collection unit 300 is turned on, the sound collection unit 300 (sound collection unit control unit 330) executes start-up control (step S21). The start-up control includes a communication route establishment process (S211) and a delay amount determination auxiliary process (S212).

[0059] The communication route establishment process (S211) is a process for establishing a communication route between the activated sound collection unit 300 and the editing device 400. The delay amount determination assistance process (S212) is a process for assisting the delay amount determination process (S13 in FIG. 6) by the editing device 400.

[0060] (A-2-3-3-2. Establishment of communication route (S11, S12 in FIG. 6, S211 in FIG. 7)) As described above, in the startup control of the sound collection unit 300, a communication route establishment process (S211 in FIG. 7) is executed to establish a communication route between the started sound collection unit 300 and the editing device 400. In the communication route establishment process, the sound collection unit 300 (sound collection unit control unit 330) judges whether or not a connectable node (sensor side router 350 or editing device side router 412) exists in its vicinity. If a connectable node is detected, the sound collection unit 300 transmits its own information to the editing device 400. For example, the sound collection unit 300 reads the IP address of the editing device side router 412 from the sound collection unit storage unit 340, and transmits a startup message (including its own information) to the IP address as the destination. In addition, the own information includes, for example, its own account name, individual identification number, IP address, and type of node (for example, whether it is a video camera 200 or a microphone 310 (sound collection unit 300)). The text of the startup message may be encrypted in a predetermined manner.

[0061] The startup message transmitted from the new sound collection unit 300 is transmitted to the editing device side router 412 via the mesh network 60. When the editing control unit 430 of the editing device 400 receives the startup message via the editing device side router 412 (S11 in FIG. 6: TRUE), in step S12, the editing control unit 430 registers information about the new sound collection unit 300 in the management table.

[0062] (A-2-3-3-3. Delay amount determination (S13 in FIG. 6, S212 in FIG. 7)) Next, in step S13, the editing device 400 (editing control unit 430) executes a delay determination process. In response to this, the new sound collection unit 300 (sound collection unit control unit 330) executes a delay amount determination auxiliary process in step S212 of Fig. 7. As described above, the delay amount determination process (S13) is a process for determining the amount of communication delay between the started sound collection unit 300 (i.e., the sound collection unit that has successfully established communication with the editing device 400) and the editing device 400. Also, the delay amount determination auxiliary process (S212) assists in the delay amount determination process (S13).

[0063] Specifically, the editing device 400 transmits a ping signal to the new sound collection unit 300. The new sound collection unit 300 that receives the ping signal transmits a reply to the editing device 400. The editing device 400 measures the communication time of the ping signal using its own clock function, calculates the amount of communication delay from the new sound collection unit 300 to the editing device 400, and registers the amount of communication delay in the management table in association with the new sound collection unit 300. As will be described later, the amount of communication delay can also be determined by another method.

[0064] (A-2-3-3-4. New sound collection unit addition notification process (S14 in FIG. 6)) 6, the editing device 400 executes a new sound collecting unit addition notification process for notifying the user of the editing device 400 that a new sound collecting unit 300 has been added to the mesh network 60. For example, the editing device 400 causes the main monitor 451 to display a message indicating that the new sound collecting unit 300 has been added to the mesh network 60 and the individual identification number of the sound collecting unit 300.

[0065] (A-2-3-3-5. Video camera-microphone link processing (S15 in FIG. 6)) In the next step S15 in FIG. 6, the editing device 400 executes a video camera-microphone link process for linking the microphone 310 of the new sound collection unit 300 with the video camera 200. As described above, in this embodiment, each video camera 200 and each microphone 310 are separate. However, each video camera 200 and each microphone 310 are often used in combination. Therefore, in the editing device 400 of this embodiment, the video camera 200 and the microphone 310 can be paired and registered in a management table. This makes it possible to switch the paired sound information together when switching the video information with the operation switch 421.

[0066] Furthermore, in this embodiment, the video information signal is input via the communication cable 202 and the video signal input unit 411, whereas the audio information signal is input via the wireless routers 350, 412. Therefore, when pairing the microphone 310 with the video camera 200, the editing device 400 displays a pairing list of the video camera 200 and the microphone 310. Then, it is possible to select a video camera 200 that is not paired or has already been paired in the pairing list. Then, the video camera 200 selected by the user is paired with a new microphone 310 and registered in the management table.

[0067] [A-2-4. Operation and control of each part during normal use] During normal use of the video camera 200, a video information signal obtained by the video camera 200 based on the operation of the user of the video camera 200 is input to the editing device 400 via the communication cable 202. During normal use of the microphone 310 (sound collection unit 300), the sound collection unit 300 performs normal operation control (S22 in FIG. 7). Specifically, a sound information signal obtained by the microphone 310 based on the operation of the user of the microphone 310 is transmitted to the editing device 400 via the mesh network 60 (sound signal transmission process of S221 in FIG. 7). Furthermore, each sensor-side router 350 performs dynamic routing processing (S222).

[0068] During normal use of the editing device 400, video information and audio information are edited and broadcast as broadcast content based on the operations of the user of the editing device 400. That is, the editing device 400 functions as a switcher or the like. Further, the editing device 400 (time shift correction unit 431) corrects the time shift of each audio information signal based on the communication delay amount determined in the delay amount determination process (S13 in FIG. 6). That is, the editing device 400 processes each audio information signal so as to bring the time shift of each audio information signal from each sound collection unit 300 closer to zero. For example, assume that the delay amount of the audio information signal Ss1 is 0.1 second, the delay amount of the audio information signal Ss2 is 0.2 seconds, and the delay amount of the audio information signal Ss3 is 0.3 seconds. In this case, the editing device 400, for example, causes the audio information signal Ss1 to be sent for 0.2 seconds and the audio information signal Ss2 to be sent for 0.1 second, thereby equalizing the delay amounts of the audio information signals Ss1 to Ss3.

[0069] <A-3. Effects of this Embodiment> According to this embodiment, an audio information signal indicating the audio information acquired by the microphone 310 of each sound collection unit 300 is transmitted to the editing device 400 via the mesh network 60 including the wireless router 350 of each sound collection unit 300 (S221, S222 in FIGS. 2 and 7). Thereby, it becomes possible to transmit audio information from the microphone 310 to the editing device 400 without a communication cable connecting each microphone 310 and the editing device 400. Therefore, it is possible to reduce the labor of laying the communication cable.

[0070] Also, compared with the case of directly performing wireless communication between each microphone 310 and the editing device 400, by performing wireless communication between each sound collection unit 300 and the editing device 400 via the mesh network 60, it is possible to suppress wireless output or expand the acquisition range of audio information.

[0071] Furthermore, by adopting the mesh network 60 instead of the daisy chain configuration, even if an abnormality occurs in one of the wireless routers 350, it is possible to transmit sound information acquired by the microphones 310 other than the microphone 310 paired with that wireless router 350 to the editing device 400. This makes it possible to improve the robustness of the communication system 10.

[0072] In this embodiment, the communication system 10 includes a plurality of video cameras 200 that acquire surrounding video information and transmit a video report signal indicating the video information to an editing device 400 via a communication cable 202 (FIG. 1). A plurality of microphones 310 are used separately from the plurality of video cameras 200 (FIG. 1). The editing device 400 switches the video information acquired by each video camera 200 and outputs it together with sound information (FIG. 4). As a result, in a configuration using a mesh network 60 using a wireless router 350 in the sound collection unit 300, even when the microphones 310 and the video cameras 200 are used separately (without being integrated) (particularly common in high-end applications), it becomes possible to output the sound information and the video information in association with each other.

[0073] In this embodiment, the communication system 10 includes a time lag correction unit 431 that determines the amount of delay of the sound information signal arriving at the editing device 400 from each sound collection unit 300 and corrects the time lag of each sound information signal (FIG. 4). This makes it possible to reduce discomfort caused by the time lag when a viewer (a person receiving the sound information edited by the editing device 400) perceives the sound information.

[0074] In this embodiment, the time lag correction unit 431 transmits a ping signal to the wireless router 350 of each sound collection unit 300, and determines the amount of delay of each sound information signal based on a response signal from each wireless router 350 (S13 in FIG. 6). The time lag correction unit 431 also corrects the time lag of each sound information signal based on the determined amount of delay. This makes it possible to correct the time lag without performing special processing on the wireless router 350 side.

[0075] In this embodiment, each wireless router 350 that constitutes the mesh network 60 is arranged at a position where it can transmit an audio information signal to at least two other wireless routers 350, excluding the wireless router 350 that communicates directly with the editing device 400 (Fig. 5). Thereby, even if a communication abnormality occurs in one of the wireless routers 350 that relays the audio information signal (excluding the wireless router 350 that communicates directly with the editing device 400), communication is possible via the mesh network 60.

[0076] B. Modification Note that the present invention is not limited to the above-described embodiment, and various configurations can of course be adopted based on the description in this specification. For example, the following configurations can be adopted.

[0077] <B-1. Configuration> In the above embodiment, the first sensor group 20 (video camera 200) and the second sensor group 30 (microphone 310) were used in the baseball field 90 (Figs. 1 and 5). However, for example, if attention is paid to the point of configuring a mesh network of node units in relation to live broadcasting, it is not limited to this. For example, it is also possible to use the first sensor group 20 and / or the second sensor group 30 in other stadiums or theaters or concert halls.

[0078] In the above embodiment, the video information signal from the video camera 200 was transmitted to the editing device 400 via the communication cable 202 (Fig. 1). However, for example, if attention is paid to the point of transmitting the video information signal to the editing device 400, the video camera 200 may perform wireless communication with the relay vehicle 40. In that case, similar to the audio information signal from the microphone 310, the video information signal from the video camera 200 may be transmitted to the editing device 400 via a wireless router. In other words, the first sensor group 20 may be constituted by a plurality of node units including the video camera 200 and a wireless router, and a mesh network may be constituted by the wireless router paired with the video camera 200.

[0079] When using a wireless router in the first sensor group 20 as well, the mesh network of the first sensor group 20 and the mesh network 60 of the second sensor group 30 may be configured separately. In that case, the specifications (such as communication speed) of the two mesh networks may be made different. Alternatively, a single mesh network may be configured with the first sensor group 20 and the second sensor group 30.

[0080] In the above embodiment, the sound collection unit 300 was used as the node unit that constitutes the mesh network 60 using the wireless router 350 (FIG. 2). However, for example, focusing on the point of constituting the mesh network of the node unit in relation to a live broadcast, it is not limited to this. For example, a mesh network may be configured only from a node unit including a video camera 200 and a wireless router paired with it. Alternatively, in a configuration where the microphone 310 is integrated with the video camera 200, a mesh network may be configured from a node unit including the video camera 200 with the integrated microphone 310 and a wireless router paired with it. Also, instead of the wireless router, it is also possible to configure a mesh network by a wired-connected router with a plurality of node units (a video unit having a video camera 200 and / or a sound collection unit 300 having a microphone 410).

[0081] In the above embodiment, the editing device side router 412 was used as the communication device of the editing device 400 that communicates with the mesh network 60 by the sensor side router 350 (FIG. 4). However, for example, focusing on the point of communicating with the mesh network 60, other communication devices (for example, gateway devices other than routers) may be used in the editing device 400. In that case, communication settings with the sensor side router 350 arranged closest to the editing device 400 may be performed in advance.

[0082] <B-2. Control> In the above embodiment, the ping signal is used to determine the amount of communication delay (S13 in FIG. 6, S212 in FIG. 7). However, for example, if attention is paid to correcting the time lag of the sound information signals from each sound collection unit 300, the present invention is not limited to this.

[0083] For example, the time lag may be corrected by the following method. That is, each wireless router 350 of the sound collection unit 300 assigns a time stamp (time of relay) to the sound information signal that it relays. The time lag correction unit 431 calculates the amount of delay based on the time stamp assigned to the sound information signal and corrects the time lag of each sound information signal. This makes it easy to correct the time lag even if the signal transmission path in the mesh network 60 changes.

[0084] Alternatively, the time lag correction unit 431 may impart a delay amount, which is a fixed value set for each wireless router 350, to the sound information signal for each wireless router 350. In other words, with each wireless router 350 placed, the delay amount is measured by a measuring device (not shown), and the measured delay amount is stored in association with each wireless router 350. Then, the time lag of the sound information signal from each wireless router 350 is corrected based on the delay amount (fixed value) stored for each wireless router 350. As a result, once each delay amount, which is a unique value, is set, it becomes possible to correct the time lag without performing special processing in each wireless router 350 or the editing device 400. [Explanation of symbols]

[0085] 10... communication system 20... first sensor group 30: Second sensor group 40: Broadcast vehicle 50...Broadcast center equipment 60...Mesh network 90…Baseball field 200...Video camera (peripheral sensor) 202…Communication cable 300…Sound collection unit (node ​​unit) 310...Microphone (peripheral sensor) 350...Wireless router 400...Editing device 412...Wireless router (communication device) 431...Time lag correction unit

Claims

1. A plurality of sound collection units each including a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal to the outside; an editing device that has a communication device that communicates with the wireless router to receive the sound information signal and edits and outputs the sound information; A communication system comprising: The editing device switches or mixes the sound information acquired by each microphone and outputs the information, The wireless routers of the plurality of sound collection units form a mesh network, The sound information signal is transmitted from each sound collection unit to the editing device via the mesh network. A communication system comprising:

2. 2. The communication system according to claim 1, the communication system includes a plurality of video cameras that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device via a communication cable or wirelessly; the plurality of microphones are used separately from the plurality of video cameras; The editing device switches the video information captured by each video camera and outputs it together with the audio information. A communication system comprising:

3. 3. The communication system according to claim 1, The communication system includes a time lag correction unit that corrects a time lag of each sound information signal based on a delay amount of the sound information signal reaching the editing device from each sound collection unit. A communication system comprising:

4. 4. The communication system according to claim 3, The time lag correction unit Transmitting a ping signal to each wireless router, and determining the delay amount of each sound information signal based on a response signal from each wireless router; The time lag of each sound information signal is corrected based on the determined delay amount. A communication system comprising:

5. 4. The communication system according to claim 3, Each wireless router assigns a time stamp to the sound information signal that it relays, The time lag correction unit corrects a time lag of each sound information signal based on the time stamp added to the sound information signal. A communication system comprising:

6. 4. The communication system according to claim 3, The time lag correction unit imparts a delay amount, which is a fixed value set for each of the wireless routers, to the sound information signal for each of the wireless routers. A communication system comprising:

7. 3. The communication system according to claim 1, Each of the wireless routers constituting the mesh network is arranged at a position where it can transmit the sound information signal to at least two other wireless routers, except for a wireless router that directly communicates with the editing device. A communication system comprising:

8. a plurality of node units each including a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal to the outside; an editing device that has a communication device that communicates with the router to receive the peripheral information signal and edits and outputs the peripheral information; A communication method utilizing a communication system comprising: A mesh network is formed by the routers of the plurality of node units, The peripheral information signal is transmitted from each node unit to the editing device via the mesh network. A communication method comprising: