Communication system, communication method, and sound collection unit

Abstract

Provided are a communication system, a communication method, and a sound collection unit in which reduction in time and effort for communication cable routing work, reduction in radio output, or expansion of a range in which sound information or video information can be acquired can be achieved. In a communication system (10), an editing device (400) switches or mixes sound information respectively acquired by microphones (310) of a plurality of sound collection units (300) and outputs the resultant. Wireless routers (350) of the plurality of sound collection units (300) form a mesh network (60). Sound information signals from the microphones (310) are transmitted from the respective sound collection units (300) to the editing device (400) via the mesh network (60).

Description

Communication system, communication method, and sound collection unit

[0001] The present invention relates to a communication system, a communication method, and a sound collection unit, and more particularly to a communication system, a communication method, and a sound collection unit that can be suitably used for live broadcasts of sports, music, and the like, for example.

[0002] Systems that can be used for live broadcasts of sports, music, and the like have been developed (for example, Patent Documents 1 and 2). Patent Document 1 aims to provide a program provision system and a program provision method that can provide video from a user's desired viewpoint (

[0014] , Abstract). To achieve this objective, a program provision system, which is a first embodiment of the invention described in Patent Document 1 (Abstract), includes a program production device (1), a communication carrier device (2), and a user terminal (3). The communication carrier device (2) and the user terminal (3) are connected via a communication network (100). Video data captured from multiple different directions of an object photographed by the program production device (1) is distributed to the communication network (100) by the communication carrier device (2) as different channels for each video data. The user terminal (3) selects and displays a channel that distributes a video desired by the user from among programs (channels) distributed to the communication network (100).

[0003] Patent Document 1 also shows a configuration for broadcasting baseball games (

[0072] to

[0075] ,

[0092] , Figures 7 and 11). In this configuration, television cameras (A to I) are placed at multiple points within a baseball stadium (

[0072] , Figure 7). The images (a to i) captured by the television cameras (A to I) are each recorded independently as images on videotapes (a1 to i1) and sent to editing equipment (

[0073] ).

[0004] Furthermore, Patent Document 1 discloses a configuration for distributing a play (

[0082] to

[0089] , Figure 9). In this configuration, television cameras (A to D) and CCD cameras (E to G) are used at multiple points within the performance area (

[0082] , Figure 9). The images (a to g) captured by the television cameras (A to D) and CCD cameras (E to G) are recorded on video tapes (a3 to g3) respectively and sent to editing equipment (

[0086] ).

[0005] In Patent Document 1, during live broadcasting, video data from a television camera and a CCD camera (program production device (1)) is transmitted to a communication line carrier device (2) via a high-speed digital communication line (

[0051] ,

[0090] ).

[0006] Patent Document 2 aims to appropriately identify scenes and cut-out ranges using an analysis engine (

[0005] ). To achieve this aim, the information processing device of Patent Document 2 (Abstract) includes a control unit that performs a first control process and a second control process. The first control process determines an analysis engine for scene detection from multiple analysis engines based on scene detection information for detecting scenes in an input video. The second control process determines an analysis engine from the multiple analysis engines for obtaining second result information related to a scene based on scene-related information about the scene obtained as first result information by the analysis engine determined in the first control process.

[0007] In addition, in Patent Document 2, moving image data and still image data captured by one or more imaging devices installed in a stadium (100) are transmitted to a broadcasting van (101) located near the stadium (100) (

[0027] , Figure 1). The broadcasting van (101) is equipped with antenna equipment used for transmitting and receiving data, a CCU (Camera Control Unit) that controls the imaging devices, a switcher that switches between the imaging devices used for broadcasting and recording, and a monitor device for checking the images (

[0028] ). The moving image data (broadcast video data) created in the broadcasting van (101) is transmitted to, for example, a broadcasting system (102) owned by a broadcasting company.

[0008] JP 2001-309342 A International Publication No. 2021 / 241430

[0009] As described above, Patent Document 1 discloses a configuration for distributing images using multiple video cameras (television cameras and CCD cameras) at a baseball stadium, a performance arena, etc. (see, for example, Abstract,

[0072] -

[0075] ,

[0082] -

[0089] ,

[0092] , Figures 7, 9, and 11). Furthermore, during live broadcasting, video data from the television cameras and CCD cameras (program production device (1)) is transmitted to a communications carrier device (2) via a high-speed digital communications line (see

[0051] and

[0090] ).

[0010] In the case of high-end broadcasting equipment for live broadcasts, the video camera and microphone are often separate (not integrated). In such cases, operators are assigned to each of the video camera and microphone, and they must be moved and operated separately. In such cases, communication cables are sometimes used for data communication, which requires the broadcaster (the video camera operator and the microphone operator) to spend a great deal of time and effort laying the communication cables. In this regard, Patent Document 1 only discloses the use of high-speed digital communication lines. In addition, Patent Document 1 only mentions video data (video information) and does not specifically mention audio data (audio information). The same is true of Patent Document 2.

[0011] Furthermore, as described above, in Patent Document 2, data is transmitted from one or more imaging devices in a stadium (100) to a broadcast van (101) (see

[0027] , FIG. 1). If data transmission from imaging devices (video cameras) or microphones used in sports stadiums, concert venues, etc. to a broadcast van were to be performed by direct wireless communication, there is a risk that this would result in an increase in wireless output or a limitation on the range in which sound or video information can be obtained.

[0012] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a communication system, communication method, and sound collection unit that can reduce the effort required for running communication cables, or reduce wireless output or expand the range in which sound information or video information can be obtained.

[0013] A communication system according to one aspect of the present invention comprises a plurality of sound collection units, each including a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal externally; and an editing device that has a communication device that communicates with the wireless router to receive the sound information signal and edits and outputs the sound information, wherein the editing device switches or mixes the sound information acquired by each microphone and outputs it, the wireless routers of the plurality of sound collection units form a mesh network, and the sound information signal is transmitted from each sound collection unit to the editing device via the mesh network.

[0014] According to the present invention, sound information signals indicating sound information acquired by the microphones of each sound collection unit are transmitted to the editing device via a mesh network including the wireless routers of each sound collection unit. This allows sound information to be transmitted from the microphones to the editing device without the need for communication cables connecting each microphone to the editing device. This reduces the effort required for laying communication cables.

[0015] Furthermore, compared to direct wireless communication between each microphone and the editing device, wireless communication between each sound collection unit and the editing device via a mesh network makes it possible to suppress wireless output or expand the range in which sound information can be obtained.

[0016] Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the wireless routers, sound information acquired by microphones other than the microphone paired with that wireless router can be transmitted to the editing device, thereby improving the robustness of the communication system.

[0017] The communication system may include a plurality of video cameras that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device via a communication cable or wirelessly. The plurality of microphones may be used separately from the plurality of video cameras. The editing device may switch the video information acquired by each video camera and output it together with the sound information. This makes it possible to output the sound information and the video information in association with each other, even when the microphones and the video cameras are used separately (without being integrated) in a configuration using a wireless router of a sound collection unit.

[0018] The communication system may further include a time lag correction unit that corrects a time lag of each sound information signal based on a delay amount of the sound information signal reaching the editing device from each sound collection unit, thereby reducing the discomfort caused by the time lag when a viewer (a person receiving the sound information edited by the editing device) perceives the sound information.

[0019] The time lag correction unit may transmit a ping signal to each wireless router and determine the delay amount of each sound information signal based on a response signal from each wireless router. The time lag correction unit may also correct the time lag of each sound information signal based on the determined delay amount. This enables time lag correction without requiring special processing on the wireless router side.

[0020] Alternatively, each wireless router may assign a timestamp to the sound information signal it relays. The time offset correction unit may correct the time offset of each sound information signal based on the timestamp assigned to the sound information signal. This makes it easy to correct the time offset even if the signal transmission path in the mesh network changes.

[0021] Alternatively, the time lag correction unit may impart a delay amount, which is a fixed value set for each wireless router, to the sound information signal for each wireless router. In this way, once each delay amount, which is a unique value, is set, time lag correction becomes possible without performing special processing in each wireless router or editing device.

[0022] Each wireless router constituting the mesh network, excluding the wireless router that directly communicates with the editing device, may be located in a position where it can transmit the sound information signal to at least two other wireless routers, thereby enabling communication via the mesh network even if a communication error occurs in one of the wireless routers relaying the sound information signal (excluding the wireless router that directly communicates with the editing device).

[0023] Another aspect of the present invention is a communication method that utilizes a communication system comprising: a plurality of node units, each of which includes a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal to the outside; and an editing device that has a communication device that communicates with the router to receive the peripheral information signal and edits and outputs the peripheral information, characterized in that a mesh network is formed by the routers of the plurality of node units, and the peripheral information signal is transmitted from each node unit to the editing device via the mesh network.

[0024] According to the present invention, a peripheral information signal indicating peripheral information (including audio information or video information) acquired by a peripheral sensor of each node unit is transmitted to an editing device via a mesh network including a router of each node unit. As a result, compared to direct communication between each peripheral sensor and the editing device, communication between each node unit and the editing device via the mesh network makes it possible to suppress the output of peripheral information signals or expand the range in which peripheral information can be acquired.

[0025] Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the routers, it is possible to transmit peripheral information acquired by peripheral sensors other than the one paired with that router to the editing device, thereby improving the robustness of the communication system.

[0026] A sound collection unit according to yet another aspect of the present invention comprises a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal to the outside, wherein the wireless router forms a mesh network together with wireless routers of other sound collection units, and the wireless router relays the sound information signal received from the wireless routers of the other sound collection units to an editing device via the mesh network.

[0027] According to the present invention, it is possible to reduce the labor required for laying communication cables, reduce wireless output, or expand the range in which sound information or video information can be obtained.

[0028] FIG. 1 is a schematic diagram illustrating a communication system according to an embodiment of the present invention. FIG. 2 is a schematic diagram illustrating a second sensor group according to the embodiment. FIG. 3 is a perspective view illustrating a simplified appearance of a sound collection unit included in the second sensor group according to the embodiment. FIG. 4 is a schematic diagram illustrating each component of a broadcast van according to the embodiment. FIG. 5 is a diagram illustrating an example of the arrangement of video cameras, microphones, and the broadcast van according to the embodiment at a baseball stadium. FIG. 6 is a flowchart of a new sound collection unit connection determination process executed by the editing device according to the embodiment. FIG. 7 is a flowchart illustrating general control of the sound collection unit in the embodiment.

[0029] A. One Embodiment <A-1. Configuration> [A-1-1. Overall Configuration] Fig. 1 is a simplified configuration diagram of a communication system 10 according to one embodiment of the present invention. The communication system 10 broadcasts (particularly live broadcasts) baseball games and the like held at a baseball stadium 90. The communication system 10 has a first sensor group 20, a second sensor group 30, a broadcast van 40, and broadcast center facilities 50.

[0030] The first sensor group 20 includes a plurality of video cameras 200 serving as first peripheral sensors or image sensors. The second sensor group 30 includes a plurality of microphones 310 serving as second peripheral sensors or sound sensors. The broadcast van 40 processes the image information signals (video signals) from the plurality of video cameras 200 and the sound information signals from the plurality of microphones to broadcast the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center facility 50. The broadcast center facility 50 broadcasts the broadcast signal received from the broadcast van 40 either directly or after processing it.

[0031] [A-1-2. First Sensor Group 20] As described above, the first sensor group 20 includes a plurality of video cameras 200 serving as first peripheral sensors or image sensors. The video cameras 200 acquire peripheral video information and output video information signals (video signals) indicative of the video information. Note that while FIG. 1 illustrates three video cameras 200, the number of video cameras 200 may be any other number (e.g., between 4 and 50). In this embodiment, each video camera 200 is connected to a broadcast van 40 (or an editing device 400, described later) via a communication cable 202. The video information signals (video signals) indicative of the video information acquired by the video cameras 200 are transmitted to the broadcast van 40 via the communication cable 202. Note that, for simplicity's sake, only one communication cable 202 is shown in FIG. 1 , but in reality, a communication cable 202 is disposed between each video camera 200 and the broadcast van 40. Furthermore, as described later, the video cameras 200 may communicate wirelessly with the broadcast van 40.

[0032] [A-1-3. Second Sensor Group 30] FIG. 2 is a schematic diagram of the second sensor group 30 of this embodiment. FIG. 3 is a perspective view showing a simplified external view of the sound collection unit 300 included in the second sensor group 30 of this embodiment. As described above, the second sensor group 30 includes a plurality of microphones 310 as second peripheral sensors or sound sensors. More specifically, the second sensor group 30 has a plurality of sound collection units 300, each having a microphone 310. Note that, in this embodiment, each sound collection unit 300 (microphone 310) is not integrated with the video camera 200. It is also possible to integrate the video camera 200 and the sound collection unit 300 (microphone 310).

[0033] 2, the sound collection unit 300 has, in addition to a microphone 310, an analog-to-digital converter 320 (hereinafter referred to as "A / D converter 320"), a sound collection unit control unit 330, a sound collection unit storage unit 340, a wireless router 350, and a battery 360. The wireless router 350 is also referred to as a sensor-side router 350 to distinguish it from a wireless router 412 (FIG. 4) of the editing device 400, which will be described later. Note that, in FIG. 2, these components are only shown in the sound collection unit 300 at the bottom left, but the other sound collection units 300 also have a similar configuration.

[0034] The microphone 310 acquires surrounding sound information and outputs an analog sound information signal indicating the sound information. The A / D converter 320 converts the analog sound information signal from the microphone 310 into a digital sound information signal. The sound collection unit control unit 330 controls the entire sound collection unit 300. For example, the sound collection unit control unit 330 performs predetermined signal processing on the digital sound information signal from the A / D converter 320 and then transmits the signal to the relay vehicle 40 via the wireless router 350 of the same sound collection unit 350 as the sound collection unit 300 and the wireless router 350 of another sound collection unit 300. In addition to transmitting the sound information signal, the sound collection unit control unit 330 also performs predetermined transmission and reception with the editing device 400 (details will be described later with reference to FIG. 7, etc.). The sound collection unit storage unit 340 stores programs executed by the sound collection unit control unit 330, data used by the sound collection unit control unit 330, etc.

[0035] The wireless router 350 performs a predetermined routing process via wireless communication. Specifically, the wireless router 350 of this embodiment performs dynamic routing. The wireless router 350 of each sound collection unit 300 performs dynamic routing, causing the second sensor group 30 to form a mesh network 60 ( FIG. 2 ). Therefore, the sound information signal is transmitted from each sound collection unit 300 to the editing device 400 of the broadcast van 40 via the mesh network 60.

[0036] Therefore, the wireless router 350 transmits the sound information signal (which has been processed by the sound collection unit control unit 330) of the sound collection unit 300 to which it belongs to the relay vehicle 40 via the wireless routers 350 of the other sound collection units 300 based on the routing table. Also, the wireless router 350 relays the sound information signal received from the wireless routers 350 of the other sound collection units 300 to the editing device 400 via the mesh network 60 based on the routing table. The wireless router 350 may have its own control unit and memory unit for performing the above-mentioned processing and the like.

[0037] The wireless router 350 of this embodiment performs communication over a communication distance of, for example, 50 to 100 m and at a communication speed of, for example, 10 to 500 Mbps. The communication distance and communication speed of the wireless router 350 can be selected as appropriate.

[0038] The battery 360 supplies power to each part of the sound collection unit 300 .

[0039] 3, in the sound collection unit 300, the A / D converter 320, the control circuit 370 (the sound collection unit control unit 330, the sound collection unit storage unit 340, and the wireless router 350), and the battery 360 are housed inside a housing 380. The microphone 310 is disposed above an upper cover 381 of the housing 380. Signal lines, power lines, etc. are omitted from FIG. 3.

[0040] Although Figure 1 illustrates three microphones 310 and Figure 2 illustrates seven microphones 310 (sound collection units 300), the number of microphones 310 (sound collection units 300) may be any other number (for example, 2, 4 to 6, or 8 to 50).

[0041] 4 is a block diagram showing in simplified form the components of the relay van 40 of this embodiment. As described above, the relay van 40 edits and processes the video information (video information) from the multiple video cameras 200 and the audio information from the multiple microphones, and broadcasts the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center facility 50.

[0042] The broadcast vehicle 40 has an editing device 400 (FIG. 4) that edits and outputs image information (video information) from the multiple video cameras 200 and audio information from the multiple microphones. The editing device 400 has functions such as a switcher. The editing device 400 has a communication unit 410, an operation input unit 420, an editing control unit 430, an editing storage unit 440, and an information output unit 450.

[0043] The communication unit 410 performs various communications between the editing device 400 and the outside, and includes a video signal input unit 411, a wireless router 412, and a broadcast antenna 413. The video signal input unit 411 is an input interface for video information signals (video signals) from the video camera 200, and includes multiple input terminals (not shown). The wireless router 412 communicates with the sensor-side router 350 that constitutes the mesh network 60 to receive video information signals (video signals) and audio information signals. The wireless router 412 is also referred to as the editing device-side router 412 to distinguish it from the sensor-side router 350 of the sound collection unit 300. The broadcast antenna 413 transmits broadcast signals indicating the video information and audio information edited by the editing device 400 to a home television (not shown) or the like, thereby broadcasting the broadcast content to homes or the like.

[0044] The operation input unit 420 receives operation input from the user for editing video information and audio information, and includes a plurality of operation switches 421. The operation switches 421 may include switches for selecting (switching) video information and / or audio information, zooming in / out of video, playback, adjusting volume, displaying multiple videos on one screen, mixing audio information, and the like.

[0045] The editing control unit 430 controls the entire editing device 400. The editing control unit 430 switches between the video information acquired by each video camera 200 and the audio information acquired by each microphone 310, and outputs the switched video information as broadcast content. At this time, video information from multiple video cameras 200 may be included together on a single screen. Audio information from multiple microphones 310 may also be mixed. Furthermore, video or audio effect processing (insertion of text information, audio processing, etc.) may be performed. A broadcast signal including the edited broadcast content (video information and audio information) can be broadcast to homes, etc. via the broadcast antenna 413, and can also be transmitted to the broadcast center facility 50 via the broadcast antenna 413 (or wireless router 412).

[0046] The editing control unit 430 of this embodiment includes a time lag correction unit 431 that determines the amount of delay of the sound information signal from each sound collection unit 300 to the editing device 400 and corrects the time lag of each sound information signal. Specific processing by the time lag correction unit 431 will be described in detail with reference to FIG. 6 .

[0047] The editing storage unit 440 stores various types of information for the editing device 400. For example, the editing storage unit 440 stores programs executed by the editing control unit 430 and data used by the editing control unit 430. This data includes broadcast content edited by the editing control unit 430. The editing storage unit 440 may also store video information and / or audio information before editing. The information output unit 450 outputs various types of information to a user of the editing device 400. The information output unit 450 includes one main monitor 451 and multiple sub-monitors 452. Each of the main monitor 451 and the sub-monitors 452 has a display device (such as a liquid crystal panel), a speaker, etc. (not shown). The main monitor 451 can output video information and audio information of the edited broadcast content. The sub-monitor 452 outputs video information (and audio information) before editing.

[0048] The basic configuration of each part of the editing device 400 can be the same as that of Patent Document 1 or Patent Document 2.

[0049] [A-1-5. Broadcasting center facility 50] The broadcasting center facility 50 (FIG. 1) broadcasts the broadcast signal received from the broadcasting van 40 either directly or after processing it. The broadcasting center facility 50 may also upload the broadcast signal to a distribution server (not shown) and distribute it to homes or the like in the form of video-on-demand from the distribution server via the Internet.

[0050] <A-2. Control and Operation> [A-2-1. Overall Flow] Next, various controls and the operations required for them in the communication system 10 of this embodiment will be described. Below, the arrangement of the first sensor group 20, the second sensor group 30, and the relay vehicle 40, the operations and controls when the first sensor group 20, the second sensor group 30, and the relay vehicle 40 are started, and the operations and controls when each part is normally used will be described.

[0051] [A-2-2. Work to Place Each Part] Figure 5 shows an example of the placement of the video camera 200, microphone 310, and broadcast vehicle 40 of this embodiment at a baseball stadium 90. In the example of Figure 5, a worker carries the video camera 200 and microphone 310 to each of placement points A to L (hereinafter also referred to as "points A to L"). In addition, the broadcast vehicle 40 is placed at a predetermined position outside the baseball stadium 90 (outside the first base stand in the example of Figure 5).

[0052] As described above, in this embodiment, video camera 200 is connected to editing device 400 via communication cable 202, so the operator of video camera 200 needs to run communication cable 202 (as will be described later, video camera 200 can also be a wireless system). On the other hand, microphone 310 is a wireless system, so the operator of microphone 310 simply carries sound collection unit 300 ( FIG. 3 ) to each of points A to L to complete placement.

[0053] Each wireless router 350 (sensor-side router 350) arranged at each of points A to L to form the mesh network 60 (FIG. 2) is arranged in a position where it can transmit sound information signals to at least two other wireless routers 350. The number of sensor-side routers 350 that communicate directly with the relay vehicle 40 (editing-device-side router 412 of the editing device 400) may be one or more.

[0054] [A-2-3. Operations and Control at Startup of Each Unit] (A-2-3-1. Operations and Control at Startup of OB Van 40) In the OB van 40, the editing device 400 is powered on at a predetermined timing (for example, when the OB van 40 is completely positioned). This enables the communication unit 410 of the editing device 400 to communicate with the video camera 200 and the sound collection unit 300 (input of video information signals and sound information signals) (it enters standby mode). At this time, the editing device-side router 412 starts dynamic routing processing. That is, the editing device-side router 412 periodically monitors whether a sensor-side router 350 (another node) is present in its surroundings, and updates the routing table each time. The editing device-side router 412 also starts a new sound collection unit connection determination process.

[0055] 6 is a flowchart of a new sound collection unit connection determination process executed by the editing device 400 of this embodiment. The new sound collection unit connection determination process determines whether or not a new sound collection unit 300 is connected to the editing device 400 (or the mesh network 60) (step S11 in FIG. 6), and if the connection is determined (S11: TRUE), performs predetermined processes (S12 to S15). Further details of the new sound collection unit connection determination process will be described later in association with FIG. 7.

[0056] (A-2-3-2. Operations and Controls at Start-Up of Video Camera 200) When the editing device 400 is powered on and the video camera 200 whose placement has been completed is powered on, the video information signal of the video camera 200 is input to the communication unit 410 (video signal input unit 411) of the editing device 400 via the communication cable 202, and the video information is displayed on one of the sub-monitors 452. In the initial setting, an input terminal (not shown) of the video signal input unit 411 is associated with the sub-monitor 452. Therefore, the corresponding sub-monitor 452 is determined depending on the input terminal to which the communication cable 202 is connected. Note that the association between the input terminal of the video signal input unit 411 and the sub-monitor 452 may be switchable by operating the operation switch 421.

[0057] Furthermore, the video information to be displayed on the main monitor 451 is selected according to the initial settings. For example, when the video information signal of only one video camera 200 is input to the editing device 400, the video information corresponding to that video information signal is displayed on the main monitor 451. When the video information signals of multiple video cameras 200 are input to the editing device 400, the video information corresponding to the video information signal input to a preset input terminal of the video signal input unit 411 is displayed on the main monitor 451. During normal use, the video information displayed on the main monitor 451 is switched by operating the operation switch 421.

[0058] (A-2-3-3. Operations and control at startup of sound collection unit 300) (A-2-3-3-1. Overview) Fig. 7 is a flowchart showing an outline of the control of sound collection unit 300 in this embodiment. When the power switch (not shown) of sound collection unit 300 is turned on, sound collection unit 300 (sound collection unit control unit 330) executes startup control (step S21). The startup control includes a communication route establishment process (S211) and a delay amount determination auxiliary process (S212).

[0059] The communication route establishment process (S211) is a process for establishing a communication route between the activated sound collection unit 300 and the editing device 400. The delay amount determination assistance process (S212) is a process for assisting the delay amount determination process (S13 in FIG. 6) by the editing device 400.

[0060] (A-2-3-3-2. Establishing a communication route (S11, S12 in FIG. 6, S211 in FIG. 7)) As described above, the startup control of the sound collection unit 300 executes a communication route establishment process (S211 in FIG. 7) that establishes a communication route between the started sound collection unit 300 and the editing device 400. In the communication route establishment process, the sound collection unit 300 (sound collection unit control unit 330) determines whether or not there is a connectable node (sensor side router 350 or editing device side router 412) in its vicinity. If a connectable node is detected, the sound collection unit 300 transmits its own information to the editing device 400. For example, the sound collection unit 300 reads the IP address of the editing device side router 412 from the sound collection unit storage unit 340, and transmits a startup message (including its own information) addressed to that IP address. The self-information includes, for example, the user's account name, individual identification number, IP address, and node type (for example, whether the node is a video camera 200 or a microphone 310 (sound collection unit 300)). The text of the startup message may be encrypted in a predetermined manner.

[0061] The startup message sent from the new sound collection unit 300 is transmitted to the editing device-side router 412 via the mesh network 60. When the editing control unit 430 of the editing device 400 receives the startup message via the editing device-side router 412 (S11 in FIG. 6: TRUE), in step S12, it registers information about the new sound collection unit 300 in the management table.

[0062] (A-2-3-3-3. Delay amount determination (S13 in FIG. 6, S212 in FIG. 7)) Next, in step S13, the editing device 400 (editing control unit 430) executes a delay determination process. In response to this, the new sound collection unit 300 (sound collection unit control unit 330) executes a delay amount determination auxiliary process in step S212 in FIG. 7. As described above, the delay amount determination process (S13) is a process for determining the amount of communication delay between the started sound collection unit 300 (i.e., the sound collection unit that has successfully established communication with the editing device 400) and the editing device 400. In addition, the delay amount determination auxiliary process (S212) assists the delay amount determination process (S13).

[0063] Specifically, the editing device 400 transmits a ping signal to the new sound collection unit 300. Upon receiving the ping signal, the new sound collection unit 300 replies to the editing device 400. The editing device 400 measures the communication time of the ping signal using its own timing function, calculates the amount of communication delay from the new sound collection unit 300 to the editing device 400, and registers this in the management table in association with the new sound collection unit 300. As will be described later, the amount of communication delay can also be determined by other methods.

[0064] (A-2-3-3-4. New sound collection unit addition notification process (S14 in Fig. 6)) Next, in step S14 in Fig. 6, the editing device 400 executes new sound collection unit addition notification process to notify the user of the editing device 400 that a new sound collection unit 300 has been added to the mesh network 60. For example, the editing device 400 displays on the main monitor 451 a message that a new sound collection unit 300 has been added to the mesh network 60, and the individual identification number of the sound collection unit 300.

[0065] (A-2-3-3-5. Video camera-microphone linking process (S15 in FIG. 6)) In the next step S15 in FIG. 6, the editing device 400 executes video camera-microphone linking process to link the microphone 310 of the new sound collection unit 300 with the video camera 200. As described above, in this embodiment, each video camera 200 and each microphone 310 are separate. However, each video camera 200 and each microphone 310 are often used in combination. Therefore, in the editing device 400 of this embodiment, the video camera 200 and the microphone 310 can be paired and registered in a management table. This makes it possible to switch the paired sound information at the same time when the video information is switched using the operation switch 421.

[0066] Furthermore, in this embodiment, the video information signal is input via the communication cable 202 and the video signal input unit 411, while the audio information signal is input via the wireless routers 350 and 412. Therefore, when pairing the microphone 310 with the video camera 200, the editing device 400 displays a pairing list of the video camera 200 and the microphone 310. Then, it is possible to select a video camera 200 that is not paired or that has already been paired in the pairing list. Then, the video camera 200 selected by the user is paired with a new microphone 310 and registered in the management table.

[0067] [A-2-4. Operation and Control of Each Part During Normal Use] During normal use of the video camera 200, a video information signal obtained by the video camera 200 based on the operation of the user of the video camera 200 is input to the editing device 400 via the communication cable 202. During normal use of the microphone 310 (sound collection unit 300), the sound collection unit 300 performs normal operation control (S22 in FIG. 7). Specifically, a sound information signal obtained by the microphone 310 based on the operation of the user of the microphone 310 is transmitted to the editing device 400 via the mesh network 60 (sound signal transmission process of S221 in FIG. 7). Furthermore, each sensor-side router 350 performs dynamic routing processing (S222).

[0068] During normal use of the editing device 400, video information and audio information are edited based on the user's operation of the editing device 400 and broadcast as broadcast content. In other words, the editing device 400 functions as a switcher or the like. Furthermore, the editing device 400 (time lag correction unit 431) corrects the time lag of each sound information signal based on the communication delay amount determined in the delay amount determination process (S13 in FIG. 6). In other words, the editing device 400 processes each sound information signal from each sound collection unit 300 so that the time lag of each sound information signal approaches zero. For example, assume that the delay amount of sound information signal Ss1 is 0.1 seconds, the delay amount of sound information signal Ss2 is 0.2 seconds, and the delay amount of sound information signal Ss3 is 0.3 seconds. In this case, the editing device 400 delays the sound information signal Ss1 by 0.2 seconds and the sound information signal Ss2 by 0.1 seconds, thereby matching the delay amounts of the sound information signals Ss1 to Ss3.

[0069] <A-3. Effects of this embodiment> According to this embodiment, sound information signals indicating sound information acquired by the microphones 310 of each sound collection unit 300 are transmitted to the editing device 400 via the mesh network 60 including the wireless routers 350 of each sound collection unit 300 (S221 and S222 in FIGS. 2 and 7). This makes it possible to transmit sound information from the microphones 310 to the editing device 400 without a communication cable connecting each microphone 310 and the editing device 400. This reduces the effort required to lay communication cables.

[0070] Furthermore, compared to direct wireless communication between each microphone 310 and the editing device 400, wireless communication between each sound collection unit 300 and the editing device 400 via the mesh network 60 makes it possible to suppress wireless output or expand the range in which sound information can be obtained.

[0071] Furthermore, by adopting the mesh network 60 configuration rather than the daisy chain configuration, even if an abnormality occurs in one of the wireless routers 350, it is possible to transmit sound information acquired by microphones 310 other than the microphone 310 paired with that wireless router 350 to the editing device 400. This makes it possible to improve the robustness of the communication system 10.

[0072] In this embodiment, communication system 10 includes multiple video cameras 200 that acquire surrounding video information and transmit video report signals indicating the video information to editing device 400 via communication cable 202 ( FIG. 1 ). Multiple microphones 310 are used separately from the multiple video cameras 200 ( FIG. 1 ). Editing device 400 switches the video information acquired by each video camera 200 and outputs it together with audio information ( FIG. 4 ). This makes it possible to output audio information and video information in association with each other, even when microphones 310 and video cameras 200 are used separately (without being integrated) in a configuration using mesh network 60 using wireless router 350 of sound collection unit 300 (which is particularly common in high-end applications).

[0073] In this embodiment, the communication system 10 includes a time lag correction unit 431 that determines the amount of delay of the sound information signal reaching the editing device 400 from each sound collection unit 300 and corrects the time lag of each sound information signal (FIG. 4). This makes it possible to reduce the sense of discomfort caused by the time lag when the viewer (a person receiving the sound information edited by the editing device 400) perceives the sound information.

[0074] In this embodiment, the time lag correction unit 431 transmits a ping signal to the wireless router 350 of each sound collection unit 300, and determines the amount of delay of each sound information signal based on a response signal from each wireless router 350 (S13 in FIG. 6). The time lag correction unit 431 also corrects the time lag of each sound information signal based on the determined amount of delay. This makes it possible to correct the time lag without performing any special processing on the wireless router 350 side.

[0075] In this embodiment, each of the wireless routers 350 constituting the mesh network 60 is arranged in a position where it can transmit a sound information signal to at least two other wireless routers 350, excluding the wireless router 350 that directly communicates with the editing device 400 (FIG. 5). This allows communication via the mesh network 60 even if a communication error occurs in one of the wireless routers 350 that relays the sound information signal (excluding the wireless router 350 that directly communicates with the editing device 400).

[0076] B. Modifications The present invention is not limited to the above-described embodiment, and various configurations can be adopted based on the contents of this specification. For example, the following configurations can be adopted.

[0077] <B-1. Configuration> In the above embodiment, the first sensor group 20 (video camera 200) and the second sensor group 30 (microphone 310) were used in a baseball stadium 90 (FIGS. 1 and 5). However, this is not limiting, for example, if attention is focused on configuring a mesh network of node units in connection with live broadcasting. For example, the first sensor group 20 and / or the second sensor group 30 could also be used in other stadiums, theaters, or concert halls.

[0078] In the above embodiment, the video information signal from the video camera 200 is transmitted to the editing device 400 via the communication cable 202 ( FIG. 1 ). However, for example, if attention is focused on the transmission of the video information signal to the editing device 400, the video camera 200 may perform wireless communication with the broadcast van 40. In that case, similar to the audio information signal from the microphone 310, the video information signal from the video camera 200 may be transmitted to the editing device 400 via a wireless router. In other words, the first sensor group 20 may be configured by a plurality of node units including the video camera 200 and a wireless router, and a mesh network may be configured by the wireless router paired with the video camera 200.

[0079] When a wireless router is also used in the first sensor group 20, the mesh network of the first sensor group 20 and the mesh network 60 of the second sensor group 30 may be configured separately. In this case, the specifications (communication speed, etc.) of the two mesh networks may be different. Alternatively, the first sensor group 20 and the second sensor group 30 may configure a single mesh network.

[0080] In the above embodiment, the sound collection unit 300 was used as a node unit for configuring the mesh network 60 using the wireless router 350 ( FIG. 2 ). However, this is not limited to the above, for example, if the mesh network of node units is configured in connection with live broadcasting. For example, the mesh network may be configured only from a node unit including the video camera 200 and a paired wireless router. Alternatively, in a configuration in which the microphone 310 is integrated into the video camera 200, the mesh network may be configured from the video camera 200 with the integrated microphone 310 and a node unit including the paired wireless router. Furthermore, instead of a wireless router, a mesh network can be configured using a wired router with multiple node units (a video unit with the video camera 200 and / or a sound collection unit 300 with the microphone 410) connected together.

[0081] In the above embodiment, the editing device-side router 412 is used as the communication device of the editing device 400 that communicates with the mesh network 60 formed by the sensor-side router 350 ( FIG. 4 ). However, for example, if attention is focused on the fact that the editing device 400 communicates with the mesh network 60, other communication devices (for example, gateway devices other than a router) may be used in the editing device 400. In this case, communication settings with the sensor-side router 350 located closest to the editing device 400 may be configured in advance.

[0082] <B-2. Control> In the above embodiment, a ping signal is used to determine the amount of communication delay (S13 in FIG. 6, S212 in FIG. 7). However, this is not limited to this, for example, if attention is focused on correcting the time lag of the sound information signals from each sound collection unit 300.

[0083] For example, the time lag may be corrected using the following method. That is, each wireless router 350 in the sound collection unit 300 assigns a timestamp (the time at which the signal is relayed) to the sound information signal it relays. The time lag correction unit 431 calculates the amount of delay based on the timestamp assigned to the sound information signal and corrects the time lag of each sound information signal. This makes it easy to correct the time lag even if the signal transmission path in the mesh network 60 changes.

[0084] Alternatively, the time lag correction unit 431 may impart a delay amount, which is a fixed value set for each wireless router 350, to the sound information signal for each wireless router 350. In other words, with each wireless router 350 placed, the delay amount is measured using a measuring device (not shown), and the measured delay amount is stored in association with each wireless router 350. Then, the time lag of the sound information signal from each wireless router 350 is corrected based on the delay amount (fixed value) stored for each wireless router 350. In this way, once each delay amount, which is a unique value, is set, time lag correction becomes possible without performing special processing in each wireless router 350 or the editing device 400.

[0085] REFERENCE SIGNS LIST 10...Communication system 20...First sensor group 30...Second sensor group 40...Relay van 50...Broadcast center equipment 60...Mesh network 90...Baseball stadium 200...Video camera (periphery sensor) 202...Communication cable 300...Sound collection unit (node ​​unit) 310...Microphone (periphery sensor) 350...Wireless router 400...Editing device 412...Wireless router (communication device) 431...Time lag correction unit

Claims

1. A communication system comprising: a plurality of sound collection units each including a microphone that acquires ambient sound information and outputs a sound information signal indicating the sound information, and a wireless router that externally transmits the sound information signal; and a communication device that communicates with the wireless router to receive the sound information signal, and an editing device that edits and outputs the sound information, wherein the editing device switches or mixes the sound information acquired by each microphone and outputs it, the wireless routers of the plurality of sound collection units form a mesh network, and the sound information signal is transmitted from each sound collection unit to the editing device via the mesh network.

2. The communication system according to claim 1, further comprising a plurality of video cameras that acquire ambient video information and transmit a video information signal indicating the video information to the editing device via a communication cable or wireless communication, wherein the plurality of microphones are used separately from the plurality of video cameras, and the editing device switches the video information acquired by each video camera and outputs it together with the sound information.

3. The communication system according to claim 1 or 2, further comprising a time shift correction unit that corrects the time shift of each sound information signal based on the delay amount of the sound information signal reaching the editing device from each sound collection unit.

4. The communication system according to claim 3, wherein the time shift correction unit transmits a pin signal to each wireless router, determines the delay amount of each sound information signal based on the response signal from each wireless router, and corrects the time shift of each sound information signal based on the determined delay amount.

5. The communication system according to claim 3, wherein each wireless router assigns a timestamp to the sound information signal relayed by itself, and the time shift correction unit corrects the time shift of each sound information signal based on the timestamp assigned to the sound information signal.

6. In the communication system according to claim 3, the time shift correction unit adds a delay amount, which is a fixed value set for each wireless router, to the sound information signal for each wireless router. A communication system characterized by this.

7. In the communication system according to claim 1 or 2, each wireless router constituting the mesh network is arranged at a position where it can transmit the sound information signal to at least two other wireless routers, excluding the wireless router that communicates directly with the editing device. A communication system characterized by this.

8. A communication method using a communication system including a plurality of node units each including a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal externally, and a communication device that communicates with the router and receives the peripheral information signal, and an editing device that edits and outputs the peripheral information. The router of the plurality of node units forms a mesh network, and the peripheral information signal is transmitted from each node unit to the editing device via the mesh network. A communication method characterized by this.

9. A sound collection unit including a microphone that acquires peripheral sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal externally. The wireless router forms a mesh network with the wireless routers of other sound collection units, and the wireless router relays the sound information signal received from the wireless routers of other sound collection units toward the editing device via the mesh network. A sound collection unit characterized by this.

Images