Output device, method, and program
The output device determines the optimal audio playback device based on reception time differences to synchronize video and audio, addressing timing deviations and reducing buffering, thereby enhancing the live streaming experience and lowering system costs.
Patent Information
- Application Number
- PCT/JP2023/017227
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-08
- Publication Date
- 2024-11-14
AI Technical Summary
Live streaming of events experiences timing deviations between video and audio due to differing processing times and data sizes, causing viewer discomfort, and conventional synchronization methods require significant buffering and increased system costs.
An output device and method that determines the appropriate audio playback device based on the time difference between video and audio reception, adjusting the audio output timing to minimize perceived delay and reduce buffering requirements.
This approach reduces viewer discomfort by synchronizing video and audio playback, allowing audio to be output from the most suitable device, thereby minimizing the sense of delay and reducing the need for large buffers, thus lowering system costs.
Smart Images

Figure JP2023017227_14112024_PF_FP_ABST
Abstract
Description
Output device, method and program
[0001] FIELD Embodiments of the present invention relate to an output device, a method, and a program.
[0002] In recent years, with the development of communication technology, live streaming of music events, sports matches, etc. has increased, and it has become possible to enjoy live streaming in environments such as small remote venues or at home equipped with multiple audio playback devices.
[0003] When synchronized video and audio captured at the same time at an event or game venue are transmitted to a remote location, the processing time and data size required for transmission differ between the video and audio. This results in a difference in the timing (communication delay) between the video and audio arriving at a remote location, such as a home, resulting in a mismatch between the playback timing of the video and audio, causing a sense of discomfort to the viewer.
[0004] To resolve the timing discrepancy, there are methods for synchronously playing back video and audio. For example, there are methods for synchronizing time using NTP (Network Time Protocol) or PTP (Precision Time Protocol) so that the same time information is managed on the sending and receiving sides, for example, at an event venue and a remote location. These include: (1) a method in which, when packetizing video and audio data into RTP (Real-time Transport Protocol) packets during transmission, the absolute time at which the video and audio are sampled is added as an RTP timestamp, and the receiving side delays either the video or the audio based on this time information to adjust the playback timing and achieve synchronization (see, for example, Non-Patent Document 1); and (2) a method in which video and audio are played back in synchronous with absolute time using the media transmission standard MMT (MPEG Media Transport) (see, for example, Non-Patent Document 2).
[0005] Daisuke TOKUMOTO, Jotaro IKEDO, Takao KANEKO, Akitoshi KATAOKA, "Synchronization for Acoustic Signals over IP Network" and Takayuki NAKACHI, "A Media Transport Technology MMT in the Post-Ultra High Definition Age"
[0006] However, with conventional synchronized playback methods, playback must wait until either the video or audio, whichever has the longer delay, arrives at the remote location, so a buffer area must be reserved to temporarily store the video or audio that was received first, and increasing this buffer area increases system costs.
[0007] This invention has been made in light of the above circumstances, and its purpose is to provide an output device, method, and program that can reduce the sense of discomfort felt by viewers when playing back video and audio with different delay times.
[0008] An output device according to one embodiment of the present invention includes a receiving unit that receives video and audio transmitted from a plurality of synchronized video and audio transmission points, and a determination unit that determines, based on the difference between the time the video is received by the receiving unit and the time the audio is received by the receiving unit, an audio playback device among a plurality of audio playback devices installed at the video and audio receiving point that will play the audio received by the receiving unit.
[0009] An output method according to one aspect of the present invention is a method performed by an output device, and includes receiving, by a receiving unit of the output device, video and audio transmitted from a plurality of synchronized video and audio transmission points, and determining, by a determination unit of the output device, an audio playback device from a plurality of audio playback devices installed at the video and audio receiving point that will play the audio received by the receiving unit, based on the difference between the time the video was received by the receiving unit and the time the audio was received by the receiving unit.
[0010] According to the present invention, it is possible to reduce the sense of discomfort felt by a viewer when video and audio with different delay times are played back.
[0011] FIG. 1 is a diagram showing an example application of a playback system according to an embodiment of the present invention. FIG. 2 is a diagram showing an example configuration of an audio time record table in table format. FIG. 3 is a diagram showing an example configuration of a video time record table in table format. FIG. 4 is a diagram showing an example configuration of a delay difference management table in table format. FIG. 5 is a diagram showing an example configuration of a distance information table in table format. FIG. 6 is a flowchart showing an example of a processing procedure performed by a calculation unit. FIG. 7 is a diagram showing a first example of acquiring records from the audio time record table and the video time record table. FIG. 8 is a diagram showing a second example of acquiring records from the audio time record table and the video time record table. FIG. 9 is a flowchart showing an example of a processing procedure performed by a determination unit. FIG. 10 is a diagram explaining examples of various values calculated by the determination unit. FIG. 11 is a block diagram showing an example hardware configuration of a computer according to an embodiment of the present invention.
[0012] An embodiment of the present invention will be described below with reference to the drawings. An output device according to an embodiment of the present invention outputs a video (video) acquired at absolute time T, i.e., recorded or sampled, at a location R of a source (sometimes referred to as a sender) of synchronized video and audio. T and audio T The time T video and T audioThe time difference |T video -T audio | Based on audio T The audio output device has the function of determining which of the multiple audio output devices located at site O is appropriate to play the audio.
[0013] At this time, the output device according to an embodiment of the present invention is T video >T audio The condition is met, i.e., audio T The video is better T If the audio arrives at the location O earlier than the location A, the greater the time difference, the more likely it is that audio will be transmitted from an audio output device that is physically farther away from a predetermined location at the receiving location, for example, from the location of the viewer. T and determines the output time at which to output the audio according to the time difference.
[0014] On the other hand, the output device according to one embodiment of the present invention is T video <T audio The condition is met, i.e., video T Audio is better T If the audio arrives at location O before the audio output device that is physically closest to the viewer, audio T The audio output device has a function of determining the audio output destination so that the audio is output.
[0015] In this embodiment, the speed of sound is approximately 340 meters per second, and audio takes longer to be perceived by the viewer after being output from an output device than video, so audio buffering is reduced and audio and video playback is controlled.
[0016] In this embodiment, the video image acquired at absolute time T at the location R is T and audio T The time T video and T audio Time difference between |T video -T audio | Based on audio TBy determining the audio output device and output timing, viewers can enjoy the video T and audio T This reduces the time difference perceived by the viewer when multiple video and audio streams with different delay times are played back.
[0017] Furthermore, in this embodiment, audio that arrives at location O before video can be output before the video, thereby reducing the buffer area required to temporarily store audio that has been received earlier.
[0018] Fig. 1 is a diagram showing an application example of a playback system according to an embodiment of the present invention. In the example shown in Fig. 1, the playback system according to this embodiment includes a computer 1 at a location O on the video and audio receiving side, and computers 2 at multiple locations R, ..., Rn on the video and audio transmitting side (sometimes referred to as each transmitting location or each location), which are communicably connected via an IP (Internet Protocol) network.
[0019] The computer 1 includes a media receiving unit 11, a management DB (database) 12, a calculation unit 13, a determination unit 14, a location information DB 15, and a video playback unit 16. A plurality of audio playback devices 1a are connected to the determination unit 14, and one video playback device 1b is connected to the video playback unit 16. The number of audio playback devices 1a and video playback devices 1b connected to the determination unit 14 is not particularly limited as long as there is a plurality of audio playback devices 1a.
[0020] Each sending computer 2 includes a media transmitter 21. A video shooting device 2a and an audio recording device 2b are connected to the media transmitter 21. The media transmitter 21 can transmit video captured by the connected video shooting device 2a and audio recorded by the audio recording device 2b to the computer 1 via the IP network. The media receiver 11 of the receiving computer 1 can receive the video and audio transmitted from the sending computer 2 via the IP network.
[0021] The media transmission unit 21 of the computer 2 at each transmitting location R acquires the video captured by the connected video imaging device 2a and the audio recorded by the connected audio recording device 2b at a certain interval I, packets them with packet numbers, and sends them to the receiving computer 1 via the IP network.
[0022] To simplify the explanation, in this embodiment, at each transmitting location R, the media transmission unit 21 acquires video and audio at a certain interval I, and video packets and audio packets (sometimes referred to as audio packets) assigned the same packet number store the same time information, i.e., the absolute time of the captured or sampled video and recorded or sampled audio.
[0023] The media receiving unit 11 of the receiving computer 1 receives IP packets transmitted from each transmitting location R. If the media stored in this IP packet is audio, the media receiving unit 11 stores in the sound time recording table (sometimes referred to as the audio time recording table) of the management DB 12 a record associated with (1) the location number unique to the transmitting location, (2) the packet number unique to the packet, and (3) the current absolute time, i.e., the time the IP packet was received, all of which are stored in the IP packet. This adds a record associated with the values of each column to the sound time recording table. The sound time recording table will be described in detail later. The media receiving unit 11 then passes the received IP packet to the determination unit 14.
[0024] Furthermore, if the media stored in the received IP packet is video, the media receiving unit 11 stores in the video time recording table of the management DB 12 a record associated with (1) the base number unique to the sending base, (2) the packet number unique to the packet, and (3) the current absolute time stored in the IP packet. This adds a record associated with the values of each column to the video time recording table. The video time recording table will be described in detail later. The media receiving unit 11 then passes the received IP packet to the video playback unit 16. The video playback unit 16 depacketizes the video data stored in the IP packet acquired from the media receiving unit 11 and outputs it to the connected video playback device 1b.
[0025] The management DB 12 is a DB that manages the delay difference between video and audio received from each location, and stores an audio time record table, a video time record table, and a delay difference management table. FIG. 2 is a diagram showing an example of the configuration of the audio time record table in table format. FIG. 3 is a diagram showing an example of the configuration of the video time record table in table format. FIG. 4 is a diagram showing an example of the configuration of the delay difference management table in table format. In the example shown in FIG. 2, the audio time record table has a location number column, an audio packet number column, and an audio reception time (sometimes referred to as audio reception time) column. This example shows an example in which each column related to each location is managed in a single audio time record table, but it is also possible to manage separate audio time record tables for each location.
[0026] In the example shown in Figure 3, the video time recording table has a location number column, a video packet number column, and a video reception time column. In this example, each column for each location is managed in a single video time recording table, but a separate video recording table may be used for each location. In the example shown in Figure 4, the delay difference management table has a location number column and a delay difference column. The value in this delay difference column is the difference between the delay time between the transmission and reception of a video packet between the sending and receiving sides and the delay time between the transmission and reception of an audio packet, and corresponds to the difference between the reception time of the video packet and the reception time of the audio packet at the receiving computer 1.
[0027] The location information DB 15 stores a distance information table, which is a DB for managing location information of audio playback devices installed at the site O. Fig. 5 is a diagram showing an example of the configuration of the distance information table in tabular form.
[0028] 5, the distance information table has an audio playback device number column specific to each audio playback device 1a, and a distance column. The distance column stores the distance from the sweet spot, the position where the listener can hear the audio in the space at site O in the best condition, to each audio playback device 1a, with the distance of an audio playback device 1a located in front of the listener, i.e., in the listener's line of sight, being expressed as a positive value, and the distance of an audio playback device 1a located behind the listener being expressed as a negative value.
[0029] The calculation unit 13 refers to the audio time record table and the video time record table stored in the management DB 12 at regular intervals, calculates the delay difference between video and audio for each transmitting location R, and updates the value in the delay difference column of the delay difference management table according to the calculation result. The processing steps of the calculation unit 13 are shown below. In the figure, the processing steps are represented as S. FIG. 6 is a flowchart showing an example of the processing procedure by the calculation unit 13.
[0030] (STEP 131) At regular intervals, the calculation unit 13 refers to the sound time record table and the video time record table stored in the management DB 12, and from the records in each table where the location number column has the same value r (= 1, 2, 3, ...), obtains from the sound time record table and the video time record table the record that contains the largest value among the values contained in both the sound packet number column and the video packet number column. This obtainment is performed for the record corresponding to each value of the location number column.
[0031] Fig. 7 is a diagram showing a first example of retrieving records from the sound time record table and the video time record table. Fig. 8 is a diagram showing a second example of retrieving records from the sound time record table and the video time record table. The example shown in Fig. 7 is an example of retrieving records from each record at a first time, and the example shown in Fig. 8 is an example of retrieving records from each record at a second time after the first time.
[0032] 7, among the records in which the location number column in both the sound time record table and the video time record table has the same value "1" at the first time, the record containing the largest value "2" in both the sound packet number column and the video packet number column is retrieved from the sound time record table and the video time record table, respectively. That is, a record associating location number "1," sound packet number "2," and sound reception time "9:00:00.020" is retrieved from the sound time record table, and a record associating location number "1," video packet number "2," and video reception time "9:00:00.040" is retrieved from the video time record table.
[0033] 8, among the records in which the location number column in the sound time record table and the video time record table has the same value "1" at the second time, the record containing the largest value "3" in both the sound packet number column and the video packet number column is retrieved from the sound time record table and the video time record table, respectively. That is, a record in which the location number "1," the sound packet number "3," and the sound reception time "9:00:00.035" are associated is retrieved from the sound time record table, and a record in which the location number "1," the video packet number "3," and the video reception time "9:00:00.050" are associated is retrieved from the video time record table.
[0034] (STEP 132) Each time a record is acquired in STEP 131 at each time, the calculation unit 13 calculates the delay difference D, which is the difference between the value in the sound reception time column and the value in the video reception time column of this acquired record, using the following formula (1). This calculation is performed for records corresponding to the respective values in the location number columns of the sound time record table and the video time record table. Delay difference D = video reception time - sound reception time Formula (1) In this embodiment, the difference between the video reception time and the sound reception time is calculated as the delay difference D in milliseconds. In other words, when the difference between the video reception time and the sound reception time is 10 / 1000 of a second, the calculated delay difference D is "10". The difference between the value of the video reception time column and the value of the sound reception time column of the records obtained from the sound time recording table and the video time recording table at the first time shown in Figure 7 is the difference between the video reception time "9:00:00.040" and the sound reception time "9:00:00.020", and the delay difference D is calculated to be "20".
[0035] Furthermore, the difference between the value of the video reception time column and the value of the sound reception time column of the records obtained from the sound time recording table and the video time recording table at the second time shown in Figure 8 is the difference between the video reception time "9:00:00.050" and the sound reception time "9:00:00.035", and the delay difference D is calculated to be "15".
[0036] (STEP 133) Every time the delay difference D is calculated in STEP 132, the calculation unit 13 refers to the delay difference management table stored in the management DB 12 and acquires a record whose location number column value is r. This r is the location number of the record acquired in STEP 132. This acquisition is performed for records corresponding to each value in the location number column of the delay difference management table.
[0037] (STEP 134) Each time an acquisition is performed in STEP 133, if the value of the delay difference column of the record acquired from the delay difference management table in STEP 133 differs from the delay difference D calculated in STEP 132, that is, if the delay difference corresponding to a certain location number managed in the delay difference management table has changed, the calculation unit 13 updates the value of the delay difference column of the record acquired from the delay difference management table in STEP 133 to the delay difference D calculated in STEP 132. Such an update is performed for records corresponding to each value in the location number column of the delay difference management table.
[0038] At the first time, the value of the delay difference D is "20" as shown in Fig. 7, and the value of the delay difference column of the record with location number "1" obtained from the delay difference management table is updated to "20". At the second time, the value of the delay difference D is "15" as shown in Fig. 8, and the value of the delay difference column of the record with location number "1" obtained from the delay difference management table is updated to "15". In this way, the processes from STEP 131 to STEP 134 are repeated at regular intervals.
[0039] The determination unit 14 refers to the delay difference management table updated as described above and stored in the management DB 12, and determines which of the audio reproduction devices 1a connected to the determination unit 14 is appropriate to output the audio data stored in the IP packet acquired from the media receiving unit 11, and outputs the audio from the determined audio reproduction device 1a. The processing steps of the determination unit 14 are shown below. Figure 9 is a flowchart showing an example of the processing procedure by the determination unit. Figure 10 is a diagram explaining an example of various values calculated by the determination unit.
[0040] In this embodiment, the determination unit 14 acquires and depackets IP packets of audio from the media receiving unit 11, and at the timing when the IP packets are acquired ("A" in FIG. 10) iThe audio output processing time, which is the time required from the timing (symbol a in FIG. 10) when the audio is output to the determined audio playback device 1a, is set to Δα (milliseconds, fixed value). In this embodiment, the video playback unit 16 acquires and depackets the IP packets of the video from the media receiving unit 11, and the timing (symbol a in FIG. 10) when the IP packets are acquired is set to Δα (milliseconds, fixed value). i The video output processing time, which is the time from the timing of the video playback device 1b being played back (reference symbol b in FIG. 10), is defined as Δβ (milliseconds, fixed value). The above Δα and Δβ can be determined in advance and stored in, for example, a storage device (not shown) of the computer 1.
[0041] (STEP 141) The determination unit 14 refers to the delay difference management table stored in the management DB 12 and obtains from this table a record whose value in the base number column matches the source base number r stored in the IP packet obtained from the media receiving unit 11.
[0042] (STEP 142) Next, the determination unit 14 sets the value of the delay difference column of the record acquired from the delay difference management table in STEP 141 as Δdelay (milliseconds), and determines that if this Δdelay is a positive value, that is, if the value satisfies the condition of "video reception time>audio reception time", that is, if the audio reception time ("A" in FIG. 10) related to the acquired IP packet is greater than the delay difference column value of the record acquired in STEP 141, the determination unit 14 determines that the delay difference column value of the record acquired in STEP 142 is Δdelay (milliseconds). i 10, the video reception time ("V" in FIG. 10) i If it precedes the .DELTA.delay, the process proceeds to STEP 143; otherwise, if the .DELTA.delay is 0 or a negative value, the process proceeds to STEP 148.
[0043] (STEP 143) The determination unit 14 calculates a correction time CT by correcting the value Δdelay in the delay difference column with the audio output processing time Δα and the video output processing time Δβ using the following formula (2). i is output to the audio reproduction device 1a (reference a in FIG. 10), i is the time until the timing at which the image is output to the video playback device 1b (symbol b in FIG. 10).
[0044] Correction time CT (milliseconds)=(Δdelay+Δβ)−Δα (2) (STEP 144) After STEP 143, the determination unit 14 determines the correction time CT (milliseconds) based on the acquired voice A. i A corrected distance CD, which is the distance traveled in the calculated corrected time CT, is calculated using the following formula (3): Corrected distance CD (meters) = (340 × CT) / 1000 Formula (3) (STEP 145) After STEP 144, the determination unit 14 refers to the distance information table stored in the position information DB 15, and obtains from this distance information table a record whose absolute value in the distance column is closest to the corrected distance CD calculated in STEP 144. In other words, the longer the calculated corrected time CT and corrected distance CD, the more likely it is that an audio reproducer 1a, out of the multiple audio reproducers 1a, that is installed at a relatively far distance from the listener at the receiving point will be determined to be the audio reproducer that reproduces the audio received by the media receiving unit 11.
[0045] (STEP 146) After STEP 145, if the difference Δd (= CD - D) between the value D of the distance column of the record acquired in STEP 145 and the corrected distance CD is greater than a preset threshold S (positive value), that is, if the relationship between the value D of the distance column and the corrected distance CD is as shown in FIG. 10, the judgment unit 14 temporarily suspends the processing related to audio output for "(1000 × Δd) / 340" (milliseconds), that is, for the time required for the audio to advance by Δd, and proceeds to STEP 147 after waiting for the processing; otherwise, the judgment unit 14 proceeds to STEP 147 without temporarily suspending the processing related to audio output.
[0046] In STEP 146, if the threshold value S is not set and Δd is a positive value, the process of pausing the process as described above may be executed. However, if the threshold value S is not set, the pause process will be executed in most cases, resulting in buffering.
[0047] (STEP 147) After STEP 146, the determination unit 14 depacketizes the IP packet acquired from the media receiving unit 11, and outputs audio to the audio playback device 1a corresponding to the audio playback device number of the record acquired from the location information table in STEP 145, and then ends the processing.
[0048] As a result, the acquired image V i is output to the video playback device 1b (symbol b in FIG. 10), and the audio A output from the audio playback device 1a is i The audio reproducing device 1a is selected and reproduction is controlled so that the timing (symbol c in FIG. 10) at which the audio reaches the ears of the listener is close (symbol d in FIG. 10).
[0049] (STEP 148) The determination unit 14 refers to the location information table stored in the location information DB 15, and acquires the record with the smallest absolute value in the distance column.
[0050] (STEP 149) After STEP 148, the determination unit 14 depacketizes the IP packet acquired from the media receiving unit 11, and outputs audio to the audio playback device 1a corresponding to the audio playback device number of the record acquired from the location information table in STEP 148, and then ends the processing.
[0051] Fig. 11 is a block diagram showing an example of the hardware configuration of a computer according to an embodiment of the present invention. In the example shown in Fig. 11, the receiving computer 1 according to the embodiment is configured, for example, as a server computer or a personal computer, and has a hardware processor 111A such as a CPU. A program memory 111B, a data memory 112, an input / output interface 113, and a communication interface 114 are connected to this hardware processor 111A via a bus 115. The transmitting computer 2 is similarly configured.
[0052] The communication interface 114 includes, for example, one or more wireless communication interface units, and enables transmission and reception of information to and from the communication network NW. As the wireless interface, for example, an interface that adopts a low-power wireless data communication standard such as a wireless LAN (Local Area Network) is used.
[0053] An input device 200 and an output device 300 that are attached to the computer 1 and used by a user or the like are connected to the input / output interface 113 .
[0054] The input / output interface 113 takes in operation data input by a user or the like via an input device 200 such as a keyboard, touch panel, touchpad, or mouse, and outputs output data to an output device 300 including a display device using liquid crystal or organic electroluminescence (EL) for display. The input device 200 and the output device 300 may be devices built into the computer 1, or may be input devices and output devices of other computers or information terminals that can communicate with the computer 1 via the network NW.
[0055] The program memory 111B is a non-transitory tangible storage medium that is a combination of a non-volatile memory that can be written to and read from at any time, such as a hard disk drive (HDD) or a solid state drive (SSD), and a non-volatile memory such as a read only memory (ROM), and stores programs necessary to execute various control processes, etc., according to one embodiment.
[0056] The data memory 112 is a tangible storage medium that is a combination of, for example, the above-mentioned nonvolatile memory and a volatile memory such as RAM (Random Access Memory), and is used to store various data acquired and created during various processing steps.
[0057] A computer 1 according to an embodiment of the present invention can be configured as an information processing device having software-based processing function units. These processing function units correspond to the various units of the computer 1 shown in FIG.
[0058] The storage device used as a work memory or the like by the computer 1 can be configured by using the data memory 112 shown in Fig. 11. However, these configured storage areas are not essential components within the computer 1, and may be areas provided in an external storage medium such as a USB (Universal Serial Bus) memory, or in a storage device such as a database server located in the cloud.
[0059] The methods described in each embodiment may be stored as a program (software means) that can be executed by a computer on a recording medium such as a magnetic disk (e.g., a floppy disk, a hard disk, etc.), an optical disk (e.g., a CD-ROM, a DVD, an MO, etc.), or a semiconductor memory (e.g., a ROM, a RAM, a flash memory, etc.), or may be transmitted and distributed via a communication medium. The program stored on the medium also includes a configuration program that configures the software means (including not only executable programs but also tables and data structures) that the computer executes. The computer that realizes this device reads the program stored on the recording medium and, in some cases, configures the software means using the configuration program, and executes the above-described processing by having the operation controlled by this software means. The term "recording medium" as used herein is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory installed inside the computer or in a device connected via a network.
[0060] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention.
[0061] REFERENCE SIGNS LIST 1, 2... Computer 1a... Audio playback device 1b... Video playback device 2a... Video shooting device 2b... Audio recording device 11... Media receiving unit 12... Management DB (database) 13... Calculation unit 14... Determination unit 15... Location information DB 16... Video playback unit 21... Media transmission unit
Claims
1. An output device comprising: a receiving unit that receives video and audio transmitted from a plurality of synchronized video and audio transmission points; and a determination unit that determines, based on the difference between the time the video is received by the receiving unit and the time the audio is received by the receiving unit, an audio playback device among a plurality of audio playback devices installed at the video and audio receiving point that will play back the audio received by the receiving unit.
2. The output device of claim 1, wherein the determination unit, when the time at which the video is received by the receiving unit is later than the time at which the audio is received by the receiving unit, determines, among the plurality of audio playback devices, an audio playback device that is installed at a relatively far distance from a specified location of the receiving station as the audio playback device that will play back the audio received by the receiving unit, the larger the difference is.
3. The output device of claim 1, wherein the determination unit, when the time at which the audio is received by the receiving unit is later than the time at which the video is received by the receiving unit, determines, among the plurality of audio playback devices, the audio playback device that is installed closest to a specified location at the receiving site as the audio playback device that will play back the audio received by the receiving unit.
4. The output device of claim 2, wherein the determination unit, when the time at which the video is received by the receiving unit is later than the time at which the audio is received by the receiving unit, calculates a time by subtracting from the difference the processing time from when the audio is received by the receiving unit to when the audio is output to the determined audio playback device and adding to the difference the processing time from when the video is received by the receiving unit to when the video is output to a video playback device, and the longer the calculated time, the more likely it is to determine that an audio playback device among the multiple audio playback devices that is installed at a relatively far distance from a specified location at the receiving site is the audio playback device that will play back the audio received by the receiving unit.
5. A method performed by an output device, comprising: receiving, by a receiving unit of the output device, video and audio transmitted from a plurality of synchronized video and audio transmission points; and determining, by a determination unit of the output device, an audio playback device that plays back the audio received by the receiving unit, from among a plurality of audio playback devices installed at the video and audio receiving point, based on the difference between the time the video was received by the receiving unit and the time the audio was received by the receiving unit.
6. The output method of claim 5, wherein the determination unit, when the time at which the video is received by the receiving unit is later than the time at which the audio is received by the receiving unit, determines, among the plurality of audio playback devices, an audio playback device that is installed at a relatively far distance from a specified location of the receiving site as the audio playback device that will play back the audio received by the receiving unit, the larger the difference is.
7. The output method described in claim 5, wherein the determination unit, when the time at which the audio is received by the receiving unit is later than the time at which the video is received by the receiving unit, determines, among the plurality of audio playback devices, the audio playback device that is installed closest to a specified location at the receiving site as the audio playback device that will play back the audio received by the receiving unit.
8. An output processing program that causes a processor to function as each part of the output device according to any one of claims 1 to 4.
Citation Information
Patent Citations
Data distribution system and relay device
JP2012161088A
Distribution system and terminal management system
JP2015079480A
Reception terminal and program
JP2018074480A
Synchronization control device, synchronization control method, and synchronization control program
WO2021250861A1
Video communication system, video communication method, video transmission device, video reception device, and program
WO2022123774A1
