Server device, transmission method, and computer program

The server device addresses the challenge of managing processing load in real-time video production by implementing a tailored delay transmission method, ensuring efficient and high-quality video production with minimal delay and distortion.

JP2025074624APending Publication Date: 2025-05-14PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023185571
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-30
Publication Date
2025-05-14

AI Technical Summary

Technical Problem

Existing technologies for real-time video production face challenges in managing processing load due to the need to transmit multiple content streams, which can lead to increased delay times and potential distortion of video or sound.

Method used

A server device configured with an arithmetic circuit and storage device that streams and receives information, allowing for sequential transmission with tailored delay times. The device accepts information through streaming, starts transmitting to one device after a first predetermined timing, and to another device after a second, longer timing, ensuring the first time is shorter than the second.

Benefits of technology

This configuration enables the server device to transmit information with delay times tailored to specific purposes, allowing for high-quality video production with minimal delay and reduced risk of video or sound distortion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025074624000001_ABST
    Figure 2025074624000001_ABST
Patent Text Reader

Abstract

To provide a server device capable of transmitting information with a delay time that suits the purpose, a transmission method, and a computer program.SOLUTION: The server device that streaming-receives information and sequentially transmits information includes: an arithmetic circuit; and a storage device for storing information. The arithmetic circuit is configured to receive the first information that is streaming-received and starts transmission of the first information to first device after a first time from a predetermined timing, and after a second time from the predetermined timing, start transmission of the first information to a second device different from the first device, in which the first time is shorter than the second time.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a server device, a transmission method, and a computer program. [Background technology]

[0002] Conventionally, technology for improving quality in real-time video production when the shooting site and the production site are separate has been considered. For example, Patent Document 1 discloses a system that transmits high-resolution content to end users and low-resolution content to video producers, thereby suppressing the amount of video data and shortening the time until the video is displayed to the producer, thereby reducing delays in real-time video production. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-509646 A Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses a technology that can reduce the amount of video data and shorten the time it takes for the video to be displayed on the production site by sending low-resolution content. However, since multiple contents for transmission must be created on the shooting site, this can increase the processing load.

[0005] An object of the present disclosure is to provide a server device, a transmission method, and a computer program capable of transmitting information with a delay time suited to the purpose. [Means for solving the problem]

[0006] A server device according to one embodiment of the present disclosure is a server device that receives information via streaming and transmits the information sequentially, and is equipped with an arithmetic circuit and a storage device that stores the information, wherein the arithmetic circuit is configured to accept first information received via streaming, start transmitting the first information to a first device a first time after a predetermined timing, and start transmitting the first information to a second device different from the first device a second time after the predetermined timing, and wherein the first time is shorter than the second time. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a server device, a transmission method, and a computer program capable of transmitting information with a delay time suited to a purpose. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a configuration of a distribution system according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of a production system according to an embodiment; [Diagram 3] FIG. 1 is a block diagram showing a schematic configuration of a production device according to an embodiment; [Figure 4] FIG. 1 is a block diagram showing a schematic functional configuration of a production device according to an embodiment; [Diagram 5] 1 is a timing chart showing an example of data transmission and reception timing of each device in a distribution system according to an embodiment; [Figure 6] 10 is a timing chart showing another example of data transmission and reception timing by each device in the distribution system according to the embodiment; [Figure 7] A flowchart showing a transmission process of a production device according to an embodiment. [Figure 8] FIG. 13 is a block diagram showing a schematic configuration of a production system according to another embodiment. [Figure 9] FIG. 13 is a block diagram showing a schematic functional configuration of a production device according to another embodiment. [Figure 10]A timing chart showing an example of timing of data transmission and reception by each device in a distribution system according to another embodiment. [Figure 11] A flowchart showing a transmission process of a production device according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. However, the configuration described below is merely an example of the present disclosure, and the present disclosure is not limited to the following embodiment. The technology in the present disclosure is not limited to this, and various modifications, substitutions, additions, omissions, etc. are possible depending on the design, etc., even if it is other than these embodiments, as long as it does not deviate from the technical idea of ​​the present disclosure.

[0010] Although the present disclosure has been fully described in connection with the preferred embodiments with reference to the accompanying drawings, various changes and modifications will be apparent to those skilled in the art, and such changes and modifications should be understood to be included within the scope of the present disclosure as defined by the appended claims unless they depart therefrom.

[0011] A video to be distributed via broadcast or the Internet may be created at a production site. The video to be distributed may be created based on a video shot at a filming site. The filming site and the production site may be physically separate environments. A user at the production site can remotely operate a camera installed at the filming site to change the orientation and angle of view of the camera.

[0012] When the shooting site and the production site are far apart, it is necessary to transmit the shot video from the shooting site to the production site, so there may be a difference between the time when the video is shot at the shooting site, the time when the shot video is viewed at the production site, and the time when the distribution video is created. In other words, there may be a delay between the time when the shot video is viewed at the production site and the time when the video is shot at the shooting site. When a distribution video is created in real time based on the shot video and the distribution video is distributed in real time, the difference may cause the video that the user at the shooting site wants to be shot.

[0013] For example, when the server device according to the present disclosure starts receiving streaming video, it starts transmitting the video or a distribution video created based on the video to two different devices at two different timings. The two different timings include a first time when the reception of packets related to streaming reception may not be completed, and a second time longer than the first time when the streaming reception is assumed to be completed. The server device displays the shot video on a display device for a user at the production site to view the video, one hour after the predetermined timing. The user at the production site can operate the shooting device with a small delay by viewing the shot video on the display device and operating the shooting device. In addition, the server device creates a distribution video, two hours after the predetermined timing, and transmits the distribution video to a device for distributing the distribution video. Since the distribution video is created after the second hour, the distribution video is less likely to be distorted in image or sound. According to the server device configured in this way, the user can produce high-quality video while operating the shooting device at the shooting site with a small delay. Therefore, the server device according to the present disclosure can transmit information with a delay time suited to the purpose.

[0014] (Embodiment 1) [composition] <Distribution system> Fig. 1 is a schematic diagram showing a configuration of a distribution system 1 according to the first embodiment of the present disclosure. As shown in Fig. 1, in the distribution system 1 according to the present disclosure, a first image capture device 10, a second image capture device 10, and a production system 20 are connected via the Internet 5. The Internet 5 is an example of a network. Hereinafter, when there is no need to distinguish between the first image capture device 10 and the second image capture device 10, they will be collectively referred to as the image capture device 10.

[0015] <Photographic equipment> The image capturing device 10 is, for example, a camera connectable to the Internet 5. In this embodiment, the image capturing device 10 is a pan-tilt-zoom (PTZ) camera controlled by the production system 20. In this embodiment, the image capturing device 10 includes an arithmetic circuit, a storage device, a communication circuit, an image capturing element, and an audio capturing device. The image capturing device 10 can capture video, i.e., moving images, through the image capturing element. The image capturing element is, for example, a CCD or CMOS. The image capturing device 10 can capture sound through the audio capturing device. The audio capturing device is, for example, a microphone.

[0016] The arithmetic circuit may be configured similarly to the arithmetic circuit 31 of the production device 21, which will be described later with reference to FIG. 3. The arithmetic circuit stores the acquired video and sound in a storage device. The storage device is configured similarly to the storage device 32 of the production device 21, which will be described later. The communication circuit may be configured similarly to the communication circuit 33 of the production device 21, which will be described later. The arithmetic circuit of the image capture device 10 streams the video and sound to the production system 20 via the input / output interface device of the image capture device 10. The image capture device 10 may be configured to stream only the video or only the sound.

[0017] <Production System> FIG. 2 is a block diagram showing a schematic configuration of the production system 20 according to the first embodiment. As shown in FIG. 2, the production system 20 according to the first embodiment includes a production device 21, a first operation device 22 and a second operation device 22, a first operation display device 23 and a second operation display device 23, a distribution data display device 24, a distribution device 25, and a storage device 26. The production device 21 is connected to the operation device 22, the operation display device 23, the distribution data display device 24, the distribution device 25, and the storage device 26. Hereinafter, when it is not necessary to distinguish between the first operation device 22 and the second operation device 22, they will be collectively referred to as the operation device 22. When it is not necessary to distinguish between the first operation display device 23 and the second operation display device 23, they will be collectively referred to as the operation display device 23. In this embodiment, the production system 20 includes two operation devices 22 and two operation display devices 23, but is not limited thereto. For example, the production system 20 may include an operation device 22 and an operation display device 23 for each of the imaging devices 10. Furthermore, the production system 20 may include one operation device 22 and one operation display device 23 regardless of the number of the image capturing devices 10.

[0018] <Production equipment> 3 is a block diagram showing a schematic configuration of the production device 21 according to the embodiment 1. The production device 21 is an example of a server device. As shown in FIG. 3, the production device 21 includes an arithmetic circuit 31, a storage device 32, and a communication circuit 33.

[0019] The arithmetic circuit 31 controls the overall operation of the production device 21. The arithmetic circuit 31 is an example of a control unit of the production device 21 according to the present disclosure. The arithmetic circuit 31 may be either a configuration in which hardware resources and software work together to realize a predetermined function, or a configuration in which a dedicated hardware circuit is used to realize a predetermined function.

[0020] As an example of the former, the arithmetic circuit 31 includes a general-purpose processor such as a CPU or MPU that executes a program to realize a predetermined process or function. The arithmetic circuit 31 is configured to be able to communicate with the storage device 32. The arithmetic circuit 31 reads out and executes an arithmetic program or the like stored in the storage device 32 to realize various functions of the production device 21. As an example of the latter, the arithmetic circuit 31 includes an FPGA or an ASIC. As can be understood from the above, the arithmetic circuit 31 can be realized using a semiconductor integrated circuit such as a CPU, an MPU, a GPU, an FPGA, a DSP, or an ASIC.

[0021] The storage device 32 is a storage medium capable of storing various information. The information includes programs and data. For example, the storage device 32 stores an arithmetic program for implementing various functions according to the present embodiment. The storage device 32 is implemented, for example, by a volatile or non-volatile semiconductor memory such as a DRAM, an SRAM, or a flash memory, an SSD, an HDD, or other storage devices, or an appropriate combination thereof.

[0022] The communication circuit 33 is an interface device for connecting to other devices or systems via a communication line, either wired or wirelessly. The interface device is capable of performing communication in accordance with a wired communication standard, such as USB (registered trademark) or Ethernet (registered trademark). The interface device is also capable of performing communication in accordance with a wireless communication standard, such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or a mobile phone line.

[0023] The server device 21 may include an input / output device. The input / output device has a function as an input device for inputting information from a user and an output device for outputting information to a user. The input / output device includes one or more human-machine interface devices. The human-machine interface devices include, for example, input devices such as a keyboard, a pointing device (mouse, trackball, etc.), and a touchpad, output devices such as a display and a speaker, and input / output devices such as a touch panel.

[0024] In this embodiment, the production device 21 is connected to the first and second camera devices 10, the first and second operation devices 22, the first and second operation display devices 23, the distribution device 25, and the storage device 26 via a communication circuit 33.

[0025] 4 is a block diagram showing a schematic functional configuration of the arithmetic circuit 31 according to the first embodiment. The arithmetic circuit 31 has a first receiving unit 41 and a second receiving unit 41, a first reading unit 42 and a second reading unit 42, a first operation output unit 43 and a second operation output unit 43, a synthesis adjustment unit 44, a distribution data output unit 45, a distribution output unit 46, and a storage output unit 47. Hereinafter, when it is not necessary to distinguish between the first receiving unit 41 and the second receiving unit 41, they will be collectively referred to as a receiving unit 41. When it is not necessary to distinguish between the first reading unit 42 and the second reading unit 42, they will be collectively referred to as a reading unit 42. When it is not necessary to distinguish between the first operation output unit 43 and the second operation output unit 43, they will be collectively referred to as an operation output unit 43.

[0026] The receiving unit 41 has a function of receiving the photographing data streamed from the photographing device 10 via the communication circuit 33. Furthermore, the receiving unit 41 has a function of storing the received data in the storage device 32 in sequence upon receiving the data.

[0027] The readout unit 42 has a function of sequentially reading out the photographic data stored in the storage device 32 after a predetermined time has elapsed. In this embodiment, the readout unit 42 has a function of reading out the photographic data after a first time has elapsed from the predetermined timing, and outputting the photographic data to the operation output unit 43. The readout unit 42 also has a function of reading out the photographic data after a second time has elapsed from the predetermined timing, and outputting the photographic data to the synthesis adjustment unit 44. The predetermined timing, the first time, and the second time will be described in detail later.

[0028] The operation output unit 43 has a function of transmitting the data received from the read-out unit 42 to the operation display device 23 via the communication circuit 33 .

[0029] The synthesis adjustment unit 44 has a function of synchronizing the multiple shooting data received from the multiple reading units 42 to synthesize the images and adjust the sound. Synthesizing the images includes combining the multiple shooting data and converting them into data capable of expressing an image including at least one of the multiple images. Adjusting the sound includes, for example, combining the multiple shooting data and converting them into data capable of emitting a sound including at least one sound corresponding to a frame of the image included in the shooting data, which was acquired together with the image. Hereinafter, the data created by the synthesis adjustment unit 44 is referred to as distribution data. The distribution data is an example of third information.

[0030] In this embodiment, the synthesis adjustment unit 44 has a function of outputting the distribution data to the distribution data output unit 45. Furthermore, the synthesis adjustment unit 44 has a function of outputting the distribution data to the distribution output unit 46 and the storage output unit 47. When the synthesis adjustment unit 44 acquires one piece of shooting data, the synthesis adjustment unit 44 may output the shooting data as distribution data. Outputting one piece of shooting data or combining multiple pieces of shooting data as distribution data may include adding any information such as characters or figures to the shooting data and outputting it as distribution data.

[0031] The distribution data output unit 45 has a function of transmitting the distribution data received from the synthesis adjustment unit 44 to the distribution data display device 24 via the communication circuit 33.

[0032] The distribution output unit 46 has a function of transmitting the distribution data received from the synthesis adjustment unit 44 to the distribution device 25 via the communication circuit 33.

[0033] The storage output unit 47 has a function of transmitting the distribution data received from the synthesis adjustment unit 44 to the storage device 26 via the communication circuit 33 .

[0034] In the production device 21 according to this embodiment, the arithmetic circuit 31 may operate as a set in which the first receiving unit 41, the first readout unit 42, and the first operation output unit 43 execute a series of processes. The arithmetic circuit 31 may operate as a set in which the second receiving unit 41, the second readout unit 42, and the second operation output unit 43 execute a series of processes. As shown in FIG. 4, in this embodiment, the arithmetic circuit 31 has two sets of the receiving unit 41, the readout unit 42, and the operation output unit 43, but the number of sets is not limited to this. The number of sets may increase or decrease depending on the number of the imaging devices 10 connected.

[0035] <Operation device> 2 indicates an input device used by a user of the production system 20 to transmit a control signal for operating the image capture device 10. Upon receiving an operation by the user, the operation device 22 transmits the control signal to the image capture device 10 via the production device 21. Upon receiving the control signal, the image capture device 10 changes the pan, tilt, and zoom. In this way, the user of the production system 20 can change the orientation and angle of view of the image capture device 10 by operating the operation device 22, thereby adjusting the image captured by the image capture device 10.

[0036] <Operation display device> The operation display device 23 is, for example, a display that displays an image used by a user to operate the operation device 22. The shooting data displayed on the operation display device 23 is used by a user of the production system 20. As will be described in detail later, the operation display device 23 displays the shooting data with a delay time that is smaller than the display on the distribution data display device 24 with respect to the shooting time by the shooting device 10.

[0037] <Distribution data display device> The distribution data display device 24 is, for example, a display that displays the distribution data created by the synthesis adjustment unit 44. Upon receiving the distribution data from the production device 21, the distribution data display device 24 displays the distribution data.

[0038] <Distribution device> The distribution device 25 is, for example, a server device that transmits distribution data by streaming over the Internet 5 via a wired or wireless communication line. The distribution device 25 includes, for example, an arithmetic circuit, a storage device, and a communication circuit similar to the production device 21. The arithmetic circuit, the storage device, and the communication circuit may be configured similarly to the arithmetic circuit 31, the storage device 32, and the communication circuit 33. The arithmetic circuit of the distribution device 25 can transmit the received distribution data by streaming via the communication circuit by IP communication. The distribution device 25 may be a device that broadcasts distribution data received by terrestrial broadcasting, cable broadcasting, satellite broadcasting, or the like.

[0039] <Storage device> The storage device 26 is a storage medium capable of storing various information, including distribution data. The storage device 26 may be configured similarly to the storage device 32.

[0040] [Operation] Hereinafter, the distribution process of the distribution system 1 according to the first embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a timing chart showing an example of the timing of data transmission and reception by each device in the distribution system 1 according to the first embodiment. Specifically, Fig. 5 shows a timing chart of an example of a process of transmitting captured data received from one image capturing device 10 to the operation display device 23. The horizontal axis of Fig. 5 indicates time. The vertical axis of Fig. 5 indicates the number of packets.

[0041] Line A in Fig. 5 indicates the cumulative number of packets of shooting data streamed from the shooting device 10 to the production device 21 and the timing at which each packet was streamed. As indicated by line A, the shooting device 10 transmits packets to the production device 21 at any timing. The any timing includes regular timing and irregular timing. The shooting device 10 can divide the shooting data into packets and transmit them sequentially toward the production device 21. A packet indicates a transmission unit of data streamed from the shooting device 10 to the production device 21.

[0042] Line B in FIG. 5 indicates the timing when the production device 21, that is, the receiving unit 41, receives the total number of packets of the received shooting data and each divided packet. As indicated by line B, the production device 21 receives packets transmitted from the shooting device 10 in various periods. In this embodiment, the shooting device 10 transmits the shooting data to the production device 21 through IP communication. Since communication through the Internet 5 is subject to delays due to various factors, the timing at which the packet reception is completed may vary relative to the timing at which the packet is transmitted. In the example shown in FIG. 5, for example, the period required to receive packets between Ta1 and Ta2 is shorter than the period required to receive packets between Ta3 and Ta4.

[0043] Line C in FIG. 5 indicates the timing when the readout unit 42 sequentially reads out the photographic data stored in the storage device 32 and outputs it to the operation output unit 43. The readout unit 42 is configured to start reading out the photographic data one hour after the predetermined timing and sequentially output it to the operation output unit 43. In FIG. 5, line C partially intersects with line B. This indicates that the process of the readout unit 42 reading out the photographic data is executed before the streaming reception of the photographic data is completed. In other words, this indicates that the readout unit 42 is reading out photographic data for which the reception of packets has not been completed. Hereinafter, photographic data read out by the readout unit 42 before the completion of the streaming reception is referred to as incompletely received data. Even if the calculation circuit 31 reads out incompletely received data, the calculation circuit 31 transmits the data to the operation display device 23 via the communication circuit 33.

[0044] Even if the data received from the production device 21 is incompletely received data, the operation display device 23 displays an image based on the data. For example, when displaying incompletely received data, the operation display device 23 can continue to display the image displayed before the incompletely received data. The operation display device 23 may display an image created by performing an interpolation process on the photographed data before the incompletely received data.

[0045] As described above, the user of the production system 20 operates the photographing device 10 based on the image displayed on the operation display device 23. Even if the image viewed by the user of the production system 20 is distorted, it is unlikely that a problem will occur. Therefore, the production system 20 according to this embodiment is configured so that the readout unit 42 starts reading out the photographed data a first time after a predetermined timing. The first time is the time from the predetermined timing to the time when it is estimated that reception of the photographed data has been completed. In addition, the first time is the time during which the photographed data read out by the readout unit 42 may become incompletely received data.

[0046] The arithmetic circuit 31 starts reading out the photographed data after the first time has elapsed from the predetermined timing, and sequentially transmits it to the operation display device 23. By operating in this manner, the arithmetic circuit 31 can display the photographed data on the operation display device 23 with a small delay time from the photographing time on the photographing device 10 compared to the display on the distribution data display device 24, although there is a possibility that the image or sound may be distorted. By configuring in this manner, the user of the production system 20 can visually recognize the photographed data with a small delay time from the photographing timing on the photographing device 10, and operate the operation device 22.

[0047] The predetermined timing is, for example, the time when streaming transmission of captured image data from the image capture device 10 is started. In other words, the predetermined timing is, for example, the time when the image capture device 10 transmits a streaming packet for the first time. Information regarding the time may be included in the captured image data transmitted from the image capture device 10. The first time is determined based on, for example, a network delay in IP communication. The network delay may include, for example, a propagation time and jitter in IP communication.

[0048] The arithmetic circuit 31 may measure, for example, a round time trip (RTT) in IP communication between the shooting device 10 and the production device 21, and may obtain the first time by multiplying the RTT by a certain coefficient. For example, when the operation of the distribution system 1 starts, the arithmetic circuit 31 can measure the RTT by performing IP communication between the shooting device 10 and the production device 21 on a trial basis using arbitrary data.

[0049] The arithmetic circuit 31 may measure the RTT for a certain period of time and set the maximum value of the measured RTT as the first time. The arithmetic circuit 31 may set the time input by the user as the first time.

[0050] The first time may be set to a predetermined period. The first time may be set to a period during which the user can control the image capturing apparatus 10 as intended when the user visually recognizes the image displayed on the operation display device 23 and then operates the operation device 22. Such a period may be determined, for example, as follows.

[0051] The timing of each process in the distribution system 1 according to the present embodiment can be classified, for example, as follows. T1: the time when the imaging device 10 transmits the imaging data. T2: The time when the production device 21 receives the shooting data. T3: the time when the production device 21 transmits the photographed data to the operation display device 23 (this time is substantially equal to the time when the operation display device 23 displays the photographed data). T4: The time when the operation device 22 transmits the control signal. T5: the time when the imaging device 10 receives the control signal. T6: the time when the imaging device 10 operates based on the control signal. T7: the time when the camera apparatus 10 transmits the captured image data after T6 (that is, the time when the captured image data captured after the PTZ operation of the camera apparatus 10 by the user is reflected is transmitted). T8: The time when the production device 21 receives the shooting data. T9: the time when the production device 21 transmits the shooting data to the operation display device 23.

[0052] Time points T1 to T9 are arranged in chronological order. Note that time points T1 to T9 are illustrated in FIG. 5 as an example. The first time may be determined based on the period from time point T3 to time point T9. For example, when the operation of the distribution system 1 starts, the calculation circuit 31 can determine the first time by experimentally transmitting and receiving captured data between the imaging device 10 and the production device 21. For example, the first time may be determined as shown in the following formula (1). That is, the first time may be determined by subtracting the period from time point T5 to time point T6 from the period from time point T3 to time point T9, and by determining the period as half the value after the subtraction. Also, the first time may be determined more simply as T5=T6 without considering time points T5 and T6. 1st hour=((T9-T3)-(T6-T5)) / 2 (1)

[0053] The predetermined timing may be a time calculated from a plurality of values ​​obtained by performing a trial transmission and reception of shooting data between the shooting device 10 and the production device 21 and obtaining the time indicated by the above formula (1). The first time may be, for example, an average value of the times obtained a plurality of times. The predetermined timing may also be the time when the production device 21 first receives a streaming packet. In this case, the first time may be determined as shown in the following formula (2). In other words, the first time may be determined as the period calculated by the above formula (1) minus the period from time T7 to time T8. 1st time=((T9-T3)-(T6-T5)) / 2-(T8-T7) (2)

[0054] Fig. 6 is a timing chart showing another example of the timing of data transmission and reception by each device in the distribution system 1 according to the first embodiment. Specifically, Fig. 6 shows a timing chart of an example of a process in which the production device 21 transmits the shooting data received from the first camera device 10 to the first operation display device 23, and transmits the shooting data received from the second camera device 10 to the second operation display device 23. Fig. 6 also shows a timing chart of an example of a process in which the production device 21 transmits distribution data created based on each shooting data to the distribution data display device 24, etc. The horizontal axis of Fig. 6 indicates time. The vertical axis of Fig. 6 indicates the number of packets.

[0055] Line A1 in Fig. 6 indicates the total number of packets of shooting data streamed from the first camera device 10 to the production device 21 and the timing at which each packet was streamed. Line A2 indicates the total number of packets of shooting data streamed from the second camera device 10 to the production device 21 and the timing at which each packet was streamed. Lines A1 and A2 each correspond to line A in Fig. 5. Time point t1 indicates an example of a predetermined timing. Specifically, time point t1 indicates the time at which streaming transmission of shooting data from each camera device 10 started.

[0056] 6, for the sake of clarity, the lines A1 and A2 are illustrated so as not to overlap with each other. However, in the first embodiment, at least the time when the streaming transmission of the captured image data from the first image capture device 10 starts is the same as the time when the streaming transmission of the captured image data from the second image capture device 10 starts.

[0057] Line B1 in Fig. 6 indicates the timing of receiving the total number of packets of imaging data received by the production device 21 and each divided packet, regarding the imaging data streamed from the first imaging device 10. Line B2 indicates the timing of receiving the total number of packets of imaging data received by the production device 21 and each divided packet, regarding the imaging data streamed from the second imaging device 10. Lines B1 and B2 each correspond to line B in Fig. 6.

[0058] A line C1 shown in Fig. 6 indicates the timing at which the first readout unit 42 sequentially reads out the imaging data received via streaming from the first imaging device 10 one hour after the predetermined timing and outputs it to the first operation output unit 43. A line C2 shown in Fig. 6 indicates the timing at which the second readout unit 42 sequentially reads out the imaging data received via streaming from the second imaging device 10 one hour after the predetermined timing and outputs it to the second operation output unit 43. Lines C1 and C2 correspond to line C in Fig. 5. Time point t2 indicates an example of the timing one hour after time point t1.

[0059] Line D in FIG. 6 indicates the timing when each readout unit 42 sequentially reads out each piece of photographic data and outputs it to the synthesis adjustment unit 44. The readout unit 42 is configured to start reading out the photographic data a second time after a predetermined timing and sequentially output it to the synthesis adjustment unit 44. In FIG. 6, line B1 and line B2 do not intersect with line D. This indicates that in this example, the process of the readout unit 42 reading out photographic data at all timings is executed after streaming reception of the photographic data is completed. In other words, this indicates that the readout unit 42 is reading out photographic data for which packet reception has been completed. Time point t3 indicates an example of the timing two hours after time point t1.

[0060] In this embodiment, the photographic data sequentially output to the synthesis adjustment unit 44 is then sequentially distributed through the distribution device 25. It is desirable that the distributed data is free of image and sound disturbances. Therefore, the production system 20 according to this embodiment is configured to set a second time period such that the photographic data read by the reading unit 42 does not become incompletely received data, and to have the reading unit 42 start reading the photographic data the second time period after a predetermined timing. By configuring in this manner, the production system 20 can distribute data with no image or sound disturbances.

[0061] The second time is, for example, the first time plus a retransmission wait time and a synchronization wait time in IP communication. Therefore, the first time is shorter than the second time.

[0062] When multiple image capture devices 10 are connected to the production device 21, the production device 21 receives image capture data from each of the multiple image capture devices 10. The multiple image capture data may be out of sync. For example, the multiple image capture data may be out of sync in frames. By adding a time that takes into account the frame lag to the first time, the arithmetic circuit 31 can create distribution data in which the multiple image capture data are synchronized in time. For example, when the image capture data is 60 fps, the arithmetic circuit 31 may add 16.6 ms to the first time as a synchronization wait time to set the second time.

[0063] In addition, since packet loss may occur in IP communication, packets may be resent using techniques such as automatic repeat request (ARQ). By adding the time required for resending packets to the first time, the arithmetic circuit 31 is more likely to transmit captured image data to the distribution device 25 or the like without including incompletely received data. For example, in order to set the second time, the arithmetic circuit 31 may add several hundred ms to the first time as a resend wait time.

[0064] In this way, by setting the second time period longer than the first time period, the arithmetic circuit 31 can distribute captured image data with a low possibility of image or sound distortion.

[0065] In the present embodiment, each readout unit 42 starts reading out a plurality of pieces of shooting data one hour after a predetermined timing, and sequentially outputs the plurality of pieces of shooting data to each operation output unit 43, but is not limited to this. For example, the first readout unit 42 may be configured to start reading out the shooting data acquired from the first photographing device 10 one hour after a predetermined timing, and the second readout unit 42 may be configured to start reading out the shooting data acquired from the second photographing device 10 three hours after the predetermined timing.

[0066] In the present embodiment, the predetermined timing for the image data captured by each image capture device 10 is the same, but the predetermined timing is not limited to this. The predetermined timing may be different for each image capture data captured by each image capture device 10. In other words, the predetermined timing may include a plurality of predetermined timings, such as a first predetermined timing and a second predetermined timing. For example, the first predetermined timing may be the time when streaming transmission of the image data from the first image capture device 10 starts, and the second predetermined timing may be the time when streaming transmission of the image data from the second image capture device 10 starts.

[0067] For example, the first readout unit 42 may start reading the imaging data a first hour after the time when streaming transmission of the imaging data from the first camera device 10 starts. Also, the second readout unit 42 may start reading the imaging data a third hour after the time when streaming transmission of the imaging data from the second camera device 10 starts. The third time may be determined based on a network delay in IP communication between the second camera device 10 and the production device 21, similar to the first time. The third time may be shorter than the second time, similar to the first time. The third time may be the same as the first time. Also, the third time may be longer than the first time.

[0068] 7 is a flowchart showing the transmission process of the production device 21 according to embodiment 1. When the image capture device 10 starts streaming transmission of captured data via the Internet 5, the production device 21 starts the following process.

[0069] The arithmetic circuit 31 of the production device 21 starts to receive streaming image data from each of the image capture devices 10 (S11). Then, the arithmetic circuit 31 sequentially stores each of the received image capture data in the storage device 32 (S12).

[0070] Next, the arithmetic circuit 31 judges whether or not a first time has elapsed from a reference time, that is, a predetermined timing (S13). The reference time is, for example, the time when the image capture device 10 starts streaming transmission of the captured data. The reference time is not limited to this, and may be the time when the production device 21 first receives a streaming packet.

[0071] If it is determined that the first time has not elapsed since the reference time (S13: NO), the arithmetic circuit 31 returns to step S13. If it is determined that the first time has elapsed since the reference time (S13: YES), the arithmetic circuit 31 starts transmitting each piece of photographing data stored in the storage device 32 to each operation display device 23 via the communication circuit 33 (S14). When the operation display device 23 receives the photographing data in sequence, it displays the photographing data in sequence.

[0072] The user of the production system 20 operates the operation device 22 based on the displayed shooting data. The operation device 22 transmits a control signal according to the user's operation to the production device 21. The production device 21 transmits the received control signal to the image capture device 10. Upon receiving the control signal, the image capture device 10 operates based on the signal. For example, the image capture device 10 pans, tilts, or zooms based on the control signal. In this way, the user of the production system 20 can control the image capture device 10 based on the displayed shooting data.

[0073] The arithmetic circuit 31 also determines whether a second time has passed since the reference time (S15). If it is determined that the second time has not passed since the reference time (S15: NO), the arithmetic circuit 31 returns to step S15. If it is determined that the second time has passed since the reference time (S15: YES), the arithmetic circuit 31 starts outputting each piece of shooting data by the readout unit 42, and starts creating distribution data by the synthesis adjustment unit 44 (S16).

[0074] Then, the arithmetic circuit 31 starts transmitting the created distribution data to the distribution data display device 24, the distribution device 25, and the storage device 26 (S17). For example, the distribution device 25 sequentially receives the distribution data and sequentially distributes the distribution data. The arithmetic circuit 31 ends the streaming reception and ends the process when the transmission of all the received data is completed.

[0075] [effect] According to the server device 21 according to the first embodiment, the following effects can be achieved.

[0076] The server device 21 according to the embodiment of the present disclosure is a server device 21 that receives information by streaming and transmits the information sequentially. The server device 21 includes an arithmetic circuit 31 and a storage device 32 that stores information. The arithmetic circuit 31 is configured to accept first information received by streaming and start transmitting the first information to the first device 23 a first time after a predetermined timing. The arithmetic circuit 31 is configured to start transmitting the first information to second devices 24, 25, 26 different from the first device 23 a second time after the predetermined timing. The first time is shorter than the second time.

[0077] According to such a configuration, when the information is an image, the server device 21 can display the image on the display device 23 with a small delay time, although there is a possibility that the image will be distorted. Also, the server device 21 can display an image on the display device 24, etc., which has a large delay time but is unlikely to cause the image to be distorted. Therefore, the server device 21 can transmit information with a delay time suited to the purpose. This allows the user of the server device 21 to operate the imaging device 10 that is capturing the image based on the image with a small delay time, thereby improving the quality of remote image creation.

[0078] Moreover, in the server device 21, the arithmetic circuit 31 is configured to receive second information different from the first information received by streaming, and start transmitting the second information to the third device 23 different from the first device 23 and the second devices 24, 25, 26 after a third time from a predetermined timing. The arithmetic circuit 31 is configured to start transmitting third information created based on the first information and the second information to the second devices 24, 25, 26 after a second time from a predetermined timing, instead of transmitting the first information. The third time is the same as the first time or is longer than the first time and shorter than the second time. With this configuration, even if there are multiple images, the server device 21 can display each image on the multiple display devices 23 with a small delay time, although there is a possibility that each image will be distorted. Furthermore, the server device 21 can display images on the display devices 24, etc., with a large delay time, while synchronizing the images and with a low possibility of image distorting.

[0079] Moreover, in the server device 21, the third time is the same as the first time. With this configuration, the arithmetic circuit 31 does not need to determine the first time for each image capturing device 10. Therefore, the server device 21 can execute the transmission process with a low load.

[0080] Furthermore, in server device 21, the first information includes video information. With this configuration, server device 21 can cause first device 23 to display a video.

[0081] Furthermore, in server device 21, the predetermined timing is the time when streaming transmission of the first information is started. According to this configuration, server device 21 can transmit information to first device 23 after a predetermined time has elapsed from the time when streaming transmission is started, and can cause first device 23 to notify the user of the first information.

[0082] Furthermore, the server device 21 receives information in a streaming manner through IP communication. With this configuration, the server device 21 can receive information acquired by a specific device in a streaming manner through the Internet 5. Even if the image capturing device 10 or the like is located in a remote location, the server device 21 can receive information and display the information on the first device 23, the second device 24, or the like with a plurality of delay times according to the purpose.

[0083] Furthermore, in the server device 21, the arithmetic circuit 31 is configured to sequentially transmit the first information to the first device 23 after a first time even if the packet reception of the first information is incomplete. With such a configuration, the server device 21 can notify the first device 23 of the first information with a small delay. Although the first device 23 may notify incomplete information, the user can perform a predetermined operation with a small delay based on the incomplete information.

[0084] Moreover, in server device 21, the first time is determined based on the propagation time and transmission jitter of IP communication. With such a configuration, the possibility that server device 21 will transmit the first information for which packet reception has been completed to first device 23 can be improved. Therefore, server device 21 can cause first device 23 to notify the user of information that is likely to be not incomplete with a smaller delay time compared to transmission to second device 24.

[0085] Furthermore, in server device 21, the second time is determined based on the time of a packet retransmission request in addition to the first time. With such a configuration, the possibility that server device 21 will transmit the first information of which packet reception has been completed to second device 24, etc. can be improved. Therefore, server device 21 can transmit information that is assumed to be not incomplete to second device 24, etc.

[0086] The server device 21 can also receive the first information including the video information from the photographing device 10 by streaming. The arithmetic circuit 31 is configured to receive a control signal for operating the photographing device 10 from the operation device 22 and transmit the control signal to the photographing device 10. With this configuration, the server device 21 can receive the video acquired by the photographing device 10 by streaming as the first information. The server device 21 causes the first device 23 to display the video after a first time has elapsed from a predetermined timing. Since the user can operate the photographing device 10 based on the video notified from the first device 23, the server device 21 can reduce the time between the timing of photographing by the photographing device 10 and the timing of the user's control of the operation device 22. Therefore, the server device 21 allows the user to control the photographing device 10 at a more appropriate timing.

[0087] The transmission method according to this embodiment is executed by an arithmetic circuit 31 that can access a storage device 32 that stores information received by streaming. The transmission method includes accepting first information received by streaming, and starting transmission of the first information to first device 23 a first time after a predetermined timing. The transmission method also includes starting transmission of the first information to second devices 24, 25, 26 different from first device 23 a second time after the predetermined timing. The first time is shorter than the second time.

[0088] The computer program according to this embodiment can cause the arithmetic circuit 31 to execute the above-mentioned transmission method.

[0089] (Embodiment 2) An overview of a distribution system 1 in the second embodiment will be described. In the second embodiment, differences from the first embodiment will be mainly described. In the second embodiment, configurations that are the same as or equivalent to those in the first embodiment will be described with the same reference numerals. Also, in the second embodiment, descriptions that overlap with those in the first embodiment may be omitted. In the distribution system 1 according to the second embodiment, the production device 21 further includes a multi-view display device 27 that simultaneously displays images of multiple shooting data.

[0090] [composition] Fig. 8 is a block diagram showing a schematic configuration of a production system 20 according to embodiment 2. As shown in Fig. 8, the production system 20 according to embodiment 2 further includes a multi-view display device 27 in addition to the components of the production system 20 according to embodiment 1.

[0091] <Multi-view display device> The multi-view display device 27 is a display that simultaneously displays images of multiple pieces of shooting data. The production device 21 creates multi-view data by synthesizing the multiple pieces of shooting data received from the first camera device 10 and the second camera device 10, and transmits the multi-view data to the multi-view display device 27. The multi-view display device 27 displays the multi-view data received from the production device 21. Details of the multi-view data will be described later.

[0092] Fig. 9 is a block diagram showing a schematic functional configuration of the arithmetic circuit 31 according to embodiment 2. As shown in Fig. 9, the arithmetic circuit 31 according to embodiment 2 further includes a multiview synthesis unit 48 and a multiview output unit 49 in addition to the components of the arithmetic circuit 31 according to embodiment 1.

[0093] In the arithmetic circuit 31 according to the second embodiment, the readout unit 42 has a function of reading out the imaging data stored in the storage device 32 after a fourth time has elapsed from a predetermined timing, and outputting the data to the multi-view synthesis unit 48. The fourth time will be described later in detail.

[0094] The multiview synthesis unit 48 has a function of synthesizing the data received from the multiple readout units 42 to synthesize the video. Hereinafter, the data created by the multiview synthesis unit 48 is referred to as multiview data. The multiview synthesis unit 48 has a function of outputting the multiview data to the multiview output unit 49.

[0095] As described above, the multi-view data is created based on a plurality of pieces of shooting data. The multi-view data is video data created so that a plurality of pieces of shooting data are simultaneously displayed. The multi-view synthesis unit 48 may configure the video data so that the plurality of pieces of shooting data have the same display area. The multi-view synthesis unit 48 may configure the video data so that some of the plurality of pieces of shooting data have a larger display area than the other pieces of shooting data.

[0096] The multi-view output unit 49 has a function of transmitting the multi-view data received from the multi-view synthesis unit 48 to the multi-view display device 27 via the communication circuit 33 .

[0097] [Operation] Hereinafter, the distribution process of the distribution system 1 according to the second embodiment will be described with reference to Fig. 10. Fig. 10 is a timing chart showing an example of the timing of data transmission and reception by each device in the distribution system 1 according to the second embodiment. Specifically, Fig. 10 shows a timing chart that further includes an example of a process of transmitting multi-view data created by the production device 21 based on each piece of shooting data to the multi-view display device 27, in addition to the timing chart shown in Fig. 6. The horizontal axis of Fig. 10 indicates time. The vertical axis of Fig. 10 indicates the number of packets.

[0098] The lines a1 and a2 correspond to the lines A1 and A2 in Fig. 6, respectively. The lines b1 and b2 correspond to the lines B1 and B2 in Fig. 6, respectively. The lines c1 and c2 correspond to the lines C1 and C2 in Fig. 6, respectively. The line d corresponds to the line D in Fig. 6.

[0099] The line e shown in FIG. 10 indicates the timing when the readout unit 42 reads out each piece of shooting data and outputs it to the multi-view synthesis unit 48. The readout unit 42 starts reading out each piece of shooting data four hours after the predetermined timing, and sequentially outputs it to the multi-view synthesis unit 48. In FIG. 10, the line e partially intersects with the line b2. Therefore, in the example shown in FIG. 10, the shooting data output to the multi-view synthesis unit 48 includes incomplete reception data. Even if the shooting data includes incomplete reception data, the multi-view synthesis unit 48 creates multi-view data based on the acquired shooting data and outputs it to the multi-view output unit 49. In this way, even if the calculation circuit 31 reads out incomplete reception data, the calculation circuit 31 creates multi-view data based on the data and transmits the multi-view data to the multi-view display device 27 via the communication circuit 33. The multi-view data is an example of the fourth information. The time point t4 indicates the timing four hours after the predetermined timing.

[0100] The fourth time may be, for example, the longer of the first time and the third time. For example, when the first and second image capture devices 10 are synchronized in time, each image capture device 10 transmits image capture data to the production device 21 at the same time or almost the same time. In this case, the predetermined timing is the time when each image capture device 10 starts transmitting image capture data. Therefore, by setting the fourth time as the longer of the first and third times, the arithmetic circuit 31 can read out the image capture data at the timing when it is estimated that the image capture data transmitted from each image capture device 10 is being received. Therefore, the fourth time is the same as the first time or longer than the first time and shorter than the second time. By setting the fourth time as described above, the arithmetic circuit 31 can create multi-view data using the image capture data estimated to have been received.

[0101] For example, if the first and second image capturing devices 10 are not synchronized in time, the timings at which each image capturing device 10 starts transmitting image capturing data may differ. In this case, multiple predetermined timings may be set. Each of the multiple predetermined timings is the time at which each image capturing device 10 starts transmitting image capturing data.

[0102] For example, the first predetermined timing is the time when the first image capturing device 10 starts transmitting the captured image data, and the second predetermined timing is the time when the second image capturing device 10 starts transmitting the captured image data. In this case, for example, the arithmetic circuit 31 compares the time one hour after the first predetermined timing with the time three hours after the second predetermined timing, and determines which time is the later time. Hereinafter, the later time is referred to as the reception timing. The arithmetic circuit 31 also compares the first predetermined timing with the second predetermined timing, and determines which time is the earlier time.

[0103] The arithmetic circuit 31 may determine the time between the predetermined timing indicating the earlier time and the reception timing indicating the later time as the fourth time. In other words, the fourth time may be the time from the earliest of the plurality of predetermined timings to the time when it is estimated that reception of the photographed data from all of the photographing devices 10 has been completed.

[0104] As described above, when the first and second camera devices 10 are not synchronized in time, the multi-view synthesis unit 48 can synchronize multiple pieces of image data, synthesize the images, and adjust the sound. Therefore, even if the first and second camera devices 10 are not synchronized in time, the arithmetic circuit 31 can display the image data synchronized in time on the multi-view display device 27.

[0105] In this way, by setting the fourth time, the arithmetic circuit 31 can synchronize multiple pieces of shooting data and display the shooting data on the multi-view display device 27 with a smaller delay time than the display on the distribution data display device 24, although there is a possibility that the image or sound will be distorted.

[0106] 11 is a flowchart showing the transmission process of the production device 21 according to embodiment 2. When the image capture device 10 starts streaming transmission of captured data via the Internet 5, the production device 21 starts the following process.

[0107] The arithmetic circuit 31 of the production device 21 executes the same processes as steps S11 to S14 shown in FIG. 7 (S21 to S24).

[0108] Next, the arithmetic circuit 31 determines whether or not a fourth time has elapsed since the reference time (S25).

[0109] If it is determined that the fourth hour has not elapsed since the reference time (S25: NO), the arithmetic circuit 31 returns to step S25. If it is determined that the fourth hour has elapsed since the reference time (S25: YES), the arithmetic circuit 31 starts outputting each piece of shooting data from the readout unit 42 and starts creating multi-view data from the multi-view synthesis unit 48 (S26).

[0110] Then, the arithmetic circuit 31 starts transmitting the multi-view data to the multi-view display device 27 (S27).

[0111] Next, the arithmetic circuit 31 executes the same processes (S28 to S30) as steps S15 to S17 shown in Fig. 7. When the arithmetic circuit 31 ends streaming reception and finishes transmitting all the received data, it ends the process.

[0112] [effect] According to the server device 21 according to the second embodiment, the following effects can be achieved.

[0113] The server device 21 according to the embodiment of the present disclosure is a server device 21 that receives information by streaming and transmits the information sequentially. The server device 21 includes an arithmetic circuit 31 and a storage device 32 that stores information. The arithmetic circuit 31 is configured to receive first information received by streaming and start transmitting the first information to the first device 23 one hour after a predetermined timing. The arithmetic circuit 31 is also configured to receive second information received by streaming, which is different from the first information, and start transmitting the second information to the third device 23, which is different from the first device 23 and the second devices 24, 25, and 26, three hours after a predetermined timing. The arithmetic circuit 31 is configured to start transmitting third information created based on the first information and the second information to the second devices 24, 25, and 26 two hours after a predetermined timing. The first time is shorter than the second time. The third time is the same as the first time or longer than the first time and shorter than the second time. The first information and the second information include video information. The arithmetic circuit 31 is configured to start transmitting, a fourth time after a predetermined timing, to the fourth device 27, fourth information created so that the first information and the second information are displayed simultaneously. The fourth device 27 is a device different from the first device 23, the second devices 24, 25, 26, and the third device 23. The fourth time is the same as the first time or is longer than the first time and shorter than the second time.

[0114] According to such a configuration, the server device 21 can display each video on the first device 23 and the third device 23 with a small delay time, although there is a possibility that each video may be distorted. Furthermore, the server device 21 can display the fourth information, which is created so that each video is displayed simultaneously, on the fourth device 27 with a small delay time compared to the transmission of the third information to the second device 24. Based on the video displayed on the fourth device 27, the user can determine the video to be used as the third information.

[0115] Furthermore, in the server device 21, the first information, the second information, the third information, and the fourth information are received by streaming through IP communication. The predetermined timing is the time when streaming transmission of the first information is started. The first time is determined based on the propagation time and transmission jitter of the IP communication. With this configuration, the server device 21 can synchronize the first information and the second information and display the fourth information on the fourth device 27. Therefore, the user can easily view the images being captured by each imaging device 10 by checking the display of the fourth device 27. (Other embodiments)

[0116] In the above embodiment, the operation device 22 transmits a control signal to the image capture device 10 via the production device 21, but this is not limiting. The operation device 22 may be configured to be directly connected to the image capture device 10 via the Internet 5, for example, and to transmit a control signal to the image capture device 10 without going through the production device 21.

[0117] In the above embodiment, the arithmetic circuit 31 synchronizes a plurality of pieces of shooting data with the synthesis adjustment unit 44 to synthesize the images and adjust the sound, but is not limited to this. For example, the plurality of readout units 42 may have a function of reading a plurality of pieces of shooting data in a synchronous manner and outputting the data to the synthesis adjustment unit 44.

[0118] In the above embodiment, the arithmetic circuit 31 synchronizes a plurality of pieces of shooting data with the multi-view synthesis unit 48, synthesizes the images, and creates multi-view data, but is not limited to this. For example, the plurality of readout units 42 may have a function of synchronously reading a plurality of pieces of shooting data and outputting the data to the multi-view synthesis unit 48.

[0119] (Summary of aspects) As is apparent from the above description, the present disclosure includes the following aspects. In the following, reference symbols are given in parentheses only to clearly indicate the correspondence with the embodiments.

[0120] (Aspect 1) A server device (21) according to the present disclosure is a server device that receives information through streaming and transmits the information sequentially, An arithmetic circuit (31); A storage device (32) for storing the information; Equipped with The arithmetic circuit includes: Accept the first information received via streaming, starting transmission of the first information to a first device (23) a first time after a predetermined timing; A second time after the predetermined timing, the first information is transmitted to a second device (24, 25, 26) different from the first device. It is configured as follows: The first time period is less than the second time period.

[0121] (Aspect 2) In the server device (21) according to aspect 1, the arithmetic circuit (31) receiving second information different from the first information received by streaming, starting transmission of the second information to a third device (23) different from the first device (23) and the second device (24, 25, 26) three hours after the predetermined timing; and starting transmission of third information created based on the first information and the second information to the second device, instead of the transmission of the first information, after the second time has elapsed from the predetermined timing. It is configured as follows: The third time period may be the same as or longer than the first time period and shorter than the second time period.

[0122] (Example 3) In the server device (21) according to Example 2, the third time may be the same as the first time.

[0123] (Aspect 4) In the server device (21) according to aspect 2 or aspect 3, the first information and the second information include video information, The arithmetic circuit (31) and starting transmission of fourth information, which is created so that the first information and the second information are simultaneously displayed, to a fourth device (27) different from the first device (23), the second device (24, 25, 26), and the third device (23) four hours after the predetermined timing. It is configured as follows: The fourth time period may be the same as or longer than the first time period and shorter than the second time period.

[0124] (Aspect 5) In the server device (21) according to any one of aspects 1 to 4, the first information may include video information.

[0125] (Aspect 6) In the server device (21) according to any one of aspects 1 to 5, the predetermined timing may be a time when streaming transmission of the first information is started.

[0126] (Example 7) In the server device (21) according to any one of Examples 1 to 6, the first information may be received by streaming through IP communication.

[0127] (Aspect 8) In the server device (21) relating to aspect 7, the arithmetic circuit (31) may be configured to sequentially transmit the first information to the first device after the first time, even if packet reception of the first information is incomplete.

[0128] (Example 9) In the server device (21) according to example 7 or example 8, the first time period may be determined based on a propagation time and a transmission jitter of IP communication.

[0129] (Example 10) In the server device (21) according to Example 9, the second time may be determined based on a time of a retransmission request for a packet in addition to the first time.

[0130] (Aspect 11) In the server device (21) according to aspect 4, the first information, the second information, the third information, and the fourth information are received through streaming via IP communication; the predetermined timing is a time when streaming transmission of the first information is started, The first time may be determined based on a propagation time and a transmission jitter of the IP communication.

[0131] (Aspect 12) A server device (21) according to any one of aspects 1 to 11 is capable of receiving the first information including video information from the photographing device (10) via streaming, The arithmetic circuit (31) may be configured to receive a control signal for operating the image capture device from an operation device (22) and to transmit the control signal to the image capture device.

[0132] (Aspect 13) A transmission method according to the present disclosure is a transmission method executed by an arithmetic circuit (31) that can access a storage device (32) that stores streaming received information, Receiving first information received by streaming; starting transmission of the first information to a first device (23) a first time after a predetermined timing; starting transmission of the first information to a second device (24, 25, 26) different from the first device (23) after a second time from the predetermined timing; Including, The first time period is less than the second time period.

[0133] (Aspect 14) A computer program according to the present disclosure causes an arithmetic circuit to execute the transmission method according to aspect 13.

[0134] In this specification, the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as expressing or implying the relative importance or ranking of technical features. Features qualified as "first" and "second" expressly or imply the inclusion of one or more of that feature.

[0135] The server device described in the present disclosure is realized by cooperation between hardware resources, such as a processor and a memory, and software (computer program). [Industrial Applicability]

[0136] According to the present disclosure, it is possible to provide a server device, a transmission method, and a computer program capable of transmitting information with a delay time suited to the purpose, and thus the server device, the transmission method, and the computer program can be suitably used in this type of industrial field. [Explanation of symbols]

[0137] 1. Distribution System 10. Imaging Device 20 Production System 21 Production equipment 22 Control device 23 Operation display device 24 Distribution data display device 27 Multi-view display device 31 Arithmetic circuit 32 Storage device 41 Receiving section 42 Readout section 43 Operation output section 44 Composite Adjustment Section 45 Output section for distribution data

Claims

1. A server device that receives information by streaming and transmits the information sequentially, An arithmetic circuit; A storage device for storing the information; Equipped with The arithmetic circuit includes: Receiving first information received by streaming; starting transmission of the first information to the first device a first time after a predetermined timing; and starting transmission of the first information to a second device different from the first device after a second time has elapsed since the predetermined timing. It is configured as follows: The first time period is less than the second time period. Server device.

2. The arithmetic circuit includes: receiving second information different from the first information received by streaming; starting transmission of the second information to a third device different from the first device and the second device a third time after the predetermined timing; and starting transmission of third information created based on the first information and the second information to the second device, instead of the transmission of the first information, after the second time has elapsed from the predetermined timing. It is configured as follows: The third time is equal to or longer than the first time and shorter than the second time. The server device according to claim 1 .

3. The server device according to claim 2 , wherein the third time is the same as the first time.

4. the first information and the second information include video information, The arithmetic circuit includes: a fourth time after the predetermined timing, starting transmission of fourth information to a fourth device different from the first device, the second device, and the third device, the fourth information being created so that the first information and the second information are simultaneously displayed; It is configured as follows: The fourth time period is equal to or longer than the first time period and shorter than the second time period. The server device according to claim 2.

5. The server device according to claim 1 , wherein the first information includes video information.

6. 2. The server device according to claim 1, wherein the predetermined timing is a time when streaming transmission of the first information is started.

7. The server device according to claim 1 , wherein the first information is received by streaming through IP communication.

8. 8. The server device according to claim 7, wherein the arithmetic circuit is configured to sequentially transmit the first information to the first device after the first time period even if packet reception of the first information is incomplete.

9. The server device according to claim 7 , wherein the first time is determined based on a propagation time and a transmission jitter of an IP communication.

10. 10. The server device according to claim 9, wherein the second time is determined based on a time of a retransmission request for a packet in addition to the first time.

11. the first information, the second information, the third information, and the fourth information are received through streaming via IP communication; the predetermined timing is a time when streaming transmission of the first information is started, The first time is determined based on a propagation time and a transmission jitter of the IP communication. The server device according to claim 4.

12. the server device is capable of receiving the first information including video information from the imaging device through streaming; The arithmetic circuit is configured to receive a control signal for operating the photographing device from an operation device and to transmit the control signal to the photographing device. The server device according to claim 1 .

13. A transmission method executed by an arithmetic circuit that can access a storage device that stores streaming received information, comprising: Receiving first information received by streaming; starting transmission of the first information to a first device a first time after a predetermined timing; starting transmission of the first information to a second device different from the first device after a second time from the predetermined timing; Including, The first time period is less than the second time period. Transmission method.

14. A computer program product for causing an arithmetic circuit to execute the transmission method according to claim 13.

Citation Information

Patent Citations

  • System and method for controlling the capture of media content for the production of live video broadcasts

    JP2020509646A