Broadcast service communication network distribution device and method
The broadcast service communication network distribution device converts TS streams to IP format, enabling simultaneous distribution of video and audio content while addressing commercial and copyright issues, supporting various formats and viewing options.
Patent Information
- Application Number
- JP2025186012
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-12-27
- Filing Date
- 2025-11-05
- Publication Date
- 2026-02-19
- Estimated Expiration
- 2040-01-22
AI Technical Summary
Broadcasters face significant costs and restrictions in distributing video and audio content over communication networks due to commercial content and copyright issues, requiring a solution that allows simultaneous distribution while addressing these challenges.
A broadcast service communication network distribution device that includes reconstruction, conversion, and transmission means to convert TS streams into IP distribution format, allowing replacement of video and audio streams with alternative content at specified intervals, and supports various formats and viewing options.
This configuration enables easy handling of commercials and copyright issues, supporting diverse broadcast programs and formats, and allows seamless distribution over communication networks.
Smart Images

Figure 0007817689000001 
Figure 0007817689000002 
Figure 0007817689000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a broadcast service communication network distribution technology for distributing television broadcast services using a communication network. [Background technology]
[0002] Broadcasters are increasingly seeking to simultaneously distribute the video and audio content they provide through their broadcasting services over communication networks. However, preparing the data for communication network distribution at each of their business locations incurs significant costs. Furthermore, restrictions arise between broadcast distribution and communication network distribution due to issues such as commercial content and copyrights. For example, content distributed over communication networks must be different from that for broadcast.
[0003] A patent document related to this invention is JP 2017-050631 A, which discloses that when content provided by a broadcasting service is distributed over a communication network, the content of commercials is appropriately switched between the broadcasting service and the communication network.
[0004] The above-mentioned prior art and its problems are described only to explain part of the background of the present invention, and it should be noted that the present invention is not limited to the above-mentioned prior art and problems. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Publication No. 2017-050631 Summary of the Invention [Problem to be solved by the invention]
[0006] This invention was made in consideration of the above circumstances, and aims to realize a scheme suitable for simultaneously distributing video and audio content provided by broadcasting services via a communication network. [Means for solving the problem]
[0007] In order to achieve the above object, the present invention employs the configurations set forth in the claims. Before describing the invention in detail, a supplementary explanation will be given below regarding the claims.
[0008] That is, according to one aspect of the present invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via a communication network, a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal via the communication network in response to a request from the client terminal on the communication network; the conversion means for IP distribution is configured to receive information specifying the start and end of a time interval and alternative content, and to replace the video stream in the IP distribution format with the alternative content in the section defined by the start and end. The video stream in the IP distribution format may have separate video streams and audio streams. The same applies hereinafter.
[0009] This configuration makes it possible to easily deal with commercials and copyright issues in broadcasting services.
[0010] In this configuration, the alternative content may be a video stream segment and an audio stream segment, or a still image and a predetermined sound.
[0011] In this configuration, the conversion means for IP distribution has a demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream, and alternative content may be used in place of the video signal and audio signal decoded from the video stream and audio stream in the section defined by the start and end dates.
[0012] In this configuration, the start and end of the time interval are displayed in year, month, day, hour, minute, and second, and can be compared with the time information displayed in year, month, day, hour, minute, and second of the time offset table and the time displayed in year, month, day, hour, minute, and second based on a clock conforming to the TS stream of the broadcast service.
[0013] According to another aspect of the present invention, a broadcast service communication network distribution device is configured to include: reconstruction means for receiving, via a communication network, a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; transmission means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal on the communication network via the communication network in response to a request from the client terminal; and control information supply means for receiving information specifying the start and end of a time interval and alternative content, and supplying control information to the client device so as to replace the section of the video stream defined by the start and end of the time interval with the video stream segment.
[0014] This configuration makes it possible to easily deal with commercials and copyright issues in broadcasting services.
[0015] According to another aspect of the present invention, a client terminal connected to the broadcast service communication network distribution device via a communication network has: a video stream playback means for receiving and playing the video stream in the IP distribution format from the transmission means of the broadcast service communication network distribution device; and the video stream playback means is configured to play the alternative content in place of the video stream at playback times corresponding to the start and end of the time interval received from the control information supply means of the broadcast service communication network distribution device.
[0016] This configuration makes it possible to easily deal with commercials and copyright issues in broadcasting services.
[0017] In this configuration, the format for the IP distribution is HLS (HTTP Live Streaming, Apple Inc., both trademarks), and the video stream playback means may play the alternative content instead of the video stream in accordance with the EXT-PROGRAM-DATE-TIME of the video stream file.
[0018] According to another aspect of the present invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via a communication network, a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; transmission means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal on the communication network in response to a request from the client terminal; and transmission means for transmitting the video and audio streams extracted from the broadcast stream to the client terminal via the network in a streaming manner. and alternative content distribution control means for controlling transmission of alternative content to be replaced by the video stream or audio stream to the client terminal via the network for a specified period of time; the alternative content distribution control means has: index file storage means for storing an index file that makes insertion control information accessible for each replacement operation; and means for transmitting the index file to the client terminal via the network in response to polling from the client terminal; and the client terminal uses the insertion control information to obtain the alternative content from a predetermined alternative content storage means and replaces the video stream and audio stream with the alternative content for a specified period of time.
[0019] This configuration makes it possible to easily deal with commercials and copyright issues in broadcasting services.
[0020] According to another aspect of the present invention, a client terminal connectable to a network comprises: a video and audio stream receiving means for receiving, from a transmitting device, a video and audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner; and an alternative content receiving means for receiving, via the network, alternative content stored in an alternative content storage means; the alternative content receiving means comprises: an index file receiving means for receiving, by polling, from the transmitting device an index file that makes the alternative content stored in the alternative content storage means accessible on a replacement operation basis; and a means for receiving the alternative content stored in the alternative content storage means on a replacement operation basis using the index file received by the index file receiving means.
[0021] In this configuration, the terminal is typically a mobile terminal or mobile communication terminal that communicates based on mobile communication, but may also be a fixed terminal. The mobile terminal or mobile communication terminal is typically a mobile phone, but may also be any device including a portable computer, a tablet computer, a media player, a personal digital assistant, or a combination of two or more of these products.
[0022] This configuration makes it possible to easily deal with commercials and copyright issues in broadcasting services.
[0023] According to a technical feature related to the present invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via a communication network, a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; characteristic determination means for determining characteristics of the TS stream of the broadcast service reconstructed by the reconstruction means; conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal on a communication network in response to a request from the client terminal; and the conversion means for IP distribution is configured to generate the video stream in the IP distribution format in a standard format based on the characteristics determined by the characteristic determination means.
[0024] This configuration generates a video stream in a standard format for IP distribution, making it possible to handle a wide variety of broadcast programs.
[0025] In this configuration, the audio mode in the moving image stream in the IP distribution format generated in the standard format may be a stereo audio mode.
[0026] In this configuration, the video mode in the moving image stream in the IP distribution format generated in the standard format may be high-definition mode.
[0027] In this configuration, the conversion means for IP distribution may generate, from the TS stream of the broadcast service, video streams in the IP distribution format in a number corresponding to N (N is an integer of 2 or more) organized channels.
[0028] In this configuration, the N organization channels are two organization channels, and even if the TS stream of the broadcast service contains only one organization channel, a number of video streams in the IP distribution format corresponding to the two organization channels may be generated.
[0029] In this configuration, the conversion means for IP distribution may generate a number of moving image streams in the IP distribution format corresponding to two modes, namely, main audio and secondary audio.
[0030] In this configuration, the conversion means for IP distribution may generate the number of moving image streams in the IP distribution format corresponding to the two modes even if the TS stream of the broadcast service does not include secondary audio.
[0031] In this configuration, the conversion means for IP distribution may generate a number of moving image streams in the IP distribution format corresponding to two viewing options: subtitle display and subtitle non-display.
[0032] In this configuration, the conversion means for IP distribution may generate a number of video streams in the IP distribution format corresponding to the two viewing selection numbers, even if the TS stream of the broadcast service does not include subtitle data.
[0033] In this configuration, the video stream may comprise a series of video files that are played sequentially by an index file.
[0034] In this configuration, the moving picture stream in the IP distribution format may be a streaming moving picture stream.
[0035] In this configuration, the streaming method is a streaming method that complies with the HTTP protocol. For example, it may be HLS (HTTP Live Streaming, Apple), MPEG-DASH, Smooth Streaming (Microsoft), or HTTP Dynamic Streaming (Adobe Systems). Methods other than HTTP streaming, such as RTS (Real Time Streaming Protocol) or RTMP (Real Time Messaging Protocol), may also be used.
[0036] In this configuration, the transport stream may be a TS stream of the broadcast service that has been IP packetized.
[0037] In this configuration, the conversion means for IP distribution may include: demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream; decoding means for decoding the video stream and the audio stream output from the demultiplexing means to generate a video signal and an audio signal; standard mode conversion means for converting the video signal and audio signal to a standard mode; and encoding means for encoding the standard mode video signal and audio signal to generate a video stream in the IP distribution format.
[0038] In this configuration, the video stream in the IP distribution format generated in the standard format may include a plurality of selectable sets of video streams.
[0039] In this configuration, one set of the selectable video streams may include subtitle display, and the other set of video streams may not include subtitle display.
[0040] According to another technical feature related to the present invention, a broadcast service communication network distribution device is configured to include: reconstruction means for receiving, via a communication network, a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; conversion means for IP distribution for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal on the communication network in response to a request from the client terminal; and when the TS stream of the broadcast service includes subtitle data, the conversion means for IP distribution not only generates a video stream in the IP distribution format from the video stream and audio stream generated by the video / audio stream generation means, but also generates another video stream in the IP distribution format from a video stream of a composite video in which subtitles based on the subtitle data are added to the video of the video stream and the audio stream.
[0041] In this configuration, it becomes possible to handle subtitle data easily.
[0042] This invention can be realized not only as an apparatus or system but also as a method. It goes without saying that a part of such an invention can be configured as software. Furthermore, software products used to run such software on a computer are also naturally included in the technical scope of this invention.
[0043] These and other aspects of the present invention are set forth in the appended claims and are further illustrated by the following examples. [Effects of the Invention]
[0044] According to the present invention, commercial and copyright issues can be easily addressed. [Brief explanation of the drawings]
[0045] [Figure 1] 1 is a diagram illustrating an environment in which an IP distribution system according to an embodiment of the present invention is executed. [Figure 2] FIG. 2 is a functional block diagram illustrating an overview of the IP distribution system of FIG. [Figure 3] 3 is a functional block diagram illustrating a video / audio transcoding unit 220 of FIG. 2. FIG. [Figure 4] FIG. 10 is a diagram illustrating an example of a standard output. [Figure 5] FIG. 10 is a functional block diagram illustrating the configuration of an alternative video / audio transcoding unit 220A. [Figure 6] FIG. 10 is a diagram illustrating an example of an alternative standard output. [Figure 7] 2 is a block diagram showing an example of the configuration of the mobile terminal of FIG. 1. FIG. [Figure 8] FIG. 2 is a functional block diagram of the mobile terminal of FIG. [Figure 9] 2A to 2C are diagrams illustrating examples of displays on the mobile terminal of FIG. 1. [Figure 10] 10 is a diagram illustrating an example of a channel selection screen of the video / audio stream playback unit 360. FIG. [Figure 11] FIG. 10 is a functional block diagram illustrating an overview of an IP distribution system according to another embodiment of the present invention. [Figure 12] 12 is a block diagram showing an example of the configuration of a subtitle data reproducing unit 370 in FIG. 11. FIG. [Figure 13] 12 is a schematic diagram illustrating the operation of the subtitle data reproducing unit 370 in FIG. 11. FIG. [Figure 14] 12 is a schematic diagram illustrating the operation of the subtitle data reproduction unit 370 in FIG. 11 to obtain a corrected PCR. FIG. [Figure 15] FIG. 10 is a diagram illustrating a message management file. [Figure 16] FIG. 2 is a diagram illustrating subtitle data. [Figure 17] FIG. 2 is a functional block diagram illustrating an alternative configuration of the IP distribution system of FIG. [Figure 18] 18 is a functional block diagram illustrating the configuration of a video / audio transcoding unit 220B in FIG. 17. FIG. [Figure 19] 19 is a diagram for explaining the operation of the video / audio transcoding unit 220B in FIG. 18. FIG. [Figure 20] 10 is a diagram illustrating the operation of an inserted moving image playback unit 380 of the mobile terminal 300. FIG. [Figure 21] FIG. 10 is a schematic diagram illustrating a processing flow of subtitle data. [Figure 22] FIG. 10 is a diagram illustrating messages in a message management file. [Figure 23] FIG. 10 is a diagram illustrating the entity types of messages in a message management file. [Figure 24] 19 is a functional block diagram illustrating an example of the configuration of an insertion control unit 270 in FIG. 18. FIG. [Figure 25] FIG. 10 is a diagram illustrating a playlist and media segment files for network distribution in accordance with HTTP. [Figure 26] FIG. 1 is a diagram illustrating an example of video distribution over a network in accordance with HTTP. DETAILED DESCRIPTION OF THE INVENTION
[0046] An embodiment of the present invention will now be described.
[0047] FIG. 1 shows an overall embodiment of the present invention applied to a digital television distribution system that simultaneously distributes digital television broadcasts (terrestrial digital television broadcasts, BS digital television broadcasts, and CS digital television broadcasts) over IP. In this figure, broadcaster subsystem 100 is a subsystem operated by a core broadcaster. It acquires TS streams from broadcast services before uplinking and transmits them to communication network distribution subsystem 200 via a communication network 500 (the Internet) or a predetermined line 700. Communication network distribution subsystem 200 may be operated by the core broadcaster or a third party. This subsystem 200 demultiplexes the transmitted TS streams to acquire video and audio streams (e.g., MPEG-2 TS), transcodes these video and audio streams into a predetermined format for IP redistribution (e.g., HLS, MPEG-DASH), and distributes them to mobile terminals 300. Communication network distribution subsystem 200 is connected to communication network 500, typically the Internet. At least a portion of communication network 500 may be configured as a CDN (content delivery network) service. The mobile terminal 300 is connected to the communication network 500 via a mobile communications carrier's gateway 400. An authentication server 600 may also be connected to the communication network 500 to authenticate requests from the mobile terminal 300 for IP distribution services. The communication network distribution subsystem 200 is located at a different site from the broadcaster subsystem 100 of the core broadcaster. The communication network distribution subsystem 200 may also provide services to broadcaster subsystems at other business locations or to broadcaster subsystems of different core broadcasters via the communication network 500. The communication network distribution subsystem 200 may be operated efficiently as a so-called cloud system, using communication lines from multiple locations with limited system resources. The line 700 may be an optical fiber transmission line or an SDI transmission line. The broadcaster subsystem 100 and the communication network distribution subsystem 200 may each be composed of a server computer.
[0048] FIG. 2 illustrates an example configuration of the main components of the broadcaster subsystem 100, the communication network distribution subsystem 200, and the mobile terminal 300; however, other configuration examples may also be employed. The subsystems 100 and 200 may be configured by appropriately combining server devices (processors) and the like. In FIG. 2, the broadcaster subsystem 100 includes a broadcast service TS stream output unit 110, an uplink unit 120, and an IP transmission device 130. The broadcast service TS stream output unit 110 outputs a broadcast service TS stream that is multiplexed with a video stream, an audio stream, and data. The uplink unit 120 transmits and modulates the broadcast service TS stream and broadcasts it via a transmission antenna. The IP transmission device 130 receives the broadcast service TS stream, converts it into IP packets, and transmits the broadcast service TS stream to the communication network distribution subsystem 200 via a communication network using IP protocol.
[0049] The communication network distribution subsystem 200 includes an IP receiving device 210, a video / audio transcoding unit 220, and a video / audio distribution unit 230. The IP receiving device 210 receives IP packets transmitted from the IP transmitting device 130 of the broadcaster subsystem 100 and reconstructs the TS stream of the broadcast service. IP transmission of TS streams is described, for example, in Pro-MPEG Code of Practice #3 release 2, July 2004, "Transmission of Professional MPEG-2 Transport Streams over IP Networks." The video / audio transcoding unit 220 converts MPEG-2 video / audio TS packets into streaming files in HTTP streaming format (typically HLS format). The video / audio distribution unit 230 distributes the video / audio stream to the mobile terminal 300 in HTTP streaming format. The video / audio transcoding unit 220 is configured to output the video / audio stream in a predetermined standard format, regardless of the configuration of the TS stream of the broadcast service. A standard format is, for example, one in which audio is in stereo mode, video is in HD mode, and the number of channels is 2. This will be explained later with an example.
[0050] The communication network distribution subsystem 200 may obtain subtitle data from the TS stream of the broadcast service and distribute it to the mobile terminal 300 by, for example, HTTP long polling, as will be described later in an alternative embodiment.
[0051] Mobile terminal 300 displays video 300 delivered by HTTP streaming on display unit 300A (FIG. 2). As will be described later, when subtitle data (300B) is delivered using a message management file transmitted by HTTP long polling, the subtitle data (300B) may be superimposed on the video on display unit 300A or displayed in a separate display area (see FIG. 9).
[0052] FIG. 3 shows an example configuration of the video / audio transcoding unit 220 in FIG. 2. In this diagram, the video / audio transcoding unit 220 includes a TS demultiplexing unit 221, a decoding unit 222, a standard mode conversion unit 223, an encoding unit 224, and a TS stream characteristic determination unit 225. In FIG. 3, the TS demultiplexing unit 221 demultiplexes the TS stream of a broadcast service to generate a video stream and an audio stream. The decoding unit 222 decodes the MPEG code to generate a video signal and an audio signal. The TS stream characteristic determination unit 225 determines the characteristics of the TS stream of the broadcast service, the number of channels, subtitle data, video mode, audio mode, etc. The standard mode conversion unit 223 performs output conversion in a predetermined format, for example, converting the input video signal and input audio signal and outputting them in two channels. In this example, the number of outputs is basically two, and the video and audio signals of these two channels are supplied to the encoding unit 224. When standard mode video signals and audio signals are input, the standard mode conversion unit 223 may output them as is. The encoding unit 224 converts the input two-channel video signals and audio signals into streaming video files, for example, streaming files in HTTP streaming format (typically HLS format). In the example of FIG. 3, a first video streaming file 226 and a second video streaming file 227 are output. The first video streaming file 226 has video in HD mode and audio in stereo, and the second video streaming file 227 also has video in HD mode and audio in stereo. The standard mode may be changed to another mode, for example, video in SD mode and audio in monaural mode.
[0053] If the TS stream of a broadcasting service contains only one channel, the first video stream and the second video stream will be the same. If the TS stream of a broadcasting service contains two different channels, the first video stream will correspond to a different channel from the second video stream and will be a different video stream.
[0054] The video and audio transcoding unit 220 generates a program table 228 that indicates what the multiple video streams are. The program table 228 may indicate which channel the video stream is on. If multiple video streams are available, the selectable group may be identified using, for example, an "EXT-MEDIA" tag in HLS.
[0055] The TS stream characteristic determination unit 225 may include a video mode determination unit 225A, an audio mode determination unit 225B, a multi-channel determination unit 225C, etc. The audio mode determination unit 225B determines the number of audio PESs (Packetized Elementary Streams) and the audio mode within each audio PES. When there are multiple audio PESs described in the PMT (Program Map Table), the audio mode determination unit 225B determines that there is secondary audio in addition to the main audio. Furthermore, the audio mode determination unit 225B determines the mode as follows based on the content of the "channel_configuration" (3 bits) of "adts_fixed_header" of "adts_frame" in the header section of the audio PES: 1:Monaural 2: Stereo 6:5.1 channel (SS) 0: Dual mono (one audio PES contains both main and secondary audio)
[0056] If the audio is in mono mode, the left and right stereo elements are made identical. If the audio is in 5.1 channel mode, only the stereo components are used.
[0057] Taking secondary audio into consideration, the number of channels in a standard video stream may be four, as shown in Figure 6(A). In Figure 6(A), a video stream on the first channel (HD / stereo / primary audio), a video stream on the second channel (HD / stereo / primary audio), a video stream on the first channel (HD / stereo / secondary audio), and a video stream on the second channel (HD / stereo / secondary audio) may be output in standard form. If secondary audio is not available, all video streams may include redundant primary audio.
[0058] In the mobile terminal 300, valid programs are displayed based on the information in the program table 228, for example, as shown in FIG. 10(A), and invalid programs (those that overlap with valid programs) may be grayed out and cannot be selected, but this is not limiting. In the example of FIG. 10(A), "Channel 01" is selectable, and "Channel 02" is unselectable because of the same content. If the content is not the same, both are selectable. By making a selection, the video file can be streamed from the destination. In the case of the video stream shown in FIG. 6(A) (four cases), the result is as shown in FIG. 10(B), and it is possible to select either the main audio or the secondary audio. In this example, too, the grayed-out programs cannot be selected due to the same content.
[0059] An example of the configuration of the mobile terminal 300 will be further described later with reference to FIGS.
[0060] The video mode determination unit 225A determines the video mode, such as resolution, from the value of "video¥encode¥format" in the "descriptor" included in the PMT, or by decoding the MPEG2 video transmitted in the video PES and referencing the "sequence header" therein. The standard video mode is HD (high definition).
[0061] The multi-channel determination unit 225C determines whether there are multiple channels (services) in the TS stream. For example, if there are two channels, it treats them as two standard video and audio streams. If there is only one channel, it generates two identical video streams. The number of channels can be determined by whether multiple services (PMT) are described in the PAT. Whether two channels have the same content can be determined by information in the EPG (Electronic Program Guide) and whether the video and audio on each channel are identical.
[0062] 5 shows an alternative example (220A) of the video / audio transcoding unit 220 described with reference to FIG. 3. In this figure, the video / audio transcoding unit 220A includes a TS demultiplexing unit 221, a decoding unit 222, a standard mode conversion unit 223, an encoding unit 224, a TS stream characteristic determination unit 225, a subtitle data extraction unit 231, and a video synthesis unit 229. In this example, when subtitle data is present, a video stream (stereo, HD) of video without subtitles and a video stream (stereo, HD) of video with subtitles are formed. A video signal including subtitles is generated using the video synthesis unit 229.
[0063] When a standard video stream contains both subtitled and non-subtitled video, the standard video stream will look like the one shown in Figure 6(B). Taking into account the presence or absence of subtitles and both main and secondary audio, eight standard video streams can be formed as shown in Figure 6(C).
[0064] An example of the display of the program selection section on the mobile terminal 300 is as shown in Fig. 10(A). When the main audio and secondary audio are set to the standard format, it will look as shown in Fig. 10(B). Grayed-out buttons may be disabled as described above, but this is not limitative.
[0065] Note that video distribution services based on a conventional HTTP protocol-compliant streaming method, such as HLS (HTTP Live Streaming, Apple Inc.), prepare a playlist file (e.g., an m3u8 file) and one or more video segment files (MPEG2-TS segment files) as shown in FIG. 25. In the example of FIG. 25, a master index file can be used to select multiple (two) alternative playlists with different resolutions. Only one playlist is also possible. The alternative playlist (playlist) is rewritten and repeatedly transmitted. The viewing client references the playlist, sequentially extracts the video segment files as shown in FIG. 25, and plays the video (FIG. 26). When multiple playlists are selectable using the master playlist (master index) shown in FIG. 25, a desired playlist in one standard format may be specified based on the selection in the program selection unit, and the corresponding media segment files may be sequentially extracted based on the desired playlist in one standard format. While viewing a selected playlist, the user may select another playlist using the program selection unit, switch the standard format, and switch to viewing based on the other playlist.
[0066] 7 illustrates an example of a mobile terminal 300, which includes a processing system 310, memory 320, an input / output subsystem 330, radio frequency circuitry 340, and audio circuitry 350. Each of these components may be implemented in hardware, software, or a combination thereof, including signal processing integrated circuits and application specific integrated circuits, as appropriate. Radio frequency circuitry 340 is used to transmit and receive information over a wireless link or network to other devices, and may include, but is not limited to, antenna systems, RF transceivers, amplifiers, tuners, oscillators, digital signal processors, CODEC chipsets, memory, and other well-known circuitry to perform this function. The radio frequency circuitry 340 may use communication protocols such as, but not limited to, mobile communications protocols such as time division multiple access (TDMA) and code division multiple access (CDMA), wireless LAN (IEEE 802.11b, IEEE 802.11a, IEEE 802.11g, and / or IEEE 802.11N), Bluetooth (IEEE 802.15.1), and Wi-MAX (IEEE 802.16). The audio circuitry 350 is coupled to an audio speaker 351 and a microphone 352. The processing system 310 includes a processor 311, a memory controller 312, and a peripheral device interface 313. The memory 320 stores code and data executed by the processor 311. The memory 320 may include any storage device, such as RAM, ROM, FLASH, a disk drive, or a magnetic tape. The processor 311 executes various software components stored in the memory 320. For example, the software components include an operating system 321, a communications module 322, a contact / motion module 323, a graphics module 324, applications 325, a timer module 326, and a web browser module 327. The applications 325 include a browser, an address book, email, encryption, a location determination function such as a Global Positioning System (GPS), and a two-dimensional barcode decoder. In this embodiment, an Internet-delivered television broadcast viewing application 325A (FIG. 6) is typically implemented as one of the applications 325.Input / output subsystem 330 controls touch panel 331 and the like. In this mobile terminal 300, the function of viewing television broadcast services distributed via Internet retransmission is implemented as an application. By installing the corresponding application in memory 320, mobile terminal 300 is realized as an Internet-distributed television broadcast viewing terminal.
[0067] 8 shows a schematic diagram of the functions realized by Internet-delivered television broadcast viewing application 325A. In the diagram, mobile terminal 300 may include functions such as video / audio stream playback unit 360, subtitle data playback unit 370, and inserted video playback unit 380. Subtitle data playback unit 370 allows subtitle data to be manipulated independently of the video stream, as in a typical digital broadcasting service, and this will be described later as an alternative embodiment. In this case, a video stream with subtitles (a stream with fixed subtitles superimposed) may or may not be provided.
[0068] The video / audio stream playback unit 360 in Fig. 8 allows a user to select a program from a predetermined program guide, and displays available channels as shown in Fig. 10(A) and (B), from which the user can select a channel to watch and play the video stream. Alternatively, only available video stream channels may be displayed.
[0069] In this embodiment, a video stream available on a communication network is generated and output in a standard manner, allowing continuous viewing of programs (videos) with different resolutions and formats, and programs with different audio standards. In addition, multiple subtitle services can be handled as a normal video stream.
[0070] FIG. 11 shows an alternative embodiment of the present invention, in which a communications network distribution subsystem 200B includes an IP receiving device 210, a video / audio transcoding unit 220, a video / audio distribution unit 230, a subtitle data extraction unit 231, a subtitle data distribution unit 250, and a message management file storage unit 260. As explained above, the video / audio distribution unit 230 transmits a video / audio stream (moving video stream) to a mobile terminal 300 using HTTP streaming. The subtitle data extraction unit 231 extracts subtitle data from a broadcast service TS stream, and this function may be included in the video / audio transcoding unit 220. The subtitle data is transmitted to the mobile terminal 300 using HTTP long polling. The distribution of subtitle data (HTTP long polling) will be explained in detail later.
[0071] The broadcaster subsystem 100 or the communication network distribution subsystem 200 stores an index file for managing TS packets of a broadcast TS stream as a message management file in the message management file storage unit 260. Each time the broadcaster subsystem 100 or the communication network distribution subsystem 200 receives a TS packet, it creates and manages an index (message entry) as shown in Fig. 15. As for subtitle data, subtitle packets as shown schematically in Fig. 16 are stored in the data storage management unit in their original form, and can be accessed by a path specified by the actual file name attribute of the message.
[0072] The video / audio stream playback unit 360 (FIG. 8) of the mobile terminal 300 decodes the video / audio packet file delivered by the video / audio delivery unit 240 of the communication network delivery subsystem 200 via HTTP streaming, and displays the video in the video viewing area A of the display area of the mobile terminal 300, as shown in FIG. 9, for example. To start watching a television broadcast, a user simply selects and launches the corresponding application and selects a channel from an on-screen display similar to that of a regular television set. Channel switching may also be performed based on a swipe. In some cases, an authentication dialogue is executed with an authentication server (not shown). The application 325A can, for example, obtain channel information for each viewable broadcast channel from the authentication server.
[0073] 8, the subtitle data playback unit 370 plays back synchronization data such as subtitles. The subtitle data playback unit 370 acquires synchronization data from the subtitle data delivery unit 250 of the communication network delivery subsystem 200 by HTTP long polling, and displays subtitles, superimposed text, and the like in synchronization with the video and audio streaming. The subtitle data playback unit 370 also processes event messages, which are also synchronization data, in synchronization with the video and audio streaming. The event messages may be used to switch the contents of the BML document, etc.
[0074] FIG. 12 illustrates a correction PCR generation unit 372 that controls synchronization timing in the subtitle data playback unit 370. In FIG. 12, the subtitle data playback unit 370 includes a subtitle display unit 371, a correction PCR generation unit 372, a message management file storage unit 373, a subtitle data storage unit 374, and a polling control unit 375. The correction PCR generation unit 372 generates a PCR (Program Clock Reference) according to the playback status of the video / audio stream playback unit 360. The polling control unit 375 polls the subtitle data delivery unit 250 of the communication network delivery subsystem 200, extracts new entries (messages) from the message management file storage unit 260, adds them to the message management file storage unit 373 of the subtitle data playback unit 370, and adds new subtitle data to the subtitle data storage unit 374. The message management file storage unit 373 and the subtitle data storage unit 374 delete entries that are no longer needed. The message management file storage unit 260 of the communication network delivery subsystem 200 also deletes entries that are no longer needed. The subtitle display unit 371 starts displaying subtitles (and superimposed text) by referring to the display timing (PST) of the subtitle packet in the subtitle data storage unit 374 based on the corrected PCR calculated by the corrected PCR generation unit 372, and ends displaying the subtitles by referring to the erasure timing.
[0075] The correction PCR generation unit 372 calculates the difference between the date and time (based on the time of the server that creates the message management file) when a program change (a change in the stream configuration of a broadcast program on one channel) is detected and the date and time of the video and audio stream being played (based on the time on the playback timeline, i.e., the time on the server that performs TS transcoding). This calculates the elapsed time from the program change to the date and time on the playback timeline (elapsed PCR time), and multiplies this by the resolution of the program reference clock (e.g., 90,000 / second) to calculate the elapsed clock. Furthermore, the correction PCR generation unit 372 stores the PCR when the program change is detected, and calculates the correction PCR by adding the elapsed clock based on this PCR (FIG. 14). This calculation method is shown in FIG. 13(A). A specific calculation example is shown in FIG. 13(B). The upper limit of the PCR is "8589935102." Note that this assumes that the exact time of the video is set in EXT-PROGRAM-DATE-TIME, and that there is preferably no frame-level discrepancy between the time on the server that creates the HLS and TS transcoding and the time on the server that creates the message management file. A program change (a change in the stream configuration of a broadcast program on one channel) is detected, for example, by the mobile terminal 300 detecting a change in the version number value of the PMT (Program Map Table) packet. In a typical example, "pmt_changed" is a message notifying that the PMT data has changed, and the server's detection time is transcribed as the message execution time in this message. The server also receives the PMT data extracted from the tuner, obtains the PCR from the PCR description location in the PMT, and transcribes it as additional information in the fourth column of the "pmt_changed" message. When the PMT indicates a program change (a change in the stream configuration of a broadcast program on one channel), the previous message management data may be cleared.
[0076] It is also possible to calculate the difference between the PTS and PCR, add the difference to the time the PCR was received, convert it to real time, and output this to a message management file, thereby controlling the display and erasure of subtitles in real time rather than based on the PCR clock.
[0077] FIG. 17 shows yet another embodiment of the present invention. In this figure, the broadcaster subsystem 100 has an insertion information transmitter 140, which supplies information for replacing commercial video and audio or copyrighted video and audio with alternative content to the insertion control unit 270 of the communication network distribution subsystem 200. The insertion control unit 270 replaces commercial video and audio or copyrighted video and audio with alternative content between break points and resume points on a frame-by-frame basis. The break points, resume points, and alternative content are supplied from the insertion information transmitter 140 of the broadcaster subsystem 100. The alternative content may be pre-located at a predetermined site or may be supplied simultaneously. The break points and resume points may be determined using PCR and PTS. 17, the replacement process may be performed in the demultiplexing unit 221, decoding unit 222, standard mode conversion unit 223, and encoding unit 224 of the video / audio transcoding unit 220B of the network distribution subsystem 200. In the configuration example of Fig. 18, the switch 242 in the video / audio transcoding unit 220B inserts the alternative content from the alternative content input unit 241 based on insertion control information (switching signal) of the insertion control unit 270 of the communication network distribution subsystem 200.
[0078] Information for replacing the alternative content (insertion control information: start point, end point, address of the alternative content) may be sent from a source other than the broadcaster subsystem 100.
[0079] The video stream can have commercials replaced with alternative content as shown in Figure 19.
[0080] FIG. 24 shows an example configuration of the insertion control unit 270. In this example configuration, the upstream system uses insertion control information (organization information) to specify the cutoff time for cap control and content replacement processing in units of hours, minutes, seconds, and milliseconds. Each video frame in the TS stream is assigned a clock time specified by a PTS (presentation timestamp). Based on the program clock value at the time the last ToT (time offset table) was received in the TS stream, the time (in year, month, day, hour, minute, second, and millisecond format, hereinafter also referred to as frame PTS time) based on the ToT of each frame is calculated. When frame data is input to the TS stream decoding unit 222, the frame PTS time is saved in a non-destructive ancillary data area (frame PTS file management unit 274) attached to each frame. When encoding into a distribution format, the frame time in the non-destructive ancillary data area is compared with the cutoff time to determine whether or not to cut the frame.
[0081] 24, the insertion control unit 270 has a structure information file management unit 271, a next structure information entry extraction unit 272, a frame PTS time generation unit 273, a frame PTS time file management unit 274, a frame PTS time extraction unit 275 to be processed, and a comparison unit 276.
[0082] The organization information file management unit 271 manages insertion information (organization information) files, and each entry of insertion information (organization information) has a specified time (written in YYYY-MM-DDT12:MM:SS:mm+0900 (time difference) format), a command, a source address, etc. An entry is created for each program and alternative content, and the commands include a program command that starts encoding the program at the specified time, a mask command that starts encoding a still image (black), and a file command that starts encoding a specified alternative video. The next organization information entry is sequentially retrieved from the organization information management file 271 in order of earliest entry to the next organization information entry retrieval unit 272. When a comparison of one organization information entry is performed in the comparison unit 276 and a switch is made by the switch 242, the next organization information entry is retrieved from the organization information management file 271 to the next organization information entry retrieval unit 272, and the next switch is prepared.
[0083] On the other hand, the TS stream is supplied to the decoding unit 222 and also to a frame PTS time generation unit 273. The frame PTS time generation unit 273 extracts the ToT from the TS stream, holds the clock at that time, and converts the PTS of the frame to be processed into a frame PTS time in year / month / day / minute / second format (YYYY-MM-DDT12:MM:SS:mm+0900 format) based on the latest ToT and the clock at the time of receiving the latest ToT. This frame PTS time is held and managed in a frame PTS time file management unit 274. A processing target frame PTS time extraction unit 275 sequentially extracts the frame PTS times for the frames to be processed (encoded), and a comparison unit 276 compares them at the frame rate (frame intervals). The comparison unit 276 identifies the frame closest to the time of the next organization information entry extracted by the next organization information entry extraction unit 272, and switches the switch 242 at that time (clock).
[0084] In the examples of Figures 17 and 24, the insertion of alternative content is performed by the communication network distribution subsystem 200, but as shown by the dashed line in Figure 8, an insertion video playback unit 380 may be provided by the mobile terminal application 325A, and the introduction operation may be performed by the mobile terminal 300.
[0085] The insertion control data, for example, the designation of alternative content, may be dynamically provided with reference to profile information and various history information of the user of the mobile terminal 300. The user may select alternative content or a group of alternative content that may be displayed on the mobile terminal 300 using an alternative content designation unit that may be included as part of the video and audio stream playback unit 360. Based on the playback history of alternative content (commercial videos), a specific played alternative content may be made individually playable using the played alternative content designation unit (video and audio stream playback unit 360).
[0086] FIG. 20 illustrates an example of configuring the insertion video playback unit 380 in a manner similar to the insertion of subtitle data described with reference to FIG. 12. In the example of FIG. 20, an alternative content insertion instruction is received by the polling control unit 375, stored by the message management file storage unit 373, and alternative content stored in the alternative data storage unit 374A is used to perform the alternative content insertion process. That is, the switching control unit 371A controls switching between the video / audio stream (video stream) and the alternative content. In this example, the break point and restart point may be determined using a correction PCR, as in the example of FIG. 12. The time information of the break point and restart point provided by the insertion information transmission unit 140 is specified in a year / month / day / hour / minute / second format, which can be mutually converted to and from the correction PCR using a Time Offset Table (ToT). The ToT is also preferably transmitted to the mobile terminal 300. The alternative content storage unit 374A may be a buffer device and may be stored in a server (storage device) on the communication network 500.
[0087] Figure 21 explains an example of a processing flow using subtitle data as an example; in the variation of Figure 20, processing may be performed in a similar manner when inserting other alternative content. In Figure 21, IP receiving device 210 of communication network distribution subsystem 200 receives TS packets of a broadcast service TS stream from broadcaster subsystem 100 and supplies them to subtitle data extraction unit 231 (X01). Subtitle data extraction unit 231 then transmits the TS packets of the subtitle data to subtitle data distribution unit (server) 250 (X02). Subtitle data distribution unit 250 stores the subtitle data in the subtitle data storage management unit and, correspondingly, updates the message management data (message management file) in message management file holding unit 260 (X03). In long polling processing portion X04, application 325A of mobile terminal 300 first retrieves message management data (X05). In response, subtitle data distribution unit 250 returns the latest message management data to application 325A (X06). The subtitle data distribution unit 250 repeatedly returns updated message management data to the application 325A each time an update is made (X07). The application 325A interprets the message management data acquired in steps X06 and X07 line by line, and if it is a subtitle message, it retrieves the subtitle data acquired in step X03 (X08), and the subtitle data distribution unit 250 sends the subtitle data to the application 325A in response (X09). The application 325A performs display processing at an appropriate time based on the contents of the message management data and subtitle data, and the subtitles are displayed to the user (X10, X11).
[0088] FIG. 22 shows an example of a message. As previously shown with reference to FIG. 3, the message includes the message execution time (also referred to as the firing time) in the first column, the message type (also referred to as the entity type) in the second column, the entity file name in the third column, and additional information in the fourth column (FIG. 22(A)). In the specific example of FIG. 22(B), the message execution time is "2016-04-20T13:02:15.588+0900," the message type is "cap_packet," the entity file name is " / tvmock / 20160420 / 7fe4.7fe4.0420 / cap / 00055002," and no additional information is included. The message type "cap_packet" indicates that the message is related to subtitles, and the entity file name " / tvmock / 20160420 / 7fe4.7fe4.0420 / cap / 00055002" indicates that subtitle data is stored in the entity file name. The main message types are as shown in FIG.
[0089] As described above, "pmt_changed" in FIG. 23 is used to control the display timing of the subtitle data.
[0090] 20, the communication network delivery subsystem 200 transfers insertion control data (message) for the alternative content to the insertion video playback unit 380 of the mobile terminal 300 to switch the display of the alternative content, and in Fig. 12, the communication network delivery subsystem 200 transfers a message for subtitle display (subtitle display instruction) to the subtitle data playback unit 370 of the mobile terminal 300 to display subtitles (overlaid on the video or displayed in a display area separate from the video), but in a similar manner, any text information may be displayed on the mobile terminal 300. For example, the communication network subsystem 200 may store a display control message for predetermined text information (advertisements, viewer messages, official information, etc.) in a message management file storage unit and transfer this to the mobile terminal 300, and the mobile terminal 300 may use this display control message to retrieve corresponding text information stored and managed in the communication network subsystem 200 or any other site, and display, erase, or move the text information at the timing instructed by the display control message. The timing of display, erasure, etc. may be based on the system clock of the broadcaster subsystem 100 (the clock in the broadcast service TS packet) or the system clock of the communication network distribution subsystem 200, and a flag may be used to specify which clock to use. This text information may be displayed in an auxiliary viewing area (for example, a window labeled "Subtitles" in Fig. 9) provided separately from the video viewing area A of the mobile terminal 300 in Fig. 9, but is not limited to this.
[0091] This completes the description of the embodiment of the present invention.
[0092] The present invention is determined based on the claims and is not limited to the specific configurations, problems, and effects of the embodiments. The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the spirit of the present invention.
[0093] For example, although the above embodiment has been described in relation to a mobile terminal, the present invention may be widely applied to fixed terminals and network television receivers. Some of the technical features described herein are listed below. [Technical feature 1] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; a characteristic determination means for determining the characteristics of the TS stream of the broadcast service reconstructed by the reconstruction means; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmitting means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcasting service communication network distribution device characterized in that the IP distribution conversion means is configured to generate a video stream in the IP distribution format in a standard format based on the characteristics determined by the characteristic determination means. [Technical feature 2] A broadcasting service communication network distribution device according to Technical Feature 1, wherein the audio mode in the video stream in the IP distribution format generated in the standard format is a stereo audio mode. [Technical feature 3] A broadcast service communication network distribution device according to Technical Features 1 or 2, wherein the video mode in the IP distribution format generated in the standard format is high-definition mode. [Technical feature 4] A broadcast service communication network distribution device described in any one of technical features 1 to 3, wherein the IP distribution conversion means generates a number of video streams in the IP distribution format corresponding to N (N is an integer greater than or equal to 2) organized channels from the TS stream of the broadcast service. [Technical feature 5] The N number of organization channels is two organization channels, and even if the TS stream of the broadcast service contains only one organization channel, the broadcast service communication network distribution device described in Technical Feature 4 generates a number of video streams in the IP distribution format corresponding to the two organization channels. [Technical feature 6] The broadcast service communication network distribution device according to any one of technical features 1 to 5, wherein the IP distribution conversion means generates the number of video streams in the IP distribution format according to two modes, main audio and secondary audio. [Technical feature 7] The broadcast service communication network distribution device described in Technical Feature 6, wherein the IP distribution conversion means generates a number of video streams in the IP distribution format corresponding to the two modes even if the TS stream of the broadcast service does not include secondary audio. [Technical feature 8] A broadcast service communication network distribution device according to any one of technical features 1 to 7, wherein the IP distribution conversion means generates a number of video streams in the IP distribution format corresponding to two viewing selections: subtitle display and subtitle non-display. [Technical feature 9] The broadcast service communication network distribution device described in Technical Feature 8, wherein the IP distribution conversion means generates a number of video streams in the IP distribution format corresponding to the two viewing selection numbers, even if the TS stream of the broadcast service does not include subtitle data. [Technical feature 10] The broadcast service communication network distribution device according to any one of Technical Features 1 to 9, wherein the video stream has a series of video files that are played back sequentially according to an index file. [Technical feature 11] 11. The broadcast service communication network distribution device according to any one of Technical Features 1 to 10, wherein the video stream in the IP distribution format is a streaming video stream. [Technical feature 12] 12. The broadcast service communication network distribution device according to any one of Technical Features 1 to 11, wherein the transmission stream is a TS stream of the broadcast service that has been IP packetized. [Technical feature 13] The above IP distribution conversion means is: a demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream; a decoding means for decoding the video stream and the audio stream output from the demultiplexing means to generate a video signal and an audio signal; a standard mode conversion means for converting the video signal and audio signal into a standard mode; 13. The broadcast service communication network distribution device according to any one of Technical Features 1 to 12, further comprising: encoding means for encoding the standard mode video signal and audio signal to generate a moving image stream in the IP distribution format. [Technical feature 14] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmitting means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcast service communication network distribution device characterized in that, when the TS stream of the broadcast service includes subtitle data, the IP distribution conversion means generates a video stream in the IP distribution format from the video stream and audio stream generated by the video / audio stream generation means, and also generates another video stream in the IP distribution format from the video stream of a composite video in which subtitles based on the subtitle data are added to the video of the video stream and the audio stream. [Technical feature 15] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmitting means for transmitting the video stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcast service communication network distribution device characterized in that the IP distribution conversion means is configured to receive information specifying the start and end of a time interval and alternative content, and to replace the video stream in the IP distribution format with the alternative content in the section specified by the start and end. [Technical feature 16] A broadcasting service communication network distribution device according to Technical Feature 15, wherein the alternative content is a video stream segment and an audio stream segment or a still image and a predetermined audio. [Technical feature 17] The IP distribution conversion means has a demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream, and uses alternative content instead of the video signal and audio signal decoded from the video stream and audio stream in the section defined by the start and end dates. This is a broadcast service communication network distribution device described in Technical Feature 15 or 16. [Technical feature 18] A broadcast service communication network distribution device as described in Technical Features 16 or 17, in which the start and end of the time interval are displayed in year, month, day, hour, minute, and second, and are compared to the time based on a clock that conforms to a time offset table and the TS stream of the broadcast service. [Technical feature 19] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network; and control information supply means for receiving information specifying the start and end of a time interval and alternative content, and supplying control information to the client device so as to replace the section of the video stream defined by the start and end with the video stream segment. [Technical feature 20] Technical feature 19: A client terminal connected to the broadcast service communication network distribution device via a communication network, a video stream playback means for receiving the video stream in the IP distribution format from the transmission means of the broadcast service communication network distribution device and playing it back; The client terminal is characterized in that the video stream playback means is configured to receive the alternative content from the control information supply means of the broadcast service communication network distribution device and play the alternative content in place of the video stream at a playback time corresponding to the start and end of the time interval. [Technical feature 21] The format for the IP distribution is HLS (HTTP Live Streaming, Apple Inc., both trademarks), and the video stream playback means plays the alternative content in place of the video stream in accordance with the EXT-PROGRAM-DATE-TIME of the video stream file. [Technical feature 22] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network; an alternative content distribution control means for controlling transmission of alternative content to be substituted for the video stream or the audio stream during a designated period of time to the client terminal via the network; The alternative content distribution control means an index file storage means for storing an index file that makes insertion control information accessible in units of replacement operations; means for transmitting the index file to the client terminal via the network in response to polling from the client terminal; The client terminal uses the insertion control information to obtain the alternative content from a predetermined alternative content storage means and replaces the video stream and the audio stream with the alternative content for a predetermined period of time. [Technical feature 23] A client terminal connectable to a network, a video and audio stream receiving means for receiving, from a transmitting device, a video and audio stream extracted from a broadcast stream and transmitted via the network in a streaming format; an alternative content receiving means for receiving the alternative content stored in the alternative content storage means via the network; The alternative content receiving means an index file receiving means for receiving, by polling, from the transmitting device an index file that enables the alternative content stored in the alternative content storage means to be accessed in units of replacement operations; and a means for receiving the alternative content stored in the alternative content storage means in units of replacement operations, using the index file received by the index file receiving means. [Technical Feature 24] Client terminals that can connect to the network a video and audio stream receiving means for receiving, from a transmitting device, a video and audio stream extracted from the broadcast stream and transmitted via the network in a streaming manner; A computer program used to cause an alternative content receiving means that receives alternative content stored in an alternative content storage means via the network to execute the alternative content, The alternative content receiving means an index file receiving means for receiving, by polling, from the transmitting device an index file that enables the alternative content stored in the alternative content storage means to be accessed in units of replacement operations; and means for receiving the alternative content stored in the alternative content storage means in units of replacement operations, using the index file received by the index file receiving means. [Explanation of symbols]
[0094] 100 Broadcaster Subsystem 110 Broadcast service TS stream output unit 120 Uplink section 130 IP transmission device 140 Insertion information sending unit 200 Communications Network Distribution Subsystem 210 IP receiving device 220 Video and audio transcoding section 221 Demultiplexer 222 Decoding section 223 Standard mode conversion unit 224 Encoding Section 225 TS stream characteristics determination unit 228 Program Table 229 Video Composition Unit 230 Video and Audio Distribution Department 231 Subtitle Data Extraction Unit 240 Video and Audio Distribution Department 241 Alternative Content Input Section 242 Switch 250 Subtitle Data Distribution Department 260 Message Management File Storage Unit 270 Insertion control section 300 mobile devices 300A display 325A Internet-delivered TV broadcast viewing application 360 video and audio stream playback section 370 Subtitle data playback unit 371 Subtitle display area 372 Correction PCR generation section 373 Message Management File Storage Unit 374 Subtitle data storage unit 374A Alternative Data Storage Unit 375 Polling control section 380 Inserted Video Playback Section 400 Gateway 500 Communication Network 600 Authentication Server 700 lines
Claims
1. a characteristic determination means for determining characteristics related to an audio mode, a video mode, and the number of channels of a TS stream of a broadcast service; a conversion means for IP distribution that converts a video stream and an audio stream included in the TS stream of the broadcast service into a video stream in a format suitable for IP distribution; a transmitting means for transmitting the moving picture stream in the IP distribution format generated by the conversion means for IP distribution to a client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcast service communication network distribution device characterized in that the IP distribution conversion means is configured to generate a video stream in the IP distribution format in a predetermined single standard format based on the characteristics regarding the audio mode, video mode, and number of channels of the TS stream of the broadcast service determined by the characteristic determination means.
2. a characteristic determination step of determining characteristics related to an audio mode, a video mode, and the number of channels of a TS stream of a broadcast service; a conversion step for IP distribution of converting a video stream and an audio stream included in the TS stream of the broadcast service into a video stream in a format suitable for IP distribution; a transmitting step of transmitting the video stream in the IP distribution format generated by the conversion step to a client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcasting service communication network distribution method characterized in that in the conversion step for IP distribution, a video stream in the IP distribution format is generated in a single predetermined standard format based on the characteristics of the TS stream of the broadcasting service determined in the characteristic determination step, regarding the audio mode, video mode, and number of channels.
3. a processor of a communications network distribution subsystem, a characteristic determination means for determining characteristics related to an audio mode, a video mode, and the number of channels of a TS stream of a broadcast service; a conversion means for IP distribution that converts the video stream and audio stream included in the TS stream of the broadcast service into a video stream in a format for IP distribution; and a transmitting means for transmitting the moving picture stream in the IP distribution format generated by the conversion means for IP distribution to the client terminal via the communication network in response to a request from the client terminal on the communication network; A computer program for causing a computer to execute the program as follows: The conversion means for IP distribution is configured to generate a video stream in the IP distribution format in a single predetermined standard format based on the characteristics of the TS stream of the broadcasting service determined by the characteristic determination means, including the audio mode, video mode, and number of channels.
Citation Information
Patent Citations
Content reception system, device and method, recording medium, and program
JP2005267172A
Broadcast content provision system, broadcast content provision device, reproducer, and advertisement provision device, and their control method and control program
JP2017050631A
Broadcast service retransmission system and viewing portable terminal
JP2017188891A
Retransmission system, retransmission device, reception device, and program
JP2019110482A
Device and method for receiving media content
US20150012956A1