Broadcast service communication network distribution device and method

The broadcast service communication network distribution device addresses the challenge of distributing varied video and audio contents by converting TS streams into a standardized IP distribution format, enhancing efficiency and uniformity in service delivery.

JP2025092798AActive Publication Date: 2025-06-20KABUSHIKI KAISHA INFOCITY
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2025033442
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-12-27
Filing Date
2025-03-04
Publication Date
2025-06-20
Estimated Expiration
2040-01-22

AI Technical Summary

Technical Problem

Existing broadcast service communication networks face challenges in simultaneously distributing video and audio contents with varying qualities and formats over a communication network, leading to increased costs and difficulties in uniform service provision.

Method used

A broadcast service communication network distribution device that includes reconstruction means, characteristic determination means, IP distribution conversion means, and transmission means. This device converts TS streams into IP distribution format, allowing for standardization and transmission of video and audio streams in various formats and qualities.

Benefits of technology

Enables efficient and standardized distribution of broadcast services over communication networks, supporting multiple video and audio formats, resolutions, and audio standards, thereby reducing costs and improving service uniformity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025092798000001_ABST
    Figure 2025092798000001_ABST
Patent Text Reader

Abstract

To provide broadcast service communication network distribution device, method, and program for displaying designated auxiliary information in an auxiliary viewing area for a designated period in network distribution of a broadcast service.SOLUTION: A broadcasting organization subsystem 100 has an insertion information sending unit 140, and the insertion information sending unit 140 supplies information for replacing commercial video / audio and copyright-infringing video / audio with alternative contents to an insertion control unit 270 of the communication network distribution subsystem 200. The insertion control unit replaces commercial video / audio and copyright-infringing video / audio with alternative contents between a cut point and a restart point on a frame-by-frame basis. In a similar manner to alternative content insertion, a polling control unit of a mobile terminal 300 receives a message and, based on time information of the message, obtains text information such as advertisements, viewer messages, and public information from an arbitrarily specified site, and displays it in a video viewing area or auxiliary viewing area for a specified period of time.SELECTED DRAWING: Figure 17
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a broadcast service communication network distribution technology for distributing a television broadcast service using a communication network.

Background Art

[0002] It is desired that a broadcaster simultaneously distributes video and audio contents provided in a broadcast service using a communication network. By the way, when a broadcaster prepares distribution data for a communication network at each business base, the cost burden increases. In addition, it is difficult to uniformly provide various services and qualities provided by a broadcast service over a communication network. For example, conventionally, a streaming-type communication network distribution service compliant with the HTTP protocol has been widely used. Since these distribution services assume distribution in units of events or programs, it is difficult to continuously distribute a plurality of programs with different possible qualities by specifying an edited channel. A video distribution service based on HLS (HTTP Live Streaming, Apple Inc., USA) prepares a playlist file (for example, an m3u8 file) and one or a plurality of video segment files (MPEG2-TS segment files) as shown in FIG. 25. In the example of FIG. 25, a plurality (two) of alternative playlists with different resolutions can be selected using a master index file. Only one playlist may be used. The alternative playlist (playlist) is rewritten and repeatedly transmitted. The viewing client refers to the playlist and sequentially extracts video segment files as shown in FIG. 25 to perform video playback (FIG. 26). However, it does not support continuously viewing programs (videos) with different resolutions and formats or programs with different audio standards.

[0003] Even when the standards and resolutions are different, it is desired to reliably distribute the broadcast service via a communication network.

[0004] Note that as a patent document related to this invention, there is Japanese Patent Application Laid-Open No. 2018-188891 of the applicant of this application.

[0005] The above-mentioned prior art and its problems are described only for explaining a part of the background of this invention. It should be noted that this invention is not limited to the above-mentioned prior art and problems.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] This invention has been made in consideration of the above circumstances, and an object thereof is to realize a scheme suitable for simultaneously distributing video and audio contents provided in a broadcast service via a communication network.

Means for Solving the Problems

[0008] According to this invention, in order to achieve the above object, a configuration as described in the claims is adopted. Here, prior to explaining the invention in detail, supplementary explanations will be given regarding the description in the claims.

[0009] That is, according to one aspect of the present invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcast service into a transmission stream for communication network transmission, and reconstructing the TS stream of the broadcast service from the transmission stream; characteristic determination means for determining the characteristics of the TS stream of the broadcast service reconstructed by the reconstruction means; IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting, via the communication network, the video stream in the format for IP distribution generated by the IP distribution conversion means to a client terminal in response to a request from the client terminal on the communication network. The IP distribution conversion means is configured to generate the video stream in the format for IP distribution in a standard format based on the characteristics determined by the characteristic determination means. The video stream in the format for IP distribution may separately include a video stream and an audio stream. The same applies hereinafter.

[0010] According to this configuration, since a video stream in a format for IP distribution is generated in a standard manner, it is possible to handle various broadcast programs.

[0011] In this configuration, the audio mode in the video stream in the format for IP distribution generated in the standard format may be a stereo audio mode.

[0012] In this configuration, the video mode in the video stream in the format for IP distribution generated in the standard format may be a high-definition mode.

[0013] In this configuration, the IP distribution conversion means may generate a number of video streams in the format for IP distribution corresponding to N (N is an integer of 2 or more) compiled channels from the TS stream of the broadcast service.

[0014] In this configuration, the above N programming channels are two programming channels, and even if the TS stream of the above broadcast service contains only one programming channel, it is possible to generate the number of video streams in the above IP distribution format corresponding to the two programming channels.

[0015] In this configuration, the above IP distribution conversion means may generate the number of video streams in the above IP distribution format corresponding to the two modes of main audio and sub-audio.

[0016] In this configuration, the above IP distribution conversion means may generate the number of video streams in the above IP distribution format corresponding to the two modes even when the TS stream of the above broadcast service does not contain sub-audio.

[0017] In this configuration, the above IP distribution conversion means may generate the number of video streams in the above IP distribution format corresponding to the two viewing selections of subtitle display and non-display.

[0018] In this configuration, the above IP distribution conversion means may generate the number of video streams in the above IP distribution format corresponding to the above two viewing selections even when the TS stream of the above broadcast service does not contain subtitle data.

[0019] In this configuration, the above video stream may have a series of video files that are sequentially played by an index file.

[0020] In this configuration, the video stream in the above IP distribution format may be a streaming video stream.

[0021] In this configuration, the streaming method complies with the HTTP protocol. For example, it may be HLS (HTTP Live Streaming, Apple), MPEG-DASH, Smooth Streaming (Microsoft), or HTTP Dynamic Streaming (Adobe Systems). Other methods other than HTTP streaming such as RTS (Real Time Streaming Protocol) and RTMP (Real Time Messaging Protocol) may also be adopted.

[0022] In this configuration, the transmission stream may be the TS stream of the broadcast service packetized into IP packets.

[0023] In this configuration, the IP distribution conversion means may include: a demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream; a decoding means for decoding the video stream and the audio stream output from the demultiplexing means to generate a video signal and an audio signal; a standard mode conversion means for converting the video signal and the audio signal into a standard mode; and an encoding means for encoding the video signal and the audio signal in the standard mode to generate a video stream in the IP distribution format.

[0024] In this configuration, the video stream in the IP distribution format generated in the standard format may have a plurality of selectable sets of video streams.

[0025] In this configuration, one set of video streams among the plurality of selectable sets of video streams may include subtitle display, and the other set of video streams may not include subtitle display.

[0026] According to another aspect of the present invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcast service into a transmission stream for communication network transmission and reconstructing the TS stream of the broadcast service from the transmission stream; IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting, in response to a request from a client terminal on the communication network, the video stream in the format for IP distribution generated by the IP distribution conversion means via the communication network. When subtitle data is included in the TS stream of the broadcast service, the IP distribution conversion means generates, in addition to the video stream in the format for IP distribution for the video stream and the audio stream generated by the video / audio stream generation means, another video stream in the format for IP distribution from a video stream of a composite video with subtitles based on the subtitle data added to the video of the video stream and the audio stream.

[0027] In this configuration, subtitle data can be easily handled.

[0028] Also, according to the technical features related to this invention, a broadcast service communication network distribution device includes: reconstruction means for receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcast service into a transmission stream for communication network transmission and reconstructing the TS stream of the broadcast service from the transmission stream; IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; and transmission means for transmitting, in response to a request from a client terminal on the communication network, the video stream in the format for IP distribution generated by the IP distribution conversion means via the communication network. The IP distribution conversion means is configured to receive information specifying a start period and an end period of a time interval and alternative content, and replace the video stream in the format for IP distribution with the alternative content in a section defined by the start period and the end period.

[0029] According to this configuration, it is possible to easily handle commercials and copyright issues of the broadcast service.

[0030] In this configuration, the alternative content may be a video stream segment and an audio stream segment or a still image and predetermined audio.

[0031] In this configuration, the IP distribution conversion means may include demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the reconstruction means to generate a video stream and an audio stream, and using the alternative content instead of video signals and audio signals decoded from the video stream and the audio stream in a section defined by the start period and the end period.

[0032] In this configuration, the start and end times of the time interval are displayed in year-month-day hour-minute-second format, and can be compared with the time displayed in year-month-day hour-minute-second format in the time offset table and the time based on the clock compliant with the TS stream of the broadcast service.

[0033] Also, according to other technical features related to this invention, the broadcast service communication network distribution device includes: reconstruction means for receiving a transmission stream obtained by converting the TS stream of the broadcast service for communication network transmission via the communication network and reconstructing the TS stream of the broadcast service from the transmission stream; IP distribution conversion means for converting the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; transmission means for transmitting the video stream in the format for IP distribution generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network; and control information supply means for receiving information specifying the start and end times of the time interval and alternative content and supplying control information to the client device so as to replace the section defined by the start and end times of the video stream with the video stream segment.

[0034] According to this configuration, it is possible to easily handle commercials and copyright issues of the broadcast service.

[0035] According to other technical features related to this invention, a client terminal connected to the above broadcast service communication network distribution device via a communication network has: a video stream playback means for receiving and playing back a video stream in the format for IP distribution from the above transmission means of the above broadcast service communication network distribution device; the above video stream playback means is configured to receive from the above control information supply means of the above broadcast service communication network distribution device and play back the above alternative content instead of the above video stream at the playback times corresponding to the start and end periods of the above time interval.

[0036] According to this configuration, commercial and copyright issues of the broadcast service can be easily addressed.

[0037] In this configuration, the above format for IP distribution is HLS (HTTP Live Streaming, both trademarks of Apple Inc.), and the above video stream playback means may play back the above alternative content instead of the above video stream based on the EXT-PROGRAM-DATE-TIME of the file of the above video stream.

[0038] According to other technical features related to this invention, a broadcast service communication network distribution device includes: a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for transmission over a communication network, and reconstructing the TS stream of the broadcast service from the transmission stream via the communication network; an IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; a transmission means for transmitting the video stream in the format for IP distribution generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network; and an alternative content distribution control means for controlling so that alternative content to be replaced with the video stream or the audio stream during a specified period is transmitted to the client terminal via the network. The alternative content distribution control means includes: an index file storage means for storing an index file that makes insertion control information accessible in units of replacement operations; and means for transmitting the index file to the client terminal via the network in response to polling from the client terminal. The client terminal uses the insertion control information to acquire the alternative content from a predetermined alternative content storage means and replace the video stream and the audio stream with the alternative content for a predetermined period.

[0039] According to this configuration, it is possible to easily handle commercials and copyright issues of broadcast services.

[0040] Also, according to other technical features related to this invention, a client terminal connectable to a network includes: video and audio stream receiving means for receiving, from a transmitting device, a video and audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner; and alternative content receiving means for receiving, via the network, alternative content stored in alternative content storage means. The alternative content receiving means includes: index file receiving means for receiving, by polling from the transmitting device, an index file that makes the alternative content stored in the alternative content storage means accessible in a replacement operation unit; and means for receiving, in the replacement operation unit, the alternative content stored in the alternative content storage means using the index file received by the index file receiving means.

[0041] Also, in this configuration, the terminal is typically a mobile terminal or a mobile communication terminal that communicates based on mobile communication, but may also be a fixed terminal. The portable terminal or mobile communication terminal is typically a mobile phone, but may be any device including a portable computer, a tablet computer, a media player, a personal digital assistant, and combinations of two or more of these products.

[0042] According to this configuration, it is possible to easily handle commercials and copyright issues of broadcast services.

[0043] Note that this invention can be realized not only as an apparatus or a system but also as a method. Of course, a part of such an invention can be configured as software. Naturally, a software product used to cause a computer to execute such software is also included in the technical scope of this invention.

[0044] The above aspects and other aspects of this invention are described in the claims and will be detailed below using examples.

Advantages of the Invention

[0045] According to this invention, since a video stream in a format for IP distribution is generated in a standard manner, it is possible to handle various broadcast programs.

Brief Description of the Drawings

[0046]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Embodiments for Carrying Out the Invention

[0047] Hereinafter, embodiments of the present invention will be described.

[0048] FIG. 1 shows an overall example applied to a digital TV distribution system that performs IP simultaneous distribution of digital TV broadcasts (terrestrial digital TV broadcasts, BS, and CS digital TV broadcasts) of the present invention. In this figure, the broadcaster subsystem 100 is a subsystem operated by a backbone broadcaster, and acquires a TS stream of a broadcast service before uplink and transmits it to the communication network distribution subsystem 200 using the communication network 500 (Internet) or a predetermined line 700. The communication network distribution subsystem 200 may be operated by the backbone broadcaster or a third party. This subsystem 200 demultiplexes the transmitted TS stream to obtain video and audio streams (e.g., MPEG-2 TS), transcodes this video and audio stream into a predetermined format (such as HLS, MPEG-DASH, etc.) for IP re-distribution, and distributes it to the mobile terminal 300. The communication network distribution subsystem 200 is connected to the communication network 500, typically the Internet. At least a part of the communication network 500 may be composed of a CDN (Content Delivery Network) service. The mobile terminal 300 is connected to the communication network 500 via the gateway 400 of the mobile carrier. Also, an authentication server 600 may be connected to the communication network 500 to authenticate requests from the mobile terminal 300 regarding the IP distribution service. The communication network distribution subsystem 200 is provided at a site different from the broadcaster subsystem 100 of the backbone broadcaster. The communication network distribution subsystem 200 may provide services to the broadcaster subsystems of other business bases or the broadcaster subsystems of different backbone broadcasters via the communication network 500, and may be efficiently utilized as a so-called cloud system by using communication lines from a plurality of bases with few system resources. The line 700 may use an optical fiber transmission line or an SDI transmission line. The broadcaster subsystem 100 and the communication network distribution subsystem 200 may each be composed of server computers.

[0049] FIG. 2 illustrates a configuration example of the main parts of each of the broadcaster subsystem 100, the communication network distribution subsystem 200, and the mobile terminal 300, and other configuration examples may be adopted as appropriate. The subsystems 100 and 200 may be configured by appropriately combining a server device (processor) or the like. In FIG. 2, the broadcaster subsystem 100 includes a broadcast service TS stream output unit 110, an uplink unit 120, an IP transmitter 130, and the like. The broadcast service TS stream output unit 110 outputs a broadcast service TS stream formed by multiplexing a video stream, an audio stream, and data. The uplink unit 120 transmits and modulates the broadcast service TS stream and broadcasts it via a transmission antenna. The IP transmitter 130 receives the broadcast service TS stream, converts it into IP packets, and transmits the broadcast service TS stream via the communication network to the communication network distribution subsystem 200 using the IP protocol.

[0050] The communication network distribution subsystem 200 includes an IP receiver 210, a video / audio transcoder 220, a video / audio distributor 230, etc. The IP receiver 210 receives IP packets transmitted from the IP transmitter 130 of the broadcasting service subsystem 100 and reconstructs the TS stream of the broadcasting service. Regarding the IP transmission of the TS stream, for example, there is an explanation in Pro-MPEG Code of Practice #3 release 2, July 2004, "Transmission of Professional MPEG-2 Transport Streams over IP Networks". The video / audio transcoder 220 converts the MPEG-2 TS packets of video / audio into a streaming file in the HTTP streaming method (typically the HLS method). The video / audio distributor 230 distributes the video / audio stream to the mobile terminal 300 in the HTTP streaming method. The video / audio transcoder 220 is configured to output the video / audio stream in a predetermined standard form regardless of the configuration of the TS stream of the broadcasting service. The standard form is, for example, stereo mode for audio, HD mode for video, and two channels for the number of channels. This will be explained with examples later.

[0051] Note that the communication network distribution subsystem 200 may obtain subtitle data from the TS stream of the broadcasting service and distribute it to the mobile terminal 300 by, for example, HTTP long polling. This will be explained later in an alternative embodiment.

[0052] The mobile terminal 300 displays the video 300 distributed by HTTP streaming on the display unit 300A (Figure 2). Also, as will be explained later, when subtitle data (300B) is distributed using the message management file transmitted by HTTP long polling, the subtitle data (300B) may be superimposed on the video of the display unit 300A or displayed in a separate display area (see Figure 9).

[0053] FIG. 3 shows a configuration example of the video / audio transcoding unit 220 in FIG. 2. In this figure, the video / audio transcoding unit 220 includes a TS demultiplexing unit 221, a decoding unit 222, a standard mode conversion unit 223, an encoding unit 224, a TS stream characteristic determination unit 225, and the like. In FIG. 3, the TS demultiplexing unit 221 demultiplexes the TS stream of the broadcast service to generate a video stream and an audio stream. The decoding unit 222 decodes the MPEG code to generate a video signal and an audio signal. The TS stream characteristic determination unit 225 determines the characteristics of the TS stream of the broadcast service, the number of channels, subtitle data, video mode, audio mode, and the like. The standard mode conversion unit 223 performs output conversion in a predetermined form. For example, it converts the input video signal and input audio signal and further outputs in two channels. In this example, the number of outputs is basically two channels, and the video signal and audio signal of these two channels are supplied to the encoding unit 224. The standard mode conversion unit 223 may output the video signal and audio signal in the standard mode as they are when they are input. The encoding unit 224 converts the input two-channel video signal and audio signal into a streaming format video file, for example, a streaming file in the HTTP streaming method (typically the HLS method). In the example of FIG. 3, the first video streaming file 226 and the second video streaming file 227 are output. The first video streaming file 226 has the video in the HD mode and the audio in stereo, and the second video streaming file 227 also has the video in the HD mode and the audio in stereo. The standard mode may be in other modes, for example, the video in the SD mode and the audio in the monaural mode.

[0054] When the TS stream of the broadcast service includes only one channel, the first video stream and the second video stream are the same. When the TS stream of the broadcast service includes two different channels, the first video stream corresponds to a different video stream for a different channel from the second video stream.

[0055] The video / audio transcoding unit 220 generates a program table 228 indicating what the plurality of video streams are like. The program table 228 may display which composition channel the video stream is on. When a plurality of video streams are viewable, for example, in HLS, selectable groups may be specified using the "EXT-MEDIA" tag.

[0056] The TS stream characteristic determination unit 225 may include a video mode determination unit 225A, an audio mode determination unit 225B, a multi-channel determination unit 225C, and the like. The audio mode determination unit 225B determines the number of audio PES (Packetized Elementary Streams) and the audio mode within each audio PES. When there are a plurality of audio PESs described in the PMT (Program Map Table), the audio mode determination unit 225B determines that there is a secondary audio in addition to the main audio. Further, the audio mode determination unit 225B determines the mode as follows from the content of "channel_configuration" (3 bits) of "adts_fixed_header" of "adts_frame" in the header part within the audio PES. 1: Monoral 2: Stereo 6: 5.1 channels (SS) 0: Dual mono (including main audio and secondary audio in one audio PES)

[0057] When the audio is in the monoral mode, the left and right stereo elements are made the same. The 5.1-channel mode audio uses only stereo components.

[0058] Taking into account the secondary audio, the number of channels of a standard video stream may be four as shown in Fig. 6(A). In Fig. 6(A), the video streams of the first channel (HD / stereo / main audio), the second channel (HD / stereo / main audio), the first channel (HD / stereo / secondary audio), and the second channel (HD / stereo / secondary audio) may be output in a standard form. When there is no secondary audio, all video streams may include the main audio redundantly.

[0059] In the mobile terminal 300, for example, as shown in Fig. 10(A), valid programs are displayed based on the information in the program table 228, and invalid programs (those overlapping with valid programs) may be grayed out and made unselectable, but it is not limited to this. In the example of Fig. 10(A), "Channel 01" is selectable, and "Channel 02" with the same content is made unselectable. If they have different contents, both are selectable. By making a selection, a video file can be streamed and played back from the destination. In the case of the video streams shown in Fig. 6(A) (when there are four), as shown in Fig. 10(B), it is possible to select between the main audio and the secondary audio. Also in this example, the grayed-out ones are unselectable due to the same content.

[0060] The configuration example of the mobile terminal 300 and the like will be further described later with reference to Figs. 7, 8, 9, etc.

[0061] The video mode determination unit 225A determines the video mode such as the resolution by the value of "video¥encode¥format" in the "descriptor" included in the PMT, or by decoding the MPEG2 video transmitted in the video PES and referring to the "sequence header" therein. The standard video mode is HD (high definition).

[0062] The multi-channel discrimination unit 225C determines whether there are a plurality of channels (services) in the TS stream. For example, if there are two channels, they are treated as two standard video and audio streams. If there is only one channel, two identical video streams are generated. The number of channels can be determined by whether a plurality of services (PMTs) are described in the PAT. Whether two channels have the same content can be determined by the information in the EPG (Electronic Program Guide) or whether the video and audio of each channel are the same.

[0063] FIG. 5 shows an alternative example (220A) of the video and audio transcoding unit 220 described with reference to FIG. 3. In this figure, the video and audio transcoding unit 220A includes a TS demultiplexing unit 221, a decoding unit 222, a standard mode conversion unit 223, an encoding unit 224, a TS stream characteristic discrimination unit 225, a subtitle data extraction unit 231, a video composition unit 229, and the like. In this example, when there is subtitle data, a video stream (stereo, HD) without subtitles and a video stream (stereo, HD) with subtitles are formed. The video signal with subtitles is generated using the video composition unit 229.

[0064] When including both videos with subtitles and videos without subtitles in a standard video stream, the standard video stream will be as shown in FIG. 6(B). Considering the presence or absence of subtitles and both the main audio and the secondary audio, eight standard video streams may be formed as shown in FIG. 6(C).

[0065] The display example of the program selection unit in the mobile terminal 300 is as shown in FIG. 10(A). When the distinction between the main audio and the secondary audio is in the standard format, it will be as shown in FIG. 10(B). The buttons shown in gray may be invalidated as described above, but are not limited to this.

[0066] When making it possible to select a plurality of playlists using the master playlist (master index) described above with reference to FIG. 25, one desired standard format playlist may be specified based on the selection by the program selection unit, and the corresponding media segment files may be sequentially retrieved based on the one desired standard format playlist. When viewing is being performed by selecting one playlist, another playlist may be selected using the program selection unit, the standard format specification may be switched, and the viewing may be switched to that based on the other playlist.

[0067] FIG. 7 shows a configuration example of the mobile terminal 300. In this figure, the mobile terminal 300 includes a processing system 310, a memory 320, an input / output subsystem 330, a high-frequency circuit section 340, and an audio circuit section 350. Each of the components can be realized by hardware, software, or a combination thereof, including, as appropriate, a signal processing integrated circuit and an application-specific integrated circuit. The high-frequency circuit section 340 is used to transmit and receive information to and from other devices over a wireless link or network. To perform this function, it includes, but is not limited to, an antenna system, an RF transceiver, an amplifier, a tuner, an oscillator, a digital signal processor, a CODEC chipset, a memory, and other well-known circuit configurations. The high-frequency circuit section 340 can utilize communication protocols such as time-division multiple access (TDMA), code-division multiple access (CDMA), wireless LAN (IEEE 802.11b, IEEE 802.11a, IEEE 802.11g, and / or IEEE 802.11n), Bluetooth (registered trademark. IEEE 802.15.1), Wi-MAX (IEEE 802.16), etc., but is not limited thereto. The audio circuit section 350 is connected to an audio speaker 351 and a microphone 352. The processing system 310 includes a processor 311, a memory controller 312, and a peripheral device interface 313. The memory 320 stores the code and data executed by the processor 311. The memory 320 may include any storage device such as a RAM, a ROM, a FLASH, a disk drive, a magnetic tape, etc. The processor 311 executes various software components stored in the memory 320. For example, the software components include an operating system 321, a communication module 322, a touch / operation module 323, a graphic module 324, an application 325, a timer module 326, and a web browser module 327. The application 325 includes a browser, an address book, email, encryption, a positioning function such as a global positioning system (GPS), and a two-dimensional barcode decoder. The Internet-delivered TV broadcast viewing application 325A (FIG. 6) of this embodiment is typically realized as one of the applications 325.The input / output subsystem 330 controls the touch panel 331 and the like. In this mobile terminal 300, the function of viewing a TV broadcast service distributed by Internet retransmission is implemented as an application. By installing the corresponding application in the memory 320, the mobile terminal 300 is realized as a terminal for viewing Internet-distributed TV broadcasts.

[0068] FIG. 8 schematically shows the functions realized by the Internet-distributed TV broadcast viewing application 325A. In the figure, the mobile terminal 300 may include a video / audio stream playback unit 360, a subtitle data playback unit 370, an inserted video playback unit 380, etc. as functions. The subtitle data playback unit 370 enables subtitle data to be operated independently of the video stream in the same manner as a normal digital broadcast service, and this will be described later as an alternative embodiment. In this case, a video stream with subtitles (a stream with fixed subtitles superimposed) may or may not be provided.

[0069] The video / audio stream playback unit 360 in FIG. 8 can select a program from a predetermined program guide and display available channels as shown in FIGS. 10(A) and (B), and can select a channel to view from among them and play the video stream. Only the available video stream channels may be displayed.

[0070] In this embodiment, since video streams available in the communication network are generated and output in a standard manner, programs (videos) with different resolutions and formats or programs with different audio standards can be continuously viewed. Also, a composite subtitle service can be treated as a normal video stream.

[0071] FIG. 11 shows an alternative embodiment of the present invention. In this figure, the communication network distribution subsystem 200B includes an IP receiver 210, a video / audio transcoder 220, a video / audio distributor 230, a subtitle data extractor 231, a subtitle data distributor 250, a message management file holder 260, and the like. The video / audio distributor 230 transmits a video / audio stream (video stream) to the mobile terminal 300 in the HTTP streaming method as described above. The subtitle data extractor 231 extracts subtitle data from the broadcast service TS stream, and the video / audio transcoder 220 may include this function. The subtitle data is transmitted to the mobile terminal 300 by HTTP long polling. The distribution of subtitle data (HTTP long polling) will be described in detail later.

[0072] Note that the broadcaster subsystem 100 or the communication network distribution subsystem 200 holds an index file for managing the TS packets of the broadcast TS stream as a message management file in the message management file holder 260. The broadcaster subsystem 100 or the communication network distribution subsystem 200 creates and manages an index (message entry) shown in FIG. 15 every time a TS packet is received. Regarding the subtitle data, subtitle packets as schematically shown in FIG. 16 are held in the data storage management unit in their original form and can be accessed by the path specified by the entity file name attribute of the message.

[0073] The video / audio stream playback unit 360 (Fig. 8) of the mobile terminal 300 decodes the file of video / audio packets distributed from the video / audio distribution unit 240 of the communication network distribution subsystem 200 by HTTP streaming, and displays a moving image in the video viewing area A of the display area of the mobile terminal 300 as shown in Fig. 9, for example. To start viewing a TV broadcast, select and start the corresponding application, and select a channel from an on-screen display or the like similar to a normal TV receiver. Channel switching may be performed based on a swipe. In some cases, an authentication dialog is executed with an authentication server (not shown). The application 325A can acquire channel information for each of the broadcast channels viewable from the authentication server, for example.

[0074] Furthermore, in Fig. 8, the subtitle data playback unit 370 plays back synchronization data such as subtitles. The subtitle data playback unit 370 acquires synchronization data from the subtitle data distribution unit 250 of the communication network distribution subsystem 200 by HTTP long polling, and displays subtitles, character supers, etc. at a timing synchronized with the video / audio streaming. Also, the subtitle data playback unit 370 processes an event message, which is also synchronization data, at a timing synchronized with the video / audio streaming. The content of the BML document may be switched or the like by the event message.

[0075] FIG. 12 illustrates a correction PCR generation unit 372 that controls the synchronization timing in the subtitle data reproduction unit 370. In FIG. 12, the subtitle data reproduction unit 370 includes a subtitle display unit 371, a correction PCR generation unit 372, a message management file holding unit 373, a subtitle data holding unit 374, and a polling control unit 375. The correction PCR generation unit 372 generates a PCR (Program Clock Reference) according to the reproduction status of the video / audio stream reproduction unit 360. The polling control unit 375 performs polling on the subtitle data distribution unit 250 of the communication network distribution subsystem 200, retrieves a new entry (message) from the message management file holding unit 260, adds it to the message management file holding unit 373 of the subtitle data reproduction unit 370, and also adds new subtitle data to the subtitle data holding unit 374. The message management file holding unit 373 and the subtitle data holding unit 374 are configured to delete unnecessary entries. The message management file holding unit 260 of the communication network distribution subsystem 200 is also configured to delete unnecessary entries. The subtitle display unit 371 starts displaying subtitles (including character supers) by referring to the display timing (PST) of subtitle packets in the subtitle data holding unit 374 based on the correction PCR calculated by the correction PCR generation unit 372, and ends the display of subtitles by referring to the erasure timing.

[0076] When the correction PCR generation unit 372 detects a program switch (i.e., the stream configuration of the broadcast program within one channel has changed), it calculates the difference between the date and time when the program switch is detected (the date and time based on the time of the server that creates the message management file) and the date and time of the reproduced video and audio stream (the date and time on the playback time axis, which is based on the time of the server that performs TS transcoding), to obtain the elapsed time from the time of program switch to the date and time on the playback time axis (the elapsed time of PCR). Then, it multiplies this elapsed time by the resolution of the program reference clock (e.g., 90,000 per second) to obtain the elapsed clock. Further, the correction PCR generation unit 372 holds the PCR when the program switch is detected, and calculates the corrected PCR by adding the elapsed clock based on this held PCR (Fig. 14). Such a calculation method is shown in Fig. 13(A). Also, a specific calculation example is shown in Fig. 13(B). The upper limit of PCR is "8589935102". Here, it is assumed that the exact time of the video is set in EXT-PROGRAM-DATE-TIME, and preferably, there is no deviation in the time of the server that creates HLS and performs TS transcoding and the server that creates the message management file in terms of one frame unit. A program switch (i.e., the stream configuration of the broadcast program within one channel has changed) is detected, for example, when the mobile terminal 300 detects that the value of the version number of the PMT (Program Map Table) packet has changed. In a typical example, "pmt_changed" is a message that notifies that the PMT data has changed, and the detection time of the server is transcribed to the message execution time in this message. Also, the server receives the PMT data extracted from the tuner, obtains the PCR from the description location of the PCR described in the PMT, and transcribes it as additional information in the fourth column of the "pmt_changed" message. When the PMT indicates a program switch (i.e., the stream configuration of the broadcast program within one channel has changed), the previous message management data may be cleared.

[0077] Note that the difference between PTS and PCR is obtained, and the difference is added at the time when PCR is received to convert it into real time, which is output to the message management file. Instead of being based on the PCR clock, the display and erasure of subtitles may be controlled in real time.

[0078] FIG. 17 shows still another embodiment of the present invention. In this figure, the broadcaster subsystem 100 has an insertion information transmission unit 140, and the insertion information transmission unit 140 supplies information for replacing commercial video / audio or video / audio that conflicts with copyright with alternative content to the insertion control unit 270 of the communication network distribution subsystem 200. The insertion control unit 270 replaces commercial video / audio or video / audio that conflicts with copyright with alternative content between the cut point and the resume point in units of frames. The cut point, the resume point, and the alternative content are supplied from the insertion information transmission unit 140 of the broadcaster subsystem 100. The alternative content may be arranged in a predetermined site in advance or may be supplied simultaneously. The cut point and the resume point may be determined using PCR and PTS. In the example of FIG. 17, the replacement process may be performed in the demultiplexing unit 221, the decoding unit 222, the standard mode conversion unit 223, and the encoding unit 224 of the video / audio transcoding unit 220B of the communication network distribution subsystem 200. In the configuration example of FIG. 18, the switch 242 in the video / audio transcoding unit 220B inserts the alternative content from the alternative content input unit 241 based on the insertion control information (switching signal) of the insertion control unit 270 of the communication network distribution subsystem 200.

[0079] The information for replacing the alternative content (insertion control information: start point, end point, address of the alternative content) may be sent from outside the broadcaster subsystem 100.

[0080] As shown in FIG. 19, the commercial part of the video stream is replaced with alternative content.

[0081] FIG. 24 shows a configuration example of the insertion control unit 270. In this configuration example, using the insertion control information (composition information), the cut-off point time for the lid control and the content replacement process is specified from the upstream system in units of hours, minutes, seconds, and milliseconds. Each video frame in the TS stream is assigned a clock time specified by a PTS (Presentation Time Stamp). Based on the program clock value at the timing when the ToT (Time Offset Table) was last received in the TS stream, the time based on the ToT of each frame (in the format of year, month, day, hour, minute, second, and millisecond, hereinafter also referred to as the frame PTS time) is obtained. When the frame data is input to the decoding unit 222 of the TS stream, the frame PTS time is stored in the non-destructive auxiliary data area (frame PTS time file management unit 274) attached to each frame. When encoding into the distribution format, the frame time in the non-destructive auxiliary data area is compared with the cut-off point time to determine whether to cut.

[0082] In FIG. 24, the insertion control unit 270 includes an editing information file management unit 271, a next editing information entry extraction unit 272, a frame PTS time generation unit 273, a frame PTS time file management unit 274, a processing target frame PTS time extraction unit 275, and a comparison unit 276.

[0083] The programming information file management unit 271 manages the insertion information (programming information) file. The insertion information (programming information) has, for each entry, a specified time (described in the format of YYYY-MM-DD T12:MM:SS:mm+0900 (time difference)), a command, a source address, etc. An entry is formed for each program and alternative content. The commands include a program command to start encoding a program at the specified time, a mask command to start encoding a still image (black), and a file command to start encoding a specified alternative video, etc. In ascending order, the next programming information entry is sequentially taken out from the programming information management file 271 by the next programming information entry extraction unit 272. When the comparison in the comparison unit 276 of one programming information entry is executed and the switch 242 is switched, the next programming information entry is taken out from the programming information management file 271 by the next programming information entry extraction unit 272 to prepare for the next switch.

[0084] On the other hand, the TS stream is supplied to the decoding unit 222 and also to the frame PTS time generation unit 273. The frame PTS time generation unit 273 extracts ToT from the TS stream, holds the clock at that time, and converts the PTS of the frame to be processed into a frame PTS time in the format of year, month, day, hour, minute, and second (YYYY-MM-DD T12:MM:SS:mm+0900 format) based on the latest ToT and the clock at the time of receiving the latest ToT. This frame PTS time is held and managed by the frame PTS time file management unit 274. The processing target frame PTS time extraction unit 275 sequentially extracts the frame PTS time for the frame to be processed (encoding target), and the comparison unit 276 performs a comparison at the frame rate (frame interval). The comparison unit 276 identifies the frame closest to the time of the next programming information entry taken out by the next programming information entry extraction unit 272, and switches the switch 242 at that time (clock).

[0085] In the examples of FIGS. 17 and 24, although the insertion of alternative content is performed by the communication network distribution subsystem 200, an insertion video playback unit 380 may be provided by the application 325A of the mobile terminal as shown by the dashed line in FIG. 8, and the introduction operation may be performed on the mobile terminal 300.

[0086] The insertion control data, for example, the designation of alternative content, may be dynamically provided with reference to the profile information of the user of the mobile terminal 300 and various history information. The user may select alternative content or a group thereof that may be displayed on the mobile terminal 300 using an alternative content designation unit that may be included as part of the video / audio stream playback unit 360. Based on the playback history of the alternative content (commercial video), a predetermined played-back alternative content may be individually playable using the played-back alternative content designation unit (video / audio stream playback unit 360).

[0087] FIG. 20 illustrates an example of configuring the insertion video playback unit 380 in a manner similar to the insertion of subtitle data described with reference to FIG. 12. In the example of FIG. 20, an alternative content insertion instruction is received by the polling control unit 375, held by the message management file holding unit 373, and alternative content insertion processing may be performed using the alternative content held in the alternative data holding unit 374A. That is, the switching control unit 371A controls the switching between the video / audio stream (video stream) and the alternative content. In this example, the cut point and restart point may be determined using the corrected PCR as in the example of FIG. 12. The time information of the cut point and restart point supplied from the insertion information transmission unit 140 is specified in the format of year / month / day / hour / minute / second, and this can be mutually converted with the corrected PCR using a ToT (Time Ofset Table). It is also preferable that the ToT is transmitted to the mobile terminal 300 side. The alternative content holding unit 374A may be a buffer device and may be held in a server (storage device) on the communication network 500.

[0088] FIG. 21 illustrates a processing flow example using subtitle data as an example. In the modification of FIG. 20, the same processing may be performed when inserting other alternative contents. In FIG. 21, the IP receiver 210 of the communication network distribution subsystem 200 receives TS packets of a broadcast service TS stream from the broadcast operator subsystem 100 and supplies them to the subtitle data extraction unit 231 (X01). The subtitle data extraction unit 231 transmits the TS packets of subtitle data to the subtitle data distribution unit (server) 250 (X02). The subtitle data distribution unit 250 stores the subtitle data in the subtitle data storage management unit, and correspondingly updates the message management data (message management file) in the message management file holding unit 260 (X03). The application 325A of the mobile terminal 300 first retrieves the message management data in the long polling processing part X04 (X05). In response, the subtitle data distribution unit 250 returns the latest data of the message management data to the application 325A (X06). The subtitle data distribution unit 250 repeatedly returns the updated part of the message management data to the application 325A each time it is updated (X07). The application 325A interprets the message management data obtained in steps X06 and X07 line by line. When it is a subtitle message, it retrieves the subtitle data obtained in step X03 (X08). The subtitle data distribution unit 250 sends the subtitle data to the application 325A in response (X09). The application 325A performs display processing at an appropriate timing based on the content of the message management data and the subtitle data, and subtitles are displayed to the user (X10, X11).

[0089] FIG. 22 shows an example of a message. As shown with reference to FIG. 3 above, the message includes the message execution time (also referred to as the ignition time) in the first column, the message type (also referred to as the entity type) in the second column, the entity file name in the third column, and additional information in the fourth column (FIG. 22(A)). In the specific example of FIG. 22(B), the message execution time is "2016-04-20T13:02:15.588+0900", the message type is "cap_packet", the entity file name is " / tvmock / 20160420 / 7fe4.7fe4.0420 / cap / 00055002", and no additional information is included. The "cap_packet" of the message type indicates that the message is related to subtitles, and the subtitle data is held in the entity file name " / tvmock / 20160420 / 7fe4.7fe4.0420 / cap / 00055002". The main message types are as shown in FIG. 23.

[0090] As described above, "pmt_changed" in FIG. 23 is used to control the display timing of subtitle data.

[0091] In FIG. 20, the insertion control data (message) of the alternative content is transferred from the communication network distribution subsystem 200 to the inserted video playback unit 380 of the mobile terminal 300 to perform the display switching of the alternative content. In FIG. 12, the message for subtitle display (subtitle display instruction) is transferred from the communication network distribution subsystem 200 to the subtitle data playback unit 370 of the mobile terminal 300 to perform the subtitle display (displayed overlaid on the video or in a separate display area from the video). However, in a similar manner, the mobile terminal 300 may be made to display arbitrary character information. For example, the communication network subsystem 200 holds a display control message for predetermined character information (advertisement, viewer message, public information, etc.) in the message management file holding unit, transfers this to the mobile terminal 300 side, and the mobile terminal 300 uses this display control message to retrieve the corresponding character information stored and managed in the communication network subsystem 200 or any other arbitrary site, and may display, erase, or move the character information at the timing indicated by the display control message. The timing of display, erasure, etc. may conform to the system clock of the broadcaster subsystem 100 (the clock in the broadcast service TS packet) or the system clock of the communication network distribution subsystem 200, and which clock to conform to may be specified by a flag. This character information may be displayed in an auxiliary viewing area provided separately from the video viewing area A of the mobile terminal 300 in FIG. 9 (for example, the window labeled "subtitle" in FIG. 9), but is not limited to this.

[0092] This concludes the description of the embodiments of the present invention.

[0093] Note that the present invention is determined based on the description in the claims, and is not limited to the specific configurations, problems, and effects of the embodiments. The present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit thereof.

[0094] For example, although the above embodiments have been described in relation to a mobile terminal, the present invention may be widely applied to fixed terminals and network television receivers. Hereinafter, some of the technical features described herein are listed. [Technical Feature 1] Reconstruction means for receiving, via the communication network, a transmission stream obtained by converting a TS stream of a broadcast service into a transmission stream for communication network transmission and reconstructing the TS stream of the broadcast service from the transmission stream; Characteristic discrimination means for discriminating the characteristics of the TS stream of the broadcast service reconstructed by the reconstruction means; IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; Transmission means for transmitting, via the communication network, the video stream in the format for IP distribution generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network, and The IP distribution conversion means is configured to generate the video stream in the format for IP distribution in a standard format based on the characteristics discriminated by the characteristic discrimination means. A broadcast service communication network distribution apparatus characterized by this. [Technical Feature 2] The broadcast service communication network distribution apparatus according to Technical Feature 1, wherein in the video stream in the format for IP distribution generated in the standard format, the audio mode is a stereo audio mode. [Technical Feature 3] The broadcast service communication network distribution apparatus according to Technical Feature 1 or 2, wherein in the video stream in the format for IP distribution generated in the standard format, the video mode is a high-definition mode. [Technical Feature 4] The IP distribution conversion means generates a number of video streams in the format for IP distribution corresponding to N (N is an integer of 2 or more) organized channels from the TS stream of the broadcast service. The broadcast service communication network distribution apparatus according to any one of Technical Features 1 to 3. [Technical Feature 5] The above N programmed channels are two programmed channels, and even when the TS stream of the above broadcast service contains only one programmed channel, it is the broadcast service communication network distribution device described in Technical Feature 4 that generates the video streams of the above IP distribution format corresponding to the number of two programmed channels. [Technical Feature 6] The above IP distribution conversion means is the broadcast service communication network distribution device described in any one of Technical Features 1 to 5 that generates the video streams of the above IP distribution format corresponding to the number according to two modes of main audio and sub-audio. [Technical Feature 7] The above IP distribution conversion means is the broadcast service communication network distribution device described in Technical Feature 6 that generates the video streams of the above IP distribution format corresponding to the number according to two modes even when the TS stream of the above broadcast service does not contain sub-audio. [Technical Feature 8] The above IP distribution conversion means is the broadcast service communication network distribution device described in any one of Technical Features 1 to 7 that generates the video streams of the above IP distribution format corresponding to the number according to two viewing selections of subtitle display and non-display. [Technical Feature 9] The above IP distribution conversion means is the broadcast service communication network distribution device described in Technical Feature 8 that generates the video streams of the above IP distribution format corresponding to the number according to the above two viewing selections even when the TS stream of the above broadcast service does not contain subtitle data. [Technical Feature 10] The above video stream is the broadcast service communication network distribution device described in any one of Technical Features 1 to 9 that has a series of video files sequentially played by an index file. [Technical Feature 11] The above video stream of the IP distribution format is the broadcast service communication network distribution device described in any one of Technical Features 1 to 10 that is a streaming video stream. [Technical Feature 12] The above transmission stream is a broadcast service communication network distribution device according to any one of technical features 1 to 11, which is obtained by IP-packetizing the TS stream of the above broadcast service. [Technical Feature 13] The above IP distribution conversion means demultiplexes the TS stream of the above broadcast service reconstructed by the above reconstruction means to generate a video stream and an audio stream; a demultiplexing means decodes the video stream and the audio stream output from the above demultiplexing means to generate a video signal and an audio signal; a decoding means converts the above video signal and audio signal into a standard mode; a standard mode conversion means encodes the video signal and audio signal in the above standard mode to generate a video stream in the above IP distribution format; an encoding means, which is a broadcast service communication network distribution device according to any one of technical features 1 to 12. [Technical Feature 14] a reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service for communication network transmission via the communication network and reconstructing the TS stream of the broadcast service from the transmission stream; an IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the above reconstruction means into a video stream in an IP distribution format; a transmission means for transmitting the video stream in the IP distribution format generated by the above IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network; When the subtitle data is included in the TS stream of the broadcast service, in addition to generating a video stream in the IP distribution format for the video stream and the audio stream generated by the video / audio stream generation means, the IP distribution conversion means generates another video stream in the IP distribution format from the video stream of the composite video with subtitles based on the subtitle data added to the video of the video stream and the audio stream. The broadcast service communication network distribution device is characterized in this way. [Technical Feature 15] Reconstruction means for receiving a transmission stream obtained by converting a TS stream of a broadcast service into a transmission stream for communication network transmission via the communication network and reconstructing the TS stream of the broadcast service from the transmission stream. IP distribution conversion means for converting the video stream and the audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in the IP distribution format. Transmission means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network. The IP distribution conversion means is configured to receive information specifying the start period and the end period of the time interval and the alternative content, and replace the video stream in the IP distribution format with the alternative content in the section defined by the start period and the end period. The broadcast service communication network distribution device is characterized in this way. [Technical Feature 16] The broadcast service communication network distribution device according to Technical Feature 15, wherein the alternative content is a video stream segment and an audio stream segment or a still image and predetermined audio. [Technical Feature 17] The above-mentioned conversion means for IP distribution has demultiplexing means for demultiplexing the TS stream of the broadcast service reconstructed by the above-mentioned reconstruction means to generate a video stream and an audio stream, and uses alternative content instead of the video signal and audio signal decoded from the video stream and audio stream in the section defined by the start period and the end period. The broadcast service communication network distribution device according to Technical Feature 15 or 16. [Technical Feature 18] The start period and the end period of the above time interval are displayed in year, month, day, hour, minute, and second, and are compared with the time based on the time offset table and the clock conforming to the TS stream of the above broadcast service. The broadcast service communication network distribution device according to Technical Feature 16 or 17. [Technical Feature 19] Reconstruction means for receiving a transmission stream obtained by converting the TS stream of the broadcast service into a transmission stream for communication network transmission via the communication network and reconstructing the TS stream of the broadcast service from the transmission stream, IP distribution conversion means for converting the video stream and audio stream included in the TS stream of the broadcast service reconstructed by the above reconstruction means into a video stream in a format for IP distribution, Transmission means for transmitting the video stream in the format for IP distribution generated by the above IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network, A broadcast service communication network distribution device, comprising control information supply means for receiving information specifying the start period and the end period of the time interval and alternative content and supplying control information to the client device so as to replace the section defined by the start period and the end period of the video stream with the video stream segment. [Technical Feature 20] In a client terminal connected via a communication network together with the broadcast service communication network distribution device according to Technical Feature 19, It has video stream playback means for receiving and playing back a video stream in a format for IP distribution from the transmission means of the broadcast service communication network distribution device. The video stream playback means is configured to play back the alternative content instead of the video stream at playback times corresponding to the start and end periods of the time interval received from the control information supply means of the broadcast service communication network distribution device. A client terminal characterized by this. [Technical Feature 21] The format for IP distribution is HLS (HTTP Live Streaming, both trademarks of Apple Inc.), and the video stream playback means plays back the alternative content instead of the video stream in accordance with EXT-PROGRAM-DATE-TIME of the video stream file. The client terminal according to Technical Feature 20. [Technical Feature 22] Reconstruction means for converting a TS stream of a broadcast service into a transmission stream for communication network transmission, receiving the transmission stream via the communication network, and reconstructing the TS stream of the broadcast service from the transmission stream; IP distribution conversion means for converting a video stream and an audio stream included in the TS stream of the broadcast service reconstructed by the reconstruction means into a video stream in a format for IP distribution; Transmission means for transmitting a video stream in a format for IP distribution generated by the IP distribution conversion means to the client terminal via the communication network in response to a request from the client terminal on the communication network; Alternative content distribution control means for controlling so that alternative content to be replaced with a video stream or an audio stream during a specified period is transmitted to the client terminal via the network; The alternative content distribution control means Index file storage means for storing an index file that makes insertion control information accessible in units of replacement operations; means for transmitting the index file to the client terminal via the network in response to polling from the client terminal; The client terminal is characterized in that it uses the insertion control information to obtain the alternative content from a predetermined alternative content storage means and replaces the video stream and the audio stream with the alternative content for a predetermined period. A broadcast service communication network distribution apparatus. [Technical Feature 23] A client terminal connectable to a network, video / audio stream receiving means for receiving, from a transmitting device, a video / audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner; alternative content receiving means for receiving, via the network, alternative content stored in an alternative content storage means; The alternative content receiving means, index file receiving means for receiving, by polling, from the transmitting device, an index file that makes the alternative content stored in the alternative content storage means accessible in units of replacement operations; means for receiving, in units of the replacement operations, the alternative content stored in the alternative content storage means using the index file received by the index file receiving means. A client terminal characterized by [Technical Feature 24] A client terminal connectable to a network, video / audio stream receiving means for receiving, from a transmitting device, a video / audio stream extracted from a broadcast stream and transmitted via the network in a streaming manner, and a computer program used to cause to be executed by alternative content receiving means for receiving, via the network, alternative content stored in an alternative content storage means, The alternative content receiving means, Index file receiving means that receives, by polling, an index file that enables access to the alternative content stored in the alternative content storage means in units of replacement operation; The computer program is characterized by comprising: receiving means for receiving, in units of the replacement operation, the alternative content stored in the alternative content storage means by using the index file received by the index file receiving means.

Explanation of Signs

[0095] 100 Broadcast operator subsystem 110 Broadcast service TS stream output section 120 Uplink section 130 IP transmission device 140 Insertion information transmission section 200 Subsystem for communication network distribution 210 IP reception device 220 Video / audio transcoding section 221 Demultiplexing section 222 Decoding section 223 Standard mode conversion section 224 Encoding section 225 TS stream characteristic determination section 228 Program table 229 Video synthesis section 230 Video / audio distribution section 231 Subtitle data extraction section 240 Video / audio distribution section 241 Alternative content input section 242 Switch 250 Subtitle data distribution section 260 Message management file holding section 270 Insertion control section 300 Mobile terminal 300A Display section 325A Internet distribution TV broadcast viewing application 360 Video / audio stream playback section 370 Subtitle data playback unit 371 Subtitle display unit 372 Correction PCR generation unit 373 Message management file holding unit 374 Subtitle data holding unit 374A Alternative data holding unit 375 Polling control unit 380 Inserted video playback unit 400 Gateway 500 Communication network 600 Authentication server 700 Line

Claims

1. A broadcast service communication network distribution device that distributes a broadcast service via a communication network, a conversion means for IP distribution for converting a video stream and an audio stream included in a TS stream of a broadcast service into a video stream in an IP distribution format; a video stream transmission means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network; a character information distribution control means for controlling transmission of the non-TS stream-origin character information, the non-TS stream-origin character information being not originating from the TS stream and displayed in a video stream viewing area for the video stream of the client terminal or in an auxiliary viewing area separate from the video stream viewing area, to the client terminal via the network, The character information distribution control means a display control information storage means for storing display control information for controlling display of the non-TS stream origin character information in units of character information; an index file storage means for storing an index file for character information originating from a non-TS stream, which enables access to the display control information of the character information originating from the non-TS stream stored in the display control information storage means on a character information basis; an index file transmission means for transmitting the non-TS stream origin character information index file to the client terminal via the network in response to polling from the client terminal; a transmission means for transmitting display control information of the non-TS stream origin character information stored in the display control information storage means to the client terminal in units of character information in response to a transfer request from the client terminal in units of character information using the non-TS stream origin character information index file transmitted to the client terminal, the client terminal uses the display control information to display the non-TS-stream-originated character information in the video stream viewing area or the auxiliary viewing area during the specified period; Furthermore, the character information distribution control means storing display control information of the subtitle information originating from the TS stream extracted from the TS stream in the display control information storage means; storing, in said index file storage means, a subtitle information index file that enables access to the display control information of said subtitle information stored in said display control information storage means on a character information basis; transmitting the subtitle information index file to the client terminal via the network in response to polling from the client terminal; a display control information storage means for storing display control information for the subtitle information stored in the display control information storage means, in response to a transfer request for character information units from the client terminal using the subtitle information index file transmitted to the client terminal, to transmit the display control information for the subtitle information stored in the display control information storage means to the client terminal in character information units, thereby enabling the subtitle information to be displayed on the client terminal.

2. 2. The broadcast service communication network distribution device according to claim 1, wherein said non-TS stream origin character information is stored and managed at an arbitrary site outside said character information distribution control means.

3. 2. The broadcast service communication network distribution device according to claim 1, wherein the non-TS stream origin character information includes advertisements, viewers' messages, or official information.

4. A broadcast service communication network distribution method for distributing a broadcast service via a communication network, comprising: a conversion step for IP distribution of a video stream and an audio stream included in the TS stream of the broadcast service into a video stream in a format for IP distribution; a video stream transmission step of transmitting the video stream in the IP distribution format generated by the IP distribution conversion step to a client terminal via the communication network in response to a request from the client terminal on the communication network; a character information distribution control step of controlling the transmission of non-TS stream-origin character information, the non-TS stream-origin character information being not originating from the TS stream and being displayed in a video stream viewing area for the video stream of the client terminal or in an auxiliary viewing area separate from the video stream viewing area, to the client terminal via the network, The character information delivery control step includes: a display control information storage step of storing display control information for controlling display of the non-TS stream origin character information in a display control information storage means on a character information basis; an index file storage step of storing, in an index file storage means, an index file for character information originating from a non-TS stream, which makes it possible to access the display control information of the character information originating from the non-TS stream stored in the display control information storage means in units of character information, in units of character information; transmitting the non-TS stream origin character information index file to the client terminal via the network in response to polling from the client terminal; a transmission step of transmitting display control information of the non-TS stream origin character information stored in the display control information storage means to the client terminal in units of character information in response to a transfer request from the client terminal in units of character information using the index file for non-TS stream origin character information transmitted to the client terminal, the client terminal uses the display control information to display the non-TS-stream-originated character information in the video stream viewing area or the auxiliary viewing area during the specified period; Furthermore, the character information distribution control step includes: storing display control information of the subtitle information originating from the TS stream extracted from the TS stream in the display control information storage means; storing, in said index file storage means, a subtitle information index file that enables access to the display control information of said subtitle information stored in said display control information storage means on a character information basis; transmitting the subtitle information index file to a client terminal via the network in response to polling from the client terminal; a display control information storage means for storing display control information for the subtitle information stored in the display control information storage means, which transmits the display control information to the client terminal in character information units in response to a transfer request from the client terminal in character information units using the subtitle information index file transmitted to the client terminal, thereby enabling the subtitle information to be displayed on the client terminal.

5. A computer program for broadcast service communication network distribution, which distributes a broadcast service via a communication network, comprising: A processor of a communications network distribution subsystem, A conversion means for IP distribution that converts a video stream and an audio stream included in the TS stream of the broadcast service into a video stream in an IP distribution format; a video stream transmitting means for transmitting the video stream in the IP distribution format generated by the IP distribution conversion means to a client terminal via the communication network in response to a request from the client terminal on the communication network; and a character information distribution control means for controlling transmission of non-TS stream origin character information, which is not originated from the TS stream and is displayed in a video stream viewing area for the video stream of the client terminal or in an auxiliary viewing area separate from the video stream viewing area, to the client terminal via the network during a designated period of time; A computer program for causing a computer to execute the program as described above, The character information distribution control means a display control information storage means for storing display control information for controlling display of the non-TS stream origin character information in units of character information; an index file storage means for storing an index file for character information originating from a non-TS stream, which enables access to the display control information of the character information originating from the non-TS stream stored in the display control information storage means on a character information basis; means for transmitting the non-TS stream origin character information index file to the client terminal via the network in response to polling from the client terminal; a transmission means for transmitting display control information of the non-TS stream origin character information stored in the display control information storage means to the client terminal in units of character information in response to a transfer request from the client terminal in units of character information using the non-TS stream origin character information index file transmitted to the client terminal, the client terminal uses the display control information to display the non-TS-stream-originated character information in the video stream viewing area or the auxiliary viewing area during the specified period; Furthermore, the character information distribution control means storing display control information of the subtitle information originating from the TS stream extracted from the TS stream in the display control information storage means; storing, in said index file storage means, a subtitle information index file that enables access to the display control information of said subtitle information stored in said display control information storage means on a character information basis; transmitting the subtitle information index file to the client terminal via the network in response to polling from the client terminal; a display control information storage means for storing display control information for the subtitle information stored in the display control information storage means, in response to a transfer request for character information units from the client terminal using the subtitle information index file transmitted to the client terminal, and causing the display control information for the subtitle information stored in the display control information storage means to be transmitted to the client terminal in character information units, thereby enabling the subtitle information to be displayed on the client terminal.

6. A client terminal connected to the broadcast service communication network distribution device according to claim 1 via a communication network, a video stream playback means for receiving the video stream transmitted from the video stream transmission means of the broadcast service communication network distribution device and playing the video stream in the video stream viewing area; a non-TS stream origin character information receiving means for receiving the non-TS stream origin character information; a display means for displaying the received non-TS stream origin character information in the video stream viewing area or the auxiliary viewing area, The non-TS stream origin character information receiving means includes: an index file receiving means for receiving the index file for character information originating from a non-TS stream, the index file being stored in the index file storage means of the broadcast service communication network distribution device, from the index file transmitting means by polling; and a character information access means for accessing character information originating from a non-TS stream using display control information for each character information unit in the index file for character information originating from the non-TS stream received by the index file receiving means.

7. A computer program for a client terminal connected to the broadcast service communication network distribution device according to claim 1 via a communication network, The processor of the client terminal, a video stream playback means for receiving the video stream transmitted from the video stream transmission means of the broadcast service communication network distribution device and playing the video stream in the video stream viewing area; a non-TS stream origin character information receiving means for receiving the non-TS stream origin character information; and A display means for displaying the received non-TS stream origin character information in the video stream viewing area or the auxiliary viewing area. A computer program for causing a computer to execute the program as described above, The non-TS stream origin character information receiving means includes: an index file receiving means for receiving, by polling, an index file for character information originating from a non-TS stream stored in the index file storage means of the broadcast service communication network distribution device from the index file transmitting means; A computer program for a client terminal, comprising: a character information access means for accessing character information originating from a non-TS stream using display control information for each character information unit in the index file for character information originating from the non-TS stream received by the index file receiving means.

Citation Information

Patent Citations

  • Digital broadcasting system, digital broadcasting compiling apparatus, and its compiling method

    JP2003169227A

  • Broadcast content provision system, broadcast content provision device, reproducer, and advertisement provision device, and their control method and control program

    JP2017050631A

  • Broadcast service retransmission system and viewing portable terminal

    JP2017188891A

  • Retransmission system, retransmission device, reception device, and program

    JP2019110482A

  • Device and method for receiving media content

    US20150012956A1