Reception device, transmission device and program
The video distribution system addresses the challenge of delivering targeted content by encoding different program videos in separate layers, ensuring personalized viewing experiences while protecting privacy and minimizing switching disruptions.
Patent Information
- Application Number
- JP2024080639
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-19
- Filing Date
- 2024-05-17
- Publication Date
- 2024-11-29
AI Technical Summary
Conventional broadcasting technologies struggle to deliver targeted advertisements based on individual viewer preferences due to the inability to collect and utilize personal viewing data, and multi-layer encoding methods cause video disturbances during switching.
A video distribution system using multi-layer encoding where different program videos are encoded in separate layers, allowing for targeted content selection based on viewer preferences while maintaining personal information privacy and minimizing video switching issues.
Enables personalized video content delivery that matches viewer preferences without compromising personal information, and reduces video switching disturbances by leveraging multi-layer encoding techniques.
Smart Images

Figure 2024167075000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a receiving device, a transmitting device, and a program. [Background technology]
[0002] Traditionally, the Internet has had technologies such as cookies that accumulate website browsing and purchasing information about web visitors, and targeted advertising techniques have been introduced that take advantage of the interactive nature of communication to deliver advertisements that match the visitor's preferences based on that accumulated information.
[0003] On the other hand, in video distribution systems such as broadcasting, which is a one-way means of information transmission, it is technically impossible for the sender to obtain individual preferences, so advertisements are distributed based on a representative demographic of viewers assumed based on surveys of viewing trends for time periods and broadcast programs.
[0004] However, personal information regarding program viewing, such as viewing history, is already collected by the receiving device, and some broadcasting technologies, such as hybrid cast and data broadcasting, connect the television receiving device to a communication network so that broadcasters can obtain non-specific viewing history that cannot be easily matched with other information, for example by anonymizing it, and use this information in program production and scheduling.
[0005] In addition, hybrid cast application technology has been proposed, which would allow programs targeted at specific viewers (such as commercials) to be distributed and downloaded to television receiving devices via the Internet during specific time periods, rather than programs broadcast over broadcast waves, and displayed in place of the broadcast programs. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2021-136480 A Summary of the Invention [Problem to be solved by the invention]
[0007] In conventional broadcasting technology, a pre-set program is broadcast to all viewers within the service area, and no advertising method is used to target individual viewers. In addition, program previews and the like are presented based on the assumed viewers' preferences, taking into account the time of day, but do not reflect the tastes and preferences of individual viewers.
[0008] In addition, the use of cookies has raised security concerns because personal information stored on the receiving side is sent at the request of the server, and there is a demand for personalized video distribution technology that protects personal information.
[0009] In addition, with hybrid casting, a pre-encoded stream must be downloaded regardless of the encoded data being broadcast, and the decoding process must be carried out by forcibly switching the stream from the regular program. This creates a logical discontinuity in the encoded signal when switching, resulting in image distortion, and may require the receiving device to insert a built-in black screen.
[0010] Therefore, an object of the present invention is to provide a receiving device, a transmitting device, and a program that can protect personal information, enable a viewer to watch videos that suit their preferences, and suppress problems associated with video switching. [Means for solving the problem]
[0011] The receiving device of the first aspect comprises a receiving means for receiving a bitstream of multiple layers obtained using multi-layer coding, in which different program images are independently coded in each of the multiple layers, a selection means for automatically selecting a layer that suits a viewer's preferences from the multiple layers based on program information that is information multiplexed into the bitstream of the multiple layers and indicates the program classification of each of the multiple layers, and a decoding means for performing a decoding process on the bitstream of the layer selected by the selection means and outputting a decoded video signal.
[0012] A transmitting device according to a second aspect includes an encoding means for generating a bit stream of a plurality of layers using multi-layer encoding, in which different program images are encoded independently in the plurality of layers, a multiplexing means for multiplexing program information indicating program classifications of the plurality of layers into the bit stream of the plurality of layers, and a transmitting means for transmitting an output signal of the multiplexing means to a receiving side. The program information is used for automatic selection of a layer that matches a viewer's preferences from the plurality of layers at the receiving side.
[0013] A program according to the third aspect causes a computer to function as the receiving device according to the first aspect or the transmitting device according to the first aspect. Effect of the Invention
[0014] According to the present invention, it is possible to provide a receiving device, a transmitting device, and a program that can protect personal information, enable a viewer to watch videos that match his / her preferences, and suppress problems associated with video switching. [Brief description of the drawings]
[0015] [Figure 1] 1 is a diagram showing a configuration of a video distribution system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of a transmission device according to an embodiment. [Diagram 3] FIG. 1 is a diagram illustrating a configuration of a receiving device according to an embodiment. [Figure 4] FIG. 11 is a diagram illustrating a first modified example of a transmitting device according to an embodiment. [Diagram 5] FIG. 11 is a diagram illustrating a first modified example of the receiving device according to the embodiment. [Figure 6] FIG. 11 is a diagram illustrating a second modified example of the transmitting device according to the embodiment. [Figure 7] FIG. 11 is a diagram illustrating a second modified example of the receiving device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] A video distribution system according to an embodiment will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.
[0017] (1) Overview of the embodiment Conventional broadcast video transmission basically uses a mode that can transmit only one video per channel, and because it is not possible to grasp the viewer's preferences, it is difficult to deliver programs that suit the viewer's preferences. Video distribution services that use communication use cookies to obtain personal information, but if the use of cookies is stopped from the perspective of personal information protection, it is still difficult to obtain personal information, and the only thing that can be done is to encourage the download of general information.
[0018] In recent years, the practicality of multi-layer coding, which codes multiple videos together, has been increasing. As a video coding method compatible with multi-layer coding, HEVC (High Efficiency Video Coding), VVC (Versatile Video Coding), and MPEG-5 Part2 LCEVC (Low Complexity Enhancement Video Codec), which are standardized by MPEG (Moving Picture Experts Group), may be used. HEVC may be considered to be a method specified in ISO / IEC 23008-2 and Recommendation ITU-T H.265, and VVC may be considered to be a method specified in ISO / IEC 23090-3 and Recommendation ITU-T H.266. LCEVC may be considered to be a method specified in ISO / IEC 23094-2. HEVC, VVC, and LCEVC support two-layer resolution scalability (2K / 4K) as well as three-layer resolution scalability (2K / 4K / 8K), and may also support using the enhancement layer for superimposing additional information such as subtitles and sub-video instead of upconversion.
[0019] In multi-layer coding, a plurality of input images to be coded are coded in a layer structure. Specifically, multi-layer coding is a technology that can code a plurality of images together as one coded stream by treating each of the images as one layer of the image. In general multi-layer coding, the base layer, which is the lowest layer, is coded first, and the decoded image of the base layer is used for prediction by coding processing of the enhancement layer, which is a higher layer, thereby improving prediction efficiency of the higher layer, and coding efficiency is improved compared to the case where each is coded independently. For example, in a video coding method that supports multi-layer coding, spatial scalable coding may be applied in which a low-resolution image is coded as a base layer, and a decoded image of the low-resolution image is used to code an enhancement layer, which is a high-resolution image. In spatial scalable coding, for example, the transmission device 100 may code a 2K resolution image as a base layer, perform a prediction process of a 4K resolution image using the 2K resolution image, and code difference information between the high-resolution image and the predicted image together with prediction information as an enhancement layer. Alternatively, the base layer and the enhancement layer may have the same resolution, and the difference of the base layer may be coded as the enhancement layer.
[0020] In this embodiment, in order to solve the above-mentioned problem, a program video aimed at a wide target demographic is distributed as a base layer, and different program videos with successively higher priorities can be distributed as enhancement layers. In the video distribution system according to this embodiment, a video different from the base layer is input as the input of the enhancement layer, but it is assumed that a video with a different content (program) from that of the base layer is input, and the enhancement layer is coded as an independent layer in multi-layer coding (for example, an independent layer in VVC), and coded as an independent video while maintaining the dependency of the internal state on the decoding side.
[0021] Specifically, the transmission device according to the present embodiment includes an encoding means for generating a bit stream of multiple layers using multi-layer coding, in which different program images are independently coded in the multiple layers, a multiplexing means for multiplexing program information indicating the program classification of each of the multiple layers into the bit stream of the multiple layers, and a transmission means for transmitting an output signal of the multiplexing means to a receiving side. The program information is used for automatic selection of a layer that matches a viewer's preferences from the multiple layers at the receiving side.
[0022] In addition, the receiving device of this embodiment is equipped with a receiving means for receiving a bit stream of multiple layers obtained using multi-layer coding, in which different program images are independently coded into each of the multiple layers, a selection means for automatically selecting a layer from the multiple layers that suits a viewer's preferences based on program information that is information multiplexed into the bit stream of the multiple layers and indicates the program classification of each of the multiple layers, and a decoding means for performing a decoding process on the bit stream of the layer selected by the selection means and outputting a decoded video signal.
[0023] According to such a transmitting device and receiving device, a plurality of program images can be distributed as one coded stream on one channel by multi-layer coding, and a viewer can be provided with options suited to various needs, thereby enabling the viewer to watch images suited to their individual preferences. In addition, since an independent layer independently codes different images, it is not possible to obtain the effect of compressing an image signal by reducing the signal redundancy between images, which is one of the features of multi-layer coding. However, since it is possible to decode a plurality of images as one coded stream, it is possible to prevent signal disturbance caused by error avoidance processing (e.g., black insertion or resetting of the decoding process) due to discontinuity of the signal on the decoding side.
[0024] In addition, the transmitted stream is multiplexed with program information indicating the program classification of each layer. For example, each layer is given a classification code indicating the classification of the program video (e.g., news, music, culture, animation, etc.). The receiving device selects the layer that is thought to be of the closest interest based on classification information such as personal information (viewing history, etc.) stored inside, and outputs the decoded video of the selected layer. This allows the provision of programs that are most suited to individual preferences to be realized without personal information leaving the receiving device.
[0025] Therefore, the transmitting device and receiving device according to this embodiment can protect personal information, enable a viewer to watch videos that suit their preferences, and also suppress problems associated with video switching.
[0026] (2) Video distribution system 1 is a diagram showing a configuration of a video distribution system 10 according to this embodiment. The video distribution system 10 according to this embodiment includes a transmitting device 100 and a receiving device 200.
[0027] The transmitting device 100 distributes program video to the receiving device 200 via a transmission path 500. In this embodiment, the transmission path 500 is a broadcast transmission path that performs one-way transmission. Note that the transmission path 500 may be a communication transmission path that allows two-way transmission, and the communication transmission path may include the Internet. However, since this embodiment does not use the two-way nature that is a characteristic of a communication transmission path, a video distribution service using a broadcast transmission path will be described as an example.
[0028] The video distribution system 10 employs a video encoding method that supports multi-layer encoding. The video encoding method that supports multi-layer encoding may be VVC. However, it is not limited to VVC, and a multi-layer extension of HEVC or LCEVC may be used.
[0029] In the video distribution system 10, RTP (Realtime Transport Protocol) or MMT (MPEG Media Transport) may be adopted as a transmission method. RTP may be considered to be a method defined in IETF RFC 3550. MMT may be considered to be a method defined in ISO / IEC 23008-1 or ARIB STD-B60. Alternatively, MPEG-DASH or MPEG-TS (Transport Stream) may be adopted as a transmission method.
[0030] (3) Transmitting device 2 is a diagram showing a configuration of a transmitting device 100 according to this embodiment. The transmitting device 100 according to this embodiment has a multi-layer encoding unit 110, a control unit 120, a multiplexing unit 130, and a transmitting unit 140.
[0031] The multi-layer encoding unit 110 is an example of an encoding means that generates a bit stream of multiple layers using multi-layer encoding. The multi-layer encoding unit 110 has a BL encoding unit 111 that encodes a base layer (also written as "BL") and an EL encoding unit 112 that encodes an enhancement layer (also written as "EL"). In the illustrated example, the multi-layer encoding unit 110 has three EL encoding units 112a to 112c, but is not limited to this. The number of EL encoding units 112 may be one or two, or may be four or more. In this embodiment, the multi-layer encoding unit 110 encodes the BL and each EL as an independent layer, so that the BL encoding unit 111 and each EL encoding unit 112 are illustrated as separate encoding units.
[0032] In this embodiment, the multi-layer encoding unit 110 encodes program video (also called "main program") for a wide target audience as BL. The multi-layer encoding unit 110 also enables distribution of different program videos with successively higher priorities as EL. Here, the multi-layer encoding unit 110 encodes each layer as an independent layer in multi-layer encoding.
[0033] In this embodiment, in each EL, a replacement program image that can be replaced with the main program image is coded as a layer independent of the BL. The replacement program may be advertising content. The advertising content may be an advertisement for a product or service (so-called CM), or may be a notice about another program. In the illustrated example, the BL coding unit 111 codes the main program and outputs the BL bit stream to the control unit 120, the EL coding unit 112a codes the replacement program a and outputs the EL bit stream a to the control unit 120, the EL coding unit 112b codes the replacement program b and outputs the EL bit stream b to the control unit 120, and the EL coding unit 112c codes the replacement program c and outputs the EL bit stream c to the control unit 120. For the sake of explanation, the outputs of the respective coding units are input to the control unit 120, respectively, but the coding units may output the coded bit streams to the control unit 120 as one coded bit stream according to a protocol, and the control unit 120 may process them individually.
[0034] In addition, in the current digital broadcasting, multi-channel broadcasting is performed by extending live broadcast programs such as sports broadcasts. In multi-channel broadcasting, the same channel is divided into two sub-channels for video distribution, and while the live broadcast program continues on sub-channel 1, a program according to the program schedule (e.g., a news program) is simultaneously broadcast on sub-channel 2. In such a case, the multi-layer encoding unit 110 may encode the live broadcast program on BL and the program according to the program schedule on EL. For example, when the viewer is watching a live sports broadcast, the receiving device 200 may automatically select the sub-channel for the live sports broadcast, or when it is known from the viewer's viewing history that the viewer has a habit of selecting a channel during a multi-channel broadcast or viewing news during that time period, the receiving device 200 may automatically select sub-channel 2, thereby presenting a program suitable for the user without requiring the user to perform any operation. In addition, in the current multi-channel broadcasting, while the initial setting sub-channel 1 is automatically switched to, there is a problem that switching to sub-channel 2 is required to be manually operated, making it difficult to understand how to switch sub-channels, but this is resolved to some extent.
[0035] The control unit 120 accumulates the bit streams of each layer output by the multi-layer encoding unit 110, and outputs the multi-layer bit stream to the multiplexing unit 130 at a timing according to the program transmission schedule. In such a configuration, the control unit 120 may constitute a part of an encoding means that generates bit streams of multiple layers (multi-layer bit streams) using multi-layer encoding.
[0036] Alternatively, when the multi-layer encoding unit 110 is configured to receive the main program and the replacement program as input and output one multi-layer bit stream to the control unit 120 through multi-layer encoding, the control unit 120 accumulates the bit streams of each layer output by the multi-layer encoding unit 110, and outputs the multi-layer bit stream to the multiplexing unit 130 at a timing according to the program transmission schedule.
[0037] However, the control unit 120 does not necessarily have to accumulate the bitstream. For a live broadcast program, the control unit 120 may output the bitstream of the program to the multiplexing unit 130 without accumulating it.
[0038] Furthermore, the control unit 120 outputs program information indicating the program classification of each layer to the multiplexing unit 130. The program classification is given based on the contents of the encoded program, and may be, for example, a classification code such as news, music, culture, or animation. The classification code may be a code that systematizes information roughly classifying program types (categories) (for example, news programs, entertainment programs, information programs, and advertising programs), or may be a code that systematizes more detailed information (for example, incidents, accidents, economy, weather, seasonal topics, stand-up comedy, dramas, movies, animations, talk, entertainment, current events, daily necessities, real estate, and finance).
[0039] The multiplexing unit 130 is an example of a multiplexing means for multiplexing program information indicating program classifications of each of a plurality of layers into a bit stream of the plurality of layers (multi-layer bit stream). The multiplexing unit 130 outputs a multiplexed stream in which the program information is multiplexed into the multi-layer bit stream to the transmitting unit 140.
[0040] The multiplexing unit 130 may multiplex the program information as Service Information (SI). The SI is multiplexed in the form of a control message. For example, the multiplexing unit 130 may periodically (repeatedly) include the program information in the multiplexed stream. The multiplexing unit 130 may include the program information in an SI (control message) associated with the program. Such SI may be, for example, information required for viewing a digital broadcast program or a table called an EIT (Event Information Table) that includes program titles, broadcast times, program performers, and the like. In this way, the multiplexing unit 130 outputs a multiplexed stream that includes the program information as part of the SI.
[0041] However, the multiplexing unit 130 may include the program information in a message or a table other than the SI. For example, the multiplexing unit 130 may include the program information in metadata of ISOBMFF (ISO Base Media File Format). Such metadata may be transmitted more frequently than the SI.
[0042] The multiplexing method in the multiplexing unit 130 is not particularly limited, and may be, for example, MPEG-2 or MPEG-4 Transport stream (TS), MPEG Media Transport (MMT), or CMAF (Common Media Application Format), etc. When MMT is used, the above-mentioned SI may be MMT-SI.
[0043] The transmitting unit 140 performs line coding and the like on the multiplexed stream output by the multiplexing unit 130, and sends it out as a broadcast signal to a transmission line 500 (a broadcast transmission line in this embodiment).
[0044] (4) Receiving device 3 is a diagram showing the configuration of a receiving device 200 according to this embodiment. The receiving device 200 according to this embodiment includes a receiving unit 210, a control unit 220, a viewing history storage unit 230, a selecting unit 240, and a decoding unit 250.
[0045] The receiving unit 210 is an example of a receiving means for receiving a bit stream of multiple layers (multi-layer bit stream) obtained by using multi-layer coding. Different program images are independently coded in each of the multiple layers. In this embodiment, the receiving unit 210 receives a broadcast signal via a transmission path 500, performs demodulation and the like, and outputs a multiplexed stream to the control unit 220. The multiplexed stream includes a multi-layer bit stream and program information indicating the program classification of each layer.
[0046] The control unit 220 detects channel information, program information, and the like of the signal received by the receiving unit 210, and outputs the detected program information to the selection unit 240. Furthermore, the control unit 220 specifies a viewing layer (i.e., a viewing program) based on selection information indicating a program (layer) selected by the selection unit 240, and outputs a bitstream of the specified layer to the decoding unit 250. When a multi-layer bitstream consisting of independent layers is received, the control unit 220 may determine that the viewing layer is in a state in which it can be automatically selected.
[0047] The viewing history storage unit 230 stores a viewing history of programs viewed by a viewer using the receiving device 200. The viewing history is an example of personal information related to the programs viewed by the viewer. The viewing history includes the program classification (classification code), date, day of the week, and viewing time period of each viewed program.
[0048] The selection section 240 includes an automatic selection section 241 that performs automatic selection of a program to be viewed, and a manual selection section 242 that is used for manual selection of a program to be viewed.
[0049] The automatic selection unit 241 is an example of a selection means that performs automatic selection to select a layer that matches a viewer's preference from among multiple layers, based on program information that is information multiplexed into the multi-layer bit stream and indicates the program classification of each layer. In this embodiment, the automatic selection unit 241 performs automatic selection based on the program information multiplexed into the multi-layer bit stream and the viewing history stored in the viewing history storage unit 230.
[0050] The automatic selection unit 241 may specify the program classification of a previously viewed program that corresponds to the current program viewing conditions (e.g., the currently viewed program, the current day of the week, and the current time slot) based on the viewing history, and select a layer that matches the specified program classification from among multiple layers based on the program information. This allows the layer of the program classification that is estimated to be of the highest interest based on the viewing history to be automatically selected.
[0051] For example, if the sponsor of a commercial is a manufacturer of children's toys or household goods, in the past the commercials that were broadcast were fixed depending on the time of day, but in this embodiment, multiple commercials are broadcast simultaneously and the viewer can select from them the commercial that is most suitable for them (for example, if the viewer has a viewing history of the program that the toy is based on, a commercial for the toy, or if the viewer has a lot of viewing history of programs that focus on housework such as cooking shows, a commercial for household goods).
[0052] Alternatively, the automatic selection unit 241 may rank program classifications in descending order of the viewer's viewing frequency based on the viewing history, and select a layer matching a program classification with a high ranking from among a plurality of layers based on the program information. For example, the automatic selection unit 241 may identify up to n program classifications (n≧2) from the top, and select a layer with a high ranking that matches the identified program classification.
[0053] However, although the layer to be selected is initially set to an automatic selection operation, the viewer can also manually switch using the manual selection unit 242 (including a remote control) to select a video output that is different from the viewing history. The manual selection unit 242 outputs selection control by the viewer from a remote control or the like. The selection result by the manual selection unit 242 is stored and accumulated in the viewing history storage unit 230.
[0054] In order to perform automatic selection based on the viewing history, a certain amount of viewing history needs to be accumulated in the viewing history storage unit 230. Therefore, the control unit 220 may control the selection unit 240 to perform a manual selection operation until a certain period (for example, about several days) has passed from the initial state, and when automatic selection becomes possible, the viewer is notified of this and then the automatic selection unit 241 may start the automatic selection operation.
[0055] Furthermore, the viewing history may be stored by identifying an individual by viewing in a state where the viewer is designated (selected) through profile selection by the user. In this case, the viewing history storage unit 230 may store the individual ID (user ID) of the viewer in association with the viewing history of the individual. When the individual currently viewing is designated through profile selection, the automatic selection unit 241 may perform an automatic selection operation based on the viewing history associated with the designated individual.
[0056] When the viewing layer (i.e., the viewing program) is specified based on the selection information indicating the program (layer) selected by the selection unit 240, the bit stream of the specified layer is output from the control unit 220 to the decoding unit 250. In this way, the viewing program is switched by switching the layer to be decoded based on the selection using the selection unit 240. Unlike the case of similar switching between channels, there is no need to switch the channel selection of the tuner, so the advantage of using independent layers in multi-layer coding is that switching can be performed instantly. In addition, based on the viewing history accumulated in the receiving device 200 (viewing history storage unit 230), a program suitable for the viewer can be automatically selected when multiple programs are sent, and the selected program can be presented. If the replacement program is an advertisement such as a commercial, targeted advertising can be realized without providing personal information to the transmitting side.
[0057] The decoding unit 250 performs a decoding process on the bit stream output by the control unit 220, and outputs a decoded video signal to an external display device. However, the display device may be integrated with the receiving device 200.
[0058] In the above embodiment, an example has been described in which the automatic selection unit 241 automatically selects a viewing layer (i.e., a viewed program) using the viewing history stored in the viewing history storage unit 230, but the present invention is not limited to this. In the receiving device 200, personal information indicating a program classification preferred by the viewer may be preset manually (e.g., by a remote control) in advance in the receiving device 200, and such preset information may be stored in the storage unit. The automatic selection unit 241 may automatically select a viewing layer based on the preset information in addition to or instead of the viewing history.
[0059] Here, the preset information may be stored by presetting the viewer in a state where the viewer is designated (selected) by the user's profile selection. In this case, the viewing history storage unit 230 may store the viewer's personal ID (user ID) in association with the preset information of the individual. When the individual currently viewing is designated by the profile selection, the automatic selection unit 241 may perform an automatic selection operation based on the preset information associated with the designated individual.
[0060] Alternatively, personal information indicating the viewer's favorite program classification may be delivered and set from an external server to the receiving device 200, and such setting information may be stored in a storage unit of the receiving device 200. Such an external server may estimate the viewer's favorite program classification from the viewer's history of Internet behavior (e.g., web browsing, video viewing, etc.), and deliver and set the estimated result to the receiving device 200.
[0061] (5) Summary of the embodiment The transmitting device 100 of this embodiment has a multi-layer encoding unit 110 that generates a bit stream of multiple layers (multi-layer bit stream) using multi-layer encoding, with different program images being independently encoded in each of the multiple layers, a multiplexing unit 130 that multiplexes program information indicating the program classification of each of the multiple layers into the bit stream of the multiple layers, and a transmitting unit 140 that transmits the output signal of the multiplexing unit 130 to the receiving side.
[0062] The receiving device 200 of this embodiment has a receiving unit 210 that receives a bitstream of multiple layers obtained using multi-layer coding, an automatic selection unit 241 that performs automatic selection to select a layer that suits a viewer's preference from among the multiple layers based on program information that is information multiplexed into the bitstream of the multiple layers and indicates the program classification of each layer, and a decoding unit 250 that performs decoding processing on the bitstream of the layer selected by the automatic selection unit 241 and outputs a decoded video signal.
[0063] According to the transmitting device 100 and the receiving device 200, it is possible to protect personal information, enable a viewer to watch videos that match his / her preferences, and suppress problems associated with video switching.
[0064] (6) First change example In the above embodiment, an example in which the transmission path 500 is a broadcast transmission path has been described, but the present invention is not limited to this. There are forms in which broadcasting and communication are used as a means of video distribution, and in recent years, a method in which broadcasting and communication are used in combination (e.g., hybrid cast) has also been put to practical use. Therefore, a configuration is possible in which the main program is transmitted over a broadcast transmission path, and the replacement program is transmitted over a communication transmission path (e.g., via the Internet).
[0065] 4 is a diagram showing a first modified example of the transmitting device 100 according to the above embodiment. The transmitting device 100 according to this modified example has a transmitting unit 140 that transmits a BL bitstream and program information via a broadcast transmission path 500a, and a communication unit 150 that transmits one or more EL bitstreams via a communication transmission path 500b.
[0066] 5 is a diagram showing a first modified example of the receiving device 200 according to the above-mentioned embodiment. The receiving device 200 according to this modified example has a receiving unit 210 that receives a BL bitstream and program information via a broadcast transmission path 500a, and a communication unit 260 that receives one or more EL bitstreams via a communication transmission path 500b.
[0067] (7) Second Change Example In this modification, an example in which the receiving device 200 requests the transmitting device 100 to transmit an EL bitstream will be described.
[0068] 6 is a diagram showing a second modified example of the transmitting device 100 according to the above embodiment. The transmitting device 100 according to this modified example has a transmitting unit 140 that transmits a BL bitstream and program information via a broadcast transmission path 500a, and a communication unit 150 that transmits one or more EL bitstreams selected by the receiving device 200 via a communication transmission path 500b.
[0069] In this modified example, the communication unit 150 receives selection information indicating the layer (EL) selected by the receiving device 200 from the receiving device 200 via the communication transmission path 500b, and outputs the received selection information to the control unit 120. The control unit 120 acquires a bit stream of the layer (EL) indicated by the selection information, and outputs the acquired EL bit stream to the multiplexing unit 130. The control unit 120 may output the acquired EL bit stream to the communication unit 150 without passing through the multiplexing unit 130. The communication unit 150 transmits the EL bit stream acquired by the control unit 120 to the receiving device 200 via the communication transmission path 500b.
[0070] 7 is a diagram showing a second modified example of the receiving device 200 according to the above embodiment. The receiving device 200 according to this modified example has a receiving unit 210 that receives the BL bitstream and program information via a broadcast transmission path 500a, and a communication unit 260 that receives the EL bitstream selected by the selection unit 240 via a communication transmission path 500b.
[0071] In this modification, the control unit 220 controls the communication unit 260 to transmit selection information indicating the layer (EL) selected by the selection unit 240 to the transmission device 100 via the communication transmission path 500b. Here, the control unit 220 obtains information on the next program provided as program information, and when a switchable program comes next, the control unit 220 controls the communication unit 260 to analyze the classification information in the automatic selection unit 241, and when it is determined that a replacement program should be selected, to obtain the replacement program (EL bitstream) in advance from the transmission device 100. This makes it possible to conceal delays that occur when obtaining a bitstream through communication.
[0072] (8) Other embodiments A program may be provided that causes a computer to execute each process performed by the transmitting device 100 or the receiving device 200. The program may be recorded in a computer-readable medium. The computer-readable medium can be used to install the program in a computer. Here, the computer-readable medium on which the program is recorded may be a non-transient recording medium. The non-transient recording medium is not particularly limited, and may be, for example, a recording medium such as a CD-ROM or a DVD-ROM. In addition, a circuit that executes each process performed by the transmitting device 100 or the receiving device 200 may be integrated, and at least a part of the transmitting device 100 or the receiving device 200 may be configured as a semiconductor integrated circuit (chip set, SoC).
[0073] The terms "based on" and "depending on / in response to" used in this disclosure do not mean "based only on" or "depending only on", unless otherwise specified. The term "based on" means both "based only on" and "based at least in part on". Similarly, the term "depending on" means both "based only on" and "depending at least in part on". The terms "include", "comprise", and variations thereof do not mean including only the recited items, but may include only the recited items or may include additional items in addition to the recited items. Additionally, the term "or" used in this disclosure is not intended to be an exclusive or. Additionally, any reference to elements using designations such as "first", "second", etc., used in this disclosure is not intended to generally limit the quantity or order of those elements. These designations may be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some manner. In this disclosure, where articles are added by translation, such as, for example, a, an, and the in English, these articles are intended to include the plural unless the context clearly indicates otherwise.
[0074] Although the embodiments have been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like are possible without departing from the spirit and scope of the invention.
[0075] (9) Additional Notes Additional notes will be given regarding the features of the above-described embodiment.
[0076] (Appendix 1) A receiving means (a receiving unit 210, a communication unit 260) for receiving a bit stream of a plurality of layers obtained by multi-layer coding, in which different program images are independently coded in each of the plurality of layers; A selection means (automatic selection unit 241) for automatically selecting a layer that matches a viewer's preference from among the plurality of layers based on program information that is information multiplexed into the bit stream of the plurality of layers and indicates program classifications of each of the plurality of layers; A decoding means (a decoding unit 250) that performs a decoding process on the bit stream of the layer selected by the selection means and outputs a decoded video signal. A receiving device (receiving device 200).
[0077] (Appendix 2) The system further includes a storage unit (a viewing history storage unit 230) for storing personal information related to a viewer's viewing program, The selection means performs the automatic selection based on the program information and the personal information. 2. A receiving device as described in claim 1.
[0078] (Appendix 3) The personal information includes a viewing history of the viewer regarding programs that the viewer has previously viewed, The selection means specifies a program classification of the previously viewed program corresponding to a current program viewing condition based on the viewing history, and selects a layer corresponding to the specified program classification from among the plurality of layers based on the program information. 3. A receiving device as described in claim 2.
[0079] (Appendix 4) The plurality of layers include: a base layer in which a main program video is encoded; and one or more enhancement layers in which replacement program video that can be substituted for the main program video is coded as a layer independent of the base layer. 4. A receiving device according to claim 1.
[0080] (Appendix 5) The receiving means includes: Receive the base layer bit stream and the program information via a broadcast transmission path (broadcast transmission path 500a); The bit stream of the enhancement layer selected by the selection means is received via a communication transmission path (communication transmission path 500b). 5. A receiving device as described in claim 4.
[0081] (Appendix 6) A coding means (a multi-layer coding unit 110) for generating a bit stream of a plurality of layers using multi-layer coding, in which different program images are independently coded in each of the plurality of layers; a multiplexing unit (130) for multiplexing program information indicating program classifications of each of the plurality of layers into a bit stream of the plurality of layers; a transmitting means (transmitting unit 140, communication unit 150) for transmitting the output signal of the multiplexing means to a receiving side, The program information is used for automatic selection on the receiving side to select a layer that matches a viewer's preference from among the plurality of layers. Transmitting device.
[0082] (Appendix 7) The plurality of layers include: a base layer in which a main program video is encoded; and one or more enhancement layers in which replacement program video that can be substituted for the main program video is coded as a layer independent of the base layer. 7. A transmitting device as described in claim 6.
[0083] (Appendix 8) The transmitting means is Transmitting the base layer bit stream and the program information via a broadcast transmission path (broadcast transmission path 500a); The bit stream of the enhancement layer selected on the receiving side is transmitted via a communication transmission path (communication transmission path 500b). 8. The transmitting device according to claim 7.
[0084] (Appendix 9) A computer is caused to function as the receiving device according to claim 1 or the transmitting device according to claim 6. program. [Explanation of symbols]
[0085] 10: Video distribution system 100: Transmitting device 110: Multi-layer coding unit 111 :BL encoding section 112 :EL encoding section 120: Control section 130: Multiplexing section 140: Transmitter 150: Communications Department 200: Receiving device 210: Receiving unit 220: Control section 230: Viewing history memory unit 240: Selection section 241: Automatic selection section 242: Manual selection section 250: Decoding section 260: Communications Department 500: Transmission line 500a: Broadcast transmission line 500b: Communication transmission line
Claims
1. A receiving means for receiving a bit stream of a plurality of layers obtained by multi-layer coding, in which different program images are independently coded in each of the plurality of layers; a selection means for automatically selecting a layer that matches a viewer's preference from among the plurality of layers based on program information that is information multiplexed into the bit stream of the plurality of layers and indicates program classifications of each of the plurality of layers; and a decoding means for performing a decoding process on the bit stream of the layer selected by the selecting means and outputting a decoded video signal. Receiving device.
2. The system further includes a storage means for storing personal information related to a program being viewed by a viewer, The selection means performs the automatic selection based on the program information and the personal information.
2. The receiving device according to claim 1.
3. The personal information includes a viewing history of the viewer regarding programs that the viewer has previously viewed, The selection means specifies a program classification of the previously viewed program corresponding to a current program viewing condition based on the viewing history, and selects a layer corresponding to the specified program classification from among the plurality of layers based on the program information.
3. The receiving device according to claim 2.
4. The plurality of layers include: a base layer in which a main program video is encoded; and one or more enhancement layers in which replacement program video that can be substituted for the main program video is coded as a layer independent of the base layer.
4. A receiving device according to claim 1.
5. The receiving means includes: receiving the base layer bitstream and the program information via a broadcast transmission path; receiving the bit stream of the enhancement layer selected by the selection means via a communication transmission path; 5. The receiving device according to claim 4.
6. An encoding means for generating a bit stream of a plurality of layers using multi-layer encoding, in which different program images are independently encoded in each of the plurality of layers; a multiplexing means for multiplexing program information indicating program classifications of each of the plurality of layers into a bit stream of the plurality of layers; a transmitting means for transmitting the output signal of the multiplexing means to a receiving side, The program information is used for automatic selection on the receiving side to select a layer that matches a viewer's preference from among the plurality of layers. Transmitting device.
7. The plurality of layers include: a base layer in which a main program video is encoded; and one or more enhancement layers in which replacement program video that can be substituted for the main program video is coded as a layer independent of the base layer. The transmitting device according to claim 6.
8. The transmitting means is Transmitting the base layer bitstream and the program information via a broadcast transmission path; The bit stream of the enhancement layer selected at the receiving side is transmitted via a communication transmission path. The transmitting device according to claim 7.
9. A computer is caused to function as the receiving device according to claim 1 or the transmitting device according to claim 6. program.
Citation Information
Patent Citations
Information cooperation system, terminal device management server, contractor management server, and program
JP2021136480A
