Content protection processing method
The implementation of MMT and advanced encoding methods in TV receivers addresses limitations in data broadcast functions, enabling high-value-added content distribution with enhanced synchronization and error resilience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- MAXELL LTD
- Filing Date
- 2022-10-19
- Publication Date
- 2026-06-22
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing TV receivers struggle to meet demands for high-value-added content distribution, particularly in broadband network environments, due to limitations in data broadcast reception functions.
Implementing a content protection processing method using MMT (MPEG Media Transport) for enhanced media transport, incorporating MPEG-H HEVC for video encoding, MPEG-4 AAC or ALS for audio encoding, and advanced error correction techniques, along with MMT-SI and TLV-SI control information for synchronized and asynchronous data transmission.
Enables high-value-added functions in TV receivers, supporting high-definition video content distribution with improved error resilience and synchronization across diverse transmission paths.
Smart Images

Figure 0007877163000001 
Figure 0007877163000002 
Figure 0007877163000003
Abstract
Description
Technical Field
[0001] The present invention relates to broadcast reception technology and output video information generation technology.
Background Art
[0002] One of the extended functions of digital broadcast services is data broadcast, which transmits digital data via a broadcast wave and displays various types of information such as weather forecasts, news, and recommended programs. A large number of commercially available TV receivers that can receive data broadcasts already exist, and a number of technologies related to data broadcast reception, including the following Patent Document 1, have been published.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In response to environmental changes related to content distribution in recent years, TV receivers are also required to have various function expansions. In particular, there are many demands for the distribution of content and cooperative applications using a broadband network environment such as the Internet, and for the high-definition / high-resolution of video content. However, it is difficult to provide a high-value-added TV receiver that can meet the above demands by simply diverting the data broadcast reception function or the like provided in the current TV receiver, or only by expanding the functions of the data broadcast reception function or the like.
[0005] An object of the present invention is to realize a content protection processing method capable of executing a function with higher added value.
Means for Solving the Problems
[0006] As means for solving the above problems, the technology described in the claims is used. [Effects of the Invention]
[0007] By using the technology of the present invention, it is possible to realize a content protection processing method that can perform functions with higher added value. [Brief explanation of the drawing]
[0008] [Figure 1] This is a system configuration diagram showing an example of a broadcast communication system including a broadcast receiving device according to Example 1. [Figure 2A] This is a diagram illustrating the overview of coded signals in MMT. [Figure 2B] This is a diagram of the MPU configuration in MMT. [Figure 2C] This is a diagram showing the configuration of an MMTP packet in MMT. [Figure 3] This is a conceptual diagram of the protocol stack of a broadcasting system using MMT. [Figure 4] This is a hierarchical diagram of the control information used in broadcasting systems. [Figure 5A] This is a list of tables used in the TLV-SI broadcasting system. [Figure 5B] This is a list of descriptors used in the TLV-SI broadcasting system. [Figure 6A] This is a list of messages used in the MMT-SI broadcasting system. [Figure 6B] This is a list of tables used in the MMT-SI broadcasting system. [Figure 6C] This is a list (part 1) of descriptors used in the MMT-SI broadcasting system. [Figure 6D] This is a list of descriptors used in the MMT-SI broadcasting system (part 2). [Figure 6E] This diagram shows the relationship between data transmission in the broadcasting system and each table. [Figure 7A] This is a block diagram of the broadcast receiving device according to Example 1. [Figure 7B]It is a configuration diagram of the logical plane structure of the presentation function of the broadcast receiving apparatus according to Embodiment 1. [Figure 7C] It is a system configuration diagram of clock synchronization / presentation synchronization of the broadcast receiving apparatus according to Embodiment 1. [Figure 7D] It is a software configuration diagram of the broadcast receiving apparatus according to Embodiment 1. [Figure 8] It is a block diagram of the broadcast station server according to Embodiment 1. [Figure 9] It is a block diagram of the service provider server according to Embodiment 1. [Figure 10A] It is a block diagram of the portable information terminal according to Embodiment 1. [Figure 10B] It is a software configuration diagram of the portable information terminal according to Embodiment 1. [Figure 11A] It is a diagram showing the data structure of MH-TOT of the broadcast system. [Figure 11B] It is a diagram showing the format of the JST_time parameter of the broadcast system. [Figure 12] It is a diagram showing a method for calculating the current date from MJD of the broadcast receiving apparatus according to Embodiment 1. [Figure 13A] It is a diagram showing the configuration of the NTP format of the broadcast system. [Figure 13B] It is a diagram showing the data structure of the MPU timestamp descriptor of the broadcast system. [Figure 13C] It is a diagram showing the data structure of the time information in the TMCC extended information area of the broadcast system. [Figure 14] It is an operation sequence diagram at the time of channel scan of the broadcast receiving apparatus according to Embodiment 1. [Figure 15A] It is a diagram showing the data structure of TLV-NIT of the broadcast system. [Figure 15B] It is a diagram showing the data structure of the satellite distribution system descriptor of the broadcast system. [Figure 15C] It is a diagram showing the data structure of the service list descriptor of the broadcast system. [Figure 15D] It is a diagram showing the data structure of AMT of the broadcast system. [Figure 16] This is an operation sequence diagram of the broadcast receiving device during channel selection according to Example 1. [Figure 17] This diagram shows the data structure of the MPT in a broadcasting system. [Figure 18] This diagram shows the data structure of the LCT in a broadcasting system. [Figure 19A] This figure shows an example of assigning layouts to layout numbers based on LCT. [Figure 19B] This figure shows an example of assigning layouts to layout numbers based on LCT. [Figure 19C] This figure shows an example of assigning layouts to layout numbers based on LCT. [Figure 19D] This figure shows an example of assigning layouts to layout numbers based on LCT. [Figure 20A] This diagram illustrates the operation of exception handling for screen layout control based on LCT. [Figure 20B] This diagram illustrates the operation of exception handling for screen layout control based on LCT. [Figure 21] This diagram shows the data structure of the MH-EIT broadcasting system. [Figure 22A] This is a screen display diagram of the EPG screen of the broadcast receiving device according to Example 1. [Figure 22B] This is a screen display diagram of the EPG screen of the broadcast receiving device according to Example 1. [Figure 22C] This is a screen display diagram of the EPG screen of the broadcast receiving device according to Example 1. [Figure 23] This is a screen display diagram of the broadcast receiving device according to Example 1 when an emergency warning broadcast is displayed. [Figure 24] This is a block diagram of the broadcast receiving device according to Example 2. [Figure 25] This diagram illustrates the inconsistency in the current time display when broadcasting services are switched. [Figure 26A] This diagram illustrates the operation of the selection control for the current time information reference source according to Example 2. [Figure 26B]This is an operation sequence diagram of the current time information update process according to Example 2. [Figure 27A] This is a screen display diagram of the EPG screen of the broadcast receiving device according to Example 2. [Figure 27B] This is a screen display diagram of the EPG screen of the broadcast receiving device according to Example 2. [Figure 28] This is a diagram illustrating the structure of the program data. [Figure 29] This is a diagram illustrating the structure of the asset data. [Figure 30] This diagram shows the data structure of a PA message. [Figure 31] This diagram shows the data structure of MMT_general_location_info. [Figure 32] This is a diagram showing the data structure of PLT. [Figure 33] This diagram shows the meaning of location types. [Figure 34] This diagram shows the data structure of the MPU-presented region descriptor. [Figure 35A] This is a diagram illustrating the presentation operation according to Example 3. [Figure 35B] This is a diagram illustrating the presentation operation according to Example 3. [Figure 36A] This diagram shows the data structure of the LCT expiration descriptor. [Figure 36B] This diagram illustrates the data structure of the layout expiration descriptor. [Figure 36C] This diagram shows the data structure of the presentation area expiration date descriptor. [Figure 37] This diagram shows the data structure of the Common Presentation Area Information Descriptor. [Figure 38] This diagram shows the meaning of full_set_flag. [Figure 39] This diagram shows the data structure of the duplicate presentation region descriptor. [Figure 40] This is a diagram illustrating the presentation operation according to Example 3. [Figure 41] This is a diagram illustrating the presentation operation according to Example 3. [Figure 42]This diagram shows the data structure of dependency descriptors. [Figure 43] This is a diagram illustrating the presentation operation according to Example 3. [Figure 44] This diagram shows the data structure of a modified dependency descriptor. [Figure 45] This diagram shows the meaning of `dependency_type`. [Figure 46] This is a diagram illustrating the presentation operation according to Example 3. [Modes for carrying out the invention]
[0009] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. (Example 1)
[0010] [System Configuration] Figure 1 is a system configuration diagram showing an example of a broadcast communication system including a broadcast receiving device of this embodiment. The broadcast communication system of this embodiment consists of a broadcast receiving device 100 and an antenna 100a, a broadband network such as the Internet 200 and a router device 200r and an access point 200a, a broadcasting station's radio tower 300t and a broadcasting satellite (or communication satellite) 300s, a broadcasting station server 300, a service provider server 400, other application servers 500, a mobile telephone communication server 600 and a base station 600b of the mobile telephone communication network, and a mobile information terminal 700.
[0011] The broadcast receiving device 100 receives broadcast waves transmitted from the radio tower 300t via the broadcast satellite (or communication satellite) 300s and antenna 100a. Alternatively, it may receive the broadcast waves transmitted from the radio tower 300t directly from antenna 100a without going through the broadcast satellite (or communication satellite) 300s. The broadcast receiving device 100 can also connect to the internet 200 via the router device 200r, and can transmit and receive data by communicating with various server devices and other communication equipment on the internet 200.
[0012] The router device 200r is connected to the internet 200 by wired communication, and is also connected to the broadcast receiving device 100 by wired or wireless communication, and to the personal information terminal 700 by wireless communication. The wireless communication may use a method such as Wi-Fi (registered trademark). This makes it possible for the broadcast receiving device 100 and the personal information terminal 700 to mutually send and receive data via the router device 200r. However, communication between the broadcast receiving device 100 and the personal information terminal 700 may be performed directly using a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without going through the router device 200r.
[0013] The radio tower 300t is broadcasting equipment of the broadcasting station and transmits broadcast waves containing encoded data for broadcast programs, subtitle information, other applications, general-purpose data, etc. The broadcasting satellite (or communication satellite) 300s is a relay that receives broadcast waves transmitted from the radio tower 300t of the broadcasting station, performs frequency conversion as appropriate, and then retransmits the broadcast waves to the antenna 100a connected to the broadcasting receiving device 100. The broadcasting station also has a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata for each broadcast program, such as the program title, program ID, program summary, cast information, broadcast date and time, etc., and is capable of providing the video content and metadata to service providers based on a contract. The provision of the video content and metadata to service providers may be done through an API (Application Programming Interface) provided by the broadcasting station server 300.
[0014] The service provider server 400 is a server device provided by the service provider and is capable of providing various services linked to broadcast programs distributed by the broadcasting station. The service provider server 400 also stores, manages, and distributes video content and metadata provided by the broadcasting station server 300, as well as various content and applications linked to broadcast programs. It also has the function of searching for and providing a list of available content and applications in response to inquiries from television receivers, etc. The storage, management, and distribution of the content and metadata and the storage, management, and distribution of the applications may be performed by different server devices. The broadcasting station and the service provider may be the same or different. Multiple service provider servers 400 may be provided for each different service. Furthermore, the functions of the service provider server 400 may also be provided by the broadcasting station server 300.
[0015] Other application servers 500 are known server devices that store, manage, and distribute other common applications, operating programs, content, data, etc. There may be multiple other application servers 500 on the Internet 200.
[0016] The mobile telephone communication server 600 is connected to the Internet 200, and on the other hand, it is connected to the personal information terminal 700 via the base station 600b. The mobile telephone communication server 600 manages the telephone communication (calls) and data transmission / reception of the personal information terminal 700 via the mobile telephone communication network, and enables data transmission and reception through communication between the personal information terminal 700 and various server devices and other communication equipment on the Internet 200. Communication between the base station 600b and the personal information terminal 700 may be carried out using W-CDMA (Wideband Code Division Multiple Access) (registered trademark), GSM (Global System for Mobile communications) (registered trademark), LTE (Long Term Evolution), or other communication methods.
[0017] The personal information terminal 700 shall have the functions of telephone communication (calls) and data transmission / reception via a mobile telephone communication network, as well as wireless communication functions such as Wi-Fi (registered trademark). The personal information terminal 700 can connect to the Internet 200 via a router device 200r and an access point 200a, or via a base station 600b and a mobile telephone communication server 600 of the mobile telephone communication network, and can transmit and receive data by communicating with various server devices and other communication devices on the Internet 200. The access point 200a is connected to the Internet 200 by wired communication and to the personal information terminal 700 by wireless communication. The wireless communication may use a method such as Wi-Fi (registered trademark). Communication between the personal information terminal 700 and the broadcast receiving device 100 may be performed via the access point 200a and the Internet 200 and the router device 200r, or via the base station 600b and the mobile telephone communication server 600 and the Internet 200 and the router device 200r.
[0018] [Overview of the MMT method] The broadcast receiving device 100 shown in Figure 1 is a television receiver that supports MMT (MPEG Media Transport) as a media transport method for transmitting video, audio, and other data, instead of TS (Transport Stream) (hereinafter referred to as MPEG2-TS) defined in the MPEG (Moving Picture Experts Group)-2 system, which is widely used in conventional digital broadcasting systems. A television receiver that supports both MPEG2-TS and MMT is also acceptable.
[0019] MPEG2-TS is characterized by multiplexing video, audio, and other components that make up a program into a single stream along with control signals and a clock. Because it treats everything, including the clock, as a single stream, it is suitable for transmitting one piece of content over a single transmission path with guaranteed transmission quality, and has been adopted in many conventional digital broadcasting systems. On the other hand, due to the limitations of MPEG2-TS in the face of recent environmental changes related to content distribution, such as the diversification of content, the diversification of equipment that uses content, the diversification of transmission paths for content distribution, and the diversification of content storage environments, MMT (Media Transport Method) was newly formulated as a media transport method.
[0020] Figure 2A shows an example of the encoded signal in the MMT of this embodiment. As shown in the figure, the MMT of this embodiment has an MFU (Media Fragment Unit), an MPU (Media Processing Unit), an MMTP (MMT Protocol) payload, and an MMTP packet as elements constituting the encoded signal. The MFU is the format used when transmitting video, audio, etc., and may be configured in units of NAL (Network Abstraction Layer) units or access units. The MPU may consist of MPU metadata containing information about the overall configuration of the MPU, movie fragment metadata containing information about the encoded media data, and sample data which is the encoded media data. It is also assumed that the MFU can be extracted from the sample data. Furthermore, in the case of media such as video components and audio components, the presentation time and decoding time may be specified on an MPU or access unit basis. Figure 2B shows an example of the configuration of the MPU.
[0021] An MMTP packet consists of a header and an MMTP payload, and transmits control information for the MFU and MMT. The MMTP payload shall have a payload header corresponding to the contents (data units) stored in the payload. Figure 2C shows an example of the overview from configuring an MFU from video / audio signals to storing it in the MMTP payload and then configuring an MMTP packet. For video signals encoded using inter-frame prediction, it is desirable to configure the MPU in units of GOP (Group Of Pictures). Also, if the size of the MFU to be transmitted is small, one MFU may be stored in one payload, or multiple MFUs may be stored in one payload. Also, if the size of the MFU to be transmitted is large, one MFU may be divided and stored in multiple payloads. Furthermore, MMTP packets may be protected using technologies such as AL-FEC (Application Layer Forward Error Correction) or ARQ (Automatic Repeat Request) to recover packet loss on the transmission path.
[0022] In the broadcast system of this embodiment, MPEG-H HEVC (High Efficiency Video Coding) is used as the video encoding method, and MPEG-4 AAC (Advanced Audio Coding) or MPEG-4 ALS (Audio Lossless Coding) is used as the audio encoding method. The encoded data of video and audio of broadcast programs encoded using the above methods shall be in MFU or MPU format, further packaged in an MMTP payload and transmitted as MMTP packets via IP (Internet Protocol) packets. Data content related to broadcast programs may also be in MFU or MPU format, further packaged in an MMTP payload and transmitted as MMTP packets via IP packets. Four types of data content transmission methods are provided: a subtitle / text superimposition transmission method used for streaming data synchronized with the broadcast, an application transmission method used for asynchronous data transmission from the broadcast, an event message transmission method used for synchronous / asynchronous message notification to applications running on a television receiver, and a general-purpose data transmission method for transmitting other general-purpose data synchronously / asynchronously.
[0023] For the transmission of MMTP packets, UDP / IP (User Datagram Protocol / Internet Protocol) is used on the broadcast transmission line, and UDP / IP or TCP / IP (Transmission Control Protocol / Internet Protocol) is used on the communication line. Furthermore, in the broadcast transmission line, the TLV (Type Length Value) multiplexing method is used for the efficient transmission of IP packets. An example of the protocol stack of the broadcast system in this embodiment is shown in Figure 3. In the figure, (A) is an example of the protocol stack on the broadcast transmission line, and (B) is an example of the protocol stack on the communication line.
[0024] In this embodiment of the broadcasting system, a mechanism is provided for transmitting two types of control information: MMT-SI (MMT-Signaling Information) and TLV-SI (TLV-Signaling Information). MMT-SI is control information that indicates the structure of the broadcast program, etc. It shall be in the format of an MMT control message, placed on an MMTP payload, packaged into an MMTP packet, and transmitted as an IP packet. TLV-SI is control information related to the multiplexing of IP packets and shall provide information for channel selection and information on the correspondence between IP addresses and services.
[0025] Furthermore, broadcast systems using MMT will also transmit time information to provide absolute time. While MPEG2-TS indicated the display time of components based on a different clock for each TS, MMT will indicate the display time of components based on Coordinated Universal Time (UTC). These mechanisms enable terminal devices to synchronously display components transmitted from different transmission points via different transmission paths. To provide UTC, IP packets in NTP (Network Time Protocol) format will be used.
[0026] [Control information for broadcast systems using MMT] In the broadcast system compatible with the broadcast receiver 100 of this embodiment, as described above, as control information, TLV-SI related to the TLV multiplexing method for multiplexing IP packets and MMT-SI related to MMT which is a media transport method are prepared. TLV-SI provides information for the broadcast receiver 100 to demultiplex the IP packets multiplexed on the broadcast transmission path. TLV-SI is composed of a "table" and a "descriptor". The "table" is transmitted in a section format, and the "descriptor" is arranged within the "table". MMT-SI is transmission control information indicating information related to the configuration of MMT packages and broadcast services. MMT-SI is composed of three layers: a "message" storing a "table" and a "descriptor", a "table" having elements and attributes indicating specific information, and a "descriptor" indicating more detailed information. An example of the hierarchical structure of the control information used in the broadcast system of this embodiment is shown in FIG. 4.
[0027] FIG. 5A shows a list of the "tables" used in the TLV-SI of the broadcast system compatible with the broadcast receiver 100 of this embodiment. In this embodiment, the following are used as the "tables" of TLV-SI.
[0028] (1) TLV-NIT The Network Information Table for TLV (TLV-NIT) represents information on the physical configuration of the TLV stream transmitted by the network and the characteristics of the network itself.
[0029] (2) AMT The Address Map Table (AMT) provides a list of multicast groups of IP packets constituting each service transmitted in the network.
[0030] (3) Table set by the operator In addition, it is possible to prepare a table independently set by a service provider or the like.
[0031] <Descriptors used in TLV-SI> Fig. 5B shows a list of "descriptors" arranged in the TLV-SI of the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment. In the present embodiment, the following are used as the "descriptors" of TLV-SI.
[0032] (1) Service list descriptor The service list descriptor provides a list of services by service identification and service format type. [[ID=1x]]
[0033] (2) Satellite distribution system descriptor The satellite distribution system descriptor indicates the physical conditions of the satellite transmission path.
[0034] (3) System management descriptor [[ID=u3]] The system management descriptor is used to distinguish between broadcast and non-broadcast.
[0035] (4) Network name descriptor The network name descriptor describes the network name with character codes.
[0036] [[ID=u3]] (5) Descriptor set by the operator In addition, it is possible to prepare a descriptor independently set by a service provider or the like.
[0037] <Messages used in MMT-SI> Fig. 6A shows a list of "messages" used in the MMT-SI of the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment. In the present embodiment, the following are used as the "messages" of MMT-SI.
[0038] (1) PA message The Package Access (PA) message is used to transmit various tables.
[0039] It should be noted that in the translation, for the tags like etc., they are kept unchanged as required. And for the text content, efforts are made to translate it accurately while maintaining the original format and line breaks. If there are any specific requirements or corrections regarding the translation, please feel free to let me know. (2) M2 Section Message The M2 section message is used to transmit the section extension format of MPEG-2 Systems.
[0040] (3) CA Message The CA message is used to transmit a table for identifying the restricted reception method.
[0041] (4) M2 Short Section Message The M2 short section message is used to transmit the short section format of MPEG-2 Systems.
[0042] (5) Data Transmission Message The data transmission message is a message that stores a table related to data transmission.
[0043] (6) Message Set by Operator In addition, it is possible to prepare messages independently set by service providers and the like.
[0044] <Tables Used in MMT-SI> Figure 6B shows a list of the 'tables' used in the MMT-SI of the broadcast system corresponding to the broadcast receiver 100 of this embodiment. The table is control information having elements and attributes indicating specific information, and is to be stored in a message and transmitted in an MMTP packet. Note that the message storing the table may be determined according to the table. In this embodiment, the following are used as the 'tables' of MMT-SI.
[0045] (1) MPT [[ID=**39**]]The MMT package table (MMT Package Table: MPT) provides information constituting a package such as a list of assets and the position of the assets on the network. MPT may be stored in a PA message.
[0046] (2) PLT[[ID=4**4**]] It seems there is a small error in your original text where the number in the tag is not fully shown in the original Japanese text you provided. I've translated it as it is presented, but please check if this is correct. If not, you can correct it and I'll adjust the translation accordingly when you provide the corrected text.The Package List Table (PLT) lists the IP data flows and packet IDs that transmit PA messages for MMT packages provided as broadcast services, as well as the IP data flows that transmit IP services. The PLT may be stored in the PA message.
[0047] (3) LCT The Layout Configuration Table (LCT) is used to associate layout information for presentation with layout numbers. The LCT may be stored in the PA message.
[0048] (4) ECM An Entitlement Control Message (ECM) is common information consisting of program information and control information, and it delivers key information for descrambling, etc. The ECM may be stored in an M2 section message.
[0049] (5) EMM An Entitlement Management Message (EMM) transmits individual information, including contract information for each subscriber and key information for decrypting the ECM (Common Information). The EMM may be stored in an M2 section message.
[0050] (6)CAT(MH) The CA table (Conditional Access Table: CAT)(MH) is used to store descriptors for identifying the restricted access scheme. The CAT(MH) may be stored in the CA message.
[0051] (7) DCM A Download Control Message (DCM) transmits key-related information, including a key for decrypting the transmission path encryption used for downloading. The DCM may be stored in an M2 section message.
[0052] (8) DMM The Download Management Message (DMM) transmits key-related information, including the download key used to decrypt the DCM. The DMM may be stored in an M2 section message.
[0053] (9) MH-EIT The MH-Event Information Table (MH-EIT) contains time-series information about events included in each service. The MH-EIT may be stored in an M2 section message.
[0054] (10) MH-AIT The MH-Application Information Table (MH-AIT) stores all information about the application and the startup status required for the application. The MH-AIT may be stored in an M2 section message.
[0055] (11) MH-BIT The MH-Broadcaster Information Table (MH-BIT) is used to display information about broadcasters present on the network. The MH-BIT may be stored in an M2 section message.
[0056] (12) MH-SDTT The MH-Software Download Trigger Table (MH-SDTT) is used for download notification information. The MH-SDTT may be stored in an M2 section message.
[0057] (13) MH-SDT The MH-Service Description Table (MH-SDT) has subtables representing services included in a specific TLV stream and transmits information about the programming channel, such as the channel name and the broadcaster's name. The MH-SDT may be stored in an M2 section message.
[0058] (14) MH-TOT The MH-Time Offset Table (MH-TOT) transmits JST time and date (modified Julian day) information. The MH-TOT may be stored in an M2 short-section message.
[0059] (15) MH-CDT The MH-Common Data Table (MH-CDT) is used to transmit common data to be stored in non-volatile memory in section format to all receivers that receive it. The MH-CDT may be stored in an M2 section message.
[0060] (16) DDM Table The Data Directory Management Table (DDM table) provides the directory structure of the files that make up an application, in order to separate the application's file structure from the configuration for file transmission. The DDM table may be stored in the data transmission message.
[0061] (17) DAM Table The Data Asset Management Table (DAM table) provides the configuration of the MPUs within the asset and version information for each MPU. The DAM table may be stored in the data transmission message.
[0062] (18) DCC Table The Data Content Configuration Table (DCC Table) provides configuration information of files as data content in order to achieve flexible and effective cache control. The DCC table may be stored in a data transmission message.
[0063] (19) EMT The Event Message Table (EMT) is used to transmit information related to event messages. The EMT may be stored in the M2 section message.
[0064] (20) Tables set by operators In addition, it is possible to prepare tables independently set by service providers and the like.
[0065] <Descriptors used in MMT-SI> Figures 6C and 6D show a list of "descriptors" arranged in the MMT-SI of the broadcast system to which the broadcast receiver 100 of this embodiment corresponds. A descriptor is control information that provides more detailed information and is assumed to be arranged in a table. Note that the table in which the descriptor is arranged may be determined according to the descriptor. In this embodiment, the following are used as the "descriptors" of MMT-SI.
[0066] (1) Asset Group Descriptor The Asset Group Descriptor provides the group relationship of assets and the priority within the group. The Asset Group Descriptor may be arranged in the MPT.
[0067] (2) Event Package Descriptor The Event Package Descriptor provides the correspondence between events representing programs and packages. The Event Package Descriptor may be arranged in the MH-EIT transmitted in the M2 section message.
[0068] (3) Background Color Designation Descriptor The background color descriptor provides the background color for the backmost element in the layout specification. The background color descriptor may be placed in the LCT.
[0069] (4) MPU presentation area specification descriptor The MPU presentation area descriptor provides a location for presenting the MPU. The MPU presentation area descriptor may be placed in the MPT.
[0070] (5) MPU timestamp descriptor The MPU timestamp descriptor indicates the presentation time of the first access unit in the presentation order on the MPU. The MPU timestamp descriptor may be placed in the MPT.
[0071] (6) Dependency descriptors A dependency descriptor provides the asset IDs of the dependent assets. Dependency descriptors may be placed in the MPT.
[0072] (7) Access control descriptor The access control descriptor provides information for identifying the restricted access scheme. The access control descriptor may be located in MPT or CAT(MH).
[0073] (8) Scrambled descriptor The scrambling scheme descriptor provides information for identifying the encryption target and the type of encryption algorithm used during scrambling. The scrambling scheme descriptor may be located in MPT or CAT(MH).
[0074] (9) Message authentication method descriptor The message authentication method descriptor provides information for identifying the message authentication method when performing message authentication. The message authentication method descriptor may be located in MPT or CAT(MH).
[0075] (10) Emergency Information Descriptor (MH) The Emergency Information Descriptor (MH) is used when broadcasting an emergency warning. The Emergency Information Descriptor (MH) may be placed in the MPT.
[0076] (11) MH-MPEG-4 audio descriptor The MH-MPEG-4 audio descriptor is used to describe basic information for identifying the encoding parameters of an audio stream according to ISO / IEC 14496-3 (MPEG-4 audio). The MH-MPEG-4 audio descriptor may be placed in the MPT.
[0077] (12) MH-MPEG-4 audio extension descriptor The MH-MPEG-4 audio extension descriptor is used to describe the profile, level, and encoding scheme-specific settings of an MPEG-4 audio stream. The MH-MPEG-4 audio extension descriptor may be placed in the MPT.
[0078] (13) MH-HEVC video descriptor The MH-HEVC video descriptor is used to describe the basic encoding parameters of a video stream (HEVC stream) as defined in ITU-T Recommendation H.265|ISO / IEC 23008-2. The MH-HEVC video descriptor may be placed in the MPT.
[0079] (14) MH-link descriptor The MH-Link descriptor identifies a service that is provided when a viewer requests additional information related to a specific item listed in the program scheduling information system. The MH-Link descriptor may be placed in the MPT, MH-EIT, MH-SDT, etc.
[0080] (15) MH-Event Group Descriptor MH-Event Group Descriptors are used to indicate that a group of events is grouped together when there is a relationship between multiple events. MH-Event Group Descriptors may be placed in MH-EIT.
[0081] (16) MH-Service List Descriptor The MH-Service List Descriptor provides a list of services categorized by service identifier and service type. The MH-Service List Descriptor may be placed in the MH-BIT.
[0082] (17) MH-Short Event Descriptor MH-Short Event Descriptors represent the event name and a short description of the event in text format. MH-Short Event Descriptors may be placed in MH-EIT.
[0083] (18) MH-Extended Event Descriptor MH-extended event descriptors are used in addition to MH-short event descriptors to provide a detailed description of the event. MH-extended event descriptors may be placed in MH-EIT.
[0084] (19) Video component descriptor Video component descriptors specify parameters and descriptions related to video components and are also used to represent elementary streams in text format. Video component descriptors may be placed in MPT or MH-EIT.
[0085] (20) MH-stream identifier descriptor The MH-Stream Identifier descriptor is used to label the component streams of a service, allowing them to reference the description indicated by the video component descriptor in the MH-EIT. The MH-Stream Identifier descriptor may be located in the MPT.
[0086] (21) MH-Content descriptor The MH-Content descriptor indicates the genre of the event. The MH-Content descriptor may be placed in MH-EIT.
[0087] (22) MH-Paternal Rate Descriptor The MH-Parental Rate descriptor represents age-based viewing restrictions and is used to extend them to other restriction conditions. The MH-Parental Rate descriptor may be placed in the MPT or MH-EIT.
[0088] (23) MH-Audio Component Descriptor The MH-Speech component descriptor specifies each parameter of the speech elementary stream and is also used to represent the elementary stream in text format. The MH-Speech component descriptor may be located in either the MPT or MH-EIT.
[0089] (24) MH-Target Area Descriptor The MH-Target Region descriptor is used to describe the region targeted by a program or a portion of the streams that make up a program. The MH-Target Region descriptor may be placed in the MPT.
[0090] (25) MH-series descriptor The MH-series descriptor is used to identify a series program. The MH-series descriptor may be placed in the MH-EIT.
[0091] (26) MH-SI transmission parameter descriptor The MH-SI transmission parameter descriptor is used to specify the transmission parameters of the SI. The MH-SI transmission parameter descriptor may be placed in the MH-BIT.
[0092] (27) MH-Broadcaster Name Descriptor The MH-BroadcasterNameDescriptor describes the name of the broadcaster. The MH-BroadcasterNameDescriptor may be placed in the MH-BIT.
[0093] (28) MH-Service Descriptor The MH-service descriptor represents the programming channel name and its operator name, along with the service type, using character codes. The MH-service descriptor may be placed in the MH-SDT.
[0094] (29) IP data flow descriptor An IP dataflow descriptor provides information about the IP dataflows that make up a service. IP dataflow descriptors may be placed in MH-SDT.
[0095] (30) MH-CA activation descriptor The MH-CA startup descriptor contains startup information for launching the CAS program on the CAS infrastructure. The MH-CA startup descriptor may be located in MPT or CAT(CA).
[0096] (31) MH-Type descriptor The MH-Type descriptor indicates the file type transmitted using the application transmission method. The MH-Type descriptor may be placed in the DAM table.
[0097] (32) MH-Info descriptor MH-Info descriptors describe information about MPUs or items. MH-Info descriptors may be placed in the DAM table.
[0098] (33) MH-Expire descriptor The MH-Expire descriptor describes the expiration date of an item. The MH-Expire descriptor may be placed in the DAM table.
[0099] (34) MH-Compression Type descriptor The MH-Compression Type descriptor indicates that the item being transmitted is compressed, and it shows the compression algorithm and the number of bytes in the item before compression. The MH-Compression Type descriptor may be placed in the DAM table.
[0100] (35) MH-Data Encoding Scheme Descriptor The MH-data encoding descriptor is used to identify the data encoding scheme. The MH-data encoding descriptor may be placed in the MPT.
[0101] (36) UTC-NPT reference descriptor UTC-NPT reference descriptors are used to communicate the relationship between NPT (Normal Play Time) and UTC. UTC-NPT reference descriptors may be placed in the EMT.
[0102] (37) Event message descriptor Event message descriptors convey general information about event messages. Event message descriptors may be placed in the EMT (Event Message Table).
[0103] (38) MH-Local Time Offset Descriptor The MH-Local Time Offset descriptor is used to introduce a fixed offset between the actual time (e.g., UTC+9 hours) and the time displayed to human systems during daylight saving time. The MH-Local Time Offset descriptor may be located in MH-TOT.
[0104] (39) MH-Component Group Descriptor MH-Component Group descriptors define and identify combinations of components within an event. MH-Component Group descriptors may be located in MH-EIT.
[0105] (40) MH-Logo transmission descriptor The MH-Logo Transmission Descriptor is used to describe a simplified logo string, pointing to a CDT-formatted logo, etc. The MH-Logo Transmission Descriptor may be placed in the MH-SDT.
[0106] (41) MPU extended timestamp descriptor The MPU extended timestamp descriptor provides the decryption time of the access unit within the MPU. The MPU extended timestamp descriptor may be placed in the MPT.
[0107] (42) MPU Downloadable Content Descriptor The MPU download content descriptor is used to describe the attribute information of content downloaded using the MPU. The MPU download content descriptor may be placed in MH-SDTT.
[0108] (43) MH-Network Downloadable Content Descriptor The MH-Network Download Content Descriptor is used to describe the attribute information of content downloaded over a network. The MH-Network Download Content Descriptor may be located in MH-SDTT.
[0109] (44) MH-Application Descriptor The MH-Application Descriptor describes the information of an application. The MH-Application Descriptor may be placed in MH-AIT.
[0110] (45) MH-Transmission Protocol Descriptor The MH-Transmission Protocol descriptor is used to specify a transmission protocol for broadcasting, communications, etc., and to indicate the location information of applications that depend on that transmission protocol. The MH-Transmission Protocol descriptor may be placed in MH-AIT.
[0111] (46) MH-Simplified Application Location Descriptor The MH-Simplified Application Location Descriptor is used to specify the details of where to retrieve the application. The MH-Simplified Application Location Descriptor may be placed in MH-AIT.
[0112] (47) MH-Application Boundary Authority Descriptor The MH-Application Boundary Permission Descriptor is used to set application boundaries and configure access permissions for broadcast resources on a per-domain (URL) basis. The MH-Application Boundary Permission Descriptor may be located in MH-AIT.
[0113] (48) MH-Activation Priority Information Descriptor The MH-Startup Priority Information Descriptor is used to specify the startup priority of an application. The MH-Startup Priority Information Descriptor may be placed in MH-AIT.
[0114] (49) MH-Cache Information Descriptor The MH-Cache Information Descriptor is used for cache control when the application is expected to be reused, by caching and retaining the resources that make up the application. The MH-Cache Information Descriptor may be placed in MH-AIT.
[0115] (50) MH-Probabilistic Application Delay Descriptor The MH-Probabilistic Application Delay Descriptor is used to delay the timing of application control by a probabilistically defined delay amount, assuming load balancing of server access for application retrieval. The MH-Probabilistic Application Delay Descriptor may be placed in MH-AIT.
[0116] (51) Linked PU descriptor The linked PU descriptor describes other presentation units that may be accessed from the present presentation unit (PU). The linked PU descriptor may be placed in the DCC table.
[0117] (52) Lock cache specifier descriptor The lock cache descriptor specifies the files to be cached and locked in the presentation unit. The lock cache descriptor may be placed in the DCC table.
[0118] (53) Unlock cache specified descriptor The unlock cache descriptor specifies which files to unlock from among the files locked in the presentation unit. The unlock cache descriptor may be placed in the DCC table.
[0119] (54) Descriptors set by the operator In addition, it is possible to prepare descriptors independently set by service providers and the like.
[0120] <Relationship between Data Transmission and Each Control Information in the MMT Method> Here, with reference to FIG. 6E, the relationship between data transmission and a representative table in the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment will be described.
[0121] In the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment, data transmission can be performed through a plurality of paths such as a TLV stream via a broadcast transmission path and an IP data flow via a communication line. The TLV stream includes TLV-SI such as TLV-NIT and AMT, and an IP data flow which is a data flow of IP packets. The IP data flow includes a video asset including a series of video MPUs and an audio asset including a series of audio MPUs. Similarly, the IP data flow may include a subtitle asset including a series of subtitle MPUs, a character super asset including a series of character super MPUs, a data asset including a series of data MPUs, and the like. These various assets are associated with each other in units of "packages" by an MPT (MMT package table) stored in a PA message and transmitted. Specifically, the association is made by describing a package ID (corresponding to the "MMT_package_id_byte" parameter shown in FIG. 17 described later) and an asset ID of each asset included in the package (corresponding to the "asset_id_byte" parameter shown in FIG. 17 described later) in the MPT.
[0122] The assets constituting a package can consist only of assets within the TLV stream, but as shown in Figure 6E, it can also include assets transmitted via the IP data flow of the communication line. This can be achieved by including the location information of each asset included in the package (corresponding to 'MMT_general_location_info()' shown in Figure 17 below) within the MPT, allowing the broadcast receiving device 100 in this embodiment to understand the reference destination of each asset. Specifically, by changing the value of the 'MMT_general_location_infonolocation_type' parameter placed in the location information, (1) Data that is multiplexed on the same IP data flow as MPT (location_type=0x00) (2) Data multiplexed in IPv4 data flow (location_type=0x01) (3) Data that is multiplexed in IPv6 data flow (location_type=0x02) (4) Data multiplexed into the broadcast MPEG2-TS (Location_type=0x03) (5) Data multiplexed in MPEG2-TS format within the IP data flow (location_type=0x04) (6) Data located at the specified URL (Location_type=0x05) This makes it possible to configure the broadcast receiving device 100 so that it can access various types of data transmitted through various transmission paths.
[0123] Of the aforementioned references, (1) is, for example, an IP data flow received via the digital broadcast signal received by the tuner / demodulation unit 131 of the broadcast receiving device 100 shown in Figure 7A later. When MPT is also transmitted in the IP data flow on the communication line side, the reference in (1) may also be the IP data flow received by the LAN communication unit 121 via the communication line later. Also, (2), (3), (5), and (6) above are IP data flows received by the LAN communication unit 121 via the communication line later. Furthermore, (4) above can be used, for example, in the case of a broadcast receiving device that has both a receiving function for receiving digital broadcast signals using the MMT method and a receiving function for receiving digital broadcast signals using the MPEG2-TS method, such as the broadcast receiving device 800 of Embodiment 2 shown in Figure 24 later, when referring to data multiplexed in MPEG2-TS received by the receiving function for receiving digital broadcast signals using the MPEG2-TS method based on the MPT location information ('MMT_general_location_info()') included in the digital broadcast signal using the MMT method.
[0124] Although the data constituting a "package" is specified in this way, in the broadcasting system to which the broadcasting receiving device 100 of this embodiment corresponds, the series of data in the "package" unit is treated as a "service" unit of digital broadcasting.
[0125] Furthermore, the MPT contains presentation time information for each MPU specified by the MPT (corresponding to the 'mpu_presentation_time' parameter shown in Figure 13B below), and using this presentation time information, it becomes possible to synchronize the presentation (display, output, etc.) of multiple MPUs specified by the MPT, based on a clock based on NTP, which is UTC notation time information. The control of presentation of various data using this NTP-based clock will be described later.
[0126] In the data transmission method of this embodiment shown in Figure 6E, there is also the concept of an "event." An "event" is a concept that represents a so-called "program" handled by the MH-EIT, which is included in the M2 section message. Specifically, in the "package" pointed to by the event package descriptor stored in the MH-EIT, the data included in the concept of the "event" is a series of data contained within a period of time (corresponding to the "duration" parameter shown in Figure 21 below) from the disclosure time (corresponding to the "start_time" parameter shown in Figure 21 below) stored in the MH-EIT. The MH-EIT can be used in the broadcast receiving device 100 of this embodiment for various processing on an "event" basis (for example, program guide generation processing, control of recording and viewing reservations, copyright management processing such as temporary storage, etc.).
[0127] [Hardware configuration of broadcast receiving equipment] Figure 7A is a block diagram showing an example of the internal configuration of the broadcast receiving device 100. The broadcast receiving device 100 consists of a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, a separation unit 132, a video decoder 141, a video color gamut conversion unit 142, an audio decoder 143, a character super decoder 144, a subtitle decoder 145, a subtitle synthesis unit 146, a subtitle color gamut conversion unit 147, a data decoder 151, a cache unit 152, an application control unit 153, a browser unit 154, an application color gamut conversion unit 155, a sound source unit 156, a video synthesis unit 161, a monitor unit 162, a video output unit 163, an audio synthesis unit 164, a speaker unit 165, an audio output unit 166, and an operation input unit 170.
[0128] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 according to a predetermined operating program. The system bus 102 is a data communication path for sending and receiving data between the main control unit 101 and each operating block within the broadcast receiving device 100.
[0129] ROM (Read Only Memory) 103 is a non-volatile memory that stores basic operating programs such as the operating system and other operational programs. For example, a rewritable ROM such as EEPROM (Electrically Erasable Programmable ROM) or flash ROM may be used. ROM 103 may also store operational setting values necessary for the operation of the broadcast receiving device 100. RAM (Random Access Memory) 104 serves as the work area when executing basic operating programs and other operational programs. ROM 103 and RAM 104 may be integrated with the main control unit 101. Furthermore, ROM 103 may not have an independent configuration as shown in Figure 7A, but may use a portion of the storage area within the storage unit 110.
[0130] The storage unit 110 stores the operating program and settings of the broadcast receiving device 100, as well as the personal information of the broadcast receiving device 100 user. It can also store operating programs downloaded via the Internet 200 and various data created by said operating programs. Furthermore, it can store content such as video, still images, and audio acquired from broadcast waves or downloaded via the Internet 200. A portion of the storage unit 110 may replace all or part of the functions of the ROM 103. In addition, the storage unit 110 needs to retain the stored information even when the broadcast receiving device 100 is not supplied with power from an external source. Therefore, devices such as flash ROM, SSD (Solid State Drive) or other non-volatile semiconductor memory, or HDD (Hard Disk Drive) or other magnetic disk drives are used.
[0131] Furthermore, the aforementioned operating programs stored in the ROM 103 and the storage unit 110 can be added, updated, and have their functions expanded through download processing from various server devices on the Internet 200.
[0132] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 200r and transmits and receives data with various server devices and other communication devices on the Internet 200. It also acquires the MMT data sequence (or a part thereof) of the program transmitted via the communication line. The connection to the router device 200r may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 shall be equipped with encoding circuits, decoding circuits, etc. Furthermore, the broadcast receiving device 100 may also be equipped with other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, or an infrared communication unit.
[0133] The tuner / demodulator 131 receives broadcast waves transmitted from the radio tower 300t via the antenna 100a and tunes (selects) to the channel of the service desired by the user based on the control of the main control unit 101. Furthermore, the tuner / demodulator 131 demodulates the received broadcast signal to obtain the MMT data sequence. In the example shown in Figure 7A, a configuration with one tuner / demodulator is illustrated, but the broadcast receiving device 100 may be configured to have multiple tuners / demodulators for purposes such as simultaneous display of multiple screens or recording of programs while watching another program.
[0134] The separation unit 132 is an MMT decoder and, based on the control signals in the input MMT data sequence, distributes real-time presentation elements such as video data sequences, audio data sequences, character superimposition data sequences, and subtitle data sequences to the video decoder 141, audio decoder 143, character superimposition decoder 144, and subtitle decoder 145, respectively. The data input to the separation unit 132 may be MMT data sequences transmitted via a broadcast transmission line and demodulated by the tuner / demodulation unit 131, or MMT data sequences transmitted via a communication line and received by the LAN communication unit 121. The separation unit 132 also plays back multimedia applications and their constituent file data and temporarily stores them in the cache unit 152. Furthermore, the separation unit 132 extracts general-purpose data for use in players that present data other than video, audio, and subtitles, or for streaming data to applications, and outputs it to the data decoder 151. In addition, the separation unit 132 may perform error correction and access restriction control of the input MMT data sequence based on the control of the main control unit 101.
[0135] The video decoder 141 decodes the video data sequence input from the separation unit 132 and outputs video information. The video color gamut conversion unit 142 performs color space conversion processing on the video information decoded by the video decoder 141 as needed for video synthesis processing in the video synthesis unit 161. The audio decoder 143 decodes the audio data sequence input from the separation unit 132 and outputs audio information. The video decoder 141 and audio decoder 143 may also be input to streaming data, such as MPEG-DASH (MPEG-Dynamic Adaptive Streaming over HTTP) format, obtained from the Internet 200 via the LAN communication unit 121. In addition, multiple video decoders 141, video color gamut conversion units 142, audio decoders 143, etc., may be provided to simultaneously decode multiple types of video data sequences and audio data sequences.
[0136] The character super decoder 144 decodes the character super data sequence input from the separation unit 132 and outputs character super information. The subtitle decoder 145 decodes the subtitle data sequence input from the separation unit 132 and outputs subtitle information. The character super information output from the character super decoder 144 and the subtitle information output from the subtitle decoder 145 are combined in the subtitle combination unit 146, and further, the subtitle color gamut conversion unit 147 performs color space conversion processing as needed for the video combination processing in the video combination unit 161. In this embodiment, among the services centered on text information that are presented simultaneously with the video of a broadcast program, those related to the content of the video are called subtitles, and all others are called character supers. When they are not distinguished, they are collectively referred to as subtitles.
[0137] The browser unit 154 presents multimedia application files and their constituent file data obtained from a server device on the Internet 200 via the cache unit 152 or the LAN communication unit 121, in accordance with instructions from the application control unit 153, which interprets control information contained in the MMT data sequence and control information obtained from the server device on the Internet 200 via the LAN communication unit 121. The multimedia application files may be HTML (Hyper Text Markup Language) documents, BML (Broadcast Markup Language) documents, etc. The application information output from the browser unit 154 is further subjected to color space conversion processing as necessary by the application color gamut conversion unit 155 for video synthesis processing in the video synthesis unit 161. The browser unit 154 also plays application audio information by interacting with the sound source unit 156.
[0138] The video synthesis unit 161 receives video information output from the video color gamut conversion unit 142, subtitle information output from the subtitle color gamut conversion unit 147, and application information output from the application color gamut conversion unit 155, and performs appropriate selection and / or superposition processing. The video synthesis unit 161 is equipped with video RAM (not shown), and the monitor unit 162, etc., are driven based on the video information input to the video RAM. The video synthesis unit 161 also performs scaling processing and superposition processing of EPG (Electronic Program Guide) screen information created based on information such as MH-EIT included in MMT-SI, as needed, based on the control of the main control unit 101. The monitor unit 162 is a display device such as an LCD panel, and provides the video information selected and / or superimposed by the video synthesis unit 161 to the user of the broadcast receiving device 100. The video output unit 163 is a video output interface that outputs the video information selected and / or superimposed by the video synthesis unit 161.
[0139] The display function of the broadcast receiving device 100 in this embodiment is equipped with a logical plane structure in order to display content as intended by the multimedia service provider. Figure 7B shows an example of the configuration of the logical plane structure provided by the display function of the broadcast receiving device 100 in this embodiment. In this logical plane structure, a character superplane for displaying character superimposition is placed at the front, and a subtitle plane for displaying subtitles is placed on the next layer. A multimedia plane for displaying broadcast video, multimedia applications, or composite video thereof is placed on the third layer, and a background plane is placed at the back. The subtitle synthesis unit 146 and the video synthesis unit 161 draw character superimposition information onto the character superplane, draw subtitle information onto the subtitle plane, and draw video information, application information, etc. onto the multimedia plane. In addition, the background color is drawn on the background plane based on the LCT included in MMT-SI. The third layer of multimedia planes can be provided in multiple quantities depending on the number of video decoders 141. However, even if there are multiple multimedia planes, application information etc. output from the application color gamut conversion unit 155 will only be output to the frontmost multimedia plane.
[0140] The speech synthesis unit 164 receives the audio information output from the audio decoder 143 and the application audio information played back by the sound source unit 156, and performs appropriate processing such as selection and / or mixing. The speaker unit 165 provides the audio information selected and / or mixed by the speech synthesis unit 164 to the user of the broadcast receiving device 100. The audio output unit 166 is an audio output interface that outputs the audio information selected and / or mixed by the speech synthesis unit 164.
[0141] The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100. In this embodiment, it consists of an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The analog video / audio interface handles input of analog video / audio signals from external video / audio output devices and output of analog video / audio signals to external video / audio input devices. The USB interface connects to a PC or the like to send and receive data. An HDD may be connected to record broadcast programs and content. A keyboard or other USB device may also be connected. The memory interface connects to a memory card or other memory medium to send and receive data.
[0142] The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface unit 125 is capable of directly outputting MMT data sequences obtained by demodulation by the tuner / demodulation unit 131, MMT data sequences obtained via the LAN communication unit 121, or mixed data of the aforementioned MMT data sequences. Alternatively, the digital interface unit 125 may be controlled to input the MMT data sequences input to the separation unit 132. Output of digital content stored in the storage unit 110, or storage of digital content in the storage unit 110, may also be performed via the digital interface unit 125.
[0143] The digital interface unit 125 may be a DVI terminal, HDMI® terminal, DisplayPort® terminal, etc., and may output or input data in a format compliant with the DVI specification, HDMI specification, DisplayPort specification, etc. It may also output or input data in a serial data format compliant with the IEEE1394 specification, etc. It may also be configured as an IP interface that outputs digital interface data via hardware such as Ethernet® or wireless LAN. In this case, the digital interface unit 125 and the LAN communication unit 121 may share their hardware configurations.
[0144] The operation input unit 170 is an instruction input unit that inputs operation instructions to the broadcast receiving device 100. In this embodiment, it consists of a remote control receiver that receives commands transmitted from a remote control (not shown) and an operation key with a row of button switches. Either one or the other may be used. The operation input unit 170 may also be replaced by a touch panel placed on top of the monitor unit 162. It may also be replaced by a keyboard connected to the expansion interface unit 124. The remote control (not shown) may be replaced by a portable information terminal 700 equipped with a remote control command transmission function.
[0145] As mentioned above, if the broadcast receiving device 100 is a television receiver or the like, the video output unit 163 and the audio output unit 166 are not essential components of the present invention. In addition, the broadcast receiving device 100 may be an optical disc drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disc drive recorder such as an HDD recorder, an STB (Set Top Box), etc. It may also be a PC (Personal Computer), tablet terminal, navigation device, game console, etc. equipped with digital broadcast receiving function and broadcast communication linkage function. If the broadcast receiving device 100 is a DVD recorder, HDD recorder, STB, etc., the monitor unit 162 and the speaker unit 165 do not need to be provided. By connecting an external monitor and external speakers to the video output unit 163 and the audio output unit 166 or the digital interface unit 125, the same operation as the broadcast receiving device 100 of this embodiment can be achieved.
[0146] [System configuration for clock synchronization / presentation synchronization of broadcast receiving equipment] Figure 7C shows an example of the system configuration for clock synchronization / presentation synchronization in the broadcasting system to which the broadcasting receiver 100 of this embodiment corresponds. In the broadcasting system of this embodiment, UTC is transmitted from the broadcasting system to the receiver (such as the broadcasting receiver 100 of this embodiment) in a 64-bit NTP timestamp format. In the NTP timestamp format, 32 bits represent "seconds or more" of UTC, and 32 bits represent "less than seconds". However, in reality, it is difficult to reproduce 1 second with 32-bit precision. For this reason, a system clock for synchronizing the video system and a system clock for operating the NTP format clock may be used, for example, a frequency of "2 to the power of 24" Hz (approximately 16.8 MHz) as shown in the figure. Considering that the system clock in conventional broadcasting systems was 27 MHz and that the hardware configuration of the receiver can be easily constructed, it is desirable to adopt a power of 2 frequency of "2 to the power of 2" to "2 to the power of 28" as the system clock.
[0147] Furthermore, if the system clock on the broadcast transmission system side or the receiver side is set to a power of 2 frequency of approximately 2^24 to 2^28 as described above, the lower 8 to 4 bits of the NTP timestamp format transmitted from the broadcast transmission system side to the receiver side, which are not referenced by the system clock or the PLL (Phase Locked Loop) system for regenerating the NTP format clock, may be fixed to 0 or 1. That is, if the system clock is 2 to the power of n Hz (n=24 in the example in Figure 7C), the lower 32-n bits of the NTP timestamp format may be fixed to 0 or 1. Alternatively, the receiver side may process the lower 32-n bits of the NTP timestamp format by ignoring them.
[0148] On the broadcast transmission system side, upon obtaining NTP-formatted time information from an external source, a PLL system is configured using a 32+n bit counter with a VCO (Voltage Controlled Oscillator) at 2 to the power of n Hz to realize a transmission system clock that synchronizes with the externally provided time information. Furthermore, the entire signal processing system is operated in synchronization with the 2 to the power of n Hz system clock. In addition, the output of the transmission system clock is periodically transmitted to the receiver side via the broadcast transmission line as NTP-length time information.
[0149] On the receiver side, time information in NTP format is received via the broadcast transmission line, and the receiver system clock is regenerated by a PLL system based on a VCO of 2 to the power of n Hz, similar to the broadcast transmission system side. As a result, the receiver system clock becomes synchronized with the broadcast transmission system side. Furthermore, by operating the receiver's signal processing system in synchronization with the system clock of 2 to the power of n Hz, clock synchronization between the broadcast transmission system side and the receiver side is achieved, enabling stable signal reproduction. In addition, the decoding time and presentation time for each presentation unit of the video / audio signal are set on the broadcast transmission system side based on the aforementioned NTP format time information. Here, the MPT stored in the PA message transmitted in the broadcast signal contains the MPU timestamp descriptor shown in Figure 13B below. In the MPU timestamp descriptor in Figure 13B, the 'mpu_sequence_number' parameter indicates the sequence number of the MPU that describes the timestamp, and the 'mpu_presentation_time' parameter indicates the MPU presentation time in 64-bit NTP timestamp format. Therefore, the receiver can refer to the MPU timestamp descriptor stored in the MPT and control the presentation (display, output, etc.) timing for each MPU of video signals, audio signals, subtitles, text overlays, etc.
[0150] Furthermore, when considering the control of the decoding timing and presentation timing for each presentation unit of the aforementioned video / audio signals, synchronization of the video / audio signals can be ensured even with a clock of approximately 2 to the power of 16 Hz (approximately 65.5 kHz). In this case, it is not necessary to refer to the lower 16 bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. That is, if a clock of 2 to the power of m Hz generated by dividing the system clock is used to control the decoding timing and presentation timing, it is not necessary to refer to the lower 32-m bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. Therefore, the lower 32-m bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. may be fixed to 0 or 1.
[0151] [Software configuration of broadcast receiving equipment] Figure 7D is a software configuration diagram of the broadcast receiving device 100 in this embodiment, showing the software configuration in the ROM 103, RAM 104, and storage unit 110. In this embodiment, the ROM 103 stores the basic operation program 1001 and other operation programs, and the storage unit 110 stores the reception function program 1002 and other operation programs. The storage unit 110 also includes a content storage area 1200 for storing content such as video, still images, and audio, an authentication information storage area 1300 for storing authentication information necessary when accessing external mobile terminal devices and server devices, and various information storage areas for storing other various information.
[0152] The basic operation program 1001 stored in ROM 103 is loaded into RAM 104, and the main control unit 101 then executes the loaded basic operation program to constitute the basic operation execution unit 1101. Similarly, the receiving function program 1002 stored in storage unit 110 is loaded into RAM 104, and the main control unit 101 then executes the loaded receiving function program to constitute the receiving function execution unit 1102. The RAM 104 also includes a temporary storage area that temporarily holds data created during the execution of each operation program as needed.
[0153] For the sake of simplicity, in the following explanation, the process by which the main control unit 101 controls each operation block by loading the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing it will be described as if the basic operation execution unit 1101 controls each operation block. The same description will be applied to other operation programs.
[0154] The receiving function execution unit 1102 controls each operating block of the broadcast receiving device 100 in order to reproduce video, audio, and other components transmitted in the broadcasting system of this embodiment. In particular, the transport processing unit 1102a mainly controls the MMT decoder function of the separation unit 132 and distributes the video data sequence, audio data sequence, etc., separated from the MMT data sequence to the corresponding decoding processing unit. The AV decoding processing unit 1102b mainly controls the video decoder 141, audio decoder 143, etc. The application processing unit 1102c mainly controls the cache unit 152, application control unit 153, browser unit 154, and sound source unit 156. The character superimposition processing unit 1102d mainly controls the character superimposition decoder 144. The subtitle processing unit 1102e mainly controls the subtitle decoder 145. The general-purpose data processing unit 1102f mainly controls the data decoder 151. The EPG generation unit 1102g interprets the description content of MH-EIT and other components included in MMT-SI and generates an EPG screen. The presentation processing unit 1102h mainly controls the video color gamut conversion unit 142, the subtitle synthesis unit 146, the subtitle color gamut conversion unit 147, the application color gamut conversion unit 155, the video synthesis unit 161, and the audio synthesis unit 164 based on the logical plane structure.
[0155] Each of the aforementioned operating programs may be pre-stored in the ROM 103 and / or storage unit 110 at the time of product shipment. Alternatively, they may be acquired after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 121. Furthermore, each of the aforementioned operating programs stored on a memory card, optical disc, etc., may be acquired via the expansion interface unit 124, etc.
[0156] [Broadcaster Server Configuration] Figure 8 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. The broadcasting station server 300 consists of a main control unit 301, a system bus 302, RAM 304, a storage unit 310, a LAN communication unit 321, and a digital broadcasting signal transmission unit 360.
[0157] The main control unit 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operating program. The system bus 302 is a data communication path for sending and receiving data between the main control unit 301 and each operating block within the broadcasting station server 300. The RAM 304 serves as the work area when each operating program is executed.
[0158] The storage unit 310 stores the basic operation program 3001, the broadcast content management / distribution program 3002, and the broadcast content transmission program 3003, and further includes a broadcast content storage area 3200 and a metadata storage area 3300. The broadcast content storage area 3200 stores the program content of each broadcast program broadcast by the broadcasting station. The metadata storage area 3300 stores metadata such as the program title, program ID, program summary, cast, broadcast date and time, and copy control information related to each program content for each broadcast program.
[0159] Furthermore, the basic operation program 3001, the broadcast content management / distribution program 3002, and the broadcast content transmission program 3003 stored in the storage unit 310 are each loaded into the RAM 304, and the main control unit 301 then executes each of the loaded programs to form the basic operation execution unit 3101, the broadcast content management / distribution execution unit 3102, and the broadcast content transmission execution unit 3103.
[0160] For the sake of simplicity, in the following explanation, the process in which the main control unit 301 controls each operation block by loading the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executing it will be described as if the basic operation execution unit 3101 controls each operation block. The same description will be applied to other operation programs.
[0161] The broadcast content management / distribution execution unit 3102 manages the program content and metadata of each broadcast program stored in the broadcast content storage area 3200 and the metadata storage area 3300, and controls the provision of the program content and metadata of each broadcast program to service providers based on the contract. Furthermore, when providing the program content and metadata of each broadcast program to the service provider, the broadcast content management / distribution execution unit 3102 may, if necessary, perform authentication processing of the service provider server 400 based on the contract.
[0162] The broadcast content transmission execution unit 3103 manages the time schedule when transmitting the program content of broadcast programs stored in the broadcast content storage area 3200 and the MMT data sequence, which includes the program title, program ID, and copy control information of the program content of broadcast programs stored in the metadata storage area 3300, from the radio tower 300t via the digital broadcast signal transmission unit 360.
[0163] The LAN communication unit 321 is connected to the Internet 200 and communicates with service provider servers 400 and the like on the Internet 200. The LAN communication unit 321 is equipped with encoding circuits, decoding circuits, and the like. The digital broadcast signal transmission unit 360 modulates the MMT data sequence, which consists of video data sequences, audio data sequences, program information data sequences, etc., of the program content of each broadcast program stored in the broadcast content storage area 3200, and transmits it as a digital broadcast wave via the radio tower 300t.
[0164] [Service provider server configuration] Figure 9 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 consists of a main control unit 401, a system bus 402, RAM 404, a storage unit 410, and a LAN communication unit 421.
[0165] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operating program. The system bus 402 is a data communication path for sending and receiving data between the main control unit 401 and each operating block within the service provider server 400. The RAM 404 serves as the work area when each operating program is executed.
[0166] The storage unit 410 stores the basic operation program 4001, the video content management / distribution program 4002, and the application management / distribution program 4004, and further includes a video content storage area 4200, a metadata storage area 4300, an application storage area 4400, and a user information storage area 4500. The video content storage area 4200 stores the program content of broadcast programs provided by the broadcasting station server 300 as video content. It also stores video content produced by the service provider. The metadata storage area 4300 stores various metadata provided by the broadcasting station server 300, as well as metadata related to video content produced by the service provider. The application storage area 4400 stores various applications for realizing services linked to broadcast programs, which are distributed in response to requests from each television receiver. The user information storage area 4500 stores information (personal information, authentication information, etc.) about users who are permitted to access the service provider server 400.
[0167] Furthermore, the basic operation program 4001, the video content management / distribution program 4002, and the application management / distribution program 4004 stored in the storage unit 410 are each deployed to the RAM 404, and the main control unit 401 then executes the deployed basic operation program, the video content management / distribution program, and the application management / distribution program, thereby forming the basic operation execution unit 4101, the video content management / distribution execution unit 4102, and the application management / distribution execution unit 4104.
[0168] For the sake of simplicity, in the following explanation, the process in which the main control unit 401 controls each operation block by loading the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executing it will be described as if the basic operation execution unit 4101 controls each operation block. The same description will be applied to other operation programs.
[0169] The video content management / distribution execution unit 4102 acquires program content and metadata of broadcast programs from the broadcasting station server 300, manages the video content and metadata stored in the video content storage area 4200 and the metadata storage area 4300, and controls the distribution of the video content and metadata to each television receiver. Furthermore, when distributing the video content and metadata to each television receiver, the video content management / distribution execution unit 4102 may perform authentication processing for each television receiver as necessary. In addition, the application management / distribution execution unit 4104 manages the applications stored in the application storage area 4400 and controls the distribution of each application to each television receiver in response to requests. Furthermore, when distributing the applications to each television receiver, the application management / distribution execution unit 4104 may perform authentication processing for each television receiver as necessary.
[0170] The LAN communication unit 421 is connected to the internet 200 and communicates with the broadcast station server 300 on the internet 200 and with the broadcast receiving device 100 via the router device 200r. The LAN communication unit 421 is equipped with encoding circuits, decoding circuits, etc.
[0171] [Hardware configuration of mobile devices] Figure 10A is a block diagram showing an example of the internal configuration of a portable information terminal 700. The portable information terminal 700 consists of a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, a voice processing unit 750, and a sensor unit 760.
[0172] The main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700 according to a predetermined operating program. The system bus 702 is a data communication path for sending and receiving data between the main control unit 701 and each operating block within the portable information terminal 700.
[0173] ROM 703 is a memory that stores basic operating programs such as the operating system and other operational programs, and a rewritable ROM such as EEPROM or flash ROM is used. RAM 704 is the work area when the basic operating programs and other operational programs are executed. ROM 703 and RAM 704 may be integrated with the main control unit 701. Also, ROM 703 may not have an independent configuration as shown in Figure 10A, but may use a portion of the storage area within the storage unit 710.
[0174] The storage unit 710 stores the operating program and settings of the personal information terminal 700, as well as the personal information of the personal information terminal 700 user. It can also store operating programs downloaded via the Internet 200 and various data created by said operating programs. Furthermore, it can store content such as videos, still images, and audio downloaded via the Internet 200. A portion of the storage unit 710 may replace all or part of the functions of the ROM 703. In addition, the storage unit 710 needs to retain the stored information even when the personal information terminal 700 is not supplied with external power. Therefore, devices such as flash ROM, SSDs or other non-volatile semiconductor memory, and HDDs or other magnetic disk drives are used.
[0175] Furthermore, the aforementioned operating programs stored in ROM 703 and storage unit 710 can be added, updated, and have their functions expanded through download processes from server devices on the Internet 200.
[0176] The communication processing unit 720 consists of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via a router device 200r or access point 200a and transmits and receives data with various server devices and other communication devices on the Internet 200. The connection with the router device 200r or access point 200a shall be made by wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (calls) and data transmission and reception via wireless communication with a base station 600b of the mobile telephone communication network. The NFC communication unit 723 performs wireless communication when in proximity to a corresponding reader / writer. The LAN communication unit 721, mobile telephone network communication unit 722, and NFC communication unit 723 shall each be equipped with a coding circuit, a decoding circuit, an antenna, etc. Furthermore, the communication processing unit 720 may also be equipped with other communication units such as a Bluetooth (registered trademark) communication unit or an infrared communication unit.
[0177] The expansion interface section 724 is a group of interfaces for extending the functionality of the portable information terminal 700, and in this embodiment, it consists of a video / audio interface, a USB interface, a memory interface, etc. The video / audio interface handles the input of video / audio signals from an external video / audio output device, the output of video / audio signals to an external video / audio input device, etc. The USB interface connects to a PC or the like to send and receive data. It may also be used to connect a keyboard or other USB devices. The memory interface connects to a memory card or other memory medium to send and receive data.
[0178] The operation unit 730 is an instruction input unit that inputs operation instructions for the portable information terminal 700. In this embodiment, it consists of a touch panel 730t superimposed on the display unit 741 and an operation key 730k arranged in a row of button switches. Either one or the other may be used. The portable information terminal 700 may also be operated using a keyboard or the like connected to the expansion interface unit 724. The portable information terminal 700 may also be operated using a separate terminal device connected by wired or wireless communication. That is, the portable information terminal 700 may be operated from the broadcast receiving device 100. Furthermore, the touch panel function may be provided by the display unit 741.
[0179] The image processing unit 740 consists of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides image data processed by the image signal processing unit 742 to the user of the portable information terminal 700. The image signal processing unit 742 includes video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. The image signal processing unit 742 also has functions to perform format conversion, menu and other OSD (On Screen Display) signal superposition processing as needed. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings and objects by converting light input from a lens into electrical signals using electronic devices such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0180] The audio processing unit 750 consists of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker and provides the audio signal processed by the audio signal processing unit 752 to the user of the portable information terminal 700. The audio input unit 753 is a microphone and inputs the user's voice and other audio data by converting it into audio data.
[0181] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700. In this embodiment, it consists of a GPS receiver 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. These sensors enable the detection of the position, tilt, direction, movement, ambient brightness, proximity of surrounding objects, etc., of the portable information terminal 700. The portable information terminal 700 may also be equipped with other sensors, such as a barometric pressure sensor.
[0182] The personal digital assistant 700 may be a mobile phone, smartphone, tablet, etc. It may also be a PDA (Personal Digital Assistant) or a notebook PC. It may also be a digital still camera, a video camera capable of recording video, a portable game console, a navigation device, or other portable digital device.
[0183] Note that the example configuration of the portable information terminal 700 shown in Figure 10A includes many components that are not essential to this embodiment, such as the sensor unit 760, but the effectiveness of this embodiment will not be impaired even if these components are not included. Furthermore, additional components not shown, such as a digital broadcasting reception function or an electronic money payment function, may also be added.
[0184] [Software configuration of mobile devices] Figure 10B is a software configuration diagram of the portable information terminal 700 of this embodiment, showing the software configuration in the ROM 703, RAM 704, and storage unit 710. In this embodiment, the ROM 703 stores the basic operation program 7001 and other operation programs, and the storage unit 710 stores the cooperation control program 7002 and other operation programs. The storage unit 710 also includes a content storage area 7200 for storing content such as video, still images, and audio, an authentication information storage area 7300 for storing authentication information necessary when accessing television receivers and various server devices, and various information storage areas for storing other types of information.
[0185] The basic operation program 7001 stored in ROM 703 is loaded into RAM 704, and the main control unit 701 then executes the loaded basic operation program to constitute the basic operation execution unit 7101. Similarly, the cooperation control program 7002 stored in storage unit 710 is loaded into RAM 704, and the main control unit 701 then executes the loaded cooperation control program to constitute the cooperation control execution unit 7102. The RAM 704 also includes a temporary storage area that temporarily holds data created during the execution of each operation program as needed.
[0186] For the sake of simplicity, in the following explanation, the process in which the main control unit 701 controls each operation block by loading the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing it will be described as if the basic operation execution unit 7101 controls each operation block. The same description will be applied to other operation programs.
[0187] The collaborative control execution unit 7102 manages device authentication and connection, transmission and reception of various data, etc., when the mobile information terminal 700 performs collaborative operations with the television receiver. The collaborative control execution unit 7102 also includes a browser engine function for executing applications that work in conjunction with the television receiver.
[0188] Each of the aforementioned operating programs may be pre-stored in the ROM 703 and / or storage unit 710 at the time of product shipment. Alternatively, they may be acquired after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Furthermore, each of the aforementioned operating programs stored on a memory card, optical disc, etc., may be acquired via the expansion interface unit 724, etc.
[0189] [Time management for broadcast receiving equipment] The broadcast receiving device of this embodiment is equipped with two types of time management functions. The first time management function is an NTP-based time management function, as already explained using Figure 7C. The second time management function is an MH-TOT-based time management function, which manages the time based on time information transmitted by MH-TOT as explained in Figure 6B.
[0190] Figure 13A shows an example of the structure of time information transmitted via NTP. Figure 13B also shows an example of the data structure of the MPU timestamp descriptor. The 'reference_timestamp' parameter and the 'transmit_timestamp' parameter in the NTP format are 64-bit NTP-length time data, and the 'mpu_presentation_time' parameter in the MPU timestamp descriptor is also 64-bit NTP timestamp-length time data. The NTP-length time data and the NTP timestamp-length time data represent 'seconds or more' in UTC with 32 bits and 'less than seconds' with 32 bits. In other words, NTP-formatted time information can transmit time information down to 'less than seconds'. Furthermore, since NTP-formatted time information is in UTC notation, unlike clock management in conventional digital broadcasting, it can be matched with NTP included in signals received on the communication line path (for example, the communication line that can be received by the LAN communication unit 121 in Figure 7A), as shown in Figure 3(B).
[0191] In contrast, the information transmitted by MH-TOT is as follows. The broadcast receiving device 100 is capable of obtaining the current date and Japan Standard Time via MH-TOT. Figure 11A shows an example of the data structure of MH-TOT. The broadcast receiving device 100 can obtain the current date and time from the 'JST_time' parameter of the MH-TOT. As shown in Figure 11B, the 'JST_time' parameter includes the lower 16 bits of encoded data of the current date using Modified Julian Date (MJD) and 24 bits of information representing Japan Standard Time (JST) using six 4-bit binary-coded decimal (BCD) numbers. The current date can be calculated by performing a predetermined operation on the 16-bit encoded data of the MJD. Six 4-bit binary-coded decimal numbers represent the 'hours' in two decimal digits using two 4-bit binary-coded decimal numbers, the 'minutes' in two decimal digits using the next two 4-bit binary-coded decimal numbers, and the 'seconds' in two decimal digits using the last two 4-bit binary-coded decimal numbers.
[0192] Therefore, the difference between time based on NTP and time based on MH-TOT is that NTP, as mentioned above, transmits time information in UTC notation that can reach "less than a second," while the information transmitted by MH-TOT is information in JST notation that reaches "seconds."
[0193] The broadcast receiving device 100 of this embodiment can achieve more accurate synchronization processing by using a time management function based on NTP, which is time information in UTC notation, for the synchronization processing of decoding and displaying video, audio, subtitles, text overlays, and other display data, which are the content of the broadcast signal. Furthermore, by referring to information in UTC notation instead of the clock notation of the broadcasting station, it is also possible to perform synchronization processing of decoding and displaying video, audio, subtitles, text overlays, or other data, which are the content of the broadcast signal received via the broadcast signal, and video, audio, subtitles, text overlays, or other data, which are acquired via the communication line path.
[0194] Furthermore, the broadcast receiving device of this embodiment can use the time management function based on "JST_time," which contains 24 bits of information represented by six 4-bit binary-coded decimal numbers of MH-TOT, for the process of presenting the current time to the user or for each process that handles the MH-event information table (MH-EIT) as explained in Figure 6B. Generally, in the process of presenting the current time to the user in a broadcast receiving device, precision down to the second is rarely required. Also, each time piece of information described in the MH-event information table (MH-EIT) is stored as 24 bits of information represented by six 4-bit binary-coded decimal numbers, with two decimal digits each for "hours," "minutes," and "seconds," similar to the EIT of conventional digital broadcasts transmitted using the MPEG2-TS method. For this reason, the time management function based on MH-TOT in the broadcast receiving device 100 of this embodiment is easily compatible with processes that use MH-EIT. Specifically, processes that use MH-EIT include the program guide generation process (described later), the control of recording and viewing reservations, and copyright management processes such as temporary storage. In most of these processes, accuracy to the second is rarely required; accuracy to the second is usually sufficient.
[0195] Furthermore, the process of generating the program guide, controlling recording and viewing reservations, and copyright management processes such as temporary storage are functions that are also included in receivers of conventional digital broadcasting systems using the MPEG2-TS method. Therefore, in the broadcasting system of this embodiment, if the process of generating the program guide, controlling recording and viewing reservations, and copyright management processes such as temporary storage is configured to be compatible with the time management process of conventional MPEG2-TS digital broadcasting systems, then when configuring a broadcasting receiver that has both the reception function of conventional MPEG2-TS digital broadcasting and the reception function of MMT digital broadcasting, it becomes unnecessary to design separate processing algorithms for these processes (processes such as generating the program guide, controlling recording and viewing reservations, and copyright management processes such as temporary storage), and costs can be reduced.
[0196] Furthermore, even for receivers that do not have the ability to receive digital broadcasts using the conventional MPEG2-TS method and only have the ability to receive digital broadcasts using the MMT method, it is possible to develop them at a lower cost by reusing algorithms for functions already installed in receivers of conventional MPEG2-TS digital broadcasting systems, rather than having to completely create new algorithms for processing such as program guide generation, control of recording and viewing reservations, and copyright management processing such as temporary storage.
[0197] Therefore, by configuring the time management function based on the MH-TOT's 'JST_time' parameter to be used for these processes (such as program guide generation, control of recording and viewing reservations, and copyright management processes such as temporary storage), it becomes possible to provide MMT-type digital broadcasting receiving equipment at a lower cost by improving compatibility with conventional broadcasting systems.
[0198] As described above, the broadcast receiving device 100 of this embodiment is equipped with a time management function that uses two types of time information with different accuracies. One type of time information is time information with a notation consistent with conventional digital broadcasting systems, and the other type of time information has a higher resolution than the first type of time information. By using the latter type of time information for synchronization processing of each content data of the broadcast signal, more advanced information presentation processing than conventional broadcasting systems can be achieved, and by using the former type of time information for program guide generation processing, control of recording and viewing reservations, and copyright management processing such as temporary storage, the broadcast receiving device can be provided at a low cost.
[0199] Therefore, by incorporating the two types of time management functions described above, the broadcast receiving device 100 of this embodiment can achieve both more advanced information presentation processing and lower costs.
[0200] [The first variation of time management] Next, a first modified example of time management in the broadcasting system of this embodiment will be described below.
[0201] In the first modified example, in order to improve the accuracy of the time management function based on NTP, as already explained using Figure 7C, information regarding the assumed delay time in time information transmission from the time management server (not shown) or broadcasting station server 300 to the broadcast receiving device 100 may be included in the broadcast signal and transmitted, and the broadcast receiving device 100 may be configured to use the information regarding the assumed delay time to correct the system clock of the NTP-based time management function.
[0202] In this case, the information regarding the assumed delay time may be configured to be transmitted not within the TLV multiplexed stream shown in Figure 3(A), but within the TMCC (Transmission and Multiplexing Configuration Control) area outside the TLV multiplexed stream. If transmitted within the TMCC area, the broadcast receiving device 100 can extract the information regarding the assumed delay time without going through the separation process (demaxing process) of the TLV multiplexed stream. That is, it is possible to acquire information that is less affected by the delay caused by the separation process in the broadcast receiving device 100, and therefore, a highly accurate system clock correction process can be performed. An example of the data structure of the time information transmitted by the TMCC signal will be explained using Figure 13C. The time information may be stored and transmitted, for example, in the TMCC extended information area. In the time information of the TMCC extended information area in Figure 13C, the 'delta' parameter represents the assumed value of the transmission delay from the time management server that distributes UTC or the server device that creates the TMCC signal to a general broadcast receiving device as a 32-bit signed fixed-point number. The upper 16 bits represent the integer part, and the lower 16 bits represent the decimal part. The 'transmit_timestamp' parameter is the transmission timestamp, which describes the time when this TMCC signal is sent from the server device in NTP timestamp length format. The upper 32 bits represent the integer part, and the lower 32 bits represent the decimal part.
[0203] In the first modification example, the broadcast receiver 100 of the present embodiment can correct the system clock of the time management function based on NTP used for synchronization processing of each content data of the broadcast signal with higher accuracy by using the information regarding the assumed delay time (for example, the aforementioned 'delta' parameter and / or 'transmit_timestamp' parameter) described in the time information stored in the TMCC extension information area and transmitted.
[0204] [Second Modification Example of Time Management] Next, a second modification example of time management in the broadcast system of the present embodiment will be described below.
[0205] As described above, the broadcast receiver 100 of the present embodiment has a time management function that acquires the current date and Japanese standard time based on the information transmitted by MH-TOT and manages the time. The current date and Japanese standard time acquired based on the information transmitted by MH-TOT can be output to the monitor unit 162 and the video output unit 163 and provided to the user by being superimposed on video information, application information, etc. in the video composition unit 161 of the broadcast receiver 100. As described above, MH-TOT has the data structure shown in FIG. 11A, and the broadcast receiver 100 can acquire the current date and current time from the 'JST_time' parameter of the MH-TOT.
[0206] However, in the aforementioned 'JST_time' parameter, only the lower 16 bits of the encoded data of MJD are used, so an overflow will occur on April 22, 2038, and a date after April 23, 2038 cannot be expressed by only the predetermined calculation. Therefore, in the second modification example of the present embodiment, it is assumed that the calculation method is switched depending on whether the value of MJD is greater than or equal to a predetermined value or less than the predetermined value, so that a date after April 23, 2038 can be expressed.
[0207] Figure 12 shows an example of a first calculation method used when the value of MJD is greater than or equal to a predetermined value, and a second calculation method used when the value of MJD is less than a predetermined value. For example, if the predetermined value is set to "32768 (0x8000)", the current date is calculated using the first calculation method when MJD is "32768" or greater, and the current date is calculated using the second calculation method when MJD is less than "32768". Note that when MJD is less than "32768", it is equivalent to when the most significant bit of the 16-bit data of MJD is "0". As a result, the broadcast receiving device 100 of this embodiment can represent dates from "April 23, 2038" onwards. However, the predetermined value can be set arbitrarily, and it may be set to "16384 (0x4000)" or "49152 (0xC000)", etc. The conditions for switching the calculation method may be set as follows: when the upper two bits of the 16-bit data of MJD are '00', or when the upper two bits of the 16-bit data of MJD are not '11'. Note that if the predetermined value is set to '32768' and the above means is used, it will not be possible to represent dates before 'September 4, 1948', but this does not pose any particular problem for practical use as a television receiver.
[0208] Furthermore, instead of switching between the first and second calculation methods depending on the comparison result between the MJD and the predetermined value, the first and second calculation methods may be switched depending on a flag that replaces or adds a part or all of the 'reserved' parameter in the MH-TOT data structure shown in Figure 11A. For example, the flag may be set to '1' if the most significant bit of the 16-bit encoded data of the MJD is '0', and the MJD indicates a date of 'April 23, 2038' or later, and to '0' if it does not indicate a date of 'April 23, 2038' or later. Then, when the flag is '1', the second calculation method shown in Figure 12 may be used, and when the flag is '0', the first calculation method may be used. Alternatively, a descriptor having the same meaning as the flag may be newly prepared and placed in the MH-TOT.
[0209] Furthermore, as described above, the broadcasting system of this embodiment transmits absolute time in NTP format, and the broadcasting receiver 100 of this embodiment has a time management function based on said NTP. In addition, the broadcasting receiver 100 of this embodiment controls the decoding timing and presentation timing for each presentation unit of video / audio signals by referring to the NTP timestamp etc. described in the MPU timestamp descriptor set for each MPU. As described above, the NTP format time information has the configuration shown in Figure 13A. The MPU timestamp descriptor also has the configuration shown in Figure 13B.
[0210] Therefore, in the broadcast receiving device 100 of this embodiment, the device may refer to the 'reference_timestamp' parameter, the 'transmit_timestamp' parameter, or the 'mpu_presentation_time' parameter, etc., and select which of the first calculation method or the second calculation method to use according to the value of the referenced time data, etc. That is, for example, if the most significant bit of the 64-bit NTP-length time data is '0', the second calculation method may be used, and if it is not '0', the first calculation method may be used, and so on.
[0211] By any of the methods described above, the broadcast receiving device 100 of this embodiment will be able to display dates from April 23, 2038 onwards.
[0212] [Broadcast receiving device channel selection process (initial scan)] The AMT of the broadcasting system in this embodiment provides a list of multicast groups for IP packets in order to receive IP packets transmitted using the TLV multiplexing scheme with as little distinction as possible from IP packets transmitted over the communication line. Multiple IP multicast groups can be listed for a single service identifier. In addition, an address mask can be used to efficiently describe consecutive IP addresses.
[0213] In the broadcast receiving device 100 of this embodiment, a list of services acquired from TLV-NIT can be stored in non-volatile memory such as ROM 103 or storage unit 110 during channel scanning for initial setup or during rescanning for setting changes. Furthermore, a list of IP multicast groups corresponding to each of the services can be stored in the non-volatile memory as IP-related information, associated with each of the services. By storing the list of services and IP-related information in non-volatile memory and making them constantly accessible, it becomes unnecessary to reacquire TLV-NIT or AMT when switching channels, etc., enabling efficient acquisition of broadcast content.
[0214] Figure 14 shows an example of the operation sequence during channel scanning (rescanning) in the broadcast receiving device 100 of this embodiment.
[0215] When a channel scan is initiated, the receiving function execution unit 1102 instructs the tuner / demodulator 131 to set an initial frequency value and tune to the said frequency value (S101). If the tuner / demodulator 131 successfully locks to the set frequency value (S102: Yes), the receiving function execution unit 1102 then acquires the TLV-NIT from the received signal (S103).
[0216] If the TLV-NIT obtained in the processing of S103 is valid data (S104: Yes), the receiving function execution unit 1102 obtains information such as the TLV stream ID and original network ID from the obtained TLV-NIT (S105). Figure 15A shows an example of the data structure of the TLV-NIT. The TLV stream ID information can be obtained from the 'tlv_stream_id' parameter, and the original network ID information can be obtained from the 'original_network_id' parameter. Furthermore, distribution system information regarding the physical conditions of the broadcast transmission path corresponding to each TLV stream ID / original network ID is obtained from the distribution system descriptor (S106), and a list of service IDs is obtained from the service list descriptor (S107). Figure 15B shows an example of the data structure of the satellite distribution system descriptor. Figure 15C shows an example of the data structure of the service list descriptor. If the TLV-NIT has multiple different data such as TLV stream ID, original network ID, distribution system information, and a list of service IDs, the process from S105 to S107 is repeated. Next, the receiving function execution unit 1102 creates a service list based on the data such as TLV stream ID, original network ID, distribution system information, and a list of service IDs obtained in the process from S105 to S107, and stores the created service list in the ROM 103 or storage unit 110, etc. (updating it during a rescan) (S108).
[0217] Next, the receiving function execution unit 1102 acquires the AMT from the received signal (S109), and further acquires a list of IP multicast groups related to each service ID stored in the service list (S110). Figure 15D shows an example of the data structure of the AMT. If the AMT has a list of IP multicast groups related to multiple service IDs, the process in S110 is repeated. If there are multiple AMTs that have lists of IP multicast groups related to different service IDs, the processes in S109 to S110 are repeated. Next, the receiving function execution unit 1102 stores the list of IP multicast groups acquired in the process of S110 as IP-related information, associated with the service ID, in the ROM 103 or storage unit 110, etc. (updated during rescan) (S111).
[0218] If the tuner / demodulator 131 fails to lock to the set frequency value during the S102 process (S102: No), or if the TLV-NIT obtained during the S103 process is not valid data (S104: No), then the S105-S111 processes will not be performed.
[0219] After completing the process in S111, the receiving function execution unit 1102 terminates processing if the frequency value set in the tuner / demodulation unit 131 is the final frequency value of the channel scan range (S112: Yes). On the other hand, if the set frequency value is not the final frequency value of the channel scan range (S112: No), it increases the frequency value set in the tuner / demodulation unit 131 (S113) and repeats the processing in S102 to S111. Note that if a single TLV-NIT can obtain service IDs for all services constituting the broadcast network, and can also obtain an AMT containing a list of IP multicast groups related to the service IDs, then processing in S112 to S113 is unnecessary.
[0220] Through the series of processes described above, the broadcast receiving device 100 of this embodiment can, during channel scanning for initial setup or during rescanning for setting changes, create / update a list of services constituting the broadcast network (service list), and at the same time create / update a list of IP multicast groups corresponding to each of the services (IP-related information), and further store this information in non-volatile memory such as the ROM 103 or storage unit 110.
[0221] Furthermore, the rescan for the aforementioned setting change may be performed automatically when a change in the information within the table is detected by referring to the 'version_number' parameter of TLV-NIT or AMT. Alternatively, when a change in the 'version_number' parameter of either TLV-NIT or AMT is detected, only the information related to the table in which the parameter change was detected may be automatically updated. However, when the above-mentioned automatic update is performed, it is desirable to notify the user that an automatic rescan has been performed. In addition, the user may be notified that a change has occurred in the information within the table and given the user the option of whether or not to perform the rescan.
[0222] [Channel selection process (channel switching) for broadcast receivers] Figure 16 shows an example of the operation sequence when selecting a station (switching channels) in the broadcast receiving device 100 of this embodiment.
[0223] When a user operates a remote control (not shown in the diagram) or the like to instruct a channel change, the receiving function execution unit 1102 interprets the command transmitted from the remote control and specifies the service ID of the target service (S201). Next, the receiving function execution unit 1102 starts acquiring the AMT from the received signal of the tuner / demodulation unit 131. If the AMT is successfully acquired within a predetermined time (S202: Yes), information regarding a list of IP multicast groups corresponding to the service ID is obtained from the acquired AMT (S204). On the other hand, if the AMT is not successfully acquired within a predetermined time (S202: No), information regarding a list of IP multicast groups corresponding to the service ID is obtained by referring to IP-related information stored in the ROM 103 or storage unit 110, etc. (S203) (S204). Note that the decision process in S202 may be omitted, and the system may always refer to IP-related information stored in the ROM 103 or storage unit 110, etc.
[0224] Next, the receiving function execution unit 1102 starts acquiring the TLV-NIT from the received signal of the tuner / demodulation unit 131. If the acquisition of the TLV-NIT is successful within a predetermined time (S205: Yes), the distribution system information for acquiring the IP data flow corresponding to the service ID is acquired from the acquired TLV-NIT (S207). On the other hand, if the acquisition of the TLV-NIT is not successful within a predetermined time (S205: No), the distribution system information for acquiring the IP data flow corresponding to the service ID is acquired by referring to the service list stored in the ROM 103 or storage unit 110, etc. (S206) (S207). Note that the decision process in S205 may be omitted, and the system may always refer to the service list stored in the ROM 103 or storage unit 110, etc. After obtaining distribution system information in the S207 process, the receiving function execution unit 1102 then controls the tuner / demodulation unit 131 using the frequency value indicated by the obtained distribution system information, receives the IP data flow corresponding to the service ID (S208), extracts the MMT data sequence from the received IP data flow, and outputs it to the separation unit 132.
[0225] In the separation unit 132, the transport processing unit 1102a acquires an MMTP packet whose packet ID is '0' from the input MMT data sequence (S209), and further acquires the MPT included in the acquired MMTP packet (S210). Next, the transport processing unit 1102a refers to the 'MMT_package_id_byte' parameter of the acquired MPT, and checks whether the lower 16 bits of the 'MMT_package_id_byte' parameter are the same value as the service ID. In an example of the data structure of the MPT shown in FIG. 17, when the lower 16 bits of the 'MMT_package_id_byte' parameter are the same value as the service ID (S211: Yes), it is determined that the MMTP packet whose packet ID is '0' is an MMTP packet having the data of the program corresponding to the service ID, and the acquisition of the MFU is executed based on the information of the acquired MPT (S216).
[0226] On the other hand, when the lower 16 bits of the 'MMT_package_id_byte' parameter are not the same value as the service ID (S211: No), it is determined that the MMTP packet whose packet ID is '0' is not an MMTP packet having the data of the program corresponding to the service ID. In this case, the transport processing unit 1102a acquires the PLT again (S212), and by checking the acquired PLT, checks the packet ID (assumed to be x) of the MMTP packet that transmits the MPT having the 'MMT_package_id_byte' parameter corresponding to the service ID (S213). Further, the transport processing unit 1102a acquires an MMTP packet whose packet ID is 'x' from the input MMT data sequence (S214), and acquires the MPT included in the acquired MMTP packet (S215). Further, the MFU is acquired based on the information of the acquired MPT (S216).
[0227] Alternatively, the processing of S209 to S211 may be omitted, and the processing of S212 to S215 may always be performed. In this case, the processing time can be shortened when the program data corresponding to the aforementioned service ID is stored in an MMTP packet other than packet ID '0'.
[0228] When the MFU is acquired in the S216 process, the transport processing unit 1102a extracts encoded video data, encoded audio data, etc., from the acquired MFU and outputs them to the video decoder 141, audio decoder 143, etc. Subsequently, video / audio decoding processing is performed based on the control of the AV decoding processing unit 1102b, and presentation processing is performed based on the control of the presentation processing unit 1102h. However, since these processes are publicly known, a detailed explanation will be omitted.
[0229] Through the above series of processes, the broadcast receiving device 100 of this embodiment is capable of performing channel selection (channel switching) operations. In particular, as explained with reference to Figures 14 and 16, service lists and IP-related information are created during the channel scan in initial setup or during a rescan for setting changes, and stored in non-volatile memory such as ROM 103 or storage unit 110 for constant reference. By referring to the service lists and IP-related information stored in non-volatile memory such as ROM 103 or storage unit 110 during channel selection (channel switching), the efficiency of the operation during channel selection (channel switching) can be improved. That is, compared to the case where AMT and TLV-NIT are reacquired during channel selection (channel switching), the time from the start of channel selection (channel switching) to the end of channel selection (channel switching) can be shortened.
[0230] [Screen layout control for broadcast receiving equipment] In this embodiment, the broadcast receiving device 100 is capable of screen layout control based on the LCT description. Figure 18 shows an example of the LCT data structure.
[0231] In the diagram, the 'left_top_pos_x' and 'right_down_pos_x' parameters, in particular, represent the horizontal positions of the top left and bottom right of the region as a percentage of the total number of pixels in the horizontal direction, with the left side of the full-screen display set to '0' and the right side to '100'. The 'left_top_pos_y' and 'right_down_pos_y' parameters represent the vertical positions of the top left and bottom right of the region as a percentage of the total number of pixels in the vertical direction, with the top side of the full-screen display set to '0' and the bottom side to '100'. The 'layer_order' parameter indicates the relative position in the depth direction of the region.
[0232] Examples of assigning layouts to layout numbers based on the settings of the aforementioned parameters are shown in Figures 19A to 19D, along with the settings for each parameter.
[0233] Figure 19A shows the default layout settings for the broadcast receiving device 100 in this embodiment, which is an example of setting only one area on the entire screen. Figure 19B shows an example where the entire screen is divided into three areas, and each area is named "Area 0", "Area 1", and "Area 2". For example, if the total number of pixels on the entire screen is 7680 horizontally and 4320 vertically, then "Area 0" is set to the range (0,0)-(6143,3455) because the "left_top_pos_x" parameter is "0", the "left_top_pos_y" parameter is "0", the "right_down_pos_x" parameter is "80", and the "right_down_pos_y" parameter is "80". Similarly, "Area 1" is set to the range (6144,0)-(7679,4319), and "Area 2" is set to the range (0,3456)-(6143,4319).
[0234] Figure 19C shows an example of setting three regions, similar to Figure 19B. Region 0 is set to the range (0,0)-(7679,4319), while Region 1 and Region 2 are set to the same range as described above and are placed in front of Region 0 according to the setting of the layer_order parameter. Figure 19D shows an example where Region 0 is set on device 0 (the default device: in this embodiment, the broadcast receiver 100) and Region 1 is set on device 1 (in this embodiment, the mobile information terminal 700).
[0235] As described above, in the broadcasting system of this embodiment, by using LCT, it becomes possible to control the screen layout so that multimedia services are displayed on the receiver as intended by the service provider.
[0236] Furthermore, any decimal fractions that occur when dividing the screen according to the settings of parameters such as 'left_top_pos_x' can be rounded up or down. Rounding to the nearest integer (or rounding to zero in binary) is also acceptable. For example, if the total number of pixels in the entire screen is 7680 pixels / 4320 vertical pixels, and the 'left_top_pos_x' parameter of 'area 0' is '0', the 'left_top_pos_y' parameter is '0', the 'right_down_pos_x' parameter is '51', and the 'right_down_pos_y' parameter is '51', then 'area 0' can be set to the range (0,0)-(3916,2203) by rounding up, or to the range (0,0)-(3915,2202) by rounding down. In addition, rounding up / down may be performed in units of 8 pixels or 16 pixels, taking into account macroblocks during video compression. The above process makes it possible to efficiently perform region setting based on LCT and resolution conversion processing of multimedia content within the region.
[0237] [Exception handling for screen layout control of broadcast receiving devices] In the broadcast receiving device 100 of this embodiment, even when the screen layout area is controlled by the aforementioned LCT, if the user instructs the display of the EPG screen, etc., it is possible to perform screen layout control that ignores the contents of the LCT as an exception. Figure 20A shows an example of the operation of the exception handling for screen layout control based on the LCT.
[0238] In this embodiment, when the LCT description performs screen layout control similar to that in Figure 19B, and the broadcast program video is displayed in "Area 0," and broadcast content such as program linkage data linked to the broadcast program is displayed in "Area 1" and "Area 2," and the user instructs the display of the EPG screen using a remote control (not shown in the figure), the broadcast receiver 100 in this embodiment will, as shown in Figure 20A(A), return the screen layout settings to the default settings (i.e., the same screen layout control as in Figure 19A) regardless of the contents of the LCT description, and control the display of the EPG screen to fill the entire screen. Furthermore, when the user instructs the end of the EPG screen display, the screen layout control according to the contents of the LCT description will be re-executed.
[0239] By performing the aforementioned control, it is possible to display the EPG screen larger and improve readability compared to the case where the EPG screen is displayed while maintaining screen layout area control, as shown in Figure 20A(B).
[0240] Furthermore, the exception handling for screen layout control described above is not only applied when displaying the EPG screen, but may also be applied when displaying various setting screens of the broadcast receiving device 100 as sub-screens or in dual-screen mode, as shown in Figure 20B.
[0241] In the case of the recording settings screen shown in Figure (A), the display area for broadcast content is changed from the entire screen to only the sub-screen portion in the lower right corner of the screen. Similarly, in the case of the dual-screen display shown in Figure (B), the display area for broadcast content is changed from the entire screen to only the split-screen portion in the middle left of the screen. In either case, the display area for displaying broadcast content is narrower compared to when the entire screen is used, so it is not visually desirable to maintain area control of the screen layout within the display area (i.e., to divide the area and display multiple broadcast contents simultaneously). Therefore, in the broadcast receiving device 100 of this embodiment, in the above situation, only the broadcast content of "Area 0" is selected and displayed in the display area. Alternatively, depending on the previous area selection status, broadcast content from "Area 1" or "Area 2" may be selected and displayed.
[0242] By performing the aforementioned control, it becomes possible to improve the readability of broadcast content compared to displaying various broadcast content while maintaining screen layout area control. The same applies to sub-window display in the recorded program list screen and browser display of internet content, etc.
[0243] [EPG display on broadcast receiving device] In this embodiment of the broadcasting system, time-series information regarding events (so-called programs) included in each service constituting the broadcasting network is transmitted via MH-EIT. Figure 21 shows an example of the data structure of the MH-EIT in this embodiment. The MH-EIT is identified into two classes by a table ID (corresponding to the 'talbe_id' parameter in the figure) and is capable of displaying information on the current / next event of its TLV stream and schedule information for each event in its TLV stream. The broadcasting receiver 100 in this embodiment can create an EPG screen by referring to the MH-EIT, etc., and identifying it by a service ID (corresponding to the 'service_id' parameter in the figure), thereby obtaining information such as the start time and broadcast time of each event. The created EPG can then be superimposed on video information, etc., by the video synthesis unit 161 and displayed on the monitor unit 162.
[0244] Figure 22A shows an example of the EPG screen in the broadcast receiving device 100 of this embodiment. The EPG screen 162a is a matrix shape with the vertical axis representing time and the horizontal axis representing service ID (channel), and displays detailed information of broadcast programs broadcast on each channel during each time period. The detailed information 162a1 for each broadcast program mainly consists of a title area 162a2 and a detailed description area 162a3.
[0245] The title area 162a2 displays the program title of the broadcast program and symbols, etc., that represent the attributes of the broadcast program. The symbols, etc., that represent the attributes of the broadcast program may be, for example, symbols / characters indicating that it is a new program, or symbols / characters indicating that it is a rebroadcast program. Alternatively, it may be a symbol representing "data" that signifies that it supports data broadcasting by the broadcast service. It may also be a symbol representing "NetWork" 162a4 that signifies that content and applications related to the broadcast program can be obtained from the network. Furthermore, the symbols, etc., that represent the attributes of the broadcast program may be replaced by differentiating the background color of the detailed information 162a1 from others, or by surrounding the display area of the detailed information 162a1 with a thick border.
[0246] Even if the control information (messages, tables, descriptors, etc.) in the broadcasting system of this embodiment indicates that content and applications related to the broadcast program can be obtained from the network, if there is no LAN cable connected to the LAN communication unit 121 of the broadcasting receiver 100, or if there is no access to the server devices on the network, the system may be controlled not to display the symbol 162a4 representing "NetWork".
[0247] Furthermore, if the broadcast program is a distributed program delivered via the Internet 200 and cannot be obtained solely from the broadcast wave, and if, as described above, the broadcast receiving device 100 is unable to access the server devices on the network, the detailed information 162b1 displayed on the EPG screen 162b may be controlled to gray out, as shown in Figure 22B. In other words, the detailed information of a distributed program that cannot be viewed is not displayed. Alternatively, the background color of the detailed information 162b1 may be differentiated from the others to serve as an alternative to the graying-out process. If the detailed information 162b1 is selected by operating a remote control (not shown in the figure), the user may be notified by a pop-up or the like that the broadcast receiving device 100 is unable to access the server devices on the network, or that the distributed program associated with the detailed information 162b1 cannot be viewed.
[0248] Through the aforementioned controls, the broadcast receiving device 100 can provide the user with program information for each broadcast program in a more natural format, depending on the network connection status.
[0249] Figure 22C shows another example of the EPG screen in the broadcast receiving device 100 of this embodiment. In the figure, "M1 TV", "M2 Broadcast", "M3 Channel", "M4 TV", "TV M5", etc. are the names of broadcasting stations for each channel, and in particular, the "M2 Broadcast" station is assumed to simultaneously provide broadcast programs distributed via broadcast waves and distributed programs distributed via the Internet 200 (information 162c1 in the frame indicated as "Internet Broadcast" in the figure).
[0250] As shown in the figure, if there is a channel that only has broadcast programs distributed via the Internet 200, under normal circumstances, the system is controlled to display information for all channels (including information 162c1) as shown in the EPG screen 162c of the figure (A). On the other hand, if the broadcast receiving device 100 is unable to access each server device on the network, the system may be controlled not to display information for "M2 broadcast (net broadcast)" channels that only have broadcast programs distributed via the Internet 200 (information 162c1 in the figure (A)), as shown in the EPG screen 162d of the figure (B).
[0251] Through the aforementioned controls, users of the broadcast receiving device 100 will no longer need to check information about channels they cannot view.
[0252] [Emergency warning broadcast display on broadcast receiving device] The broadcast receiving device 100 of this embodiment is capable of receiving an emergency warning broadcast when the emergency warning broadcast activation control signal bit of the TMCC signal included in the transmission data including the TLV stream changes from '0' to '1'.
[0253] The aforementioned emergency warning broadcast may be provided as a full-screen application or as text information via text overlay. When the emergency warning broadcast is provided as text information via text overlay, it is preferable to display the text information via text overlay regardless of the state of the broadcast receiving device 100 immediately before receiving the emergency warning broadcast. That is, as shown in Figure 23, if a user is watching a regular broadcast program and the program screen 162e of the broadcast program is displayed on the monitor unit 162 when an emergency warning broadcast is received, the text information 162e1 from the emergency warning broadcast is superimposed on the program screen 162e. Similarly, if a user instructs the display of the EPG screen and the EPG screen 162f is displayed on the monitor unit 162 when an emergency warning broadcast is received, the system is controlled to superimpose the text information 162f1 from the emergency warning broadcast onto the EPG screen 162f.
[0254] Through the aforementioned control, the broadcast receiving device 100 of this embodiment can prevent users from missing important text information based on an emergency warning broadcast, even when the user has selected and is displaying the EPG screen, various settings screens, recorded program list screen, internet browser, etc.
[0255] [Various exception handling] In this embodiment, if the broadcast receiving device 100 cannot acquire data outside the TLV stream within the same package, it may perform exception handling such as the following.
[0256] As explained in Figure 6E, in the broadcasting system to which the broadcasting receiver 100 of this embodiment corresponds, data acquired within the TLV stream and data acquired via routes other than the TLV stream can be included in the same package based on location information stored in the MPT (corresponding to 'MMT_general_location_info()' in Figure 17). However, data transmission routes other than the TLV stream, which the location information points to (for example, IPv4 data flow, IPv6 data flow, broadcast MPEG2-TS, etc.), are receiving functions separate from the TLV / MMT stream receiving function. Therefore, even when the broadcasting receiver 100 is operating, there may be situations in which data cannot be acquired from these transmission routes, such as when the receiving function of these transmission routes is not operating, when the receiving function itself is operating but relay devices, etc., are not operating, when there is no wired or wireless connection to these transmission routes, or when the broadcasting receiver 100 is installed in an environment where these transmission routes cannot be connected in the first place.
[0257] Under these circumstances, if the broadcast receiving device 100 of this embodiment receives an event indicating that the location information stored in the MPT should be associated with including data acquired within the TLV stream and data acquired via a route other than the TLV stream in the same package, it may perform the following actions, for example.
[0258] For example, if the LCT has set up multiple areas on the screen, as shown in Figures 19B and 19C, and the video contained in the TLV stream is displayed in 'Area 0', and data acquired through transmission paths other than the TLV stream is displayed in 'Area 1' and 'Area 2', and if the data from transmission paths other than the TLV stream that should be displayed in 'Area 1' and 'Area 2' cannot be acquired, the display of the multi-area layout specified by the LCT may be prohibited. Specifically, even if the LCT is received, the default layout display shown in Figure 19A should remain with the video of the content received in the TLV stream displayed in 'Area 0', and it should not switch to a multi-area layout display like those in Figures 19B and 19C. Furthermore, even if a command to change from the default layout to the layout shown by the LCT is input to the operation input unit 170 in Figure 7A, it may remain in the default layout display shown in Figure 19A, or switch to another data broadcasting screen, so as not to switch to a multi-area layout display like those in Figures 19B and 19C.
[0259] If the LCT has set up multiple areas on the screen as shown in Figures 19B and 19C, and the video contained in the TLV stream is displayed in 'Area 0', and data acquired through transmission paths other than the TLV stream is displayed in 'Area 1' and 'Area 2', then another example of operation in the case where data from transmission paths other than the TLV stream that should be displayed in 'Area 1' and 'Area 2' cannot be acquired is to first display the display frames for the multiple areas shown in Figures 19B and 19C indicated by the LCT, display the background color or a predetermined still image in 'Area 1' and 'Area 2', and if data from transmission paths other than the TLV stream indicated by the MPT location information cannot be acquired even after a predetermined time has elapsed, the display may be switched back to the default layout display state shown in Figure 19A. In this case, it is preferable that the program video contained in the TLV stream continues to be displayed in 'Area 0' even when the layout is changed in Figures 19A, 19B, and 19C, as this will allow the user's program video itself to continue.
[0260] Furthermore, if data from transmission paths other than the TLV stream that should be displayed in "Area 1" and "Area 2" cannot be acquired, and the video of the content received within the TLV stream is displayed in "Area 0" of the default layout display shown in Figure 19A, it is possible that the operation of various communication functions and various receiving functions of the broadcast receiving device 100 of this embodiment may start, or the communication environment and communication status of the various communication functions, or the reception environment and reception status of the various receiving functions may change, resulting in a situation where data from transmission paths other than the TLV stream that should be displayed in "Area 1" and "Area 2" can be acquired. In this case, the broadcast receiving device 100 of this embodiment may immediately switch from the default layout display shown in Figure 19A to a multi-area layout as shown in Figures 19B and 19C shown by LCT, and switch to displaying the video of the content received within the TLV stream in "Area 0" and the data acquired from transmission paths other than the TLV stream in "Area 1" and "Area 2". Alternatively, the layout change may not be performed immediately, but rather after an instruction to change from the default layout to the layout indicated by the LCT is input from the operation input unit 170.
[0261] [Copyright protection feature] In the digital broadcasting system to which the broadcast receiving device 100 of this embodiment corresponds, the MPT may be configured to transmit copy control information, for example, indicating the copy control status of the content referenced by the MPT, such as "unlimited copying allowed" (which may be divided into two types: "unlimited copying allowed and encryption processing required during storage and output" and "unlimited copying allowed and no encryption processing required during storage and output"), "only one generation of copying allowed", "a predetermined number of copies allowed" (for example, 9 copies allowed + 1 move allowed is the so-called "Dubbing 10"), or "copy prohibited". In this case, the broadcast receiving device 100 of this embodiment may be configured to control the storage of the content in the storage unit 110, recording to a removable recording medium, output to an external device, copying to an external device, moving to an external device, etc., according to the copy control information. Note that the storage processing may include not only the storage unit 110 inside the broadcast receiving device 100, but also records that have undergone protection processing such as encryption so that they can be played back only by the broadcast receiving device 100. Specifically, the targets of the storage process include external recording devices and other equipment that have been made capable of recording and playback using only the broadcast receiving device 100.
[0262] A specific example of processing based on the copy control information is described below.
[0263] First, if the copy control information included in the MPT indicates "unlimited copying allowed," the broadcast receiving device 100 of this embodiment may perform storage in the storage unit 110, recording to a removable recording medium, output to an external device, copying to an external device, and moving to an external device without restriction. However, if there are two distinct conditions, "unlimited copying allowed and encryption processing required during storage and output" and "unlimited copying allowed and encryption processing not required during storage and output," then in the case of "unlimited copying allowed and encryption processing required during storage and output," storage in the storage unit 110, recording to a removable recording medium, output to an external device, copying to an external device, and moving to an external device can be performed an unlimited number of times, but encryption processing must be applied to all of them.
[0264] Furthermore, if the copy control information included in the MPT indicates "only one generation can be copied," the broadcast receiving device 100 in this embodiment will enable encrypted storage in the storage unit 110. However, when outputting the stored content to an external device for viewing, it will be output encrypted along with copy control information indicating "copy prohibited." However, so-called move processing to an external device (a process in which the content is copied to an external device and the content in the storage unit 110 of the broadcast receiving device 100 is rendered unplayable by erasure processing, etc.) is permitted.
[0265] Furthermore, if the copy control information included in the MPT indicates "copyable a predetermined number of times," the broadcast receiving device 100 in this embodiment will enable encrypted storage in the storage unit 110. However, when outputting the stored content to an external device for viewing, it will be encrypted and output along with copy control information indicating "copy prohibited." However, it is possible to enable a predetermined number of copies and moves to the external device. In the case of the so-called "Dubbing 10" provision, it is possible to perform 9 copies and 1 move to the external device.
[0266] Furthermore, if the copy control information included in the MPT indicates "copy prohibited," the broadcast receiving device 100 in this embodiment prohibits copying to the storage unit 110. However, if the broadcast receiving device 100 is configured to have a "temporary storage" mode that allows retention in the storage unit 110 only for a predetermined time or a predetermined time specified by control information included in the broadcast signal (for example, by the MH-Expire descriptor shown in Figure 6D), then even if the copy control information included in the MPT indicates "copy prohibited," temporary retention of the content in the storage unit 110 is possible. When outputting content with copy control information of "copy prohibited" included in the MPT for viewing on an external device, it shall be encrypted and output along with the copy control information of "copy prohibited."
[0267] Furthermore, output for viewing to the aforementioned external devices can be performed via the video output unit 163 and audio output unit 166 in Figure 7A, or via the digital I / F unit 125 or LAN communication unit 121, etc. Copying or moving to the aforementioned external devices can be performed via the digital I / F unit 125 or LAN communication unit 121, etc. in Figure 7A.
[0268] According to the process described above, appropriate content protection can be achieved in accordance with the copy control information associated with the content.
[0269] Furthermore, the copying process of content with copy control information indicating copy restrictions such as "copyable only once," "copyable a predetermined number of times," or "copy prohibited" to external devices via the LAN communication unit 121 is permitted only if the IP address of the external device, which is the destination of the packet transmitted from the broadcast receiving device 100, is within the same subnet as the IP address of the broadcast receiving device 100. If the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100, copying may be prohibited. Content with copy control information indicating "unlimited copying and encryption processing required during storage and output" may be treated similarly.
[0270] Similarly, the process of moving content that indicates copy restrictions such as "only one generation can be copied," "a predetermined number of copies can be made," or "unlimited copies are allowed, but encryption processing is required during storage and output" to an external device via the LAN communication unit 121 after it has been stored in the storage unit 110 may be limited to cases where the IP address of the external device, which is the destination of the packet transmitted from the broadcast receiving device 100, is within the same subnet as the IP address of the broadcast receiving device 100. If the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100, this process may be prohibited.
[0271] As a general rule, video and audio output for viewing content stored in the storage unit 110 of the broadcast receiving device 100 is only permitted if the IP address of the external device to which the transmitted packets from the broadcast receiving device 100 are destined is within the same subnet as the IP address of the broadcast receiving device 100. Output is prohibited if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. However, if the external device has been connected within the same subnet as the IP address of the broadcast receiving device 100 within a predetermined period and has been registered (paired) as a device that can be viewed even outside the same subnet as the IP address of the broadcast receiving device 100, the broadcast receiving device 100 may be configured to allow video and audio output for viewing content stored in the storage unit 110 to the external device, even if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. In this case, the video and audio output for viewing shall be performed with the content encrypted.
[0272] As described above, by performing different processing depending on whether the external device is on the same subnet as the IP address of the broadcast receiving device 100 or outside the same subnet, it is possible to achieve both user convenience and content protection.
[0273] Next, as explained in Figure 6E, in the digital broadcasting system to which the broadcast receiving device 100 of this embodiment is compatible, due to location information in the MPT (MMT_general_location_info() in Figure 17), data acquired via a different route (IPv4, IPv6, MPEG2-TS, URL, etc.) than the data acquired via the TLV stream of the broadcast route may be included in the same package and event as the data acquired via the TLV stream. In this case, we will explain content protection when copy control information is included in the MPT.
[0274] First, if the MPT includes copy control information, data included in the same package and event in the location information may be controlled according to the copy control information included in the TLV stream, even if the data was acquired via a different route (IPv4, IPv6, MPEG2-TS, URL, etc.) than the data acquired via the TLV stream on the broadcast route. Depending on this copy control information, the copy control status of the specified content can be set as follows, as mentioned above: "unlimited copying allowed" (which may be divided into two types: "unlimited copying allowed and encryption processing required during storage and output" and "unlimited copying allowed and encryption processing not required during storage and output"), "only one generation allowed", "a predetermined number of copies allowed" (for example, 9 copies allowed + 1 move allowed is the so-called "Dubbing 10"), "copy prohibited", etc.
[0275] Here, if the location information indicates the location of data that includes MPEG2-TS data transmitted in other digital broadcast signals, then that MPEG2-TS data is also broadcast in other digital broadcast signals, associated with copy control information. The question then becomes: how and according to which information should copy control of that MPEG2-TS data be performed (i.e., according to the copy control information contained in the TLV / MMT stream, or according to the copy control information contained in the MPEG2-TS data)?
[0276] In the digital broadcasting system of this embodiment, as a solution to this problem, the broadcast receiving device 100 can perform one of the following multiple solutions.
[0277] <Example of operation 1> In the first operational example, when the MPT contains copy control information and the location information includes data in the same package and event that contains MPEG2-TS data transmitted by other digital broadcast signals, the copy control state indicated by the copy control information contained in the TLV stream takes precedence over the copy control state indicated by the copy control information contained in the MPEG2-TS.
[0278] For example, if the copy control status indicated by the copy control information included in the TLV stream is "copyable for one generation" and the copy control status indicated by the copy control information included in the MPEG2-TS is "copyable for a predetermined number of times", then even if the data is acquired via a different route (digital broadcasting in MPEG2-TS transmission format) than the data acquired in the TLV stream, copy control may be applied to it as "copyable for one generation" content. For example, if the copy control status indicated by the copy control information included in the TLV stream is "copyable without limit" and the copy control status indicated by the copy control information included in the MPEG2-TS is "copyable for a predetermined number of times", then even if the data is acquired via a different route (digital broadcasting in MPEG2-TS transmission format) than the data acquired in the TLV stream, copy control may be applied to it as "copyable without limit" content.
[0279] In this operation, data acquired through routes other than the TLV stream can also be put into a copy state that the broadcast receiving device 100 of this embodiment can manage in the corresponding broadcasting system.
[0280] <Example of operation 2> In the second example of operation, if the MPT contains copy control information and the location information includes data in the same package and event that contains MPEG2-TS data transmitted by other digital broadcast signals, the copy control state indicated by the copy control information contained in the TLV stream is compared with the copy control state indicated by the copy control information contained in the MPEG2-TS. If the copy control state indicated by the copy control information contained in the MPEG2-TS is stricter than the copy control state indicated by the copy control information contained in the TLV stream, the system operates to exclude the MPEG2-TS data from the content to be processed when performing storage processing in the storage unit 110, recording processing on a removable recording medium, or output processing from the digital interface.
[0281] In this operation, for data acquired via a path other than the TLV stream, the duplication of copy control states on the broadcast receiving device 100 of this embodiment can be resolved while respecting the original copy control information set in the broadcasting system that transmits the data.
[0282] Furthermore, if the results of this comparison show that the copy control status indicated by the copy control information contained in the MPEG2-TS is the same as, or less restrictive than, the copy control status indicated by the copy control information contained in the TLV stream, then copy control should be applied to the MPEG2-TS data contained in the same package and event at the same location information, as if it were content with the copy control status indicated by the copy control information contained in the TLV stream.
[0283] In this operation, for data acquired via a path other than the TLV stream, the duplication of copy control states on the broadcast receiving device 100 of this embodiment can be resolved while respecting the original copy control information set in the broadcasting system that transmits the data.
[0284] In the above description, the copyright protection function of the broadcast receiving device 100 in this embodiment was described as being performed based on copy control information included in the MPT. However, the table in which copy control information is placed is not limited to the MPT. In addition to the MPT, the information may be placed and transmitted in the MH-Service Description Table (MH-SDT) or MH-Event Information Table (MH-EIT) described in Figure 6B, or in other tables, and the broadcast receiving device 100 may perform copyright protection processing according to these.
[0285] According to the embodiment described above, a broadcast receiver compatible with MMT digital broadcasting can be provided. (Example 2)
[0286] The following describes Embodiment 2 of the present invention. Unless otherwise specified, the configuration, processing, and effects in this embodiment are the same as those in Embodiment 1. Therefore, the following description will mainly focus on the differences between this embodiment and Embodiment 1, and will omit explanations of common points as much as possible to avoid duplication. Furthermore, the broadcast receiving device in this embodiment is assumed to be a television receiver that supports both the MMT and MPEG2-TS media transport methods, and the following description will proceed accordingly.
[0287] [Hardware configuration of broadcast receiving equipment] Figure 24 is a block diagram showing an example of the internal configuration of the broadcast receiving device 800. The broadcast receiving device 800 consists of a main control unit 801, a system bus 802, a ROM 803, a RAM 804, a storage unit 810, a LAN communication unit 821, an expansion interface unit 824, a digital interface unit 825, a first tuner / demodulation unit 831, a second tuner / demodulation unit 832, an MMT decoding processing unit 841, an MPEG2-TS decoding processing unit 842, a video synthesis unit 861, a monitor unit 862, a video output unit 863, a sound synthesis unit 864, a speaker unit 865, a sound output unit 866, and an operation input unit 870.
[0288] The main control unit 801, system bus 802, ROM 803, RAM 804, storage unit 810, expansion interface unit 824, digital interface unit 825, monitor unit 862, video output unit 863, speaker unit 865, audio output unit 866, operation input unit 870, etc., have the same functions as the main control unit 101, system bus 102, ROM 103, RAM 104, storage unit 110, expansion interface unit 124, digital interface unit 125, monitor unit 162, video output unit 163, speaker unit 165, audio output unit 166, operation input unit 170, etc., in the broadcast receiving device 100 of Embodiment 1, and a detailed explanation is omitted.
[0289] The first tuner / demodulator 831 receives broadcast waves from a broadcast service employing MMT as the media transport method via an antenna (not shown) and tunes (selects) to the channel of the service desired by the user based on the control of the main control unit 801. Furthermore, the first tuner / demodulator 831 demodulates the received broadcast signal to obtain an MMT data sequence and outputs it to the MMT decoding processing unit 841. The second tuner / demodulator 832 receives broadcast waves from a broadcast service employing MPEG2-TS as the media transport method via an antenna (not shown) and tunes (selects) to the channel of the service desired by the user based on the control of the main control unit 801. Furthermore, the second tuner / demodulator 832 demodulates the received broadcast signal to obtain an MPEG2-TS data sequence and outputs it to the MPEG2-TS decoding processing unit 842.
[0290] The MMT decoding processing unit 841 receives the MMT data sequence output from the first tuner / demodulation unit 831 and performs separation and decoding processes for real-time presentation elements such as video data sequences, audio data sequences, character superimposition data sequences, and subtitle data sequences based on the control signals contained in the MMT data sequence. The MMT decoding processing unit 841 has functions equivalent to the separation unit 132, video decoder 141, video color gamut conversion unit 142, audio decoder 143, character superimposition decoder 144, subtitle decoder 145, subtitle synthesis unit 146, subtitle color gamut conversion unit 147, data decoder 151, cache unit 152, application control unit 153, browser unit 154, application color gamut conversion unit 155, sound source unit 156, etc., in the broadcast receiving device 100 of Embodiment 1.
[0291] The MPEG2-TS decoding processing unit 842 receives the MPEG2-TS data sequence output from the second tuner / demodulation unit 832 and performs separation and decoding processes for real-time presentation elements such as video data sequences, audio data sequences, character superimposition data sequences, and subtitle data sequences based on the control signals contained in the MPEG2-TS data sequence. The MPEG2-TS decoding processing unit 842 has the same functionality as the IRD (Integrated Receiver Decoder) unit of a conventional television receiver that receives broadcast waves of broadcast services employing MPEG2-TS as the media transport method, and a detailed explanation is omitted.
[0292] The video synthesis unit 861 receives video information, subtitle information, and application information output from the MMT decoding processing unit 841, and video information, subtitle information, and application information output from the MPEG2-TS decoding processing unit 842, and performs appropriate selection and / or superposition processing. The video synthesis unit 861 is equipped with video RAM (not shown), and the monitor unit 862, etc., are driven based on the video information, etc., input to the video RAM. The video synthesis unit 861 also performs scaling processing, EPG screen information superposition processing, etc., as needed, based on the control of the main control unit 801. The audio synthesis unit 164 receives audio information output from the MMT decoding processing unit 841 and audio information output from the MPEG2-TS decoding processing unit 842, and performs appropriate selection and / or mix processing.
[0293] The LAN communication unit 821 is connected to the Internet 200 via the router device 200r and transmits and receives data with various server devices and other communication devices on the Internet 200. It also acquires the MMT data sequence (or a part thereof) and the MPEG2-TS data sequence (or a part thereof) of the program transmitted via the communication line and outputs them to the MMT decoding processing unit 841 and the MPEG2-TS decoding processing unit 842 as appropriate.
[0294] [Time display on broadcast receiving device] In this embodiment, the broadcast receiving device 800 is capable of displaying the current date and time on the EPG screen and various setting screens. The information regarding the current date and time is transmitted via MH-TOT, etc., in broadcast services that employ MMT as the media transport method, and via TOT (Time Offset Table), etc., provided by the SI (Service Information) specified in the MPEG-2 system, in broadcast services that employ MPEG2-TS as the media transport method. The broadcast receiving device 800 can acquire the information regarding the current date and time by referring to the MH-TOT or TOT.
[0295] Furthermore, generally speaking, if the video synthesis unit 861 primarily selects video information output from the MMT decoding processing unit 841, it is sufficient to control it to superimpose the current date and time information obtained from the MH-TOT onto the video information, and if the video synthesis unit 861 primarily selects video information output from the MPEG2-TS decoding processing unit 842, it is sufficient to control it to superimpose the current date and time information obtained from the TOT onto the video information.
[0296] However, there are differences in encoding / decoding processes and transmission paths between broadcast services that employ MMT as the media transport method and those that employ MPEG2-TS as the media transport method. Therefore, inconsistencies may occur, particularly in the display of the current time, when selecting a broadcast service that employs MMT as the media transport method versus a broadcast service that employs MPEG2-TS as the media transport method. For example, as shown in Figure 25, when switching the screen display from EPG screen 162g, which displays channel information for a broadcast service that employs MMT as the media transport method, to EPG screen 162h, which displays channel information for a broadcast service that employs MPEG2-TS as the media transport method, the display of the current time changes from current time display 162g1 to current time display 162h1, which may cause users to experience a visual sense of unease.
[0297] In the broadcast receiving device 800 of this embodiment, in order to prevent the user from experiencing visual discomfort, even when the video synthesis unit 861 primarily selects video information output from the MMT decoding processing unit 841, it is controlled to superimpose information regarding the current date and time obtained from the TOT onto the video information. That is, it is controlled to superimpose current time information provided by a broadcast service using MPEG2-TS as the media transport method onto the content of a broadcast service using MMT as the media transport method.
[0298] By performing the aforementioned control, the broadcast receiving device 800 of this embodiment will always display current time information obtained by referring to the TOT when displaying the current time. Therefore, even when switching between a broadcast service employing MMT as the media transport method and a broadcast service employing MPEG2-TS as the media transport method, it is possible to prevent users from experiencing visual discomfort due to inconsistencies in the display of the current time.
[0299] Figure 26A shows an example of the selection control of the current time information source according to the reception status of each broadcast service in the broadcast receiving device 800 of this embodiment. In the broadcast receiving device 800 of this embodiment, when it is possible to receive a broadcast service that employs MPEG2-TS as the media transport method, it is always controlled to obtain the current time information by referring to the TOT, and only when it is not possible to receive a broadcast service that employs MPEG2-TS as the media transport method, and when it is possible to receive a broadcast service that employs MMT as the media transport method, it is controlled to obtain the current time information by referring to the MH-TOT.
[0300] Conversely to the control described above, the same effect can be obtained by controlling the system to superimpose current time information provided by a broadcasting service using MMT as the media transport method onto the content of a broadcasting service using MPEG2-TS as the media transport method.
[0301] As mentioned above, in both cases—when controlling the system to superimpose current time information provided by a broadcasting service using MPEG2-TS as the media transport method onto content from a broadcasting service using MMT as the media transport method, and when controlling the system to superimpose current time information provided by a broadcasting service using MMT as the media transport method onto content from a broadcasting service using MPEG2-TS as the media transport method—it is possible to correct the current time information by referring to the 'delta' parameter of the time information in the TMCC extended information area, similar to the explanation in [Time Management of Broadcasting Receiving Device] in Example 1.
[0302] Furthermore, in both cases—whether a broadcast service employs MMT as its media transport method or a broadcast service employing MPEG2-TS as its media transport method—there is a possibility that the MH-TOT or TOT transmitted by each broadcast service constituting the network may contain errors due to malfunctions or transmission errors in the transmitting system. In this embodiment, the broadcast receiving device 800 has a function to update the time information of its built-in clock by obtaining an MH-TOT or TOT from another broadcast service on the same network, or from any broadcast service on another network, and referring to the current time information, as a countermeasure against such errors in the MH-TOT or TOT.
[0303] Figure 26B shows an example of the current time information update process in the broadcast receiving device 800 of this embodiment when receiving a broadcast service that employs MPEG2-TS as the media transport method. Note that the same process as shown in the figure is also possible when receiving a broadcast service that employs MMT as the media transport method.
[0304] In the broadcast receiving device 800 of this embodiment, when updating the time information of the built-in clock, first, the receiving function execution unit 1102 obtains the TOT from the MPEG2-TS data sequence of the broadcast service currently being received (a broadcast service employing MPEG2-TS as the media transport method) (S301), and then obtains the current time information by referring to the obtained TOT (S302). Next, the receiving function execution unit 1102 performs a process to compare the current time information obtained in the S302 process with the time information of the built-in clock.
[0305] If, as a result of the comparison process, the difference between the current time information obtained in the S302 process and the internal clock time information is within a predetermined value (for example, within 3 minutes) (S303: Yes), the receiving function execution unit 1102 updates the internal clock time information using the current time information obtained in the S302 process (S306). On the other hand, if, as a result of the comparison process, the difference between the current time information obtained in the S302 process and the internal clock time information is not within a predetermined value (S303: No), or if the TOT obtained in S301 has a flag indicating that there is an error in the data, the receiving function execution unit 1102 obtains a TOT from the MPEG2-TS data sequence of another broadcasting service within the same network, or obtains an MH-TOT from the MMT data sequence of any broadcasting service on another network (a broadcasting service that employs MMT as the media transport method) (S304), and further obtains the current time information from the obtained TOT or MH-TOT (S305). The receiving function execution unit 1102 can then perform the comparison process in S303 again using the current time information obtained in the S305 process.
[0306] Through the above process, if the broadcast receiving device 800 of this embodiment determines that the MH-TOT or TOT obtained from the service being received is incorrect, it can obtain the MH-TOT or TOT from another broadcasting service on the same network, or from any broadcasting service on another network, and refer to the current time information to perform the time information update process for the built-in clock.
[0307] Furthermore, if, during initial setup after factory shipment, the current time information that falls within a predetermined range from the internal clock's time information cannot be obtained through repeated processing of S304 to S305, the internal clock's time information can be reset using the current time information obtained in processing S302. In this way, it is possible to handle cases where there is an error in the internal clock's time information of the broadcast receiving device 800 in this embodiment.
[0308] [EPG display on broadcast receiving device] Event schedule information for broadcast services employing MMT as the media transport method is transmitted via MH-EIT, etc. On the other hand, event schedule information for broadcast services employing MPEG2-TS as the media transport method is transmitted via EIT (Event Information Table), etc., provided by the SI specified in the MPEG-2 system. Therefore, generally speaking, when displaying video information, etc., provided by a broadcast service employing MMT as the media transport method, the event schedule information (MH-EIT) of the broadcast service employing MMT can be obtained, and when displaying video information, etc., provided by a broadcast service employing MPEG2-TS as the media transport method, the event schedule information (EIT) of the broadcast service employing MPEG2-TS can be obtained.
[0309] However, the broadcast receiving device 800 of this embodiment is capable of acquiring both the MH-EIT and the EIT, whether it is displaying video information provided by a broadcast service that employs MMT as the media transport method, or whether it is displaying video information provided by a broadcast service that employs MPEG2-TS as the media transport method, thereby improving usability for the user.
[0310] Figure 27A shows an example of an EPG screen in the broadcast receiving device 800 of this embodiment. In the figure, EPG screen 162i is an EPG screen created based on the MH-EIT of a broadcast service that employs MMT as the media transport method, and 'M1 TV', 'M2 Broadcast', 'M3 Channel', 'M4 TV', 'TV M5', etc. are the names of broadcasting stations of broadcasting services that employ MMT as the media transport method. EPG screen 162j is an EPG screen created based on the EIT of a broadcasting service that employs MPEG2-TS as the media transport method, and 'T6 TV', 'T7 Broadcast', 'T8 Channel', 'T9 TV', 'TV TA', etc. are the names of broadcasting stations of broadcasting services that employ MPEG2-TS as the media transport method.
[0311] For example, when a user is watching a broadcast program provided by a broadcast service that employs MMT as the media transport method, and operates a remote control (not shown) to instruct it to display the EPG screen, the initial EPG screen (not shown) is displayed. The initial EPG screen is an EPG screen created based on MH-EIT of a broadcast service that employs MMT as the media transport method, and displays detailed information about broadcast programs on each channel from 17:00 (around the current time) on October 7, 2014 (today). Next, if the user wishes to check the detailed information about broadcast programs on each channel from 20:00 on October 9, 2014, and operates a remote control (not shown) to instruct it to update the EPG screen, EPG screen 162i is displayed.
[0312] Furthermore, if a user wishes to check detailed information about broadcast programs provided by a broadcast service that employs MPEG2-TS as the media transport method, and instructs the network to switch using a remote control (not shown in the diagram), the EPG screen 162j will be displayed. In this case, the broadcast receiving device 800 of this embodiment is controlled to display detailed information about broadcast programs for each channel at the same time and date as the previously displayed EPG screen 162i (i.e., from 8 PM on October 9, 2014), rather than the initial EPG screen created based on the EIT of a broadcast service employing MPEG2-TS as the media transport method (i.e., detailed information about broadcast programs for each channel from 5 PM on October 7, 2014).
[0313] The aforementioned control allows users to easily and continuously check detailed information about broadcast programs on multiple networks using different media transport systems at the same time on the same day. In other words, the usability of the broadcast receiving device 800 is improved.
[0314] Figure 27B shows a different example of the EPG screen in the broadcast receiving device 800 of this embodiment. EPG screen 162k shows the state after scrolling in the channel direction (horizontally) from the state in which EPG screen 162i shown in Figure 27A is displayed, by operating a remote control (not shown). That is, in the example shown in Figure 27B, by scrolling the EPG screen in the channel direction (horizontally), channel information created based on MH-EIT of broadcast services employing MMT as the media transport method and channel information created based on EIT of broadcast services employing MPEG2-TS as the media transport method are seamlessly displayed on the same time axis.
[0315] Therefore, even if a user wishes to check channel information created based on the EIT of a broadcasting service using MPEG2-TS as the media transport method while checking channel information created based on the MH-EIT of a broadcasting service using MMT as the media transport method, it is not necessary to instruct the user to switch networks using the remote control (not shown in the diagram). Furthermore, the user can simultaneously check detailed information about broadcast programs on multiple networks with different media transport methods for the same day and time. In other words, the usability of the broadcasting receiver 800 is improved. (Example 3)
[0316] The following describes Embodiment 3 of the present invention. Unless otherwise specified, the configuration and effects in this embodiment are the same as those in Embodiments 1 and 2. Therefore, the following will mainly describe the differences between this embodiment and Embodiments 1 and 2, and will omit explanations of common points as much as possible to avoid duplication. In this embodiment, the handling of presentation area information set by the layout setting table (LCT) shown in Figure 18 will be described.
[0317] [Hardware configuration of broadcast receiving equipment] The hardware configuration of the broadcast receiving device 100 is the same as in Example 1, so the explanation will be omitted.
[0318] [Program Standard Structure] Figure 28 shows the structure of the program data. The program data consists of information (assets 30003) to be presented to the broadcast receiving device 100, such as video, audio, and program linkage information, and control information. The program linkage information includes text information, graphic information, image information, or video information to be presented in accordance with the program video. Figure 28 shows the PA message 30000, which contains the information on how to present assets 30003 and the acquisition location information. The acquisition location of assets 30003 is described as MMT_general_location_info (Figure 31) in the MP table (MPT) 30001 (Figure 17) within the PA message 30000 (Figure 30). In addition, a layout setting table (LCT) 30100 (Figure 18) is placed within the PA message 30000 to describe the layout of the area where each asset 30003 should be presented. Examples of the layout of the presentation area are shown in Figures 19A to 19D.
[0319] Within PA message 30000, a package list table (PLT) 30002 (Figure 32) is placed, and the MMT_general_location_info (Figure 31) within the PLT can specify the retrieval location for another PA message 30000. By specifying the retrieval location for PA message 30000, a hierarchical structure of PA messages 30000 can be created. Figure 33 shows the location types of the retrieval locations for PA message 30000 and asset 30003.
[0320] Normally, the hierarchical structure of PA message 30000 is limited to two levels, as shown in Figure 28. However, it is also possible to increase the number of levels by placing a PLT30002 in the second level of PA message 30000.
[0321] Since an asset is composed of Media Processing Units (MPUs) that serve as processing units (Figure 29), the presentation area of asset 30003 is specified by specifying the presentation area of the MPU in the MPU presentation area specification descriptor (Figure 34). The MPU presentation area specification descriptor is placed in the asset descriptor area of the MPT. Since the presentation area is specified for each MPU, it is also possible to change the presentation area of the same asset 30003 during presentation. Furthermore, in order to reduce the amount of data, it is also possible to control the presentation by not specifying the presentation area for all MPUs belonging to the asset, but only specifying the presentation area for the first MPU and the first MPU of the group of MPUs whose presentation area is to be changed.
[0322] [Example of asset presentation functionality] <Example of operation 1> The broadcast receiving device 100 acquires presentation area information by reading the LCT 30100. Figure 16 shows the flow of how the broadcast receiving device 100 acquires program control information as an example during channel switching. Like the MPT 30001, the LCT 30100 is placed and transmitted within an MMTP packet. Since the MPT 30001 contains information specifying the presentation area of asset 30003, it is preferable that the LCT 30100 is acquired before the MPT 30001. As shown in Figure 16, it is preferable that it is acquired as a step between S209 and S210 and between S214 and S215. Even if acquisition at the above timing is not possible, it is equally preferable if the LCT can be acquired before S216.
[0323] LCT30100 is placed within PA message 30000, but for LCT30100 related to asset 30003 corresponding to a second-level PA message, it is placed within either the first-level PA message 30000 or the second-level PA message 30000. When presenting asset 30003, the presentation area information of the LCT30100 placed within the PA message 30000 to which the asset 30003 belongs is used preferentially. If LCT30100 is not placed within the PA message 30100 to which it belongs, the presentation area information of the LCT30100 placed within the higher-level PA message 30100 is used.
[0324] By using the method described in this example, if the same LCT30100 is used throughout the entire program data shown in Figure 28, placing a common LCT30100 within the first-level PA message 30000 allows for early acquisition of the presentation area information, enabling prompt presentation of the program data.
[0325] <Example of operation 2> If LCT30100 is not included in the MMTP packet, the previously acquired LCT30100 presentation area information is used. In other words, the broadcast receiver stores the LCT30100 presentation area information and updates it each time a new LCT30100 is acquired.
[0326] However, immediately after an event occurs that invalidates the previously used display area information, such as when the power is turned on or when the channel is changed, there is no valid display area information yet. Therefore, even if the video and audio data of the program has been acquired, it may not be possible to display that data. For this reason, until valid display area information is acquired, the display process is performed assuming that a temporary display area, such as the one shown in Figure 19A, is set. The setting in Figure 19A will be referred to as the default setting below. The display area shown in the default setting (Figure 19A) is set as a full-screen display area for the device with device_id 0, i.e., the main device, and the layout_number is set to 0, region_number to 0, and layer_order to 0.
[0327] Figure 35A shows the state where only the main asset 30201 is presented using temporary presentation area information, while Figure 35B shows the state after acquiring LCT 30100, presenting the program according to its original presentation area information, including sub-asset 30202. When using temporary presentation area information, the presentation area specification for the main asset is ignored, and the area with layout_number 0 and region_number 0 is assumed to be specified, and other assets are not presented. Here, the main asset refers to the asset that specifies region_number 0 for the main device, or an asset that specifies region_number 0 for an asset transmitted via broadcast waves, and a sub-asset refers to any other asset.
[0328] By setting temporary display area information in this way, it becomes possible to perform at least the main asset display process even before the LCT30100 information is loaded.
[0329] <Example of operation 3> In example 2, when changing channels, the system uses the default display area information to display only the main asset until a new LCT30100 is acquired. However, it is also acceptable to use the LCT30100 that was used for the previously viewed program. The system will display the asset (main asset) specified as region_number 0 in the region of the program after the channel change in the region where region_number 0 of the previously used display area information was 0, and will not display any other assets (sub-assets).
[0330] After obtaining the LCT30100 for the program after the channel change, all assets are presented using its display area information. If the LCT30100 used for the previously viewed program divides the display area as shown in Figure 19B, the process in Operation Example 2 is performed. If the LCT30100 used for the previously viewed program displays an overlay as shown in Figure 19C, the process in Operation Example 3 is performed. Furthermore, if the LCT30100 used for the previously viewed program has an area with region_number 1 or later, a predetermined pattern or message may be displayed in that area.
[0331] By using the presentation area information of the program that was previously being watched, it becomes possible to perform at least the main asset presentation process even before the LCT30100 information is loaded.
[0332] <Example of operation 4> Since it is sometimes necessary to return to the original channel after changing channels, it is also possible to store the information of the LCT30100 that has been read once, associating it with the channel information, and then use the stored display area information when the channel is returned to its original position. Furthermore, if the most recent LCT30100 is stored for all channels that can be received by the broadcast receiving device 100, the convenience of controlling the display area when changing channels will be improved.
[0333] Furthermore, since the display area information may be changed even in the middle of a program, an expiration date is set for the LCT30100. If the expiration date has passed when the channel is switched back, the display area information will not be used. Instead, the default settings will be used as shown in Operation Example 2 or Operation Example 3, or only the main assets will be displayed using the display area information of the program that was previously being watched. Alternatively, only the main assets may be displayed using the expired display area information for that channel. Of course, after obtaining a new LCT30100, the normal display method will be returned. Note that the above control may be performed by referring to the expiration date, but it may also be performed by referring to the version instead of the expiration date information.
[0334] Figure 36A shows an example of setting an expiration date for the LCT30100. The expiration date is set in NTP length format (ending_time) within the LCT expiration descriptor. The descriptor is placed in the descriptor area of the LCT30100 (Figure 18).
[0335] Alternatively, you may set an expiration date for each layout, as shown in Figure 36B as a layout expiration date descriptor.
[0336] Alternatively, an expiration date can be set for each region, as shown in Figure 36C as a region expiration date descriptor.
[0337] You can set expiration dates at a single level or at multiple levels. When setting expiration dates at multiple levels, the earliest expiration date will take precedence for each area.
[0338] This method allows for the effective use of presentation area information, once acquired, while taking its expiration date into consideration.
[0339] <Example of operation 5> In Operation Example 4, the display area information of a program that was loaded was stored, but it is also possible to prepare display area information (common display area information) that is used in common for multiple programs within a channel for each channel, acquire that common display area information in advance with the broadcast receiving device 100, and then use that common display area information for each program.
[0340] The broadcast receiver 100 acquires the common presentation area information in LCT (Figure 18) format beforehand. To indicate that it is common presentation area information, the common presentation area descriptor shown in Figure 37 is used. This descriptor is placed in the descriptor area of the LCT (Figure 18), and the layout numbers of the common presentation areas are listed along with the device numbers. The service_id represents the broadcast channel. Furthermore, the start time (beginning_time) and end time (ending_time) of the validity period of the common presentation area information are written in NTP length format. In addition, a full_set_flag is written so that it can be confirmed that all information is available when updating the information. The meaning of full_set_flag is summarized in Figure 38.
[0341] This common display area information can be read at regular intervals, such as once a day or once a week, for example, during times outside of broadcast hours. It can also be obtained from broadcast waves or via the internet.
[0342] Furthermore, in case the common display area information has not been loaded, the program data will transmit the common display area information used in that program as LCT30100. In this case, the full_set_flag in the common display area descriptor will indicate that it is only a part of the common display area information.
[0343] By utilizing this common presentation area information, asset 30003 can be promptly presented even immediately after powering on the broadcast receiving device 100 or immediately after switching programs, before LCT 30100 is acquired.
[0344] <Example of operation 6> In Operation Example 5, a method for using common presentation area information was demonstrated. However, even if the common presentation area information is transmitted via broadcast waves or the Internet, some programs may use presentation areas with layouts not described in the common presentation area information.
[0345] Specifically, the LCT30100 for the program in question should contain layout information that is not included in the common display area information. In this case, the layout number of the common display area will be recorded in the common display area descriptor (Figure 37), so the broadcast receiving device 100 will determine whether or not there is additional display area information in the LCT30100 that is not part of the common display area, and if so, it will use that information. In this case, if the layout number and area number of the display area overlap with the common display area information, it will be predetermined which information to prioritize. That is, depending on the broadcasting system, the broadcast receiving device 100 may be configured to prioritize the common display area information. Alternatively, depending on the broadcasting system, the broadcast receiving device 100 may be configured to prioritize the program-specific display area information.
[0346] Furthermore, if a common presentation area descriptor (Figure 37) is not placed in LCT30100, all presentation area information described in LCT30100 will be treated as if it were specified that it is not common area information.
[0347] This additional information specific to each program may be obtained from the broadcast signal, but it may also be obtained via the internet instead.
[0348] This method allows for the use of commonly shared presentation area information while also utilizing presentation area information optimized for each program.
[0349] <Example of operation 7> Asset 30003 should be displayed in a single display area, but if it's better to display it on as many devices as possible, such as in breaking news, then it's best to display the same content on all devices that are available at that time.
[0350] Specifically, in the duplicate display area specification descriptor (Figure 39), the layout_number is specified in the layout settings of the main device (device with Device_id 0) so that the same area settings are applied to other devices as well. This descriptor is placed in the descriptor area of LCT30100 (Figure 18).
[0351] Figure 40 shows an example where the same screen content is displayed on a sub-device (portable information terminal 700) in addition to the main device (broadcast receiving device 100).
[0352] Furthermore, to ensure the program returns to its original format after the breaking news segment, the information displayed in the original program's presentation area can be stored and used again after the breaking news segment ends.
[0353] This method increases awareness of urgent and important information.
[0354] <Example of operation 8> The display area for each asset 30003 is specified by the layout_number and region_number in the MPU display area descriptor (Figure 34). If there is no display area information corresponding to this layout number and region number, the asset 30003 cannot be displayed and will not be shown. However, if the faulty asset 30003 is displayed in only a portion of the screen, it may not be immediately apparent that there is a display error. Therefore, if an asset 30003 cannot be displayed, an error message like that shown in Figure 41 is displayed.
[0355] This method allows viewers to recognize that the display is not working correctly.
[0356] <Example of operation 9> In Operation Example 8, we explained the operation when a display area without display area information is specified, but this section explains the operation when different assets 30003 specify the same display area. In the case of assets that display some kind of content, they cannot be displayed in the same display area, so different assets 30003 should not specify the same display area at the same time. If they are specified at the same time, the asset transmitted by broadcast waves will take precedence. Alternatively, the display of asset 30003 that was using that layout number and area number first will continue, and the display of asset 30003 specified later will be prohibited. Alternatively, the display of all assets 30003 with overlapping area specifications will be prohibited. If an asset 30003 that cannot be displayed occurs, an error message like that shown in Figure 41 may be displayed.
[0357] However, it is possible to specify the same display area for different assets 30003, for example, when adding information from additional assets to a video asset to enhance its gradation. Dependency descriptor information is used to indicate that multiple assets have a complementary relationship, such that they constitute a single piece of content. The data structure of the dependency descriptor is shown in Figure 42. If this dependency exists, display is permitted even if the same display area is specified.
[0358] To manage the display area specifications for asset 30003, a management table can be used that shows which asset 30003 specifies which display area. Figure 43 shows an example of a management table. Assets 30003 with asset IDs 1 and 3, and asset IDs 2 and 4 have dependencies, so display is allowed even if they specify the same area. On the other hand, asset 30003 with asset ID 7 is a video asset, has no dependencies, and specifies the same area as asset ID 0, so display is prohibited.
[0359] Asset ID 1, asset 30003 is transmitted via broadcast waves, so it will be given priority. Also, asset ID 8, asset 30003 is likely the audio corresponding to asset ID 7, since asset ID 7, which was acquired from the same source, has been deemed unavailable for display, so it will also be deemed unavailable for display. Furthermore, assets IDs 2, 4, 6, and 8 are audio assets, and since audio assets are not directly related to the display process in the monitor unit 162, it is not necessarily required to manage them in the management table. In other words, it is also possible to manage only video assets in the management table.
[0360] By controlling the presentation in this way, it is possible to prevent abnormal presentations from occurring when there is an inconsistency in the control information.
[0361] <Example of operation 10> The dependencies of asset 30003 can be parallel relationships, where the content cannot be completed unless multiple dependent asset 30003s are available, or dependent relationships, such as when data for image enhancement is provided to a primary asset 30003 by another asset 30003. A primary asset 30003 can be presented independently, but a dependent asset 30003 is likely to fail to present if the primary asset 30003 is not present. Therefore, if the dependent asset 30003 cannot be obtained, the presentation of the dependent asset 30003 is prohibited. It is also permissible to have a multi-layered structure where one dependent asset 30003 is further dependent on another asset 30003.
[0362] To specify a dependency relationship, it is necessary to decide in advance whether the asset 30003 described in the dependency descriptor (Figure 42) refers to the dependent asset 30003 or to the asset 30003 that is dependent on that asset. In the case of parallel assets 30003, the dependency descriptor (Figure 42) is placed assuming that both depend on the other.
[0363] Another way to specify dependencies is to explicitly indicate them in the dependency descriptor (Figure 42). A dependency descriptor with explicitly indicated dependencies is shown in Figure 44. A parameter called `dependency_type` is specified to indicate the type of dependency for the dependent asset. The meaning of `dependency_type` is shown in Figure 45. 0 indicates that it is dependent on the other asset, and 1 indicates that it is dependent on the other asset. In the case of a parallel relationship, each asset is specified as being dependent on the other asset.
[0364] Figure 46 shows an example of a management table for allowing / prohibiting presentation. Assets with IDs 3 and 4 are dependent on assets with IDs 1 and 2, but since assets with IDs 1 and 2 have been acquired, presentation is permitted. On the other hand, assets with IDs 9 and 10 are prohibited from being presented because their dependent assets with IDs 7 and 8 have not been acquired.
[0365] Assets ID11 and ID12 are interdependent, but since both are available, their presentation is permitted. On the other hand, assets ID13 and ID14 are also interdependent, but since asset ID14 has not been obtained, the presentation of asset ID13 is prohibited. If asset 30003 cannot be presented, an error message like that shown in Figure 41 may be displayed.
[0366] By controlling the presentation while considering the dependency relationships in this way, it is possible to prevent abnormal presentations from occurring when there are inconsistencies in the control information.
[0367] <Example of operation 11> The broadcast receiving device 100 can display both assets 30003 acquired from the broadcast wave and assets 30003 acquired from the communication line (Internet). However, depending on the state of the communication line, it may not be possible to acquire assets 30003 via the communication line, or the broadcast receiving device 100 may not be connected to the communication line at all. Therefore, normally, the default setting (Figure 19A) is used to display only the broadcast video from the broadcast wave in full screen, and when assets 30003 are acquired via the communication line, the assets 30003 are displayed in the area specified according to the settings of the LCT 30100.
[0368] For example, let's consider a scenario where the LCT30100's area settings are as shown in Figure 19B, with the broadcast video set to be displayed in area 0 and the asset 30003 via the communication line set to be displayed in areas 1 and 2. If only the broadcast video is received, the default setting (Figure 19A) is used to display the broadcast video in full screen. Once the asset 30003 via the communication line becomes available, the LCT30100's area settings are used to display the broadcast video in area 0 of Figure 19B and the asset 30003 via the communication line in areas 1 and 2. In this case, the LCT30100 does not transmit via the broadcast wave, but rather transmits along with the asset 30003 via the communication line. By using the method in this example, it becomes possible to display data according to the actual reception status of the program data. Note that if only one of the assets 30003 via the communication line has been acquired and the other has not, the default setting (Figure 19A) can be used. It is desirable to control the system so that it transitions to the area setting shown in Figure 19B once all assets 30003 have been received via both communication lines.
[0369] Although examples of embodiments of the present invention have been described above using Examples 1 to 3, the configurations that realize the technology of the present invention are not limited to the above examples, and various modifications are conceivable. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these fall within the scope of the present invention. Furthermore, the numbers and messages that appear in the text and figures are merely examples, and using different ones will not impair the effects of the present invention.
[0370] The functions and features of the present invention described above may be implemented in hardware, in whole or in part, for example, by designing them using an integrated circuit. Alternatively, they may be implemented in software by having a microprocessor unit or the like interpret and execute an operating program that implements each of these functions. Hardware and software may also be used in combination.
[0371] The software that controls the broadcast receiving device 100 may be pre-stored in the ROM 103 and / or storage unit 110 of the broadcast receiving device 100 at the time of product shipment. Alternatively, it may be acquired after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 121. Furthermore, the software stored on a memory card or optical disc may be acquired via the expansion interface unit 124.
[0372] Furthermore, the control lines and information lines shown in the diagram are those deemed necessary for explanation and do not necessarily represent all control lines and information lines on the product. In reality, it is safe to assume that almost all components are interconnected. [Explanation of symbols]
[0373] 100,800…Broadcast receiving device, 100a…Antenna, 101,801…Main control unit, 102,802…System bus, 103,803…ROM, 104,804…RAM, 110,810…Storage unit, 121,821…LAN communication unit, 124,824…Expansion interface unit, 125,825…Digital interface unit, 131,831,832…Tuner / demodulation unit, 132…Separation unit, 141…Video decoder, 142…Video color gamut conversion unit, 143…Audio decoder, 144…Character super decoder, 145…Subtitle decoder, 146…Subtitle synthesis unit, 147…Subtitle color gamut conversion unit, 151…Data decoder, 152…Cache unit, 153…Application control unit, 154…Browser 155...Application color gamut conversion unit, 156...Sound source unit, 161,861...Video synthesis unit, 162,862...Monitor unit, 163,863...Video output unit, 164,864...Speech synthesis unit, 165,865...Speaker unit, 166,866...Speech output unit, 170,870...Operation input unit, 841...MMT decoding processing unit, 842...MPEG2-TS decoding processing unit, 200...Internet, 200r...Router device, 200a...Access point, 300t...Radio tower, 300s...Broadcasting satellite (or communication satellite), 300...Broadcasting station server, 400...Service provider server, 500...Other application server, 600...Mobile telephone communication server, 600b...Base station, 700...Personal information terminal.
Claims
[Claim 1] A content protection processing method in a broadcast receiving device of a transmission system that transmits broadcast program content from a broadcasting station and receives the broadcast program content at the broadcast receiving device, A receiving step of receiving the aforementioned broadcast program content, A storage step for storing the broadcast program content received in the reception step, An output step for outputting the broadcast program content stored in the storage step to an external device, Equipped with, In the storage step, if the broadcast program content received in the reception step is content that is transmitted in the transmission system with the specification that it can be copied without restriction and protected by encryption, the broadcast program content received in the reception step is recorded and stored in an encrypted state so that it can be played back only by the broadcast receiving device. The storage of the broadcast program content in the storage step can be performed in a storage unit located at the output destination of an IP interface, which is configured with Ethernet-compatible hardware provided in the broadcast receiving device, and the storage of the broadcast program content in the storage unit located at the output destination of the IP interface in the storage step, in an encrypted state so that it can be played back only by the broadcast receiving device, and the output of the broadcast program content stored in the storage unit located at the output destination of the IP interface in the storage step, in an encrypted state so that it can be played back only by the broadcast receiving device, to the external device in the output step can both be performed via the same IP interface, which is configured with Ethernet-compatible hardware. In the storage step, the stored broadcast program content is recorded in the storage unit at the output destination of the IP interface in an encrypted state so that it can be played back only by the broadcast receiving device, and then the stored broadcast program content is output from the broadcast receiving device after the broadcast receiving device has finished storing it by playing it back. In the output step, the output control state to the external device via the IP interface is as follows: In the storage step, the stored broadcast program content is recorded in the storage unit at the output destination of the IP interface in an encrypted state so that it can be played back only by the broadcast receiving device, and then the stored broadcast program content is output from the broadcast receiving device after the storage is completed by playback by the broadcast receiving device. In the output step, when outputting the encrypted content to the external device via the IP interface for viewing is permitted when the IP address of the external device is within the same subnet as the IP address of the broadcast receiving device, and prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device. However, if within a predetermined period the conditions are met that the external device is connected within the same subnet as the IP address of the broadcast receiving device and is paired as a device that can be viewed even outside the same subnet as the IP address of the broadcast receiving device, then output is permitted even if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device. This is a first output control state. The storage step involves recording the stored broadcast program content in an encrypted state in the storage unit at the output destination of the IP interface so that it can be played back only by the broadcast receiving device, and then, when the stored broadcast program content is output from the broadcast receiving device after the broadcast receiving device has finished storing it by playing it back, the output step involves copying the encrypted content to the external device via the IP interface, and includes a second output control state which allows the copy when the IP address of the external device is within the same subnet as the IP address of the broadcast receiving device, and prohibits the copy when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device. Content protection processing method.