Content protection processing method
The MMT protocol enhances TV receivers with advanced content protection and synchronization, addressing the challenge of integrating broadband networks and delivering high-definition content.
Patent Information
- Application Number
- JP2025085016
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-05-21
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2035-08-12
AI Technical Summary
Existing TV receivers struggle to provide high-value-added functions, particularly in integrating broadband network environments and delivering high-definition/high-resolution content, by simply expanding data broadcast reception functions.
A content protection processing method utilizing the MMT (MPEG Media Transport) protocol for enhanced broadcast reception, incorporating MPEG-H HEVC for video coding, MPEG-4 AAC or ALS for audio coding, and advanced control information mechanisms like MMT-SI and TLV-SI to support high-definition content distribution and network integration.
Enables high-value-added TV receiver functions with improved content protection and synchronization, allowing for seamless integration of broadband network services and high-definition content delivery.
Smart Images

Figure 0007717299000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to broadcast reception technology and output video information generation technology.
Background Art
[0002] One of the extended functions of digital broadcast services is data broadcast that transmits digital data by broadcast waves and displays various information such as weather forecasts, news, and recommended programs. A large number of TV receivers capable of receiving data broadcasts are already commercially available, and a number of technologies related to data broadcast reception, including Patent Document 1 below, have been published.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In response to environmental changes related to content distribution in recent years, TV receivers are also required to have various function expansions. In particular, there are many demands for the distribution of content and cooperative applications using a broadband network environment such as the Internet, and for the high-definition / high-resolution of video content. However, it is difficult to provide a high-value-added TV receiver that can meet the above requirements by simply diverting the data broadcast reception function or the like provided in the current TV receiver, or only by expanding the functions of the data broadcast reception function or the like.
[0005] An object of the present invention is to provide a content protection processing method capable of executing a function with higher added value.
Means for Solving the Problems
[0006] As a means for solving the above problems, the technology described in the claims is used.
Advantages of the Invention
[0007] By using the technology of the present invention, it is possible to provide a content protection processing method capable of executing a function with higher added value.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2A
Figure 2B
Figure 2C
Figure 3
Figure 4
Figure 5A
Figure 5B
Figure 6A
Figure 6B
Figure 6C
Figure 6D
Figure 6E
Figure 7A
Figure 7B
Figure 7C
Figure 7D
Figure 8
Figure 9
Figure 10A
Figure 10B
Figure 11A
Figure 11B
Figure 12
Figure 13A
Figure 13B
Figure 13C
Figure 14
Figure 15A
Figure 15B
Figure 15C
Figure 15D
Figure 16
Figure 17
Figure 18
Figure 19A
Figure 19B
Figure 19C
Figure 19D
Figure 20A
Figure 20B
Figure 21
Figure 22A
Figure 22B
Figure 22C
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27A
Figure 27B
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35A
Figure 35B
Figure 36A
Figure 36B
Figure 36C
Figure 37
Figure 38
Figure 39
Figure 40
Figure 41
Figure 42
Figure 43
Figure 44
Figure 45
Figure 46
Figure 47
Figure 48
Figure 49
Figure 50
Figure 51
Figure 52
Figure 53
Figure 54
Figure 55
Figure 56
Figure 57
Figure 58
Figure 59
Figure 60
Best Mode for Carrying Out the Invention
[0009] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. (Example 1)
[0010] [System Configuration] FIG. 1 is a system configuration diagram showing an example of a broadcast communication system including the broadcast receiving apparatus of the present embodiment. The broadcast communication system of the present embodiment includes a broadcast receiving apparatus 100, an antenna 100a, a broadband network such as the Internet 200 and a router device 200r, an access point 200a, a radio tower 300t of a broadcasting station, a broadcast satellite (or communication satellite) 300s, a broadcasting station server 300, a service provider server 400, other application servers 500, a mobile phone communication server 600, a base station 600b of a mobile phone communication network, and a portable information terminal 700.
[0011] The broadcast receiving apparatus 100 receives a broadcast wave transmitted from the radio tower 300t via the broadcast satellite (or communication satellite) 300s and the antenna 100a. Alternatively, the broadcast wave transmitted from the radio tower 300t may be received directly from the antenna 100a without passing through the broadcast satellite (or communication satellite) 300s. Further, the broadcast receiving apparatus 100 can be connected to the Internet 200 via the router device 200r, and can transmit and receive data by communicating with each server device and other communication devices on the Internet 200.
[0012] The router device 200r is connected to the Internet 200 by wired communication, and is connected to the broadcast receiving apparatus 100 by wired or wireless communication and to the portable information terminal 700 by wireless communication. The wireless communication may use a method such as Wi-Fi (registered trademark). Thereby, each server device and other communication devices on the Internet 200, the broadcast receiving apparatus 100, and the portable information terminal 700 can mutually transmit and receive data via the router device 200r. Note that the communication between the broadcast receiving apparatus 100 and the portable information terminal 700 may be directly performed by a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without passing through the router device 200r.
[0013] The radio tower 300t is broadcast equipment of a broadcasting station, and transmits broadcast waves including encoded data of broadcast programs, subtitle information, other applications, general-purpose data, etc. The broadcast satellite (or communication satellite) 300s is a repeater that receives the broadcast waves transmitted from the radio tower 300t of the broadcasting station, performs frequency conversion, etc. as appropriate, and then re-transmits the broadcast waves to the antenna 100a connected to the broadcast receiving device 100. Also, assume that the broadcasting station is equipped with a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (such as video content) and metadata such as the program title, program ID, program outline, cast information, broadcast date and time, etc. of each broadcast program, and can provide the video content and each metadata to service providers based on a contract. Note that the provision of the video content and each metadata to the service provider may be performed through the API (Application Programming Interface) provided in the broadcasting station server 300.
[0014] The service provider server 400 is a server device prepared by the service provider, and is assumed to be able to provide various services in cooperation with the broadcast programs distributed from the broadcasting station. Also, the service provider server 400 stores, manages, and distributes the video content and metadata provided from the broadcasting station server 300, various contents and applications that cooperate with the broadcast programs, etc. It is also assumed to have a function of searching for and providing a list of available contents and applications in response to inquiries from a TV receiver or the like. Note that the storage, management, and distribution of the content and metadata, and the storage, management, and distribution of the application may be performed by different server devices. The broadcasting station and the service provider may be the same or different. A plurality of service provider servers 400 may be prepared for different services. Also, the functions of the service provider server 400 may be provided by the broadcasting station server 300.
[0015] The other application server 500 is a known server device that stores, manages, and distributes other general applications, operation programs, content, data, etc. There may be multiple other application servers 500 on the Internet 200.
[0016] The mobile phone communication server 600 is connected to the Internet 200 and, on the other hand, is connected to the mobile information terminal 700 via the base station 600b. The mobile phone communication server 600 manages telephone communication (call) and data transmission / reception via the mobile phone communication network of the mobile information terminal 700, and enables data transmission / reception through communication between the mobile information terminal 700 and each server device and other communication devices on the Internet 200. The communication between the base station 600b and the mobile information terminal 700 may be performed by a W-CDMA (Wideband Code Division Multiple Access) (registered trademark) method, a GSM (Global System for Mobile communications) (registered trademark) method, an LTE (Long Term Evolution) method, or other communication methods.
[0017] The mobile information terminal 700 is assumed to have functions of telephone communication (call) via a mobile phone communication network and data transmission / reception, as well as a function of wireless communication by Wi-Fi (registered trademark) or the like. The mobile information terminal 700 can be connected to the Internet 200 via a router device 200r, an access point 200a, or via a base station 600b of the mobile phone communication network and a mobile phone communication server 600, and can transmit and receive data through communication with each server device on the Internet 200 and other communication devices. The access point 200a is connected to the Internet 200 by wired communication and is connected to the mobile information terminal 700 by wireless communication. The wireless communication may use a method such as Wi-Fi (registered trademark). Note that the communication between the mobile information terminal 700 and the broadcast receiving apparatus 100 may be performed via the access point 200a, the Internet 200, and the router device 200r, or via the base station 600b, the mobile phone communication server 600, the Internet 200, and the router device 200r.
[0018] [Overview of MMT Method] The broadcast receiving apparatus 100 shown in FIG. 1 is assumed to be a television receiver capable of supporting MMT (MPEG Media Transport) in place of the TS (Transport Stream) defined in the MPEG (Moving Picture Experts Group)-2 system (hereinafter referred to as MPEG2-TS), which is widely adopted in conventional digital broadcast systems, as a media transport method for transmitting data such as video and audio. A television receiver capable of supporting both MPEG2-TS and MMT may be used.
[0019] MPEG2-TS is characterized by multiplexing components such as video and audio that make up a program into one stream together with control signals and clocks. Since it is treated as one stream including the clock, it is suitable for transmitting one content over one transmission path with ensured transmission quality and has been adopted in many conventional digital broadcast systems. On the other hand, due to the limitations of the functions of MPEG2-TS with respect to environmental changes related to content distribution in recent years, such as the diversification of content, the diversification of devices using content, the diversification of transmission paths for delivering content, and the diversification of content storage environments, etc., the newly formulated media transport method is MMT.
[0020] Figure 2A shows an example of the outline of the encoded signal in the MMT of this embodiment. As shown in the figure, the MMT of this embodiment is assumed to have, as elements constituting the encoded signal, an MFU (Media Fragment Unit), an MPU (Media Processing Unit), an MMTP (MMT Protocol) payload, and an MMTP packet. The MFU is a format during transmission of video, audio, etc., and may be composed of NAL (Network Abstraction Layer) unit units or access unit units. The MPU may be composed of MPU metadata including information on the overall configuration of the MPU, movie fragment metadata including information on the encoded media data, and sample data that is the encoded media data. Also, it is assumed that the MFU can be extracted from the sample data. Also, in the case of media such as video components and audio components, the presentation time and decoding time may be specified in units of MPU or access units. Figure 2B shows an example of the configuration of the MPU.
[0021] The MMTP packet is composed of a header part and an MMTP payload, and is assumed to transmit the control information of the MFU and MMT. The MMTP payload is assumed to include a payload header corresponding to the content (data unit) stored in the payload part. Fig. 2C shows an example of an overview from a video / audio signal to configuring the MFU, further storing it in the MMTP payload, and then configuring the MMTP packet. Note that for a video signal encoded using inter-frame prediction, it is desirable to configure the MPU in units of GOP (Group Of Pictures). Also, when the size of the MFU to be transmitted is small, one MFU may be stored in one payload part, or multiple MFUs may be stored in one payload part. Further, when the size of the MFU to be transmitted is large, one MFU may be divided and stored in multiple payload parts. Also, the MMTP packet may be protected using techniques such as AL-FEC (Application Layer Forward Error Correction) and ARQ (Automatic Repeat Request) in order to recover packet loss on the transmission path.
[0022] In the broadcast system of this embodiment, MPEG-H HEVC (High Efficiency Video Coding) is used as the video coding method, and MPEG-4 AAC (Advanced Audio Coding) or MPEG-4 ALS (Audio Lossless Coding) is used as the audio coding method. The encoded data such as the video and audio of the broadcast program encoded by each of the above methods shall be in the form of MFU or MPU, and further mounted on the MMTP payload and packetized into MMTP packets for transmission in IP (Internet Protocol) packets. Also, regarding the data content related to the broadcast program, it may be in the form of MFU or MPU, further mounted on the MMTP payload and packetized into MMTP packets for transmission in IP packets. As the transmission method of the data content, there are four types prepared: a subtitle / character super transmission method used for streaming data synchronized with the broadcast, an application transmission method used for asynchronous data transmission with the broadcast, an event message transmission method used for synchronous / asynchronous message notification for applications operating on the television receiver, and a general-purpose data transmission method for transmitting other general-purpose data in a synchronous / asynchronous manner.
[0023] For the transmission of MMTP packets, UDP / IP (User Datagram Protocol / Internet Protocol) is used in the broadcast transmission path, and UDP / IP or TCP / IP (Transmission Control Protocol / Internet Protocol) is used in the communication line. Also, in the broadcast transmission path, the TLV (Type Length Value) multiplexing method is used for efficient transmission of IP packets. An example of the protocol stack of the broadcast system of this embodiment is shown in FIG. 3. In the figure, (A) is an example of the protocol stack in the broadcast transmission path, and (B) is an example of the protocol stack in the communication line.
[0024] In the broadcast system of this embodiment, a mechanism for transmitting two types of control information, MMT-SI (MMT-Signaling Information) and TLV-SI (TLV-Signaling Information), shall be provided. MMT-SI is control information indicating the composition of a broadcast program, etc. It shall be in the form of an MMT control message, carried on an MMTP payload, packetized into an MMTP packet, and transmitted as an IP packet. TLV-SI is control information regarding the multiplexing of IP packets, and shall provide information for channel selection and the correspondence information between IP addresses and services.
[0025] Also, in a broadcast system using MMT, time information shall be transmitted to provide an absolute time. Note that while MPEG2-TS indicates the display time of components based on different clocks for each TS, in MMT, the display time of components shall be indicated based on Coordinated Universal Time (UTC). With these mechanisms, it becomes possible for a terminal device to synchronously display components transmitted from different transmission points via different transmission paths. To provide UTC, IP packets in NTP (Network Time Protocol) format shall be used.
[0026] [Control Information of a Broadcast System Using MMT] In the broadcast system supported by the broadcast receiver 100 of this embodiment, as described above, as control information, TLV-SI related to the TLV multiplexing method for multiplexing IP packets and MMT-SI related to MMT, which is a media transport method, are prepared. TLV-SI provides information for the broadcast receiver 100 to demultiplex the IP packets multiplexed on the broadcast transmission path. TLV-SI is composed of a "table" and a "descriptor". The "table" is transmitted in section format, and the "descriptor" is arranged within the "table". MMT-SI is transmission control information indicating the configuration of MMT packages and information related to broadcast services. MMT-SI is composed of three layers: a "message" that stores "tables" and "descriptors", a "table" that has elements and attributes indicating specific information, and a "descriptor" that indicates more detailed information. An example of the hierarchical structure of the control information used in the broadcast system of this embodiment is shown in FIG. 4.
[0027] FIG. 5A shows a list of the "tables" used in the TLV-SI of the broadcast system supported by the broadcast receiver 100 of this embodiment. In this embodiment, the following are used as the "tables" of TLV-SI.
[0028] (1) TLV-NIT The Network Information Table for TLV (TLV-NIT) represents information regarding the physical configuration of the TLV stream transmitted by the network and the characteristics of the network itself.
[0029] (2) AMT The Address Map Table (AMT) provides a list of multicast groups of the IP packets that make up each service transmitted in the network.
[0030] (3) Table set by the operator In addition, it is possible to prepare tables independently set by service providers and the like.
[0031] <Descriptors used in TLV-SI> Fig. 5B shows a list of "descriptors" arranged in the TLV-SI of the broadcast system corresponding to the broadcast receiving apparatus 100 of this embodiment. In this embodiment, the following are used as the "descriptors" of TLV-SI.
[0032] (1) Service list descriptor The service list descriptor provides a list of services based on service identification and service format type.
[0033] (2) Satellite distribution system descriptor The satellite distribution system descriptor indicates the physical conditions of the satellite transmission path.
[0034] (3) System management descriptor The system management descriptor is used to distinguish between broadcast and non-broadcast.
[0035] (4) Network name descriptor The network name descriptor describes the network name using character codes.
[0036] (5) Descriptor set by the operator In addition, it is possible to prepare descriptors independently set by service providers and the like.
[0037] <Messages used in MMT-SI> Fig. 6A shows a list of "messages" used in the MMT-SI of the broadcast system corresponding to the broadcast receiving apparatus 100 of this embodiment. In this embodiment, the following are used as the "messages" of MMT-SI.
[0038] (1) PA message The Package Access (PA) message is used to transmit various tables.
[0039] (2) M2 Section Message The M2 section message is used to transmit the section extension format of MPEG-2 Systems.
[0040] (3) CA Message The CA message is used to transmit a table for identifying the restricted reception method.
[0041] (4) M2 Short Section Message The M2 short section message is used to transmit the short section format of MPEG-2 Systems.
[0042] (5) Data Transmission Message The data transmission message is a message that stores a table related to data transmission.
[0043] (6) Message Set by Operator In addition, it is possible to prepare messages independently set by service providers and the like.
[0044] <Tables Used in MMT-SI> Figure 6B shows a list of the 'tables' used in the MMT-SI of the broadcast system to which the broadcast receiving apparatus 100 of the present embodiment corresponds. The table is control information having elements and attributes indicating specific information, and is to be stored in a message and transmitted in an MMTP packet. Note that the message storing the table may be determined according to the table. In the present embodiment, the following are used as the 'tables' of MMT-SI.
[0045] (1) MPT The MMT packet table (MMT Package Table: MPT) provides information constituting a package such as a list of assets and the positions of assets on the network. The MPT may be stored in the PA message.
[0046] (2) PLT The Package List Table (PLT) shows the IP data flows for transmitting PA messages of MMT packages provided as broadcast services, the packet IDs, and a list of IP data flows for transmitting IP services. The PLT may be stored in the PA message.
[0047] (3)LCT The Layout Configuration Table (LCT) is used to associate layout information for presentation with layout numbers. The LCT may be stored in the PA message.
[0048] (4)ECM The Entitlement Control Message (ECM) is common information consisting of program information and control information, and delivers key information for decrypting scrambling, etc. The ECM may be stored in the M2 section message.
[0049] (5)EMM The Entitlement Management Message (EMM) transmits individual information including contract information for each subscriber and key information for decrypting the encryption of the ECM (common information), etc. The EMM may be stored in the M2 section message.
[0050] (6)CAT(MH) The Conditional Access Table (CAT) (MH) is used to store descriptors for identifying the restricted reception method. The CAT (MH) may be stored in the CA message.
[0051] (7)DCM The Download Control Message (DCM) transmits key-related information consisting of keys for decrypting the transmission path encryption for downloading, etc. The DCM may be stored in the M2 section message.
[0052] (8)DMM The Download Management Message (DMM) transmits key-related information such as the download key for decrypting the DCM. The DMM may be stored in the M2 section message.
[0053] (9)MH-EIT The MH-Event Information Table (MH-EIT) is time-series information regarding events included in each service. The MH-EIT may be stored in the M2 section message.
[0054] (10)MH-AIT The MH-Application Information Table (MH-AIT) stores all information regarding the application and startup states required by the application. The MH-AIT may be stored in the M2 section message.
[0055] (11)MH-BIT The MH-Broadcaster Information Table (MH-BIT) is used to present information about broadcasters existing on the network. The MH-BIT may be stored in the M2 section message.
[0056] (12)MH-SDTT The MH-Software Download Trigger Table (MH-SDTT) is used for download notification information. The MH-SDTT may be stored in the M2 section message.
[0057] (13)MH-SDT The MH-Service Description Table (MH-SDT) has sub-tables representing services included in a specific TLV stream, and transmits information regarding the programmed channel, such as the name of the programmed channel and the name of the broadcaster. The MH-SDT may be stored in an M2 section message.
[0058] (14)MH-TOT The MH-Time Offset Table (MH-TOT) transmits JST time and date (Modified Julian Date) information. The MH-TOT may be stored in an M2 short section message.
[0059] (15)MH-CDT The MH-Common Data Table (MH-CDT) is used to transmit common data to be stored in non-volatile memory in section format for all receivers that receive it. The MH-CDT may be stored in an M2 section message.
[0060] (16)DDM table The Data Directory Management Table (DDM table) provides the directory configuration of the files that make up an application in order to separate the file configuration of the application from the configuration for file transmission. The DDM table may be stored in a data transmission message.
[0061] (17)DAM table The Data Asset Management Table (DAM table) provides the configuration of the MPUs within an asset and the version information for each MPU. The DAM table may be stored in a data transmission message.
[0062] (18)DCC table The Data Content Configuration Table (DCC Table) provides configuration information of files as data content in order to achieve flexible and effective cache control. The DCC table may be stored in the data transmission message.
[0063] (19) EMT The Event Message Table (EMT) is used to transmit information related to event messages. The EMT may be stored in the M2 section message.
[0064] (20) Tables set by operators In addition, it is possible to prepare tables independently set by service providers and the like.
[0065] <Descriptors used in MMT-SI> Figures 6C and 6D show a list of "descriptors" arranged in the MMT-SI of the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment. The descriptor is control information that provides more detailed information and is assumed to be arranged in a table. Note that the table in which the descriptor is arranged may be determined according to the descriptor. In the present embodiment, the following are used as the "descriptors" of MMT-SI.
[0066] (1) Asset group descriptor The asset group descriptor provides the group relationship of assets and the priority within the group. The asset group descriptor may be arranged in the MPT.
[0067] (2) Event package descriptor The event package descriptor provides the correspondence between the event representing the program and the package. The event package descriptor may be arranged in the MH-EIT transmitted in the M2 section message.
[0068] (3) Background color specification descriptor The background color descriptor provides the background color at the very back in layout specification. The background color descriptor may be placed in the LCT.
[0069] (4) MPU Presentation Area Descriptor The MPU presentation area descriptor provides the position where the MPU is presented. The MPU presentation area descriptor may be placed in the MPT.
[0070] (5) MPU Timestamp Descriptor The MPU timestamp descriptor indicates the presentation time of the first access unit in the presentation order at the MPU. The MPU timestamp descriptor may be placed in the MPT.
[0071] (6) Dependency Descriptor The dependency descriptor provides the asset ID of the asset in a dependency relationship. The dependency descriptor may be placed in the MPT.
[0072] (7) Access Control Descriptor The access control descriptor provides information for identifying the restricted reception method. The access control descriptor may be placed in the MPT or CAT (MH).
[0073] (8) Scrambling Method Descriptor The scrambling method descriptor provides information for identifying the encryption target and the type of encryption algorithm during scrambling. The scrambling method descriptor may be placed in the MPT or CAT (MH).
[0074] (9) Message Authentication Method Descriptor The message authentication method descriptor provides information for identifying the message authentication method when performing message authentication. The message authentication method descriptor may be placed in the MPT or CAT (MH).
[0075] (10) Emergency Information Descriptor (MH) The emergency information descriptor (MH) is used when performing an emergency alert broadcast. The emergency information descriptor (MH) may be placed in the MPT.
[0076] (11) MH-MPEG-4 Audio Descriptor The MH-MPEG-4 Audio Descriptor is used to describe the basic information for identifying the encoding parameters of an audio stream in ISO / IEC 14496-3 (MPEG-4 Audio). The MH-MPEG-4 Audio Descriptor may be placed in the MPT.
[0077] (12) MH-MPEG- Audio Extension Descriptor The MH-MPEG-4 Audio Extension Descriptor is used to describe the profile and level of an MPEG-4 audio stream and the settings specific to the encoding method. The MH-MPEG-4 Audio Extension Descriptor may be placed in the MPT.
[0078] (13) MH-HEVC Video Descriptor The MH-HEVC Video Descriptor is used to describe the basic encoding parameters of a video stream (HEVC stream) in ITU-T Recommendation H.265|ISO / IEC 23008-2. The MH-HEVC Video Descriptor may be placed in the MPT.
[0079] (14) MH-Link Descriptor The MH-Link Descriptor identifies the services provided when additional information related to a specific one described in the program arrangement information system is requested by the viewer. The MH-Link Descriptor may be placed in the MPT, MH-EIT, MH-SDT, etc.
[0080] (15) MH-Event Group Descriptor The MH-Event Group Descriptor is used to indicate that a group of events are grouped when there is a relationship between multiple events. The MH-Event Group Descriptor may be placed in the MH-EIT.
[0081] (16) MH-Service List Descriptor The MH-Service List Descriptor provides a list of services by service identification and service format type. The MH-Service List Descriptor may be placed in the MH-BIT.
[0082] (17) MH-Short Form Event Descriptor The MH-Short Form Event Descriptor represents the event name and a short description of the event in text form. The MH-Short Form Event Descriptor may be placed in the MH-EIT.
[0083] (18) MH-Extended Form Event Descriptor The MH-Extended Form Event Descriptor is used in addition to the MH-Short Form Event Descriptor to provide a detailed description of the event. The MH-Extended Form Event Descriptor may be placed in the MH-EIT.
[0084] (19) Video Component Descriptor The Video Component Descriptor indicates parameters and descriptions related to the video component and is also used to represent the elementary stream in text form. The Video Component Descriptor may be placed in the MPT or MH-EIT.
[0085] (20) MH-Stream Identification Descriptor The MH-Stream Identification Descriptor labels the component streams of a service and is used to be able to refer to the description content indicated by the Video Component Descriptor in the MH-EIT by this label. The MH-Stream Identification Descriptor may be placed in the MPT.
[0086] (21) MH-Content Descriptor The MH-Content Descriptor indicates the genre of the event. The MH-Content Descriptor may be placed in the MH-EIT.
[0087] (22) MH-Parental Rate Descriptor The MH-Parental Rating Descriptor represents age-based viewing restrictions and is used to be extended to be based on other restrictive conditions. The MH-Parental Rating Descriptor may be placed in the MPT or MH-EIT.
[0088] (23) MH-Audio Component Descriptor The MH-Audio Component Descriptor indicates each parameter of the audio elementary stream and is also used to represent the elementary stream in character form. The MH-Audio Component Descriptor may be placed in the MPT or MH-EIT.
[0089] (24) MH-Target Area Descriptor The MH-Target Area Descriptor is used to describe the area targeted by a program or a part of the stream that constitutes the program. The MH-Target Area Descriptor may be placed in the MPT.
[0090] (25) MH-Series Descriptor The MH-Series Descriptor is used to identify a series program. The MH-Series Descriptor may be placed in the MH-EIT.
[0091] (26) MH-SI Transmission Parameter Descriptor The MH-SI Transmission Parameter Descriptor is used to indicate the transmission parameters of the SI. The MH-SI Transmission Parameter Descriptor may be placed in the MH-BIT.
[0092] (27) MH-Broadcaster Name Descriptor The MH-Broadcaster Name Descriptor describes the name of the broadcaster. The MH-Broadcaster Name Descriptor may be placed in the MH-BIT.
[0093] (28) MH-Service Descriptor The MH-Service Descriptor represents the compiled channel name and its operator name together with the service format type in character codes. The MH-Service Descriptor may be placed in the MH-SDT.
[0094] (29) IP Data Flow Descriptor The IP data flow descriptor provides information on the IP data flows that make up a service. The IP data flow descriptor may be placed in the MH-SDT.
[0095] (30) MH-CA Activation Descriptor The MH-CA activation descriptor describes the activation information for starting a CAS program on the CAS platform. The MH-CA activation descriptor may be placed in the MPT or CAT(CA).
[0096] (31) MH-Type Descriptor The MH-Type descriptor indicates the type of file transmitted by the application transmission method. The MH-Type descriptor may be placed in the DAM table.
[0097] (32) MH-Info Descriptor The MH-Info descriptor describes information regarding the MPU or item. The MH-Info descriptor may be placed in the DAM table.
[0098] (33) MH-Expire Descriptor The MH-Expire descriptor describes the expiration date of an item. The MH-Expire descriptor may be placed in the DAM table.
[0099] (34) MH-Compression Type Descriptor The MH-Compression Type descriptor means that the item to be transmitted is compressed, and indicates the compression algorithm and the number of bytes of the item before compression. The MH-Compression Type descriptor may be placed in the DAM table.
[0100] (35) MH-Data Encoding Method Descriptor The MH-data encoding method descriptor is used to identify the data encoding method. The MH-data encoding method descriptor may be placed in the MPT.
[0101] (36) UTC-NPT Reference Descriptor The UTC-NPT reference descriptor is used to convey the relationship between NPT (Normal Play Time) and UTC. The UTC-NPT reference descriptor may be placed in the EMT.
[0102] (37) Event Message Descriptor The event message descriptor conveys information about event messages in general. The event message descriptor may be placed in the EMT.
[0103] (38) MH-Local Time Offset Descriptor The MH-local time offset descriptor is used when giving a certain offset value to the actual time (e.g., UTC +9 hours) and the display time for the human system during the implementation of daylight saving time. The MH-local time offset descriptor may be placed in the MH-TOT.
[0104] (39) MH-Component Group Descriptor The MH-component group descriptor defines and identifies the combination of components within an event. The MH-component group descriptor may be placed in the MH-EIT.
[0105] (40) MH-Logo Transmission Descriptor The MH-logo transmission descriptor is used to describe, for example, the simple logo string, the pointer to the CDT-formatted logo. The MH-logo transmission descriptor may be placed in the MH-SDT.
[0106] (41) MPU Extended Timestamp Descriptor The MPU extended timestamp descriptor provides the decoding time of the access unit within the MPU. The MPU extended timestamp descriptor may be placed in the MPT.
[0107] (42) MPU Download Content Descriptor The MPU download content descriptor is used to describe the attribute information of the content downloaded using the MPU. The MPU download content descriptor may be arranged in the MH-SDTT.
[0108] (43) MH-Network Download Content Descriptor The MH-network download content descriptor is used to describe the attribute information of the content downloaded using the network. The MH-network download content descriptor may be arranged in the MH-SDTT.
[0109] (44) MH-Application Descriptor The MH-application descriptor describes the information of the application. The MH-application descriptor may be arranged in the MH-AIT.
[0110] (45) MH-Transmission Protocol Descriptor The MH-transmission protocol descriptor is used to specify the transmission protocol such as broadcasting or communication and to indicate the location information of the application dependent on the transmission protocol. The MH-transmission protocol descriptor may be arranged in the MH-AIT.
[0111] (46) MH-Simple Application Location Descriptor The MH-simple application location descriptor is described to indicate the details of the acquisition destination of the application. The MH-simple application location descriptor may be arranged in the MH-AIT.
[0112] (47) MH-Application Boundary Permission Setting Descriptor The MH-application boundary permission setting descriptor is described to set the application boundary and to set the permission for accessing the broadcast resource for each area (URL). The MH-application boundary permission setting descriptor may be arranged in the MH-AIT.
[0113] (48) MH-Startup Priority Information Descriptor The MH-Startup Priority Descriptor is described to specify the startup priority of an application. The MH-Startup Priority Descriptor may be placed in the MH-AIT.
[0114] (49) MH-Cache Information Descriptor The MH-Cache Information Descriptor is described for use in cache control when caching and holding the resources that make up an application when reuse of the application is assumed. The MH-Cache Information Descriptor may be placed in the MH-AIT.
[0115] (50) MH-Probabilistic Application Delay Descriptor The MH-Probabilistic Application Delay Descriptor is described to delay the timing of performing application control by a delay amount set probabilistically, assuming load distribution of server access for application acquisition. The MH-Probabilistic Application Delay Descriptor may be placed in the MH-AIT.
[0116] (51) Linked Destination PU Descriptor The Linked Destination PU Descriptor describes other presentation units (PUs) that may be transitioned from the current presentation unit. The Linked Destination PU Descriptor may be placed in the DCC table.
[0117] (52) Lock Cache Specification Descriptor The Lock Cache Specification Descriptor describes the specification of files to be cached and locked in the current presentation unit. The Lock Cache Specification Descriptor may be placed in the DCC table.
[0118] (53) Unlock Cache Specification Descriptor The Unlock Cache Specification Descriptor describes the specification of files to be unlocked among the files locked in the current presentation unit. The Unlock Cache Specification Descriptor may be placed in the DCC table.
[0119] (54) Descriptor Set by the Operator In addition, it is possible to prepare descriptors independently set by service providers and the like.
[0120] <Relationship between Data Transmission and Each Control Information in the MMT Method> Here, with reference to FIG. 6E, the relationship between data transmission and representative tables in the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment will be described.
[0121] In the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment, data can be transmitted through a plurality of paths such as a TLV stream via a broadcast transmission path or an IP data flow via a communication line. The TLV stream includes TLV-SIs such as TLV-NIT and AMT, and an IP data flow which is a data flow of IP packets. The IP data flow includes a video asset including a series of video MPUs and an audio asset including a series of audio MPUs. Similarly, the IP data flow may include a subtitle asset including a series of subtitle MPUs, a character super asset including a series of character super MPUs, a data asset including a series of data MPUs, and the like. These various assets are associated in units of "packages" by an MPT (MMT package table) stored in a PA message and transmitted. Specifically, the association is made by describing a package ID (corresponding to the "MMT_package_id_byte" parameter shown in FIG. 17 described later) and an asset ID of each asset included in the package (corresponding to the "asset_id_byte" parameter shown in FIG. 17 described later) in the MPT.
[0122] The assets that make up the package can be only the assets within the TLV stream, but as shown in FIG. 6E, assets transmitted in the IP data flow of the communication line can also be included. This can be realized by including the location information of each asset included in the package (corresponding to 'MMT_general_location_info()' shown in FIG. 17 described later) in the MPT so that the broadcast receiving apparatus 100 of the present embodiment can grasp the reference destination of each asset. Specifically, by changing the value of the 'MMT_general_location_infonolocation_type' parameter arranged in the location information, (1) Data multiplexed in the same IP data flow as the MPT (location_type = 0x00) (2) Data multiplexed in the IPv4 data flow (location_type = 0x01) (3) Data multiplexed in the IPv6 data flow (location_type = 0x02) (4) Data multiplexed in the broadcast MPEG2-TS (location_type = 0x03) (5) Data multiplexed in the MPEG2-TS format within the IP data flow (location_type = 0x04) (6) Data at the specified URL (location_type = 0x05) Thus, it becomes possible to configure various types of data transmitted through various transmission paths so that the broadcast receiving apparatus 100 can refer to them.
[0123] Among the aforementioned references, (1) is, for example, an IP data flow received via a digital broadcast signal received by the tuner / demodulation unit 131 of the broadcast receiving apparatus 100 shown in FIG. 7A described later. When transmitting MPT including the IP data flow on the communication line side, the reference of (1) may be an IP data flow received by the LAN communication unit 121 described later via the communication line. Further, the aforementioned (2), (3), (5), and (6) are IP data flows received by the LAN communication unit 121 described later via the communication line. Further, the aforementioned (4) is, for example, in the case of a broadcast receiving apparatus having both a receiving function for receiving a digital broadcast signal using the MMT method and a receiving function for receiving a digital broadcast signal using the MPEG2-TS method, such as the broadcast receiving apparatus 800 of Embodiment 2 shown in FIG. 24 described later. Based on the location information of MPT (『MMT_general_location_info()』) included in the digital broadcast signal using the MMT method, it can be used when referring to the data multiplexed in the MPEG2-TS received by the receiving function for receiving the digital broadcast signal using the MPEG2-TS method.
[0124] Note that the data constituting the 'package' is specified in this way. However, in the broadcast system corresponding to the broadcast receiving apparatus 100 of the present embodiment, a series of data in the unit of the 'package' is treated as a unit of 'Service' of digital broadcast.
[0125] Furthermore, MPT describes the presentation time information of each MPU specified by MPT (corresponding to the'mpu_presentation_time' parameter shown in FIG. 13B described later). Using the presentation time information, a plurality of MPUs specified by MPT can be presented (displayed, output, etc.) in conjunction with each other based on a clock based on NTP, which is time information in UTC notation. The presentation control of various data using the clock based on NTP will be described later.
[0126] In the data transmission method of this embodiment shown in FIG. 6E, there is further a concept of "event". An "event" is a concept indicating a so-called "program" handled by MH-EIT included in the M2 section message and sent. Specifically, in the "package" indicated by the event package descriptor stored in MH-EIT, a series of data included in the period of the duration (corresponding to the "duration" parameter shown in FIG. 21 described later) from the disclosure time (corresponding to the "start_time" parameter shown in FIG. 21 described later) stored in MH-EIT is data included in the concept of the "event". MH-EIT can be used in various processes in the broadcast receiving apparatus 100 of this embodiment in units of the "event" (for example, program guide generation process, recording reservation and viewing reservation control, copyright management processes such as temporary storage).
[0127] [Hardware Configuration of Broadcast Receiving Apparatus] FIG. 7A is a block diagram showing an example of the internal configuration of the broadcast receiving apparatus 100. The broadcast receiving apparatus 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage (accumulation) unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, a separation unit 132, a video decoder 141, a video color gamut conversion unit 142, an audio decoder 143, a character super decoder 144, a subtitle decoder 145, a subtitle synthesis unit 146, a subtitle color gamut conversion unit 147, a data decoder 151, a cache unit 152, an application control unit 153, a browser unit 154, an application color gamut conversion unit 155, a sound source unit 156, a video synthesis unit 161, a monitor unit 162, a video output unit 163, an audio synthesis unit 164, a speaker unit 165, an audio output unit 166, and an operation input unit 170.
[0128] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving apparatus 100 according to a predetermined operation program. The system bus 102 is a data communication path for performing data transmission and reception between the main control unit 101 and each operation block in the broadcast receiving apparatus 100.
[0129] The ROM (Read Only Memory) 103 is a non-volatile memory that stores basic operation programs such as an operating system and other operation programs. For example, a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or a flash ROM is used. The ROM 103 may store operation setting values necessary for the operation of the broadcast receiving apparatus 100. The RAM (Random Access Memory) 104 serves as a work area when executing basic operation programs and other operation programs. The ROM 103 and the RAM 104 may be integrally configured with the main control unit 101. Further, the ROM 103 may use a partial storage area in the storage (accumulation) unit 110 instead of having an independent configuration as shown in FIG. 7A.
[0130] The storage (accumulation) unit 110 stores operation programs, operation setting values, personal information of the user of the broadcast receiving apparatus 100, and the like of the broadcast receiving apparatus 100. Further, it can store operation programs downloaded via the Internet 200 and various data created by the operation programs. It can also store contents such as moving images, still images, and audio obtained from a broadcast wave or downloaded via the Internet 200. A partial area of the storage (accumulation) unit 110 may replace all or part of the functions of the ROM 103. Further, the storage (accumulation) unit 110 needs to retain the stored information even when no external power is supplied to the broadcast receiving apparatus 100. Therefore, for example, devices such as non-volatile semiconductor element memories such as flash ROMs and SSDs (Solid State Drives), and magnetic disk drives such as HDDs (Hard Disc Drives) are used.
[0131] It is assumed that the respective operation programs stored in the ROM 103 and the storage (accumulation) unit 110 can be added, updated, and functionally expanded by download processing from each server device on the Internet 200.
[0132] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 200r, and transmits and receives data with each server device and other communication devices on the Internet 200. Also, it shall acquire the MMT data sequence (or a part thereof) of the program transmitted via the communication line. The connection to the router device 200r may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 shall be provided with an encoding circuit, a decoding circuit, and the like. Further, the broadcast receiving apparatus 100 may further include other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, and an infrared communication unit.
[0133] The tuner / demodulation unit 131 receives the broadcast wave transmitted from the radio tower 300t via the antenna 100a, and tunes (selects a channel) to the channel of the service desired by the user based on the control of the main control unit 101. Further, the tuner / demodulation unit 131 demodulates the received broadcast signal to acquire the MMT data sequence. In the example shown in FIG. 7A, a configuration in which there is one tuner / demodulation unit is illustrated, but for the purpose of simultaneous display of multiple screens, recording of a back program, etc., the broadcast receiving apparatus 100 may be configured to include a plurality of tuner / demodulation units.
[0134] The separation unit 132 is an MMT decoder, which distributes a video data sequence, an audio data sequence, a character super data sequence, a subtitle data sequence, etc., which are real-time presentation elements, based on the control signals in the input MMT data sequence, to a video decoder 141, an audio decoder 143, a character super decoder 144, a subtitle decoder 145, etc., respectively. The data input to the separation unit 132 may be an MMT data sequence transmitted via a broadcast transmission line and demodulated by the tuner / demodulation unit 131, or an MMT data sequence transmitted via a communication line and received by the LAN communication unit 121. Further, the separation unit 132 plays multimedia applications and file system data which are components thereof, and temporarily stores them in the cache unit 152. Further, the separation unit 132 extracts general-purpose data and outputs it to the data decoder 151 for use in streaming data for a player that presents data other than video, audio, and subtitles or for an application. Further, the separation unit 132 may perform control such as error correction and access restriction control on the input MMT data sequence based on the control of the main control unit 101.
[0135] The video decoder 141 decodes the video data sequence input from the separation unit 132 and outputs video information. The video color gamut conversion unit 142 performs color space conversion processing on the video information decoded by the video decoder 141 as necessary for video composition processing in the video composition unit 161. The audio decoder 143 decodes the audio data sequence input from the separation unit 132 and outputs audio information. Further, streaming data in, for example, the MPEG-DASH (MPEG-Dynamic Adaptive Streaming over HTTP) format or the like, acquired from the Internet 200 via the LAN communication unit 121, may be input to the video decoder 141 and the audio decoder 143. Further, a plurality of the video decoder 141, the video color gamut conversion unit 142, the audio decoder 143, etc. may be provided to decode a plurality of types of video data sequences and audio data sequences simultaneously.
[0136] The character super decoder 144 decodes the character super data string input from the separation unit 132 and outputs character super information. The subtitle decoder 145 decodes the subtitle data string input from the separation unit 132 and outputs subtitle information. The character super information output from the character super decoder 144 and the subtitle information output from the subtitle decoder 145 are subjected to a synthesis process in the subtitle synthesis unit 146, and further, in the subtitle color gamut conversion unit 147, color space conversion processing is performed as necessary for the video synthesis process in the video synthesis unit 161. In this embodiment, among the services centered on character information presented simultaneously with the video of the broadcast program, those related to the content of the video are called subtitles, and the others are called character supers. Also, when not distinguishing between them, they are collectively referred to as subtitles.
[0137] The browser unit 154 presents the multimedia application file and the file system data that are components thereof, which are acquired from a server device on the Internet 200 via the cache unit 152 or the LAN communication unit 121, in accordance with an instruction from the application control unit 153 that interprets the control information included in the MMT data string and the control information acquired from the server device on the Internet 200 via the LAN communication unit 121. Note that the multimedia application file may be an HTML (Hyper Text Markup Language) document, a BML (Broadcast Markup Language) document, or the like. The application information output from the browser unit 154 is further subjected to color space conversion processing as necessary for the video synthesis process in the video synthesis unit 161 in the application color gamut conversion unit 155. Also, the browser unit 154 is assumed to reproduce the application audio information by acting on the sound source unit 156.
[0138] The video composition unit 161 receives the video information output from the video color gamut conversion unit 142, the caption information output from the caption color gamut conversion unit 147, the application information output from the application color gamut conversion unit 155, etc., and performs processes such as appropriate selection and / or superimposition. The video composition unit 161 includes a video RAM (not shown), and the monitor unit 162, etc. is driven based on the video information, etc. input to the video RAM. Also, the video composition unit 161 performs superimposition processing, etc. of an EPG (Electronic Program Guide) screen information created based on information such as scaling processing and MH-EIT included in MMT-SI as necessary based on the control of the main control unit 101. The monitor unit 162 is a display device such as a liquid crystal panel, for example, and provides the video information subjected to selection and / or superimposition processing by the video composition unit 161 to the user of the broadcast receiving apparatus 100. The video output unit 163 is a video output interface that outputs the video information subjected to selection and / or superimposition processing by the video composition unit 161.
[0139] Note that the presentation function of the broadcast receiving apparatus 100 in this embodiment is provided with a logical plane structure in order to display the multimedia service as intended by the provider. FIG. 7B shows an example of the configuration of the logical plane structure provided in the presentation function of the broadcast receiving apparatus 100 in this embodiment. In the logical plane structure, a character super plane for displaying character supers is arranged at the forefront, and a subtitle plane for displaying subtitles is arranged in the next layer. In the third layer, a multimedia plane for displaying broadcast video, multimedia applications, or a composite video thereof is arranged, and a background plane is arranged at the rearmost. In the subtitle synthesizing unit 146 and the video synthesizing unit 161, drawing of character super information on the character super plane, drawing of subtitle information on the subtitle plane, and drawing of video information, application information, etc. on the multimedia plane are performed. Further, the background color is drawn on the background plane based on LCT or the like included in MMT-SI. Note that it is assumed that a plurality of multimedia planes in the third layer can be prepared according to the number of video decoders 141. However, even when there are a plurality of multimedia planes, the application information etc. output from the application color gamut conversion unit 155 is output only to the frontmost multimedia plane.
[0140] The voice synthesizing unit 164 inputs the voice information output from the voice decoder 143 and the application voice information reproduced by the sound source unit 156, and performs processes such as appropriate selection and / or mixing. The speaker unit 165 provides the voice information subjected to the selection and / or mixing process by the voice synthesizing unit 164 to the user of the broadcast receiving apparatus 100. The voice output unit 166 is a voice output interface that outputs the voice information subjected to the selection and / or mixing process by the voice synthesizing unit 164.
[0141] The expansion interface section 124 is a group of interfaces for expanding the functions of the broadcast receiving apparatus 100. In this embodiment, it is assumed to be composed of an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The analog video / audio interface performs input of analog video signals / audio signals from an external video / audio output device, output of analog video signals / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to perform data transmission and reception. An HDD may be connected to record broadcast programs and contents. Also, a keyboard and other USB devices may be connected. The memory interface connects a memory card and other memory media to perform data transmission and reception.
[0142] The digital interface section 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface section 125 shall be capable of directly outputting the MMT data sequence obtained by demodulation by the tuner / demodulation section 131, the MMT data sequence acquired via the LAN communication section 121, or the mixed data of the respective MMT data sequences. Also, it may be controlled to input the MMT data sequence input from the digital interface section 125 to the separation section 132. Output of digital contents stored in the storage (accumulation) section 110, or storage of digital contents in the storage (accumulation) section 110 may be performed via the digital interface section 125.
[0143] The digital interface unit 125 may be a DVI terminal, an HDMI (registered trademark) terminal, a Display Port (registered trademark) terminal, etc., and data may be output or input in a format compliant with DVI specifications, HDMI specifications, Display Port specifications, etc. It may also be output or input in the form of serial data compliant with IEEE1394 specifications, etc. Further, it may be configured as an IP interface that performs digital interface output via hardware such as Ethernet (registered trademark) or wireless LAN. In this case, the digital interface unit 125 and the LAN communication unit 121 may share their hardware configuration.
[0144] The operation input unit 170 is an instruction input unit that inputs operation instructions to the broadcast receiving apparatus 100. In this embodiment, it is assumed to be composed of a remote control receiving unit that receives commands transmitted from a remote control (not shown) and operation keys arranged with button switches. Only one of them may be used. Further, the operation input unit 170 may be replaced with a touch panel disposed over the monitor unit 162. It may also be replaced with a keyboard or the like connected to the extension interface unit 124. The remote control (not shown) may be replaced with a portable information terminal 700 having a remote control command transmission function.
[0145] Note that, as described above, when the broadcast receiving device 100 is a television receiver or the like, the video output unit 163 and the audio output unit 166 are not essential components of the present invention. Further, the broadcast receiving device 100 may be, in addition to a television receiver, an optical disc drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disc drive recorder such as an HDD recorder, an STB (Set Top Box), or the like. It may also be a PC (Personal Computer), a tablet terminal, a navigation device, a game machine, or the like having a digital broadcast receiving function and a broadcast communication cooperation function. When the broadcast receiving device 100 is a DVD recorder, an HDD recorder, an STB, or the like, the monitor unit 162 and the speaker unit 165 may not be provided. By connecting an external monitor and an external speaker to the video output unit 163 and the audio output unit 166 or the digital interface unit 125, the same operation as that of the broadcast receiving device 100 of the present embodiment becomes possible.
[0146] [System Configuration of Clock Synchronization / Presentation Synchronization of Broadcast Receiving Device] FIG. 7C is an example of a system configuration of clock synchronization / presentation synchronization in a broadcast system corresponding to the broadcast receiving device 100 of the present embodiment. In the broadcast system of the present embodiment, UTC is transmitted from the broadcast transmission system to a receiver (such as the broadcast receiving device 100 of the present embodiment) in the form of a 64-bit NTP timestamp. In the NTP timestamp format, the 'above seconds' of UTC is represented by 32 bits, and the 'less than seconds' is represented by 32 bits. However, in practice, it is difficult to reproduce 1 second with 32-bit accuracy. For this reason, as the system clock for synchronizing the video system or the system clock for operating the NTP format clock, for example, a frequency of '2 to the 24th power' Hz (about 16.8 MHz) as shown in the figure may be used. Considering that the system clock in the conventional broadcast system was 27 MHz and that the hardware configuration of the receiver can be easily constructed, it is desirable to adopt a power-of-two frequency of about '2 to the 24th power' to '2 to the 28th power' as the system clock.
[0147] In addition, when the system clock is set to a frequency of a power of 2 between approximately "2 to the 24th power" and "2 to the 28th power" as described above on the broadcast transmission system side or the receiver side, the lower 8 to 4 bits that are not referenced by the PLL (Phase Locked Loop) system for reproducing the system clock or the NTP-formatted clock in the NTP timestamp format transmitted from the broadcast transmission system side to the receiver side may be fixed to '0' or '1'. That is, if the system clock is "2 to the nth power" Hz (in the example of FIG. 7C, n = 24), the lower '32 - n' bits of the NTP timestamp format may be fixed to '0' or '1'. Alternatively, on the receiver side, the lower '32 - n' bits of the NTP timestamp format may be processed to be ignored.
[0148] On the broadcast transmission system side, when obtaining NTP-formatted time information from the outside, a PLL system is configured with a 32 + n-bit counter using a VCO (Voltage Controlled Oscillator) of "2 to the nth power" Hz, and a transmission system clock synchronized with the time information given from the outside is realized. Also, the entire signal processing system is operated in synchronization with the system clock of "2 to the nth power" Hz. Further, the output of the transmission system clock is periodically transmitted to the receiver side via the broadcast transmission path as NTP long-formatted time information.
[0149] On the receiver side, the NTP long-format time information is received via the broadcast transmission path, and similar to the broadcast transmission system side, the receiver system clock is reproduced by a PLL system based on a VCO of "2 to the power of n" Hz. As a result, the receiver system clock becomes a clock synchronized with the broadcast transmission system side. Also, by operating the signal processing system of the receiver in synchronization with the system clock of "2 to the power of n" Hz, clock synchronization between the broadcast transmission system side and the receiver side is achieved, enabling stable signal reproduction. Further, the decoding time and presentation time for each presentation unit of the video / audio signal are set on the broadcast transmission system side based on the NTP format time information. Here, the MPU stored in the PA message transmitted by the broadcast signal stores an MPU timestamp descriptor shown in FIG. 13B described later. In the MPU timestamp descriptor of FIG. 13B, the "mpu_sequence_number (MPU sequence number)" parameter indicates the sequence number of the MPU that describes the timestamp, and the "mpu_presentation_time (MPU presentation time)" parameter indicates the presentation time of the MPU in the 64-bit NTP timestamp format. Therefore, the receiver can refer to the MPU timestamp descriptor stored in the MPT and control the presentation (display, output, etc.) timing for each MPU of the video signal, audio signal, subtitle, character super, etc.
[0150] Note that when focusing on the control of the decoding timing and presentation timing for each presentation unit of the aforementioned video / audio signal, etc., synchronization of the video / audio signal can be ensured even with a clock of about "2 to the 16th power" Hz (about 65.5 KHz). In this case, it is not necessary to refer to the lower 16 bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. That is, when using a clock of "2 to the power of m" Hz generated by dividing the system clock, etc. for the control of the decoding timing and presentation timing, it is not necessary to refer to the lower "32 - m" bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. Therefore, the lower "32 - m" bits of the NTP timestamp format described in the MPU timestamp descriptor, etc. may be fixed to "0" or "1".
[0151] [Software Configuration of Broadcast Receiver] Figure 7D is a software configuration diagram of the broadcast receiver 100 of this embodiment, showing the software configuration in the ROM 103, RAM 104, and storage (accumulation) unit 110. In this embodiment, the basic operation program 1001 and other operation programs are stored in the ROM 103, and the receiver function program 1002 and other operation programs are stored in the storage (accumulation) unit 110. Further, the storage (accumulation) unit 110 is provided with a content storage area 1200 for storing contents such as videos, still images, and audio, an authentication information storage area 1300 for storing authentication information and the like necessary when accessing external portable terminal devices and each server device, and various information storage areas for storing other various types of information.
[0152] The basic operation program 1001 stored in the ROM 103 is expanded into the RAM 104, and further, the main control unit 101 executes the expanded basic operation program to constitute the basic operation execution unit 1101. Similarly, the receiver function program 1002 stored in the storage (accumulation) unit 110 is expanded into the RAM 104, and further, the main control unit 101 executes the expanded receiver function program to constitute the receiver function execution unit 1102. Also, the RAM 104 is provided with a temporary storage area for temporarily holding data created when each operation program is executed as needed.
[0153] In the following, for the sake of simplicity of explanation, the process of the main control unit 101 expanding and executing the basic operation program 1001 stored in the ROM 103 in the RAM 104 to control each operation block will be described as if the basic operation execution unit 1101 controls each operation block. The same description will be made for other operation programs.
[0154] The reception function execution unit 1102 controls each operation block of the broadcast receiving apparatus 100 in order to reproduce components such as video and audio transmitted in the broadcast system of the present embodiment. In particular, the transport processing unit 1102a mainly controls the MMT decoder function of the separation unit 132, and distributes the video data sequence, audio data sequence, etc. separated from the MMT data sequence to the corresponding decoding processing units. The AV decoding processing unit 1102b mainly controls the video decoder 141, audio decoder 143, etc. The application processing unit 1102c mainly controls the cache unit 152, application control unit 153, browser unit 154, and sound source unit 156. The character super processing unit 1102d mainly controls the character super decoder 144. The subtitle processing unit 1102e mainly controls the subtitle decoder 145. The general-purpose data processing unit 1102f mainly controls the data decoder 151. The EPG generation unit 1102g interprets the description content such as MH-EIT included in the MMT-SI and generates an EPG screen. The presentation processing unit 1102h mainly controls the video color gamut conversion unit 142, subtitle composition unit 146, subtitle color gamut conversion unit 147, application color gamut conversion unit 155, video composition unit 161, and audio composition unit 164 based on the logical plane structure.
[0155] Each of the above operation programs may be stored in the ROM 103 and / or the storage (accumulation) unit 110 in advance at the time of product shipment. After product shipment, it may be acquired from other application servers 500 on the Internet 200 via the LAN communication unit 121. Also, each of the above operation programs stored in a memory card, optical disk, etc. may be acquired via the expansion interface unit 124, etc.
[0156] [Configuration of Broadcast Station Server] FIG. 8 is a block diagram showing an example of the internal configuration of the broadcast station server 300. The broadcast station server 300 includes a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, a LAN communication unit 321, and a digital broadcast signal transmission unit 360.
[0157] The main control unit 301 is a microprocessor unit that controls the entire broadcast station server 300 according to a predetermined operation program. The system bus 302 is a data communication path for performing data transmission and reception between the main control unit 301 and each operation block in the broadcast station server 300. The RAM 304 serves as a work area when each operation program is executed.
[0158] The storage unit 310 stores the basic operation program 3001, the broadcast content management / delivery program 3002, and the broadcast content transmission program 3003, and further includes a broadcast content storage area 3200 and a metadata storage area 3300. The broadcast content storage area 3200 stores program contents and the like of each broadcast program broadcast by the broadcast station. The metadata storage area 3300 stores metadata such as the program title, program ID, program summary, cast, broadcast date and time, and copy control information related to each program content of each broadcast program.
[0159] Also, the basic operation program 3001, the broadcast content management / delivery program 3002, and the broadcast content transmission program 3003 stored in the storage unit 310 are respectively expanded into the RAM 304, and further, by the main control unit 301 executing each of the expanded programs, a basic operation execution unit 3101, a broadcast content management / delivery execution unit 3102, and a broadcast content transmission execution unit 3103 are configured.
[0160] In the following, for the sake of simplicity of explanation, the process of the main control unit 301 expanding and executing the basic operation program 3001 stored in the storage unit 310 in the RAM 304 to control each operation block is described as being performed by the basic operation execution unit 3101 to control each operation block. The same description is made for other operation programs.
[0161] The broadcast content management / delivery execution unit 3102 manages the program content and other data of each broadcast program and each metadata stored in the broadcast content storage area 3200 and the metadata storage area 3300, and controls the provision of the program content and other data of each broadcast program and each metadata to the service provider based on the contract. Further, when providing the program content and other data of each broadcast program and each metadata to the service provider, the broadcast content management / delivery execution unit 3102 may perform authentication processing of the service provider server 400 based on the contract as necessary.
[0162] The broadcast content transmission execution unit 3103 performs time schedule management and the like when transmitting an MMT data sequence including the program content of the broadcast program stored in the broadcast content storage area 3200, the program title of the broadcast program stored in the metadata storage area 3300, the program ID, the copy control information of the program content, etc. from the radio tower 300t via the digital broadcast signal transmission unit 360.
[0163] The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 and the like on the Internet 200. The LAN communication unit 321 is assumed to include an encoding circuit, a decoding circuit, and the like. The digital broadcast signal transmission unit 360 modulates an MMT data sequence composed of a video data sequence, an audio data sequence, a program information data sequence, etc. of the program content of each broadcast program stored in the broadcast content storage area 3200, and transmits it as a digital broadcast wave via the radio tower 300t.
[0164] [Configuration of Service Provider Server] FIG. 9 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 includes a main control unit 401, a system bus 402, a RAM 404, and a storage unit 410, and a LAN communication unit 421.
[0165] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operation program. The system bus 402 is a data communication path for performing data transmission and reception between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.
[0166] The storage unit 410 stores the basic operation program 4001, the video content management / delivery program 4002, and the application management / distribution program 4004, and further includes a video content storage area 4200, a metadata storage area 4300, an application storage area 4400, and a user information storage area 4500. The video content storage area 4200 stores the program content of the broadcast program provided by the broadcasting station server 300 as video content. It also stores video content produced by the service provider. The metadata storage area 4300 stores each piece of metadata provided by the broadcasting station server 300 and metadata related to the video content produced by the service provider. The application storage area 4400 stores various applications for realizing services linked to broadcast programs for distribution in response to requests from each television receiver. The user information storage area 4500 stores information (such as personal information and authentication information) about users who are permitted to access the service provider server 400.
[0167] Also, the basic operation program 4001, the video content management / delivery program 4002, and the application management / distribution program 4004 stored in the storage unit 410 are each expanded to the RAM 404, and further, the main control unit 401 executes the expanded basic operation program, video content management / delivery program, and application management / distribution program, thereby constituting a basic operation execution unit 4101, a video content management / delivery execution unit 4102, and an application management / distribution execution unit 4104.
[0168] In the following, for the sake of simplicity, the process of controlling each operation block by the main control unit 401 expanding and executing the basic operation program 4001 stored in the storage unit 410 in the RAM 404 will be described as being performed by the basic operation execution unit 4101 for controlling each operation block. The same description will be made for other operation programs.
[0169] The video content management / delivery execution unit 4102 acquires program content and metadata of a broadcast program from the broadcast station server 300, manages the video content and metadata stored in the video content storage area 4200 and the metadata storage area 4300, and controls the distribution of the video content and metadata to each television receiver. Further, when distributing the video content and metadata to each television receiver, the video content management / delivery execution unit 4102 may perform authentication processing and the like for each television receiver as necessary. Also, the application management / distribution execution unit 4104 manages each application stored in the application storage area 4400 and controls the distribution of each application in response to requests from each television receiver. Further, when distributing each application to each television receiver, the application management / distribution execution unit 4104 may perform authentication processing and the like for each television receiver as necessary.
[0170] The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast station server 300 on the Internet 200 and the broadcast receiving device 100 via the router device 200r. The LAN communication unit 421 is assumed to include an encoding circuit, a decoding circuit, and the like.
[0171] [Hardware Configuration of Mobile Information Terminal] FIG. 10A is a block diagram showing an example of the internal configuration of the mobile information terminal 700. The mobile information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760.
[0172] The main control unit 701 is a microprocessor unit that controls the entire mobile information terminal 700 according to a predetermined operation program. The system bus 702 is a data communication path for performing data transmission and reception between the main control unit 701 and each operation block in the mobile information terminal 700.
[0173] The ROM 703 is a memory in which basic operation programs such as an operating system and other operation programs are stored. For example, a rewritable ROM such as an EEPROM or a flash ROM is used. The RAM 704 serves as a work area when the basic operation program and other operation programs are executed. The ROM 703 and the RAM 704 may be integrally configured with the main control unit 701. Also, the ROM 703 may not have an independent configuration as shown in FIG. 10A, and may use a part of the storage area in the storage unit 710.
[0174] The storage unit 710 stores the operation program and operation setting values of the mobile information terminal 700, personal information of the user of the mobile information terminal 700, and the like. Also, it can store operation programs downloaded via the Internet 200 and various data created by the operation programs. Further, it can store contents such as videos, still images, and sounds downloaded via the Internet 200. A part of the storage area of the storage unit 710 may replace all or part of the functions of the ROM 703. Also, the storage unit 710 needs to retain the stored information even when no external power is supplied to the mobile information terminal 700. Therefore, for example, devices such as non-volatile semiconductor element memories such as flash ROMs and SSDs, and magnetic disk drives such as HDDs are used.
[0175] It is assumed that each of the operation programs stored in the ROM 703 and the storage unit 710 can be added, updated, and functionally expanded by a download process from each server device on the Internet 200.
[0176] The communication processing unit 720 is composed of a LAN communication unit 721, a mobile phone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via a router device 200r or an access point 200a, and transmits and receives data with each server device and other communication devices on the Internet 200. The connection with the router device 200r or the access point 200a is assumed to be made by wireless connection such as Wi-Fi (registered trademark). The mobile phone network communication unit 722 performs telephone communication (call) and data transmission and reception by wireless communication with a base station 600b of a mobile phone communication network. The NFC communication unit 723 performs wireless communication when in proximity to a corresponding reader / writer. The LAN communication unit 721, the mobile phone network communication unit 722, and the NFC communication unit 723 are each assumed to be provided with an encoding circuit, a decoding circuit, an antenna, and the like. Further, the communication processing unit 720 may further include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.
[0177] The extended interface unit 724 is a group of interfaces for expanding the functions of the mobile information terminal 700. In this embodiment, it is assumed to be composed of a video / audio interface, a USB interface, a memory interface, and the like. The video / audio interface performs input of video signals / audio signals from an external video / audio output device, output of video signals / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to transmit and receive data. Further, a keyboard or other USB devices may be connected. The memory interface connects a memory card or other memory medium to transmit and receive data.
[0178] The operation unit 730 is an instruction input unit for inputting operation instructions to the portable information terminal 700. In this embodiment, it is assumed to be composed of a touch panel 730t arranged overlapping the display unit 741 and operation keys 730k arranged with button switches. Only one of them may be used. The operation of the portable information terminal 700 may also be performed using a keyboard or the like connected to the expansion interface unit 724. The operation of the portable information terminal 700 may also be performed using a separate terminal device connected by wired communication or wireless communication. That is, the operation of the portable information terminal 700 may be performed from the broadcast receiving device 100. Further, the touch panel function may be provided by the display unit 741 itself.
[0179] The image processing unit 740 is composed of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, for example, and provides the image data processed by the image signal processing unit 742 to the user of the portable information terminal 700. The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. Further, the image signal processing unit 742 is assumed to have functions such as performing format conversion, superimposing menu and other OSD (On Screen Display) signals as necessary. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings or an object by converting the light input from the lens into an electrical signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0180] The audio processing unit 750 is composed of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker, and provides the audio signal processed by the audio signal processing unit 752 to the user of the portable information terminal 700. The audio input unit 753 is a microphone, and converts the user's voice or the like into audio data and inputs it.
[0181] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700. In this embodiment, it is composed of a GPS receiver 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. With these sensor groups, it becomes possible to detect the position, inclination, direction, movement, and ambient brightness of the portable information terminal 700, as well as the proximity status of surrounding objects, etc. Also, the portable information terminal 700 may further include other sensors such as a barometric pressure sensor.
[0182] The portable information terminal 700 may be a mobile phone, a smartphone, a tablet terminal, etc. It may also be a PDA (Personal Digital Assistants) or a notebook PC. Further, it may be a digital still camera, a video camera capable of shooting videos, a portable game machine, a navigation device, etc., or other portable digital devices.
[0183] Note that the configuration example of the portable information terminal 700 shown in FIG. 10A includes many configurations that are not essential in this embodiment, such as the sensor unit 760, etc. However, even if these configurations are not provided, the effects of this embodiment will not be impaired. Also, configurations not shown, such as a digital broadcast reception function and an electronic money settlement function, may be further added.
[0184] [Software Configuration of Portable Information Terminal] FIG. 10B is a software configuration diagram of the portable information terminal 700 of this embodiment, showing the software configurations in the ROM 703, the RAM 704, and the storage unit 710. In this embodiment, a basic operation program 7001 and other operation programs are stored in the ROM 703, and a cooperation control program 7002 and other operation programs are stored in the storage unit 710. Also, the storage unit 710 is assumed to include a content storage area 7200 for storing contents such as videos, still images, and voices, an authentication information storage area 7300 for storing authentication information, etc. required when accessing a television receiver and each server device, and various information storage areas for storing other various information.
[0185] The basic operation program 7001 stored in the ROM 703 is expanded into the RAM 704, and further, by the main control unit 701 executing the expanded basic operation program, the basic operation execution unit 7101 is configured. Also, the cooperation control program 7002 stored in the storage unit 710 is similarly expanded into the RAM 704, and further, by the main control unit 701 executing the expanded cooperation control program, the cooperation control execution unit 7102 is configured. Also, the RAM 704 is provided with a temporary storage area for temporarily holding data created when each operation program is executed, as needed.
[0186] In the following, for the sake of simplicity, the process of the main control unit 701 expanding and executing the basic operation program 7001 stored in the ROM 703 in the RAM 704 to control each operation block will be described as the basic operation execution unit 7101 performing the control of each operation block. The same description will be made for other operation programs.
[0187] The cooperation control execution unit 7102 manages device authentication and connection, transmission and reception of each data, etc. when the mobile information terminal 700 performs a cooperation operation with the television receiver. Also, the cooperation control execution unit 7102 is provided with a browser engine function for executing an application that interlocks with the television receiver.
[0188] Each of the above operation programs may be stored in the ROM 703 and / or the storage unit 710 in advance at the time of product shipment. After product shipment, it may be acquired from other application servers 500 on the Internet 200 etc. via the LAN communication unit 721 or the mobile phone network communication unit 722. Also, each of the above operation programs stored in a memory card, an optical disk, etc. may be acquired via the expansion interface unit 724 etc.
[0189] [Time Management of Broadcast Receiver] The broadcast receiver of this embodiment has two types of time management functions. The first time management function is a time management function based on NTP, as already described with reference to FIG. 7C. The second time management function is a time management function based on MH-TOT, and is the time managed based on the time information transmitted by MH-TOT described in FIG. 6B.
[0190] An example of the configuration of the time information transmitted by NTP is shown in FIG. 13A. Also, an example of the data structure of the MPU timestamp descriptor is shown in FIG. 13B. The “reference_timestamp” parameter, “transmit_timestamp” parameter, etc. in the NTP format are 64-bit NTP long format time data, and the “mpu_presentation_time” parameter in the MPU timestamp descriptor is also 64-bit NTP timestamp format time data. The NTP long format time data and the NTP timestamp format time data are data representing “seconds or more” of UTC in 32 bits and “less than seconds” in 32 bits. That is, the time information in the NTP format can transmit time information up to “less than seconds”. Furthermore, since the time information in the NTP format is in UTC notation, unlike the clock management in conventional digital broadcasting, it can be synchronized with the NTP included in the signal received via the communication line path (for example, the communication line receivable by the LAN communication unit 121 in FIG. 7A) as shown in FIG. 3(B).
[0191] On the other hand, the information transmitted by MH-TOT is as follows. Assume that the broadcast receiving apparatus 100 can acquire the current date and the Japan Standard Time by MH-TOT. FIG. 11A shows an example of the data structure of MH-TOT. The broadcast receiving apparatus 100 can acquire the current date and the current time from the 'JST_time' parameter of the MH-TOT. As shown in FIG. 11B, the 'JST_time' parameter includes the lower 16 bits of the encoded data of the current date by the Modified Julian Date (MJD) and 24-bit information representing the Japan Standard Time (JST) in six 4-bit Binary-Coded Decimal (BCD). By performing a predetermined operation on the 16-bit encoded data of the MJD, the current date can be calculated. The six 4-bit Binary-Coded Decimals represent 'hour' in two decimal digits by two 4-bit Binary-Coded Decimals, 'minute' in two decimal digits by the next two 4-bit Binary-Coded Decimals, and 'second' in two decimal digits by the last two 4-bit Binary-Coded Decimals.
[0192] Therefore, the difference between the time based on NTP and the time based on MH-TOT is that the former NTP is information in UTC notation that can transmit time information down to 'less than a second' as described above, while the information transmitted by MH-TOT is information up to the 'second unit' in JST notation.
[0193] The broadcast receiving apparatus 100 of this embodiment can use the time management function based on NTP, which is time information in UTC notation, for synchronization processing of decoding and displaying video, audio, subtitles, character supers, and other presentation data that are the content of the broadcast signal, thereby realizing more accurate synchronization processing. Furthermore, by referring to the information in UTC notation instead of the clock notation of the broadcasting station, it is also possible to perform synchronization processing of decoding and displaying video, audio, subtitles, character supers, or other data that are the content of the broadcast signal received by the broadcast signal and video, audio, subtitles, character supers, or other data obtained via the communication line path.
[0194] Furthermore, the broadcast receiver of this embodiment may use the time management function based on "JST_time" including 24-bit information represented by six 4-bit binary-coded decimal numbers of MH-TOT for presenting the current time to the user or for each process that handles the MH-event information table (MH-EIT) described in FIG. 6B. Generally, in the process of presenting the current time to the user in a broadcast receiver, there is almost no requirement for accuracy down to less than one second. Also, each time information described in the MH-event information table (MH-EIT) is stored in decimal "hour", "minute", and "second" in 24-bit information represented by six 4-bit binary-coded decimal numbers, similar to the EIT of conventional digital broadcasts transmitted in the MPEG2-TS format. For this reason, the time management function based on MH-TOT in the broadcast receiver 100 of this embodiment is easily compatible with the processes using MH-EIT. Specifically, the processes using MH-EIT are, for example, the process of generating a program guide (described later), the control of recording reservations and viewing reservations, and copyright management processes such as temporary storage. In any of these processes, it is rare to require accuracy down to less than one second, and accuracy in one-second units is sufficient.
[0195] Also, the process of generating the program guide and copyright management processes such as the control of recording reservations and viewing reservations and temporary storage are functions also mounted on receivers of conventional digital broadcast systems using the MPEG2-TS format. Then, in the broadcast system of this embodiment as well, in processes such as the process of generating a program guide and copyright management processes such as the control of recording reservations and viewing reservations and temporary storage, if it is configured to be able to handle with a time management process that is compatible with the conventional MPEG2-TS format digital broadcast system, when configuring a broadcast receiver having both the receiving function of the conventional MPEG2-TS format digital broadcast and the receiving function of the MMT format digital broadcast, in these processes (the process of generating a program guide and copyright management processes such as the control of recording reservations and viewing reservations and temporary storage), there is no need to separately design the processing algorithms, and the cost can be reduced.
[0196] Also, even in a receiver that does not have the receiving function of the conventional MPEG2-TS digital broadcast and only has the receiving function of the MMT digital broadcast, without completely newly creating the algorithms of processes such as the program guide generation process, recording reservation and viewing reservation control, and copyright management processes such as temporary storage, the algorithms of the functions mounted on the receiver of the digital broadcast system using the conventional MPEG2-TS method can be reused, so that development can be carried out at a lower cost.
[0197] Therefore, by adopting a configuration in which the time management function based on the 'JST_time' parameter of MH-TOT is used for these processes (processes such as the program guide generation process, recording reservation and viewing reservation control, and copyright management processes such as temporary storage), even in a broadcast receiving apparatus for MMT digital broadcast, by enhancing the compatibility with the conventional broadcast system, it is possible to provide it at a lower cost.
[0198] As described above, the broadcast receiving apparatus 100 of the present embodiment has a time management function using two types of time information with different accuracies. One type of time information is time information in a notation that is compatible with the conventional digital broadcast system, and the other type of time information is time information with a higher resolution than the former. By using the latter time information for the synchronization process of each content data of the broadcast signal, a more advanced information presentation process is realized, and by using the former time information for processes such as the program guide generation process, recording reservation and viewing reservation control, and copyright management processes such as temporary storage, the broadcast receiving apparatus can be provided at a low cost.
[0199] Therefore, in the broadcast receiving apparatus 100 of the present embodiment, by providing the two types of time management functions described above, it is possible to achieve both the realization of a more advanced information presentation process and cost reduction.
[0200] [First Modification Example of Time Management] Next, the first modification example of time management in the broadcast system of the present embodiment will be described below.
[0201] In the first modification example, in order to improve the accuracy of the management time of the NTP-based time management function already described with reference to FIG. 7C, information regarding the assumed delay time in the time information transmission from a time management server (not shown) or a broadcasting station server 300 to the broadcast receiving apparatus 100 is included in the broadcast signal and transmitted, and in the broadcast receiving apparatus 100, the information regarding the assumed delay time may be configured to be used for correcting the system clock of the NTP-based time management function.
[0202] At this time, the information regarding the assumed delay time may be configured to be transmitted not within the TLV multiplexed stream shown in FIG. 3(A) but within the TMCC (Transmission and Multiplexing Configuration Control) area outside the TLV multiplexed stream. If it is transmitted within the TMCC area, in the broadcast receiving apparatus 100, it becomes possible to extract the information regarding the assumed delay time without going through the separation process (demultiplexing process) of the TLV multiplexed stream. That is, it is possible to acquire information that is less affected by the delay due to the separation process in the broadcast receiving apparatus 100, and thus, it is possible to perform a correction process for a highly accurate system clock. An example of the data structure of the time information transmitted by the TMCC signal will be described with reference to FIG. 13C. The time information may be stored and transmitted in, for example, the TMCC extended information area. In the time information of the TMCC extended information area in FIG. 13C, the 'delta' parameter represents an assumed value of the transmission delay from the time management server that distributes UTC or the server apparatus that creates the TMCC signal to a general broadcast receiving apparatus in a 32-bit signed fixed-point decimal. The upper 16 bits describe the integer part, and the lower 16 bits describe the decimal part. The 'transmit_timestamp' parameter is a transmission timestamp, and describes the time when this TMCC signal is sent from the server apparatus in the NTP timestamp length format. The upper 32 bits represent the integer part, and the lower 32 bits represent the decimal part.
[0203] In the first modification example, the broadcast receiver 100 of this embodiment can correct the system clock of the time management function based on NTP used for synchronization processing of each content data of the broadcast signal with higher accuracy by using the information regarding the assumed delay time (for example, the aforementioned 'delta' parameter and / or 'transmit_timestamp' parameter) described in the time information stored in and transmitted from the TMCC extension information area.
[0204] [Second Modification Example of Time Management] Next, a second modification example of time management in the broadcast system of this embodiment will be described below.
[0205] As described above, the broadcast receiver 100 of this embodiment has a time management function that acquires the current date and Japanese standard time based on the information transmitted by MH-TOT and manages the time. The current date and Japanese standard time acquired based on the information transmitted by MH-TOT can be output to the monitor unit 162 and the video output unit 163 and provided to the user by being superimposed on video information, application information, etc. in the video composition unit 161 of the broadcast receiver 100. As described above, MH-TOT has the data structure shown in FIG. 11A, and the broadcast receiver 100 can acquire the current date and current time from the 'JST_time' parameter of the MH-TOT.
[0206] However, in the aforementioned 'JST_time' parameter, only the lower 16 bits of the encoded data of MJD are used, so an overflow will occur after April 22, 2038, and the date after April 23, 2038 cannot be expressed by the predetermined calculation alone. Therefore, in the second modification example of this embodiment, it is assumed that the calculation method is switched depending on whether the value of MJD is equal to or greater than a predetermined value or less than the predetermined value, so that the date after April 23, 2038 can be expressed.
[0207] FIG. 12 shows an example of a first calculation method used when the value of MJD is equal to or greater than a predetermined value, and a second calculation method used when the value of MJD is less than the predetermined value. For example, when the predetermined value is set to '32768 (0x8000)', if MJD is equal to or greater than '32768', the current date is calculated using the first calculation method, and if MJD is less than '32768', the current date is calculated using the second calculation method. Note that when MJD is less than '32768', it is equivalent to the case where the most significant bit of the 16-bit data of MJD is '0'. Thereby, in the broadcast receiving apparatus 100 of the present embodiment, it is possible to represent dates after 'April 23, 2038'. However, the predetermined value can be arbitrarily set, and it may be set to '16384 (0x4000)', '49152 (0xC000)', etc. The switching condition of the calculation method may be that the upper 2 bits of the 16-bit data of MJD are '00', or the upper 2 bits of the 16-bit data of MJD are not '11'. Note that when the above-described means is used with the predetermined value set to '32768', dates before 'September 4, 1948' cannot be represented, but this is not particularly problematic in practical use as a television receiver.
[0208] Alternatively, instead of switching between the first calculation method and the second calculation method according to the comparison result between MJD and the predetermined value, the first calculation method and the second calculation method may be switched according to a flag obtained by replacing some or all of the'reserved' parameters in the MH-TOT data structure shown in FIG. 11A, or a newly added flag. For example, if the most significant bit of the 16-bit encoded data of MJD is '0', the flag may be set to '1' if MJD indicates a date after 'April 23, 2038', and set to '0' if MJD does not indicate a date after 'April 23, 2038'. Then, when the flag is '1', the second calculation method shown in FIG. 12 may be used, and when the flag is '0', the first calculation method may be used. Or, a descriptor having the same meaning as the flag may be newly prepared and arranged in MH-TOT.
[0209] Also, in the broadcast system of this embodiment, as described above, it transmits the absolute time in NTP format, and the broadcast receiving apparatus 100 of this embodiment has a time management function based on the NTP. Further, in the broadcast receiving apparatus 100 of this embodiment, by referring to the NTP timestamp etc. described in the MPU timestamp descriptor set for each MPU unit, it controls the decoding timing and presentation timing for each presentation unit of the video / audio signal. As described above, the time information in the NTP format has the configuration shown in FIG. 13A. Also, the MPU timestamp descriptor has the configuration shown in FIG. 13B.
[0210] Therefore, in the broadcast receiving apparatus 100 of this embodiment, it may refer to the'reference_timestamp' parameter, the 'transmit_timestamp' parameter, or the'mpu_presentation_time' parameter, etc., and select which of the first calculation method and the second calculation method to use according to the values of the referred time data etc. That is, for example, when the most significant bit of the 64-bit long NTP long format time data is '0', the second calculation method may be used, and when it is not '0', the first calculation method may be used, and so on.
[0211] By any of the above methods, in the broadcast receiving apparatus 100 of this embodiment, it becomes possible to express dates after 'April 23, 2038'.
[0212] [Channel selection process (initial scan) of broadcast receiving apparatus] The AMT of the broadcast system of this embodiment provides a list of IP multicast groups for receiving IP packets transmitted in the TLV multiplexing method and IP packets transmitted over the communication line with as little distinction as possible. For one service identification, it is possible to list a plurality of IP multicast groups. Also, in order to efficiently describe consecutive IP addresses, it is possible to use an address mask.
[0213] In the broadcast receiving apparatus 100 of the present embodiment, when performing channel scanning at the time of initial setting or re-scanning for setting change, it is possible to store the list of services acquired from the TLV-NIT in a non-volatile memory such as the ROM 103 or the storage unit 110. Further, it is assumed that a list of IP multicast groups corresponding to each of the services can be stored in the non-volatile memory in association with each of the services as IP-related information. By storing the list of the services and the IP-related information in the non-volatile memory so that they can be always referred to, it becomes unnecessary to re-acquire the TLV-NIT or the AMT at the time of channel switching or the like, and it becomes possible to efficiently acquire broadcast content.
[0214] FIG. 14 is a diagram showing an example of an operation sequence at the time of channel scanning (re-scanning) in the broadcast receiving apparatus 100 of the present embodiment.
[0215] When the channel scanning is started, the reception function execution unit 1102 sets an initial frequency value for the tuner / demodulation unit 131 and instructs it to perform tuning to the frequency value (S101). When the tuner / demodulation unit 131 successfully locks to the set frequency value (S102: Yes), next, the reception function execution unit 1102 acquires the TLV-NIT from the received signal (S103).
[0216] If the TLV-NIT obtained in the process of S103 is valid data (S104: Yes), the reception function execution unit 1102 acquires information such as the TLV stream ID and the original network ID from the obtained TLV-NIT (S105). FIG. 15A shows an example of the data structure of the TLV-NIT. It is assumed that the information of the TLV stream ID can be acquired from the 'tlv_stream_id' parameter, and the information of the original network ID can be acquired from the 'original_network_id' parameter, respectively. Further, distribution system information regarding the physical conditions of the broadcast transmission path corresponding to each TLV stream ID / original network ID is acquired from the distribution system descriptor (S106), and a list of service IDs is acquired from the service list descriptor (S107). FIG. 15B shows an example of the data structure of the satellite distribution system descriptor. FIG. 15C shows an example of the data structure of the service list descriptor. If the TLV-NIT has a plurality of different data such as the TLV stream ID, the original network ID, the distribution system information, and the list of service IDs, the processes of S105 to S107 are repeated. Next, the reception function execution unit 1102 creates a service list based on the data such as the TLV stream ID, the original network ID, the distribution system information, and the list of service IDs obtained in the processes of S105 to S107, and stores (updates during rescan) the created service list in the ROM 103 or the storage unit 110, etc. (S108).
[0217] Next, the reception function execution unit 1102 acquires the AMT from the received signal (S109), and further acquires a list of IP multicast groups related to each service ID stored in the service list (S110). FIG. 15D shows an example of the data structure of the AMT. When the AMT has a list of IP multicast groups related to a plurality of service IDs, the process of S110 is repeated. When there are a plurality of AMTs having lists of IP multicast groups related to different service IDs, the processes of S109 to S110 are repeated. Next, the reception function execution unit 1102 stores (updates during rescan) the list of IP multicast groups acquired in the process of S110 in the ROM 103 or the storage unit 110 or the like, in association with the service ID, as IP-related information (S111).
[0218] Note that if in the process of S102, the tuner / demodulation unit 131 fails to lock to the set frequency value (S102: No), and if the TLV-NIT acquired in the process of S103 is not valid data (S104: No), the processes of S105 to S111 are not performed.
[0219] When the process of S111 is completed, if the frequency value set in the tuner / demodulation unit 131 is the final frequency value in the channel scan range (S112: Yes), the reception function execution unit 1102 ends the process. On the other hand, if the set frequency value is not the final frequency value in the channel scan range (S112: No), the frequency value set in the tuner / demodulation unit 131 is incremented (S113), and the processes of S102 to S111 are repeated. Note that when all service IDs related to all services constituting the broadcast network can be acquired with one TLV-NIT, and further, an AMT having a list of IP multicast groups related to the service ID can be acquired, the processes of S112 to S113 are unnecessary.
[0220] Through the above series of processes, when the broadcast receiver 100 of this embodiment performs channel scanning during initial setting or re-scanning for setting changes, it can create / update a list (service list) of services constituting the broadcast network and simultaneously create / update a list (IP-related information) of IP multicast groups corresponding to each service, and further store it in a non-volatile memory such as the ROM 103 or the storage unit 110.
[0221] Note that the re-scanning for the setting change may be automatically performed when it is detected that there is a change in the information in the table by referring to the 'version_number' parameter of TLV-NIT or AMT. When a change in the'version_number' parameter of either TLV-NIT or AMT is detected, only the information related to the table in which the change in the parameter is detected may be automatically updated. However, when the above automatic update is performed, it is desirable to notify the user that the re-scanning has been automatically performed. Also, the user may be notified that there is a change in the information in the table and be allowed to select whether to perform the re-scanning.
[0222] [Station Selection Process (Channel Switching) of Broadcast Receiver] FIG. 16 is a diagram showing an example of an operation sequence during station selection (channel switching) in the broadcast receiver 100 of this embodiment.
[0223] When the user operates a remote controller (not shown) or the like to instruct channel switching, the reception function execution unit 1102 interprets the command transmitted from the remote controller and designates the service ID of the target service (S201). Next, the reception function execution unit 1102 starts acquiring the AMT from the reception signal of the tuner / demodulation unit 131. If the acquisition of the AMT is successful within a predetermined time (S202: Yes), information regarding the list of IP multicast groups corresponding to the service ID is acquired from the acquired AMT (S204). On the other hand, if the acquisition of the AMT is not successful within a predetermined time (S202: No), information regarding the list of IP multicast groups corresponding to the service ID is acquired by referring to the IP-related information stored in the ROM 103 or the storage unit 110 or the like (S203) (S204). Note that the determination process of S202 may not be performed, and the IP-related information stored in the ROM 103 or the storage unit 110 or the like may always be referred to.
[0224] Next, the reception function execution unit 1102 starts acquiring the TLV-NIT from the reception signal of the tuner / demodulation unit 131. If the acquisition of the TLV-NIT is successful within a predetermined time (S205: Yes), distribution system information for acquiring the IP data flow corresponding to the service ID is acquired from the acquired TLV-NIT (S207). On the other hand, if the acquisition of the TLV-NIT is not successful within a predetermined time (S205: No), distribution system information for acquiring the IP data flow corresponding to the service ID is acquired by referring to the service list stored in the ROM 103 or the storage unit 110 or the like (S206) (S207). Note that the determination process of S205 may not be performed, and the service list stored in the ROM 103 or the storage unit 110 or the like may always be referred to. When the distribution system information is acquired in the process of S207, next, the reception function execution unit 1102 controls the tuner / demodulation unit 131 with the frequency value indicated by the acquired distribution system information, receives the IP data flow corresponding to the service ID (S208), extracts the MMT data sequence from the received IP data flow, and outputs it to the separation unit 132.
[0225] In the separation unit 132, the transport processing unit 1102a acquires an MMTP packet whose packet ID is '0' from the input MMT data sequence (S209), and further acquires the MPT included in the acquired MMTP packet (S210). Next, the transport processing unit 1102a refers to the 'MMT_package_id_byte' parameter of the acquired MPT, and checks whether the lower 16 bits of the 'MMT_package_id_byte' parameter are the same value as the service ID. In an example of the data structure of the MPT shown in FIG. 17, when the lower 16 bits of the 'MMT_package_id_byte' parameter are the same value as the service ID (S211: Yes), it is determined that the MMTP packet whose packet ID is '0' is an MMTP packet having the data of the program corresponding to the service ID, and the acquisition of the MFU is executed based on the information of the acquired MPT (S216).
[0226] On the other hand, when the lower 16 bits of the 'MMT_package_id_byte' parameter are not the same value as the service ID (S211: No), it is determined that the MMTP packet whose packet ID is '0' is not an MMTP packet having the data of the program corresponding to the service ID. In this case, the transport processing unit 1102a acquires the PLT again (S212), and by checking the acquired PLT, checks the packet ID (denoted as x) of the MMTP packet that transmits the MPT having the 'MMT_package_id_byte' parameter corresponding to the service ID (S213). Further, the transport processing unit 1102a acquires an MMTP packet whose packet ID is 'x' from the input MMT data sequence (S214), and acquires the MPT included in the acquired MMTP packet (S215). Further, the MFU is acquired based on the information of the acquired MPT (S216).
[0227] Note that, instead of performing the processes of S209 to S211, the processes of S212 to S215 may always be performed. In this case, when the data of the program corresponding to the service ID is stored in an MMTP packet other than the packet ID '0', the processing time can be shortened.
[0228] When the MFU is acquired in the process of S216, the transport processing unit 1102a extracts encoded video data, encoded audio data, etc. from the acquired MFU and outputs them to the video decoder 141, the audio decoder 143, etc. Hereinafter, video / audio decoding processing based on the control of the AV decoding processing unit 1102b and presentation processing based on the control of the presentation processing unit 1102h are performed. However, since each of the above processes is well-known, detailed description thereof is omitted.
[0229] Through the above series of processes, the broadcast receiving apparatus 100 of the present embodiment can execute a channel selection (channel switching) operation. In particular, as described with reference to FIGS. 14 and 16, at the time of channel scanning during initial setting or at the time of re-scanning for setting change, a service list and IP-related information are created and stored in a non-volatile memory such as the ROM 103 or the storage unit 110 so that they can be always referred to. When performing channel selection (channel switching), by referring to the service list and IP-related information stored in the non-volatile memory such as the ROM 103 or the storage unit 110, it is possible to improve the efficiency of the operation at the time of channel selection (channel switching). That is, it is possible to shorten the time from the start to the end of channel selection (channel switching) compared to the case where AMT and TLV-NIT are re-acquired at the time of channel selection (channel switching).
[0230] [Screen Layout Control of Broadcast Receiving Apparatus] In the broadcast receiving apparatus 100 of the present embodiment, it is assumed that screen layout control based on the description of the LCT is possible. FIG. 18 shows an example of the data structure of the LCT.
[0231] In the figure, in particular, the `left_top_pos_x` parameter and the `right_down_pos_x` parameter indicate the horizontal position of the upper left corner and the horizontal position of the lower right corner of the region, respectively, as a ratio to the total number of horizontal pixels when the left side of the full-screen display is set to '0' and the right side is set to '100'. The `left_top_pos_y` parameter and the `right_down_pos_y` parameter indicate the vertical position of the upper left corner and the vertical position of the lower right corner of the region, respectively, as a ratio to the total number of vertical pixels when the upper side of the full-screen display is set to '0' and the lower side is set to '100'. Also, the `layer_order` parameter indicates the relative position in the depth direction of the region.
[0232] Examples of allocating the layout to the layout number based on the settings of the respective parameters are shown in FIGS. 19A to D together with the set values of the respective parameters.
[0233] FIG. 19A shows a default layout setting of the broadcast receiving apparatus 100 of the present embodiment, which is an example of setting only one region on the entire screen. FIG. 19B shows an example in the case where the entire screen is divided into three regions, and the respective regions are set as 'Region 0', 'Region 1', and 'Region 2'. For example, when the number of pixels of the entire screen is 7680 pixels horizontally / 4320 pixels vertically, since the `left_top_pos_x` parameter of 'Region 0' is '0', the `left_top_pos_y` parameter is '0', the `right_down_pos_x` parameter is '80', and the `right_down_pos_y` parameter is '80', it is set in the range of (0,0)-(6143,3455). Similarly, 'Region 1' is set in the range of (6144,0)-(7679,4319), and 'Region 2' is set in the range of (0,3456)-(6143,4319).
[0234] FIG. 19C is an example of setting three regions in the same way as FIG. 19B. However, "Region 0" is set in the range of (0,0)-(7679,4319), and "Regions 1" and "2" are in the same range as described above. Depending on the setting of the "layer_order" parameter, they are arranged in front of "Region 0". FIG. 19D is an example where "Region 0" is set for Device 0 (default device: the broadcast receiving apparatus 100 in this embodiment), and "Region 1" is set for Device 1 (in this embodiment, the portable information terminal 700).
[0235] As described above, in the broadcast system of this embodiment, by using the LCT, it becomes possible to perform screen layout control for displaying multimedia services on the receiver as intended by the service provider.
[0236] Note that when dividing the screen according to the set values of parameters such as the above-mentioned "left_top_pos_x", fractional parts generated can be processed by rounding up, rounding down, etc. Rounding (or round-to-nearest in binary) processing may also be used. For example, when the number of pixels of the entire screen is 7680 pixels / vertical 4320 pixels, and the "left_top_pos_x" parameter of "Region 0" is "0", the "left_top_pos_y" parameter is "0", the "right_down_pos_x" parameter is "51", and the "right_down_pos_y" parameter is "51", "Region 0" may be set in the range of (0,0)-(3916,2203) by rounding up, or "Region 0" may be set in the range of (0,0)-(3915,2202) by rounding down. Also, considering macroblocks during video compression processing, rounding up / rounding down processing in units of 8 pixels, 16 pixels, etc. may be performed. By the above processing, it becomes possible to efficiently perform region setting based on the LCT and resolution conversion processing of multimedia content in the region.
[0237] [Exception Handling for Screen Layout Control of Broadcast Receiving Apparatus] In the broadcast receiving apparatus 100 of the present embodiment, even when the area control of the screen layout is performed by the aforementioned LCT, when the user instructs the display of the EPG screen or the like, as an exception process, it is possible to perform screen layout control that ignores the description content of the LCT. FIG. 20A shows an example of the operation of the exception process of the screen layout control based on the LCT.
[0238] When the screen layout control similar to that in FIG. 19B is performed according to the description of the LCT, the broadcast program video is displayed in the 'area 0', and broadcast contents such as program link data linked to the broadcast program are displayed in the 'area 1' and the 'area 2'. When the user instructs the display of the EPG screen by a remote control (not shown), in the broadcast receiving apparatus 100 of the present embodiment, as shown in FIG. 20A(A), regardless of the description content of the LCT, the screen layout setting is returned to the default setting (that is, the state where the screen layout control similar to that in FIG. 19A is performed), and the EPG screen is controlled to be displayed on the entire screen. Further, when the user instructs the end of the display of the EPG screen, the screen layout control according to the description content of the LCT is re-executed.
[0239] By performing the above control, compared with the case of displaying the EPG screen while maintaining the area control of the screen layout as shown in FIG. 20A(B), the EPG screen can be displayed larger, and the visibility can be improved.
[0240] Note that the exception process of the screen layout control is not only applied when the EPG screen is displayed, but may also be applied when a sub-screen is displayed or when a two-screen display is performed on various setting screens (in the illustrated example, the recording setting screen) of the broadcast receiving apparatus 100, as shown in FIG. 20B.
[0241] In the case of the recording setting screen shown in FIG. (A), the display area of the broadcast content is changed from the entire screen to only the sub-screen part in the lower right of the screen. Similarly, in the case of the two-screen display shown in FIG. (B), the display area of the broadcast content is changed from the entire screen to only the split-screen part on the left side in the middle of the screen. In both cases, since the display area for displaying the broadcast content becomes narrower compared to the case of using the entire screen, it is not visually preferable to maintain the area control of the screen layout within the said display area (i.e., while performing area division and displaying a plurality of broadcast contents simultaneously). Therefore, in the broadcast receiving apparatus 100 of the present embodiment, in such a situation, only the broadcast content of 'Area 0' is selected and displayed in the said display area. Note that, according to the previous area selection situation, the broadcast content of 'Area 1' or 'Area 2' may be selected and displayed.
[0242] By performing the above control, it becomes possible to improve the visibility of the broadcast content compared to the case of displaying various broadcast contents while maintaining the area control of the screen layout. The same applies to the sub-screen display on the recording program list screen and the browser display of Internet content, etc.
[0243] [EPG Display of Broadcast Receiving Apparatus] In the broadcast system of this embodiment, it is assumed that the time series information regarding events (so-called programs) included in each service constituting the broadcast network is transmitted by MH-EIT. Fig. 21 shows an example of the data structure of MH-EIT of this embodiment. MH-EIT is identified into two classes by a table ID (corresponding to the 'talbe_id' parameter in the figure), and it is assumed that it can indicate the information of the current / next event of its own TLV stream and the schedule information of each event of its own TLV stream. The broadcast receiving apparatus 100 of this embodiment can acquire information such as the start time and broadcast time of each event by performing identification by service ID (corresponding to the'service_id' parameter in the figure) with reference to the MH-EIT and create an EPG screen, and it is assumed that the created EPG can be superimposed on video information and the like by the video composition unit 161 and displayed on the monitor unit 162.
[0244] Fig. 22A is a diagram showing an example of an EPG screen in the broadcast receiving apparatus 100 of this embodiment. The EPG screen 162a has a matrix shape with the vertical axis representing time display and the horizontal axis representing service ID (channel), and displays detailed information of the broadcast programs broadcast on each channel in each time zone. Further, the detailed information 162a1 of each broadcast program mainly consists of a title area 162a2 and a detailed description area 162a3.
[0245] In the title area 162a2, the program title of the broadcast program and symbols representing the attributes of the broadcast program are displayed. The symbols representing the attributes of the broadcast program are, for example, symbols / characters indicating that it is a new program, symbols / characters indicating that it is a rebroadcast program, etc. Alternatively, it may be a symbolized mark such as 'data' meaning that it corresponds to data broadcast by the broadcast service. Also, it may be a symbolized mark 162a4 such as 'NetWork' meaning that contents and applications related to the broadcast program can be acquired from the network. Further, by differentiating the background color of the detailed information 162a1 from others, or by surrounding the display area of the detailed information 162a1 with a thick frame, symbols representing the attributes of the broadcast program may be substituted.
[0246] Note that, even when it is shown that each control information (message, table, descriptor, etc.) in the broadcast system of this embodiment allows content, applications, etc. related to the broadcast program to be acquired from the network, if the LAN cable is not connected to the LAN communication unit 121 of the broadcast receiving apparatus 100 or the like, and access to each server apparatus on the network is not possible, control may be performed so as not to display the mark 162a4 or the like in which the “NetWork” is symbolized.
[0247] Further, when the broadcast program is a distribution program distributed via the Internet 200 and cannot be acquired only from the broadcast wave, and further, when the broadcast receiving apparatus 100 cannot access each server apparatus on the network as in the foregoing, control may be performed so as to gray out the portion of the detailed information 162b1 displayed on the EPG screen 162b as shown in FIG. 22B. That is, control is performed so as not to display the detailed information of the distribution program that cannot be viewed. Further, as an alternative to the graying-out process, the background color of the detailed information 162b1 may be differentiated from others. When the detailed information 162b1 is selected by operating a remote controller (not shown), the user may be notified by a pop-up or the like that the broadcast receiving apparatus 100 cannot access each server apparatus on the network or that the distribution program associated with the detailed information 162b1 cannot be viewed.
[0248] By the above-described respective controls, the broadcast receiving apparatus 100 can provide the program information of each broadcast program to the user in a form that causes less discomfort according to the network connection status.
[0249] FIG. 22C is a diagram showing another example of the EPG screen in the broadcast receiving apparatus 100 of the present embodiment. In the figure, “M1 TV”, “M2 Broadcast”, “M3 Channel”, “M4 TV”, “TV M5”, etc. are the names of the broadcast stations of each channel. In particular, the “M2 Broadcast” station is assumed to simultaneously provide a broadcast program distributed by a broadcast wave and a distribution program distributed via the Internet 200 (information 162c1 in the frame indicated by “Internet Broadcast” in the figure).
[0250] As shown in the figure, when there is a channel having only a distribution program distributed via the Internet 200, normally, it is controlled to display information of all channels as shown in the EPG screen 162c of FIG. 4A (including information 162c1). On the other hand, when the broadcast receiving apparatus 100 is in a state where it cannot access each server apparatus on the network or the like, as shown in the EPG screen 162d of FIG. 4B, the information of the channel of “M2 Broadcast (Internet Broadcast)” having only a distribution program distributed via the Internet 200 (information 162c1 in FIG. 4A) may not be displayed.
[0251] By the above-described respective controls, the user of the broadcast receiving apparatus 100 can be made unnecessary to check the information of channels that he / she cannot view.
[0252] [Emergency Warning Broadcast Display of Broadcast Receiving Apparatus] It is assumed that the broadcast receiving apparatus 100 of the present embodiment can perform reception processing of an emergency warning broadcast when an emergency warning broadcast activation control signal bit of a TMCC signal included in transmission data including a TLV stream changes from “0” to “1”.
[0253] The emergency warning broadcast may be provided as an application for full-screen display, or may be provided as character information in a character super. When the emergency warning broadcast is provided as character information in a character super, it is preferable to display the character information of the character super regardless of the state of the broadcast receiving apparatus 100 immediately before receiving the emergency warning broadcast. That is, as shown in FIG. 23, when the user is viewing a normal broadcast program and the emergency warning broadcast is received while the program screen 162e of the broadcast program is displayed on the monitor unit 162, the character information 162e1 by the emergency warning broadcast is superimposed and displayed on the program screen 162e. Similarly, when the user instructs to display the EPG screen and the emergency warning broadcast is received while the EPG screen 162f is displayed on the monitor unit 162, control is performed so that the character information 162f1 by the emergency warning broadcast is superimposed and displayed on the EPG screen 162f.
[0254] By the above control, in the broadcast receiving apparatus 100 of the present embodiment, even when the user selects and displays an EPG screen, various setting screens, a recorded program list screen, an Internet browser, etc., when the emergency warning broadcast is received, it is possible to avoid overlooking important character information based on the emergency warning broadcast. Note that this control may be performed on the character information of a normal character super not based on the emergency warning broadcast.
[0255] [Various Exception Processes] The broadcast receiving apparatus 100 of the present embodiment may perform exception processing as follows, for example, when data outside the TLV stream in the same package cannot be acquired.
[0256] As described with reference to FIG. 6E, in the broadcast reception system to which the broadcast reception apparatus 100 of this embodiment corresponds, based on the location information stored in the MPT (corresponding to “MMT_general_location_info()” in FIG. 17), data acquired within the TLV stream and data acquired via a path other than the TLV stream can be included in the same package. However, the data transmission paths other than the TLV stream indicated by the location information (for example, IPv4 data flow, IPv6 data flow, broadcast MPEG2-TS, etc.) are reception functions different from the reception function of the TLV / MMT stream. Therefore, even during the operation of the broadcast reception apparatus 100, there may be situations where the reception functions of these transmission paths are not operating, or where the relay device etc. is not operating even though the reception function itself is operating, or where the wired or wireless connection of these transmission paths is not established, or where the broadcast reception apparatus 100 is installed in an environment where these transmission paths cannot be connected at all, etc., and thus there may be situations where data cannot be acquired from these transmission paths.
[0257] Under such circumstances, when the broadcast reception apparatus 100 of this embodiment receives an event indicating that the location information stored in the MPT is associated so as to include data acquired within the TLV stream and data acquired via a path other than the TLV stream in the same package, the broadcast reception apparatus 100 may perform operations such as the following, for example.
[0258] For example, when the LCT has set a plurality of regions within the screen as shown in FIGS. 19B and 19C, and the video included in the TLV stream is displayed in 'Region 0', and the data obtained through a transmission path other than the TLV stream is associated with being displayed in 'Region 1' and 'Region 2', and when the data of the transmission path other than the TLV stream to be displayed in 'Region 1' and 'Region 2' cannot be obtained, the LCT may prohibit the layout display of the plurality of regions. Specifically, even when receiving the LCT, the video of the content received within the TLV stream may be displayed in 'Region 0' of the default layout display shown in FIG. 19A, and the transition to the layout display of the plurality of regions such as in FIGS. 19B and 19C may be prevented. Further, even if a change instruction from the default layout to the layout indicated by the LCT is input to the operation input unit 170 in FIG. 7A in this state, the display may remain in the default layout display shown in FIG. 19A, or may be switched to other data broadcast screens, etc., so as not to transition to the layout display of the plurality of regions such as in FIGS. 19B and 19C.
[0259] As another operation example when the LCT has set a plurality of regions within the screen as shown in FIGS. 19B and 19C, and the video included in the TLV stream is displayed in 'Region 0', and the data obtained through a transmission path other than the TLV stream is associated with being displayed in 'Region 1' and 'Region 2', and when the data of the transmission path other than the TLV stream to be displayed in 'Region 1' and 'Region 2' cannot be obtained, first, the display frames of the plurality of regions in FIGS. 19B and 19C indicated by the LCT are displayed, and for 'Region 1' and 'Region 2', a background color or a predetermined still image is displayed. If the data of the transmission path other than the TLV stream indicated by the location information of the MPT cannot be obtained even after a predetermined time has elapsed, a display switching may be performed to return to the state of the default layout display shown in FIG. 19A. In this case, if the program video included in the TLV stream is continuously displayed in 'Region 0' even when changing the layouts of FIGS. 19A, 19B, and 19C, it is preferable because the user's program video itself continues.
[0260] In addition, when the data of transmission paths other than the TLV stream to be displayed in "Region 1" or "Region 2" cannot be acquired, and the video of the content received within the TLV stream is being displayed in "Region 0" of the default layout display shown in FIG. 19A, when the operations of various communication functions and various reception functions of the broadcast receiving apparatus 100 of the present embodiment start, or when the communication environment, communication status of various communication functions, reception environment, and reception status of various reception functions change, it may become a situation where the data of transmission paths other than the TLV stream to be displayed in "Region 1" or "Region 2" can be acquired. In this case, the broadcast receiving apparatus 100 of the present embodiment may immediately switch from the default layout display shown in FIG. 19A to a layout of a plurality of regions as shown in FIGS. 19B and 19C indicated by the LCT, display the video of the content received within the TLV stream in "Region 0", and switch to display the data acquired from transmission paths other than the TLV stream in "Region 1" and "Region 2". Further, instead of immediately performing the layout change, the layout change may be executed after an instruction to change from the default layout to the layout indicated by the LCT is input from the operation input unit 170.
[0261] [Copyright protection function] In the digital broadcast system compatible with the broadcast receiving apparatus 100 of the present embodiment, by transmitting while including copy control information in the MPT, for example, by the copy control information, "copyable without restriction" (it may be divided into two types: "copyable without restriction and encryption processing required at the time of storage and output" and "copyable without restriction and encryption processing not required at the time of storage and output"), "copyable only once", "copyable a predetermined number of times" (for example, if it is copyable 9 times + moveable once, so-called "dubbing 10"), "copy prohibited", etc., it may be configured to transmit indicating the copy control state of the content referred to by the MPT. In this case, the broadcast receiving apparatus 100 of the present embodiment may be configured to control storage of the content in the storage (accumulation) unit 110, recording on a removable recording medium, output to an external device, copying to an external device, move processing to an external device, etc. according to the copy control information. Note that the target of the storage process may include not only the storage (accumulation) unit 110 inside the broadcast receiving apparatus 100, but also recordings subjected to protection processes such as encryption processing so that they can be reproduced only by the broadcast receiving apparatus 100. Specifically, the target of the storage process includes those that are made recordable and reproducible only by the broadcast receiving apparatus 100 among external recording devices and the like.
[0262] A specific example of the process based on the copy control information will be described below.
[0263] First, when the copy control information included in the MPT indicates "copyable without restriction", the broadcast receiving apparatus 100 of the present embodiment may perform storage in the storage (accumulation) unit 110, recording on a removable recording medium, output to an external device, copying to an external device, and move processing to an external device without restriction. However, when "copyable without restriction and encryption processing required at the time of storage and output" and "copyable without restriction and encryption processing not required at the time of storage and output" are separated, in the case of "copyable without restriction and encryption processing required at the time of storage and output", storage in the storage (accumulation) unit 110, recording on a removable recording medium, output to an external device, copying to an external device, and move processing to an external device can be performed without restriction on the number of times, but encryption processing needs to be performed on all of them.
[0264] Also, when the copy control information included in the MPT indicates "Copyable only for one generation", the broadcast receiving apparatus 100 of the present embodiment enables encrypted storage in the storage (accumulation) unit 110. However, when outputting the accumulated content to an external device for viewing, it shall be output after encryption together with the copy control information of "Copy prohibited". However, so-called move processing to an external device (a process of copying the content to the external device and making the content in the storage (accumulation) unit 110 of the broadcast receiving apparatus 100 unplayable by means such as erasure processing) is possible.
[0265] Also, when the copy control information included in the MPT indicates "Copyable a predetermined number of times", the broadcast receiving apparatus 100 of the present embodiment enables encrypted storage in the storage (accumulation) unit 110. However, when outputting the accumulated content to an external device for viewing, it shall be output after encryption together with the copy control information of "Copy prohibited". However, it is acceptable to enable a predetermined number of copies and move processing to an external device. In the case of the so-called "Dubbing 10" regulation, it is acceptable to perform 9 copies and 1 move processing to an external device.
[0266] Also, when the copy control information included in the MPT indicates "Copy prohibited", the broadcast receiving apparatus 100 of the present embodiment prohibits copying to the storage (accumulation) unit 110. However, when the broadcast receiving apparatus 100 is configured to have a "temporary storage" mode that enables holding in the storage (accumulation) unit 110 only for a predetermined time determined in advance or for a predetermined time specified by control information included in the broadcast signal (for example, by an MH-Expire descriptor shown in FIG. 6D), even when the copy control information included in the MPT indicates "Copy prohibited", temporary holding of the content in the storage (accumulation) unit 110 is possible. When outputting the content for which the copy control information included in the MPT indicates "Copy prohibited" to an external device for viewing, it shall be output after encryption together with the copy control information of "Copy prohibited".
[0267] Note that the output for viewing on the aforementioned external device may be performed via the video output unit 163 and the audio output unit 166 in Fig. 7A, or via the digital I / F unit 125, the LAN communication unit 121, etc. The copy or move process to the aforementioned external device may be performed via the digital I / F unit 125, the LAN communication unit 121, etc. in Fig. 7A.
[0268] According to the processes described above, appropriate content protection can be realized according to the copy control information associated with the content.
[0269] Also, regarding the copy process of content indicating copy restrictions such as 'copyable only for one generation', 'copyable a predetermined number of times', 'copy prohibited', etc. to an external device via the LAN communication unit 121, it is only possible when the IP address of the external device, which is the destination of the transmission packet from the broadcast receiving apparatus 100, is within the same subnet as the IP address of the broadcast receiving apparatus 100, and it may be prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving apparatus 100. Content with copy control information of 'copyable without restriction and encryption processing required during storage and output' may be treated similarly.
[0270] Similarly, regarding the process of moving content indicating copy restrictions such as 'copyable only for one generation', 'copyable a predetermined number of times', 'copyable without restriction and encryption processing required during storage and output', etc. to an external device via the LAN communication unit 121 after once storing (accumulating) it in the storage (accumulation) unit 110, it is only possible when the IP address of the external device, which is the destination of the transmission packet from the broadcast receiving apparatus 100, is within the same subnet as the IP address of the broadcast receiving apparatus 100, and it may be prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving apparatus 100.
[0271] Regarding the video output for viewing and audio output of the content stored in the storage (accumulation) unit 110 of the broadcast receiving device 100, in principle, it is only possible when the IP address of the external device, which is the destination of the transmission packet from the broadcast receiving device 100, is within the same subnet as the IP address of the broadcast receiving device 100, and it is prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. However, if the external device is connected within the same subnet as the IP address of the broadcast receiving device 100 within a predetermined period, and a registration process (pairing) has been performed as a device that can also be viewed outside the same subnet as the IP address of the broadcast receiving device 100, then even if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100, it may be configured to enable video output for viewing and audio output of the content stored in the storage (accumulation) unit 110 of the broadcast receiving device 100 to the external device. In this case, the video output for viewing and audio output are performed after encrypting the content.
[0272] According to the process described above, by performing different processes corresponding to whether the external device is within the same subnet as the IP address of the broadcast receiving device 100 or outside the same subnet, it is possible to achieve both user convenience and content protection.
[0273] Next, as described with reference to FIG. 6E, in the digital broadcast system corresponding to the broadcast receiving device 100 of this embodiment, depending on the location information in the MPT (『MMT_general_location_info()』 in FIG. 17), data obtained through a different path (IPv4, IPv6, MPEG2-TS, URL, etc.) than the data obtained in the TLV stream of the broadcast path may be included in the same packet and the same event as the data obtained in the TLV stream. At this time, content protection when copy control information is included in the MPT will be described.
[0274] First, when copy control information is included in the MPT, even if the data included in the same package and the same event in the location information is data obtained through a different path (IPv4, IPv6, MPEG2-TS, URL, etc.) from the data obtained in the TLV stream of the broadcast path, it may be controlled according to the copy control information included in the TLV stream. As the copy control state of the specified content by these copy control information, as described above, 'Copyable without restriction' (which may be divided into two types: 'Copyable without restriction and encryption processing required during accumulation and output' and 'Copyable without restriction and encryption processing not required during accumulation and output'), 'Copyable only once', 'Copyable a predetermined number of times' (for example, if it is copyable 9 times + movable once, it is so-called 'Dubbing 10'), 'Copy prohibited', etc. may be specified.
[0275] Here, when the position of the data indicated by the location information includes MPEG2-TS data transmitted by another digital broadcast signal, the MPEG2-TS data is also broadcast in association with copy control information by another digital broadcast signal. Then, the problem becomes how to perform copy control of the MPEG2-TS data according to which information and in what manner (according to the copy control information included in the TLV / MMT stream or according to the copy control information included in the MPEG2-TS).
[0276] In the digital broadcast system of this embodiment, as a solution to this problem, in the broadcast receiving apparatus 100, any one of the following plurality of solutions may be operated.
[0277] <Operation Example 1> In the first operation example, when copy control information is included in the MPT and the data included in the same package and the same event in the location information includes MPEG2-TS data transmitted by another digital broadcast signal, the copy control state indicated by the copy control information included in the TLV stream is preferentially controlled over the copy control state indicated by the copy control information included in the MPEG2-TS.
[0278] For example, if the copy control state indicated by the copy control information included in the TLV stream is "copyable for one generation" and the copy control state indicated by the copy control information included in the MPEG2-TS is "copyable a predetermined number of times", even if the data is obtained through a path different from the data obtained from the TLV stream (digital broadcast in the MPEG2-TS transmission format), copy control may be performed as content that is "copyable for one generation". For example, if the copy control state indicated by the copy control information included in the TLV stream is "unrestricted copyable" and the copy control state indicated by the copy control information included in the MPEG2-TS is "copyable a predetermined number of times", even if the data is obtained through a path different from the data obtained from the TLV stream (digital broadcast in the MPEG2-TS transmission format), copy control may be performed as content that is "unrestricted copyable".
[0279] In this operation case, for the data obtained through a path other than the TLV stream, the broadcast receiving apparatus 100 of the present embodiment can set the copy state to be managed in the corresponding broadcast system.
[0280] <Operation Example 2> In the second operation example, when the MPT includes copy control information and the MPEG2-TS data transmitted by another digital broadcast signal is included in the data in the same package and the same event in terms of location information, the copy control state indicated by the copy control information included in the TLV stream is compared with the copy control state indicated by the copy control information included in the MPEG2-TS. When the copy control state indicated by the copy control information included in the MPEG2-TS is stricter than the copy control state indicated by the copy control information included in the TLV stream, when performing the storage process to the storage (accumulation) unit 110, the recording process to the removable recording medium, or the output process from the digital interface, the data of the MPEG2-TS is excluded from the content to be processed and operates accordingly.
[0281] In this operation, for data obtained through a path other than the TLV stream, while respecting the original copy control information set in the broadcast system that transmits the data, it is possible to eliminate the duplication of the copy control state on the broadcast receiver 100 of this embodiment.
[0282] Also, as a result of the comparison, when the copy control state indicated by the copy control information included in the MPEG2-TS is the same state as or a looser copy control state than the copy control state indicated by the copy control information included in the TLV stream, for the data of the MPEG2-TS included in the same package and the same event in the location information, copy control may be performed as the content of the copy control state indicated by the copy control information included in the TLV stream.
[0283] In this operation, for data obtained through a path other than the TLV stream, while respecting the original copy control information set in the broadcast system that transmits the data, it is possible to eliminate the duplication of the copy control state on the broadcast receiver 100 of this embodiment.
[0284] In the above description, the copyright protection function of the broadcast receiver 100 of this embodiment has been described as being performed based on the copy control information included in the MPT. However, the table in which the copy control information is arranged is not limited to the MPT. In addition to the MPT, it may be arranged and transmitted in the MH-Service Description Table (MH-SDT) or MH-Event Information Table (MH-EIT) described in FIG. 6B, or other tables, and the broadcast receiver 100 may perform copyright protection processing according to these.
[0285] According to the embodiment described above, it is possible to provide a broadcast receiver corresponding to MMT digital broadcasting. (Embodiment 2)
[0286] Hereinafter, Example 2 of the present invention will be described. Note that the configurations, processes, effects, etc. in this example are the same as those in Example 1 unless otherwise specified. Therefore, hereinafter, the differences between this example and Example 1 will be mainly described, and the common points will be omitted as much as possible to avoid duplication. In addition, the broadcast receiving apparatus in this example is a television receiver that supports both the MMT method and the MPEG2-TS method as media transport methods, and the description will be given below.
[0287] [Hardware Configuration of Broadcast Receiving Apparatus] FIG. 24 is a block diagram showing an example of the internal configuration of the broadcast receiving apparatus 800. The broadcast receiving apparatus 800 includes a main control unit 801, a system bus 802, a ROM 803, a RAM 804, a storage unit 810, a LAN communication unit 821, an expansion interface unit 824, a digital interface unit 825, a first tuner / demodulation unit 831, a second tuner / demodulation unit 832, an MMT decoding processing unit 841, an MPEG2-TS decoding processing unit 842, a video synthesis unit 861, a monitor unit 862, a video output unit 863, an audio synthesis unit 864, a speaker unit 865, an audio output unit 866, and an operation input unit 870.
[0288] The main control unit 801, the system bus 802, the ROM 803, the RAM 804, the storage unit 810, the expansion interface unit 824, the digital interface unit 825, the monitor unit 862, the video output unit 863, the speaker unit 865, the audio output unit 866, the operation input unit 870, etc. have the same functions as the main control unit 101, the system bus 102, the ROM 103, the RAM 104, the storage (accumulation) unit 110, the expansion interface unit 124, the digital interface unit 125, the monitor unit 162, the video output unit 163, the speaker unit 165, the audio output unit 166, the operation input unit 170, etc. in the broadcast receiving apparatus 100 of Example 1, respectively, and detailed descriptions thereof are omitted.
[0289] The first tuner / demodulator unit 831 receives the broadcast wave of a broadcast service that adopts MMT as a media transport method via an antenna (not shown), and tunes (selects a channel) to the channel of the service desired by the user based on the control of the main control unit 801. Further, the first tuner / demodulator unit 831 demodulates the received broadcast signal to obtain an MMT data sequence, and outputs it to the MMT decode processing unit 841. The second tuner / demodulator unit 832 receives the broadcast wave of a broadcast service that adopts MPEG2-TS as a media transport method via an antenna (not shown), and tunes (selects a channel) to the channel of the service desired by the user based on the control of the main control unit 801. Further, the second tuner / demodulator unit 832 demodulates the received broadcast signal to obtain an MPEG2-TS data sequence, and outputs it to the MPEG2-TS decode processing unit 842.
[0290] The MMT decode processing unit 841 inputs the MMT data sequence output from the first tuner / demodulator unit 831, and performs separation processing, decoding processing, etc. on the video data sequence, audio data sequence, character super data sequence, subtitle data sequence, etc., which are real-time presentation elements, based on the control signal included in the MMT data sequence. The MMT decode processing unit 841 shall be provided with functions corresponding to those of the separation unit 132, video decoder 141, video color gamut conversion unit 142, audio decoder 143, character super decoder 144, subtitle decoder 145, subtitle synthesis unit 146, subtitle color gamut conversion unit 147, data decoder 151, cache unit 152, application control unit 153, browser unit 154, application color gamut conversion unit 155, sound source unit 156, etc. in the broadcast receiving apparatus 100 of the first embodiment. The MMT decode processing unit 841 can perform the various processes described in the first embodiment. Since the details of the various processes are as described in the first embodiment, the description is omitted.
[0291] The MPEG2-TS decoding processing unit 842 inputs the MPEG2-TS data sequence output from the second tuner / demodulation unit 832, and performs separation processing and decoding processing, etc. on video data sequences, audio data sequences, character super data sequences, subtitle data sequences, etc., which are real-time presentation elements, based on the control signals included in the MPEG2-TS data sequence. The MPEG2-TS decoding processing unit 842 is assumed to have the same functions as the IRD (Integrated Receiver Decoder) unit of a conventional television receiver that receives a broadcast wave of a broadcast service adopting MPEG2-TS as a media transport method, and detailed explanations are omitted.
[0292] The video synthesis unit 861 inputs the video information, subtitle information, and application information output from the MMT decoding processing unit 841 and the video information, subtitle information, and application information output from the MPEG2-TS decoding processing unit 842, and performs processing such as appropriate selection and / or superimposition. The video synthesis unit 861 includes a video RAM (not shown), and the monitor unit 862, etc. is driven based on the video information, etc. input to the video RAM. Also, the video synthesis unit 861 performs scaling processing, superimposition processing of EPG screen information, etc. as necessary based on the control of the main control unit 801. The audio synthesis unit 164 inputs the audio information output from the MMT decoding processing unit 841 and the audio information output from the MPEG2-TS decoding processing unit 842, and performs processing such as appropriate selection and / or mixing.
[0293] The LAN communication unit 821 is connected to the Internet 200 via the router device 200r, and transmits and receives data with each server device and other communication devices on the Internet 200. Also, it acquires the MMT data sequence (or a part thereof) or the MPEG2-TS data sequence (or a part thereof) of a program transmitted via a communication line, and outputs it to the MMT decoding processing unit 841 or the MPEG2-TS decoding processing unit 842 as appropriate.
[0294] [Time display of the broadcast receiving device] In the broadcast receiving apparatus 800 of this embodiment, it is assumed that the current date and current time can be displayed on an EPG screen, various setting screens, and the like. Information regarding the current date and current time is transmitted by MH-TOT or the like in a broadcast service that employs MMT as a media transport method, and is transmitted by a TOT (Time Offset Table) included in SI (Service Information) defined in the MPEG-2 system in a broadcast service that employs MPEG2-TS as a media transport method. The broadcast receiving apparatus 800 can acquire information regarding the current date and current time by referring to the MH-TOT and the TOT.
[0295] Also, generally, when the video composition unit 861 mainly selects video information and the like output from the MMT decoding processing unit 841, information regarding the current date and current time acquired from the MH-TOT is superimposed on the video information and the like. When the video composition unit 861 mainly selects video information and the like output from the MPEG2-TS decoding processing unit 842, control may be performed so that information regarding the current date and current time acquired from the TOT is superimposed on the video information and the like.
[0296] However, there are differences in encoding / decoding processes and transmission paths between a broadcast service that adopts MMT as the media transport method and a broadcast service that adopts MPEG2-TS as the media transport method. Therefore, especially in the display of the current time, there may be inconsistencies when selecting a broadcast service that adopts MMT as the media transport method and when selecting a broadcast service that adopts MPEG2-TS as the media transport method. For example, as shown in FIG. 25, when switching the screen display from an EPG screen 162g that displays channel information of a broadcast service that adopts MMT as the media transport method to an EPG screen 162h that displays channel information of a broadcast service that adopts MPEG2-TS as the media transport method, the display of the current time changes from the current time display 162g1 to the current time display 162h1, which may give the user a visual discomfort due to the inconsistency.
[0297] In the broadcast receiving apparatus 800 of the present embodiment, in order to prevent the user from experiencing visual discomfort, even when the video composition unit 861 mainly selects the video information and the like output from the MMT decoding unit 841, the information regarding the current date and the current time acquired from the TOT is controlled to be superimposed on the video information and the like. That is, the current time information provided by the broadcast service that adopts MPEG2-TS as the media transport method is controlled to be superimposed on the content of the broadcast service that adopts MMT as the media transport method.
[0298] By performing the above control, the broadcast receiving apparatus 800 of the present embodiment always displays the current time information acquired by referring to the TOT when displaying the current time. Therefore, even when switching between a broadcast service that adopts MMT as the media transport method and a broadcast service that adopts MPEG2-TS as the media transport method, it is possible to prevent the user from experiencing visual discomfort due to the inconsistency in the display of the current time.
[0299] Note that FIG. 26 shows an example of the selection control of the current time information reference source according to the reception status of each broadcast service in the broadcast receiving apparatus 800 of the present embodiment. In the broadcast receiving apparatus 800 of the present embodiment, when the reception of a broadcast service adopting MPEG2-TS as the media transport method is possible, the TOT is always referred to obtain the current time information. When the reception of a broadcast service adopting MPEG2-TS as the media transport method is impossible and the reception of a broadcast service adopting MMT as the media transport method is possible, the control is performed so as to obtain the current time information by referring to the MH-TOT.
[0300] Conversely, even if the control is performed so as to superimpose the current time information provided by the broadcast service adopting MMT as the media transport method on the content of the broadcast service adopting MPEG2-TS as the media transport method, the same effect as described above can be obtained.
[0301] Note that, as described above, in either the case of controlling to superimpose the current time information provided by the broadcast service adopting MPEG2-TS as the media transport method on the content of the broadcast service adopting MMT as the media transport method or the case of controlling to superimpose the current time information provided by the broadcast service adopting MMT as the media transport method on the content of the broadcast service adopting MPEG2-TS as the media transport method, the current time information can be corrected by referring to the 'delta' parameter of the time information in the TMCC extension information area in the same manner as the description in [Time Management of Broadcast Receiving Apparatus] of the first embodiment.
[0302] [EPG Display of Broadcast Receiving Apparatus] Event schedule information of a broadcast service that employs MMT as a media transport method is transmitted by MH-EIT or the like. On the other hand, event schedule information of a broadcast service that employs MPEG2-TS as a media transport method is transmitted by EIT (Event Information Table) included in SI defined in the MPEG-2 system. Therefore, generally, when displaying video information or the like provided by a broadcast service that employs MMT as a media transport method, the event schedule information (MH-EIT) of the broadcast service that employs MMT can be acquired, and when displaying video information or the like provided by a broadcast service that employs MPEG2-TS as a media transport method, the event schedule information (EIT) of the broadcast service that employs MPEG2-TS can be acquired.
[0303] However, the broadcast receiver 800 of this embodiment can acquire both the MH-EIT and the EIT when displaying video information or the like provided by a broadcast service that employs MMT as a media transport method, or when displaying video information or the like provided by a broadcast service that employs MPEG2-TS as a media transport method, thereby improving the usability for the user.
[0304] FIG. 27A shows an example of an EPG screen in the broadcast receiver 800 of this embodiment. In the figure, the EPG screen 162i is an EPG screen created based on the MH-EIT of a broadcast service that employs MMT as the media transport method. Assume that "M1 TV", "M2 Broadcast", "M3 Channel", "M4 TV", "TV M5", etc. are the names of broadcast stations of broadcast services that employ MMT as the media transport method, respectively. Also, the EPG screen 162j is an EPG screen created based on the EIT of a broadcast service that employs MPEG2-TS as the media transport method. Assume that "T6 TV", "T7 Broadcast", "T8 Channel", "T9 TV", "TV TA", etc. are the names of broadcast stations of broadcast services that employ MPEG2-TS as the media transport method, respectively.
[0305] For example, while the user is watching a broadcast program provided by a broadcast service that employs MMT as the media transport method, if the user operates a remote control (not shown) to instruct the display of the EPG screen, an initial screen of the EPG screen (not shown) is displayed. The initial screen of the EPG screen is an EPG screen created based on the MH-EIT of a broadcast service that employs MMT as the media transport method, and detailed information on the broadcast programs of each channel from "17:00 to (near the current time)" on "October 7, 2014 (today)" is displayed. Next, if the user desires to check the detailed information on the broadcast programs of each channel from "20:00 to" on "October 9, 2014" and operates a remote control (not shown) to instruct the update of the EPG screen, the EPG screen 162i is displayed.
[0306] Furthermore, when the user desires to check the detailed information of a broadcast program provided in a broadcast service that adopts MPEG2-TS as the media transport method and operates a remote control (not shown) to instruct network switching, an EPG screen 162j is displayed. At this time, in the broadcast receiving apparatus 800 of the present embodiment, instead of the initial screen of the EPG screen created based on the EIT of the broadcast service that adopts MPEG2-TS as the media transport method (that is, the detailed information of the broadcast programs of each channel from '17:00' on 'October 7, 2014'), the detailed information of the broadcast programs of each channel in the same date and time zone as the immediately preceding EPG screen 162i (that is, from '20:00' on 'October 9, 2014') is displayed under control.
[0307] By the above control, the user can continuously check the detailed information regarding the broadcast programs in the same date and time zone of a plurality of networks with different media transport methods through a simple operation. That is, the usability of the broadcast receiving apparatus 800 is improved.
[0308] FIG. 27B is a diagram showing an example different from the above of the EPG screen in the broadcast receiving apparatus 800 of the present embodiment. The EPG screen 162k shows a state where the EPG screen 162i shown in FIG. 27A is scrolled in the channel direction (horizontal direction) by operating a remote control (not shown). That is, in the example shown in FIG. 27B, by scrolling the EPG screen in the channel direction (horizontal direction), the channel information created based on the MH-EIT of the broadcast service that adopts MMT as the media transport method and the channel information created based on the EIT of the broadcast service that adopts MPEG2-TS as the media transport method are seamlessly displayed on the same time axis.
[0309] Therefore, even when a user desires to check channel information created based on the EIT of a broadcast service that employs MPEG2-TS as a media transport method during the check of channel information created based on the MH-EIT of a broadcast service that employs MMT as a media transport method, it is possible to eliminate the need for instructions to switch networks, etc., by operating a remote controller (not shown). Furthermore, the user can simultaneously check detailed information regarding broadcast programs in the same time slot on the same day for a plurality of networks with different media transport methods. That is, the usability of the broadcast receiving apparatus 800 is improved. (Example 3)
[0310] Hereinafter, Example 3 of the present invention will be described. Note that the configurations, effects, etc. in this example are the same as those in Examples 1 and 2 unless otherwise specified. For this reason, hereinafter, the differences between this example and Examples 1 and 2 will be mainly described, and the common points will be omitted as much as possible to avoid duplication. In this example, the handling of presentation area information set by the layout setting table (LCT) shown in FIG. 18 will be described.
[0311] [Hardware Configuration of Broadcast Receiving Apparatus] Since the hardware configuration of the broadcast receiving apparatus 100 is the same as that in Example 1, the description thereof will be omitted.
[0312] [Structure of Program Data] Figure 28 shows the structure of program data. The program data consists of information (asset 30003) presented to the broadcast receiving apparatus 100, such as video, audio, and program linkage information, and control information. Note that the program linkage information stores character information, graphic information, image information, video information, etc. for presentation in accordance with the program video. Figure 28 shows a PA message 30000 that describes the presentation method of the asset 30003 and the acquisition destination information among the control information. The acquisition destination of the asset 30003 is described as MMT_general_location_info (Figure 31) in the MP table (MPT) 30001 (Figure 17) within the PA message 30000 (Figure 30). Also, a layout setting table (LCT) 30100 (Figure 18) is arranged within the PA message 30000 to describe the layout of the area where each asset 30003 should be presented. Examples of the layout of the presentation area are shown in Figures 19A to 19D.
[0313] A package list table (PLT) 30002 (Figure 32) is arranged within the PA message 30000, and the acquisition destination of another PA message 30000 can be described by the MMT_general_location_info (Figure 31) within the PLT. By specifying the acquisition destination of this PA message 30000, the PA message 30000 can be made into a hierarchical structure. Note that the location type of the acquisition destination of the PA message 30000 and the asset 30003 is shown in Figure 33.
[0314] Normally, the hierarchical structure of the PA message 30000 is up to two levels as shown in Figure 28, but a PLT 30002 can be further arranged in the second-level PA message 30000 to increase the levels.
[0315] Since the asset is composed of Media Processing Units (MPUs) which are processing units (Fig. 29), in the MPU presentation area designation descriptor (Fig. 34), the presentation area of asset 30003 is designated by designating the presentation area of the MPU. The MPU presentation area designation descriptor is arranged in the asset descriptor area of the MPT. Note that since the presentation area is designated for each MPU, a presentation method in which the presentation area of the same asset 30003 is changed during presentation is also possible. Note that in order to reduce the data amount, a control method is also possible in which the presentation area is not designated for all the MPUs belonging to the asset, and only the presentation areas of the head MPU and the head MPU of the group of MPUs whose presentation areas are changed are designated.
[0316] [Operation Example of Asset Presentation] <Operation Example 1> The broadcast receiver 100 acquires presentation area information by reading the LCT30100. Fig. 16 shows an example of the flow in which the broadcast receiver 100 acquires the program control information at the time of channel switching. Similar to the MPT30001, the LCT30100 is arranged and transmitted in the MMTP packet. Since the designation information of the presentation area of the asset 30003 is described in the MPT30001, it is preferable that the LCT30100 is acquired earlier than the MPT30001. As shown in Fig. 16, it is preferable that it is acquired as steps between S209 and S210 and between S214 and S215. Note that even if it could not be acquired at the timing, it is similarly preferable if the LCT can be acquired before S216.
[0317] LCT30100 is placed within the PA message 30000. Regarding the LCT30100 related to the asset 30003 corresponding to the second - level PA message, it is placed either within the first - level PA message 30000 or within the second - level PA message 30000. When presenting the asset 30003, the presentation area information of the LCT30100 placed within the PA message 30000 to which the asset 30003 to be presented belongs is preferentially used. If the LCT30100 is not placed within the belonging PA message 30100, the presentation area information of the LCT30100 placed within the higher - level PA message 30100 is used.
[0318] By using the method of this operation example, for the entire program data in Figure 28, when using the same LCT30100, if a common LCT30100 is placed within the first - level PA message 30000, the presentation area information can be obtained at an early timing, so that prompt presentation of program data becomes possible.
[0319] <Operation Example 2> When the LCT30100 is not included in the MMTP packet, the presentation area information of the LCT30100 obtained so far is used. That is, the broadcast receiving device stores the presentation area information of the LCT30100 and updates the stored presentation area information each time a new LCT30100 is obtained.
[0320] However, immediately after an event occurs in which the presentation area information that has been used until then, such as when the power is turned on or when the channel is changed, becomes invalid, since there is no valid presentation area information yet, there is a possibility that even if program video data or audio data is acquired, the data cannot be presented. Therefore, until valid presentation area information is acquired, as temporary presentation area information, for example, the presentation process is performed assuming that the presentation area shown in FIG. 19A is set. The setting in FIG. 19A is hereinafter referred to as the default setting. The presentation area shown in the default setting (FIG. 19A) sets the full-screen display area for the device with device_id of 0, that is, the main device, and assigns 0 to layout_number, 0 to region_number, and 0 to layer_order.
[0321] FIG. 35A shows a state in which only the main asset 30201 is presented using temporary presentation area information, and FIG. 35B shows a state in which after acquiring the LCT 30100, presentation is performed including the sub-asset 30202 according to the original presentation area information of the program. When using temporary presentation area information, the presentation area specification of the main asset is ignored, and an area with layout_number of 0 and region_number of 0 is specified, and presentation of other assets is not performed. Here, the main asset means an asset that designates region_number 0 of the main device or an asset that designates region_number 0 and is transmitted by a broadcast wave, and the sub-asset means other assets.
[0322] By setting the temporary presentation area information in this way, even before the information of the LCT 30100 is read, at least the presentation process of the main asset can be performed.
[0323] <Operation Example 3> In Operation Example 2, an example was shown in which, when changing channels or the like, only the main asset is presented using the default presentation area information until a new LCT30100 is acquired. However, it is also possible to use the LCT30100 that was used in the program viewed up to that point. Present the asset (main asset) specified in the area where region_number is 0 in the program after channel change in the area where region_number is 0 in the presentation area information that was used up to that point, and do not display other assets (sub assets).
[0324] After acquiring the LCT30100 of the program after channel change, present all assets using the presentation area information. Also, when the LCT30100 used in the program viewed up to that point divides the display area as shown in FIG. 19B, perform the processing of Operation Example 2, and if the LCT30100 used in the program viewed up to that point performs an overlay display as shown in FIG. 19C, the processing of Operation Example 3 may be performed. Further, when the LCT30100 used in the program viewed up to that point has areas where region_number is 1 or later, a predetermined pattern, message, etc. may be displayed in the areas.
[0325] By using the presentation area information of the program viewed up to that point in this way, it becomes possible to perform at least the presentation process of the main asset even before the information of the LCT30100 is read.
[0326] <Operation Example 4> Since there may be cases where the original channel is restored after channel change, it is also possible to associate and store the information of the LCT30100 read once with the channel information, and use the stored presentation area information when the channel is restored. In addition, if the latest LCT30100 is stored for each of all channels that can be received by the broadcast receiving apparatus 100, the convenience regarding the presentation area control at the time of channel change is improved.
[0327] Also, since the presentation area information may be changed even during a program, an expiration date is set for LCT30100. If the expiration date has passed when the channel is returned, the presentation area information is not used, and the default settings are used in the method shown in Operation Example 2 or Operation Example 3, or only the main asset is presented using the presentation area information of the program that has been viewed up to that point. Alternatively, only the main asset may be presented using the presentation area information with an expired expiration date for that channel. Of course, after obtaining a new LCT30100, the normal presentation method is restored. Note that the control may be performed by referring to the expiration date, or may be performed by referring to the version instead of the expiration date information.
[0328] An example of setting an expiration date for LCT30100 is shown in FIG. 36A. It is set in NTP long format (ending_time) in the LCT expiration date descriptor. The descriptor is arranged in the descriptor area of LCT30100 (FIG. 18).
[0329] Alternatively, as shown as a layout expiration date descriptor in FIG. 36B, an expiration date may be set for each layout.
[0330] Alternatively, as shown as a presentation area expiration date descriptor in FIG. 36C, an expiration date may be set for each area.
[0331] The expiration date may be set at a single hierarchy or at multiple hierarchies. When setting the expiration date at multiple hierarchies, the earlier expiration date is prioritized for each area.
[0332] By this method, the presentation area information once obtained can be effectively used while considering the expiration date.
[0333] <Operation Example 5> In Operation Example 4, the presentation area information of a program once read is memorized. However, it is also possible to prepare presentation area information (common presentation area information) commonly used for a plurality of programs within a channel for each channel in advance, have the broadcast receiving apparatus 100 acquire the common presentation area information in advance, and use the common presentation area information in each program.
[0334] The broadcast receiving apparatus 100 acquires the common presentation area information in advance in the form of an LCT (FIG. 18). In order to indicate that it is common presentation area information, the common presentation area descriptor shown in FIG. 37 is used. This descriptor is arranged in the descriptor area of the LCT (FIG. 18), and the layout numbers that are common presentation areas are enumerated together with the device numbers. The service_id represents the broadcast channel. Further, the start time (beginning_time) and end time (ending_time) of the valid period of the common presentation area information are described in the NTP long format. Also, a full_set_flag is described so that it can be confirmed that all information is available when the information is updated. The meaning of the full_set_flag is summarized in FIG. 38.
[0335] This common presentation area information may be read, for example, at a time zone outside of broadcast time at a cycle of once a day or once a week. Also, it may be acquired from a broadcast wave or via the Internet.
[0336] In addition, for the case where the common presentation area information has not been read, in the program data, the common presentation area information used in the program is transmitted as an LCT30100. At that time, the full_set_flag of the common presentation area descriptor indicates that it is a part of the common presentation area information.
[0337] By using this common presentation area information, it is possible to promptly present the asset 30003 even at the timing immediately after the broadcast receiving apparatus 100 is powered on or immediately after program switching before the LCT30100 is acquired.
[0338] <Operation Example 6> Although the method of using the common presentation area information in Operation Example 5 has been shown, even if the common presentation area information is a broadcast wave or a channel transmitted via the Internet, depending on the program, a presentation area with a layout not described in the common presentation area information may be used.
[0339] Specifically, in the LCT30100 of the program, information on the layout not described in the common presentation area information may be described. At this time, since the layout number of the common presentation area is described in the common presentation area descriptor (Fig. 37), the broadcast receiving apparatus 100 determines whether there is additional presentation area information that is not a common presentation area in the LCT30100, and uses that information if there is. At this time, if there is an overlap between the layout number and the area number of the presentation area and the common presentation area information, which information takes precedence should be determined in advance. That is, depending on the broadcast system, the broadcast receiving apparatus 100 may be configured to prioritize the common presentation area information. Also, depending on the broadcast system, the broadcast receiving apparatus 100 may be configured to prioritize the presentation area information specific to the program.
[0340] Furthermore, when the common presentation area descriptor (Fig. 37) is not arranged in the LCT30100, all the presentation area information described in the LCT30100 is treated as being designated as not common area information.
[0341] Note that this additional presentation area information specific to the program may be obtained from the broadcast wave, but it may also be obtained via the Internet rather than from the broadcast wave.
[0342] According to this method, while using the common presentation area information, it is possible to use presentation area information optimized for each program.
[0343] <Operation Example 7> The presentation of the asset 30003 is performed in one presentation area, but in the case of breaking news, for example, when it is better to display it on as many terminals as possible, it is better to perform the presentation on all available terminals at that time with the same content.
[0344] As a specific method, in the overlapping presentation area specification descriptor (Figure 39), among the layout settings of the main device (the device with Device_id = 0), the layout_number for which the same area settings are to be made on other devices is described. This descriptor is placed in the descriptor area of LCT30100 (Figure 18).
[0345] Figure 40 shows an example in which, in addition to the main device (broadcast receiver 100), the same content screen is presented on a sub-device (portable information terminal 700).
[0346] Note that, for the case when returning to the original program after the end of the temporary news, the presentation area information used in the original program may be memorized and this information may be used after the end of the temporary news.
[0347] By this method, the recognition of important information with high urgency is enhanced.
[0348] <Operation Example 8> The presentation area of each asset 30003 is determined by specifying the layout_number (layout number) and region_number (area number) using the MPU presentation area specification descriptor (Figure 34). If there is no presentation area information corresponding to this layout number and area number, presentation cannot be performed, so the presentation of the asset 30003 is not carried out. However, when an abnormal asset 30003 is presented in a partial area of the screen, it may not be immediately apparent that there is a display abnormality. Therefore, when an asset 30003 that cannot be presented occurs, an error display as shown in Figure 41 is performed.
[0349] By this method, viewers can recognize that the display is not being performed normally.
[0350] <Operation Example 9> In Operation Example 8, the operation when a presentation area without presentation area information is specified was described. Here, the operation when different assets 30003 specify the same presentation area will be described. In the case of an asset that displays some content, since it cannot be displayed in the same presentation area, different assets 30003 should not specify the same presentation area simultaneously. If they are specified simultaneously, prioritize the asset transmitted by the broadcast wave. Alternatively, continue presenting the asset 30003 that first used the layout number and area number, and prohibit presenting the asset 30003 specified later. Alternatively, prohibit presenting all assets 30003 with overlapping area specifications. When an asset 30003 that cannot be presented occurs, an error display as shown in FIG. 41 may be performed.
[0351] However, for example, in the case of a video asset where additional asset information is added to enhance the tone, it may be possible to specify the same presentation area with different assets 30003. To indicate that multiple assets are in a complementary relationship that constitutes one content, the information of the dependency descriptor is used. The data structure of the dependency descriptor is shown in FIG. 42. If there is such a dependency relationship, presentation is permitted even when the same presentation area is specified.
[0352] To manage the presentation area specifications of asset 30003, a management table indicating which asset 30003 specifies which presentation area may be used. An example of the management table is shown in FIG. 43. Since the assets 30003 with asset IDs 1 and 3, and asset IDs 2 and 4 have a dependency relationship, presentation is permitted even when the same area is specified. On the other hand, the asset 30003 with asset ID 7 is a video asset, and without a dependency relationship, it specifies the same area as asset ID 0, so presentation is prohibited.
[0353] Note that since the asset 30003 with asset ID 1 is transmitted by broadcast waves, this is given priority. Also, since the asset 30003 with asset ID 8 is prohibited from being presented because the asset 30003 with the same acquisition destination asset ID 7 is prohibited from being presented, it is highly likely that it is the voice paired with the asset ID 7, so it is also prohibited from being presented. Further, the assets with asset IDs 2, 4, 6, and 8 are voice assets, and since voice assets are not directly related to the presentation process in the monitor unit 162, it is not necessarily required to manage them in the management table. That is, only video assets may be managed in the management table.
[0354] By performing such presentation control, it is possible to prevent abnormal presentation when there is an inconsistency in the control information.
[0355] <Operation Example 10> In the dependency relationship of the asset 30003, there are cases where it becomes a parallel relationship where a plurality of dependent assets 30003 must be present for the content to be completed, and cases where it becomes a subordinate relationship, such as when data for high image quality is provided by another asset 30003 for the main asset 30003. The main asset 30003 can be presented alone, but if the subordinate asset 30003 does not have the main asset 30003, there is a high possibility that the presentation will be abnormal. Therefore, if the subordinate asset 30003 cannot be acquired, the presentation of the subordinate asset 30003 is prohibited. Note that the subordinate asset 30003 may have a multi-layered structure in which another asset 30003 is further subordinate to it.
[0356] In order to specify the subordinate relationship, it may be determined in advance whether the asset 30003 described in the dependency descriptor (Figure 42) indicates the subordinate asset 30003 or the asset 30003 subordinate to the said asset. In the case of assets 30003 in a parallel relationship, the dependency descriptor (Figure 42) is arranged assuming that both are dependent on each other.
[0357] As another method of specifying a dependency relationship, a method of explicitly indicating the dependency relationship in a dependency descriptor (Figure 42) may be used. A dependency descriptor with the dependency relationship explicitly indicated is shown in Figure 44. A parameter named dependency_type is specified to indicate the type of dependency on the asset in the dependency relationship. The meaning of dependency_type is shown in Figure 45. When 0, it indicates subordination to the other party; when 1, it indicates being subordinate to the other party. In the case of a parallel relationship, it is specified that each is subordinate to the other asset.
[0358] An example of a management table for permission / forbidden presentation is shown in Figure 46. The assets with IDs 3 and 4 are subordinate to the assets with IDs 1 and 2. Since the assets with IDs 1 and 2 have been acquired, the presentation is permitted. On the other hand, for the assets with IDs 9 and 10, since the subordinate assets with IDs 7 and 8 have not been acquired, the presentation is prohibited.
[0359] The assets with IDs 11 and 12 are in a mutual dependency relationship, and since both are present, the presentation is permitted. On the other hand, the assets with IDs 13 and 14 are also in a mutual dependency relationship, but since the asset with ID 14 has not been acquired, the presentation of the asset with ID 13 is prohibited. In addition, when an asset 30003 that cannot be presented occurs, an error display as shown in Figure 41 may be performed.
[0360] In this way, by controlling the presentation while considering the dependency relationship, it is possible to prevent abnormal presentation when there is an inconsistency in the control information.
[0361] <Operation Example 11> The broadcast receiving device 100 can present both the asset 30003 acquired from the broadcast wave and the asset 30003 acquired from the communication line (Internet). However, depending on the state of the communication line, it may not be possible to acquire the asset 30003 via the communication line, or the broadcast receiving device 100 may not be connected to the communication line at all. Therefore, usually, only the broadcast video of the broadcast wave is displayed in full screen using the default setting (Figure 19A), and when the asset 30003 via the communication line is acquired, the asset 30003 may be presented in the area specified according to the setting of the LCT30100.
[0362] For example, it will be described in the case where the area setting of the LCT30100 is as shown in Figure 19B, the broadcast video is set to be presented in area 0, and the asset 30003 via the communication line is set to be presented in areas 1 and 2. When only the broadcast wave video can be received, the broadcast video is displayed in full screen using the default setting (Figure 19A). When the asset 30003 via the communication line can be acquired, the area setting of the LCT30100 is used, the broadcast video is presented in area 0 of Figure 19B, and the asset 30003 via the communication line is presented in areas 1 and 2. In this case, the LCT30100 is not transmitted via the broadcast wave, and it may be transmitted together with the asset 30003 via the communication line. By using the method of this operation example, it is possible to display according to the actual reception status of the program data. Note that when only one of the assets 30003 via the communication line is acquired and the other is not acquired, it may remain in the default setting (Figure 19A). It is desirable to control to shift to the area setting of Figure 19B when both assets 30003 via the communication line are available. (Example 4)
[0363] Hereinafter, Example 4 of the present invention will be described. Note that the configurations, effects, etc. in this example are the same as those in Examples 1 to 3 unless otherwise specified. Therefore, hereinafter, the differences between this example and Examples 1 to 3 will be mainly described, and the common points will be omitted as much as possible to avoid duplication. In this example, an operation example of handling presentation area information set by the layout setting table (LCT) shown in FIG. 18 and handling of out-of-program content will be described.
[0364] [Hardware Configuration of Broadcast Receiver] Since the hardware configuration of the broadcast receiver 100 is the same as that in Example 1, the description thereof will be omitted.
[0365] [Modified Operation Example of Asset Presentation] <Operation Example 1> When changing channels using the electronic program guide (EPG), as shown by the dashed frame 30203 in FIG. 47, when a new program is selected on the EPG, if the LCT 30100 is obtained from the PA message 30000 of the new program while the EPG is being displayed, the asset presentation process according to the presentation area information specified by the program can be performed when the program display state is set.
[0366] Alternatively, presentation area information for each program may be incorporated into the EPG data (MH-EIT obtained from a broadcast wave or a communication network and other necessary various data stored in a storage unit such as a memory), and the presentation area information of the program newly changed from the EPG data may be read to obtain the presentation area information of the program more quickly. In this case, another tuner does not need to be used, so the number of tuners can be reduced.
[0367] Alternatively, it may be decided to distribute the presentation area information of each program via the Internet, and a process of previously reading the presentation area information of each program may be performed. Also in this case, another tuner does not need to be used, so the number of tuners can be reduced.
[0368] When the EPG is being displayed, a reduced program video may be displayed on the sub-screen 30204. However, since it becomes difficult to view the sub-asset even in this state, the LCT setting of the program may be ignored, and only the main asset may be presented on the entire sub-screen 30204. Not limited to the sub-screen when the EPG is being displayed, in a situation where the main asset becomes difficult to view due to the display of the sub-asset, the LCT setting may be similarly ignored.
[0369] <Operation Example 2> To support viewing from the middle of a program, the LCT 30100 is repeatedly transmitted. However, if the LCT 30100 has not been sent for a certain period, including when the broadcast reception has stopped, the receiver determines that there is no valid presentation area information and sets it to the default setting (Figure 19A). When the reception resumes, if the presentation area setting has been changed, abnormal presentation due to the remaining old presentation area setting can be prevented. Since the default setting is a setting that only presents the main asset, regardless of the program, the presentation will not become abnormal.
[0370] <Operation Example 3> If there is an inconsistency or the like in the information of the LCT 30100 used in the program and there is no valid presentation area information, the default setting (Figure 19A) is used to ensure at least the display of only the main asset.
[0371] <Operation Example 4> In addition to the broadcast wave, when there is an asset via the Internet, although the asset data via the Internet can be acquired, when the broadcast wave reception stops, the presentation area setting is maintained for a certain period or until a new presentation area setting is established even without the acquisition of the LCT 30100, and the presentation of the asset via the Internet is continued. By this method, in an abnormal situation, the presentation of the asset that can be presented at least partially can be continued.
[0372] <Operation Example 5> In addition to broadcast waves, when there are Internet-based assets and the reception of broadcast waves continues but the acquisition of Internet-based asset data becomes impossible, the presentation area setting is changed to the default setting (Figure 19A), and only the main asset is presented. For example, if the presentation areas of Internet-based assets are Area 1 and Area 2 in Figure 19B and the presentation area of the broadcast screen is Area 0, when the presentation of Internet-based assets disappears, the parts of Area 1 and Area 2 become the background color, which looks unpleasant. In such a case, if the broadcast screen (main asset) is displayed in full using the default setting (Figure 19A), it will not look unpleasant and the screen can be used effectively.
[0373] In addition, in the above process, when changing the presentation area setting to the default setting (Figure 19A), an error message 30205 may be displayed indicating that data acquisition from the Internet has become impossible (Figure 48).
[0374] [Handling Method of Out-of-Program Content] During program viewing, there may be a case where you want to use out-of-program content, such as content on the Internet or an app. The processing in such a case will be described.
[0375] First, it is set in the content control descriptor whether to permit the presentation of out-of-program content during program viewing. The data structure of the content control descriptor is shown in Figure 49. This descriptor is arranged in MPT30001 (Figures 17 and 28). In Figure 49, a parameter called contents_control_mode (content control mode) represents the permission / non-permission of the presentation of out-of-program content.
[0376] Figure 50 shows the meaning of the content control mode. In the case of mode 00, it means not permitted, and the others mean permitted. And three types of permission modes are provided. In the case of mode 01, it is permitted to present in the specified area. The area is specified by layout_number and region_number. In the case of mode 10, if the presentation of the program content is not hidden, the presentation of the out-of-program content is permitted. In the case of mode 11, the presentation of the out-of-program content is permitted, and the presentation method is also arbitrary.
[0377] Figure 51 shows an example of mode 01. The program content is the main asset presented in area 30206 and the sub-asset presented in area 30207. The out-of-program content is displayed in area 30208. Here, the presentation of the web browser 30209 is shown as an example. In the example of Figure 51, there is no overlap between the presentation area of the program content and the presentation area of the out-of-program content, but these areas can be overlapped, and the out-of-program content can be presented on top of the program content.
[0378] Figure 52 shows an example of mode 10. It shows where the program content 30210 and the out-of-program content 30209 are presented. The presentation of the program content here is performed as the entire screen area specified by LCT30100 for a partial area of the screen 162 of the broadcast receiver. That is, the upper left position 30211 of the presentation area of the program content 30210 corresponds to the position where left_top_pos_x = 0 and left_top_pos_y = 0 in LCT30100, and the lower right position 30212 corresponds to the position where right_down_pos_x = 100 and right_down_pos_y = 100 in LCT30100. Where to set the entire screen area specified by LCT on the screen 162 of the broadcast receiver 100 is set in advance in the broadcast receiver 100 or set by the viewer. The out-of-program content can be presented at any position as long as it does not interfere with the presentation of the program content. Whether it does not overlap as an area or overlaps, it is presented behind the program content so as not to hide the presentation of the program content (Figure 53).
[0379] Fig. 54 shows an example of Mode 11. In this case, the relationship between the presentation of program content and the presentation of non-program content is arbitrary. The non-program content may be presented so as to hide the presentation of the program content.
[0380] As described above, if the program content and the non-program content can be viewed simultaneously, it is more convenient for the viewer. (Example 5)
[0381] Hereinafter, Example 5 of the present invention will be described. Note that the configuration and effects in this example are the same as those in Examples 1 to 4 unless otherwise specified. Therefore, hereinafter, the differences between this example and Examples 1 to 4 will be mainly described, and the common points will be omitted as much as possible to avoid duplication. Also, the broadcast receiving apparatus in this example is a television receiver that supports both the MMT method and the MPEG2-TS method as a media transport method, and the description will be given below.
[0382] [Hardware Configuration of Broadcast Receiving Apparatus] Since the hardware configuration of the broadcast receiving apparatus 800 is the same as that in Example 2, the description thereof will be omitted.
[0383] [Types of Assets] There are two media transport methods corresponding to the asset, namely the MMT method and the MPEG2-TS method, which are distinguished by the location_type (location type) in the MMT_general_location_info (Fig. 31). The types of the location type are shown in Fig. 33.
[0384] [Synchronization Control of MPEG2-TS Packets] <Operation Example 1> The synchronization control of the MMT packets is performed by a timestamp based on the time information of the NTP (Network Time Protocol) shown in Fig. 3. As the hardware configuration, the clock inside the receiver synchronized with the NTP shown in Fig. 7C is used.
[0385] On the one hand, in the MPEG2-TS system, synchronization control is performed using a time stamp based on time information called PCR (Program Clock Reference). The protocol stack of the MPEG2-TS system is shown in FIG. 55. The time system based on this PCR consists of a high-order 33-bit counter running at 90 kHz and a low-order 9-bit counter running at 27 MHz. 300 counts of the low-order 9 bits correspond to 1 count of the high-order 90 kHz. The high-order 33-bit counter makes one full cycle in approximately 26.5 hours and the counter returns to 0 (FIG. 57). On the other hand, the clock synchronized with NTP consists of a high-order 32 bits (in seconds) and a low-order 32 bits (the fractional part). Therefore, the clock based on NPT has a representable period of approximately 136 years and is completely different from the PCR system as a time representation system (FIG. 57).
[0386] Therefore, in a receiver that processes MPEG2-TS packets, in addition to a clock synchronized with NTP, it is necessary to have an internal clock synchronized with PCR and present the asset according to that clock, or use the NTP clock to present the asset based on the relationship between the times of PCR and NTP. Also, when achieving precise presentation synchronization between an MMT system asset and an MPEG2-TS system asset, it is desirable to know the relationship between the times of PCR and NTP even when having an internal clock synchronized with PCR.
[0387] As a method for obtaining the relationship between the times of PCR and NTP, for example, the following method can be used. First, on the transmission side, as a method for giving the correspondence between the times of PCR and NTP, there is a method of describing the relationship for each MMT packet table. That is, it is described as an MPT_descriptor in the MPT of FIG. 17. An example of the descriptor is shown in FIG. 56. Here, the timestamp_offset parameter gives the difference (timestamp offset) between the time stamp by PCR and the time stamp by NTP. Here, the time based on NPT corresponding to the time when the counter of the time stamp by PCR used in the asset group indicated by the MPT is reset to 0 is shown in the 64-bit NTP time stamp format.
[0388] As shown in Fig. 57, when A in the figure is the PCR timestamp, B in the figure is the timestamp offset. By using the value of this timestamp offset and adding the value of the PCR timestamp offset to it, the value of the NTP-based timestamp can be obtained. Once the value of the NTP-based timestamp is obtained, even for an asset in the MPEG2-TS format, presentation processing can be performed using the NTP-based clock, and precise presentation synchronization with an asset in the MMT format can be achieved.
[0389] Also, the timestamp offset may be described for each asset corresponding to the MPEG2-TS format. In this case, it is described as an asset_descriptor in the MPT of Fig. 17.
[0390] In addition, if the PCR timestamps used in the asset include those exceeding 0, there may be a case where there are multiple times corresponding to the counter value as the PCR timestamp being 0. In that case, the timestamp offset may be described with the earliest time. As shown in Fig. 57, when there is also A' in addition to A as the PCR timestamp used in the asset. In this case as well, the value of B is used as the timestamp offset described in the descriptor. In the presentation processing of an asset in the MPEG2-TS format, initially, the value of the timestamp offset described in the descriptor is used, and as the presentation processing proceeds, if the value of the PCR timestamp decreases when viewed in the time series order of the packets, it is determined that the counter has made a full cycle, and the value of the time offset used in the processing is added with the time for one full cycle of the PCR counter, that is, the value obtained by dividing 2 to the power of 33 by 90 kHz (approximate value is 26.5 hours) as the new timestamp offset value and the processing continues. Thereafter, if the value of the PCR time offset decreases during the processing, the timestamp offset value may be updated in the same manner.
[0391] <Operation Example 2> Next, the processing when the transmission side does not describe the timestamp offset will be explained. When there is no description of the timestamp offset in the transmitted data, when the PCR timestamp is received, the value of the NTP clock in the receiving device at the time of reception is read, and in the same manner as above, the time of the NTP clock corresponding to the time when the counter of the PCR timestamp is reset to 0 may be set as the value of the timestamp offset. The presentation process of the MPEG2-TS format asset after setting the value of the timestamp offset may be the same as the case where the value of the timestamp offset is described in the above-described descriptor.
[0392] Note that when viewing a program during broadcast, even if the value of the timestamp offset is not described in the descriptor in the transmitted data, it is possible to obtain it on the receiving device side as described above, for example. However, when recording and playing back a program, it is difficult to obtain the relationship between the NTP timestamp and the PCR timestamp. Therefore, when recording a program in which MMT format assets and MPEG2-TS format assets are mixed, it is desirable to record the timestamp offset descriptor at the same time. When the transmission side does not describe the timestamp offset in the transmitted data, it is desirable to obtain the value of the timestamp offset in the receiving device and add it to the received data for recording. These recorded data may be recorded in the storage unit 810 of FIG. 24, for example. At the time of viewing, these recorded data may be reproduced from the storage unit 810 and used.
[0393] As described above, by performing the presentation process of the asset using the timestamp offset that gives the relationship between the NTP timestamp and the PCR timestamp, more precise presentation synchronization processing becomes possible in a program in which MMT format assets and MPEG2-TS format assets are mixed.
[0394] <Operation Example 3> The presentation area of an asset transmitted by the media transport method of the MMT method is specified by the MPU presentation area descriptor (Figure 34). However, for assets transmitted by other media transport methods such as the MPEG2-TS method, the presentation area may also be specified by the MPU presentation area descriptor (Figure 34). In this case, specifications that have no meaning depending on the type of asset, such as mpu_sequence_number, shall be ignored. This enables the presentation of assets without using a special specification method, enhancing convenience.
[0395] Note that when ignoring the specification of mpu_sequence_number, the presentation area of the entire asset specified by the MP table (MPT) 30001 (Figures 17 and 28) shall follow the area specification of the MPU presentation area descriptor (Figure 34).
[0396] <Operation Example 4> The presentation time of an asset transmitted by the media transport method of the MMT method is specified by the MPU timestamp descriptor (Figure 58). However, for assets transmitted by other media transport methods such as the MPEG2-TS method, the presentation time may also be specified by the MPU timestamp descriptor (Figure 58). In this case, specifications that have no meaning depending on the type of asset, such as mpu_sequence_number, shall be ignored on the receiver side. In this case, the specified time is the presentation time of the beginning of the asset. By using this time information, the difference between the NTP-based timestamp and the PCR-based timestamp can be obtained, and the presentation synchronization of assets transmitted by the MMT method and assets transmitted by the MPEG2-TS method can be achieved. This enables the presentation of assets without using a special specification method, enhancing convenience.
[0397] <Operation Example 5> In Operation Example 3 and Operation Example 4, methods of using an MPU presentation area designation descriptor (FIG. 34) and an MPU timestamp descriptor (FIG. 58) for presenting assets transmitted by a method other than the MMT method were shown, but dedicated descriptors may also be used. As examples of dedicated descriptors, an asset presentation area designation descriptor (FIG. 59) and an asset timestamp descriptor (FIG. 60) may be used. In these descriptors, information that has no meaning other than the MMT method, such as mpu_sequence_number, is not described. This improves certainty without causing processing confusion.
[0398] The descriptors for transmitting the timestamp offset or the presentation time of an asset other than the media transport method of the MMT method, which were described in the above-described Operation Examples 1, 3, 4, and 5, are transmitted as descriptors in the MMT package table. In this case, it is transmitted as data received by the tuner / demodulator unit 831 in FIG. 24 and decoded by the MMT decoding processing unit 841.
[0399] However, as a modification of this operation example, it may be transmitted as data received by the tuner / demodulator unit 832 and decoded by the MPEG2-TS decoding processing unit 842.
[0400] As described in the above Example 5, the video of the asset transmitted by the MMT method synchronized by the synchronization process and the video of the asset transmitted by the MPEG2-TS method may be generated and output as a composite video by the video composite unit 861 in FIG. 24 so as to be presented in any of the regions obtained by dividing the screen based on the LCT described in Examples 1 to 4, for example.
[0401] As described above, examples of embodiments of the present invention have been described using Examples 1 to 5. However, the configuration for realizing the technology of the present invention is not limited to the above-described examples, and various modifications are conceivable. For example, a part of the configuration of one example can be replaced with the configuration of another example, and the configuration of another example can also be added to the configuration of one example. All of these belong to the scope of the present invention. Also, the numerical values, messages, etc. appearing in the text and the drawings are merely examples, and using different ones will not impair the effects of the present invention.
[0402] The functions, etc. of the present invention described above may be realized in hardware by designing a part or all of them, for example, in an integrated circuit. Alternatively, they may be realized in software by a microprocessor unit or the like interpreting and executing an operation program for realizing each function, etc. Hardware and software may be used in combination.
[0403] Note that the software for controlling the broadcast receiving apparatus 100 may be stored in advance in the ROM 103 and / or the storage (accumulation) unit 110, etc. of the broadcast receiving apparatus 100 at the time of product shipment. It may be acquired from other application servers 500, etc. on the Internet 200 via the LAN communication unit 121 after product shipment. Also, the software stored in a memory card, an optical disk, etc. may be acquired via the expansion interface unit 124, etc.
[0404] Also, the control lines and information lines shown in the drawings indicate those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In reality, it may be considered that almost all the components are interconnected.
Explanation of Reference Numerals
[0405] 100,800...Broadcast receiving device, 100a...antenna, 101,801...main control unit, 102,802...system bus, 103,803...ROM, 104,804...RAM, 110,810...storage unit, 121,821...LAN communication unit, 124,824...extension interface unit, 125,825...digital interface unit, 131,831,832...tuner / demodulation unit, 132...separation unit, 141...video decoder, 142...video color gamut conversion unit, 143...audio decoder, 144...character superimposition decoder, 145...subtitle decoder, 146...subtitle synthesis unit, 147...subtitle color gamut conversion unit, 151...data decoder, 152...cache unit, 153...application control unit, 154...browser unit, 155...application color gamut conversion unit, 156...sound source unit, 161,861...video synthesis unit, 162,862...monitor unit, 163,863...video output unit, 164,864...audio synthesis unit, 165,865...speaker unit, 166,866...audio output unit, 170,870...operation input unit, 841...MMT decoding processing unit, 842...MPEG2-TS decoding processing unit, 200...Internet, 200r...router device, 200a...access point, 300t...radio tower, 300s...broadcasting satellite (or communication satellite), 300...broadcasting station server, 400...service provider server, 500...other application servers, 600...mobile telephone communication server, 600b...base station, 700...mobile information terminal.
Claims
【Claim 1】 A content protection processing method for a transmission system that transmits date and time information including the current date and time, control information related to a broadcast program, and broadcast program content from a broadcasting station side, and receives the date and time information, the control information related to the broadcast program, and the broadcast program content at a broadcast receiving device, comprising: In the transmission system, a transmission step of transmitting the broadcast program content from the broadcasting station side to the broadcast receiving device; A receiving step of receiving, by the broadcast receiving device, the date and time information, the control information related to the broadcast program, and the broadcast program content; A recording reservation step of the broadcast receiving device making a recording reservation for the broadcast program using the EIT in which information related to an event is described among the date and time information and the control information received in the receiving step; An accumulation step of the broadcast receiving device accumulating the broadcast program content received in the receiving step using copy control information among the control information received in the receiving step for the broadcast program reserved for recording in the recording reservation step; An output step of the broadcast receiving device outputting the broadcast program content accumulated in the accumulation step to an external device in a copy-prohibited state; Comprising: The current date and time included in the date and time information represent Japan Standard Time; When the broadcast program content received in the receiving step is content that is transmitted with protection that allows copying only once in the transmission system, the broadcast program content accumulated in the accumulation step is encrypted in a copy-prohibited state and in a state that allows playback only by the broadcast receiving device, and the broadcast program content is accumulated; For the broadcast program content accumulated in the accumulation step, when the broadcast program content received in the receiving step is content that is transmitted with protection that allows copying a predetermined number of times in the transmission system, the broadcast program content accumulated in the accumulation step is encrypted in a state that allows nine copies and one move process and in a state that allows playback only by the broadcast receiving device, and the broadcast program content is accumulated. The accumulation of the broadcast program content in the accumulation step can be performed in an accumulation unit located at the output destination of the IP interface via the IP interface provided in the broadcast receiving device, and the accumulation of the broadcast program content in the accumulation step in a state encrypted so that it can be reproduced only by the broadcast receiving device, and the output of the broadcast program content in the output step in a state where copying to an external device is prohibited are performed via an IP interface composed of the same hardware compatible with Ethernet. The output in a state where copying to the external device is prohibited in the output step and the control state of whether copying and moving to the external device are possible or prohibited when the IP address of the external device is within the same subnet as the IP address of the broadcast receiving device, and the output in a state where copying to the external device is prohibited in the output step and the control state of whether copying and moving to the external device are possible or prohibited when the IP address of the external device is not within the same subnet as the IP address of the broadcast receiving device are made different. Content protection processing method.
Citation Information
Patent Citations
Broadcasting system for data broadcast in tv broadcast
JP2001186486A
Image displaying method
JP2002010156A
Recording control method
JP2009048703A
Receiver, receiving method, and output control method
JP2011139191A
Digital content transmission / reception system, and digital content transmission / reception method
JP2014112844A
Cited By
Content protection processing method
JP2025146875A
Content protection processing method
JP2026015475A