Broadcast receiving apparatus and content output method
By using a broadcast receiver compatible with MMT, data in the broadcast wave is separated and decoded, and images and collaborative information are generated and configured. This solves the high added value requirements of existing television receivers in the Internet environment and enables high-resolution images and flexible content distribution.
Patent Information
- Application Number
- CN202010972765.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2015-03-23
- Filing Date
- 2016-01-27
- Publication Date
- 2026-01-30
- Estimated Expiration
- 2036-01-27
AI Technical Summary
Existing television receivers are unable to meet the high added value demands of the Internet environment, especially the requirements for content distribution, collaborative applications, and high-resolution images.
Employing an MMT-compatible broadcast receiver, program coordination information is generated by separating and decoding coded program image data, program coordination data, and screen layout control information in the broadcast wave. The image and coordination information are then appropriately configured in the display area to support the display control of user operation instructions.
It enables higher value-added functions, supports content distribution and collaborative applications in the Internet environment, and improves the resolution and flexibility of image display.
Smart Images

Figure CN112118480B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a broadcast receiving device and a content output method. Background Technology
[0002] As an extended function of digital broadcasting services, data broadcasting is used to transmit digital data via broadcast waves, display various information such as weather forecasts and news, and recommend programs. Various television receivers capable of receiving data broadcasts are commercially available, and numerous technologies related to data broadcast reception, exemplified by Patent Document 1 described below, have been disclosed.
[0003] Existing technical documents
[0004] Patent documents
[0005] Patent Document 1: Japanese Patent Application Publication No. 2001-186486 Summary of the Invention
[0006] The problem that the invention aims to solve
[0007] In response to the changing content distribution environment in recent years, television receivers have also required various functional expansions. In particular, there are increasing demands for content distribution via broadband networks such as the internet, collaborative applications, and higher resolution / high definition video content. However, simply retaining the existing data broadcasting reception functions of current television receivers, or merely expanding upon these functions, is insufficient to provide a high-value-added television receiver that meets these requirements.
[0008] The purpose of this invention is to provide a broadcast receiving device capable of performing functions with higher added value.
[0009] Technical solutions for solving the problem
[0010] As a technical solution to solve the above-mentioned problems, the technology described in the claims is used.
[0011] For example, a broadcast receiving device capable of receiving digital broadcast services from a broadcast system employing a prescribed media transmission method includes: a broadcast receiving unit that receives broadcast waves from the digital broadcast service; a separation unit that separates at least coded program image data, program coordination data, and screen layout control information related to the broadcast program from the received broadcast waves; an image decoding unit that decodes the coded program image data and reproduces the program image information; a coordination information generation unit that parses the program coordination data to generate program coordination information; and a display processing unit that, based on the screen layout control information, appropriately divides the image display area into regions and appropriately configures the program image information and the program coordination information in the divided regions. The system includes a display unit capable of outputting data from the aforementioned image display area as image information; a display unit that displays the image information; an operation input unit for inputting user operation instructions; and a control unit. The display processing unit divides the image display area based on the aforementioned screen layout control information, configures the program image information in one of the divided areas, and configures the program cooperation information in the other divided areas. When outputting data from the aforementioned image display area as image information, if a command to display a specified screen is input into the operation input unit, the control unit controls the display processing unit to output the information of the specified screen as image information without dividing the image display area based on the aforementioned screen layout control information.
[0012] Invention Effects
[0013] By using the technology of the present invention, it is possible to provide a broadcast receiving device capable of performing functions with higher added value. Attached Figure Description
[0014] Figure 1 This is a system structure diagram illustrating an example of a broadcast communication system including the broadcast receiving device of Embodiment 1.
[0015] Figure 2A This is a diagram illustrating the general structure of the coded signals in MMT.
[0016] Figure 2B This is a structural diagram of the MPU in an MMT (Multi-Media Technology) system.
[0017] Figure 2C This is a structural diagram of the MMTP packet in MMT.
[0018] Figure 3 This is a conceptual diagram of the protocol stack of a broadcast system using MMT.
[0019] Figure 4 It is a layer structure diagram of the control information used in the broadcasting system.
[0020] Figure 5AThis is a list of tables used in the TLV-SI broadcast system.
[0021] Figure 5B This is a list of descriptors used in the TLV-SI of the broadcast system.
[0022] Figure 6A This is a list of messages used in the MMT-SI broadcast system.
[0023] Figure 6B This is a list of tables used in the MMT-SI of the broadcast system.
[0024] Figure 6C This is a list of descriptors used in the MMT-SI of the broadcast system (1).
[0025] Figure 6D This is a list of descriptors used in the MMT-SI of the broadcast system (part 2).
[0026] Figure 6E It is a diagram showing the relationship between data transmission in a broadcast system and various tables.
[0027] Figure 7A This is a block diagram of the broadcast receiving device of Embodiment 1.
[0028] Figure 7B This is a structural diagram of the logical plane structure of the broadcast receiving device of Embodiment 1, which demonstrates the broadcast receiving function.
[0029] Figure 7C This is a system structure diagram of clock synchronization / display synchronization of the broadcast receiving device in Embodiment 1.
[0030] Figure 7D This is a software structure diagram of the broadcast receiving device in Embodiment 1.
[0031] Figure 8 This is a block diagram of the broadcasting station server in Example 1.
[0032] Figure 9 This is a block diagram of the service operator server in Embodiment 1.
[0033] Figure 10A This is a block diagram of the portable information terminal of Embodiment 1.
[0034] Figure 10B This is a software structure diagram of the portable information terminal in Example 1.
[0035] Figure 11A This is a diagram representing the data structure of the MH-TOT in a broadcast system.
[0036] Figure 11B This is a diagram showing the format of the JST_time parameter in a broadcast system.
[0037] Figure 12 This is a diagram illustrating the calculation method of the current date of the MJD from the broadcast receiving device according to Embodiment 1.
[0038] Figure 13A This is a diagram representing the structure of the NTP format in a broadcast system.
[0039] Figure 13B It is a diagram representing the data structure of the MPU timestamp descriptor of a broadcast system.
[0040] Figure 13C It is a diagram representing the data structure of the time information in the TMCC extended information area of the broadcast system.
[0041] Figure 14 This is a sequence diagram of the operation during channel scanning of the broadcast receiving device in Embodiment 1.
[0042] Figure 15A This is a diagram representing the data structure of the TLV-NIT broadcast system.
[0043] Figure 15B It is a diagram representing the data structure of the satellite allocation system descriptor of the broadcasting system.
[0044] Figure 15C It is a graph representing the data structure of the service list descriptor of the broadcast system.
[0045] Figure 15D This is a diagram representing the data structure of the AMT (Automated Media Transfer) system in a broadcast system.
[0046] Figure 16 This is a sequence diagram of the actions of the broadcast receiving device in Embodiment 1 when selecting a station.
[0047] Figure 17 This is a diagram representing the data structure of the MPT in a broadcast system.
[0048] Figure 18 This is a diagram representing the data structure of the LCT (Limited Transmission Control) system in a broadcasting system.
[0049] Figure 19A This is a diagram illustrating an example of layout allocation for layout numbers based on LCT.
[0050] Figure 19B This is a diagram illustrating an example of layout allocation for layout numbers based on LCT.
[0051] Figure 19C This is a diagram illustrating an example of layout allocation for layout numbers based on LCT.
[0052] Figure 19DThis is a diagram illustrating an example of layout allocation for layout numbers based on LCT.
[0053] Figure 20A This diagram illustrates the exception handling actions of LCT-based screen layout control.
[0054] Figure 20B This diagram illustrates the exception handling actions of LCT-based screen layout control.
[0055] Figure 21 This is a diagram representing the data structure of the MH-EIT broadcast system.
[0056] Figure 22A This is a screenshot of the EPG screen of the broadcast receiving device in Embodiment 1.
[0057] Figure 22B This is a screenshot of the EPG screen of the broadcast receiving device in Embodiment 1.
[0058] Figure 22C This is a screenshot of the EPG screen of the broadcast receiving device in Embodiment 1.
[0059] Figure 23 This is a screenshot of the emergency alarm broadcast displayed by the broadcast receiving device in Embodiment 1.
[0060] Figure 24 This is a block diagram of the broadcast receiving device of Embodiment 2.
[0061] Figure 25 This is a diagram illustrating the mismatch in the current time displayed when the broadcast service is switched.
[0062] Figure 26 This is a diagram illustrating the action of selecting and controlling the current time information reference source in Embodiment 2.
[0063] Figure 27A This is a screenshot of the EPG screen of the broadcast receiving device in Embodiment 2.
[0064] Figure 27B This is a screenshot of the EPG screen of the broadcast receiving device in Embodiment 2.
[0065] Figure 28 This is a system structure diagram illustrating an example of a broadcast communication system including the broadcast receiving device of Embodiment 3.
[0066] Figure 29A This is a block diagram of the broadcast receiving device of Embodiment 3.
[0067] Figure 29B This is a software structure diagram of the broadcast receiving device in Embodiment 3.
[0068] Figure 30 This is a block diagram of the monitor device of Embodiment 3.
[0069] Figure 31 This is an interface structure diagram of the broadcast receiving device and the monitor device in Embodiment 3.
[0070] Figure 32A This is a diagram illustrating the operation of the data output control of the broadcast receiving device in Embodiment 3.
[0071] Figure 32B This is a diagram illustrating the operation of the data output control of the broadcast receiving device in Embodiment 3.
[0072] Figure 33 This is a diagram representing the data structure of the extended timestamp descriptor of the MPU in a broadcast system.
[0073] Figure 34A This is a diagram illustrating the operation of the data output control of the broadcast receiving device in Embodiment 3.
[0074] Figure 34B This is a diagram illustrating the operation of the data output control of the broadcast receiving device in Embodiment 3.
[0075] Figure 35 This is a diagram illustrating the data mixing and processing operation of the broadcast receiving device in Embodiment 3. Detailed Implementation
[0076] The following uses accompanying drawings to illustrate examples of embodiments of the present invention.
[0077] (Example 1)
[0078] [System Architecture]
[0079] Figure 1 This is a system structure diagram illustrating an example of a broadcast communication system including the broadcast receiving device of this embodiment. The broadcast communication system of this embodiment includes: a broadcast receiving device 100 and an antenna 100a, a broadband network such as the Internet 200 and a routing device 200r and an access point 200a, a radio tower 300t of a broadcasting station, a broadcast satellite (or communication satellite) 300s, a broadcasting station server 300, a service operator server 400, other application servers 500, a mobile phone communication server 600, a base station 600b of a mobile phone communication network, and a portable information terminal 700.
[0080] The broadcast receiving device 100 receives broadcast waves transmitted from the radio tower 300t via a broadcast satellite (or communication satellite) 300s and an antenna 100a. Alternatively, it can receive broadcast waves transmitted from the radio tower 300t directly from the antenna 100a without using the broadcast satellite (or communication satellite) 300s. Furthermore, the broadcast receiving device 100 can connect to the Internet 200 via a routing device 200r, and can send and receive data by communicating with various server devices or other communication devices on the Internet 200.
[0081] Router 200r connects to Internet 200 via wired communication, and to broadcast receiver 100 via wired or wireless communication, and to portable information terminal 700 via wireless communication. The aforementioned wireless communication can utilize methods such as Wi-Fi (registered trademark). Thus, server devices or other communication equipment on Internet 200 can exchange data with broadcast receiver 100 and portable information terminal 700 via router 200r. Alternatively, communication between broadcast receiver 100 and portable information terminal 700 can also bypass router 200r, allowing direct communication via methods such as Bluetooth (registered trademark) or NFC (Near Field Communication).
[0082] Radio tower 300t is the broadcasting equipment of the broadcasting station, transmitting broadcast waves containing encoded data of broadcast programs, subtitle information, other applications, general data, etc. Broadcast satellite (or communication satellite) 300s is a repeater that receives the broadcast waves transmitted from the radio tower 300t of the broadcasting station, performs appropriate frequency conversions, etc., and then retransmits the broadcast waves to antenna 100a connected to broadcast receiving device 100. In addition, the broadcasting station has a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (moving image content, etc.) and metadata such as program titles, program IDs, program summaries, performer information, and broadcast dates and times for each broadcast program, and can provide the aforementioned moving image content and metadata to service operators based on contracts. Furthermore, the provision of the aforementioned moving image content and metadata to service operators can also be done through the API (Application Programming Interface) of the broadcasting station server 300.
[0083] Service operator server 400 is a server device prepared by the service operator, capable of providing various services in conjunction with broadcast programs distributed from the broadcasting station. Furthermore, service operator server 400 stores, manages, and distributes dynamic image content, metadata, various content and applications in conjunction with broadcast programs provided by broadcasting station server 300. It also has the function of retrieving and providing a list of available content or applications in response to inquiries from television receivers, etc. Moreover, the storage, management, and distribution of the aforementioned content and metadata, and the storage, management, and distribution of the aforementioned applications, can be performed by different server devices. The broadcasting station and the service operator can be the same or different. Multiple service operator servers 400 can also be prepared for each different service. Additionally, broadcasting station server 300 can also combine the functions of service operator server 400.
[0084] Other application servers 500 are known server devices used for storing, managing, and distributing other common applications, programs, content, data, etc. Multiple other application servers 500 may exist on the Internet 200.
[0085] The mobile phone communication server 600 is connected to the Internet 200, and on the other hand, it is connected to the portable information terminal 700 via base station 600b. The mobile phone communication server 600 manages the telephone communication (calls) and data transmission and reception of the portable information terminal 700 via the mobile phone communication network, and can transmit and receive data through communication between the portable information terminal 700 and various server devices or other communication devices on the Internet 200. Communication between base station 600b and portable information terminal 700 can be conducted via W-CDMA (Wideband Code Division Multiple Access), GSM (Global System for Mobile communications), LTE (Long Term Evolution), or other communication methods.
[0086] The portable information terminal 700 has the functions of telephone communication (calling) and data transmission and reception via a mobile phone communication network, and wireless communication using Wi-Fi (registered trademark). The portable information terminal 700 can connect to the Internet 200 via a router 200r, access point 200a, or a base station 600b and mobile phone communication server 600 of the mobile phone communication network, and can transmit and receive data by communicating with various server devices or other communication devices on the Internet 200. Access point 200a connects to the Internet 200 via wired communication and connects to the portable information terminal 700 via wireless communication. The aforementioned wireless communication can use methods such as Wi-Fi (registered trademark). Furthermore, communication between the portable information terminal 700 and the broadcast receiving device 100 can be conducted via access point 200a and the Internet 200 and router 200r, or via base station 600b and mobile phone communication server 600 and the Internet 200 and router 200r.
[0087] [Overview of MMT Methods]
[0088] Figure 1 The broadcast receiver 100 shown is a television receiver that serves as a media transmission method for transmitting video, audio, and other data. It replaces the TS (Transport Stream) (hereinafter referred to as MPEG2-TS) specified by the MPEG (Moving Picture Experts Group)-2 system, which is widely used in existing digital broadcasting systems, and is compatible with MMT (MPEG Media Transport). Alternatively, it can be a television receiver compatible with both MPEG2-TS and MMT.
[0089] The defining characteristic of MPEG2-TS is that the video and audio components constituting a program are multiplexed together with control signals and clock signals into a single stream. Because it processes the content, including the clock signal, as a single stream, it is suitable for transmitting content over a single transmission line that ensures transmission quality, and is used by many existing digital broadcasting systems. However, due to the diversification of content, the devices using the content, the transmission lines for distributing content, and the content storage environment in recent years, MPEG2-TS has reached its limits in the face of these changing content distribution environments. Therefore, a new media transmission method, MMT, was developed.
[0090] Figure 2AThis is an example illustrating the outline of the encoded signal of the MMT in this embodiment. As shown in the figure, the MMT of this embodiment, as elements constituting the encoded signal, includes an MFU (Media Fragment Unit), an MPU (Media Processing Unit), an MMTP (MMT Protocol) payload, and MMTP packets. The MFU is a format for transmitting images, audio, etc., and can be constructed in NAL (Network Abstraction Layer) units or access unit units. The MPU can consist of MPU metadata containing information about the overall structure of the MPU, video fragment metadata containing information about the encoded media data, and sample data as the encoded media data. Furthermore, the MFU can be extracted from the sample data. In the case of media such as video components and audio components, the display time and decoding time can be specified on an MPU unit or access unit basis. Figure 2B An example of the structure of an MPU.
[0091] An MMTP packet consists of a header and an MMTP payload, transmitting control information for the MFU and MMT. The MMTP payload has a payload header corresponding to the content (data units) stored in the payload section. Figure 2C This is an example of how an MMTP packet is constructed by forming an MFU from video / audio signals and storing it in the MMTP payload. Furthermore, in video signals encoded using inter-frame prediction, it is preferable to construct the MPU in GOP (Group of Pictures) units. Additionally, when the size of the MFU to be transmitted is small, one MFU can be stored in one payload, or multiple MFUs can be stored in one payload. Furthermore, when the size of the MFU to be transmitted is large, one MFU can be divided into multiple payloads for storage. Moreover, to recover from packet loss on the transmission line, MMTP packets can be protected using techniques such as AL-FEC (Application Layer Forward Error Correction) and ARQ (Automatic Repeat Request).
[0092] In the broadcast system of this embodiment, MPEG-H HEVC (High Efficiency Video Coding) is used as the video encoding method, and MPEG-4 AAC (Advanced Audio Coding) or MPEG-4 ALS (Audio Lossless Coding) is used as the audio encoding method. The encoded video and audio data of the broadcast program, encoded using the above methods, are placed in MFU or MPU format and then into MMTP payloads to form MMTP packets (MMTP packetization), which are then transmitted as IP (Internet Protocol) packets. Furthermore, data content related to the broadcast program can also be in MFU or MPU format, placed in MMTP payloads to form MMTP packets, and transmitted as IP packets. As for the data content transmission methods, the following four transmission methods are prepared: a subtitle / character overlay transmission method used in data streams synchronized with broadcasting; an application transmission method used in data transmission asynchronous with broadcasting; an event message transmission method used for synchronous / asynchronous message notification of applications operating on television receivers; and a general data transmission method for synchronous / asynchronous transmission of other general data.
[0093] MMTP packet transmission uses UDP / IP (User Datagram Protocol / Internet Protocol) on broadcast lines and either UDP / IP or TCP / IP (Transmission Control Protocol / Internet Protocol) on communication lines. Additionally, in broadcast lines, TLV (Type Length Value) multiplexing is used for efficient IP packet transmission. Figure 3 This figure illustrates an example of the protocol stack of the broadcast system in this embodiment. In the figure, (A) is an example of the protocol stack of the broadcast transmission line, and (B) is an example of the protocol stack of the communication line.
[0094] In the broadcast system of this embodiment, a mechanism is prepared for transmitting two types of control information: MMT-SI (MMT-Signaling Information) and TLV-SI (TLV-Signaling Information). MMT-SI is control information representing the structure of broadcast programs, etc. It adopts the format of MMT control messages, is placed in the MMTP payload to form MMTP packets, and is transmitted as IP packets. TLV-SI is control information regarding IP packet multiplexing, providing information for channel selection, IP addresses, and corresponding service information.
[0095] In addition, in broadcast systems using MMT, time information is also transmitted to provide absolute time. Furthermore, MPEG2-TS represents the display time of components based on a different clock for each TS, while MMT represents the display time of components based on Coordinated Universal Time (UTC). Using these mechanisms, terminal devices can synchronously display components transmitted from different transmission points via different transmission lines. To provide UTC, IP packets in NTP (Network Time Protocol) format are used.
[0096] [Control information for broadcast systems using MMT]
[0097] In the broadcast system compatible with the broadcast receiving device 100 of this embodiment, as described above, TLV-SI, relating to the TLV multiplexing mode for IP packet multiplexing, and MMT-SI, relating to the MMT as a media transmission mode, are prepared as control information. TLV-SI provides information for the broadcast receiving device 100 to demultiplex IP packets multiplexed on the broadcast transmission line. TLV-SI consists of a "table" and "descriptors". The "table" is transmitted in section format, and the "descriptors" are configured within the "table". MMT-SI is transmission control information representing information related to the packet structure of the MMT and the broadcast service. MMT-SI consists of three levels: a "message" for storing the "table" and "descriptors", a "table" having elements and attributes representing specific information, and a "descriptor" representing more detailed information. Figure 4 This illustrates an example of a hierarchical structure for control information used in the broadcast system of this embodiment.
[0098] <Tables used in TLV-SI>
[0099] Figure 5A This section presents a list of "tables" used in the TLV-SI of broadcast systems compatible with the broadcast receiving device 100 of this embodiment. In this embodiment, the "tables" of the TLV-SI used are shown below.
[0100] (1) TLV-NIT
[0101] TLV uses a Network Information Table for TLV (TLV-NIT) to represent information about the physical structure of TLV streams transmitted over the network and the characteristics of the network itself.
[0102] (2) AMT
[0103] The Address Map Table (AMT) provides an overview of the multicast groups that make up the IP packets of the various services transmitted in the network.
[0104] (3) Table set by the operator
[0105] In addition, it is possible to prepare tables that can be set up independently by service operators, etc.
[0106] <Descriptors used in TLV-SI>
[0107] Figure 5B This section presents a list of "descriptors" configured in the TLV-SI of a broadcast system compatible with the broadcast receiving device 100 of this embodiment. In this embodiment, the TLV-SI "descriptors" used are shown below.
[0108] (1) Service list descriptor
[0109] The service list descriptor provides an overview of the services offered based on the service identifier and service type.
[0110] (2) Satellite allocation system descriptor
[0111] The satellite allocation system descriptor represents the physical conditions of the satellite transmission line.
[0112] (3) System management descriptor
[0113] System management descriptors are used to identify broadcast and non-broadcast components.
[0114] (4) Network name descriptor
[0115] A network name descriptor describes a network name using character symbols.
[0116] (5) Descriptor set by the operator
[0117] Additionally, it is possible to prepare descriptors that can be set independently by service operators, etc.
[0118] <Messages used in MMT-SI>
[0119] Figure 6AThis section presents a list of "messages" used in the MMT-SI of broadcast systems compatible with the broadcast receiving device 100 of this embodiment. In this embodiment, the MMT-SI "messages" used are shown below.
[0120] (1) PA message
[0121] Package Access (PA) messages are used to transmit various tables.
[0122] (2) Section message (M2)
[0123] M2 section messages are used to transmit the section extension format of MPEG-2 Systems.
[0124] (3) CA message
[0125] CA messages are used to transmit tables that identify conditional access methods.
[0126] (4) M2 short message
[0127] M2 short messages are used to transmit short format MPEG-2 Systems.
[0128] (5) Data transmission message
[0129] Data transfer messages are messages used to store tables about data transfers.
[0130] (6) Messages set by the operator
[0131] In addition, it can prepare messages that can be set independently by service operators, etc.
[0132] <Tables used in MMT-SI>
[0133] Figure 6B This section presents a list of "tables" used in the MMT-SI of a broadcast system compatible with the broadcast receiving apparatus 100 of this embodiment. These tables are control information containing elements and attributes representing specific information, stored in messages and transmitted as MMTP packets. Furthermore, the message storing the table can be determined based on the table. In this embodiment, the "tables" of the MMT-SI used are shown below.
[0134] (1) MPT
[0135] The MMT Package Table (MPT) provides information that constitutes a packet, such as a list of assets and their location on the network. The MPT can be stored in the PA message.
[0136] (2) PLT
[0137] The Package List Table (PLT) represents a list of IP data streams used to transmit PA messages for MMT packets provided as broadcast services, and IP data streams used to transmit packet IDs and IP services. The PLT can be stored within the PA message.
[0138] (3) LCT
[0139] The Layout Configuration Table (LCT) is used to associate layout information for display with layout numbers. The LCT can be stored in the PA message.
[0140] (4) ECM
[0141] The Entitlement Control Message (ECM) is a shared message that includes program information and control information, and sends key information for descrambling, etc. The ECM can be stored in the M2 section message.
[0142] (5) EMM
[0143] The Entitlement Management Message (EMM) transmits individual information including each participant's contract information and the encryption key used to decrypt the ECM (Shared Information). The EMM can be stored in the M2 section of the message.
[0144] (6)CAT(MH)
[0145] The Conditional Access Table (CAT) (MH) is used to store descriptors that identify conditional access methods. The CAT (MH) can be stored in a CA message.
[0146] (7)DCM
[0147] The Download Control Message (DCM) transmits key-related information, including the key used to decrypt the transmission line cipher used for downloading. The DCM can be stored in the M2 section of the message.
[0148] (8)DMM
[0149] The Download Management Message (DMM) transmits key-related information, including the download key used to decrypt the DCM cipher. The DMM can be stored in the M2 section of the message.
[0150] (9)MH-EIT
[0151] The MH-Event Information Table (MH-EIT) contains timing information about events contained in various services. MH-EIT can be stored in the M2 section of the message.
[0152] (10)MH-AIT
[0153] The MH-Application Information Table (MH-AIT) stores all information about the application, including its required startup status. The MH-AIT can be stored in the M2 section message.
[0154] (11)MH-BIT
[0155] The MH-Broadcaster Information Table (MH-BIT) is used to display information about broadcasters existing on the network. The MH-BIT can be stored in the M2 section of the message.
[0156] (12)MH-SDTT
[0157] The MH-Software Download Trigger Table (MH-SDTT) is used to provide notification information for downloads. The MH-SDTT can be stored in the M2 section message.
[0158] (13)MH-SDT
[0159] The MH-Service Description Table (MH-SDT) contains sub-tables representing the services contained in a specific TLV stream, and transmits information about the grouped channel, such as the name of the grouped channel and the name of the broadcast operator. The MH-SDT can be stored in the M2 section message.
[0160] (14)MH-TOT
[0161] The MH-Time Offset Table (MH-TOT) transmits JST time and date (corrected Julian day) information. MH-TOT can be stored in an M2 short message.
[0162] (15)MH-CDT
[0163] The MH-Common Data Table (MH-CDT) is used to transmit shared data to be stored in non-volatile memory in section format to all receivers that receive it. The MH-CDT can be stored in an M2 section message.
[0164] (16) DDM Table
[0165] The Data Directory Management Table (DDM) provides the directory structure of the files that make up an application, separating the application's file structure from the structure used for file transfers. The DDM can be stored in data transfer messages.
[0166] (17) DAM table
[0167] The Data Asset Management Table (DAM) provides the structure of MPUs within a resource and version information for each MPU. The DAM table can be stored in data transfer messages.
[0168] (18) DCC Table
[0169] The Data Content Configuration Table (DCC table) provides structural information about the files that constitute the data content, enabling flexible and effective caching control. The DCC table can be stored in data transmission messages.
[0170] (19)EMT
[0171] The Event Message Table (EMT) is used to transmit information about event messages. The EMT can be stored in the M2 section of the message.
[0172] (20) Table set by the operator
[0173] In addition, it is possible to prepare tables that can be set up independently by service operators, etc.
[0174] <Descriptors used in MMT-SI>
[0175] Figure 6C and Figure 6D This table shows a list of "descriptors" configured in the MMT-SI of a broadcast system compatible with the broadcast receiving device 100 of this embodiment. Descriptors are control information that provides more detailed information and are configured in the table. Furthermore, the table configuring descriptors can be determined based on the descriptors. In this embodiment, the "descriptors" of the MMT-SI used are shown below.
[0176] (1) Resource group descriptor
[0177] Resource group descriptors provide information about resource group relationships and priorities within groups. Resource group descriptors can be configured in the MPT (Multi-Level Designation).
[0178] (2) Event Packet Descriptor
[0179] Event packet descriptors provide a mapping between program events and packets. Event packet descriptors can be configured in MH-EIT, which uses M2 section messages for transmission.
[0180] (3) Background color specification descriptor
[0181] The background color specifyer descriptor provides the background color of the backmost element in the layout specification. The background color specifyer descriptor can be configured in the LCT.
[0182] (4) MPU presentation area descriptor
[0183] The MPU display area specification descriptor specifies the location where the MPU is displayed. The MPU display area specification descriptor can be configured in the MPT.
[0184] (5) MPU timestamp descriptor
[0185] The MPU timestamp descriptor represents the display time of the first accessed unit in the MPU in display order. The MPU timestamp descriptor can be configured in the MPT.
[0186] (6) Dependency Descriptor
[0187] A dependency descriptor provides the resource ID of the resource in which the dependency exists. Dependency descriptors can be configured in the MPT.
[0188] (7) Access control descriptor
[0189] Access control descriptors provide information for identifying conditional access methods. Access control descriptors can be configured in MPT or CAT(MH).
[0190] (8) Scrambling mode descriptor
[0191] The scrambling mode descriptor provides information for identifying the encryption object and the type of encryption algorithm used during scrambling. The scrambling mode descriptor can be configured in MPT or CAT(MH).
[0192] (9) Message authentication method descriptor
[0193] The message authentication method descriptor provides information used to identify the message authentication method when performing message authentication. The message authentication method descriptor can be configured in MPT or CAT(MH).
[0194] (10) Emergency Message Descriptor (MH)
[0195] Emergency Message Descriptors (MHs) are used when broadcasting emergency alerts. MHs can be configured in the MPT (Multi-Level Program).
[0196] (11) MH-MPEG-4 audio descriptor
[0197] The MH-MPEG-4 audio descriptor is used to describe basic information for determining the encoding parameters of an audio stream in ISO / IEC 14496-3 (MPEG-4 audio). The MH-MPEG-4 audio descriptor can be configured in the MPT.
[0198] (12) MH-MPEG-4 audio extended descriptor
[0199] The MH-MPEG-4 audio extension descriptor is used to describe the configuration file and level of the MPEG-4 audio stream, as well as the inherent settings of the encoding method. The MH-MPEG-4 audio extension descriptor can be configured in the MPT.
[0200] (13) MH-HEVC video descriptor
[0201] The MH-HEVC video descriptor is used to describe the basic coding parameters of video streams (HEVC streams) according to ITU-T Recommendation H.265|ISO / IEC 23008-2. The MH-HEVC video descriptor can be configured in MPT.
[0202] (14) MH-Connection Descriptor
[0203] The MH-connection descriptor identifies the service provided when a viewer requests additional information related to a specific item recorded in the program arrangement information system. MH-connection descriptors can be configured in MPT, MH-EIT, MH-SDT, etc.
[0204] (15) MH - Event Group Descriptor
[0205] The MH-Event Group Descriptor is used to represent the grouping of events when there are relationships between them. The MH-Event Group Descriptor can be configured in MH-EIT.
[0206] (16) MH-Service List Descriptor
[0207] The MH-Service List Descriptor provides a list of services based on service identifier and service format type. The MH-Service List Descriptor can be configured in the MH-BIT.
[0208] (17) MH - Short Format Event Descriptor
[0209] The MH-short format event descriptor represents the event name and a brief description of the event in text format. The MH-short format event descriptor can be configured in MH-EIT.
[0210] (18) MH-Extended Format Event Descriptor
[0211] The MH-Extended Format Event Descriptor is used in conjunction with the MH-Short Format Event Descriptor to provide a detailed description of the event. The MH-Extended Format Event Descriptor can be configured in MH-EIT.
[0212] (19) Image component descriptor
[0213] Image component descriptors represent parameters and descriptions about image components and are also used to describe the basic stream in character format. Image component descriptors can be configured in MPT or MH-EIT.
[0214] (20) MH-Stream Identifier Descriptor
[0215] The MH-stream identification descriptor is used to attach a label to the component streams of a service, and this label can be used to reference the description content represented by the image component descriptor in MH-EIT. The MH-stream identification descriptor can be configured in MPT.
[0216] (21) MH - Content Descriptor
[0217] The MH-content descriptor represents the type of event. The MH-content descriptor can be configured in MH-EIT.
[0218] (22)MH-Parental Hierarchical Control Descriptor
[0219] The MH-Parental Rating Control Descriptor represents age-based audiovisual restrictions and is used to extend these restrictions based on other criteria. The MH-Parental Rating Control Descriptor can be configured in either MPT or MH-EIT.
[0220] (23) MH - Sound Component Descriptor
[0221] MH-Voice Component Descriptors represent the parameters of the audio elementary stream and are also used to describe the elementary stream in character format. MH-Voice Component Descriptors can be configured in MPT or MH-EIT.
[0222] (24)MH - Object Region Descriptor
[0223] The MH-Object Region Descriptor is used to describe the region of a program or a stream that forms part of a program as an object. The MH-Object Region Descriptor can be configured in the MPT.
[0224] (25) MH-series descriptors
[0225] The MH-series descriptor is used to identify series programs. The MH-series descriptor can be configured in MH-EIT.
[0226] (26) MH-SI transmission parameter descriptor
[0227] The MH-SI transmission parameter descriptor is used to represent the transmission parameters of the SI. The MH-SI transmission parameter descriptor can be configured in the MH-BIT.
[0228] (27)MH-Broadcaster Name Descriptor
[0229] The MH-broadcaster name descriptor describes the name of the broadcaster. The MH-broadcaster name descriptor can be configured in the MH-BIT.
[0230] (28)MH-Service Descriptor
[0231] The MH-Service Descriptor represents the group channel name, its operator name, and the service format type using character symbols. The MH-Service Descriptor can be configured in the MH-SDT.
[0232] (29) IP Data Stream Descriptor
[0233] IP flow descriptors provide information about the IP flow that constitutes the service. IP flow descriptors can be configured in MH-SDT.
[0234] (30) MH-CA boot descriptor
[0235] The MH-CA boot descriptor contains boot information used to start the CAS program on the CAS base disk. The MH-CA boot descriptor can be configured in MPT or CAT(CA).
[0236] (31) MH-Type descriptor
[0237] The MH-Type descriptor indicates the type of file being transferred using the application's transfer method. The MH-Type descriptor can be configured in the DAM table.
[0238] (32) MH-Info descriptor
[0239] The MH-Info descriptor describes information about the MPU or project. The MH-Info descriptor can be configured in the DAM table.
[0240] (33) MH-Expire descriptor
[0241] The MH-Expire descriptor describes the expiration period of an item. The MH-Expire descriptor can be configured in the DAM table.
[0242] (34) MH-Compression Type descriptor
[0243] The MH-Compression Type descriptor indicates that the item to be transmitted is compressed, and specifies the compression algorithm and the number of bytes in the item before compression. The MH-Compression Type descriptor can be configured in the DAM table.
[0244] (35) MH - Data Encoding Mode Descriptor
[0245] The MH (Data Encoding Mode) descriptor is used to identify the data encoding mode. The MH descriptor can be configured in the MPT (Multi-Level Design).
[0246] (36) UTC-NPT reference descriptor
[0247] The UTC-NPT reference descriptor is used to communicate the relationship between NPT (Normal Play Time) and UTC. The UTC-NPT reference descriptor can be configured in the EMT.
[0248] (37) Event message descriptor
[0249] Event message descriptors convey general information about event messages. Event message descriptors can be configured in the EMT.
[0250] (38) MH - Local Time Offset Descriptor
[0251] The MH-Local Time Offset Descriptor is used to offset the displayed time from the actual time (e.g., UTC+9 hours) when daylight saving time is in effect. The MH-Local Time Offset Descriptor can be configured in MH-TOT.
[0252] (39) MH-Component Group Descriptor
[0253] The MH-component group descriptor defines and identifies combinations of components within an event. The MH-component group descriptor can be configured in MH-EIT.
[0254] (40) MH-logo transfer descriptor
[0255] The MH-logo transfer descriptor is used to describe simple logo strings, pointers to CDT format logos, etc. The MH-logo transfer descriptor can be configured in the MH-SDT.
[0256] (41) MPU Extended Timestamp Descriptor
[0257] The MPU extended timestamp descriptor provides the decoding time of the access unit within the MPU. The MPU extended timestamp descriptor can be configured in the MPT.
[0258] (42) MPU download content descriptor
[0259] The MPU download content descriptor is used to describe the attribute information of the content downloaded using the MPU. The MPU download content descriptor can be configured in MH-SDTT.
[0260] (43) MH - Network Download Content Descriptor
[0261] The MH-Network Download Content Descriptor is used to describe the attribute information of content downloaded over the network. The MH-Network Download Content Descriptor can be configured in MH-SDTT.
[0262] (44)MH - Application Descriptor
[0263] The MH-Application Descriptor describes information about the application. The MH-Application Descriptor can be configured in MH-AIT.
[0264] (45) MH - Transport Protocol Descriptor
[0265] The MH-Transmission Protocol Descriptor is used to specify the transmission protocol for broadcasting, communication, etc., and to indicate the location information of applications that depend on the transmission protocol. The MH-Transmission Protocol Descriptor can be configured in MH-AIT.
[0266] (46) MH - Simple Application Location Descriptor
[0267] The MH-Simple Application Location Descriptor is used to indicate details of the application's retrieval source. The MH-Simple Application Location Descriptor can be configured in MH-AIT.
[0268] (47)MH - Application Boundary Permission Setting Descriptor
[0269] The MH-Application Boundary Permission Setting Descriptor sets the application boundary and configures broadcast source access permissions on a per-zone (URL) basis. The MH-Application Boundary Permission Setting Descriptor can be configured in MH-AIT.
[0270] (48) MH - Startup Priority Information Descriptor
[0271] The MH-Startup Priority Information Descriptor is used to specify the startup priority of an application. The MH-Startup Priority Information Descriptor can be configured in MH-AIT.
[0272] (49) MH - Cache Information Descriptor
[0273] The MH-Cache Information Descriptor describes cache control when resources constituting the application are pre-stored in the cache in cases where the application is anticipated to be used again. The MH-Cache Information Descriptor can be configured in MH-AIT.
[0274] (50)MH - Randomly Applicable Delay Descriptor
[0275] The MH-Random Applicable Delay Descriptor describes the load distribution of server accesses expected by the application, allowing for a randomized delay amount at which application control is performed. The MH-Random Applicable Delay Descriptor can be configured in MH-AIT.
[0276] (51) Connect to the destination PU descriptor
[0277] The destination PU descriptor describes other presentation units that may be transferred from this presentation unit (PU). The destination PU descriptor can be configured in the DCC table.
[0278] (52) Lock the cache specified descriptor
[0279] The lock cache specification descriptor describes the file specified for objects cached and locked in this display cell. The lock cache specification descriptor can be configured in the DCC table.
[0280] (53) Unlock the cached specified descriptor
[0281] The unlock cache specification descriptor describes the file to be unlocked from the files locked in this display unit. The unlock cache specification descriptor can be configured in the DCC table.
[0282] (54) Descriptor set by the operator
[0283] Additionally, it is possible to prepare descriptors that can be set independently by service operators, etc.
[0284] <Relationship between data transmission and various control information in MMT mode>
[0285] Here, refer to Figure 6E The relationship between data transmission and representative tables in a broadcast system compatible with the broadcast receiving device 100 of this embodiment will be explained.
[0286] In a broadcast system compatible with the broadcast receiving device 100 of this embodiment, data can be transmitted via multiple paths, such as TLV streams via broadcast transmission lines or IP data streams via communication lines. TLV streams include TLV-SIs such as TLV-NIT and AMT, and IP data streams as data streams of IP packets. IP data streams include video resources containing a series of video MPUs and audio resources containing a series of audio MPUs. Similarly, IP data streams may also include subtitle resources containing a series of subtitle MPUs, character overlay resources containing a series of character overlay MPUs, and data resources containing a series of data MPUs. These various resources are associated in units called "packets" according to the MPT (MMT packet table) stored in the PA message and transmitted. Specifically, this is achieved by recording the packet ID (corresponding to the one described later) in the MPT. Figure 17 The “MMT_package_id_byte” parameter shown) and the resource IDs of each resource contained in the package (corresponding to those described later) Figure 17 The above association is performed using the "asset_id_byte" parameter shown.
[0287] The resources that make up a packet can also be resources from a TLV stream, but such as Figure 6E As shown, it can also include resources transmitted via IP data streams over communication lines. This can be achieved by including the location information of each resource contained in the packet (corresponding to those described later) in the MPT. Figure 17 The broadcast receiving device 100 in this embodiment is able to grasp the reference destination of each resource by changing the value of the "MMT_general_location_infonolocation_type" parameter configured in the above location information. More specifically, by changing the value of the "MMT_general_location_infonolocation_type" parameter configured in the above location information, the broadcast receiving device 100 can refer to...
[0288] (1) Data multiplexed in the same IP data stream as MPT
[0289] (location_type = 0x00)
[0290] (2) Data in IPv4 data stream multiplexing
[0291] (location_type = 0x01)
[0292] (3) Data in IPv6 data stream multiplexing
[0293] (location_type = 0x02)
[0294] (4) Data multiplexed in broadcast MPEG2-TS
[0295] (location_type = 0x03)
[0296] (5) Data multiplexed in MPEG2-TS format in IP data streams
[0297] (location_type = 0x04)
[0298] (6) Data at the specified URL
[0299] (location_type = 0x05)
[0300] Various data transmitted using various transmission paths.
[0301] In the aforementioned references, (1) is, for example, via the method described below. Figure 7A The IP data stream received by the tuning / demodulation unit 131 of the broadcast receiving device 100 is a digital broadcast signal received by the IP data stream. In cases where the IP data stream on the communication line side also includes MPT and is transmitted, sometimes the reference destination of (1) becomes the IP data stream received by the LAN communication unit 121 via the communication line, as described later. Furthermore, (2), (3), (5), and (6) above are IP data streams received by the LAN communication unit 121 via the communication line, as described later. Additionally, (4) above, for example, in the case described later... Figure 24 In the case of a broadcast receiving device 800 of Embodiment 2, which has both a receiving function for receiving digital broadcast signals using the MMT method and a receiving function for receiving digital broadcast signals using the MPEG2-TS method, it can be used when referring to MPEG2-TS data received by the receiving function for receiving digital broadcast signals using the MPEG2-TS method, based on the MMT location information (“MMT_general_location_info()”) contained in the digital broadcast signal using the MMT method.
[0302] Furthermore, the data constituting the "packet" is specified in such a way that, in a broadcast system compatible with the broadcast receiving device 100 of this embodiment, the series of data of the "packet" unit is treated as a "service" unit of digital broadcasting.
[0303] Furthermore, the MPT contains the display time information for each MPU specified by the MPT (corresponding to the following description). Figure 13B The "mpu_presentation_time" parameter (as shown) allows for the synchronized display (display, output, etc.) of multiple MPUs specified by the MPT, based on UTC-based time information, i.e., the NTP clock. Display control using this NTP-based clock will be described later.
[0304] Figure 6E In the data transmission method of this embodiment shown, the concept of "event" also exists. An "event" refers to a so-called "program" processed by MH-EIT and included in the M2 section message. Specifically, in the "packet" pointed to by the event packet descriptor stored in MH-EIT, from the indicated time stored in MH-EIT (corresponding to the time described later)... Figure 21 The duration starting from the “start_time” parameter shown (corresponding to the following). Figure 21 The series of data contained in the period (as shown in the "duration" parameter) is the data included in the concept of "event". MH-EIT can be used in various processes performed in the broadcast receiving device 100 of this embodiment in units of "event" (e.g., program schedule generation processing, recording reservation and audiovisual reservation control, copyright management processing such as temporary storage).
[0305] [Hardware structure of broadcast receiving device]
[0306] Figure 7A This is a block diagram illustrating an example of the internal structure of a broadcast receiver 100. The broadcast receiver 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuning / demodulation unit 131, a separation unit 132, an image decoder 141, an image color gamut conversion unit 142, an audio decoder 143, a character overlay decoder 144, a subtitle decoder 145, a subtitle synthesis unit 146, a subtitle color gamut conversion unit 147, a data decoder 151, a buffer unit 152, an application control unit 153, a browser unit 154, an application color gamut conversion unit 155, an audio source unit 156, an image synthesis unit 161, a monitor unit 162, an image output unit 163, an audio synthesis unit 164, a speaker unit 165, an audio output unit 166, and an operation input unit 170.
[0307] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 according to a prescribed operating procedure. The system bus 102 is a data communication line used for data transmission and reception between the main control unit 101 and the various operating blocks within the broadcast receiving device 100.
[0308] ROM (Read Only Memory) 103 is a non-volatile memory that stores basic operating programs and other operating programs, such as the operating system. For example, it may be a rewritable ROM like EEPROM (Electrically Erasable Programmable ROM) or Flash ROM. Operating settings required for the operation of the broadcast receiver 100 can be stored in ROM 103. RAM (Random Access Memory) 104 is the working area for the basic operating programs and other operating programs. ROM 103 and RAM 104 can be integrated with the main control unit 101. Alternatively, ROM 103 may not be as... Figure 7A Instead of the independent structure shown, a portion of the storage area within the storage (accumulation) section 110 is used.
[0309] The storage unit 110 stores the operating program and operating settings of the broadcast receiver 100, as well as the personal information of the user of the broadcast receiver 100. It can also store operating programs downloaded via the Internet 200 and various data generated using these operating programs. Furthermore, it can store moving images, still images, and sounds obtained from broadcast waves or downloaded via the Internet 200. A portion of the storage unit 110 can replace all or part of the functions of the ROM 103. Additionally, the storage unit 110 needs to maintain the stored information even when no external power is supplied to the broadcast receiver 100. Therefore, devices such as flash memory ROM, non-volatile semiconductor memory such as SSD (Solid State Drive), and disk drives such as HDD (Hard Disc Drive) can be used.
[0310] Furthermore, the aforementioned operation programs stored in ROM103 and storage (accumulation) unit 110 can be added, updated, and have their functions expanded through download processing from various server devices on Internet 200.
[0311] The LAN (Local Area Network) communication unit 121 connects to the Internet 200 via the router 200r, and transmits and receives data with various server devices or other communication devices on the Internet 200. It also acquires MMT data strings (or portions thereof) of programs transmitted via the communication line. The connection to the router 200r can be a wired connection or a wireless connection such as Wi-Fi. The LAN communication unit 121 includes encoding circuits, decoding circuits, etc. Furthermore, the broadcast receiver 100 may further include other communication units such as a Bluetooth communication unit, an NFC communication unit, and an infrared communication unit.
[0312] The tuning / demodulation unit 131 receives broadcast waves transmitted from the radio tower 300t via antenna 100a, and tunes (selects stations) to the channel of the service requested by the user based on the control of the main control unit 101. Furthermore, the tuning / demodulation unit 131 demodulates the received broadcast signal to obtain an MMT data string. Additionally, in Figure 7A The example shown illustrates a structure with one tuning / demodulation unit, but for purposes such as simultaneously displaying multiple screens and recording background programs, a structure in which the broadcast receiver 100 is equipped with multiple tuning / demodulation units can also be adopted.
[0313] The separation unit 132 is an MMT decoder. Based on the control signals in the input MMT data string, it distributes the image data string, audio data string, character overlay data string, and subtitle data string, which are real-time display elements, to the image decoder 141, audio decoder 143, character overlay decoder 144, and subtitle decoder 145, respectively. The data input to the separation unit 132 can be an MMT data string transmitted via a broadcast transmission line and demodulated by the tuning / demodulation unit 131, or an MMT data string transmitted via a communication line and received by the LAN communication unit 121. In addition, the separation unit 132 reproduces multimedia application data or file data that is a component of it and temporarily stores it in the buffer unit 152. Furthermore, the separation unit 132 extracts general data and outputs it to the data decoder 151 for use in players displaying data other than image, audio, and subtitle data, or for streaming application data. In addition, the separation unit 132 can also perform error correction and access restriction control on the input MMT data string based on the control of the main control unit 101.
[0314] The image decoder 141 decodes the image data string input from the separation unit 132 and outputs image information. The image color gamut conversion unit 142 performs color space conversion processing on the image information decoded by the image decoder 141 as needed for image compositing processing in the image compositing unit 161. The audio decoder 143 decodes the audio data string input from the separation unit 132 and outputs audio information. Alternatively, streaming data in formats such as MPEG-DASH (MPEG-Dynamic Adaptive Streaming over HTTP) obtained from the Internet 200 via the LAN communication unit 121 can be input into the image decoder 141 and audio decoder 143. Furthermore, multiple image decoders 141, image color gamut conversion units 142, and audio decoders 143 can be included to simultaneously decode multiple types of image and audio data strings.
[0315] The character overlay decoder 144 decodes the character overlay data string input from the separation unit 132 and outputs character overlay information. The subtitle decoder 145 decodes the subtitle data string input from the separation unit 132 and outputs subtitle information. The character overlay information output from the character overlay decoder 144 and the subtitle information output from the subtitle decoder 145 are combined in the subtitle synthesis unit 146, and then in the subtitle color gamut conversion unit 147, color space conversion is performed as needed for the image synthesis processing in the image synthesis unit 161. Furthermore, in this embodiment, in a character-based service displayed simultaneously with the broadcast program's image, information related to the image content is called subtitle, and everything else is called character overlay. However, without distinguishing between them, they are collectively referred to as subtitles.
[0316] Browser unit 154, based on instructions from application control unit 153 that parses control information contained in the MMT data string and control information obtained from a server device on Internet 200 via LAN communication unit 121, displays the multimedia application file obtained from cache unit 152 or from server device on Internet 200 via LAN communication unit 121, and file type data that are components thereof. Furthermore, the aforementioned multimedia application file may be an HTML (Hypertext Markup Language) document, a BML (Broadcast Markup Language) document, etc. The application information output from browser unit 154 is further processed in application color gamut conversion unit 155, where color space conversion is performed as needed for image compositing processing in image compositing unit 161. In addition, browser unit 154 also reproduces application sound information by activating audio source unit 156.
[0317] The image compositing unit 161 receives image information output from the image color gamut conversion unit 142, subtitle information output from the subtitle color gamut conversion unit 147, and application information output from the application color gamut conversion unit 155, and performs appropriate selection and / or overlay processing. The image compositing unit 161 has an image RAM (not shown), and drives the monitor unit 162 based on the image information input to the aforementioned image RAM. Furthermore, under the control of the main control unit 101, the image compositing unit 161 performs scaling processing and overlay processing of EPG (Electronic Program Guide) screen information generated based on MH-EIT information included in the MMT-SI, as needed. The monitor unit 162 is, for example, a display device such as a liquid crystal panel, and provides the user of the broadcast receiver 100 with image information that has undergone selection and / or overlay processing by the image compositing unit 161. The image output unit 163 is an image output interface that outputs image information that has undergone selection and / or overlay processing by the image compositing unit 161.
[0318] Furthermore, the display function of the broadcast receiving device 100 in this embodiment has a logical plane structure in order to display multimedia services according to the operator's intention. Figure 7B This is an example of the logical plane structure of the display function of the broadcast receiving device 100 in this embodiment. In the above logical plane structure, a character overlay plane for displaying overlayed characters is arranged at the front, and a subtitle plane for displaying subtitles is arranged on the next layer. A multimedia plane for displaying broadcast images, multimedia applications, or composite images thereof is arranged on the third layer, and a background plane is arranged at the backmost position (the very back). In the subtitle compositing unit 146 and the image compositing unit 161, character overlay information is depicted on the character overlay plane, subtitle information is depicted on the subtitle plane, and image information, application information, etc., are depicted on the multimedia plane. In addition, a background color is depicted on the background plane based on LCT and other elements included in MMT-SI. Furthermore, multiple third-layer multimedia planes can be prepared depending on the number of image decoders 141. However, even when multiple multimedia planes exist, application information, etc., output from the application color gamut conversion unit 155 is only output to the frontmost multimedia plane.
[0319] The sound synthesis unit 164 takes into account the sound information output from the sound decoder 143 and the application sound information reproduced by the sound source unit 156, and performs appropriate selection and / or mixing processing. The speaker unit 165 provides the sound information, which has undergone selection and / or mixing processing by the sound synthesis unit 164, to the user of the broadcast receiving device 100. The sound output unit 166 is a sound output interface that outputs the sound information, which has undergone selection and / or mixing processing by the sound synthesis unit 164.
[0320] The expansion interface section 124 is an interface group used to expand the functionality of the broadcast receiver 100. In this embodiment, it consists of an analog video / audio interface, a USB (Universal Serial Bus) interface, and a memory interface. The analog video / audio interface receives analog video / audio signals from and outputs analog video / audio signals to external video / audio output devices. The USB interface connects to a PC or similar device for data transmission and reception. It can also connect to an HDD for recording broadcast programs and content. Additionally, it can connect to a keyboard or other USB devices. The memory interface connects to a memory card or other storage medium for data transmission and reception.
[0321] The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface unit 125 can directly output MMT data strings demodulated by the tuning / demodulation unit 131, MMT data strings obtained via the LAN communication unit 121, or mixed data of the above MMT data strings. Additionally, it can be controlled to input MMT data strings from the digital interface unit 125 to the separation unit 132. The digital interface unit 125 can also output digital content stored in the storage unit 110, or store digital content in the storage unit 110.
[0322] The digital interface unit 125 can be a DVI terminal, an HDMI terminal, or a DisplayPort terminal, etc., and outputs or inputs data in a format conforming to DVI, HDMI, or DisplayPort specifications. It can also output or input serial data in a format conforming to IEEE 1394 specifications. Alternatively, it can be configured as an IP interface that outputs digital data via hardware such as Ethernet or wireless LAN. In this case, the digital interface unit 125 and the LAN communication unit 121 can share this hardware structure.
[0323] The operation input unit 170 is an instruction input unit for inputting operation instructions to the broadcast receiving device 100. In this embodiment, it consists of a remote control receiving unit that receives instructions sent from a remote control (not shown) and operation buttons arranged with push-button switches. Only one of these may be used. Furthermore, the operation input unit 170 may be replaced by a touch panel superimposed on the monitor unit 162. It may also be replaced by a keyboard or the like connected to the expansion interface unit 124. The remote control (not shown) may also be replaced by a portable information terminal 700 with remote control instruction transmission function.
[0324] Furthermore, as described above, when the broadcast receiving device 100 is a television receiver or the like, the image output unit 163 and the audio output unit 166 are not essential structures in this invention. In addition to a television receiver, the broadcast receiving device 100 can also be a DVD (Digital Versatile Disc) recorder or other optical disc drive recorder, an HDD recorder or other disk drive recorder, an STB (Set Top Box), etc. It can also be a PC (Personal Computer) or tablet terminal, navigation device, game console, etc., with digital broadcast reception and broadcast communication cooperation functions. When the broadcast receiving device 100 is a DVD recorder, HDD recorder, STB, etc., it may not have a monitor unit 162 and a speaker unit 165. By connecting an external monitor and an external speaker to the image output unit 163 and the audio output unit 166 or the digital interface unit 125, the same operation as the broadcast receiving device 100 of this embodiment can be achieved.
[0325] [System architecture for clock synchronization / display synchronization of broadcast receiving devices]
[0326] Figure 7C This is an example of a clock synchronization / display synchronization system structure for a broadcast system compatible with the broadcast receiving device 100 of this embodiment. In the broadcast system of this embodiment, UTC is transmitted from the broadcast sending system to the receiver (broadcast receiving device 100, etc. of this embodiment) in an NTP timestamp format with a length of 64 bits. In the above-described NTP timestamp format, the "seconds and longer" (seconds and longer) of UTC is represented by 32 bits, and the "less than seconds" (less than seconds) is also represented by 32 bits. However, in reality, it is difficult to reproduce 1 second with 32-bit precision. Therefore, as the system clock for synchronizing the video system and the system clock for operating the NTP format clock, a frequency of "2 to the power of 24" Hz (approximately 16.8 MHz) can be used, for example, as shown in the figure. In addition, considering that the system clock of existing broadcast systems is 27 MHz and that the hardware structure of the receiver can be easily constructed, it is preferable to use a frequency of powers of 2, such as "2 to the power of 24" to "2 to the power of 28", as the system clock.
[0327] Furthermore, on both the broadcasting and receiving sides, when the system clock is set to a power of 2 (2^24 to 2^28) as described above, the lower 8 to 4 bits (in bits) of the PLL (Phase Locked Loop) used to reproduce the system clock or NTP-format clock transmitted from the broadcasting system to the receiving side, which are not referenced by the PLL, can be fixed to "0" or "1". That is, if the system clock is a power of 2 Hz (…), Figure 7C In the example where n=24, the lower 32-n bits of the NTP timestamp format can be fixed as "0" or "1". Alternatively, the receiver can ignore the lower 32-n bits of the NTP timestamp format as described above.
[0328] On the broadcast transmission system side, when NTP format time information is received from an external source, a PLL class is constructed using a 32+n bit counter based on a 2^n Hz VCO (Voltage Controlled Oscillator) to generate a transmission system clock synchronized with the externally received time information. Furthermore, the entire signal processing system operates in synchronization with the 2^n Hz system clock. Finally, the output of the aforementioned transmission system clock is periodically transmitted to the receiver side as NTP long format time information via the broadcast transmission line.
[0329] On the receiver side, NTP long-format time information is received via the broadcast transmission line, and the receiving system clock is reproduced using a PLL-type VCO based on a frequency of "2 to the power of n" Hz, just like on the broadcast transmission system side. Thus, the receiving system clock becomes synchronized with the broadcast transmission system side. Furthermore, by synchronizing the receiver's signal processing system with the "2 to the power of n" Hz system clock, clock synchronization between the broadcast transmission system side and the receiver side is achieved, enabling stable signal reproduction. Additionally, on the broadcast transmission system side, based on the aforementioned NTP format time information, the decoding time and display time for each display unit of the video / audio signal are set. Here, the MPT stored in the PA message transmitted via the broadcast signal contains the information described later. Figure 13B The MPU timestamp descriptor shown. Figure 13B The "mpu_sequence_number(MPU sequence number)" parameter of the MPU timestamp descriptor represents the sequence number of the MPU describing the timestamp, and the "mpu_presentation_time(MPU presentation time)" parameter represents the presentation time of the MPU in 64-bit NTP timestamp format. Therefore, the receiver can refer to the MPU timestamp descriptors stored in the MPT to control the presentation (display, output, etc.) time of each MPU for video signals, audio signals, subtitles, character overlays, etc.
[0330] Furthermore, when controlling the decoding and display times of each display unit of the aforementioned image / audio signals, synchronization of the image / audio signals can be ensured using a clock of approximately 65.5 kHz (2^16 Hz). In this case, the lower 16 bits of the NTP timestamp format described in the MPU timestamp descriptor can be disregarded. That is, when using a clock of 2^m Hz generated by dividing the system clock, the lower 32-m bits of the NTP timestamp format described in the MPU timestamp descriptor can be disregarded in controlling the decoding and display times. Therefore, the lower 32-m bits of the NTP timestamp format described in the MPU timestamp descriptor can be fixed to "0" or "1".
[0331] [Software Structure of Broadcast Receiver]
[0332] Figure 7D This is a software structure diagram of the broadcast receiving device 100 of this embodiment, showing the structure of the software in the ROM 103, RAM 104, and storage (storage) unit 110. In this embodiment, the ROM 103 stores the basic operation program 1001 and other operation programs, and the storage (storage) unit 110 stores the receiving function program 1002 and other operation programs. In addition, the storage (storage) unit 110 has a content storage area 1200 for storing content such as moving images, still images, and sound, an authentication information storage area 1300 for storing authentication information required when accessing external portable terminal devices or various server devices, and various information storage areas for storing other types of information.
[0333] The basic operation program 1001 stored in ROM 103 is expanded in RAM 104, and then the main control unit 101 runs the expanded basic operation program, thereby constituting the basic operation operation unit 1101. Similarly, the receiving function program 1002 stored in storage (accumulation) unit 110 is also expanded (deployed) to RAM 104, and then the main control unit 101 runs the expanded receiving function program, thereby constituting the receiving function operation unit 1102. Furthermore, RAM 104 has a temporary storage area for temporarily holding data generated during the operation of each operation program as needed.
[0334] Furthermore, for the sake of simplicity, the process of controlling each action block by the main control unit 101 expanding and running the basic operation program 1001 stored in ROM 103 in RAM 104 will be described as the basic operation execution unit 1101 controlling each action block. The same description applies to other operation programs.
[0335] The receiving function operation unit 1102 controls each operation block of the broadcast receiving device 100 to reproduce the video, audio, and other components transmitted in the broadcast system of this embodiment. Specifically, the transmission processing unit 1102a mainly controls the MMT decoder function of the separation unit 132, assigning the video data string, audio data string, etc., separated from the MMT data string to their respective corresponding decoding processing units. The AV decoding processing unit 1102b mainly controls the video decoder 141, audio decoder 143, etc. The application processing unit 1102c mainly controls the buffer unit 152, application control unit 153, browser unit 154, and audio source unit 156. The character overlay processing unit 1102d mainly controls the character overlay decoder 144. The subtitle processing unit 1102e mainly controls the subtitle decoder 151. The general data processing unit 1102f mainly controls the data decoder 151. The EPG generation unit 1102g parses the description content such as MH-EIT included in the MMT-SI to generate an EPG image. The display processing unit 1102h is constructed based on the above-mentioned logical plane and mainly controls the image color gamut conversion unit 142, the subtitle synthesis unit 146, the subtitle color gamut conversion unit 147, the application color gamut conversion unit 155, the image synthesis unit 161, and the sound synthesis unit 164.
[0336] The aforementioned operation programs may be pre-stored in the ROM 103 and / or storage (accumulation) unit 110 at the time of product shipment. Alternatively, they may be obtained from other application servers 500 on the Internet 200 via the LAN communication unit 121 after the product is shipped. In addition, the aforementioned operation programs stored in the memory card or optical disc may be obtained via the expansion interface unit 124, etc.
[0337] [Structure of the broadcasting station server]
[0338] Figure 8 This is a block diagram illustrating an example of the internal structure of a broadcasting station server 300. The broadcasting station server 300 includes a main control unit 301, a system bus 302, a RAM 304, a storage (accumulation) unit 310, a LAN communication unit 321, and a digital broadcast signal transmission unit 360.
[0339] The main control unit 301 is a microprocessor unit that controls the entire broadcast station server 300 according to a prescribed operating procedure. The system bus 302 is a data communication line used for data transmission and reception between the main control unit 301 and the various operating blocks within the broadcast station server 300. The RAM 304 is the working area for each operating procedure during operation.
[0340] Storage unit 310 stores basic operation program 3001, broadcast content management / distribution program 3002, and broadcast content sending program 3003, and has a broadcast content storage area 3200 and a metadata storage area 3300. The broadcast content storage area 3200 stores the program content of each broadcast program aired by the broadcasting station. The metadata storage area 3300 stores metadata such as program title, program ID, program summary, performers, broadcast date and time, and copy control information for each program.
[0341] In addition, the basic operation program 3001, the broadcast content management / distribution program 3002, and the broadcast content sending program 3003 stored in the storage unit 310 are respectively expanded into the RAM 304, and then the main control unit 301 runs the expanded programs, thereby forming the basic operation unit 3101, the broadcast content management / distribution unit 3102, and the broadcast content sending unit 3103.
[0342] Furthermore, for the sake of simplicity, the process of controlling each action block by the main control unit 301 expanding and running the basic operation program 3001 stored in the storage unit 310 in the RAM 304 will be described as the basic operation execution unit 3101 controlling each action block. The same description applies to other operation programs.
[0343] The broadcast content management / distribution operation unit 3102 manages the program content and metadata of each broadcast program stored in the broadcast content storage area 3200 and the metadata storage area 3300, and controls the provision of the program content and metadata of each broadcast program to the service operator based on a contract. Furthermore, when providing the program content and metadata of each broadcast program to the service operator, the broadcast content management / distribution operation unit 3102 may also perform authentication processing of the service operator server 400 based on the contract, as needed.
[0344] The broadcast content transmission operation unit 3103 performs schedule management, etc., when transmitting MMT data strings, including program content of broadcast programs stored in broadcast content storage area 3200, program titles of broadcast programs stored in metadata storage area 3300, program IDs, program content copy control information, etc., from radio tower 300t via digital broadcast signal transmission unit 360.
[0345] The LAN communication unit 321 connects to the Internet 200 and communicates with service provider servers 400 on the Internet 200. The LAN communication unit 321 includes encoding circuits and decoding circuits. The digital broadcast signal transmission unit 360 modulates the MMT data string, which consists of image data strings, audio data strings, and program information data strings of each broadcast program stored in the broadcast content storage area 3200, and transmits it as a digital broadcast wave via the radio tower 300t.
[0346] [Structure of the service provider's server]
[0347] Figure 9 This is a block diagram illustrating an example of the internal structure of a service provider server 400. The service provider server 400 includes a main control unit 401, a system bus 402, RAM 404, a storage (accumulation) unit 410, and a LAN communication unit 421.
[0348] The main control unit 401 is a microprocessor unit that controls the entire service operator server 400 according to a prescribed action procedure. The system bus 402 is a data communication line used for data transmission and reception between the main control unit 401 and the various action blocks within the service operator server 400. RAM 404 is the working area for each action procedure during operation.
[0349] Storage unit 410 stores basic operation program 4001, image content management / distribution program 4002, and application management / publishing program 4004, and further includes an image content storage area 4200, a metadata storage area 4300, an application storage area 4400, and a user information storage area 4500. Image content storage area 4200 stores program content from broadcasting stations provided by broadcasting station server 300 as image content. It also stores image content produced by the aforementioned service operator. Metadata storage area 4300 stores various metadata provided by broadcasting station server 300, metadata about image content produced by the aforementioned service operator, etc. Application storage area 4400 stores various applications published in response to requests from various television receivers to implement services that cooperate with broadcasting programs. User information storage area 4500 stores information about users allowed to access service operator server 400 (personal information, authentication information, etc.).
[0350] In addition, the basic operation program 4001, the image content management / distribution program 4002, and the application management / publishing program 4004 stored in the storage unit 410 are expanded in the RAM 404, and then the main control unit 401 runs the expanded basic operation program, the image content management / distribution program, and the application management / publishing program, thereby constituting the basic operation running unit 4101, the image content management / distribution running unit 4102, and the application management / publishing running unit 4104.
[0351] Furthermore, for the sake of simplicity, the process of controlling each action block by the main control unit 401 expanding and running the basic operation program 4001 stored in the storage unit 410 in the RAM 404 will be described as the basic operation execution unit 4101 controlling each action block. The same description applies to other operation programs.
[0352] The image content management / distribution operation unit 4102 acquires program content and metadata of broadcast programs from the broadcasting station server 300, manages the image content and metadata stored in the image content storage area 4200 and the metadata storage area 4300, and controls the distribution of the aforementioned image content and metadata to each television receiver. Furthermore, when distributing the aforementioned image content and metadata to each television receiver, the image content management / distribution operation unit 4102 may also perform authentication processing for each television receiver as needed. Additionally, the application management / distribution operation unit 4104 manages the applications stored in the application storage area 4400 and controls the distribution of the aforementioned applications in response to requests from each television receiver. Furthermore, when distributing the aforementioned applications to each television receiver, the application management / distribution operation unit 4104 may also perform authentication processing for each television receiver as needed.
[0353] The LAN communication unit 421 is connected to the Internet 200, communicates with the broadcast server 300 on the Internet 200, and communicates with the broadcast receiving device 100 via the routing device 200r. The LAN communication unit 421 includes encoding circuits, decoding circuits, etc.
[0354] [Hardware Structure of Portable Information Terminals]
[0355] Figure 10A This is a block diagram illustrating an example of the internal structure of a portable information terminal 700. The portable information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage (accumulation) unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, a sound processing unit 750, and a sensor unit 760.
[0356] The main control unit 701 is a microprocessor unit that controls the portable information terminal 700 as a whole according to a prescribed operating procedure. The system bus 702 is a data communication line used for data transmission and reception between the main control unit 701 and the various operating blocks within the portable information terminal 700.
[0357] ROM 703 is a memory that stores basic operating programs and other operating programs, such as rewritable ROMs like EEPROM or flash ROM. RAM 704 is the working area for running basic operating programs and other operating programs. ROM 703 and RAM 704 can be integrated with the main control unit 701. Alternatively, ROM 703 may not be... Figure 10A Instead of using the independent structure shown, a portion of the storage area within the storage unit 710 is utilized.
[0358] The storage unit 710 stores the operating procedures and operating settings of the portable information terminal 700, as well as the personal information of the user of the portable information terminal 700. It can also store operating procedures downloaded via the Internet 200 and various data generated by these operating procedures. Furthermore, it can store content such as moving images, still images, and sounds downloaded via the Internet 200. A portion of the storage unit 710 can replace all or part of the functions of the ROM 703. Additionally, the storage unit 710 needs to maintain the stored information even when no external power is supplied to the portable information terminal 700. Therefore, devices such as flash memory ROM or SSDs (non-volatile semiconductor memory), or HDDs (disk drives) can be used.
[0359] Furthermore, the aforementioned operation programs stored in ROM 703 and storage unit 710 can be added, updated, and have their functions expanded through download processing from various server devices on Internet 200.
[0360] The communication processing unit 720 includes a LAN communication unit 721, a mobile network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 connects to the Internet 200 via a router 200r and an access point 200a, and transmits and receives data with various server devices or other communication devices on the Internet 200. The connection with the router 200r and access point 200a is made wirelessly using Wi-Fi (registered trademark). The mobile network communication unit 722 performs telephone communication (calls) and data transmission and reception via wireless communication with the base station 600b of the mobile network. The NFC communication unit 723 performs wireless communication when it is near a corresponding reader / writer. The LAN communication unit 721, the mobile network communication unit 722, and the NFC communication unit 723 each have encoding circuits, decoding circuits, antennas, etc. Furthermore, the communication processing unit 720 may also include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.
[0361] The expansion interface unit 724 is an interface group used to expand the functions of the portable information terminal 700. In this embodiment, it consists of an image / audio interface, a USB interface, a memory interface, etc. The image / audio interface receives image / audio signals from and outputs image / audio signals to external image / audio output devices. The USB interface connects to a PC or similar device for data transmission and reception. It can also connect to a keyboard or other USB devices. The memory interface connects to a memory card or other storage medium for data transmission and reception.
[0362] The operation unit 730 is an instruction input unit for inputting operation instructions to the portable information terminal 700. In this embodiment, it consists of a touch panel 730t stacked on top of the display unit 741 and operation buttons 730k arranged as push-button switches. Only one of these may be used. The portable information terminal 700 may also be operated using a keyboard or the like connected to the expansion interface unit 724. The portable information terminal 700 may also be operated using another terminal device connected via wired or wireless communication. That is, the portable information terminal 700 may also be operated from the broadcast receiving device 100. Alternatively, the display unit 741 may also have the aforementioned touch panel function.
[0363] The image processing unit 740 includes a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is, for example, a display device such as a liquid crystal panel, providing the user of the portable information terminal 700 with image data processed by the image signal processing unit 742. The image signal processing unit 742 has a video RAM (not shown), and drives the display unit 741 based on the image data input to the video RAM. Furthermore, the image signal processing unit 742 has functions such as format conversion, menu processing, and overlay processing of other OSD (On Screen Display) signals as needed. The first image input unit 743 and the second image input unit 744 are camera units that convert light input from the lens into electrical signals using electronic devices such as CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensors, and input image data of the surroundings or objects.
[0364] The sound processing unit 750 includes a sound output unit 751, a sound signal processing unit 752, and a sound input unit 753. The sound output unit 751 is a speaker that provides the user of the portable information terminal 700 with the sound signal processed by the sound signal processing unit 752. The sound input unit 753 is a microphone that converts the user's voice, etc., into sound data input.
[0365] The sensor unit 760 is a sensor group used to detect the status of the portable information terminal 700. In this embodiment, it includes a GPS receiver 761, a gyroscope sensor 762, a geomagnetic sensor 763, an accelerometer 764, an illuminance sensor 765, and a proximity sensor 766. This sensor group can detect the position, tilt, orientation, movement, ambient brightness, and proximity of surrounding objects of the portable information terminal 700. Furthermore, the portable information terminal 700 may also include other sensors such as a barometric pressure sensor.
[0366] The portable information terminal 700 can be a mobile phone, smartphone, tablet, etc. It can also be a PDA (Personal Digital Assistant) or a laptop PC. Additionally, it can be a digital camera, a camcorder capable of capturing moving images, a portable game console, a navigation device, or other portable digital devices.
[0367] in addition, Figure 10AThe illustrated portable information terminal 700 also includes several structures that are not essential to this embodiment, such as the sensor unit 760. The absence of these structures will not impair the effectiveness of this embodiment. Furthermore, structures not shown, such as digital broadcast receiving functionality and electronic currency settlement functionality, can be added.
[0368] [Software Structure of Portable Information Terminals]
[0369] Figure 10B This is a software structure diagram of the portable information terminal 700 of this embodiment, showing the structure of the software in the ROM 703, RAM 704, and storage unit 710. In this embodiment, the ROM 703 stores the basic operation program 7001 and other operation programs, and the storage unit 710 stores the cooperation control program 7002 and other operation programs. Furthermore, the storage unit 710 has a content storage area 7200 for storing moving images, still images, sound, etc., an authentication information storage area 7300 for storing authentication information required for accessing a television receiver or various server devices, and various other information storage areas.
[0370] The basic operation program 7001 stored in ROM 703 is expanded to RAM 704, and then the main control unit 701 runs the expanded basic operation program, thereby forming the basic operation operation unit 7101. Similarly, the cooperative control program 7002 stored in storage unit 710 is also expanded to RAM 704, and then the main control unit 701 runs the expanded cooperative control program, thereby forming the cooperative control operation unit 7102. Furthermore, RAM 704 has a temporary storage area for temporarily holding data generated during the execution of each operation program as needed.
[0371] Furthermore, for the sake of simplicity, the process of controlling each action block by the main control unit 701 expanding and running the basic operation program 7001 stored in ROM 703 in RAM 704 will be described as the basic operation execution unit 7101 controlling each action block. The same description applies to other operation programs.
[0372] The collaborative control operation unit 7102 manages device authentication and connection, as well as the transmission and reception of data, when the portable information terminal 700 and the television receiver are operating in collaboration. Furthermore, the collaborative control operation unit 7102 has a browser engine function for running applications that are linked to the aforementioned television receiver.
[0373] The aforementioned operation programs may be pre-stored in the ROM 703 and / or storage unit 710 at the time of product shipment. Alternatively, they may be obtained after product shipment from other application servers such as the Internet 200 via the LAN communication unit 721 or the mobile network communication unit 722. Furthermore, the aforementioned operation programs stored on a memory card or optical disc may be obtained via the expansion interface unit 724, etc.
[0374] [Time Management of Broadcast Receiving Devices]
[0375] The broadcast receiving device in this embodiment has two time management functions. The first time management function is an NTP-based time management function, such as that already in use. Figure 7C As explained. The second time management function is based on the MH-TOT time management function, which is based on... Figure 6B The time is managed by time information transmitted via MH-TOT as described in the document.
[0376] Figure 13A This is an example of a structure representing time information transmitted via NTP. Additionally, Figure 13B This is an example of the data structure for the MPU timestamp descriptor described above. The "reference_timestamp" and "transmit_timestamp" parameters in the NTP format are 64-bit NTP long format time data. Similarly, the "mpu_presentation_time" parameter in the MPU timestamp descriptor is also 64-bit NTP timestamp format time data. Both the NTP long format time data and the NTP timestamp format time data use 32 bits to represent "more than a second" in UTC and 32 bits to represent "less than a second" in UTC. That is, NTP format time information can be transmitted up to the "less than a second" time information. Furthermore, because NTP format time information is represented in UTC, it differs from the clock management of existing digital broadcasting, such as... Figure 3 (B) also shows the ability to communicate via a communication line path (e.g., can be used with...). Figure 7A The NTP matching contained in the signal received by the LAN communication unit 121 (the communication line).
[0377] In contrast, the information transmitted by MH-TOT is as follows. It is assumed that the broadcast receiving device 100 can obtain the current date and Japanese standard time via MH-TOT. Figure 11A This is an example of the data structure for MH-TOT. The broadcast receiver 100 can obtain the current date and time from the "JST_time" parameter of the MH-TOT described above. The "JST_time" parameter is as follows: Figure 11BThe data shown includes: the lower 16 bits of the encoded data for the current date based on the Modified Julian Date (MJD); and 24 bits of information representing Japan Standard Time (JST) using six 4-bit binary-coded decimal (BCD) numbers. The current date can be calculated by performing prescribed operations on the aforementioned 16-bit encoded MJD data. The six 4-bit binary-coded decimal numbers represent the hour (two 4-bit numbers), the minute (two 4-bit numbers), and the second (two 4-bit numbers).
[0378] Therefore, the difference between NTP-based time and MH-TOT-based time is that, as mentioned above, the former's NTP is UTC-represented information that can transmit time information up to "less than a second", while the information transmitted using MH-TOT is "second-unit" information up to JST.
[0379] The broadcast receiving apparatus 100 of this embodiment achieves higher-precision synchronization processing by using the time management function of NTP, which is time information expressed as UTC, for the synchronization processing of decoding and displaying images, sounds, subtitles, character overlays, and other display data that are the content of the broadcast signal. Furthermore, by referring to information expressed as UTC instead of the broadcast station's clock, it is also possible to perform synchronization processing of decoding and displaying images, sounds, subtitles, character overlays, or other data that are the content of the broadcast signal received via the broadcast signal and images, sounds, subtitles, character overlays, or other data obtained through the communication line path.
[0380] Furthermore, the broadcast receiving device in this embodiment can use the time management function based on "JST_time," which contains 24 bits of information represented by six 4-bit binary decimal numbers in MH-TOT, for display processing or processing of the current time to the user. Figure 6BIn the various processes described in the MH-Event Information Table (MH-EIT) processing, generally speaking, in the display process of showing the current time to the user in a broadcast receiving device, precision down to less than a second is not required. Furthermore, the time information described in the MH-Event Information Table (MH-EIT), like the EIT of existing digital broadcasting transmitted in MPEG2-TS mode, is stored as 24 bits of information represented by six 4-bit binary decimal numbers, with each bit representing "hour," "minute," and "second" as two-digit decimal digits. Therefore, the time management function based on MH-TOT of the broadcast receiving device 100 in this embodiment can easily be matched with processing using MH-EIT. Specifically, processing using MH-EIT includes program schedule generation (described later), recording and audiovisual reservation control, copyright management processing such as temporary storage, etc. This is because it is rare for any process to require precision less than a second, so precision in one-second units is sufficient.
[0381] Furthermore, the copyright management processing for program schedule generation, recording and audiovisual reservation control, and temporary storage is also a function included in receivers of existing digital broadcasting systems using the MPEG2-TS method. Therefore, in the broadcasting system of this embodiment, as long as the processing for program schedule generation, recording and audiovisual reservation control, and copyright management processing for temporary storage are configured to be compatible with the timing management processing of existing MPEG2-TS digital broadcasting systems, when constructing a broadcast receiving device that has both existing MPEG2-TS digital broadcasting reception capabilities and MMT digital broadcasting reception capabilities, no additional processing algorithms need to be designed for these processes (program schedule generation, recording and audiovisual reservation control, and copyright management processing for temporary storage), thus reducing costs.
[0382] Even receivers that only have MMT-style digital broadcasting reception capabilities but not existing MPEG2-TS-style digital broadcasting reception capabilities do not need to completely recreate algorithms for program schedule generation, recording reservation and audiovisual reservation control, copyright management processing such as temporary storage, etc. Instead, they can use algorithms with functions that are also installed in existing receivers using MPEG2-TS-style digital broadcasting systems, thus enabling development at a lower cost.
[0383] Therefore, by using the time management function of the "JST_time" parameter based on MH-TOT for these processes (program schedule generation, recording reservation and audiovisual reservation control, copyright management of temporary storage, etc.), even broadcast receiving devices for digital broadcasting in the MMT mode can be provided at a lower cost by improving compatibility with existing broadcasting systems.
[0384] As described above, the broadcast receiving device 100 of this embodiment has a time management function that uses two types of time information with different accuracies. One type of time information is time information that is compatible with existing digital broadcasting systems, while the other type of time information has a higher resolution than the first type. By using the latter type of time information for the synchronization processing of various content data of the broadcast signal, a higher level of information display processing than existing broadcasting systems is achieved. By using the former type of time information for processing such as program schedule generation, recording reservation and audiovisual reservation control, and copyright management processing for temporary storage, a broadcast receiving device is provided at a low cost.
[0385] Therefore, the broadcast receiving device 100 of this embodiment, by having the two time management functions described above, can achieve both higher information display processing and lower cost.
[0386] [The First Variation of Time Management]
[0387] Next, a first variation of time management in the broadcast system of this embodiment will be described.
[0388] In the first variation, in order to improve the use Figure 7C The accuracy of the time management function based on NTP described herein can be achieved by including information about the expected delay time in the time information transmission from the time management server (not shown) or the broadcast server 300 to the broadcast receiving device 100 in the broadcast signal. In the broadcast receiving device 100, this information about the expected delay time is used to correct the system clock of the NTP-based time management function.
[0389] At this point, the information about the anticipated delay time may not be in Figure 3 The transmission occurs outside the TLV multiplexed stream (as shown in (A)) in the TMCC (Transmission and Multiplexing Configuration Control) area. If transmission occurs within the TMCC area, the information regarding the expected delay time can be extracted in the broadcast receiver 100 without undergoing the TLV multiplexed stream separation process (DEMUX processing). That is, information less susceptible to delay due to the aforementioned separation process can be obtained in the broadcast receiver 100, thus enabling high-precision system clock correction processing. Figure 13C An example of a data structure for time information transmitted via this TMCC signal is described. This time information can, for example, be stored in the TMCC extended information area for transmission. Figure 13CIn the time information of the TMCC extended information area, the "delta" parameter represents the expected value of the transmission delay from the time management server distributing UTC or the server device generating the TMCC signal to a general broadcast receiving device, expressed as a 32-bit signed fixed decimal. The high 16 bits describe the integer part, and the low 16 bits describe the fractional part. The "transmit_timestamp" parameter is the transmission timestamp, describing the time the TMCC signal was sent from the aforementioned server device in NTP timestamp long format. The high 32 bits represent the integer part, and the low 32 bits represent the fractional part.
[0390] In this first variation, the broadcast receiving device 100 of this embodiment uses information about the expected delay time described in the time information transmitted in the TMCC extended information area (e.g., the "delta" parameter and / or the "transmit_timestamp" parameter) to more accurately correct the system clock of the NTP time management function used in the synchronization processing of each content data based on the broadcast signal.
[0391] [A second variation of time management]
[0392] Next, a second variation of time management in the broadcast system of this embodiment will be described.
[0393] As described above, the broadcast receiving device 100 of this embodiment has a time management function that manages the time by obtaining the current date and Japanese Standard Time based on information transmitted via MH-TOT. Based on the current date and Japanese Standard Time obtained via MH-TOT, the image composite unit 161 of the broadcast receiving device 100 overlays image information or application information, thereby enabling output to the monitor unit 162 or the image output unit 163 for provision to the user. As described above, MH-TOT has... Figure 11A The data structure shown allows the broadcast receiver 100 to obtain the current date and time from the "JST_time" parameter of the MH-TOT.
[0394] However, the "JST_time" parameter mentioned above only uses the lower 16 bits of the MJD's encoded data, which will overflow as "April 22, 2038". If only the above-specified calculation is used, it is impossible to express dates after "April 23, 2038". Therefore, in the second variation of this embodiment, by switching the calculation method when the value of MJD is above a specified value and below a specified value, control is performed to enable the expression of dates after "April 23, 2038".
[0395] Figure 12This describes an example of a first calculation method used when the value of MJD is above a specified value, and a second calculation method used when the value of MJD is below a specified value. For example, when the specified value is set to "32768 (0x8000)", the first calculation method is used to calculate the current date when MJD is above "32768", and the second calculation method is used when MJD is below "32768". Furthermore, the case where MJD is below "32768" is equivalent to the case where the highest bit (bit) of the 16-bit data of MJD is "0". Therefore, the broadcast receiving device 100 of this embodiment can express dates after "April 23, 2038". The specified value can be arbitrarily set, and can be set to "16384 (0x4000)" or "49152 (0xC000)", etc. The switching conditions for the above calculation method can be when the high 2 bits of the 16-bit data of the MJD are "00" or when the high 2 bits of the 16-bit data of the MJD are not "11". Specifically, when the above-mentioned value is set to "32768" and the above method is used, although it cannot express dates before "September 4, 1948", this is not a problem in practical use as a television receiver.
[0396] Furthermore, the switching between the first and second calculation methods can be based not on the comparison between MJD and the aforementioned specified value, but rather on... Figure 11A The first and second calculation methods described above are switched by replacing part or all of the "reserved" parameter in the MH-TOT data structure with a new flag. For example, regarding the flag, if the highest bit of the 16-bit encoded data of the MJD is "0", the flag is set to "1" if the MJD represents a date after "April 23, 2038", and set to "0" if it does not represent a date after "April 23, 2038". The method can be used when the flag is "1". Figure 12 The second calculation method described above uses the first calculation method when the flag is "0". Alternatively, a new descriptor with the same meaning as the flag can be prepared and configured in MH-TOT.
[0397] Furthermore, in the broadcast system of this embodiment, as described above, the absolute time in NTP format is transmitted, and the broadcast receiving device 100 of this embodiment has a time management function based on this NTP. Moreover, in the broadcast receiving device 100 of this embodiment, the decoding timing and display timing of each display unit of the image / audio signal are controlled by referring to the NTP timestamp recorded in the MPU timestamp descriptor set in the MPU unit. As described above, the aforementioned time information in NTP format has... Figure 13A The structure shown. Furthermore, the above MPU timestamp descriptor has... Figure 13B The structure shown.
[0398] Therefore, in the broadcast receiving apparatus 100 of this embodiment, by referring to the aforementioned "reference_timestamp" parameter, "transmit_timestamp" parameter, or "mpu_presentation_time" parameter, etc., one of the first calculation method and the second calculation method is selected based on the value of the referenced time data, etc. That is, for example, when the highest bit of the 64-bit NTP long format time data is "0", the second calculation method can be used; when it is not "0", the first calculation method is used, etc.
[0399] According to any of the methods described above, the broadcast receiving device 100 of this embodiment can represent dates after "April 23, 2038".
[0400] [Channel selection processing (initial scan) of the broadcast receiver]
[0401] The AMT of the broadcast system in this embodiment provides a list of IP packet multicast groups for receiving IP packets transmitted via TLV multiplexing as indistinguishably as possible from IP packets transmitted via communication lines. Multiple IP multicast groups can be listed for a single service identifier. Furthermore, address masks can be used to efficiently describe consecutive IP addresses.
[0402] In the broadcast receiving apparatus 100 of this embodiment, during initial channel scanning or rescanning for setting changes, a list of services obtained from TLV-NIT can be stored in a non-volatile memory such as ROM 103 or storage unit 110. Furthermore, a list of IP multicast groups corresponding to each of the aforementioned services can be associated with each of the aforementioned services as IP-related information and stored in the aforementioned non-volatile memory. By storing the list of services and IP-related information in non-volatile memory, it can be frequently referenced, thereby eliminating the need to obtain TLV-NIT or AMT during channel switching, and enabling efficient acquisition of broadcast content.
[0403] Figure 14 This diagram illustrates an example of the sequence of actions during channel scanning (re-scanning) in the broadcast receiving apparatus 100 of this embodiment.
[0404] When channel scanning begins, the receive function operation unit 1102 instructs the tuning / demodulation unit 131 to set an initial frequency value and performs tuning to that frequency value (S101). In the tuning / demodulation unit 131, when the set frequency value is successfully locked (S102: YES), the receive function operation unit 1102 then obtains the TLV-NIT from the received signal (S103).
[0405] If the TLV-NIT obtained in the S103 process is valid data (S104: Yes), the receiving function operation unit 1102 obtains information such as TLV stream ID and original network ID from the TLV-NIT obtained above (S105). Figure 15A This is an example of a TLV-NIT data structure. Assume the TLV stream ID information can be obtained from the "tlv_stream_id" parameter, and the original network ID information can be obtained from the "original_network_id" parameter. Furthermore, allocation system information regarding the physical conditions of the broadcast transmission lines corresponding to each TLV stream ID / original network ID is obtained from the allocation system descriptor (S106), and a list of service IDs is obtained from the service list descriptor (S107). Figure 15B An example of a data structure representing a satellite allocation system descriptor. Figure 15C This is an example of a data structure representing a service list descriptor. Furthermore, if the TLV-NIT has multiple different data such as TLV stream IDs, original network IDs, allocation system information, and a list of service IDs, the processing steps S105 to S107 are repeated. Next, the receiving function operation unit 1102 creates a service list based on the data obtained in the processing steps S105 to S107, including the TLV stream IDs, original network IDs, allocation system information, and a list of service IDs, and stores the created service list in the ROM 103 or storage unit 110 (updated during rescanning) (S108).
[0406] Next, the receiving function operation unit 1102 obtains the AMT from the received signal (S109), and also obtains a list of IP multipoint transmission groups with respect to each service ID stored in the above service list (S110). Figure 15DThis is an example of the data structure of an AMT. Furthermore, if an AMT has multiple lists of IP multicast groups with different service IDs, the process in S110 is repeated. If multiple AMTs have lists of IP multicast groups with different service IDs, the processes in S109 to S110 are repeated. Next, the receiving function operation unit 1102 stores the list of IP multicast groups obtained in the process of S110 as IP-related information, associated with the aforementioned service IDs, in ROM 103 or storage unit 110, etc. (updated during rescan) (S111).
[0407] In addition, if the tuning / demodulation unit 131 fails to lock the set frequency value in the processing of S102 (S102: No), and if the TLV-NIT obtained in the processing of S103 is not valid data (S104: No), the processing of S105 to S111 will not be performed.
[0408] When the processing in S111 is completed, if the frequency value set in the tuning / demodulation unit 131 is the final frequency value of the channel scanning range (S112: Yes), the receiving function operation unit 1102 ends the processing. On the other hand, if the frequency value set above is not the final frequency value of the channel scanning range (S112: No), the frequency value set in the tuning / demodulation unit 131 is increased (S113), and the processing in S102 to S111 is repeated. In addition, if it is possible to obtain the service IDs of all services constituting the broadcast network using a single TLV-NIT, and also to obtain an AMT with a list of IP multicast groups containing the aforementioned service IDs, the processing in S112 to S113 is not required.
[0409] Through the above series of processes, the broadcast receiving device 100 of this embodiment can create / update the list of IP multipoint transmission groups (IP related information) corresponding to each of the above services while creating / updating the list of services constituting the broadcast network during channel scanning during initial setting or during rescanning for setting changes, and then store it in non-volatile memory such as ROM 103 and storage unit 110.
[0410] Additionally, a rescan for the aforementioned setting changes can be performed automatically when a change in the information in the table is detected by referring to the "version_number" parameter of TLV-NIT or AMT. When a change in the "version_number" parameter of either TLV-NIT or AMT is detected, only the information in the table regarding the detected change can be automatically updated. However, it is desirable to notify the user that a rescan has been performed when the aforementioned automatic update occurs. Alternatively, the user can be informed that the information in the aforementioned table has changed, allowing the user to choose whether to perform the rescan.
[0411] [Channel selection processing (channel switching) of broadcast receiver]
[0412] Figure 16 This diagram illustrates an example of the sequence of actions during channel selection (channel switching) in the broadcast receiving device 100 of this embodiment.
[0413] When a user instructs a channel switch by operating a remote control (not shown in the diagram), the receiving function operation unit 1102 parses the command sent from the remote control and specifies the service ID of the target service (S201). Next, the receiving function operation unit 1102 begins to acquire the Access Mode (AMT) from the received signal of the tuning / demodulation unit 131. If the AMT is successfully acquired within a specified time (S202: Yes), information about the IP multicast group corresponding to the service ID is obtained from the acquired AMT (S204). On the other hand, if the AMT is not successfully acquired within the specified time (S202: No), information about the IP multicast group corresponding to the service ID is obtained by referring to IP-related information stored in the ROM 103 or storage unit 110 (S203) (S204). Alternatively, the decision processing in S202 can be omitted, and the IP-related information stored in the ROM 103 or storage unit 110 can always be referenced.
[0414] Next, the receiving function operation unit 1102 begins to acquire the TLV-NIT from the received signal of the tuning / demodulation unit 131. If the TLV-NIT is successfully acquired within a specified time (S205: Yes), the allocation system information for acquiring the IP data stream corresponding to the service ID is obtained from the acquired TLV-NIT (S207). On the other hand, if the TLV-NIT is not successfully acquired within the specified time (S205: No), the allocation system information for acquiring the IP data stream corresponding to the service ID is obtained by referring to the service list stored in the ROM 103 or the storage unit 110 (S206) (S207). Alternatively, the decision process in S205 can be omitted, and the service list stored in the ROM 103 or the storage unit 110 can always be referred to. When the allocation system information is obtained in the processing of S207, the receiving function operation unit 1102 then controls the tuning / demodulation unit 131 according to the frequency value indicated in the obtained allocation system information, receives the IP data stream corresponding to the service ID (S208), extracts the MMT data string from the received IP data stream, and outputs it to the separation unit 132.
[0415] In the separation unit 132, the transmission processing unit 1102a obtains the MMTP packet with packet ID "0" from the input MMT data string (S209), and further obtains the MPT contained in the obtained MMTP packet (S210). Next, the transmission processing unit 1102a refers to the "MMT_package_id_byte" parameter of the obtained MPT and confirms whether the lower 16 bits of the "MMT_package_id_byte" parameter are the same as the service ID. Figure 17 In one example of the MPT data structure shown, if the lower 16 bits of the "MMT_package_id_byte" parameter have the same value as the service ID (S211: Yes), it is determined that the MMTP packet with the packet ID "0" is an MMTP packet with data of the program corresponding to the service ID, and the MFU is obtained based on the information obtained by the MPT (S216).
[0416] On the other hand, if the lower 16 bits of the "MMT_package_id_byte" parameter are different from the service ID (S211: No), it is determined that the MMTP packet with packet ID "0" is not an MMTP packet containing data of the program corresponding to the service ID. In this case, the transmission processing unit 1102a re-acquires the PLT (S212), and by confirming the acquired PLT, it can confirm the packet ID (let's say x) of the MMTP packet that transmits the MPT with the "MMT_package_id_byte" parameter corresponding to the service ID (S213). Furthermore, the transmission processing unit 1102a obtains the MMTP packet with packet ID "x" from the input MMT data string (S214), and further obtains the MPT contained in the obtained MMTP packet (S215). Furthermore, based on the information contained in the obtained MPT, the MFU is obtained (S216).
[0417] Alternatively, steps S209 to S211 can be skipped, and steps S212 to S215 can be executed continuously. In this case, when the data of the program corresponding to the aforementioned service ID is stored in an MMTP packet other than packet ID "0", the processing time can be shortened.
[0418] When the MFU is obtained in process S216, the transmission processing unit 1102a extracts encoded video data and encoded audio data from the obtained MFU and outputs them to the video decoder 141 and the audio decoder 143, etc. Hereinafter, video / audio decoding processing based on the control of the AV decoding processing unit 1102b and display processing based on the control of the display processing unit 1102h are performed, but since the above-mentioned processes are known, detailed descriptions are omitted.
[0419] Through the above series of processes, the broadcast receiving device 100 of this embodiment is able to perform channel selection (channel switching) operations. In particular, as used... Figure 14 and Figure 16 As explained, during initial channel scanning or rescanning for setting changes, a service list and IP-related information are created and stored in a non-volatile memory such as ROM 103 or storage unit 110. This information can be referenced at all times. When selecting a channel (channel switching), by referring to the aforementioned service list and IP-related information stored in the non-volatile memory such as ROM 103 or storage unit 110, the efficiency of channel selection (channel switching) can be improved. That is, compared to the case where AMT and TLV-NIT are reacquired during channel selection (channel switching), the time from the start of channel selection (channel switching) to its completion can be shortened.
[0420] [Screen layout control for broadcast receivers]
[0421] In the broadcast receiving device 100 of this embodiment, screen layout control can be performed based on the description of LCT. Figure 18 An example of a data structure representing LCT.
[0422] In the diagram, specifically, the "left_top_pos_x" and "right_down_pos_x" parameters represent the top-left and bottom-right horizontal positions of the region when the left side is "0" and the right side is "100" in the full-screen display, respectively, using proportions relative to the total number of pixels in the horizontal direction. Similarly, the "left_top_pos_y" and "right_down_pos_y" parameters represent the top-left and bottom-right vertical positions of the region when the top side is "0" and the bottom side is "100" in the full-screen display, respectively, using proportions relative to the total number of pixels in the vertical direction. Furthermore, the "layer_order" parameter indicates the relative position of the region in the depth direction.
[0423] An example of layout allocation relative to the layout number based on the settings of the above parameters is shown together with the setting values of the above parameters. Figure 19A ~D in.
[0424] Figure 19A This is the default layout setting of the broadcast receiving device 100 in this embodiment, which is an example of setting only one area on the entire screen. Figure 19B This example demonstrates dividing the entire screen into three regions, designated as "Region 0," "Region 1," and "Region 2." For instance, with a screen resolution of 7680 pixels horizontally and 4320 pixels vertically, the parameters "left_top_pos_x" and "left_top_pos_y" are both "0," "right_down_pos_x" is "80," and "right_down_pos_y" is "80." Therefore, "Region 0" is set within the range of (0, 0) to (6143, 3455). Similarly, "Region 1" is set within the range of (6144, 0) to (7679, 4319), and "Region 2" is set within the range of (0, 3456) to (6143, 4319).
[0425] Figure 19C and Figure 19B In the same example of setting three regions, "Region 0" is set in the range of (0, 0)-(7679, 4319), while "Region 1" and "Region 2" are in the same range as above, and are configured before "Region 0" according to the setting of the "layer_order" parameter. Figure 19DThis is an example of a situation where “Area 0” is set in device 0 (default device: broadcast receiving device 100 in this embodiment) and “Area 1” is set in device 1 (portable information terminal 700 in this embodiment).
[0426] As described above, in the broadcast system of this embodiment, LCT can be used to control the screen layout for displaying multimedia services on the receiver as intended by the service provider.
[0427] Additionally, the decimal part generated when segmenting the image based on the settings of parameters such as "left_top_pos_x" can be rounded up or down. Rounding (or binary rounding) can also be performed. For example, if the total image resolution is 7680 pixels / vertical resolution is 4320 pixels, and the "left_top_pos_x" parameter, "left_top_pos_y" parameter, "right_down_pos_x" parameter, and "right_down_pos_y" parameter for "Region 0" are all "0", then "Region 0" can be set to the range (0, 0) - (3916, 2203) by rounding up, or to the range (0, 0) - (3915, 2202) by rounding down. Furthermore, considering macroblocks during image compression, rounding up / down can be performed in 8-pixel or 16-pixel units. Through the above processing, LCT-based region setting and resolution conversion of multimedia content in the aforementioned regions can be performed efficiently.
[0428] [Exception handling for screen layout control of broadcast receiving devices]
[0429] In the broadcast receiving device 100 of this embodiment, even when the area control of the screen layout is performed according to the above-described LCT, if the user instructs to display the EPG screen, etc., as an exception, the screen layout control that ignores the description content of the above-described LCT can be performed. Figure 20A This represents an example of an exception handling action for LCT-based screen layout control.
[0430] According to the description of LCT, to perform with Figure 19B With the same screen layout control, in a state where broadcast program images are displayed in "Area 0" and broadcast content such as program collaboration data that cooperates with the aforementioned broadcast program is displayed in "Area 1" and "Area 2", and the user instructs the display of the EPG screen using a remote control (illustrated but not shown), the broadcast receiving device 100 of this embodiment, as shown... Figure 20A As shown in (A), the screen layout settings are returned to the default settings regardless of the LCT description (i.e., the settings are adjusted accordingly). Figure 19A (In the same screen layout control state), control is performed to display the EPG screen as a whole. Furthermore, if the user instructs to end the display of the EPG screen, screen layout control according to the LCT description is executed again.
[0431] By implementing the above controls, and Figure 20A Compared to the case shown in (B), where the EPG screen is displayed in a controlled manner while maintaining the screen layout, the EPG screen can be displayed larger, thus improving visibility.
[0432] Furthermore, the exception handling for the aforementioned screen layout control can be applied not only to the display of EPG screens, but also, as... Figure 20B As shown, this applies to the display of various setting screens (the example shown is the recording setting screen) of the broadcast receiver 100 when displaying a sub-screen and when displaying a dual-screen display.
[0433] In the recording setup shown in Figure (A), the display area for the broadcast content changes from the entire screen to only the lower right sub-screen portion. Similarly, in the dual-screen display shown in Figure (B), the display area for the broadcast content changes from the entire screen to only the split screen portion on the left side of the middle of the screen. In either case, because the display area for displaying the broadcast content is narrower than when using the entire screen, maintaining the area control of the screen layout within the aforementioned display area (i.e., displaying multiple broadcast contents simultaneously by dividing the area) is not preferable in terms of visual recognition. Therefore, in the broadcast receiving device 100 of this embodiment, in the above-mentioned situation, only the broadcast content of "Area 0" is selected for display in the aforementioned display area. Alternatively, the broadcast content of "Area 1" and "Area 2" can be selected for display based on the immediately preceding area selection status.
[0434] By implementing the above controls, the visibility of broadcast content can be improved compared to the situation where various broadcast contents are displayed in a controlled manner while maintaining the layout of the screen. The same applies to the display of sub-screens in a recorded program overview and the display of internet content in a browser.
[0435] [EPG display on broadcast receiver]
[0436] In the broadcast system of this embodiment, MH-EIT transmits timing information about events (i.e., programs) contained in the various services constituting the broadcast network. Figure 21This illustrates an example of the MH-EIT data structure in this embodiment. MH-EIT identifies two types based on the table ID (corresponding to the "table_id" parameter in the figure): information about the current / next event from the TLV stream and timetable information for each event from the TLV stream. The broadcast receiving device 100 of this embodiment performs identification based on the service ID (corresponding to the "service_id" parameter in the figure) with reference to the MH-EIT described above. This allows it to obtain information such as the start time and broadcast time of each event to create an EPG screen. The created EPG is then overlaid on image information by the image compositing unit 161 and displayed on the monitor unit 162.
[0437] Figure 22A This is a diagram illustrating an example of the EPG screen of the broadcast receiving device 100 in this embodiment. The EPG screen 162a displays detailed information about broadcast programs broadcast on each channel within each time period in a matrix shape, with time represented on the vertical axis and service IDs (channels) displayed on the horizontal axis. Furthermore, the detailed information 162a1 for each broadcast program mainly includes a title area 162a2 and a detailed description area 162a3.
[0438] In the title area 162a2, the program title of the aforementioned broadcast program and symbols representing the attributes of the broadcast program are displayed. These symbols representing the attributes of the broadcast program may be, for example, symbols / characters indicating a new program or a rebroadcast program. Alternatively, they may be symbols representing "data," signifying correspondence with data broadcasting services. Additionally, symbols representing "Network," signifying the ability to obtain content and applications related to the broadcast program from the network, may be used, such as symbol 162a4. Furthermore, the background color of the detailed information 162a1 may be used to distinguish it from other information, or the display area of the detailed information 162a1 may be surrounded by a thick border, thereby replacing the symbols representing the attributes of the broadcast program.
[0439] Furthermore, even if the control information (messages, tables, descriptors, etc.) in the broadcast system of this embodiment indicates that content or applications related to the broadcast program can be obtained from the network, when the LAN communication unit 121 of the broadcast receiving device 100 is not connected to the LAN cable and cannot access the server devices on the network, it can be controlled so that the symbol 162a4 obtained by symbolizing the above-mentioned "NetWork" is not displayed.
[0440] Furthermore, when the aforementioned broadcast program is a distribution program distributed via the Internet 200 and cannot be obtained solely from the broadcast wave, and thus falls into a state similar to the aforementioned broadcast receiving device 100 being unable to access the various server devices on the network, it is also possible to... Figure 22BAs shown, the control is configured to partially gray out the detailed information 162b1 displayed on the EPG screen 162b. That is, the control is configured to not display detailed information about unavailable broadcast programs. Alternatively, the graying-out process can be replaced by distinguishing the background color of the detailed information 162b1 from other information. When detailed information 162b1 is selected using the remote control (not shown), the user can be informed via a pop-up window or similar means that the broadcast receiving device 100 is in a state where it cannot access the various server devices on the network, or that the broadcast program associated with detailed information 162b1 cannot be viewed.
[0441] Through the above controls, the broadcast receiving device 100 can provide program information for each broadcast program in a manner that is less disruptive to the user, based on the network connection status.
[0442] Figure 22C This is another example of the EPG screen of the broadcast receiving device 100 in this embodiment. In the figure, “M1 TV station”, “M2 broadcast”, “M3 channel”, “M4 TV”, “TV station M5”, etc. are the names of the broadcasting stations of each channel. In particular, the “M2 broadcast” station provides both broadcast programs distributed by the broadcast wave and distribution programs distributed via the Internet 200 (information 162c1 in the box shown as “Internet broadcast” in the figure).
[0443] As shown in the figure, when there are channels that only distribute programs via the Internet 200, the system is normally controlled to display information for all channels (including information 162c1) as shown in EPG screen 162c of Figure (A). On the other hand, when the broadcast receiving device 100 is in a state where it cannot access servers or other devices on the network, as shown in EPG screen 162d of Figure (B), the system can control the system to not display information for channels that only distribute programs "M2 Broadcast (Internet Broadcast)" via the Internet 200 (information 162c1 in Figure (A)).
[0444] Through the above controls, users of the broadcast receiving device 100 are able to receive information about channels they cannot access without having to check for them.
[0445] [Emergency alarm broadcast display on the broadcast receiver]
[0446] When the emergency alarm broadcast start control signal bit (bit) of the TMCC signal contained in the transmission data containing the TLV stream changes from "0" to "1", the broadcast receiving device 100 of this embodiment can perform emergency alarm broadcast reception processing.
[0447] The aforementioned emergency alarm broadcast can be provided as a full-screen display application or as character information in a character overlay format. When the emergency alarm broadcast is provided as character information in a character overlay format, it is preferable to display the character information in a character overlay format regardless of the state of the broadcast receiving device 100 at the time the emergency alarm broadcast is about to be received. That is, as... Figure 23 As shown, when an emergency alarm broadcast is received while the user is watching a normal broadcast program and the monitor unit 162 is displaying the program screen 162e, the character information 162e1 of the emergency alarm broadcast is superimposed on the program screen 162e for display. Similarly, when the user instructs to display the EPG screen and an emergency alarm broadcast is received while the monitor unit 162 is displaying the EPG screen 162f, the control is set to superimpose the character information 162f1 of the emergency alarm broadcast on the EPG screen 162f for display.
[0448] Through the above control, in the broadcast receiving device 100 of this embodiment, even when the user selects to display the EPG screen, various setting screens, video program overview screen, internet browser, etc., important character information based on the emergency alarm broadcast can be avoided when receiving the broadcast. Furthermore, this control can also be applied to ordinary character information superimposed on characters unrelated to the emergency alarm broadcast.
[0449] [Handling of various exceptions]
[0450] In this embodiment, the broadcast receiving device 100 may perform exception handling as described below when it is unable to obtain TLV stream data within the same packet.
[0451] like Figure 6E As explained, in a broadcast system compatible with the broadcast receiving device 100 of this embodiment, the location information stored in the MPT (corresponding to...) is used... Figure 17 The "MMT_general_location_info()" function can include data obtained from within a TLV stream and data obtained from paths other than the TLV stream in the same packet. However, data transmission paths other than the TLV stream, as indicated by location information (e.g., IPv4 streams, IPv6 streams, broadcast MPEG2-TS, etc.), have different reception functions than the TLV / MMT stream reception function. Therefore, even when the broadcast receiving device 100 is operating, there may be situations where the reception function of these transmission paths is not working, the reception function itself is working but the relay device, etc., is not working, the wired or wireless connection of these transmission paths is not available, or the broadcast receiving device 100 is set up in an environment where it is impossible to connect to these transmission paths, resulting in situations where data cannot be obtained from these transmission paths.
[0452] In such a situation, when receiving an event in which the location information stored in the MPT indicates that data obtained from the TLV stream and data obtained from a path outside the TLV stream are contained in the same packet, the broadcast receiving device 100 of this embodiment may, for example, perform the following actions.
[0453] For example, LCT Figure 19B and Figure 19C As shown, when multiple regions are set within the screen, and the image contained in the TLV stream is displayed in "Region 0," while data obtained from transmission paths other than the TLV stream is displayed in "Region 1" and "Region 2," the layout display of the multiple regions specified by the LCT can be disabled if data from transmission paths other than the TLV stream to be displayed in "Region 1" and "Region 2" cannot be obtained. Specifically, even if the LCT is received, the layout display of the multiple regions can be disabled. Figure 19A The default layout shown retains the image of the content received within the TLV stream in "Region 0" without shifting to... Figure 19B and Figure 19C The layout of the multiple areas shown is illustrated. Furthermore, in this state, it is possible to... Figure 7A The operation input unit 170 inputs a change instruction from the default layout to the layout shown in the LCT, and also maintains... Figure 19A The default layout shown does not allow switching to other data broadcast screens, etc. Figure 19B and Figure 19C The layout of the multiple areas shown is displayed.
[0454] LCT such as Figure 19B and Figure 19C As shown, when multiple regions are set within the screen, and the image contained in the TLV stream is displayed in "Region 0", and data obtained from transmission paths other than the TLV stream is displayed in "Region 1" and "Region 2", another example of an action when data from transmission paths other than the TLV stream to be displayed in "Region 1" and "Region 2" cannot be obtained is that the LCT (Limited Time Transmission) can be temporarily displayed. Figure 19B and Figure 19C The display frames for multiple areas, displaying a background color or a specified still image in "Area 1" and "Area 2", and if data from a transmission path other than the TLV stream indicated by the MPT location information cannot be obtained after a specified time, a return to... Figure 19A The default layout shown is displayed in a toggle mode. In this case, if... Figure 19A , Figure 19B , Figure 19C If the layout is changed and the program images contained in the TLV stream are still displayed in "Area 0", it is preferable to let the user's program images continue to be displayed.
[0455] Additionally, due to the inability to obtain data from transmission paths other than the TLV streams to be displayed in "Area 1" and "Area 2", Figure 19A When the default layout shown displays an image of the content received from the TLV stream in "Area 0", due to changes in the communication and reception environments of the broadcast receiving device 100 in this embodiment, it may become possible to obtain data from transmission paths other than the TLV streams to be displayed in "Area 1" and "Area 2". In this case, the broadcast receiving device 100 of this embodiment can immediately obtain data from... Figure 19A The default layout shown has been switched to the LCT display. Figure 19B and Figure 19C The layout of the multiple regions shown can be switched so that "Region 0" displays the image of the content received within the TLV stream, while "Region 1" and "Region 2" display data obtained from transmission paths other than the TLV stream. Alternatively, the layout change can be performed after a change instruction from the default layout to the layout shown in the LCT is input from the operation input unit 170, rather than immediately.
[0456] [Copyright Protection Function]
[0457] In a digital broadcasting system compatible with the broadcast receiving device 100 of this embodiment, transmission is performed by including copy control information in the MPT. For example, the transmission can be configured to display the copy control status of the content referenced by the MPT, such as "unlimited copying is allowed" (which can be divided into two categories: "unlimited copying is allowed, but encryption is required for storage and output" and "unlimited copying is allowed, but encryption is not required for storage and output"), "only one generation can be copied", "can be copied a specified number of times" (for example, 9 times can be copied + 1 time can be moved, i.e., "dubbing 10"), "copying is prohibited". At this time, the broadcast receiving device 100 of this embodiment can control the storage of the content to the storage unit 110, the recording to the removable recording medium, the output to the external device, the copying to the external device, and the moving to the external device, etc., according to the copy control information. In addition, the object of storage processing can not only be the storage unit 110 inside the broadcast receiving device 100, but also include recording methods that have implemented protection processing such as encryption processing so that they can only be reproduced by the broadcast receiving device 100. More specifically, the objects of storage processing include external recording devices and the like, which are in a state where only the broadcast receiving device 100 can record and reproduce them.
[0458] The following is a specific example of processing based on this replication control information.
[0459] First, when the copy control information contained in the MPT indicates "unrestricted copying," the broadcast receiving device 100 of this embodiment can perform unlimited storage to the storage unit 110, recording to the removable recording medium, output to an external device, copying to an external device, and moving to an external device. Among these, there are two cases: "unrestricted copying is allowed, but encryption processing is required during storage and output" and "unrestricted copying is allowed, but encryption processing is not required during storage and output." When it is "unrestricted copying is allowed, but encryption processing is required during storage and output," storage to the storage unit 110, recording to the removable recording medium, output to an external device, copying to an external device, and moving to an external device can be performed without limitation on the number of times, but encryption processing is required for all of them.
[0460] Furthermore, when the copy control information contained in the MPT indicates "only one generation can be copied", the broadcast receiving device 100 of this embodiment can perform encrypted storage in the storage unit 110. However, when the stored content is output to an external device for viewing, it is encrypted along with the copy control information indicating "copying is prohibited". However, it is possible to perform so-called moving processing to an external device (copying content to an external device and using deletion processing, etc., to prevent the content in the storage unit 110 of the broadcast receiving device 100 from being reproduced).
[0461] Furthermore, when the copy control information included in the MPT indicates "copyable multiple times," the broadcast receiving device 100 of this embodiment can perform encrypted storage in the storage unit 110. However, when outputting the stored content to an external device for viewing, it is encrypted along with the copy control information indicating "copying prohibited." Nevertheless, it is possible to perform a predetermined number of copying and moving operations to the external device. Under the so-called "dubbing 10 (ten-times copy rule)," it is possible to perform nine copies and one moving operation to the external device.
[0462] Furthermore, in cases where the copy control information contained in the MPT indicates "copying prohibited," the broadcast receiving device 100 of this embodiment prohibits copying to the storage (accumulation) unit 110. However, when the broadcast receiving device 100 has control information contained in the broadcast signal (e.g., according to a predetermined time) that can only be copied at a predetermined time, or according to the control information contained in the broadcast signal (e.g., based on...), the copying is prohibited. Figure 6DIn the "temporary storage" mode, where the content can be saved to the storage (accumulation) unit 110 for a specified period of time as indicated by the MH-Expire descriptor, the content can still be temporarily saved to the storage (accumulation) unit 110 even if the copy control information contained in the MPT indicates "copying prohibited". When the copy control information contained in the MPT indicates that the content is "copy prohibited" for audio-visual output to an external device, it is encrypted and output together with the copy control information indicating "copy prohibited".
[0463] In addition, the aforementioned audiovisual output to external devices can be achieved through... Figure 7A The image output unit 163 and audio output unit 166, or digital I / F unit 125, LAN communication unit 121, etc., are used for this process. The aforementioned copying or moving process to external devices can be performed via... Figure 7A It is carried out using the digital I / F section 125, LAN communication section 121, etc.
[0464] Based on the processing described above, appropriate content protection can be achieved by using copy control information associated with the content.
[0465] Furthermore, copy control information indicating restrictions such as "copying only once," "copying allowed multiple times," or "copying prohibited" can be copied to external devices via the LAN communication unit 121. This copying can only be performed when the destination IP address of the packet from the broadcast receiver 100 is within the same subnet as the IP address of the external device. It can be prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiver 100. Copy control information stating "unrestricted copying allowed, but encryption required for storage and output" can also be handled similarly.
[0466] Similarly, the process of temporarily storing copy control information indicating copy restrictions such as "only one generation can be copied", "can be copied multiple times", and "can be copied without limit, but encryption must be performed when storing and outputting" in the storage (storage) unit 110, and then moving it to an external device via the LAN communication unit 121, can only be performed when the destination of the transmission packet from the broadcast receiving device 100, i.e., the IP address of the external device, is within the same subnet as the IP address of the broadcast receiving device 100. It can be prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100.
[0467] The output of audio-visual images and audio from the content stored in the storage unit 110 of the broadcast receiving device 100 is, in principle, only possible when the IP address of the external device (the destination of the transmission packet from the broadcast receiving device 100) is within the same subnet as the IP address of the broadcast receiving device 100. It is prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. However, if the external device is connected to the same subnet as the broadcast receiving device 100 for a specified period and has undergone registration (pairing) as a device capable of audio-visual output even outside the same subnet as the IP address of the broadcast receiving device 100, then the audio-visual images and audio from the content stored in the storage unit 110 of the broadcast receiving device 100 can be output to that external device, even if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. In this case, the audio-visual image and audio output is encrypted.
[0468] Based on the above processing, by handling different aspects depending on whether the external device's IP address is within the same subnet as the broadcast receiving device 100 or outside the same subnet, both user convenience and content protection can be taken into account.
[0469] Then, as for Figure 6E As explained, in a digital broadcasting system compatible with the broadcast receiving device 100 of this embodiment, based on the location information in the MPT ( Figure 17 The “MMT_general_location_info()” describes content protection when MPT contains copy control information, where data obtained through a different path (IPv4, IPv6, MPEG2-TS, URL, etc.) than data obtained from a TLV stream via a broadcast route may also be included in the same packet as data obtained from a TLV stream and in the same event.
[0470] First, when copy control information is included in the MPT, even if the data contained in the same packet and the same event in the location information is obtained through a different path (IPv4, IPv6, MPEG2-TS, URL, etc.) than the data obtained from the TLV stream via the broadcast route, it can still be controlled according to the copy control information contained in the TLV stream. Based on this copy control information, the copy control status of the specified content can be specified as follows: "unlimited copying" (which can be divided into two categories: "unlimited copying with encryption during storage and output" and "unlimited copying without encryption during storage and output"), "copying only once", "copying a specified number of times" (e.g., if it is 9 times + 1 time to move, i.e., the so-called "dubbing 10"), "copying prohibited", etc.
[0471] Here, if the location information indicates that the data includes MPEG2-TS data transmitted by other digital broadcast signals, this MPEG2-TS data is also broadcast in other digital broadcast signals in association with copy control information. Therefore, the question arises as to which information should be used for copy control of this MPEG2-TS data (whether it should be based on the copy control information contained in the TLV / MMT stream or the copy control information contained in the MPEG2-TS itself).
[0472] In the digital broadcasting system of this embodiment, as a solution to this problem, any one of the following solutions can be performed in the broadcast receiving device 100.
[0473] <Action Example 1>
[0474] In the first action example, if the MPT contains copy control information and the data contained in the same packet and the same event in the location information includes MPEG2-TS data transmitted by other digital broadcast signals, the copy control state shown by the copy control information contained in the TLV stream shall be given priority over the copy control state shown by the copy control information contained in the MPEG2-TS.
[0475] For example, if the copy control status indicated by the copy control information contained in the TLV stream is "copyable for one generation," while the copy control status indicated by the copy control information contained in MPEG2-TS is "copyable a specified number of times," then even data obtained through a different path than the data obtained from the TLV stream (digital broadcasting in MPEG2-TS transmission format) can be copied as "copyable for one generation." Similarly, if the copy control status indicated by the copy control information contained in the TLV stream is "copyable without restriction," while the copy control status indicated by the copy control information contained in MPEG2-TS is "copyable a specified number of times," then even data obtained through a different path than the data obtained from the TLV stream (digital broadcasting in MPEG2-TS transmission format) can be copied as "copyable without restriction."
[0476] During this operation, data obtained from paths other than the TLV stream can also be in a copy state that is to be managed in a broadcast system compatible with the broadcast receiving device 100 of this embodiment.
[0477] <Action Example 2>
[0478] In the second example of operation, if the MPT contains copy control information and the data contained in the same packet and the same event in the location information includes MPEG2-TS data transmitted by other digital broadcast signals, the copy control state shown by the copy control information contained in the TLV stream is compared with the copy control state shown by the copy control information contained in the MPEG2-TS. If the copy control state shown by the copy control information contained in the MPEG2-TS is stricter than the copy control state shown by the copy control information contained in the TLV stream, when performing storage processing to the storage (storage) unit 110, recording processing to the removable recording medium, or output processing from the digital interface, the MPEG2-TS data is excluded from the processing target data content.
[0479] During this operation, data obtained from paths other than the TLV stream can respect the original copy control information set by the broadcast system transmitting the data, and eliminate the duplication of copy control state on the broadcast receiving device 100 of this embodiment.
[0480] Furthermore, if the result of this comparison is that the copy control state indicated by the copy control information contained in the MPEG2-TS is the same as or a looser copy control state indicated by the copy control information contained in the TLV stream, then the data of the MPEG2-TS contained in the same packet and the same event in the location information can also be copied as the content of the copy control state indicated by the copy control information contained in the TLV stream.
[0481] During this operation, data obtained from paths other than the TLV stream can respect the original copy control information set by the broadcast system transmitting the data, and eliminate the duplication of copy control state on the broadcast receiving device 100 of this embodiment.
[0482] The above description explains the copyright protection function of the broadcast receiving device 100 in this embodiment based on the copy control information contained in the MPT. However, the table configuring the copy control information is not limited to the MPT. Besides the MPT, it can also be configured in... Figure 6B The data may be transmitted in the MH-Service Description Table (MH-SDT), MH-Event Information Table (MH-EIT), or other tables as described herein, and the broadcast receiving device 100 may process the data for copyright protection in accordance with them.
[0483] According to the embodiment described above, a broadcast receiver compatible with digital broadcasting in MMT can be provided.
[0484] (Example 2)
[0485] The following describes Embodiment 2 of the present invention. Unless otherwise specifically mentioned, the structure, processing, and effects of this embodiment are the same as those of Embodiment 1. Therefore, the following mainly describes the differences between this embodiment and Embodiment 1, and common parts are omitted as much as possible to avoid repetition. Furthermore, the broadcast receiving device of this embodiment is a television receiver corresponding to both MMT and MPEG2-TS media transmission methods, and will be described below.
[0486] [Hardware structure of broadcast receiving device]
[0487] Figure 24 This is a block diagram illustrating one example of the internal structure of a broadcast receiver 800. The broadcast receiver 800 includes a main control unit 801, a system bus 802, a ROM 803, a RAM 804, a storage unit 810, a LAN communication unit 821, an expansion interface unit 824, a digital interface unit 825, a first tuning / demodulation unit 831, a second tuning / demodulation unit 832, an MMT decoding processing unit 841, an MPEG2-TS decoding processing unit 842, an image synthesis unit 861, a monitor unit 862, an image output unit 863, a sound synthesis unit 864, a speaker unit 865, a sound output unit 866, and an operation input unit 870.
[0488] The main control unit 801, system bus 802, ROM 803, RAM 804, storage unit 810, expansion interface unit 824, digital interface unit 825, monitor unit 862, video output unit 863, speaker unit 865, sound output unit 866, operation input unit 870, etc., have the same functions as the main control unit 101, system bus 102, ROM 103, RAM 104, storage (accumulation) unit 110, expansion interface unit 124, digital interface unit 125, monitor unit 162, video output unit 163, speaker unit 165, sound output unit 166, operation input unit 170 of the broadcast receiving device 100 of Embodiment 1, and detailed descriptions are omitted.
[0489] The first tuning / demodulation unit 831 receives broadcast waves from a broadcast service using MMT as the media transmission method via an antenna (not shown), and tunes (selects) the channel to the user's desired service based on the control of the main control unit 801. Then, the first tuning / demodulation unit 831 demodulates the received broadcast signal to obtain an MMT data string and outputs it to the MMT decoding processing unit 841. The second tuning / demodulation unit 832 receives broadcast waves from a broadcast service using MPEG2-TS as the media transmission method via an antenna (not shown), and tunes (selects) the channel to the user's desired service based on the control of the main control unit 801. Then, the second tuning / demodulation unit 832 demodulates the received broadcast signal to obtain an MPEG2-TS data string and outputs it to the MPEG2-TS decoding processing unit 842.
[0490] The MMT decoding processing unit 841 receives the MMT data string output from the first tuning / demodulation unit 831 and performs separation and decoding processing on image data strings, audio data strings, character overlay data strings, subtitle data strings, etc., which are real-time display elements, based on the control signals contained in the MMT data string. The MMT decoding processing unit 841 has functions equivalent to those of the separation unit 132, image decoder 141, image color gamut conversion unit 142, audio decoder 143, character overlay decoder 144, subtitle decoder 145, subtitle synthesis unit 146, subtitle color gamut conversion unit 147, data decoder 151, buffer unit 152, application control unit 153, browser unit 154, application color gamut conversion unit 155, and audio source unit 156 in the broadcast receiving device 100 of Embodiment 1. The MMT decoding processing unit 841 is capable of performing various processes described in Embodiment 1. Furthermore, the details of these various processes are the same as those described in Embodiment 1, so descriptions are omitted.
[0491] The MPEG2-TS decoding processing unit 842 receives the MPEG2-TS data string output from the second tuning / demodulation unit 832, and performs separation and decoding processing on the image data string, audio data string, character overlay data string, subtitle data string, etc., which are real-time display elements, based on the control signals contained in the MPEG2-TS data string. The MPEG2-TS decoding processing unit 842 has the same functions as the IRD (Integrated Receiver Decoder) of a conventional television receiver that receives broadcast waves of broadcast services using MPEG2-TS as the media transmission method, and detailed description is omitted.
[0492] The image compositing unit 861 receives image information, subtitle information, and application information output from the MMT decoding processing unit 841 and the MPEG2-TS decoding processing unit 842, and performs appropriate selection and / or overlay processing. The image compositing unit 861 has an image RAM (not shown), and drives the monitor unit 862 and the like based on the image information input to the aforementioned image RAM. Furthermore, the image compositing unit 861 performs scaling processing, EPG image information overlay processing, etc., as needed, based on the control of the main control unit 801. The sound compositing unit 164 receives sound information output from the MMT decoding processing unit 841 and the MPEG2-TS decoding processing unit 842, and performs appropriate selection and / or mixing processing.
[0493] The LAN communication unit 821 connects to the Internet 200 via the routing device 200r and sends and receives data with various server devices or other communication devices on the Internet 200. Additionally, it acquires MMT data strings (or a portion thereof) and MPEG2-TS data strings (or a portion thereof) of programs transmitted via the communication line and outputs them appropriately to the MMT decoding processing unit 841 and the MPEG2-TS decoding processing unit 842.
[0494] [Time display on the broadcast receiver]
[0495] In the broadcast receiving device 800 of this embodiment, the current date and time can be displayed on the EPG screen and various setting screens. This information regarding the current date and time is transmitted according to MH-TOT or similar methods in broadcast services using MMT as the media transmission method, and according to TOT (Time Offset Table) or similar methods included in the SI (Service Information) defined by the MPEG-2 system in broadcast services using MPEG2-TS as the media transmission method. The broadcast receiving device 800 can obtain this information regarding the current date and time by referring to MH-TOT and TOT.
[0496] In addition, generally speaking, the following control can be performed: when the image compositing unit 861 mainly selects image information output from the MMT decoding processing unit 841, the information about the current date and current time obtained from the MH-TOT is superimposed on the image information, etc.; when the image compositing unit 861 mainly selects image information output from the MPEG2-TS decoding processing unit 842, the information about the current date and current time obtained from the TOT is superimposed on the image information.
[0497] However, when broadcast services using MMT and MPEG2-TS as the media transmission method differ, there are differences in encoding / decoding processes and transmission paths. Therefore, especially in the current display, mismatches may occur when selecting broadcast services using MMT and MPEG2-TS as the media transmission method. For example, ... Figure 25 As shown, when switching from displaying EPG screen 162g, which displays channel information of broadcast services using MMT as the media transmission method, to displaying EPG screen 162h, which displays channel information of broadcast services using MPEG2-TS as the media transmission method, the mismatch between the current display and the current display 162g1 and the current display 162h1 may make the user aware of a visual incongruity.
[0498] In the broadcast receiving apparatus 800 of this embodiment, in order to prevent the aforementioned visual disharmony for the user, even when the image synthesis unit 861 mainly selects image information output from the MMT decoding processing unit 841, it is controlled to overlay information about the current date and current time obtained from the aforementioned TOT onto the aforementioned image information. That is, it is controlled to overlay the current time information provided by the broadcast service using MPEG2-TS as the media transmission method onto the content of the broadcast service that uses MMT as the media transmission method.
[0499] By performing the above-described control, the broadcast receiving device 800 of this embodiment always refers to the aforementioned TOT when displaying the current time. Therefore, even when switching between a broadcast service using MMT as the media transmission method and a broadcast service using MPEG2-TS as the media transmission method, it is possible to prevent visual disharmony caused to the user due to a mismatch in the display of the current time.
[0500] Figure 26 This describes an example of the selection control of the current time information reference source in the broadcast receiving apparatus 800 of this embodiment, corresponding to the reception status of each broadcast service. In the broadcast receiving apparatus 800 of this embodiment, when it is in a state where it can receive broadcast services using MPEG2-TS as the media transmission mode, it always obtains the current time information by referring to the above-mentioned TOT. Only when it is in a state where it cannot receive broadcast services using MPEG2-TS as the media transmission mode, but is in a state where it can receive broadcast services using MMT as the media transmission mode, is it controlled to obtain the current time information by referring to the above-mentioned MH-TOT.
[0501] In addition, contrary to the control described above, the same effect can be achieved by overlaying the current time information provided by the broadcast service using MMT as the media transmission method onto the content of the broadcast service using MPEG2-TS as the media transmission method.
[0502] Furthermore, as described above, whether the current time information provided by the broadcast service using MPEG2-TS as the media transmission method is superimposed on the content of the broadcast service using MMT as the media transmission method, or the current time information provided by the broadcast service using MMT as the media transmission method is superimposed on the content of the broadcast service using MPEG2-TS as the media transmission method, as described in the [Time Management of Broadcast Receiving Device] of Embodiment 1, the current time information can be corrected by referring to the "delta" parameter of the time information in the extended information area of the TMCC.
[0503] [EPG display on broadcast receiver]
[0504] Event schedule information for broadcast services using MMT as the media transmission method is transmitted via MH-EIT, etc. On the other hand, event schedule information for broadcast services using MPEG2-TS as the media transmission method is transmitted via EIT (Event Information Table) provided by the SI defined by the MPEG-2 system. Therefore, generally speaking, when displaying video information or the like provided by broadcast services using MMT as the media transmission method, the event schedule information (MH-EIT) of the broadcast services using MMT can be obtained; and when displaying video information or the like provided by broadcast services using MPEG2-TS as the media transmission method, the event schedule information (EIT) of the broadcast services using MPEG2-TS can be obtained.
[0505] However, the broadcast receiving device 800 of this embodiment can obtain both MH-EIT and EIT when displaying video information provided by a broadcast service that uses MMT as the media transmission method or when displaying video information provided by a broadcast service that uses MPEG2-TS as the media transmission method, thereby improving ease of use for users.
[0506] Figure 27AThis figure shows an example of the EPG screen of the broadcast receiving device 800 in this embodiment. In the figure, EPG screen 162i is an EPG screen generated based on the MH-EIT broadcast service using MMT as the media transmission method. "M1 TV Station," "M2 Broadcast," "M3 Channel," "M4 TV," and "TV Station M5," etc., are the names of broadcasting stations using the MMT broadcast service as the media transmission method. Furthermore, EPG screen 162j is an EPG screen generated based on the EIT broadcast service using MPEG2-TS as the media transmission method. "T6 TV Station," "T7 Broadcast," "T8 Channel," "T9 TV," and "TV Station TA," etc., are the names of broadcasting stations using the MPEG2-TS broadcast service as the media transmission method.
[0507] For example, while a user is watching a broadcast program provided by a broadcast service using MMT as the media transmission method, and the remote control (illustration omitted) is instructed to display the EPG screen, the initial EPG screen (illustration omitted) is displayed. This initial EPG screen is an EPG generated based on MH-EIT by the broadcast service using MMT as the media transmission method, displaying detailed information about broadcast programs on various channels from 5 PM to (around the current time) on October 7, 2014 (today). Next, if the user wishes to check the detailed information about broadcast programs on various channels from 8 PM to (around October 9, 2014), and the remote control (illustration omitted) is instructed to update the EPG screen, EPG screen 162i is displayed.
[0508] Next, when the user wants to confirm the details of the broadcast programs provided by the broadcast service using MPEG2-TS as the media transmission method, and operates the remote control (not shown) to switch networks, EPG screen 162j is displayed. At this time, in the broadcast receiving device 800 of this embodiment, it is controlled to not display the initial screen of the EIT-generated EPG screen using the broadcast service using MPEG2-TS as the media transmission method (i.e., the details of the broadcast programs of each channel from "17:00" to "October 7, 2014"), but instead display the details of the broadcast programs of each channel on the same day and at the same time as the adjacent previously displayed EPG screen 162i (from "20:00" to "October 9, 2014").
[0509] Through the aforementioned controls, users can easily check detailed information about broadcast programs on the same day and at the same time from multiple networks with different media transmission methods. This improves the usability of the broadcast receiver 800.
[0510] Figure 27BThis diagram shows an example of the EPG screen of the broadcast receiving device 800 in this embodiment, which differs from the one described above. The EPG screen at 162k represents the image from... Figure 27A The image shows the state of the EPG screen 162i, and the state of scrolling in the channel direction (horizontal) using the remote control (illustrated but not shown). That is, Figure 27B In the example shown, by scrolling the EPG image in the channel direction (horizontal), the channel information generated by MH-EIT based on the broadcast service that uses MMT as the media transmission method and the channel information based on EIT based on the broadcast service that uses MPEG2-TS as the media transmission method are seamlessly displayed on the same timeline.
[0511] Therefore, when a user wants to confirm channel information generated by EIT for a broadcast service using MPEG2-TS as the media transmission method while confirming channel information generated by MH-EIT for a broadcast service using MMT as the media transmission method, they no longer need to instruct the user to switch networks using the remote control (illustrated but not shown). Furthermore, the user can simultaneously confirm detailed information about broadcast programs on multiple networks with different media transmission methods for the same day and time period. In other words, the usability of the broadcast receiver 800 is improved.
[0512] (Example 3)
[0513] The following describes Embodiment 3 of the present invention. Furthermore, the structure and effects in this embodiment are the same as in Embodiment 1 unless otherwise specifically mentioned. Therefore, the following mainly describes the differences between this embodiment and Embodiment 1, and common parts are omitted as much as possible to avoid repetition.
[0514] [System Architecture]
[0515] Figure 28 This is a system structure diagram illustrating an example of a broadcast communication system including the broadcast receiving device of this embodiment. The broadcast communication system of this embodiment includes a broadcast receiving device 20100 and an antenna 20100a, a connecting cable 20200, a monitor device 20300, a broadband network 200 (such as the Internet) and a routing device 200r, a radio tower 300t of a broadcasting station and a broadcast satellite (or communication satellite) 300s, a broadcasting station server 300, a service operator server 400, and other application servers 500. Although the illustration is omitted, similar to the system structure diagram of the broadcast communication system in Embodiment 1, it may also include an access point 200a, a mobile phone communication server 600, a base station 600b of a mobile phone communication network, and a portable information terminal 700. Furthermore, in this case, the portable information terminal 700 can communicate directly with the broadcast receiving device 20100 without going through the routing device 200r, etc.
[0516] The broadcast receiver 20100 receives broadcast waves transmitted from the radio tower 300t via a broadcast satellite (or communication satellite) 300s and an antenna 20100a. Alternatively, it can receive broadcast waves transmitted from the radio tower 300t directly from the antenna 20100a without using the broadcast satellite (or communication satellite) 300s. Furthermore, the broadcast receiver 20100 can connect to the Internet 200 via a routing device 200r, and can send and receive data by communicating with various server devices or other communication equipment on the Internet 200.
[0517] The connecting cable 20200 is a communication cable that connects the broadcast receiver 20100 and the monitor device 20300, transmitting encoded video / audio data output from the broadcast receiver 20100. The monitor device 20300 is an image display device that provides image and audio information obtained by decoding the encoded video / audio data received via the connecting cable 20200 to the user via a display device such as an LCD panel and a speaker.
[0518] [Hardware structure of broadcast receiving device]
[0519] Figure 29A This is a block diagram illustrating an example of the internal structure of a broadcast receiver 20100. The broadcast receiver 20100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage (accumulation) unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 20125, a tuning / demodulation unit 131, a separation unit 132, an image decoder 141, an image color gamut conversion unit 142, an audio decoder 143, a character overlay decoder 144, a subtitle decoder 145, a subtitle synthesis unit 146, a subtitle color gamut conversion unit 147, a data decoder 151, a buffer unit 152, an application control unit 153, a browser unit 154, an application color gamut conversion unit 155, an audio source unit 156, an image synthesis unit 161, an image output unit 163, an audio synthesis unit 164, an audio output unit 166, an operation input unit 170, and a transcoding processing unit 20181. The transcoding processing unit 20181 can be expressed as an encoding mode conversion unit, multiplexing mode conversion unit, transmission mode conversion unit, data string conversion unit, data structure conversion unit, etc.
[0520] The broadcast receiving device 20100 of this embodiment is an optical disc drive recorder such as a DVD recorder, a disk drive recorder such as an HDD recorder, or an STB, etc. That is, compared with the broadcast receiving device 100 of Embodiment 1, the monitor unit 162 and the speaker unit 165 can be omitted. In addition, the transcoding processing unit 20181 is a signal processing unit that performs transcoding operations to convert the encoding format, bit rate, media transmission mode, etc. of each component constituting the content. For example, the transcoding processing unit 20181 can convert the MMT data string containing the video component of the broadcast program output from the separation unit 132 in MPEG-H HEVC format into the MPEG2-TS data string containing the video component in MPEG-2 or MPEG-4 AVC (Advanced Video Coding) format. In addition, the program content that has undergone the above transcoding operation can be stored as recorded content in the storage (accumulation) unit 110, or output from the digital interface unit 20125 and the like to an external monitor device, etc.
[0521] [Software Structure of Broadcast Receiver]
[0522] Figure 29B This is a software structure diagram of the broadcast receiving apparatus 20100 of this embodiment, showing the structure of the software in the ROM 103, RAM 104, and storage (storage) unit 110. Compared with the software structure diagram of the broadcast receiving apparatus 100 of Embodiment 1, a transcoding program 21003 is added to the storage (storage) unit 110. Furthermore, the transcoding program 21003 stored in the storage (storage) unit 110 is expanded to the RAM 104, and then the main control unit 101 runs the expanded transcoding program, thereby constituting a transcoding operation unit 21103. The transcoding operation unit 21103 mainly controls the transcoding operation processing in the transcoding processing unit 20181.
[0523] Furthermore, the receiving function operation unit 1102, which is deployed in RAM 104, has an output control unit 21102i. The output control unit 21102i of the receiving function operation unit 1102 controls the data output of the image output unit 163, the audio output unit 166, and the digital interface unit 20125.
[0524] [Hardware structure of the monitor device]
[0525] Figure 30This is a block diagram illustrating an example of the internal structure of a monitor device 20300. The monitor device 20300 includes a main control unit 20301, a system bus 20302, a ROM 20303, a RAM 20304, a storage unit 20310, an expansion interface unit 20324, a digital interface unit 20325, a LAN communication unit 20326, an MMT decoding processing unit 20341, an MPEG2-TS decoding processing unit 20342, an image synthesis unit 20361, a monitor unit 20362, a sound synthesis unit 20364, a speaker unit 20365, and an operation input unit 20370.
[0526] Main control unit 20301, system bus 20302, ROM 20303, RAM 20304, storage unit 20310, expansion interface unit 20324, digital interface unit 20325, LAN communication unit 20326, MMT decoding processing unit 20341, MPEG2-TS decoding processing unit 20342, image compositing unit 20361, monitor unit 20362, sound compositing unit 20364, speaker unit 20365, operation input unit 203 Unit 70, etc., has the same functions as the main control unit 801, system bus 802, ROM 803, RAM 804, storage unit 810, expansion interface unit 824, digital interface unit 825, LAN communication unit 821, MMT decoding processing unit 841, MPEG2-TS decoding processing unit 842, image synthesis unit 861, monitor unit 862, sound synthesis unit 864, speaker unit 865, operation input unit 870 of the broadcast receiving device 800 of Embodiment 2.
[0527] That is, compared with the broadcast receiving device 800 of Embodiment 2, the monitor device 20300 of this embodiment can omit the first tuning / demodulation unit 831, the second tuning / demodulation unit 832, the image output unit 863, the sound output unit 866, etc. Furthermore, the monitor device 20300 has the same structure as the broadcast receiving device 800 of Embodiment 2, that is, it does not omit the first tuning / demodulation unit 831, the second tuning / demodulation unit 832, the image output unit 863, the sound output unit 866, etc. It can also have the same structure as the broadcast receiving device 100 of Embodiment 1. It can also be a structure that omits the LAN communication unit 121 and the tuning / demodulation unit 131 from the broadcast receiving device 100 of Embodiment 1. Other structures are also possible.
[0528] [Interface structure of broadcast receiver and monitor device]
[0529] Figure 31This is a system structure diagram showing an example of the interface structure between the broadcast receiver 20100 and the monitor device 20300. In this embodiment, the connection terminal of the digital interface section 20125 on the broadcast receiver 20100 side (not shown) and the connection terminal of the digital interface section 20325 on the monitor device 20300 side (not shown) are connected by a connection cable 20200.
[0530] As shown in the figure, the connecting cable 20200 includes n pairs of differential transmission channels CH1 to CHn, a DDC (Display Data Channel) line standardized by VESA (Video Electronics Standard Association), an HPD (Hot Plug Detect) line, a CEC (Consumer Electronics Control) line, etc. The aforementioned n pairs of differential transmission channels can be a pair of clock channels and (n-1) pairs of data channels. Alternatively, a pair of clock channels and a pair of data channels can be used (i.e., n=2). As mentioned above, when n=2, the differential transmission channels can be serial transmission. Furthermore, although the diagram is omitted, it may also include a power line, a GND line, and a spare line. The CEC line, etc., may also be omitted.
[0531] Digital video (R / G / B / Vsync / Hsync) / audio signals, control signals, etc., can be output to the aforementioned data channel in a prescribed parallel transmission format from the video synthesis unit 161 and the audio synthesis unit 164 via the transmission processing unit 20125b of the digital interface unit 20125 on the broadcast receiver 20100 side. Alternatively, encoded video / audio data, program data, etc., including MMT data strings, MPEG2-TS data strings, etc., and control signals, can be output in a prescribed serial transmission format from the separation unit 132 and the transcoding processing unit 20181. The aforementioned digital video / audio signals, control signals, etc., or program data, etc., including the aforementioned encoded video / audio data, control signals, etc., are received by the receiving processing unit 20325b of the digital interface unit 20325 on the monitor device 20300 side, and after being processed appropriately (including decoding processing, etc., when it is program data including encoded video / audio data, control signals, etc.), they are output from the monitor unit 20362 and the speaker unit 20365.
[0532] In addition, the aforementioned MMT data stream can be a continuous stream of MMTP packets. It can also be a stream of IP packets that retain MMTP packets in the payload and also contain time information in NTP packet format, or it can be a stream of IP packets that do not contain time information in NTP packet format.
[0533] Furthermore, the transmission processing unit 20125b of the digital interface unit 20125 on the broadcast receiver 20100 side can communicate with the reception processing unit 20325b of the digital interface unit 20325 on the monitor device 20300 side via the aforementioned DDC line, and thereby read EDID (Extended Display Identification Data) data from the EDID storage unit 20325c. That is, the broadcast receiver 20100 can understand the performance and functions of the monitor device 20300 by obtaining the EDID.
[0534] In addition, as an example of the performance and functions of the monitor device 20300 that can be grasped at this time, this embodiment includes, in addition to the input resolution, refresh rate, video specifications that the monitor device 20300 can be compatible with, whether it has the function to decode MMT data strings, whether it has the function to decode MPEG2-TS data strings, and whether it has the function to process network communication.
[0535] Furthermore, the EDID acquisition process described above will be illustrated by an example of a process for acquiring information (hereinafter referred to as "function identification information") representing the functions, performance, and compatible functions of the monitor device 20300. That is, in order to understand the display performance of the monitor device 20300, methods other than reading the EDID data can be used. For example, data representing display performance in a separate format different from the EDID data can be used as function identification information, and this function identification information can be transmitted from the digital interface unit 20325 on the monitor device 20300 side to the digital interface unit 20125 on the broadcast receiver 20100 side.
[0536] Alternatively, unlike the aforementioned "function identification information" such as EDID, "operational status information," indicating whether a specified function of the monitoring device 20300 is currently operational, can be transmitted from the digital interface unit 20325 on the monitoring device 20300 side to the digital interface unit 20125 on the broadcast receiver 20100 side. For example, even if the monitoring device 20300 has functions corresponding to network communication processing, it may be in an environment where the network communication network used by that function is unable to communicate for some reason, resulting in a situation where the various functions of the monitoring device 20300 cannot perform as expected. In such cases, by transmitting operational status information indicating whether the functions of the monitoring device 20300 are in a normally functioning state, the broadcast receiver 20100 can be notified of the status of each function of the monitoring device 20300. The aforementioned notification processing can be performed via the sending control unit 20125a, the CEC line of the connecting cable 20200, and the receiving control unit 20325a, through data exchange between the main control unit 101 of the broadcast receiving device 20100 and the main control unit 20301 of the monitoring device 20300.
[0537] Furthermore, the transmission control unit 20125a of the digital interface unit 20125 on the broadcast receiver 20100 side controls the transmission processing unit 20125b, and communicates with the reception control unit 20325a of the digital interface unit 20325 on the monitor device 20300 side via the aforementioned HPD line. This allows it to detect whether the monitor device 20300 is connected, whether the monitor device 20300 is powered on, and other similar statuses. Additionally, the reception control unit 20325a of the digital interface unit 20325 on the monitor device 20300 side also controls the reception processing unit 20325b.
[0538] Figure 31 The structures shown for the connecting cable 20200, the internal structure of the digital interface section 20125 of the broadcast receiver 20100, and the internal structure of the digital interface section 20325 of the monitor device 20300 are merely examples. The hardware of this digital interface can use DVI, HDMI, DisplayPort, MHL, etc., as long as it can output and input data in formats conforming to DVI, HDMI, DisplayPort, MHL, SuperMHL, or extended versions of these specifications. Alternatively, it can output or input serial data in formats conforming to IEEE 1394, etc.
[0539] Furthermore, the functions of the digital interface unit 20125 on the broadcast receiver 20100 side and the digital interface unit 20325 on the monitor device 20300 side, as described above, can be implemented through communication via hardware such as Ethernet or wireless LAN. In this case, the LAN communication unit 121 can be used instead of the digital interface unit 20125 on the broadcast receiver 20100 side, and the LAN communication unit 20326 can be used instead of the digital interface unit 20325 on the monitor device 20300 side to form an IP interface. Based on the IP protocol enabling communication between the LAN communication unit 121 and the LAN communication unit 20326, the previously described "function identification information" and "operating status information" can be sent and received between the two. With this structure, as long as a LAN environment available to both the broadcast receiver 20100 and the monitor device 20300 exists, it is not necessary to connect them separately using a digital interface.
[0540] The digital and IP interfaces described above can use either wired or wireless transmission.
[0541] [Data output control of broadcast receiving device]
[0542] The following is an example of data output control for the broadcast receiver 20100.
[0543] (A) Output control corresponding to the decoding processing performance of the output destination device
[0544] Figure 32A and Figure 32B This embodiment illustrates an example of data output control in the broadcast receiving apparatus 20100 when receiving a broadcast service using MMT as the media transmission method, corresponding to the decoding processing performance of the MMT data string or MPEG2-TS data string of the output destination device connected via a connection cable or LAN connection. In this embodiment, a connection cable 20200 is used as an example of a connection cable, and a monitor device 20300 is used as an example of an output destination device.
[0545] In this embodiment, the output control unit 21102i of the broadcast receiving device 20100 first obtains functional identification information such as EDID data stored in the EDID storage unit 20325c of the monitor device 20300, which is the output destination device, via the DDC line of the connecting cable 20200, the transmission processing unit 20125b of the digital interface unit 20125, and the transmission control unit 20125a.
[0546] First use Figure 32A The identification results of the output destination device that uses the acquired functional identification information are explained.
[0547] For example, in the monitor device 20300, which serves as the output destination device... Figure 30 In the structure shown, the monitor device 20300 has both MMT data string decoding processing and MPEG2-TS data string decoding processing. In principle, this device stores function identification information capable of recognizing compatibility between both MMT data string decoding processing and MPEG2-TS data string decoding processing.
[0548] Next, at the output destination device Figure 30 In the structure of the monitor device 20300 shown, in the case where only one of the decoding processing of MMT data strings and the decoding processing of MPEG2-TS data strings is present but the other is absent, in principle, it stores function identification information that can identify the case where only the decoding processing of MMT data strings is present but the decoding processing of MPEG2-TS data strings is absent, or function identification information that can identify the case where only the decoding processing of MPEG2-TS data strings is present but the decoding processing of MMT data strings is absent.
[0549] In addition, the output destination device can be connected to the broadcast receiver 20100 via an interface. However, in the case of a device that does not have either MMT data string decoding or MPEG2-TS data string decoding, it should, in principle, store function identification information that can identify the case of not having either MMT data string decoding or MPEG2-TS data string decoding.
[0550] Additionally, there are exceptions, such as situations where even if the broadcast receiver 20100 obtains the function identification information stored in the output destination device, it cannot identify the compatibility or incompatibility status of the decoding processing of MMT data strings and MPEG2-TS data strings. This also includes situations where obtaining the function identification information stored in the output destination device fails.
[0551] Figure 32A The identification results of the broadcast receiver 20100 during the function identification processing, which involved decoding the MMT data string and the MPEG2-TS data string of the output destination device based on the function identification information obtained from the output destination device, are "compatible", "incompatible", and "unrecognizable". Output control examples of the broadcast receiver 20100 based on these identification results are described in Output Control Examples 1 to 3.
[0552] First of all, Figure 32AThe "MMT data output" example shown in Examples 1 to 3 will be explained below. In the case of "MMT data output", the output control unit 21102i of the broadcast receiving device 20100 controls the output to ensure that the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132 is output from the separation unit 132 as is, and the MMT data string is output to the monitor device 20300, which is the output destination device, via the digital interface unit 20125. Alternatively, it can be controlled so that after the data volume is reduced by bit rate conversion processing such as the transcoding processing unit 20181 in the MMT data string output from the separation unit 132, it is again in the state of MMT data string, and can be output to the monitor device 20300 via the digital interface unit 20125. At this time, in the monitor device 20300, the digital interface unit 20325 receives the MMT data string sent from the broadcast receiving device 20100, the MMT data string is decoded by the MMT decoding processing unit 20341, and then the image information and sound information are provided to the user via the monitor unit 20362 and the speaker unit 20365.
[0553] Next, regarding Figure 32A The “MPEG2-TS data output” shown in Examples 1 to 3 will be used to illustrate the output control. Figure 32A In the case of "MPEG2-TS data output", the output control unit 21102i of the broadcast receiver 20100 controls the output of the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132 to maintain its original output from the separation unit 132. Then, the MMT data string is converted into an MPEG2-TS data string by the media transmission mode conversion processing of the transcoding processing unit 20181, and then output to the monitor device 20300, which is the output destination device, via the digital interface unit 20125. In the monitor device 20300, the MPEG2-TS data string sent from the broadcast receiver 20100 is received by the digital interface unit 20325, and the received MPEG2-TS data string is decoded by the MPEG2-TS decoding processing unit 20342, etc., and then the image and sound information are provided to the user via the monitor unit 20362 and the speaker unit 20365.
[0554] Furthermore, in the case of "MPEG2-TS data output" described above, during the process of converting the MMT data string into an MPEG2-TS data string using the transcoding processing unit 20181, the following processing is preferably performed. That is, the timing information such as the DTS (Decoding Time Stamp), which is the decoding reference, and the PTS (Presentation Time Stamp), which is the reproduction reference, of the encoded video / audio data contained in the PES (Packetized Elementary Stream) of the MPEG2-TS data string or MPEG2-PS (Program Stream) data string, can be generated by referring to the control information of the MMT data string during the media transmission mode conversion processing of the transcoding processing unit 20181 described above.
[0555] More specifically, the aforementioned DTS can be referenced. Figure 13B The "mpu_presentation_time" parameter of the MPU timestamp descriptor shown is... Figure 33 The MPU extended timestamp descriptor shown above is generated using the "mpu_decoding_time_offset" parameter, the "timescale" parameter, and the "pts_offset" parameter. Additionally, the aforementioned PTS can also be generated by referring to the DTS generated above. Figure 33 The "dts_pts_offset" and "timescale" parameters of the MPU extended timestamp descriptor shown are used for generation. Furthermore, the PCR (Program Clock Reference) and SCR (System Clock Reference), required for generating the STC (System Time Clock), which serves as the reference clock for decoding / reproducing the encoded video / audio data contained in the PES of the aforementioned MPEG2-TS and MPEG2-PS data strings, can be based on the example in Example 1. Figure 7C It is generated by receiving the time information output by the receiving system clock on the receiver side.
[0556] Through the above processes, in the MPEG2-TS data string converted from the MMT data string through the media transmission method conversion process, it is also possible to control the decoding time and display time of each display unit of the image / sound signal.
[0557] Additionally, the MPT of the program being output specifies multiple video resources, and the descriptor is specified according to the MPU display area. Figure 19B , Figure 19C , Figure 19DIn cases where the layout, device, and / or region are associated with LCT transmission, the question arises during the MMT data string to MPEG2-TS data string conversion process in the transcoding processing unit 20181 described above: what kind of image resource data should be included in the MPEG2-TS data output? At this time, the image resources to be included in the MPEG2-TS data output can be determined based on the correspondence between the layout, device, region, and image resources specified using LCT. For example, the transcoding processing unit 20181 can generate a data stream containing the image resources from the layout transmitted by LCT. Figure 19B , Figure 19C The description refers to the MPEG2-TS data string resulting from the conversion processing of the image resources associated with device number 0 (device_id: 0) and region number 0 (region_number: 0). In this case, image data based on image resources associated with other device numbers and region numbers may not be included in the MPEG2-TS data string as the output.
[0558] Furthermore, if a priority order is pre-specified among the aforementioned image resources, the image resource with the highest priority can be selected for conversion into an MPEG2-TS data string, regardless of the device number and region number. Alternatively, image resources displayed in the user-selected region can be converted into MPEG2-TS data strings.
[0559] Return to Figure 32A Explanation. Figure 32A If, in any of the output control examples 1-3, one party's decoding process is "compatible" while the other party's decoding process is "incompatible" or "unrecognizable," the data string is output in the format of the decoding process that is recognized as "compatible." If both parties' decoding processes are "incompatible" or "unrecognizable," Figure 32A Any of the output control examples 1 to 3 shall be performed "according to output control example 4". This output control example 4 uses... Figure 32B To be described later. Figure 32A The difference in output control in Examples 1 to 3 is that the output control is performed when both decoding processes are recognized as "compatible".
[0560] In Output Control Example 1, "MMT data output" is performed when both decoding processes are identified as "compatible". At this time, in the monitor device 20300, layout control and other processes can achieve more refined processing than "MPEG2-TS output".
[0561] In Output Control Example 2, "MPEG2-TS Output" is performed when both decoding processes are identified as "compatible". In this case, the data to be processed by the output destination device is conventional MPEG2-TS, thus reducing the processing load in the output destination device.
[0562] In output control example 3, when both decoding processes are identified as "compatible," the decision to perform "MMT data output" or "MPEG2-TS output" is made according to the priority order set in the broadcast receiver 20100. The "set priority order" refers to a setting that follows, for example, the factory default setting to select one output format, or a setting that allows the user to pre-select one output format via menu operation on the operation input unit. In this case, data can be output in a format that matches the user's intention.
[0563] Next, using Figure 32B Output control (Example 4) is explained when both decoding processes are "incompatible" or "unrecognizable". Figure 32B Examples of output control for combinations of recognition results (output control examples 4-A1 to 4-E) are given when the decoding processing of MMT data strings and MPEG2-TS data strings for the output destination device is performed in the broadcast receiving device 20100 and the recognition result is "incompatible" or "unrecognizable".
[0564] Output control example 4-A1 is an example where no data string of any format is output when the recognition result is "incompatible" or "unrecognizable". This approach can at least reduce the possibility of unexpected problems occurring in the output destination device.
[0565] Output control examples 4-A2 to A4: If both decoding processes in the recognition result are "incompatible," then "no output." If at least one of the two decoding processes is not "incompatible" but "unrecognizable," then considering that the output destination device may be compatible with that decoding process, the output will be in the data format corresponding to the decoding process whose recognition result is not "incompatible" but "unrecognizable." Output control examples 4-A2 to A4 differ in output control when both decoding processes in the recognition result are "unrecognizable," but the output control scheme in this case is different from... Figure 32A The output control examples 1 to 3 show the same "compatible" decoding process for both sides in their recognition results, so the explanation is omitted.
[0566] In Output Control Example 4-B1, if the identification results show that the two decoding processes mentioned above are "incompatible" or "unrecognizable," "MPEG2-TS output" is performed first in either case. For example, if the output destination device is not a monitor device but a relay device such as an image distribution device connected between the monitor device 20300 and the broadcast receiving device 20100, the function identification information of the output destination device may indicate a connection environment where both decoding processes are "incompatible."
[0567] Output control example 4-B1 is an example of "MPEG2-TS output" control that takes into account the situation where the recognition results of the two decoding processes mentioned above are "incompatible" or "unrecognizable".
[0568] Output control example 4-C1 anticipates the same situation, and even if the recognition results of the two decoding processes mentioned above are "incompatible" or "unrecognizable", the control example of "MMT output" is still performed.
[0569] Output control examples 4-B2 and 4-C2 are variations of output control examples 4-B1 and 4-C1, respectively. They are examples where, in the recognition result, one of the two decoding processes is "unrecognizable" and the other is "incompatible," the data format corresponding to the "unrecognizable" decoding process is prioritized for output. Through such variations, the possibility of processing at the output destination can be significantly improved compared to output control examples 4-B1 and 4-C1.
[0570] Output control example 4-D illustrates how, in cases where the recognition results of the two decoding processes described above are "incompatible" or "unrecognizable," the output will "export according to the set priority order." The "output according to the set priority order" process... Figure 32A The output control has already been explained in Example 3, so the explanation is omitted.
[0571] Output control example 4-E, when the recognition results of the above two decoding processes are "incompatible" or "unrecognizable", prompts the user to select a data output mode, so that the user can select a data output mode through operation input unit 170.
[0572] At this point, how to display a notification message to the user becomes a problem, but it can be done, for example, by connecting to... Figure 29A The digital interface unit 20125 outputs to a different destination device, and displays an image superimposed with the aforementioned message on a display device connected via the image output unit 163. A sub-monitor for displaying various messages to be conveyed to the user can be installed in the broadcast receiver 20100. Figure 29A(Not shown in the figure) to display the above message. Alternatively, the message can be displayed by sending a message to a portable information terminal 700 that cooperates with the broadcast receiving device 100. Alternatively, only an audio message (audio data) with the same content as the above message can be sent to the output destination device, and the user can be prompted to select a data output method via the speaker of the output destination device.
[0573] In the broadcast receiving device 20100 of this embodiment, by employing... Figure 32A and Figure 32B Any of the output control examples described can perform data output control corresponding to the decoding processing performance of MMT data strings or MPEG2-TS data strings of the output destination device connected via a digital interface connection cable or LAN connection.
[0574] Furthermore, even if a particular output control is set at the factory, it is preferable to allow the output control settings for each condition to be changed manually via user menu operation on the operation input unit 170. This is because even if the output destination device is an unexpectedly special device, or if the broadcast receiver 20100 itself or the output destination device's software fails to obtain a normal recognition result in the output destination device's function recognition processing, the configuration allows the user to obtain the required data output through manual setting, thus preventing situations that are detrimental to the user.
[0575] (B) Output control corresponding to the network communication performance and status of the output destination device
[0576] Figure 34A and Figure 34B This embodiment illustrates an example of data output control in the broadcast receiving device 20100 when receiving a broadcast service using MMT as the media transmission method, corresponding to the network communication processing performance and network communication status of the output destination device connected via a connection cable or LAN connection. In this embodiment, a connection cable 20200 is used as an example of a connection cable, and a monitor device 20300 is used as an example of an output destination device.
[0577] In this embodiment, the output control unit 21102i of the broadcast receiving device 20100 first obtains functional identification information such as EDID data stored in the EDID storage unit 20325c of the monitor device 20300, which is the output destination device, via the DDC line of the connecting cable 20200, the transmission processing unit 20125b of the digital interface unit 20125, and the transmission control unit 20125a.
[0578] For example, in monitor device 20300, such as... Figure 30 In the case of the structure shown with LAN communication unit 20326, or in the case of other network communication functions (e.g., 3G communication function or LTE communication function, etc.), such a device, in principle, stores function identification information that can identify the compatibility with network communication functions. In particular, when the broadcast receiving device 20100 and the output destination device are connected by LAN connection, network communication function is provided.
[0579] In addition, with Figure 32A and Figure 32B Similarly, for example, there are cases where even if the broadcast receiver 20100 obtains the function identification information stored in the output destination device, it is still unable to identify the compatibility or incompatibility status of the network communication function.
[0580] Figure 34A This indicates that when the broadcast receiver 20100 performs function identification processing on the network communication function of the output destination device based on the function identification information obtained from the output destination device, the identification result is "compatible", "incompatible", or "unrecognizable". Examples of output control of the broadcast receiver 20100 in response to these identification results are described.
[0581] If the result of the above identification process is "compatible", the output control unit 21102i of the broadcast receiver 20100 performs a process of "not mixing the data obtained through the network communication function for output". Specifically, control is performed so that the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132 is output from the separation unit 132 as is, and can be output to the monitor device 20300, which is the output destination device, via the digital interface unit 20125. At this time, even if the location information contained in the MPT of the MMT data string specifies that the data is obtained from a network communication route different from the broadcast wave received via the tuning / demodulation unit 131, the data obtained from that network communication route will not be mixed, and the MMT data string obtained from the broadcast wave received via the tuning / demodulation unit 131 will be output to the monitor device 20300.
[0582] In the monitoring device 20300, the digital interface unit 20325 receives the aforementioned MMT data string sent from the broadcast receiving device 20100. Furthermore, in the monitoring device 20300, if the location information contained in the MPT of the MMT data string specifies data obtained from a network communication route, the relevant data stored in a designated server device on the network is obtained as needed via the LAN communication unit 20326. The MMT data string received from the broadcast receiving device 20100 and the obtained relevant data are then decoded using the MMT decoding processing unit 20341, and finally, image and sound information are provided to the user via the monitoring unit 20362 and the speaker unit 20365.
[0583] On the other hand, if the result of the above identification process is "incompatible", when the location information contained in the MPT specifies that the output is an MMT data string obtained from a network communication route different from the broadcast wave received via the tuning / demodulation unit 131, the output control unit 21102i of the broadcast receiving device 20100 controls "mixing and outputting data obtained through the network communication function". Specifically, the control is performed in the following manner: relevant data obtained from the specified server device on the network shown in the above location information via the LAN communication unit 121 is mixed with the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132 to generate a mixed MMT data string.
[0584] This data string mixing process can be achieved by separating and rearranging the data strings in the separation unit 132, whereby the relevant data obtained via the LAN communication unit 121 and the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132. Alternatively, as another method, it can be achieved by performing a data string conversion process in the transcoding processing unit 20181, whereby the relevant data obtained via the LAN communication unit 121 and the MMT data string input from the tuning / demodulation unit 131 to the separation unit 132 are rearranged.
[0585] Furthermore, control is performed to enable the newly generated MMT data string to be output to the monitor device 20300, which serves as the output destination device, via the digital interface unit 20125. In the monitor device 20300, the aforementioned mixed data transmitted from the broadcast receiving device 20100 is received via the digital interface unit 20325, the received mixed data is decoded using the MMT decoding processing unit 20341, and then image and sound information are provided to the user via the monitor unit 20362 and the speaker unit 20365.
[0586] according to Figure 34AIn this process, when the output destination device is a device compatible with network communication processing, the MMT data string obtained via broadcast waves and the data obtained via a network path are mixed at the output destination device. This reduces the processing time of the broadcast receiving device 20100, thus mitigating playback delays at the output destination device. Conversely, when the output destination device is not a device compatible with network communication processing, the above-mentioned mixing processing is performed in the broadcast receiving device 20100 before output to the output destination device. In this case, even a monitor device without network communication capabilities can provide users with high-precision image, sound, and data display services using both the MMT data string obtained via broadcast waves and the data obtained via a network path.
[0587] Furthermore, if the result of the above identification process is "unrecognizable," the same output control as for "incompatible" can be performed. This is because it increases the possibility of providing high-precision video, audio, and data display services using both MMT data strings obtained via broadcast waves and data obtained via network paths, even when the output destination device lacks network communication capabilities.
[0588] Based on the above explanation Figure 34A The output control can realize output processing based on whether the output destination device is compatible with network communication processing.
[0589] Here, the details of the process by which the broadcast receiving device 20100 mixes the relevant data obtained via the LAN communication unit 121 and the MMT data string obtained via the tuning / demodulation unit 131 will be explained below.
[0590] For example, the packages that make up a broadcast service, such as Figure 35 As shown, it consists of image resource A, sound resource A, data resource A, image resource B, sound resource B, and data resource B. Furthermore, image resource A, sound resource A, and data resource A are distributed via an IP data stream (broadcast signal) contained in a TLV stream transmitted via a broadcast wave. Image resource B, sound resource B, and data resource B are distributed from a designated server device via a network communication route such as a communication line via an IP data stream (communication line). Image resource B, sound resource B, and data resource B can be accessed via the MH-EIT event packet descriptor (configured in the control signal (MMT-SI) of the IP data stream (broadcast signal) transmitted by the TLV stream. Figure 21 The “descriptor()” section shown) and the packet ID of MPT (and) Figure 17 The "MMT_package_id_byte" parameter shown corresponds to the location information (and...). Figure 17Refer to the “MMT_general_location_info()” shown below.
[0591] Therefore, in the broadcast receiving apparatus 20100 of this embodiment, by referring to the control signal (MMT-SI) of the IP data stream (broadcast signal) transmitted by the TLV stream and associating it with the IP data stream (broadcast signal), the IP data stream (communication line) distributed via the communication line can be obtained. Furthermore, by mixing processing, the data strings of each resource of the IP data stream (broadcast signal) and the data strings of each resource of the IP data stream (communication line) can be formed into an IP data stream (output signal), which is then output from the digital interface unit 20125.
[0592] Furthermore, at this time, the broadcast receiving device 20100 of this embodiment rewrites the location information contained in the MPT. Specifically, for example, the location information of each resource of the IP data stream (communication line) can be rewritten from "location_type = 0x01" indicating data multiplexed in the IPv4 data stream and "location_type = 0x02" indicating data multiplexed in the IPv6 data stream to "location_type = 0x00" indicating data multiplexed in the same IP data stream as the MPT. Through the above-mentioned MPT location information rewriting process, the monitoring device 20300 can obtain the above-mentioned image resource B, sound resource B, and data resource B by referring to the IP data stream (output signal) obtained via the communication line 20200.
[0593] Next, as Figure 34A A variation of output control, using Figure 34B An example of output control that not only uses network communication function identification processing with function identification information, but also uses network communication status information indicating the network communicability / non-communicability status of the output destination device will be explained. Figure 34B In the output control example, the broadcast receiver 20100 obtains function identification information and network communication status information from the output destination device via a connection cable or LAN connection. At this time, with... Figure 34A Similarly, the identification results of network communication processing that uses functional identification information are categorized into three types: "compatible," "incompatible," and "unrecognizable." This is consistent with... Figure 34AThe same applies, so the explanation is omitted. Conversely, network communication status information also includes "communicationable state" and "non-communicationable state," and there are also cases where the broadcast receiver 20100's identification processing result is "unrecognizable." Network communication status information can be generated by the control unit of the output destination device determining whether its network communication function is in a communicationable state (not necessarily requiring communication itself to occur at this time) or a non-communicationable state.
[0594] Figure 34B The output control has an option to selectively execute the output mode, and... Figure 34A Both options are "not outputting data obtained through network communication functions" and "outputting data obtained through network communication functions in a mixed manner." The details of their control are as already explained, so they will be omitted here.
[0595] Figure 34B In the output control, if the output destination device is identified as "compatible" with the network communication function based on the function identification information, and the network communication status information indicates a "communicable state," then control is performed to "not output data obtained through the network communication function in a mixed manner." This is because, in this case, mixed processing can be performed at the output destination device. Furthermore, if the identification result based on the function identification information is "unrecognizable" regarding compatibility between the output destination device and the network communication function, but the network communication status information indicates a "communicable state," then control can also be performed to "not output data obtained through the network communication function in a mixed manner." This is because, in this case, considering the result of the network communication status information indicating a "communicable state," it can be inferred that the "unrecognizable" network communication function is "compatible," increasing the likelihood of appropriate processing.
[0596] Conversely, when the function identification information indicates that the output destination device is "incompatible" with the network communication function, control is performed to "mix and output the data obtained through the network communication function," regardless of the network communication status information identification result. This is because the possibility of mixing the data using the output destination device is extremely low. Furthermore, when the network communication status information indicates a "non-communicable state," control is performed to "mix and output the data obtained through the network communication function," regardless of the function identification information identification result. This is because the possibility of mixing the data using the output destination device is also extremely low in this case. Finally, when the network communication status information indicates "unrecognizable," control is performed to "mix and output the data obtained through the network communication function," since the possibility of mixing the data using the output destination device is opaque.
[0597] Based on the above explanation Figure 34B The output control can achieve appropriate output processing based on the compatibility of the network communication processing of the output destination device and the operation status of the network communication processing of the output destination device.
[0598] In addition, even if it is set at the factory Figure 34A and Figure 34B The output control shown is preferably configured so that the output data format settings for each condition can be changed manually via user menu operation or other means through the operation input unit 170. This is because, even if a normal identification result regarding the network communication status of the output destination device cannot be obtained due to problems with the broadcast receiver 20100 itself or the software of the output destination device, the configuration allows the user to obtain the required data output through manual settings, thus preventing situations that are detrimental to the user.
[0599] Based on the above processing, the broadcast receiving device 20100 of this embodiment can perform data output control of the monitor device connected via a connection cable or LAN connection, corresponding to the network communication processing performance and network communication status.
[0600] As explained above, the broadcast receiving device 20100 according to this embodiment is capable of output control corresponding to information about the display performance of a monitor device obtained from a monitor device connected via a connection cable or LAN connection. In other words, it is capable of providing a broadcast receiving device that can perform functions with higher added value.
[0601] The above examples 1-3 illustrate embodiments of the present invention, but the structure for implementing the technology of the present invention is not limited to the above embodiments, and various modifications can be considered. For example, a part of the structure of one embodiment can be replaced with the structure of another embodiment, or the structure of another embodiment can be added to the structure of one embodiment. All of these fall within the scope of the present invention. In addition, the numerical values and messages appearing in the text and figures are only examples, and using different content will not impair the effect of the present invention.
[0602] Some or all of the functions of the present invention described above can be implemented in hardware, such as through integrated circuit design. Alternatively, they can be implemented in software, such as through a microprocessor unit that parses and executes the operation program to implement each function. Hardware and software can also be used in combination.
[0603] Furthermore, the software controlling the broadcast receiver 100 may be pre-stored in the ROM 103 and / or storage (accumulation) unit 110 of the broadcast receiver 100 at the time of product shipment. Alternatively, it may be obtained from other application servers 500 on the Internet 200 via the LAN communication unit 121 after product shipment. Alternatively, the software stored on a memory card or optical disc may be obtained via the expansion interface unit 124.
[0604] Furthermore, regarding control lines and information lines, the diagram shows only the portions deemed necessary for the illustration and does not necessarily represent all control lines and information lines in the product. It can be assumed that almost all structures are actually interconnected.
[0605] Explanation of reference numerals in the attached figures
[0606] 100, 800, 20100… Broadcast receiving device; 100a, 20100a… Antenna; 101, 801… Main control unit; 102, 802… System bus; 103, 803… ROM; 104, 804… RAM; 110, 810… Storage unit; 121, 821… LAN communication unit; 124, 824… Expansion interface unit; 125, 825, 20125… Digital interface unit; 131… 831, 832… Tuning / Demodulation Unit, 132… Separation Unit, 141… Image Decoder, 142… Image Color Gamut Conversion Unit, 143… Audio Decoder, 144… Character Overlay Decoder, 145… Subtitle Decoder, 146… Subtitle Compositing Unit, 147… Subtitle Color Gamut Conversion Unit, 151… Data Decoder, 152… Buffer Unit, 153… Application Control Unit, 154… Browser Unit, 155… Application Color Gamut Conversion unit, 156… Audio source unit, 161, 861… Image synthesis unit, 162, 862… Monitor unit, 163, 863… Image output unit, 164, 864… Sound synthesis unit, 165, 865… Speaker unit, 166, 866… Sound output unit, 170, 870… Operation input unit, 20181… Transcoding processing unit, 841… MMT decoding processing unit, 842… MPEG2-TS decoding processing unit, 200… Internet, 200r… Routing device, 200a… Access point, 300t… Radio tower, 300s… Broadcast satellite (or communication satellite), 300… Broadcasting station server, 400… Service operator server, 500… Other application server, 600… Mobile phone communication server, 600b… Base station, 700… Portable information terminal, 20200… Connecting cable, 20300… Monitor device.
Claims
1. A broadcast receiving apparatus characterized by comprising: comprising: a digital broadcast receiving section that receives a digital broadcast of a transmission content; a network communication section that can perform network communication; a data string conversion processing section that can generate a new data string by mixing a data string of the content received by the digital broadcast receiving section and a data string acquired by the network communication section; a digital interface that can communicate with an external device; and a control section, the broadcast receiving apparatus can acquire performance information of the external device and network communication state information of the external device via the digital interface, the control section, when outputting the received content from the digital interface to the external device, switches, according to a combination of both the performance information of the external device and the network communication state information of the external device acquired via the digital interface, whether to output a new data string generated by mixing the data string of the content received by the digital broadcast receiving section and the data string acquired by the network communication section from the digital interface or to output the data string of the content received by the digital broadcast receiving section in a state where the mixing processing is not performed from the digital interface so that the mixing processing of the output data string in the state where the mixing processing is not performed can be performed in the external device.
2. The broadcast receiving apparatus according to claim 1, wherein: a media transmission method of the content received by the digital broadcast receiving section is an MMT method, a media transmission method of the new data string output from the digital interface is also the MMT method. comprising:
3. A content output method for outputting, from a broadcast receiving apparatus, content to an external device via a digital interface, characterized by, a receiving step of receiving a digital broadcast of a transmission content; a network communication step of performing network communication; a data string conversion step of being able to generate a new data string by mixing a data string of the content received in the receiving step of receiving the digital broadcast and a data string acquired in the network communication step; and an input / output step of performing communication with the external device and output of the content via the digital interface, wherein performance information of the external device and network communication state information of the external device can be acquired via the digital interface, in the input / output step, when outputting the received content from the digital interface to the external device, according to a combination of both the performance information of the external device and the network communication state information of the external device acquired via the digital interface, it is switched whether to output a new data string generated by mixing the data string of the content received in the receiving step of receiving the digital broadcast and the data string acquired in the network communication step from the digital interface or to output the data string of the content received in the receiving step of receiving the digital broadcast in a state where the mixing processing is not performed from the digital interface so that the mixing processing of the output data string in the state where the mixing processing is not performed can be performed in the external device.
4. The content output method according to claim 3, wherein: a media transmission method of the content received in the receiving step is an MMT method, The media transmission mode of the new data string output from the digital interface in the input and output step is also the MMT mode.
Citation Information
Patent Citations
Broadcasting system for data broadcast in tv broadcast
JP2001186486A
Presentation control device, presentation control method, presentation system, presentation control program, recording medium and metadata
CN104081762A
Digital video converter box for subscriber / home with multiple television sets
US5936660A
Data decoding method, data decoding apparatus, and data transmitting method
WO2014196189A1