How to launch an application
The integration of digital broadcasting with broadband networks through a broadcast-communication collaboration system addresses the limitations of current digital broadcast receivers, enabling enhanced functionality and application execution.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- MAXELL LTD
- Filing Date
- 2025-07-23
- Publication Date
- 2026-05-22
AI Technical Summary
Current digital broadcast receivers face limitations in data transmission capacity, making it difficult to execute high-definition screen displays or high-functional effects, thereby hindering the execution of valuable functions.
A broadcast-communication collaboration system that integrates digital broadcasting with broadband networks, enabling the execution of applications through a broadcast-communication collaboration system, utilizing HTML and an extended BML specification, and application control information to enhance functionality.
Enables the execution of functions with higher added value by integrating digital broadcasting with broadband networks, allowing for enhanced application execution and collaboration with mobile terminal devices.
Smart Images

Figure 0007864234000001 
Figure 0007864234000002 
Figure 0007864234000003
Abstract
Description
Technical Field
[0001] The present invention relates to an application startup method.
Background Art
[0002] One of the extended functions of digital broadcast services is data broadcasting, which transmits digital data by broadcast waves and displays various information such as weather forecasts, news, and recommended programs. A large number of commercially available TV receivers capable of receiving data broadcasts already exist, and a large number of technologies related to data broadcast reception, including Patent Document 1 below, have been published.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] As a feature of data broadcasting, in a TV receiver compatible with digital broadcast services, it is possible to receive data broadcasts alone and acquire / view various information. On the other hand, since data broadcasting has a limited amount of data that can be transmitted due to radio wave band limitations, it is difficult to obtain high-definition screen displays or high-functional effects. For this reason, there has been a problem that it is difficult to execute useful functions with high added value on current digital broadcast receivers.
[0005] An object of the present invention is to provide an application startup method capable of executing functions with higher added value.
Means for Solving the Problems
[0006] As a means for solving the above problems, the technology described in the claims is used.
[0007] For example, the technology described in claim 1 is used. [Effects of the Invention]
[0008] By using the technology of the present invention, it is possible to provide an application startup method that enables the execution of functions with higher added value. [Brief explanation of the drawing]
[0009] [Figure 1] This is a system configuration diagram of a communication system according to an embodiment. [Figure 2A] This is a block diagram of a broadcast receiving device according to an embodiment. [Figure 2B] This is a software configuration diagram of a broadcast receiving device according to an embodiment. [Figure 2C] This is a block diagram of an information display device according to an embodiment. [Figure 2D] This figure shows an example of the viewer instruction input section of an information display device according to an embodiment. [Figure 3] This is a block diagram of a broadcasting station server according to an embodiment. [Figure 4] This is a block diagram of the service provider server according to the embodiment. [Figure 5A] This is a block diagram of a portable information terminal according to an embodiment. [Figure 5B] This is a software configuration diagram of a portable information terminal according to an embodiment. [Figure 6] This is a data structure diagram of application control information related to the embodiment. [Figure 7A] This is an operation sequence diagram of the broadcast receiving device according to the embodiment when the application is started. [Figure 7B] This is an operation sequence diagram of the broadcast receiving device according to the embodiment when the application is started. [Figure 7C] This is an operation sequence diagram of the broadcast receiving device according to the embodiment when the application is started. [Figure 8A] This is an operation sequence diagram of the mobile information terminals during the operation of the linked devices according to the embodiment. [Figure 8B] It is an operation sequence diagram at the time of cooperation of the mobile information terminal according to the embodiment. [Figure 8C] It is an operation sequence diagram at the time of cooperation of the mobile information terminal according to the embodiment. [Figure 9] It is an operation sequence diagram at the time of starting an application of the broadcast receiving apparatus and the mobile information terminal according to the embodiment. [Figure 10A] It is a screen display diagram of the basic screen of the cooperation control application of the mobile information terminal according to the embodiment. [Figure 10B] It is a screen display diagram of the basic screen of the cooperation control application of the mobile information terminal according to the embodiment. [Figure 11] It is a screen display diagram of the data broadcast screen of the broadcast receiving apparatus according to the embodiment. [Figure 12A] It is a screen display diagram of the notification screen of the broadcast receiving apparatus according to the embodiment. [Figure 12B] It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving apparatus according to the embodiment. [Figure 13A] It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus according to the embodiment. [Figure 13B] It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus according to the embodiment. [Figure 13C] It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus according to the embodiment. [Figure 13D] It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus according to the embodiment. [Figure 14] It is a screen display diagram of the error display screen of the broadcast receiving apparatus according to the embodiment. [Figure 15] It is a screen display diagram of the broadcast cooperation application execution screen of the mobile information terminal according to the embodiment. [Figure 16A] It is a screen display diagram of the EPG display screen of the broadcast receiving apparatus according to the embodiment. [Figure 16B] It is a diagram of detailed information of the EPG display screen of the broadcast receiving apparatus according to the embodiment. [Figure 17] It is an operation sequence diagram at the time of acquiring the broadcast cooperation application of the broadcast receiving apparatus according to the embodiment. [Figure 18A] This is an operation sequence diagram for terminal linkage in the embodiment. [Figure 18B] This is an operation sequence diagram for terminal linkage in the embodiment. [Figure 18C] This is an operation sequence diagram for terminal linkage in the embodiment. [Figure 18D] This is an operation sequence diagram for terminal linkage in the embodiment. [Figure 19A] This is a screen display diagram of the broadcast linkage application launcher of the broadcast receiving device according to the embodiment. [Figure 19B] This is a screen display diagram of the broadcast linkage application launcher of the broadcast receiving device according to the embodiment. [Figure 19C] This is a screen display diagram of the broadcast linkage application launcher of the broadcast receiving device according to the embodiment. [Figure 19D] This is a screen display diagram of the broadcast linkage application launcher of the broadcast receiving device according to the embodiment. [Figure 19E] This is a screen display diagram of a broadcast receiving device according to an embodiment. [Figure 19F] This is a screen display diagram of the broadcast-linked application launcher for a mobile information terminal according to the embodiment. [Figure 20A] This is a screen display diagram of an information display device according to an embodiment. [Figure 20B] This is a screen display diagram of an information display device according to an embodiment. [Figure 20C] This is a screen display diagram of an information display device according to an embodiment. [Figure 20D] This is a screen display diagram of an information display device according to an embodiment. [Figure 21A] This is an operation sequence diagram of an information display device according to an embodiment. [Figure 21B] This is an operation sequence diagram of an information display device according to an embodiment. [Figure 21C] This is an operation sequence diagram of an information display device according to an embodiment. [Figure 21D] This is an operation sequence diagram of an information display device according to an embodiment. [Figure 22A] This is a button layout diagram of the remote control according to the embodiment. [Figure 22B]This is a screen display diagram of an information display device according to an embodiment. [Figure 22C] This is a screen display diagram of a portable information terminal according to an embodiment. [Figure 22D] This is a screen display diagram of an information display device according to an embodiment. [Figure 22E] This is a screen display diagram of an information display device according to an embodiment. [Figure 22F] This is a screen display diagram of an information display device according to an embodiment. [Figure 22G] This is a screen display diagram of an information display device according to an embodiment. [Figure 22H] This is a screen display diagram of an information display device according to an embodiment. [Figure 22I] This is a screen display diagram of an information display device according to an embodiment. [Figure 22J] This is a screen display diagram of an information display device according to an embodiment. [Figure 22K] This is a screen display diagram of an information display device according to an embodiment. [Figure 23A] This is a diagram of the window frame of an information display device according to an embodiment. [Figure 23B] This is a screen display diagram of an information display device according to an embodiment. [Figure 24] This is an operation sequence diagram of an information display device according to an embodiment. [Modes for carrying out the invention]
[0010] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. [Examples]
[0011] First, we will describe an example of a digital broadcasting service that can be received by the broadcasting receiving device of this embodiment.
[0012] For example, in one example of BS / terrestrial digital broadcasting that can be received by the broadcast receiving device of this embodiment, multiple transport streams (TS) can be multiplexed and transmitted on a single transponder (frequency channel). A TS is a sequence of TS packets of a predetermined length, formed by dividing data streams such as video / audio elementary streams (ES), program-specific information (PSI), and service information (SI), and adding a TS header.
[0013] The PSI (Program Information System) is a unique information table defined in the MPEG (Moving Picture Experts Group)-2 system standard, used to identify which program each ES (Electronic Sample) included in a TS (Timestamp) belongs to. The PSI consists of the PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), etc. The PAT defines the list of programs included in the TS using the PMT's PID (Packet Identifier). The PMT defines the PIDs of the components of each program, etc. The CAT contains information related to restricted access.
[0014] Furthermore, SI extends PSI to include program information, etc., and contains information related to the Electronic Program Guide (EPG) as defined by the Association of Radio Industries and Businesses (ARIB) in ARIB STD-B10. SI consists of BIT (Broadcaster Information Table), SDT (Service Description Table), EIT (Event Information Table), TOT (Time Offset Table), etc. BIT includes broadcaster identification information, network information, and broadcaster SI transmission information. SDT includes information such as a network ID for identifying the network, a TS ID for identifying the TS, and a service ID (so-called channel number) for identifying individual services (so-called channels) within the network. EIT includes a service ID for identifying individual services within the network, and information related to events, such as the name of each event (so-called program), broadcast date and time, and broadcast content. TOT includes information related to the current date and time.
[0015] Furthermore, TS includes PCR (Program Clock Reference) information, which serves as the basis for playback timing in the decoder, and BML documents that have been subsetted based on the BML (Broadcast Markup Language) specification defined in ARIB STD-B24.
[0016] In this embodiment, the broadcast receiving device can receive and decode the TS, which consists of the video / audio ES and various information, and provide users with broadcast programs, EPG, data broadcast screens created using BML, etc.
[0017] Furthermore, the broadcast receiving device of this embodiment can integrate functions utilizing a broadband network with digital broadcasting services, enabling a broadcast-communication collaboration system that combines digital broadcasting services with functions such as acquiring additional content via the broadband network, computational processing on server devices, and presentation processing in cooperation with mobile terminal devices. To realize the aforementioned broadcast-communication collaboration system, the broadcast receiving device of this embodiment is capable of executing applications written in HTML (Hyper Text Markup Language) or the like. In addition, the broadcast-communication collaboration system supported by this broadcast receiving device uses an extended BML specification, application control information (Application Information Table: AIT) in the broadcast-communication collaboration system, and extended PSI / SI information necessary when transmitting applications over broadcast waves. The AIT is information for providing or disseminating various information necessary to start an application, such as the application acquisition destination, and control information that controls the start / stop of the application.
[0018] The above explanation is based on Japan's digital broadcasting service, but the broadcast receiving equipment in this embodiment, including the corresponding broadcast-communication cooperation system, is not limited to application within Japan.
[0019] Next, we will describe a specific example of the configuration of the embodiment in this example.
[0020] [System Configuration] Figure 1 is a system configuration diagram showing an example of the communication system of this embodiment that realizes a broadcast-communication collaboration system. The communication system of this embodiment consists of a broadcast receiving device 100 and an antenna 100a, a broadband network such as the Internet 200 and a router device 210, a broadcasting station's radio tower 300t, a broadcasting station server 300, a service provider server 400, other application servers 500, a mobile telephone communication server 600 and a base station 600b of the mobile telephone communication network, and a mobile information terminal 700.
[0021] The broadcast receiving device 100 is a television receiver that, in addition to existing digital broadcasting reception functions, has functions that correspond to the aforementioned broadcast communication interoperation system. The broadcast receiving device 100 receives broadcast waves transmitted from the radio tower 300t via the antenna 100a. Furthermore, the broadcast receiving device 100 can connect to the internet 200 via the router device 210, and can transmit and receive data by communicating with various server devices on the internet 200.
[0022] The router device 210 is connected to the Internet 200 via wireless or wired communication, and is also connected to the broadcast receiving device 100 via wireless or wired communication, and to the personal information terminal 700 via wireless communication. This allows each server device on the Internet 200, the broadcast receiving device 100, and the personal information terminal 700 to mutually send and receive data via the router device 210. Note that communication between the broadcast receiving device 100 and the personal information terminal 700 may be performed directly using methods such as Bluetooth® or NFC (Near Field Communication) without going through the router device 210.
[0023] The radio tower 300t transmits broadcast waves from the broadcasting station's broadcasting equipment, including digital broadcast signals, AIT (Application Information Terminal), control information related to application presentation, etc. The control information related to application presentation refers to control information regarding the overlay of broadcast programs and applications on television receivers, and whether or not applications can be presented. The broadcasting station shall also be equipped with a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata for each broadcast program, such as the program title, program ID, program summary, cast, broadcast date and time, etc., and is capable of providing the video content and metadata to service providers based on a contract. The provision of the video content and metadata to service providers may be done through an API (Application Programming Interface) provided by the broadcasting station server 300.
[0024] The service provider server 400 is a server device prepared by the service provider to provide services through the broadcast-communication collaboration system. The service provider server 400 stores, manages, and distributes video content and metadata provided by the broadcast station server 300, as well as content and applications created for the broadcast-communication collaboration system. It also has the function of searching for and providing a list of available applications in response to inquiries from television receivers. Note that the storage, management, and distribution of the content and metadata and the storage, management, and distribution of the applications may be performed by different server devices. The broadcast station and the service provider may be the same or different companies. Multiple service provider servers 400 may be prepared for each different service. Also, the functions of the service provider server 400 may be provided by the broadcast station server 300.
[0025] Other application servers 500 are well-known server devices that store, manage, and distribute general applications, operating programs, content, and data other than those related to the aforementioned broadcast-communication collaboration system.
[0026] The mobile telephone communication server 600 is connected to the internet 200, and is connected to the personal information terminal 700 via the base station 600b. The mobile telephone communication server 600 manages telephone communication (calls) and data transmission / reception of the personal information terminal 700 via the mobile telephone communication network, and enables data transmission and reception through communication between the personal information terminal 700 and various server devices on the internet 200. Note that communication between the personal information terminal 700 and the broadcast receiving device 100 may also be conducted via the base station 600b, the mobile telephone communication server 600, the internet 200, and the router device 210.
[0027] [Hardware configuration of broadcast receiving equipment] Figure 2A is a block diagram showing an example of the internal configuration of the broadcast receiving device 100. The broadcast receiving device 100 consists of a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first subtitle decoding unit 135, a data broadcasting reception processing unit 141, a data broadcasting engine 142, a streaming reception processing unit 151, a second separation unit 152, a second video decoding unit 153, a second audio decoding unit 154, a second subtitle decoding unit 155, an application control unit 161, an application engine 162, a video overlay unit 171, an audio selection unit 172, a video display unit 173, a speaker 174, a video output unit 175, an audio output unit 176, a presentation synchronization control unit 181, and a terminal linkage control unit 191.
[0028] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 according to a predetermined operating program. The system bus 102 is a data communication path for sending and receiving data between the main control unit 101 and each operating block within the broadcast receiving device 100.
[0029] ROM (Read Only Memory) 103 is a memory that stores basic operating programs such as the operating system and other operational programs. For example, rewritable ROM such as EEPROM (Electrically Erasable Programmable ROM) or flash ROM is used. RAM (Random Access Memory) 104 is the work area when basic operating programs and other operational programs are executed. ROM 103 and RAM 104 may be integrated with the main control unit 101. Also, ROM 103 may not have an independent configuration as shown in Figure 2A, but may use a portion of the storage area within the storage unit 110.
[0030] The storage unit 110 stores the operating program and settings of the broadcast receiving device 100, as well as the personal information of the broadcast receiving device 100 user. It can also store operating programs downloaded from the network and various data created by said operating programs. Furthermore, it can store content such as video, still images, and audio acquired from broadcast waves or downloaded from the network. A portion of the storage unit 110 may replace all or part of the functions of the ROM 103. In addition, the storage unit 110 needs to retain the stored information even when the broadcast receiving device 100 is not supplied with external power. Therefore, devices such as semiconductor memory such as flash ROM or SSD (Solid State Drive), or magnetic disk drives such as HDD (Hard Disc Drive) are used.
[0031] Furthermore, the aforementioned operating programs stored in the ROM 103 and storage unit 110 can be updated and their functions expanded by downloading them from server devices on the Internet 200.
[0032] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 210 and transmits and receives data with various server devices on the Internet 200. The connection to the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 shall be equipped with encoding circuits, decoding circuits, etc. Furthermore, the broadcast receiving device 100 may also be equipped with other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, or an infrared communication unit.
[0033] The tuner / demodulator 131 receives broadcast waves from the radio tower 300t via the antenna 100a and tunes (selects) to the channel of the service desired by the user based on the control of the main control unit 101. Furthermore, the tuner / demodulator 131 demodulates the received broadcast signal to acquire a TS (Time Steady Signal). In the example shown in Figure 2A, a configuration with one tuner / demodulator is illustrated, but the broadcast receiving device 100 may be configured to have multiple tuners / demodulators for purposes such as simultaneous display of multiple screens or recording of programs while watching another program. In addition, based on the control of the main control unit 101, control such as restricting access to the demodulated TS may be performed.
[0034] The first separation unit 132 receives the TS output from the tuner / demodulation unit 131 and separates and outputs it into various data sequences, such as a video data sequence, an audio data sequence, a subtitle data sequence, a program information data sequence, an AIT data sequence, and a BML data sequence. These data sequences may be in ES format, for example. The first video decoding unit 133 decodes the video data sequence input from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data sequence input from the first separation unit 132 and outputs audio information. The first subtitle decoding unit 135 decodes the subtitle data sequence input from the first separation unit 132 and outputs subtitle information.
[0035] The data broadcasting reception processing unit 141 decodes the BML data sequence input from the first separation unit 132 and reconstructs the BML document. The data broadcasting engine 142 is a BML browser that executes the BML document and outputs data broadcasting screen information by executing the BML document reconstructed by the data broadcasting reception processing unit 141.
[0036] The streaming reception processing unit 151, based on the control of the main control unit 101, accesses video content etc. located on each server device on the Internet 200 via the LAN communication unit 121 and acquires the program stream (PS) of the video content etc. Furthermore, based on the control of the main control unit 101, it may also perform control of DRM (Digital Rights Management) processing on the acquired PS.
[0037] The second separation unit 152 receives the PS output from the streaming reception processing unit 151 and separates and outputs each data sequence, such as the video data sequence, audio data sequence, and subtitle data sequence. These data sequences may be in ES format, for example. The second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155 perform the same processing as the first video decoding unit 133, the first audio decoding unit 134, and the first subtitle decoding unit 135, respectively, so their explanation is omitted.
[0038] Furthermore, the first separation unit 132 and the second separation unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, and the first subtitle decoding unit 135 and the second subtitle decoding unit 155 may be used interchangeably.
[0039] The application control unit 161 interacts with the application engine 162 regarding applications created for the broadcast-communication collaboration system, based on the AIT data sequence input from the first separation unit or AIT files acquired from each server device on the Internet 200, and controls and manages the lifecycle and events of each application. It also controls the functional constraints of the application as appropriate, depending on the application state and AIT instructions. The application engine 162 is an HTML browser that acquires and executes applications created for the broadcast-communication collaboration system based on the control of the application control unit 161.
[0040] The video overlay unit 171 receives video information output from the first video decoding unit 133, subtitle information output from the first subtitle decoding unit 135, data broadcasting screen information output from the data broadcasting engine 142, video information output from the second video decoding unit 153, subtitle information output from the second subtitle decoding unit 155, and application execution screen information output from the application engine 162, and performs processing such as selection and / or overlay. The video overlay unit 171 is equipped with a video RAM (not shown), and the video display unit 173 and the like are driven based on the video information input to the video RAM. In addition, the video overlay unit 171 performs scaling processing and overlay processing of EPG screen information created based on the program information data sequence output from the first separation unit 132, etc., as needed, based on the control of the main control unit 101.
[0041] The audio selection unit 172 receives audio information output from the first audio decoding unit 134, audio information output from the second audio decoding unit 154, and application execution audio information output from the application engine 162, and appropriately selects and outputs the audio information according to the control of the main control unit 101.
[0042] The video display unit 173 is a display device such as a liquid crystal panel, and provides video information selected and / or superimposed by the video superimposition unit 171 to the user of the broadcast receiving device 100. The speaker 174 provides audio information output from the audio selection unit 172 to the user of the broadcast receiving device 100. The video output unit 175 is a video output interface that outputs video information selected and / or superimposed by the video superimposition unit 171. The audio output unit 176 is an audio output interface that outputs audio information output from the audio selection unit 172. As mentioned above, if the broadcast receiving device 100 is a television receiver or the like, the video output unit 175 and the audio output unit 176 are not essential components of the present invention.
[0043] The presentation synchronization control unit 181 controls the presentation synchronization on the video display unit 173 and speaker 174, or on the video output unit 175 and audio output unit 176, based on, for example, PCR information, etc., of video information and audio information obtained by decoding TS acquired from broadcast waves, video information and audio information obtained by decoding PS acquired from each server device on the Internet 200, and application execution screen information and application execution audio information output from the application engine 162.
[0044] The terminal linkage control unit 191 manages and controls the discovery and authentication of the linked device (mobile terminal device), the connection between the broadcast receiving device 100 and the linked device, and the linkage of applications when linking with an external mobile terminal device.
[0045] The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100. In this embodiment, it consists of an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The analog video / audio interface handles input of analog video / audio signals from external video / audio output devices and output of analog video / audio signals to external video / audio input devices. The USB interface connects to a PC or the like to send and receive data. An HDD may be connected to record broadcast programs and content. A keyboard or other USB device may also be connected. The memory interface connects to a memory card or other memory medium to send and receive data.
[0046] The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface unit 125 is capable of directly outputting TS acquired by the tuner / demodulation unit 131 and PS acquired by the streaming reception processing unit 151. Alternatively, the TS and PS input from the digital interface unit 125 may be controlled to be input to the first separation unit 132 and the second separation unit 152. Output of digital content stored in the storage unit 110, or storage of digital content in the storage unit 110, may be performed via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal or an HDMI terminal, and may output or input data in a format compliant with the DVI specification or HDMI specification, etc. It may also output or input data in a serial data format compliant with the IEEE1394 specification, etc.
[0047] The broadcast receiving device 100 may be a television receiver, an optical disc drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disc drive recorder such as an HDD recorder, or an STB (Set Top Box). It may also be a PC (Personal Computer), tablet terminal, or game console equipped with digital broadcast receiving and broadcast communication linkage functions. If the broadcast receiving device 100 is a DVD recorder, HDD recorder, STB, etc., the video display unit 173 and speaker 174 do not need to be provided. By connecting an external monitor and an external speaker to the video output unit 175 and audio output unit 176, the same operation as the broadcast receiving device 100 in this embodiment can be achieved.
[0048] [Software configuration of broadcast receiving equipment] Figure 2B is a software configuration diagram of the broadcast receiving device 100 in this embodiment, showing the software configuration in ROM 103, RAM 104, and storage unit 110. In this embodiment, the ROM 103 stores the basic operation program 1001 and other operation programs, and the storage unit 110 stores the reception function program 1002, BML browser program 1003, HTML browser program 1004, and other operation programs. The storage unit 110 also includes a content storage area 1011 for storing content such as video, still images, and audio, an authentication information storage area 1012 for storing authentication information used when coordinating with external mobile terminal devices, and various information storage areas for storing various other information.
[0049] The basic operation program 1001 stored in ROM 103 is loaded into RAM 104, and the main control unit 101 then executes the loaded basic operation program to constitute the basic operation execution unit 1101. Similarly, the receiving function program 1002, BML browser program 1003, and HTML browser program 1004 stored in storage unit 110 are each loaded into RAM 104, and the main control unit 101 then executes each of the loaded operation programs to constitute the receiving function execution unit 1102, the BML browser engine 1103, and the HTML browser engine 1104. Furthermore, RAM 104 includes a temporary storage area for temporarily holding data created during the execution of each operation program as needed.
[0050] For the sake of simplicity, in the following explanation, the process by which the main control unit 101 controls each operation block by loading the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing it will be described as if the basic operation execution unit 1101 controls each operation block. The same description will be applied to other operation programs.
[0051] The reception function execution unit 1102 controls each operating block of the broadcast receiving device 100 to realize broadcast reception functions and broadcast communication cooperation functions. In particular, the broadcast program playback unit 1102a mainly controls the tuner / demodulation unit 131, the first separation unit 132, the first video decoding unit 133, the first audio decoding unit 134, the first subtitle decoding unit 135, the data broadcast reception processing unit 141, and the data broadcast engine 142. Note that the data broadcast engine 142 may be replaced by the BML browser engine 1103 deployed on RAM 104. The communication content playback unit 1102b mainly controls the streaming reception processing unit 151, the second separation unit 152, the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155. The cooperation application control unit 1102c mainly controls the application control unit 161 and the application engine 162. Note that the application engine 162 may be replaced by the HTML browser engine 1104 deployed on RAM 104. The terminal linkage management unit 1102d primarily controls the terminal linkage control unit 191.
[0052] Each of the aforementioned operating programs may be pre-stored in the ROM 103 and / or storage unit 110 at the time of product shipment. Alternatively, they may be obtained after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 121. Furthermore, each of the aforementioned operating programs stored on a memory card, optical disc, etc., may be obtained via the expansion interface unit 124, etc.
[0053] [Broadcaster Server Configuration] Figure 3 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. The broadcasting station server 300 consists of a main control unit 301, a system bus 302, RAM 304, a storage unit 310, and a LAN communication unit 321.
[0054] The main control unit 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operating program. The system bus 302 is a data communication path for sending and receiving data between the main control unit 301 and each operating block within the broadcasting station server 300. The RAM 304 serves as the work area when each operating program is executed.
[0055] The storage unit 310 stores the basic operation program 3001 and the content management / distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. The video content storage area 3011 stores the video content of each broadcast program broadcast by the broadcasting station. The metadata storage area 3012 stores metadata such as the program title, program ID, program summary, cast, broadcast date and time, for each of the aforementioned broadcast programs.
[0056] Furthermore, the basic operation program 3001 and the content management / distribution program 3002 stored in the storage unit 310 are deployed to the RAM 304, and the main control unit 301 then executes the deployed basic operation program and content management / distribution program, thereby configuring the basic operation execution unit 3101 and the content management / distribution execution unit 3102.
[0057] For the sake of simplicity, in the following explanation, the process in which the main control unit 301 controls each operation block by loading the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executing it will be described as if the basic operation execution unit 3101 controls each operation block. The same description will be applied to other operation programs.
[0058] The content management / distribution execution unit 3102 manages the video content and metadata stored in the video content storage area 3011 and the metadata storage area 3012, and controls the provision of the video content and metadata to the service provider based on the contract. Furthermore, when providing the video content and metadata to the service provider, the content management / distribution execution unit 3102 also performs authentication processing of the service provider server 400 based on the contract, as necessary.
[0059] The LAN communication unit 321 is connected to the Internet 200 and communicates with service provider servers 400 and other devices on the Internet 200. The LAN communication unit 321 is equipped with encoding circuits, decoding circuits, and the like.
[0060] [Service provider server configuration] Figure 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 consists of a main control unit 401, a system bus 402, RAM 404, a storage unit 410, and a LAN communication unit 421.
[0061] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operating program. The system bus 402 is a data communication path for sending and receiving data between the main control unit 401 and each operating block within the service provider server 400. The RAM 404 serves as the work area when each operating program is executed.
[0062] The storage unit 410 stores the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003, and further includes a video content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content and metadata provided from the broadcasting station server 300, as well as content produced by the service provider and metadata related to that content. The application storage area 4013 stores applications necessary for realizing each service of the broadcast-communication cooperation system, which are distributed in response to requests from each television receiver.
[0063] Furthermore, the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003 stored in the storage unit 410 are each deployed to the RAM 404, and the main control unit 401 then executes the deployed basic operation program, the content management / distribution program, and the application management / distribution program, thereby configuring the basic operation execution unit 4101, the content management / distribution execution unit 4102, and the application management / distribution execution unit 4103.
[0064] For the sake of simplicity, in the following explanation, the process in which the main control unit 401 controls each operation block by loading the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executing it will be described as if the basic operation execution unit 4101 controls each operation block. The same description will be applied to other operation programs.
[0065] The content management / distribution execution unit 4102 acquires video content and metadata from the broadcasting station server 300, manages the video content and metadata stored in the video content storage area 4011 and the metadata storage area 4012, and controls the distribution of the video content and metadata to each television receiver. The application management / distribution execution unit 4103 manages the applications stored in the application storage area 4013 and controls the distribution of the applications to each television receiver in response to requests. Furthermore, when distributing the applications to each television receiver, the application management / distribution execution unit 4103 also performs authentication processing for each television receiver as needed.
[0066] The LAN communication unit 421 is connected to the internet 200 and communicates with the broadcasting station server 300 on the internet 200, as well as the broadcasting receiving device 100 and the mobile information terminal 700 via the router device 210. The LAN communication unit 421 shall be equipped with encoding circuits, decoding circuits, etc.
[0067] [Hardware configuration of mobile devices] Figure 5A is a block diagram showing an example of the internal configuration of the personal information terminal 700. The personal information terminal 700 consists of a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, a voice processing unit 750, and a sensor unit 760.
[0068] The main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700. The system bus 702 is a data communication path for sending and receiving data between the main control unit 701 and each operational block within the portable information terminal 700.
[0069] ROM 703 is a memory that stores basic operating programs such as the operating system and other operational programs, and a rewritable ROM such as EEPROM or flash ROM is used. RAM 704 is the work area when the basic operating programs and other operational programs are executed. ROM 703 and RAM 704 may be integrated with the main control unit 701. Also, ROM 703 may not have an independent configuration as shown in Figure 5A, but may use a portion of the storage area within the storage unit 710.
[0070] The storage unit 710 stores the operating program and settings of the personal information terminal 700, as well as the personal information terminal 700 user's personal information. It can also store operating programs downloaded from the network and various data created by said operating programs. Furthermore, it can store content such as videos, still images, and audio downloaded from the network. A portion of the storage unit 710 may replace all or part of the functions of the ROM 703. In addition, the storage unit 710 needs to retain the stored information even when the personal information terminal 700 is not supplied with external power. Therefore, devices such as flash ROM, SSD, or HDD are used.
[0071] Furthermore, the aforementioned operating programs stored in the ROM 703 and storage unit 710 can be updated and their functions expanded by downloading them from server devices on the Internet 200.
[0072] The communication processing unit 720 consists of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via a router device 210 and transmits and receives data with various server devices on the Internet 200. The connection with the router device 210 shall be made by a wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (calls) and data transmission and reception via wireless communication with a base station 600b of the mobile telephone communication network. The NFC communication unit 723 performs wireless communication when in proximity to a corresponding reader / writer. The LAN communication unit 721, the mobile telephone network communication unit 722, and the NFC communication unit 723 shall each be equipped with a coding circuit, a decoding circuit, an antenna, etc. Furthermore, the communication processing unit 720 may also be equipped with other communication units such as a Bluetooth (registered trademark) communication unit or an infrared communication unit.
[0073] The expansion interface section 724 is a group of interfaces for extending the functionality of the portable information terminal 700, and in this embodiment, it consists of a video / audio interface, a USB interface, a memory interface, etc. The video / audio interface handles the input of video / audio signals from an external video / audio output device, the output of video / audio signals to an external video / audio input device, etc. The USB interface connects to a PC or the like to send and receive data. It may also be used to connect a keyboard or other USB devices. The memory interface connects to a memory card or other memory medium to send and receive data.
[0074] The operation unit 730 is an instruction input unit that inputs operation instructions for the personal information terminal 700. In this embodiment, it consists of a touch panel 730t superimposed on the display unit 741 and an operation key 730k arranged in a row of button switches. Either one or the other may be used. The personal information terminal 700 may also be operated using a keyboard or the like connected to the expansion interface unit 724. The personal information terminal 700 may also be operated using a separate personal terminal device connected via wired or wireless communication. Furthermore, the touch panel function may be provided by the display unit 741.
[0075] The image processing unit 740 consists of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides image data processed by the image signal processing unit 742 to the user of the portable information terminal 700. The image signal processing unit 742 includes video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. The image signal processing unit 742 also has functions to perform format conversion, menu and other OSD (On Screen Display) signal superposition processing as needed. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings and objects by converting light input from a lens into electrical signals using electronic devices such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0076] The audio processing unit 750 consists of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker and provides the audio signal processed by the audio signal processing unit 752 to the user of the portable information terminal 700. The audio input unit 753 is a microphone and inputs the user's voice and other audio data by converting it into audio data.
[0077] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700. In this embodiment, it consists of a GPS receiver 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. These sensors enable the detection of the position, tilt, direction, movement, ambient brightness, proximity of surrounding objects, etc., of the portable information terminal 700. The portable information terminal 700 may also be equipped with other sensors, such as a barometric pressure sensor.
[0078] The personal digital assistant 700 may be a mobile phone, smartphone, tablet, etc. It may also be a PDA (Personal Digital Assistant) or a notebook PC. It may also be a digital still camera, a video camera capable of recording video, a portable game console, or other portable digital device.
[0079] Note that the example configuration of the portable information terminal 700 shown in Figure 5A includes many components that are not essential to this embodiment, such as the sensor unit 760, but the effectiveness of this embodiment will not be impaired even if these components are not included. Furthermore, additional components not shown, such as a digital broadcasting reception function or an electronic money payment function, may also be added.
[0080] [Software configuration of mobile devices] Figure 5B is a software configuration diagram of the portable information terminal 700 of this embodiment, showing the software configuration in the ROM 703, RAM 704, and storage unit 710. In this embodiment, the ROM 703 stores the basic operation program 7001 and other operation programs, and the storage unit 710 stores the cooperation control program 7002, the HTML browser program 7003, and other operation programs. The storage unit 710 also includes a content storage area 7011 for storing content such as video, still images, and audio, an authentication information storage area 7012 for storing authentication information used during cooperation with a television receiver, and various information storage areas for storing other various information.
[0081] The basic operation program 7001 stored in ROM 703 is loaded into RAM 704, and the main control unit 701 then executes the loaded basic operation program to constitute the basic operation execution unit 7101. Similarly, the cooperation control program 7002 and the HTML browser program 7003 stored in storage unit 710 are each loaded into RAM 704, and the main control unit 701 then executes each of the loaded operation programs to constitute the cooperation control execution unit 7102 and the HTML browser engine 7103. Furthermore, RAM 704 includes a temporary storage area for temporarily holding data created during the execution of each operation program as needed.
[0082] For the sake of simplicity, in the following explanation, the process in which the main control unit 701 controls each operation block by loading the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing it will be described as if the basic operation execution unit 7101 controls each operation block. The same description will be applied to other operation programs.
[0083] The collaborative control execution unit 7102 manages device authentication and connection, transmission and reception of various data, etc., when the mobile information terminal 700 performs collaborative operations with the television receiver. The HTML browser engine 7103 is an HTML browser that runs applications created for the broadcast-communication collaborative system on the mobile information terminal 700.
[0084] Each of the aforementioned operating programs may be pre-stored in the ROM 703 and / or storage unit 710 at the time of product shipment. Alternatively, they may be obtained after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Furthermore, each of the aforementioned operating programs stored on a memory card, optical disc, etc., may be obtained via the expansion interface unit 724, etc.
[0085] [Overview of Application Control Information (AIT)] The application control information (AIT) in this embodiment is intended to inform television receivers, etc. (in this embodiment, the broadcast receiving device 100) of the existence of applications that cooperate with broadcast services (hereinafter sometimes referred to as broadcast cooperation apps) and to instruct their control in the broadcast communication cooperation function supported by the broadcast receiving device 100. The broadcast cooperation apps may be distinguished into (1) broadcast-managed applications that operate only in a broadcast reception state based on control signals such as start / stop included in the broadcast signal and are permitted to access broadcast resources based on the control signals, (2) non-broadcast-managed applications that operate in a manner not controlled by broadcast signals such as start / stop and are permitted to access broadcast resources based on means such as application authentication, and (3) other general applications that are not permitted to access broadcast resources.
[0086] The transmission method for AIT can be either a method of transmitting AIT in section format or XML (eXtensible Markup Language) format over broadcast waves using a data carousel (DC) method, or a method of distributing the aforementioned section format or XML format AIT files from a server device on the Internet 200 using http (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure). Other methods may also be adopted.
[0087] Figure 6 is a data structure diagram showing an example of the AIT data structure. The AIT mainly consists of information such as application type 901, application identifier 902, application control code 903, application profile 904, application source information 905, application boundary and access permission settings 906, startup priority 907, cache information 908, and server access distribution parameters 909. In addition, other information may also be included.
[0088] Application type 901 defines the application description method. In this embodiment, the application description method is assumed to be HTML. Application identifier 902 is identification information for identifying application units, consisting of an organization identifier that identifies the business operator and an application identifier assigned to each business operator. An application unit is a set of HTML documents and their reference resources, with the HTML document located at the location specified in application acquisition information 905 as the entry document. Application control code 903 defines the operation control for the target application, and one of the following is described: (1) automatic startup, (2) operational, (3) termination, or (4) prefetch. Application profile 904 is a value that indicates the functions of the television receiver required by the application, and is shown by combining the functions that the television receiver has as options. The availability of the application is determined by referring to this value.
[0089] Application acquisition destination information 905 is information that identifies the acquisition destination of the application, and is location information for acquiring the HTML document that is first referenced when the application is launched. Since the application is expected to be transmitted by broadcast or reside on a server device on a communication network, the location information identified in application acquisition destination information 905 is defined to accommodate both broadcast acquisition and communication acquisition. Application boundary and access restriction settings 906 is information that indicates the scope of operation as a broadcast-managed application as a set of one or more areas (URL: Uniform Resource Locator). In addition, access restrictions to broadcast resources for each area are set on a functional basis. Application boundary and access restriction settings 906 specify the scope of document transitions to prevent unexpected document transitions or access to inappropriate broadcast resources due to chains of document transitions from the entry document when the application is launched. Furthermore, it is possible to set access permissions to specific broadcast resources on an area basis within the scope of the document transitions.
[0090] Startup priority 907 specifies which to start first when data broadcasting via broadcast services and broadcast-managed applications using HTML documents exist simultaneously. It is possible to unconditionally designate data broadcasting as the highest priority on the PMT, to specify the startup priority of a specific application type on the PMT, and to specify the startup priority of the target application using startup priority 907. Cache information 908 is information used for cache control when retaining application resources in preparation for application reuse. This information makes it possible to cache application resources for reuse even after the application has finished. Server access distribution parameters 909 are a set of parameters for distributing access in order to reduce the load on servers where access is concentrated, such as when obtaining applications. The television receiver may operate to probabilistically delay the application of application control codes according to the setting of these parameters.
[0091] The operation of the broadcast receiving device 100 in this embodiment will be described below.
[0092] [Application startup sequence] First, the startup process for the broadcast-linked application based on the AIT transmitted via broadcast waves in the broadcast receiving device 100 of this embodiment will be described. In the broadcast receiving device 100 of this embodiment, it is possible to specify which to start first when data broadcasting by broadcast services and a broadcast-linked application exist simultaneously, based on information on the PMT and information such as the AIT application control code 903 and startup priority 907.
[0093] Figure 7A is an operation sequence diagram showing an example of the operation sequence of a broadcast linkage application when it is specified that the broadcast linkage application should be launched first. This diagram shows the series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT and launches the specified broadcast linkage application.
[0094] When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs the channel selection process for the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S101) and checks the startup priority described in the PMT. If the process in S101 confirms that the startup priority of the broadcast collaboration application is high (S102), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S103) and checks the application control code 903 of the acquired AIT data sequence (S104). If the application control code 903 is "automatic startup" in the process in S104, the application profile 904 of the acquired AIT data sequence is further checked (S105), and if it is confirmed that the broadcast collaboration application specified in the AIT can be executed, a request to transmit the broadcast collaboration application is sent to a predetermined service provider server 400 via the LAN communication unit 121 based on the information described in the application acquisition destination information 905 (S106).
[0095] Upon receiving the transmission request for the broadcast collaboration application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing on the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast collaboration application stored in the application storage area 4013 via the LAN communication unit 421 (S107). Note that any known method may be used for the authentication processing, and a detailed explanation is omitted. Next, the application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161, starts the predetermined broadcast collaboration application distributed from the service provider server 400, which was received via the LAN communication unit 121 (S108).
[0096] Figure 7B is an operation sequence diagram showing an example of the operation sequence of a broadcast-linked application when it is specified to prioritize the activation of data broadcasting via broadcast services. The diagram shows the series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it activates the specified broadcast-linked application.
[0097] When the tuner / demodulation unit 131 of the broadcast receiving device 100 selects a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S201) and checks the startup priority described in the PMT. In the process of S201, it is confirmed that the startup priority of data broadcasting by the broadcast service is high (S202), and the data broadcasting reception processing unit 141 acquires the BML data sequence separated by the first separation unit 132 and plays back the BML document (S203). If automatic startup of data broadcasting is set in the BML document, and the user has requested the startup of data broadcasting using an operating terminal (portable information terminal 700, remote control, etc.) (S204), the data broadcasting engine 142 generates data broadcasting screen information by executing the played back BML document and displays it on the video display unit 173 (S205).
[0098] After processing S205, or simultaneously with processing S205, the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S206) and checks the application profile 904 of the acquired AIT data sequence (S207). If, in processing S207, it is confirmed that the broadcast-linked application specified in the AIT can be executed, an entry button for the executable broadcast-linked application is displayed on the data broadcast screen. The entry button may always be displayed, and its color scheme may be changed from an inactive color to an active color only when the broadcast-linked application can be executed. The inactive and active states of the entry button may be switched by changing its shape.
[0099] When the user selects the entry button using the operating terminal (S208), the data broadcasting engine 142 finishes the process of executing the BML document to generate data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S210) and confirms the application acquisition destination information 905 of the acquired AIT data sequence. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S210, it sends a request to transmit a broadcasting collaboration application to a predetermined service provider server 400 via the LAN communication unit 121 (S211).
[0100] Upon receiving the transmission request for the broadcast collaboration application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing for the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast collaboration application stored in the application storage area 4013 via the LAN communication unit 421 (S212). Next, the application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161, starts the predetermined broadcast collaboration application distributed from the service provider server 400, which was received via the LAN communication unit 121 (S213).
[0101] Figure 7C is an operation sequence diagram showing an example of the operation sequence of a broadcast-linked application when no priority startup is specified. This diagram shows the series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts the predetermined broadcast-linked application.
[0102] When the tuner / demodulation unit 131 of the broadcast receiving device 100 selects a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S301) and checks the startup priority described in the PMT. In the process of S301, it is confirmed that the startup priority of the broadcast link application is high (S302), and then the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S303) and checks the application control code 903 of the acquired AIT data sequence (S304). In the process of S304, if the application control code 903 is "startable" and not "automatic startup", the display of the broadcast program continues without starting either the data broadcasting by the broadcast service or the broadcast link application.
[0103] If, after the processing in S304 is completed, the user requests the activation of data broadcasting using the operating terminal (S305), the BML data column is acquired, the BML document is played back, and data broadcasting screen information is generated, similar to the processing from S205 onwards in Figure 7B (however, this is not shown). On the other hand, if, after the processing in S304 is completed, the user requests the activation of the broadcast-linked application launcher using the operating terminal (S306), the application control unit 161 acquires the AIT data column separated by the first separation unit 132 (S307) and confirms the application profile 904 of the acquired AIT data column (S308). Furthermore, the application control unit 161 displays a list of executable broadcast-linked applications on the video display unit 173 as the broadcast-linked application launcher (S309).
[0104] When a user uses an operating terminal to select a predetermined broadcast collaboration application from the broadcast collaboration application launcher displayed in S309 (S310), the application control unit 161 acquires the AIT data column separated by the first separation unit 132 (S311) and confirms the application acquisition destination information 905 of the acquired AIT data column. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S311, it sends a broadcast collaboration application transmission request to a predetermined service provider server 400 via the LAN communication unit 121 (S312).
[0105] Upon receiving the transmission request for the broadcast collaboration application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing of the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast collaboration application stored in the application storage area 4013 via the LAN communication unit 421 (S313). Next, the application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161, starts the predetermined broadcast collaboration application distributed from the service provider server 400, which was received via the LAN communication unit 121 (S314).
[0106] In addition, while the startup sequence of the broadcast-linked application described using Figures 7A to 7C all illustrate examples of acquiring the AIT from a broadcast wave, the AIT file may also be acquired from a predetermined server device specified by the PMT information description, etc. Furthermore, the acquisition of the broadcast-linked application may be performed from a broadcast wave instead of from a server device on the network (service provider server 400). That is, if the location information described in the application acquisition destination information 905 of the AIT indicates a broadcast wave, the application control unit 161 may reconstruct an HTML document from the HTML data sequence transmitted using a data carousel method, etc., and separated and output by the first separation unit 132, and the application engine 162 may execute the reconstructed HTML document (broadcast-linked application).
[0107] Furthermore, if there is no information on the PMT specifying the startup priority when data broadcasting by broadcast services and broadcast-linked applications exist simultaneously, the startup priority may be determined solely by information such as application control code 903 and startup priority 907 of the AIT. Similarly, if obtaining the aforementioned information from the PMT fails, the startup priority may be determined solely by information such as application control code 903 and startup priority 907 of the AIT. In other words, regardless of the information on the PMT, the AIT should be checked periodically, and if a broadcast-linked application specified as "automatic startup" in the AIT application control code 903 exists, the startup of the broadcast-linked application should be prioritized. If no broadcast-linked application specified as "automatic startup" in the AIT application control code 903 exists, the startup of data broadcasting by broadcast services should be prioritized.
[0108] Furthermore, if a response from the service provider server 400 is not received for a predetermined period of time when a distribution request for the broadcast-linked application is made in S106, S211, and S312, a message such as "Please wait a moment" may be displayed on the video display unit 173. Alternatively, in this case, a message asking the user whether to cancel the execution of the broadcast-linked application may be displayed.
[0109] Furthermore, it goes without saying that the launch sequence for broadcast-linked applications is not limited to the three patterns mentioned above, and that they may be launched by different sequences.
[0110] [Operation sequence when connecting mobile devices] In this embodiment, the broadcast receiving device 100 is designed to enable functional enhancement of broadcast communication services through coordinated operation between the broadcast receiving device 100 and the personal information terminal 700. For example, by installing an application (cooperation control application) provided by the television receiver manufacturer, the personal information terminal 700 can be used as a high-function remote control for the broadcast receiving device 100. Furthermore, by running the broadcast cooperation application on the personal information terminal 700, it becomes possible to display services linked to the broadcast program being displayed on the broadcast receiving device 100, for example, on the personal information terminal 700. In order to perform functional enhancement through coordinated operation between the broadcast receiving device 100 and the personal information terminal 700, it is desirable that the cooperation control application is running on the personal information terminal 700, and the broadcast cooperation application running on the personal information terminal 700 is controlled by the cooperation control application.
[0111] Figure 8A is an operation sequence diagram showing an example of the operation sequence when the aforementioned collaborative control application is launched on the personal digital assistant 700. This figure shows the sequence of events (initial) from when the personal digital assistant 700 performs authentication processing with the broadcast receiving device 100 until collaborative operation becomes possible. The collaborative control application is assumed to be pre-installed as the collaborative control program 7002 on the storage unit 710 of the personal digital assistant 700.
[0112] When a user instructs the mobile information terminal 700 to launch the linked control application (S401), the linked control execution unit 7102 of the mobile information terminal 700 searches for a television receiver on the network that can communicate (operate in a linked manner) (S402), and displays the search results as a list of television receivers on the display unit 741. If no television receiver that can communicate is found, the unit displays a message to that effect and terminates the process. When a user selects a television receiver (the broadcast receiving device 100 in this embodiment) from the list of television receivers, the linked control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. When a user enters authentication information (such as a login name and password specified by the broadcast receiving device 100) on the login screen via the operation unit 730 (S403), the linked control execution unit 7102 stores the entered authentication information in the authentication information storage area 7012 and simultaneously transmits it to the broadcast receiving device 100 (S404). The transmission of the authentication information to the broadcast receiving device 100 may be performed via the LAN communication unit 721 and the router device 210, or it may be performed directly to the broadcast receiving device 100 via the NFC communication unit 723.
[0113] The terminal linkage control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S405). If the process in S405 confirms that the received authentication information is correct, the information of the mobile information terminal 700 is stored in the authentication information storage area 1012 and the mobile information terminal 700 is authenticated (S406). The mobile information terminal 700, having been authenticated by the broadcast receiving device 100, displays the basic screen of the linkage control application (for example, the high-function remote control screen) on the display unit 741 (S407). If the received authentication information is not confirmed to be correct in S405, the terminal linkage control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. Through the above process, the broadcast receiving device 100 and the mobile information terminal 700 are in a state where linkage operation is possible.
[0114] Figure 8B is an operation sequence diagram showing an example of the operation sequence when the aforementioned collaborative control application is launched on the mobile information terminal 700. This diagram shows the series of steps (from the second time onward) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until collaborative operation becomes possible.
[0115] When a user instructs the mobile information terminal 700 to launch the linkage control application (S501), the linkage control execution unit 7102 of the mobile information terminal 700 searches for a television receiver on the network that can communicate and displays the search results as a list of television receivers on the display unit 741. If no television receiver that can communicate is found, the unit displays a message to that effect and terminates the process. When a user selects a television receiver (the broadcast receiving device 100 in this embodiment) from the list of television receivers (S502), and the selected broadcast receiving device 100 is a device that has been connected to (operated in a linkage) in the past, the linkage control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S503).
[0116] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S504). If the process in S504 confirms that the received authentication information is correct, the mobile information terminal 700 is authenticated (S505). The mobile information terminal 700, having been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control application on the display unit 741 (S506). Through the above process, the broadcast receiving device 100 and the mobile information terminal 700 are ready for cooperative operation.
[0117] Furthermore, when launching the broadcast linkage application in the broadcast receiving device 100 following the processing in Figures 8A to 8B, the processing in Figures 7A to 7C should be performed after the processing in Figures 8A to 8B.
[0118] Figure 8C is an operation sequence diagram showing an example of the operation sequence when the linked control application is launched on the mobile information terminal 700. This figure shows a series of steps (from the second time onward) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until linked operation becomes possible. However, in this figure, it is an example where the broadcast receiving device 100, which executes the launch sequence of the broadcast linked application, requests the launch of the linked control application on the mobile information terminal 700.
[0119] When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs the channel selection process for the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S601) and checks the startup priority described in the PMT. After confirming in the process of S601 that the startup priority of the broadcast linkage application is high (S602), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S603) and checks the application control code 903 of the acquired AIT data sequence (S604). In the process of S604, if the application control code 903 is "Automatic Startup", the application profile 904 of the acquired AIT data sequence is further checked (S605). In the process of S605, if it is confirmed that the broadcast collaboration application specified in the AIT can be executed, and it is determined that collaboration control of a mobile terminal device is necessary, the terminal collaboration control unit 191 refers to the authentication information storage area 1012 to select the mobile information terminal 700 as the mobile terminal device and sends a collaboration control application launch request to the selected mobile information terminal 700 (S606).
[0120] Furthermore, the selection of the portable information terminal 700 by referring to the authentication information storage area 1012 should be based on the latest information in the authentication information storage area 1012, or on the most frequently used information in the authentication information storage area 1012.
[0121] Furthermore, in the processing of S606, if a mobile terminal device to which a request to launch the linked control application should be sent cannot be found, a message indicating this may be displayed on the video display unit 173. Alternatively, in this case, a message asking the user whether to cancel the execution of the broadcast linked application may be displayed.
[0122] The main control unit 701 of the mobile information terminal 700 activates the cooperation control application (cooperation control execution unit 7102) in response to the cooperation control application activation request received via the LAN communication unit 721 (S607). Furthermore, the cooperation control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).
[0123] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S609). If the process in S609 confirms that the received authentication information is correct, the mobile information terminal 700 is authenticated (S610). The mobile information terminal 700, having been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control application on the display unit 741 (S611). Through the above process, the broadcast receiving device 100 and the mobile information terminal 700 are ready for cooperative operation.
[0124] Furthermore, if the broadcast linkage application is to be executed on both the broadcast receiving device 100 and the mobile information terminal 700 following the aforementioned process, the process shown in Figure 9 should be followed. Figure 9 is an operation sequence diagram showing an example of the startup sequence of the broadcast linkage application on the broadcast receiving device 100 and the mobile information terminal 700.
[0125] Specifically, after the processing in S601 to S611 in Figure 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data sequence separated by the first separation unit 132 (S612) and confirms the application acquisition destination information 905 of the acquired AIT data sequence. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S612, it sends a transmission request for the broadcast collaboration application (TV side) to a predetermined service provider server 400 via the LAN communication unit 121 (S613).
[0126] Upon receiving the transmission request for the broadcast collaboration application (TV side), the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing of the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast collaboration application (TV side) stored in the application storage area 4013 via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161, starts the predetermined broadcast collaboration application (TV side) that was received via the LAN communication unit 121 and distributed from the service provider server 400 (S615).
[0127] Next, the terminal linkage control unit 191 of the broadcast receiving device 100 transmits to the mobile information terminal 700 the URL information, etc., of the broadcast linkage application (terminal side) to be executed on the mobile information terminal 700, which was obtained from the broadcast linkage application (TV side) executed in AIT or S615 (S616). The linkage control execution unit 7102 of the mobile information terminal 700 transmits a request to send the broadcast linkage application (terminal side) to a predetermined service provider server 400 via the LAN communication unit 721, based on the URL information, etc., of the broadcast linkage application (terminal side) that was received via the LAN communication unit 721 (S617).
[0128] Upon receiving the transmission request for the aforementioned broadcast collaboration application (terminal side), the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing of the mobile information terminal 700 as necessary, and then distributes the predetermined broadcast collaboration application (terminal side) stored in the application storage area 4013 via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 starts the predetermined broadcast collaboration application (terminal side) distributed from the service provider server 400, which it received via the LAN communication unit 721 (S619).
[0129] The ability to obtain the AIT file from a designated server device and the ability to obtain the broadcast-linked application from the broadcast wave rather than from a server device on the network are the same as in the operation sequence in Figures 7A to 7C. When obtaining the broadcast-linked application from the broadcast wave, the broadcast receiving device 100 can obtain the broadcast-linked application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave and transfer the obtained broadcast-linked application (terminal side) to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 can obtain the broadcast-linked application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave and store it in the storage unit 110, and in the processing of S616 in Figure 9, the location information of the storage unit 110 of the broadcast receiving device 100 can be transmitted as URL information to be sent to the mobile information terminal 700. The broadcast receiving device 100 may acquire the broadcast collaboration application (TV side) from the broadcast wave, while the mobile information terminal 700 may acquire the broadcast collaboration application (terminal side) from a server device on the network. Alternatively, the mobile information terminal 700 may use its digital broadcast receiving function to acquire the broadcast collaboration application (terminal side) directly from the broadcast wave.
[0130] Furthermore, the operation sequences in Figures 7A-7C, 8A-8C, and 9 can be partially combined as appropriate, and some operation steps can be rearranged, operated simultaneously, etc., with other operation steps as appropriate.
[0131] [Basic screen of the mobile device control app] Figure 10A is a screen display diagram showing an example of the basic screen of the linked control application displayed by the processing of S407 in Figure 8A, the processing of S506 in Figure 8B, the processing of S611 in Figure 8C, etc. In this embodiment, the basic screen 741a of the linked control application is provided with the functionality of a high-function remote control corresponding to the broadcast receiving device 100.
[0132] The basic screen 741a of the linked control application, as shown in Figure 10A, consists of a power key 741a1, network selection key (terrestrial digital, BS, CS) 741a2, number keys (1-12) 741a3, volume up / down key 741a4, channel up / down key 741a5, input switching key 741a6, program guide key 741a7, data key 741a8, linked application key 741a9, menu key 741aa, back key 741ab, cursor keys (up, down, left, right) 741ac, select key 741ad, and color keys (blue, red, green, yellow) 741ae. Additional operation keys may also be displayed.
[0133] The aforementioned operation keys should have the same key layout and operation as the dedicated remote control included with the broadcast receiving device 100 for ease of use. Furthermore, the power key 741a1, network selection key 741a2, numeric key 741a3, etc., have the same functions as the operation keys on a well-known television remote control, and therefore, a detailed explanation is omitted. The linked application key 741a9 is an operation key provided for the broadcast communication linkage function of this embodiment.
[0134] Furthermore, in the processes of S204 in Figure 7B and S305 in Figure 7C, data broadcasting can be started / stopped by selecting the data key 741a8. Also, in the processes of S208 in Figure 7B and S310 in Figure 7C, the execution of the broadcast collaboration application can be selected by operating the cursor key 741ac and the select key 741ad. In addition, in the process of S306 in Figure 7C, the broadcast collaboration application launcher can be requested to be started by selecting the collaboration application key 741a9.
[0135] By providing the linked application key 741a9 or another operation key with similar functionality on the basic screen 741a of the linked control application, it becomes possible to easily select and launch each broadcast linked application used in the broadcast linked system of this embodiment. Alternatively, the linked application key 741a9 or another operation key with similar functionality may be provided on a dedicated remote control attached to the broadcast receiving device 100.
[0136] Figure 10B is a screen display diagram showing an example of the basic screen of the linked control application displayed by the processing of S407 in Figure 8A, the processing of S506 in Figure 8B, the processing of S611 in Figure 8C, etc., and is a different example from Figure 10A.
[0137] The basic screen 741b of the linked control application consists of a linked control message 741b1 and a linked control application operation screen 741b2. Other objects may also be displayed. The linked control message 741b1 is a message displayed to inform the user that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. The linked control application operation screen 741b2 is an area where the linked control application can display any screen, and a detailed explanation is omitted in this embodiment. For example, the configuration within the linked control application operation screen 741b2 may be the same as the basic screen 741a of the linked control application described above. A sub-screen of a broadcast program displayed on the broadcast receiving device 100 may also be displayed.
[0138] As shown in Figure 10B, by displaying the "Cooperation Control in Progress" message 741b1, the user of the mobile information terminal 700 can easily understand that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. Note that the "Cooperation Control in Progress" message 741b1 is not limited to text display; it may also be a symbol display, graphic display, etc. A difference in background color may also be used as a substitute for the "Cooperation Control in Progress" message 741b1.
[0139] [Data broadcasting screen on a broadcasting receiver] Figure 11 is a screen display diagram showing an example of a data broadcast screen displayed by the processing of S205 in Figure 7B. In this embodiment, it is assumed that three broadcast collaboration applications, collaboration application A, collaboration application B, and collaboration application C, are in a state where they can be executed on the broadcast receiving device 100, based on the description in AIT, etc. In this case, the entry button 173a2 for collaboration application A, the entry button 173a3 for collaboration application B, and the entry button 173a4 for collaboration application C are displayed at arbitrary positions on the data broadcast screen 173a.
[0140] In the data broadcasting screen 173a shown in Figure 11, when you select entry buttons 173a2, 173a3, 173a4, etc. using the cursor keys 741ac and select key 741ad on the basic screen 741a of the linked control application, the display of the data broadcasting screen 173a ends, and linked application A, linked application B, linked application C, etc. are launched by the control of the application control unit 161 and the application engine 162.
[0141] Furthermore, when displaying the data broadcast screen 173a, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed depending on the type of broadcast-linked application and security status. For example, if linked application A is a broadcast-managed application, the frame color of entry button 173a2 may be set to blue; if linked application B is an off-broadcast-managed application, the frame color of entry button 173a3 may be set to yellow; and if linked application C is a general application, the frame color of entry button 173a4 may be set to red. Alternatively, if linked application A is deemed to be trustworthy from a security standpoint, the frame color of entry button 173a2 may be set to blue; if linked application B is deemed not to be trustworthy from a security standpoint, the frame color of entry button 173a3 may be set to yellow; and if linked application C is deemed to be a security risk, the frame color of entry button 173a4 may be set to red.
[0142] In addition, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed depending on the function and genre of the broadcast linkage application, or depending on the expiration date of each broadcast linkage application. The frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed depending on whether or not the broadcast linkage application has already been acquired from the network. For example, if linkage application A has already been acquired from the network (cached in RAM 104 or storage unit 110), the frame color of entry button 173a2 may be set to blue; if linkage application B is being acquired, the frame color of entry button 173a3 may be set to yellow; and if linkage application C has not yet been acquired, the frame color of entry button 173a4 may be set to red.
[0143] In this way, users of the broadcast receiving device 100 can easily understand the types of broadcast-linked applications that can be run on the broadcast receiving device 100, as well as their security status.
[0144] [Broadcast receiving device's broadcast linkage app launcher screen] Figure 12A is a screen display diagram showing an example of a notification screen in the broadcast receiving device 100 of this embodiment, which informs the user that there is a broadcast linkage application that can be launched.
[0145] For example, in the operation sequence shown in Figure 7C, after processing in S304, the display of the broadcast program continues without launching either the data broadcasting service or the broadcast-linked application. On the other hand, in this case, displaying an icon 173b0 as shown in Figure 12A would improve the usability of the broadcast receiver 100, in order to let the user know that there is a broadcast-linked application that can be launched. In other words, by displaying the icon 173b0, it becomes possible to prevent the user from overlooking the existence of a broadcast-linked application that can be launched.
[0146] The icon 173b0 can be displayed anywhere on the screen, but it is desirable to place it in a location that does not interfere with viewing broadcast programs. For example, the four corners of the screen. The icon 173b0 may be a text display as shown in Figure 12A, or it may be a symbol, graphic, etc. The icon 173b0 may be displayed at all times, or it may be displayed only for a predetermined time after the power is turned on or after channel switching. Alternatively, it may be displayed simultaneously when program information or channel numbers are displayed.
[0147] Figure 12B is a screen display diagram showing an example of a broadcast linkage application launcher displayed by the processing in S306 of Figure 7C. In this embodiment, it is assumed that three broadcast linkage applications, linkage application A, linkage application B, and linkage application C, are in a state where they can be executed on the broadcast receiver 100, based on the description in AIT, etc. In this case, the broadcast linkage application launcher 173b1 is displayed at any position on the broadcast program screen 173b, and furthermore, the entry button 173b2 for linkage application A, the entry button 173b3 for linkage application B, the entry button 173b4 for linkage application C, and the back button 173b5 are displayed within the broadcast linkage application launcher 173b1.
[0148] With the broadcast collaboration application launcher 173b1 displayed as shown in Figure 12B, selecting entry buttons 173b2, 173b3, 173b4, etc. using the cursor keys 741ac and select key 741ad on the basic screen 741a of the collaboration control application will launch collaboration application A, collaboration application B, collaboration application C, etc., under the control of the application control unit 161 and the application engine 162. If the back button 173b5 is selected, the display of the broadcast collaboration application launcher 173b1 will end.
[0149] Furthermore, when displaying the broadcast-linked application launcher 173b1 on the broadcast program screen 173b, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed depending on the type and security status of the broadcast-linked application, the functions and genre of the broadcast-linked application, the status of acquisition of the broadcast application from the network, etc., just as when displaying the entry buttons for each broadcast-linked application on the data broadcast screen 173a in Figure 11.
[0150] Furthermore, if there are no broadcast-linked applications that can be run on the broadcast receiving device 100, the broadcast-linked application launcher 173b1 may be hidden. Alternatively, in this case, a message such as "No applications available" may be displayed inside the broadcast-linked application launcher 173b1.
[0151] [Screenshot of the broadcast receiving device's broadcast linkage application] Figure 13A is a screen display diagram showing an example of a broadcast collaboration application execution screen displayed in the process of S108 in Figure 7A, the process of S213 in Figure 7B, the process of S314 in Figure 7C, the process of S615 in Figure 9, etc. The broadcast collaboration application in this embodiment is equipped with graphics performance and effect performance using HTML description, and is capable of being overlaid on the broadcast program screen on the video display unit 173. For example, as shown in Figure 13A, the broadcast collaboration application unit 173c1, which displays information such as weather forecasts and news, is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. The broadcast collaboration application unit 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, and a background object 173c5, etc. Other objects may also be displayed.
[0152] With the broadcast linkage application section 173c1 overlaid on the broadcast program screen 173c, selecting the data key 741a8 on the basic screen 741a of the linkage control application will terminate the execution of the broadcast linkage application and allow the user to switch to the data broadcasting screen. Furthermore, selecting the linkage application key 741a9 on the basic screen 741a of the linkage control application will terminate the execution of the broadcast linkage application and allow the user to return to displaying only the broadcast program screen 173c. These processes may be implemented using different operation keys.
[0153] Furthermore, while the broadcast linkage application unit 173c1 is overlaid on the broadcast program screen 173c, the transparency of the broadcast linkage application unit 173c1 can be changed by operating the operation keys on the basic screen 741a of the linkage control application. The transparency change process may be performed on the entire broadcast linkage application unit 173c1 at once, or on the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5 individually. It may also be performed on a predetermined group (for example, multiple objects existing on the same graphics layer).
[0154] When performing the transparency change process, for example, an object can be selected using the cursor keys 741ac on the basic screen 741a of the linked control application, the transparency of the object can be increased using the 'blue' key of the color key 741ae, and decreased using the 'yellow' key. The transparency change process may also be performed using different operation keys. If the entire broadcast linked application unit 173c1 is set to 100% transparency, the broadcast linked application unit 173c1 can be temporarily hidden. For example, if an emergency broadcast is distributed via broadcast waves, the entire broadcast linked application unit can be set to 100% transparency, and only the broadcast program screen of the emergency broadcast can be displayed on the video display unit 173. Alternatively, a commercial detection unit (not shown) can detect when the broadcast program has changed from the main video to a commercial video and control the entire broadcast linked application unit 173c1 to 100% transparency (or a transparency that allows the video of the broadcast program to be clearly seen).
[0155] By performing the aforementioned process, it becomes possible to check the broadcast program screen in the background while the broadcast linking application is running, without having to close the broadcast linking application.
[0156] Figure 13B is a screen display diagram showing a different example of the broadcast collaboration application execution screen displayed in the process of S108 in Figure 7A, the process of S213 in Figure 7B, the process of S314 in Figure 7C, the process of S615 in Figure 9, etc. In the example shown in Figure 13B, the broadcast collaboration application section 173c6, which introduces recommended programs, is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. The broadcast collaboration application section 173c6 displays the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. Further recommended program information may be displayed by scrolling or page switching.
[0157] Each of the aforementioned recommended program information may be information about a program recommended in relation to the currently displayed broadcast program (broadcast program screen 173c), information about a program recommended based on the user's viewing history, or information about a program that is trending on the internet, etc. It may also be information about a program recommended by a friend of the user of the broadcast receiving device 100 to the user. Furthermore, the recommended program may be a program transmitted via broadcast waves of a digital broadcasting service, or a VOD (Video On Demand) program distributed from various server devices on the Internet 200, etc. It may also be an information screen such as a homepage prepared on a server device on the Internet 200.
[0158] With the broadcast linkage application unit 173c6 overlaid on the broadcast program screen 173c, by using the cursor keys 741ac and select key 741ad on the basic screen 741a of the linkage control application to select the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc., the video of each program recommended by the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc., will be displayed on the video display unit 173.
[0159] Figure 13C is a screen display diagram showing an example of when a program video recommended by the broadcast linkage application unit 173c6 is displayed. For example, if the first recommended program information 173c7 of the broadcast linkage application unit 173c6 is selected using the cursor keys 741ac and select key 741ad on the basic screen 741a of the linkage control application, the program video 173ca of the program recommended by the first recommended program information 173c7 is displayed on the video display unit 173. The program video 173ca may be paused or jumped to at a specified time by the user operating the control terminal. In addition, when displaying the program video 173ca, the original broadcast program screen 173c may be displayed in PIP (Picture In Picture) format at an arbitrary position. In this case, the user may change whether the program video 173ca of the recommended program or the original broadcast program screen 173c is the main screen by operating the control terminal. The size of the window of the original broadcast program screen 173c may also be adjustable by operating the control terminal.
[0160] Furthermore, user convenience can be improved by displaying an icon 173cb at any position on the screen indicating that the program video 173ca of the recommended program was displayed as a result of selecting any of the recommended program information displayed in the broadcast linkage application unit 173c6. Needless to say, the transparency of the broadcast linkage application unit 173c6 can also be changed in the broadcast linkage application execution screen shown in Figure 13B, as described above.
[0161] Figure 13D is a screen display diagram showing a different example of the broadcast collaboration application execution screen displayed in the processes of S108 in Figure 7A, S213 in Figure 7B, S314 in Figure 7C, S615 in Figure 9, etc. In the example shown in Figure 13D, the broadcast collaboration application section 173cc, which serves as a portal for SNS (Social Networking Service) services, is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. The broadcast collaboration application section 173cc displays entry buttons for the first SNS service 173cd, the second SNS service 173ce, the third SNS service 173cf, etc. Entry buttons for even more SNS services may be displayed by scrolling or page switching.
[0162] With the broadcast linkage application section 173cc overlaid on the broadcast program screen 173c, the user can use the cursor keys 741ac and select key 741ad on the basic screen 741a of the linkage control application to select the entry button 173cd for the first SNS service, the entry button 173ce for the second SNS service, the entry button 173cf for the third SNS service, etc., thereby activating the functions assigned to each entry button, such as the chat function, bulletin board function, and internet telephone function. This makes it possible to enjoy the broadcast program being displayed (broadcast program screen 173c) while exchanging information with others. At the same time, the basic screen 741a of the linkage control application on the mobile information terminal 700 may be changed to a text input screen such as a software keyboard, or a voice input screen for chatting or posting on a bulletin board using voice input.
[0163] Furthermore, in addition to the examples described above, the broadcast linkage application that can be executed on the broadcast receiving device 100 of this embodiment may also be one that uses the linkage function between the broadcast receiving device 100 and the mobile information terminal 700 to present related commercial applications to both the broadcast receiving device 100 and the mobile information terminal 700 in synchronization with the timing of commercial broadcasts. Alternatively, in the case of paid services available on the broadcast receiving device 100, the broadcast linkage application may check whether the user of the broadcast receiving device 100 is subscribed to a paid service, and change the display on the broadcast receiving device 100 and / or the mobile information terminal 700 according to the result. In the broadcast receiving device 100 of this embodiment, regardless of which broadcast linkage application is executed, it is possible to enjoy the effects described using Figures 13A and 13B, etc.
[0164] [Error display screen for broadcast receiving equipment] Figure 14 is a screenshot showing an example of an error display screen that may appear in the following cases: when it is determined that the broadcast-linked application cannot be executed based on the verification of the application profile 904 of the acquired AIT data column, when there is insufficient information in the AIT description, or when the acquisition of AIT fails, etc., such as during the processing of S105 in Figure 7A, the processing of S207 in Figure 7B, the processing of S308 in Figure 7C, the processing of S605 in Figure 8C, etc.
[0165] In the broadcast receiving device 100 of this embodiment, if it is determined that the broadcast linking application cannot be executed, the reason why the broadcast linking application cannot be executed, such as the result of checking the application profile 904, is displayed in the error message 173d1. For example, if the result of checking the application profile 904 is that a predetermined optional function is lacking on the television receiver side, this is displayed in the error message 173d1. The error code and a link (URL, etc.) to the television receiver manufacturer's website, which contains an explanation of the error code, may also be displayed. Alternatively, if the broadcast linking application is to be acquired over a network, the network connection status is naturally checked in advance. In this case, if the acquisition of the broadcast linking application is not possible due to, for example, a faulty LAN cable connection, this is displayed in the error message 173d1. Furthermore, even if the network connection is established, the error status is so poor that the acquisition of the broadcast linking application cannot be performed correctly, the error message 173d1 may also be displayed. The error message 173d1 may also be displayed if the acquisition of the broadcast linking application is in progress and the system is not yet in a state where the broadcast linking application can be executed. Furthermore, if the broadcast signal reception is unstable, and information such as AIT was initially received but then stopped being received midway through, it is acceptable to display error message 173d1. In such cases, if the broadcast collaboration application obtained from each server device is cached, it can be used again after the broadcast signal reception is restored.
[0166] Furthermore, if the application profile 904 check reveals that a specified optional function is missing on the television receiver side, the error message 173d1 may include a message recommending checking for or updating to the latest firmware for the television receiver. Alternatively, the broadcast receiving device 100 may automatically perform the aforementioned checking for or updating to the latest firmware. Alternatively, if the broadcast-linked application can be made executable by adding paid optional hardware or software to the television receiver, information about the paid optional hardware or software may be displayed. Note that the error message 173d1 may be displayed on the personal information terminal 700 instead of the broadcast receiving device 100.
[0167] [Screenshot of the broadcast-linked application running on a mobile device] Figure 15 is a screen display diagram showing an example of the broadcast collaboration application (terminal side) execution screen displayed in the process of S619 in Figure 9. The broadcast collaboration application execution screen 741c shown in Figure 15 consists of a main window 741c1, a sub-window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an exit button 741c7. Other objects may be added.
[0168] In this embodiment, the broadcast collaboration application (terminal side) executed on the mobile information terminal 700 is an application for checking the details of the broadcast program being displayed on the broadcast receiving device 100. The main window 741c1 displays the same video as the broadcast program screen displayed on the broadcast receiving device 100, and the sub-window 741c2 displays an enlarged video of the position specified by the selection marker 741c3. The position of the selection marker 741c3 can be changed by selecting the cursor keys 741c4 and 741c5. The explanation display unit 714c6 displays explanatory subtitles about the broadcast program being displayed in the main window 741c1, as well as comments posted by other users regarding the broadcast program. The exit button 741c7 is a button for ending the operation of the broadcast collaboration application (terminal side).
[0169] By running the aforementioned broadcast collaboration application (terminal side) on the mobile information terminal 700, it becomes possible to expand the functionality of the broadcast communication collaboration service through the collaborative operation between the broadcast receiving device 100 and the mobile information terminal 700.
[0170] [EPG screen of broadcast receiver] Figure 16A is a screen display diagram showing an example of the electronic program guide (EPG) display screen in the broadcast receiving device 100 of this embodiment. The EPG display screen 173e is a broadcast program distribution schedule for the digital broadcasting service of this embodiment, created by the main control unit 101 based on the program information data sequence output from the first separation unit 132. The EPG display screen 173e is displayed on the video display unit 173 by selecting the program guide key 741a7 on the basic screen 741a of the linked control application.
[0171] In this embodiment, the EPG display screen 173e is a matrix with the vertical axis representing time and the horizontal axis representing service ID (channel), displaying detailed information about each broadcast program broadcast on each channel during each time period. The detailed information 173e1 for each broadcast program consists mainly of a title area 173e2 and a detailed description area 173e3, as shown in Figure 16A.
[0172] The title area 173e2 displays the program title of each broadcast program and symbols representing the attributes of each broadcast program. The symbols representing the attributes of each broadcast program may be, for example, a symbol representing "New" to indicate that it is a new program, or a symbol representing "Replay" to indicate that it is a rebroadcast program. Alternatively, a symbol representing "data" to indicate that it supports data broadcasting by the broadcast service may also be used. Furthermore, if a broadcast program has a broadcast linkage application that can be run on the broadcast receiver 100 of this embodiment, a symbol representing "Linkage" to indicate this may also be used. The detail description area 173e3 displays related information such as the program content, cast, and the URL of the homepage introducing each broadcast program.
[0173] Furthermore, the symbol representing "Linkage" displayed in the title area 173e2 may not be displayed if, even if a broadcast linkage application is available for the broadcast program, the application profile 904 checks that execution on the information display device 100 is not possible. In addition, the symbol representing "Linkage" displayed in the title area 173e2, which indicates that a broadcast program has an executable broadcast linkage application available, may have its color, shape, font, etc. changed depending on whether or not it is possible to operate in conjunction with a mobile terminal device. If it is possible to operate in conjunction with a mobile terminal device, a symbol representing "Mobile" may be displayed in addition to the symbol representing "Linkage".
[0174] The presence or absence of the symbols representing "Linkage" and "Mobile" can be controlled by obtaining information that has been pre-recorded in the EIT information, which includes detailed information about each broadcast program, such as whether or not each broadcast program is a broadcast program for which a broadcast linkage application that can be executed on the broadcast receiving device 100 of this embodiment is available, and whether or not the executable broadcast linkage application can operate in cooperation with a mobile terminal device. Alternatively, the aforementioned information obtained from program distribution information of digital broadcast programs prepared on a predetermined server device on the Internet 200 may be added to an electronic program guide created based on a sequence of program information data obtained from the broadcast waves of the digital broadcasting service.
[0175] As described above, by displaying a symbol representing "Linkage," indicating that an executable broadcast linkage application is available for a broadcast program, and a symbol representing "Mobile," indicating that it can be operated in conjunction with a mobile terminal device, on the EPG display screen 173e, users can easily grasp the status of each broadcast program's support for broadcast communication linkage services in the broadcast receiving device 100. Needless to say, the symbols representing predetermined characters that indicate the attributes of each broadcast program may be replaced with the characters themselves or sentences. The support status of each broadcast program's support for broadcast communication linkage services may also be indicated by changing the background color of the detailed information 173e1 for each broadcast program. Furthermore, the symbols representing "Linkage" and "Mobile" may not normally be displayed in the title area 173e2, but may only be displayed as a pop-up when each broadcast program is selected by the program selection cursor 173e4.
[0176] The broadcast receiving device 100 of this embodiment has a function to make viewing and / or recording reservations for each broadcast program from the EPG display screen 173e. For example, with the EPG display screen 173e displayed, the program selection cursor 173e4 on the EPG display screen 173e is moved using the cursor keys 741ac on the basic screen 741a of the linked control application, and the desired broadcast program is selected using the OK key 741ad, thereby making a viewing and / or recording reservation for the selected broadcast program.
[0177] In the process described above, if the broadcast program for which viewing and / or recording reservations have been made is a broadcast program that supports the broadcast communication collaboration service, the system may use the viewing and / or recording reservation as a trigger to start acquiring the broadcast collaboration application prepared for the broadcast program without waiting for the broadcast start time. That is, the EIT information, which includes detailed information for each broadcast program, will contain information specifying the location from which to acquire the broadcast collaboration application (location information such as a URL). In this way, the broadcast receiving device 100 will be able to obtain the information on the location from which to acquire the broadcast collaboration application prepared for each broadcast program as soon as it selects the broadcast program with the program selection cursor 173e4. For this reason, the broadcast receiving device 100 will be able to start acquiring the broadcast collaboration application before the broadcast start time of the broadcast program.
[0178] Furthermore, if the broadcast program for which viewing and / or recording reservations have been made is a broadcast program that supports the broadcast-communication collaboration service and is a broadcast program that can operate in conjunction with a mobile terminal device, the broadcast collaboration application (terminal side) prepared for the mobile terminal device may also be configured to start acquiring data before the broadcast start time of the broadcast program, using the same processing as described above. In addition, as shown in Figure 16B, a two-dimensional barcode 173e5 or the like indicating the acquisition destination information (location information such as a URL) for the broadcast collaboration application (terminal side) prepared for the mobile terminal device may be displayed on the EPG display screen 173e to prompt the user to download the broadcast collaboration application (terminal side) prepared for the mobile terminal device.
[0179] In this way, if the broadcast receiving device 100 refers to the acquisition destination information for the broadcast linking application included in the EPG information and starts acquiring the broadcast linking application before the broadcast program starts, it becomes possible to distribute the load on the service provider server 400 that stores the broadcast linking application. Furthermore, even if the network communication speed between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast linking application can be effectively utilized from immediately after the broadcast program starts.
[0180] Figure 17 is an operation sequence diagram showing an example of the acquisition sequence of the broadcast-linked application when a viewing reservation and / or recording reservation for a broadcast program is made from the EPG display screen 173e.
[0181] While viewing a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires a program information data sequence output from the first separation unit 132 (S701). When the user requests the activation of the EPG screen using an operation terminal (S702), the EPG display screen 173e is displayed on the video display unit 173 (S703). When the user selects a broadcast program of their choice on the EPG display screen 173e using an operation terminal to make a viewing reservation and / or recording reservation for the broadcast program (S704), the main control unit 101 confirms the program information data sequence acquired from the first separation unit 132 (S705), and further confirms the location of the broadcast linkage application linked to the broadcast program for which the viewing reservation and / or recording reservation was made (S706).
[0182] After processing in S706, the application control unit 161 sends a request to send the broadcast collaboration application to a predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). Upon receiving the request to send the broadcast collaboration application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing of the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast collaboration application stored in the application storage area 4013 via the LAN communication unit 421 (S708). Subsequently, the application control unit 161 caches the predetermined broadcast collaboration application distributed from the service provider server 400 via the LAN communication unit 121 in the RAM 104 or storage unit 110 (S709).
[0183] According to the broadcast receiving device 100 of this embodiment described above, it becomes possible to perform functions with higher added value. [Examples]
[0184] The following describes Embodiment 2 of the present invention. Unless otherwise specified, the configuration and effects in this embodiment are the same as those in Embodiment 1. Therefore, the following will mainly describe the differences between this embodiment and Embodiment 1, and will omit explanations of common points as much as possible to avoid duplication.
[0185] Although an embodiment of the process for performing mobile information terminal linkage processing (hereinafter referred to as terminal linkage) was described in Example 1, a more detailed embodiment will be explained below.
[0186] When performing mobile device linkage, there are cases where it is desirable to restrict the use of the device linkage to only mobile devices 700 located in the same household as the broadcast receiving device 100 (hereinafter referred to as the same household restriction). For example, this may occur when the display screen of the broadcast receiving device 100 and the display screen of the mobile device 700 are closely related in an application for using broadcast linkage (hereinafter referred to as the broadcast linkage application), or when it is necessary to ensure that the user of the mobile device 700 views the advertising video displayed on the broadcast receiving device 100.
[0187] One point to consider in the procedure is whether the target broadcast-linked application imposes a same-household restriction. If it is assumed that all broadcast-linked applications have a same-household restriction, this determination is unnecessary. However, if there are cases where there is no restriction, the broadcast receiving device 100 needs to acquire control information regarding the presence or absence of the same-household restriction and change the operating procedure accordingly. This control information regarding the presence or absence of the restriction may be obtained from the broadcast signal (for example, as an item in the AIT section) or from a server designated by the broadcasting station.
[0188] In this embodiment, including the steps described above, we will explain the procedure for ensuring that the portable information terminal 700 is located in the same house as the broadcast receiving device 100.
[0189] Typically, devices located within the same household are on the same local network connected to the same router device 210. Therefore, since the portable information terminal 700 is connected to the same local network as the broadcast receiving device 100, it can be determined that they are located within the same household. Note that determining whether a device is connected to the local network can be done using a well-known method, and therefore, an explanation is omitted.
[0190] Furthermore, even if the mobile information terminal 700 is not on the local network, it can be determined to be in the same house by communicating directly with the broadcast receiving device 100 using NFC, Bluetooth, infrared communication, etc. In this case, communication for obtaining broadcast linkage applications, etc., may be done via the direct communication described above, or via mobile telephone communication.
[0191] As described above, there are several ways to confirm that the devices are located within the same house, but which method to use is described, for example, in the AIT (Automatic Information Terminal) and read by the broadcast receiving device 100.
[0192] Furthermore, once it is confirmed that a mobile information terminal 700 is present in the same household, it may be assumed to be present in the same household until the program ends. Alternatively, a certain validity period (for example, 10 minutes) can be set, during which the device is assumed to be present in the same household. After the validity period has expired, it will not be assumed to be present in the same household unless it is reconfirmed. This validity period can be written to, for example, the AIT and read by the broadcast receiving device 100.
[0193] Furthermore, it is also possible to set an event signal in the broadcast signal at any point during the program, and each time this event signal is received, it is confirmed that the mobile information terminal 700 is in the same house.
[0194] Furthermore, it is also possible to combine the two methods mentioned above.
[0195] Next, we will explain the specific procedure for allowing terminal linking only to the mobile information terminal 700 located within the same household. In this embodiment, restrictions are placed on when the mobile information terminal 700 acquires the broadcast linking application or acquires information used by the broadcast linking application (hereafter, the broadcast linking application and the information used by the broadcast linking application, specifically HTML documents and streaming video, will be collectively referred to as broadcast linking information). There are two methods for acquiring broadcast linking information: communication acquisition, which is acquired from the broadcast station server 300 or the carrier server 400, and broadcast acquisition, which is acquired from the broadcast wave. In the case of communication acquisition, there are two methods: acquiring after the start of broadcast reception and acquiring before the start of broadcast reception. Furthermore, in the case of communication acquisition, there are two cases: one in which the broadcast receiving device 100 acquires the information first and then the mobile information terminal 700 acquires it from the broadcast receiving device 100, and another in which the mobile information terminal 700 directly acquires the information from the broadcast station server 300 or the carrier server 400. Although there are various methods, from the perspective of the mobile information terminal 700, they can be broadly divided into two categories: acquiring data from the broadcast receiving device 100, and acquiring data from the broadcasting station server 300 or the carrier server 400.
[0196] This embodiment describes the case in which the mobile information terminal 700 acquires broadcast coordination information from the broadcast receiving device 100, while the case in which it acquires information from a server will be described in the next embodiment.
[0197] Figure 18A shows the procedure for this embodiment.
[0198] First, before performing terminal linking, the linking control application, which controls terminal linking, is launched on both the mobile information terminal 700 and the broadcast receiving device 100 (S10001, S10002). In this state, the mobile information terminal 700 sends a terminal linking request to the broadcast receiving device 100 (S10003). Next, the AIT is obtained from the broadcast signal (S10004). From this AIT information, it is determined whether the application for the target mobile information terminal has a same-house restriction (S10006). If there is a restriction, the process proceeds to step S10008. In the initial stage of the terminal linking request, the process proceeds to step S10009, where it is determined whether the mobile information terminal 700 that made the terminal linking request is in the same house as the broadcast receiving device 100 (S10009). If the result of the determination is that they are not in the same house, a response of "linking denied" is sent to the linking control application on the mobile information terminal side, and the process ends (S10011).
[0199] Here, assuming that all broadcast-linked apps have a same-house restriction, the S10006 check is skipped. The S10006 check is performed only when there is a possibility that some apps have a same-house restriction and others do not.
[0200] If it is determined that the mobile information terminal 700 is in the same household, or if the application does not have a same-house restriction, the process proceeds to S10012, and broadcast-linked application-related services are performed. In this service (S10012), the broadcast-linked information distribution request (S10013) from the mobile information terminal 700 is processed, and the broadcast-linked information is distributed to the mobile information terminal 700 (S10018). This broadcast-linked information includes information received by the broadcast receiving device 100 from the distribution server, which is the carrier server 300 (S10014, S10015, S10016), information obtained from broadcast signals (S10017), and information stored in the broadcast receiving device 100. The reception of broadcast coordination information by the broadcast receiving device 100 (S10016, S10017) may not only occur in response to a broadcast coordination information distribution request from the mobile information terminal 700 (S10013), but may also occur autonomously by the broadcast receiving device 100 or based on an event occurring from a broadcast signal. Furthermore, the distribution of broadcast coordination information to the mobile information terminal 700 (S10018) may also occur spontaneously from the broadcast receiving device 100.
[0201] After the processing of receiving (acquiring) and distributing a series of broadcast coordination information is completed, it is determined whether the broadcast receiving device 100 is continuing to watch the same program (S10019). If it is not continuing, a response of "cooperation denied" is sent to the coordination control application on the mobile information terminal, and the process is terminated (S10020).
[0202] If viewing continues, the procedure returns to S10005, and if there are home restrictions, it is checked whether the mobile information terminal 700 is in the same home (S10009). It is then determined whether a pre-set validity period has elapsed since the last check, or whether a confirmation request (S10007) has been generated from the broadcast signal or distribution server since the last check (S10008). If neither condition is met, the check to see if it is in the same home (S10009) is not performed, and the process proceeds via S10010 to the execution of the next broadcast-linked application-related service (S10012). Here, it is stated that the confirmation request from the broadcast signal (S10007) should be obtained from the broadcast-linked information, but here it is stated that event messages are also included in the broadcast-linked information. Furthermore, this confirmation request may also be written to the AIT.
[0203] The procedure described above is a loop processing procedure for the entire system, including the broadcast signal, the broadcast receiving device 100, the mobile information terminal 700, and the distribution server, within the section indicated by the arrow in S10022. The confirmation request in S10007 can be made at any point within the loop.
[0204] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication on the distribution server (S10015). This allows for confirmation that the authentication request is legitimate. Additionally, by changing the authentication information described in the AIT as the program progresses, and by requiring the distribution server to only perform authentication with an authentication key that incorporates information synchronized with the program's progress, it is possible to confirm that the user is continuously watching the same program. In this case, the information in the AIT will be read and updated as needed (S10021). Note that the authentication information to be incorporated into the broadcast signal may be included not only in the AIT but also as broadcast linkage information. Furthermore, as a method that effectively changes the authentication information, it is also possible to change the URL of the distribution server itself according to the program's progress.
[0205] In this way, while running the broadcast-linked application-related service (S10012), the mobile information terminal 700 can be checked to see if it is in the same premises as the broadcast receiving device 100 at pre-set valid intervals, or each time there is a broadcast signal or a verification request from the distribution server, thereby enabling the appropriate execution of broadcast-related applications that are restricted to use within the same premises. Furthermore, by using the authentication information embedded in the broadcast signal for authentication at the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information in the broadcast signal, it is also possible to confirm that the user is continuously watching the same program.
[0206] According to the mobile information terminal linkage technology of this embodiment described above, it becomes possible to implement same-house restriction for mobile information terminals linked with broadcast receiving equipment. [Examples]
[0207] This embodiment describes a case in which the mobile information terminal 700 obtains broadcast coordination information from the distribution server.
[0208] Figure 18B shows the procedure for this embodiment.
[0209] First, before performing terminal linking, the linking control application, which controls terminal linking, is launched on both the mobile information terminal 700 and the broadcast receiving device 100 (S10101, S10102). In this state, the mobile information terminal 700 sends a terminal linking request to the broadcast receiving device 100 (S10103). Next, the AIT is obtained from the broadcast signal (S10104). Information such as the URL of the distribution server is obtained from this AIT information and sent to the mobile information terminal 700 (S10105). Next, the broadcast receiving device 100 sends a time confirmation request to the distribution server (S10106), and based on this request, the distribution server sends time information to the broadcast receiving device 100 (S10107). This allows the subsequent authentication key issuance (S10115) to be performed in accordance with the time of the distribution server, but this step can be omitted if the time difference is not a problem.
[0210] From this point onward, the system enters loop control, as indicated by the arrow in S10127.
[0211] First, the mobile information terminal 700 sends a request to the broadcast receiving device 100 for the issuance of an authentication key or for the distribution of broadcast collaboration information (S10109). The authentication key is used in the subsequent request for the distribution of broadcast collaboration information to the distribution server (S10125). The broadcast collaboration distribution request in S10109 is a request for the distribution of information obtained from the broadcast signal and corresponds to the procedure in the subsequent S10126.
[0212] In any case, when the request S10109 is issued from a mobile device, it is determined whether the broadcast linking app has a same-house restriction (S10111). If there is a restriction, the process proceeds to the next step S10112; otherwise, the procedure for S10112 is skipped and the process proceeds to S10114. If all broadcast linking apps have a same-house restriction, the determination in S10111 is not performed, and the process proceeds to S10112. In S10112, it is determined whether the mobile device that made the request is in the same house. If not, the terminal linking is terminated (S10113). If it is in the same house, the requested procedure is performed: obtaining broadcast linking information from the distribution server (S10125) or obtaining broadcast linking information from the broadcast signal (S10126). Since it is also acceptable to obtain information from the broadcast signal in addition to obtaining it from the distribution server, the procedure for S10126 is also described.
[0213] First, I will explain the procedure for obtaining broadcast coordination information from the distribution server (S10125).
[0214] First, the broadcast receiver 100 issues the authentication key requested by the information sharing terminal 700. At this time, the authentication key, including the time information at the time of issuance, is valid only for a predetermined period of time (for example, 10 minutes). The distribution server checks the authentication information, including whether the authentication key is valid within the validity period, and if authentication is OK, it permits the distribution of broadcast sharing information. Subsequently, information distribution is permitted as long as the validity period is active, but distribution stops when the validity period expires. For example, streaming video will no longer be viewable after the validity period has expired.
[0215] The pre-set validity period may be stored on the distribution server, or the broadcast receiving device 100 may obtain it from the broadcast signal (e.g., AIT) and incorporate the validity period information into the authentication key. The personal information terminal 700 may be notified of the validity period in advance and requested to issue an authentication key before the validity period expires. Alternatively, the validity period may be managed by the broadcast receiving device 100, and before the validity period expires, the broadcast receiving device 100 may automatically issue an authentication key to the personal information terminal 700 after confirming that the personal information terminal 700 is in the same house.
[0216] The validity period can be the same throughout a program, or it can change according to the program's progress. Alternatively, if no validity period is set, authentication can remain valid for the duration of program viewing after the initial authentication.
[0217] Furthermore, the authentication information written in the AIT may be incorporated into the authentication key used for authentication on the distribution server (S10117). This allows for confirmation that the authentication request is legitimate. Additionally, by changing the authentication information written in the AIT as the program progresses, and by requiring the distribution server to only perform authentication with an authentication key that incorporates information synchronized with the program's progress, it is possible to confirm that the user is continuously watching the same program. In this case, the information in the AIT will be read and updated as needed (S10124). Note that the authentication information to be incorporated into the broadcast signal may be included not only in the AIT but also as broadcast linkage information. Furthermore, as a method that effectively changes the authentication information, it is also possible to change the URL of the distribution server itself according to the progress of the program. Note that in this case, the URL change is for cases where the distribution server is the same but the entry point is different, but it is also possible to change to a new distribution server due to changes in the broadcast linkage application, etc. In this case, the procedures of sending distribution server information (S10105), requesting time confirmation (S10106), and sending time information (S10107) are performed each time a change is made.
[0218] Next, we will explain the procedure for obtaining broadcast coordination information from the broadcast signal (S10126).
[0219] In this case, after it is confirmed that the mobile information terminal 700 is located in the same house, the broadcast receiving device 100 acquires broadcast coordination information from the broadcast signal (S10119), and then distributes that information to the mobile information terminal 700 (S10120).
[0220] Furthermore, if the broadcast coordination information is changed in accordance with the progress of the program, a notification of the change may be issued from the broadcast signal (S10110), and the broadcast coordination information may be acquired as a result of that notification. In that case, if the information is acquired from the distribution server, the broadcast receiving device 100 issues an authentication key to the mobile information terminal (S10115) and notifies it that a change notification has been received. If it is within the validity period, the issuance of the authentication key may be omitted, and only the change notification may be sent. If the information is acquired from the broadcast signal, the broadcast receiving device 100 acquires the information (S10119) and distributes it to the mobile information terminal (S10120). Furthermore, if the information is acquired from the broadcast signal, it may be confirmed that the mobile information terminal 700 is in the same house for each change notification, or, as in Example 2, this confirmation may be omitted if it is within the validity period. Here, it is written that the change notification from the broadcast signal (S10110) is acquired from the broadcast coordination information, but here it is written that event messages are also included in the broadcast coordination information. Furthermore, this change notification may also be included in the AIT.
[0221] After the processing of receiving (acquiring) and distributing a series of broadcast coordination information is completed, it is determined whether the broadcast receiving device 100 is continuing to watch the same program (S10121). If it is not continuing, a response of "cooperation denied" is sent to the coordination control application on the mobile information terminal, and the process is terminated (S10123). If it is continuing to watch, the process returns to S10108 and the loop processing S10127 continues.
[0222] In this way, by including time information in the authentication key used for authentication on the distribution server and managing its validity period, it is possible to periodically confirm that the mobile information terminal 700 is in the same premises as the broadcast receiving device 100, and to appropriately execute broadcast-linked applications that have same-premises restrictions. Furthermore, by using the authentication information embedded in the broadcast signal for authentication on the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information in the broadcast signal, it is also possible to confirm that the same program is being viewed continuously.
[0223] According to the mobile information terminal linkage technology of this embodiment described above, even when a mobile information terminal linked with a broadcast receiving device obtains broadcast linkage information from a distribution server, it becomes possible to achieve same-household restriction. [Examples]
[0224] Examples 2 and 3 described the procedure for achieving in-home restriction in terminal linking, but some broadcast linking apps may also allow use from outside the home. This example describes such a case. For example, if the program itself, such as a TV shopping program, serves as publicity and advertising, it is desirable for the broadcaster to allow the broadcast linking app to be used regardless of whether the user is inside or outside the home. In the case of such a program, once registered with the broadcast receiving device 100, the use of the broadcast linking app may be permitted regardless of whether the mobile information terminal 700 is inside the home. In this case, the convenience is further enhanced if the broadcast linking app converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the internet. The streaming data may be encrypted by the broadcast receiving device 100 for copyright protection. Whether the broadcast linking app allows use from outside the home, including the distribution of broadcast video outside the home, is indicated in the data within the broadcast signal (e.g., AIT).
[0225] The specific procedure is shown in Figure 18C. Since some of the steps are the same as those in Examples 2 and 3, the explanation of the parts that overlap with Examples 2 and 3 will be omitted. When the broadcast receiving device 100 receives a terminal linkage request from outside the home (S10203), if the application is permitted for use outside the home, it will verify that the requesting party is a registered mobile information terminal (S10205) and then grant the linkage. If necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving device 100 to protect the copyright of the broadcast video and broadcast linkage information (S10207). In this case, the authentication may also be performed on the distribution server (S10207). Information on whether copyright protection is necessary and information on the method of authentication for copyright protection are obtained from the broadcast signal (for example, as described in the AIT), and control is performed accordingly. If this information is not stored in the broadcast signal, the broadcast receiving device 100 will follow a predetermined method. For example, it may perform a predetermined copyright protection process. Furthermore, if this information is not stored in the broadcast signal, it may be predetermined that the broadcast receiving device 100 will not perform copyright protection processing.
[0226] The following are specific examples of authentication for copyright protection. Each of the following authentications may be performed individually, or a combination of the authentications exemplified below may be used. Furthermore, the authentications exemplified below may be combined with other authentication processes not exemplified below.
[0227] [Authentication using ID and password] When registering the personal information terminal 700 with the broadcast receiving device 100, an ID and password are issued, and the broadcast receiving device 100 authorizes the connection by verifying this ID and password.
[0228] [Using encryption keys] In addition to authentication using the above ID and password, the broadcast receiving device 100 transmits an encryption key for decrypting encrypted video data, etc., to the mobile information terminal. This encryption key may also be obtained from the broadcast signal (for example, recorded in the AIT).
[0229] [Using a distribution server] This method involves the distribution server issuing an encryption key for decrypting encrypted video data, etc. The personal digital assistant (PDTA) 700 sends an ID and password to the distribution server to obtain the encryption key. In this case, security is enhanced by obtaining the distribution server's location information (specifically, the URL) from the broadcast signal (for example, recorded in the AIT), and transmitting this location information from the broadcast receiving device 100 to the PDTA 700. Since the PDTA 700 cannot decrypt the video, etc., if it cannot obtain the encryption key, the broadcast receiving device 100 may request authentication from the distribution server to protect copyright, or the PDTA 700 may notify the broadcast receiving device 100 that it has obtained the encryption key to complete the authentication. The distribution server may charge a fee.
[0230] [Mutual authentication of encryption keys] Copyright protection is authenticated by mutually authenticating and verifying the encryption keys held by the broadcast receiving device 100 and the portable information terminal 700.
[0231] If the information stored in the broadcast signal indicates that copyright protection is required by a predetermined method, and copyright protection cannot be authenticated by that predetermined method, terminal connection will not be permitted. Furthermore, even if there is no specification in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100, terminal connection will not be permitted if copyright protection cannot be authenticated by that default method.
[0232] If terminal linking is permitted, the system will no longer check whether the mobile information terminal 700 is located within the same household. Instead, it will distribute broadcast linking information to the mobile information terminal 700 (S10217) and issue an authentication key for the distribution server (S10212) in accordance with requests from the mobile information terminal 700 (S10211), autonomous control of the broadcast receiving device 100, and requests from the broadcast signal (S10210). In this case, it is not necessary to set an effective time limit for control. A mobile information terminal 700 located outside the household will obtain broadcast linking information from the broadcast receiving device 100 or from the distribution server using the issued authentication key (S10215). Furthermore, if the authentication information obtained from the broadcast signal (for example, as described in the AIT) is incorporated into the authentication key issued by the broadcast receiving device 100, and the distribution server is allowed access only if the authentication key incorporates the authentication information obtained from the broadcast signal, the system can further optimize use outside the household.
[0233] Furthermore, in cases where a discount is offered as a premium for watching a program, it may be better not to allow unlimited use of the broadcast-linked app. In such cases, it is preferable to perform authentication once while the mobile device is in the same household, and then allow use of the distribution server even if it is not in the same household. In this case, it is not necessary for the mobile device 700 to be registered with the broadcast receiving device 100.
[0234] The specific procedure in this case is shown in Figure 18D. Since some of the steps are the same as those in Figure 18C above, the explanation of the overlapping parts will be omitted. First, with the mobile information terminal 700 in the same house as the broadcast receiving device 100, the mobile information terminal 700 makes a terminal linkage request to the broadcast receiving device 100, and the broadcast receiving device 100 confirms that the mobile information terminal 700 is in the same house (S10305) and then grants the linkage. Here, if necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving device 100 to protect the copyright of the broadcast video and broadcast linkage information (S10307). In this case, the authentication may be performed by an external distribution server. Information on whether copyright protection is necessary and information on the method of authentication for copyright protection are obtained from the broadcast signal (for example, as described in the AIT), and control is performed accordingly. If this information is not stored in the broadcast signal, the broadcast receiving device 100 follows a predetermined method. For example, it may perform a predetermined copyright protection process. Furthermore, if this information is not stored in the broadcast signal, it may be predetermined that the broadcast receiving device 100 will not perform copyright protection processing.
[0235] The following are specific examples of authentication for copyright protection. Each of the following authentications may be performed individually, or a combination of the authentications exemplified below may be used. Furthermore, the authentications exemplified below may be combined with other authentication processes not exemplified below.
[0236] [Using encryption keys] When the mobile information terminal 700 is in the same house, the broadcast receiving device 100 transmits an encryption key for decrypting encrypted video data, etc., to the mobile information terminal. This encryption key may also be obtained from the broadcast signal (for example, recorded in the AIT). Authentication is performed by handing over this encryption key within the same house. Furthermore, by making it so that the encryption key can only be obtained from the broadcast signal at a certain point in the program, and limiting the handover of the encryption key to the mobile information terminal 700 to within the same house, a restriction can be imposed that viewers must be in the same house at that time, which can also be used to add a premium for viewing.
[0237] [Using a distribution server] This method involves the distribution server issuing an encryption key for decrypting encrypted video data, etc. The personal digital assistant (PDTA) 700 sends an ID and password to the distribution server to obtain the encryption key. In this case, security is enhanced by obtaining the distribution server's location information (specifically, the URL) from the broadcast signal (for example, recorded in the AIT), and transmitting this location information from the broadcast receiving device 100 to the PDTA 700. Since the PDTA 700 cannot decrypt the video, etc., if it cannot obtain the encryption key, the broadcast receiving device 100 can request authentication from the distribution server to protect copyright, or the PDTA 700 can notify the broadcast receiving device 100 that it has obtained the encryption key to complete the authentication. Access to the distribution server can be done both inside and outside the home, but by making it so that the distribution server's location information can only be obtained from the broadcast signal at a certain point in the program, and limiting the transfer of location information to the PDTA 700 to within the same home, a restriction can be imposed that the user must be in the same home at that time, which can also be used to add a premium for viewing. The distribution server may also charge for viewing.
[0238] [Mutual authentication of encryption keys] Copyright protection is authenticated by mutually authenticating and verifying the encryption keys held by the broadcast receiving device 100 and the portable information terminal 700. This authentication can be performed either inside or outside the home.
[0239] If the information stored in the broadcast signal indicates that copyright protection is required by a predetermined method, and copyright protection cannot be authenticated by that predetermined method, terminal connection will not be permitted. Furthermore, even if there is no specification in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100, terminal connection will not be permitted if copyright protection cannot be authenticated by that default method. The procedure after terminal connection is permitted is the same as the procedure in Figure 18C, so the explanation will be omitted.
[0240] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use from outside the home while paying attention to copyright protection for the mobile information terminal that cooperates with the broadcast receiving device.
Embodiment
[0241] In actual usage, it is more desirable to easily know whether there is a terminal cooperation app for a program and which terminal cooperation app is available. In this embodiment, a method for displaying the availability status of the terminal cooperation app will be described. The terminal cooperation app refers to a broadcast cooperation app used for terminal cooperation.
[0242] FIG. 19A is an example of a launcher screen (173b11) of the broadcast cooperation app when there is a terminal cooperation app. The broadcast cooperation app is displayed as an icon with framed text. Broadcast cooperation apps (173b12 to 173b14) for the broadcast receiving device 100 linked to the program being viewed and broadcast cooperation apps (173b15 to 173b17) for the mobile information terminal are displayed. In this example, the status of the app is indicated by the thickness of the frame line surrounding the string and the color inside the frame. The main body apps A and B (173b12, 173b13) and the terminal apps A and B (173b15, 173b16) are available, and the main body app C (173b14) and the terminal app C (173b17) are unavailable. The state where the terminal app is unavailable means that among the mobile information terminals 700 that are in a state where they can communicate with the broadcast receiving device 100, there is no device having the function of executing the app.
[0243] FIG. 19B is a screen after selecting the terminal app A in FIG. 19A. It shows the status of each mobile information terminal 700 regarding the terminal app A. The mobile information terminals displayed on this screen are those that have previously cooperated with or been registered with the broadcast receiving device 100.
[0244] The solid outlines on the icons of mobile terminals 1 (173b22) and 2 (173b23) indicate that they are in a state where they can communicate with the broadcast receiving device 100, while the dotted outlines on the icons of mobile terminals 3 (173b24) and 4 (173b25) indicate that they are not in a state where they can communicate with the broadcast receiving device 100. Furthermore, the white outlines on the icons of mobile terminals 1 (173b22) and 3 (173b24) indicate that they have the function to run terminal application A, while the gray outlines on the icons of mobile terminals 2 (173b23) and 4 (173b25) indicate that they do not have the function to run terminal application A. In addition, if an application is already running on the terminal, an icon with a design that indicates this may be used.
[0245] Additionally, icons are more visually understandable when they use images, so an example is shown below.
[0246] Figure 19C is an example of a launcher screen (173b31) showing a list of broadcast-linked applications. Icons are shown for each type of mobile information terminal 700, in addition to the broadcast receiving device 100. Icons 173b32 and 173b33 represent the broadcast receiving device 100, icons 173b34 and 173b35 represent smartphone-type mobile information terminals 700, and icon 173b36 represents head-mounted display-type mobile information terminals 700. Each application is for the device indicated by the icon.
[0247] In Figure 19C, if the application is unavailable, a mark indicating its unavailability (in this case, a circle with a diagonal line) is displayed over the image of the device. Furthermore, for the broadcast receiving device 100, if the application is already running, a mark indicating this (in this case, a circle with a dot) may be displayed over it. This display prevents unnecessary actions such as proceeding with the launcher procedure even though the application is already running. For the personal digital assistant 700, it is also possible to display a mark indicating that the application is running on all terminals that are able to communicate with the broadcast receiving device and are capable of running the application.
[0248] Figure 19D is the screen (173b41) after selecting application C (173b34) in Figure 19C. It shows the status of the type of mobile information terminal 700 that corresponds to application C. On this screen, if the mobile information terminal 700 does not have the function to execute broadcast-linked applications, is not in a state where it can communicate with the broadcast receiving device 100, or is already running the broadcast-linked application, a mark indicating these conditions is displayed over the icon. In this example, a circle with a diagonal line is displayed if the application does not have the execution function (173b44, 173b46), a triangle with an exclamation mark is displayed if it is not in a state where it can communicate (173b45, 173b46), and a circle with a dot is displayed if it is already running (173b43).
[0249] Furthermore, it would be desirable to have a way to indicate the presence of a broadcast-linked app when the situation changes, without having to launch the launcher every time. For example, when the power is turned on, when the channel is changed, when there is a change in the broadcast-linked app at the beginning of a program, or even in the middle of a program, when there is a change in the communication status between the broadcast receiving device 100 and the mobile information terminal 700, or when the execution status of the app changes, an icon should be displayed for a predetermined time and the status at that time should be shown.
[0250] Figure 19E shows an example of this case. If an icon indicating the type of device is displayed, it means that there is a broadcast-linked application that corresponds to that type of device. In this case, a circle with a diagonal line indicates that there are no available devices of that type that can run the application. A circle with a dot indicates that the application is running on all available devices of that type.
[0251] Figure 19F shows the display screen (10401) on the mobile information terminal 700. When requesting terminal linkage from the mobile information terminal 700, it is convenient to know in a list which broadcast linkage app is available on which broadcast receiving device 100. Figure 19F shows an example of such a list (10402). This table shows which broadcast receiving device 100 in the home is available with the broadcast linkage app corresponding to the program to be checked. Displaying the status of each broadcast receiving device 100 would further enhance convenience, especially when using it from outside the home. In this example, examples of displays include: receiving the program, receiving another program, available, and another program scheduled (when recording of another program is scheduled from the middle of the program). Furthermore, if there are multiple tuners in the broadcast receiving device 100, it would be even more convenient if the status of each tuner were displayed. In Table 10202, the sub-numbers indicate the distinction between tuners within the same device. For example, receiving devices B-1 and B-2 are tuners within the same broadcast receiving device 100. In the case of terminal linkage, if broadcast video and audio can be received as streaming data, there is no need to use the video unit of the broadcast receiving device 100. Broadcasting can be used as long as the tuners within the broadcast receiving device 100 are available, so it is convenient to know the usage status of each tuner.
[0252] Furthermore, in order to perform the display described in this embodiment, each broadcast-linked application must have information indicating whether it is an application compatible with the broadcast receiving device 100, or what type of mobile information terminal 700 it is compatible with. In addition, information is required for the broadcast receiving device 100 and the mobile information terminal 700 to run the compatible application. This information can be obtained by the broadcast receiving device 100 by, for example, recording it in the AIT.
[0253] According to the mobile information terminal linkage technology of this embodiment described above, by displaying information related to the broadcast linkage application, the broadcast receiving device 100, and the mobile information terminal 700, it becomes possible to use broadcast linkage services with greater convenience. [Examples]
[0254] In the following examples 6 to 10, the broadcast receiving device 100 will be referred to as an information display device.
[0255] First, Example 6 will be described using Figures 2C, 2D, and 20-24. Unless otherwise specified, the configuration and effects of Example 6 are the same as those of Example 1. Therefore, the following will mainly describe the differences between Example 6 and Example 1, and will omit explanations of common points as much as possible.
[0256] In Examples 1 to 5, only one broadcast program is displayed on the broadcast receiving device 100. On the other hand, in Example 6, multiple broadcast programs are displayed on the information display device.
[0257] [Hardware configuration of information display devices] Figure 2C is a block diagram of the information display device 1000 according to Embodiment 6. As shown in Figure 2C, the information display device 1000 includes a video display unit 173, a video output unit 175, an audio playback unit 174b, an audio output unit 176, a viewer instruction input unit 25001 (described later, Figure 2D), a content input unit 25002, a content playback unit 25003, a content recording and playback unit 25004, and a control unit 25005.
[0258] The viewer instruction input unit 25001 receives instruction information received from the viewer by a device (for example, a remote control (described later, Figure 22A)).
[0259] The content input unit 25002 acquires content (for example, broadcast content, internet content, recorded content). Specifically, the content input unit 25002 includes a tuner / demodulation unit 131 (described above, Figure 2A) for receiving broadcast content, a LAN communication unit 121 (described above, Figure 2A) for acquiring internet content, and an expansion interface unit 124 (described above, Figure 2A) or digital interface unit 125 (described above, Figure 2A) for inputting recorded content from an external content playback device, etc.
[0260] The content playback unit 25003 plays back the recorded content. Specifically, the content playback unit 25003 is the storage unit 110 (described above, Figure 2A). Also specifically, the storage unit 110 is a drive for an optical disk recording medium or the like.
[0261] The content recording and playback unit 25004 records / plays back content (in the case of content on the Internet, records / reads). Specifically, the content recording and playback unit 25004 is the storage unit 110 (described above, Figure 2A), the RAM 104 (described above, Figure 2A), etc.
[0262] The control unit 25005 is a set of control units including the main control unit 101 (described above, Figure 2A).
[0263] The control unit 25005 outputs video information for displaying a main window on which main content, which is the main video of a broadcast program, is displayed, and a sub-window for displaying sub-content included in the execution screen of a broadcast-linked application that is linked to the broadcast program, to the video output unit 175. The video output unit 175 outputs the video information output from the control unit 25005 to an external display device (such as a display).
[0264] Also, the control unit 25005 causes the main window and the sub-window to be displayed on the video display unit 173. Note that on the execution screen of the broadcast-linked application, information associated with the main video of the broadcast program (for example, weather forecasts, responses from viewers of the broadcast program, profiles of the performers in the broadcast program, etc.) is displayed. For example, when the broadcast program is a marathon broadcast, in the main window, video from the relay (for example, video of a runner near the front) is displayed, and in the sub-window, video of a runner running at a position away from the front is displayed.
[0265] Also, the control unit 25005 controls the display of the window group displayed on the video display unit 173. Also, the control unit 25005 controls the audio playback unit 174b and the audio output unit 176.
[0266] The audio playback unit 174b plays sound. Specifically, the audio playback unit 174b is the speaker 174 (described above, Figure 2A). The audio playback unit 174b also includes earphones.
[0267] The audio output unit 176 outputs audio information. For example, the audio output unit 176 outputs audio information (audio signals) to an external output device (such as a speaker). In the following explanation, in order to distinguish it from the case where audio information (audio signals) is output from the audio output unit 176, the case where audio is output from the audio playback unit 174b will be referred to as audio playback.
[0268] The video display unit 173 displays the main window based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (window-related specification information is a general term for window-related specification information such as window shape specification information and window front-to-back relationship specification information). The broadcast signal (e.g., AIT) may also include the window shape specification information. Furthermore, the window shape specification information may include whether some or all of the window-related specification information can be changed by the viewer's selection. In the case of recorded content, the video display unit 173 may display the main window based on the window shape specification information pre-stored as content group-related information. In the case of content on the Internet, the video display unit 173 may display the main window based on the window shape specification information distributed along with the content as content group-related information. Furthermore, since it is desirable to adjust the window size, i.e., the size of the image display area, according to the size and pixel count of the information display device 1000, the window-related specification information may consist of multiple specification pieces corresponding to the size and pixel count of the information display device 1000.
[0269] The video display unit 173 displays a main window that displays the main video of the broadcast program, and a sub-window that displays the execution screen of a broadcast-linked application that works in conjunction with the broadcast program.
[0270] Furthermore, the video display unit 173 displays not only broadcast programs received from broadcast waves, but also recorded programs and content from the internet. Hereinafter, broadcast content received from broadcast waves, internet content, and recorded content may be collectively referred to as "content."
[0271] The video output unit 175 outputs video information to an external display device for displaying a main window that displays the main video of the broadcast program and a sub-window that displays the execution screen of a broadcast-linked application that works in conjunction with the broadcast program.
[0272] Furthermore, the video output unit 175 outputs video information to an external display device for displaying not only broadcast programs received from broadcast waves, but also recorded programs and content from the internet. [Viewer Instruction Input Section]
[0273] Figure 2D shows an example of the viewer instruction input unit 25001 of an information display device according to an embodiment. The viewer instruction input unit 25001 receives instruction information that the device has received from a viewer.
[0274] The devices that accept input of instructions from viewers include, specifically, the remote control 25102, mouse 25104, touchpad 25106, keyboard 25108, personal digital assistant 25110, and touch panel 25111.
[0275] If these input devices (remote control 25102, mouse 25104, touchpad 25106, keyboard 25108, portable information terminal 25110, touch panel 25111) are integrated with the information display device 1000, the input devices themselves become the viewer instruction input unit 25001. On the other hand, if these input devices are not integrated with the information display device 1000 and are connected to the information display device 1000 via wireless or wired connection, then input ports 25101, 25103, 25105, 25107, and 25109 become the viewer instruction input unit 25001. Furthermore, if the portable information terminal 25110 is connected to the information display device via LAN as an input device, the LAN communication unit 121 (described above, Figure 2A) becomes the viewer instruction input unit 25001.
[0276] Keyboard 25108 (including when using a mobile information terminal as a means of text input) launches an internet browser and accepts text input to the browser when searching for content on the internet.
[0277] The personal information terminal 25110 and the touch panel 25111 detect touch operations on the screen display area and execute processing corresponding to the location where the touch operation was received.
[0278] [Screen display of information display device] The following describes an example of the screen when the video display unit 173 displays two broadcast programs, using Figure 20A.
[0279] Figure 20A shows the state in which the video display unit 173 displays the first main window 20000 corresponding to broadcast signal 1, the first sub-window 20001 corresponding to broadcast signal 1, the second main window 20002 corresponding to broadcast signal 2, and the second sub-window 20003 corresponding to broadcast signal 2. Here, the main windows, the first main window 20000 and the second main window 20002 shown in Figure 20A, display the main video of the broadcast program. On the other hand, the sub-windows, the first sub-window 20001 and the second sub-window 20003, display the execution screen of the broadcast-linked application that works in conjunction with the broadcast program.
[0280] Hereinafter, the content contained in the main windows, such as the first main window 20000 and the second main window 20002, displayed by the video display unit 173, may be referred to as the main content. In addition, the content contained in the subwindows, such as the first subwindow 20001 and the second subwindow 20003, may be referred to as the subcontent.
[0281] Furthermore, a collection of content consisting of main content and sub-content related to the main content is sometimes called a content group. Note that there may also be cases where only main content exists; however, here, we will refer to such cases as well as content groups. Therefore, the content groups described below include collections of content consisting of main content and sub-content related to the main content, or single main content without related sub-content.
[0282] Furthermore, as a concrete example, the content group consists of the main video of the aforementioned broadcast program (including broadcast programs received from terrestrial broadcasting and recorded programs) and the execution screen of the broadcast-linked application that works in conjunction with the broadcast program. Another concrete example is that the content group consists of content from the internet (e.g., a web page) and streaming video contained within that content (e.g., streaming video contained within a web page). Yet another concrete example is that the content group consists of content from the internet (e.g., a web page) and other content displayed in multiple windows opened by the same application. It is also possible that the sub-window displayed by the video display unit 173 contains multiple sub-contents. In addition, in the case of VOD (Video On Demand) or broadcast-linked applications for recorded programs, the application may be deleted from the specified distribution server. In such cases, alternative processing described in the AIT or accompanying information (e.g., connecting to an alternative connection URL) may be performed, or if there is no provision for alternative processing, a message to that effect may be displayed in the sub-window, and the application may not be launched.
[0283] The video output unit 175 outputs video information to an external display device for displaying the videos of multiple content groups in different windows for each content group.
[0284] The video display unit 173 displays the videos of multiple content groups in separate windows for each content group.
[0285] The viewer instruction input unit 25001 accepts input to set the content group to be selected from a group of multiple content groups.
[0286] The video display unit 173 displays (or the video output unit 175 outputs) content groups simultaneously, but only one content group is set to be selected, and all other content groups are set to be unselected. The audio output unit 176 outputs audio information corresponding to the selected content group. The audio playback unit 174b plays the audio corresponding to the selected content group. This prevents the audio from multiple content groups from mixing.
[0287] When an input is received to switch the selected content group, the switched content group is set as the selected group, and the previously selected content group is set as the unselected group. Then, the audio playback unit 174b / audio output unit 176 stops playing / outputting the audio that was playing up until then and starts playing / outputting the audio of the newly selected content group.
[0288] Specifically, a pointing device such as a mouse 25104 or touchpad 25106 (including cases where the personal digital assistant 25110 is used as a pointing device) accepts input to switch to the selected content group by moving the cursor 20004 to the window displaying the selected content group and clicking (for example, double-clicking). In the case of the touch panel 25111, the touch panel 25111 accepts input to switch to the selected content group by double-tapping.
[0289] In the case shown in Figure 20A, the content group displayed in the first main window 20000 and the first sub-window 20001 is selected, while the content group displayed in the second main window and the second sub-window 20003 is not selected. The audio playback unit 174b / audio output unit 176 then plays / outputs the audio of the content group of broadcast signal 1 corresponding to the first main window 20000, which is in the selected state.
[0290] The audio playback unit 174b / audio output unit 176 may play / output either the audio from the main content or the audio from the sub-content. Furthermore, if the same content group contains multiple audio tracks, the audio playback unit 174b / audio output unit 176 may select one of them to play / output.
[0291] In the case of VOD (Video On Demand), the menu list can be displayed in the main windows 20000 and 20002, and the video can be displayed in the sub-windows 20001 and 20003.
[0292] Furthermore, the shape, size, and position of the window may be freely changed based on input received from the viewer. Specifically, the shape, size, and position of the window are changed based on input received by the touch panel 25111 (for example, input to move the window's position by dragging, or input to change the window's size by pinching in or pinching out). In addition, the shape, size, and position of the window are changed based on input received by a pointing device such as a mouse 25104 or touchpad 25106 (for example, input by dragging).
[0293] The video display unit displays the window showing the selected content group and the window showing the unselected content group in different ways. For example, the video display unit 173 displays the borders of windows showing content from the same content group in the same way (for example, by displaying them in the same color). In addition, the video display unit 173 displays the borders of the window showing the selected content group and the borders of the window showing the unselected content group in different ways. This makes it easier to identify windows that belong to the same content group.
[0294] In the example in Figure 20A, the content displayed in the first main window 20000 and the first sub-window 20001 is shown to be selected. That is, the borders of the first main window 20000 and the first sub-window 20001 are displayed as thick lines, while the borders of the second main window and the second sub-window 20003 are displayed as dashed lines. Note that the border colors of the windows displaying selected content and the border colors of the windows displaying unselected content may be displayed as different colors. Specifically, the display color within the window displaying unselected content may be a lighter color than the display color within the window displaying selected content.
[0295] Furthermore, the video display unit 173 displays the main window and the sub-window in different ways. For example, as shown in Figure 20A, the video display unit 173 displays marks 20006 and 20007 in the main window. Alternatively, as shown in Figure 23A, the window attribute display unit 20310 may be configured to indicate whether it is the main window or a sub-window.
[0296] Here, when windows overlap, the order in which each window is displayed in front of the others becomes an issue. Next, using Figure 20B, we will explain the case where a window displaying selected content and a window displaying unselected content overlap.
[0297] As shown in Figure 20B, the window displaying the selected content is superimposed on the window displaying the unselected content. In other words, the first main window 20000 and the first sub-window 20001, which display the selected content, are superimposed on the second main window and the second sub-window 20003.
[0298] Furthermore, the broadcast signal (e.g., AIT) may include window context information that specifies the relative order of related windows.
[0299] Additionally, the window context specification information may include whether some or all of the window-related specification information can be changed by the viewer's selection.
[0300] In the case of recorded content, the video display unit 173 may display the main window based on window context information that has been stored in advance as information related to the content group.
[0301] Furthermore, in the case of content on the Internet, the video display unit 173 may display the main window based on window context specification information that is distributed along with the content as information related to the content group.
[0302] Furthermore, the system may determine which window is displayed in front of other windows based on input received from the viewer. Specifically, as shown in Figure 20C, when a pointing device such as a mouse 25104 or touchpad 25106 moves the cursor 20004 to the first sub-window 20001 and accepts a single-click input, the video display unit 173 displays the first main window 20000 and the first sub-window 20001 superimposed on the second main window and the second sub-window 20003. Alternatively, the touch panel 25111 may accept a single-tap operation on the window to be displayed in the foreground, thereby displaying the window that was selected in the foreground. It is preferable that the click operation for switching between content groups and the click operation for displaying windows be different operations, such as a single click and a double-click.
[0303] Furthermore, as shown in Figure 20D, a pointing device such as a mouse 25104 or touchpad 25106 may move the cursor 20004 to the first subwindow 20001, accept a click input, and then display the confirmation window 20005. This prevents the selected content group from switching to an unintended content group.
[0304] The remote control 25102 accepts input to switch between selected content groups (hereinafter sometimes simply referred to as switching windows) via button operation. The remote control 25102 will be described in detail below using Figure 22A.
[0305] When the content add button 20213 shown in Figure 22A receives input, the mode switches to either switching mode or adding mode. For example, when in switching mode, if the content add button 20213 receives input, the mode switches from switching mode to adding mode. Conversely, when in adding mode, if the content add button 20213 receives input, the mode switches from adding mode to switching mode.
[0306] In switching mode, the total number of content items displayed by the video display unit 173 does not change. On the other hand, in addition mode, the total number of content items displayed by the video display unit 173 increases.
[0307] In detail, when channel button 20211 receives input in switching mode, a set of broadcast program content corresponding to channel button 20211 is added. The video display unit 173 then clears the window displaying the previously selected set of content and displays a new window showing the newly added set of content. Once the newly added set of content is selected, the audio playback unit 174b / audio output unit 176 stops playing / outputting the audio that was previously playing / outputting and starts playing / outputting the audio of the newly added set of content.
[0308] The video display unit 173 may also be configured to clear the window displaying the content group for which the longest time has elapsed since it became unselected. Furthermore, it may be configured to accept input from the viewer to select a group of content to stop displaying.
[0309] In add-on mode, when channel button 20211 accepts input, the content group of the broadcast program corresponding to channel button 20211 is added. The video display unit 173 then displays a new window showing the added content group. When the newly added content group is selected, the audio playback unit 174b / audio output unit 176 stops the audio that was previously being played / output and starts playing / outputting the audio of the newly added content group.
[0310] Furthermore, if the total number of added content sets exceeds the number of tuners, the video display unit 173 may clear the window displaying the content set that has been in a non-selected state for the longest time. It may also accept input from the viewer to select the content set to stop displaying.
[0311] When the content switching button 20201 shown in Figure 22A receives input, the group of content that is in a provisional selection state is switched. Subsequently, when the confirm button 20202 receives input, the group of content that is in a provisional selection state becomes selected. The above process will be explained in detail below using Figure 22B.
[0312] Figure 22B shows an example where the content displayed in the second main window 20002 is in a provisional selection state. As shown in Figure 22B, provisional selection frames 20204 are displayed around the second main window 20002.
[0313] Subsequently, when the OK button 20202 accepts input, the content group displayed in the second main window 20002 is set as selected.
[0314] When the back button 20203 accepts input, the temporary selection state of the content group displayed in the second main window 20002 is canceled. This makes it possible to avoid switching content groups even after making a temporary selection. Alternatively, the window of the temporarily selected content group can be displayed in front of the windows of other content groups, and the audio can be switched. This allows users to check the contents of the content groups they are considering switching to, improving usability.
[0315] Alternatively, the system may accept input combining the content switching button 20201, the channel button 20211, and the color button 20212, thereby setting the content group as either tentatively selected or selected.
[0316] Furthermore, the window displayed by the video display unit 173 may also display a number corresponding to the channel button 20211. In this case, the content switching button 20201 accepts input, and then the channel button 20211 accepts input, thereby setting the window, i.e., the group of contents, corresponding to the channel button 20211 to a provisional selection state or a selected state. Alternatively, as shown in Figure 23A, the number corresponding to the channel button 20211 may be displayed on the window attribute display unit 20310.
[0317] Furthermore, the color corresponding to the color button 20212 may be used to display a portion of the window shown by the video display unit 173 (for example, the window's border). In this case, the channel button 20211 accepts input after the content switching button 20201 accepts input, thereby setting the window, i.e., the group of contents, corresponding to the color button 20212 to a provisional selection state or a selected state.
[0318] Alternatively, as shown in Figure 22C, content groups can be added by accepting input from the menu screen displayed by the personal digital assistant 25110. In the menu screen shown in Figure 22C, each content group is represented as an icon. When an icon 20206 displayed on the personal digital assistant 25110 is selected (for example, by touch operation), the personal digital assistant 25110 accepts input to add a content group. In the example shown in Figure 22C, "Channel B" is selected as the content group to be added. The border of the icon 20206 corresponding to "Channel B" is displayed in a different manner from the other icons 20206 (in the example in Figure 22C, the border is thicker).
[0319] The above example described the process of specifying or adding content sets by operating an input device, along with an example of the display screen. Below, the process of adding broadcast program content sets by specifying them from the EPG will be explained using Figures 22H and 22I.
[0320] As shown in Figure 22H, the borders of broadcast programs that are in a provisional selection state are enclosed in provisional selection frame 20226.
[0321] When the select button 20202 on the remote control (as described above, Figure 22A) is pressed, the video display unit 173 displays a new window showing the added content group in place of EPG173e. Then, the content group of the broadcast program that was in a provisional selection state is added.
[0322] When the remote control's content addition button 20213 accepts input, the content group of broadcast programs that is currently in a provisional selection state becomes selected. Also, the border 20224 of the selected broadcast program is displayed in a thicker color. In this case, EPG173e does not close and continues to accept input to add content groups of broadcast programs. Then, a new provisional selection frame 20226 is displayed for selecting the broadcast program to be provisionally selected.
[0323] In the state shown in Figure 22H, when the content addition button 20213 accepts input, the content group of broadcast programs that was in a provisional selection state becomes selected. Also, as shown in Figure 22I, the border 20224 of the selected broadcast program is displayed in a thicker color. Furthermore, the content group of broadcast programs that was selected in Figure 22H becomes semi-selected in Figure 22I. And, as shown in Figure 22I, the border of the semi-selected broadcast program is displayed in a thicker color, and a diagonal line is displayed in the corner. In this way, when the content addition button 20213 accepts input, the content group of broadcast programs that was previously selected becomes semi-selected, and the content group of broadcast programs that was in a provisional selection state becomes selected. Therefore, each time the content addition button 20213 accepts input, a semi-selected content group is added.
[0324] In the state shown in Figure 22I, when the remote control's OK button 20202 receives input, the content group of broadcast programs that is semi-selected and the content group of broadcast programs that is selected are added. The video display unit 173 then displays two windows, each showing the added content group. In this case, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the content group of broadcast programs that was selected in EPG 173e. In other words, the audio playback unit 174b / audio output unit 176 does not play / output the audio of the content group of broadcast programs that was semi-selected in EPG 173e. The content group of broadcast programs that was semi-selected in EPG 173e becomes an unselected content group when the content group is displayed. If there was a content group that was selected in the video display unit 173 before the content group was added by EPG 173e, that content group becomes unselected.
[0325] When you select a group of content that you want to deselect or partially select in EPG173e, and then the content exit button 20216 accepts input, the selected or partially selected group of content will be deselected. In that case, when the broadcast program that was deselected becomes selected, the partially selected group of content will be changed to selected.
[0326] Furthermore, the content groups added by EPG173e may all be set to a semi-selected state. In this case, if there are any content groups that were selected in the video display unit 173 before the addition of the content groups by EPG173e, those content groups will remain selected.
[0327] Next, we will explain the process of adding content sets when the remote control (mentioned above, Figure 22A) accepts input while the launcher menu (described later, Figure 22J) is displayed, using Figures 22A and 22J.
[0328] When the remote control's menu button 20232 receives input, the video display unit 173 displays the launcher menu 20230 shown in Figure 22J.
[0329] As shown in Figure 22J, the launcher menu 20230 displays a list of multiple menu items 20233 for selecting content and apps. Note that apps are also selected as part of the content group.
[0330] Furthermore, as shown in Figure 22J, the border of menu item 20233, which is in a provisional selection state, is surrounded by provisional selection frame 20231. When the arrow button 20214 on the remote control (mentioned above, Figure 22A) receives input, the menu item 20233 surrounded by provisional selection frame 20231 switches, and consequently, the group of content (content or app) in a provisional selection state switches.
[0331] When the remote control's content addition button 20213 receives input, the menu item 20233, which is currently in a provisional selection state, and the corresponding content group (content or app) become selected. The border of the selected content group is also displayed in a thicker format. As the new content group becomes selected, the previously selected content group becomes semi-selected, and the border of the semi-selected content group is displayed in a thicker format, along with a diagonal line in the corner. Subsequently, when the remote control's OK button 20202 receives input, the audio output unit 176 displays a window showing each of the added content groups instead of the launcher menu 20230. In this case, the content group that was semi-selected and the content group that was selected in the launcher menu 20230 are added as a new content group. The audio output unit 176 then outputs the audio for the content group that was selected in the launcher menu 20230. In other words, the audio for the semi-selected content group is not output. In the Launcher Menu 20230, content groups that were partially selected will become unselected when the content group is displayed.
[0332] Specifically, in Figure 22J, "App 3" is tentatively selected. When the content addition button 20213 receives input in this state, "App 3," which was tentatively selected, becomes selected. Also, "Content 3," which was previously selected, becomes semi-selected, its border is displayed thicker, and diagonal lines are displayed in the corners. Subsequently, when the remote control's OK button 20202 receives input, the semi-selected "Content 1," "Content 3," and "App 2," along with the selected "App 3," are added as a new content group. The video display unit 173 then displays the main window showing the added "Content 1," "Content 2," "App 2," and "App 3." In this case, the audio output unit 176 outputs the audio for "App 3," which was selected in the launcher menu 20230. In other words, the audio for "Content 1," "Content 2," and "App 2," which were semi-selected, is not output. If the added app does not require display on the video display unit 173, it will only be launched. Alternatively, the launcher menu 20230 may be configured so that "Content" is the main content and "Apps" are sub-content corresponding to "Content".
[0333] After selecting a group of content items in the launcher menu 20230 and deselecting them, the selection or deselection of that group of content items will be canceled when the content exit button 20216 accepts input.
[0334] Next, the process of adding content sets by specifying them from the launcher menu using a pointing device such as a mouse 25104 or touchpad 25106, or a touch panel 25111, will be explained using Figures 22J and 22K.
[0335] When the launcher icon 20240 shown in Figure 22K receives a click (or touch operation in the case of the touchpad 25106), the screen switches to the one shown in Figure 22J, and the launcher menu 20230 is displayed.
[0336] When an unselected menu item (20233) receives a click (or touch input in the case of a touchpad 25106), the corresponding content group becomes selected. Additionally, any previously selected content group becomes partially selected.
[0337] Furthermore, when a selected menu item 20233 receives a click input (or a touch operation in the case of a touchpad 25106), the corresponding content group becomes semi-selected. When a semi-selected menu item 20233 receives a click input (or a touch operation in the case of a touchpad 25106), the corresponding content group becomes deselected.
[0338] When the remote control's select button 20202 receives input, the video display unit 173 displays a window showing the added content groups instead of the launcher menu 20230. In this case, the content groups that were partially selected and the content groups that were selected in the launcher menu 20230 are added as a new content group. In this case, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the selected broadcast program content group. The content groups that were partially selected in the launcher menu 20230 become unselected content groups when displayed.
[0339] Furthermore, after the information display device 1000 is powered on, the launcher menu 20230 may be displayed as the initial screen on the video display unit 173. Also, after the launcher menu 20230 is displayed, frequently selected content or applications may be pre-selected according to the viewer's preferences.
[0340] As shown in Figure 22D, the information display device 1000 may be configured to display only internet content and not broadcast programs.
[0341] Additionally, it would be beneficial to allow users to select related content groups not only from the main window but also from subwindows.
[0342] [Operation sequence of the information display device] Figures 21A to 21D show the operation sequence diagrams of the information display device 1000 according to Embodiment 6. Using Figure 21A, the process of adding another set of broadcast program content while only the content set of a broadcast program is displayed will be explained.
[0343] First, after the information display device 1000 is powered on, the main window displays the selected main content from the program being watched when the power was briefly interrupted. At this point, if a different broadcast channel is selected by the channel button 20211 on the remote control (as described above, Figure 22A), the displayed content group switches to the content group corresponding to the selected broadcast channel. Alternatively, when the information display device 1000 is powered on, only a window without content displayed may be shown, and then the video of the selected channel may be displayed in the window after the channel button 20211 on the remote control is selected.
[0344] The following explanation assumes that the program from the first broadcast signal (which may be referred to as broadcast signal 1 below) has been selected as the main content.
[0345] First, the information display device 1000 acquires the PMT data sequence (S20101).
[0346] Next, the information display device 1000 acquires the AIT data column (S20102).
[0347] Next, the information display device 1000 checks the window-related specification information (window-related specification information is a general term for window-related specification information such as the window shape specification information and window front-to-back relationship specification information mentioned above) (S20103).
[0348] Next, the information display device 1000 displays the first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1, based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (S20104).
[0349] After displaying the first main window 20000, the information display device 1000 starts the broadcast-linked application either automatically or based on a startup command received from a viewer (S20107).
[0350] As a result, the broadcast linkage application is executed, and the execution screen of the broadcast linkage screen is displayed in the first subwindow 20001 (subwindow 1 in the figure) corresponding to broadcast signal 1 (S20108).
[0351] Subsequently, the information display device 1000 accepts input to add a new set of content. Specifically, the content add button 20213 accepts the input. Then, the channel button 20211 corresponding to the second broadcast signal to be added (hereinafter sometimes referred to as broadcast signal 2) accepts the input, and the content set corresponding to broadcast signal 2 is added. The added content set corresponding to broadcast signal 2 becomes the selected content set, and after the same processing as when broadcast signal 1 is selected (S20109~S20111, S20113~S20115), the second main window 20002 (main window 2 in the figure) and the second sub-window 20003 (sub-window 2 in the figure) corresponding to broadcast signal 2 are displayed (S20112, S20116), and the audio switches to the audio of the content set for broadcast signal 2. Even after the second main window 20002 and the second sub-window 20003 are displayed, the first main window 20000 and the first sub-window 20001 remain displayed.
[0352] Furthermore, when either the first main window 20000 or the first sub-window 20001 accepts an input selection (for example, a double-click), the selected content group switches to the content group corresponding to broadcast signal 1, and the audio switches to the audio of the content group for broadcast signal 1.
[0353] Here, the number of tuners available in the information display device 1000 is limited. If the number of tuners becomes insufficient due to the addition of content sets, the information display device 1000 closes the window for the last selected content set. However, if the last selected content set is being streamed over the internet, the information display device 1000 may switch to the streaming broadcast instead of closing the window.
[0354] Furthermore, when recording ends and the tuner that was receiving the broadcast signal is released, the information display device 1000 may display the closed window again. Also, when recording ends and the tuner that was receiving the broadcast signal is released, the information display device 1000 may revert the display that was switched to streaming broadcast back to its original state.
[0355] Furthermore, the information display device 1000 may be configured to accept input from the viewer to select a window to close.
[0356] Next, we will explain, using Figure 21B, the process of adding content distributed via the internet when only broadcast program content is displayed, highlighting the differences from Figure 21A.
[0357] The information display device 1000 confirms the window-related specification information (window-related specification information is a general term for window-related specification information such as the window shape specification information and window front-to-back relationship specification information mentioned above) (S20103).
[0358] Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (S20104).
[0359] After displaying the first main window 20000, the information display device 1000 starts the broadcast linkage application either automatically or based on a startup command received from a viewer (S20107). Then, the execution screen of the broadcast linkage screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0360] The information display device 1000 accepts input information (for example, a URL or search keywords) to identify the content to be requested for distribution, and then requests the distribution of the content identified from the input information (S20117).
[0361] The process of receiving input information to identify the content to be delivered using the remote control (mentioned above, Figure 22A) will be explained in detail below using Figures 22A, 22D, and 22E.
[0362] First, when the content addition button 20213 on the remote control accepts input, and then when the input switching button accepts input, the screen shown in Figure 22D is displayed on the video display unit 173 of the information display device 1000.
[0363] The screen shown in Figure 22D displays the Input Switching Menu 20220. The Input Switching Menu 20220 also displays various content categories (TV broadcast, recorder, external input 1, external input 2, internet, etc.). In the screen shown in Figure 22D, "Internet" is tentatively selected as the category, and the box for the tentatively selected "Internet" is displayed with a thick line.
[0364] Furthermore, as shown in Figure 22D, when the input switching menu 20220 is displayed and the remote control's arrow button 20214 accepts input, the temporarily selected category switches from "Internet" to another category. Along with the switch in the temporarily selected category, the thick line displayed in the "Internet" frame disappears, and the frame of the switched category is displayed with a thick line.
[0365] For example, when the arrow button 20214, which shows an upward arrow, accepts input, the category that is temporarily selected will switch to "External Input 2," which is located above the currently temporarily selected "Internet." Subsequently, when the arrow button 20214, which shows a downward arrow, accepts input, the category that is temporarily selected will switch to "Internet," which is located below the currently temporarily selected "External Input 2."
[0366] When the remote control's select button 20202 is pressed, the currently selected category is determined as the category for the newly added content.
[0367] With "Internet" provisionally selected, when the OK button 20202 accepts input, the screen shown in Figure 22E is displayed on the video display unit 173 of the information display device 1000.
[0368] The screen shown in Figure 22E displays a specification window 20221 that accepts input for specifying new internet content to be added. The content to be added is specified by entering a URL or search keyword ("Search" in Figure 22E) into the text box within the specification window 20221. In the screen shown in Figure 22E, URL is selected as the input target, and the text box for URL input is shown with a thick border. When the remote control's arrow button 20214 accepts input while the specification window 20221 is displayed, the input target switches from URL to search keyword. Along with the switch, the thick border around the text box for URL input disappears, and the border around the text box for search keyword input becomes thick.
[0369] The channel button 20211 on the remote control also functions as a text input button. When the channel button 20211 accepts input, text is entered into the target text box, thereby entering a URL or search keyword. For example, if a URL is entered into the text box and then the OK button 20202 accepts input, the information display device 1000 requests the delivery of content identified from the URL. Alternatively, the input switching operation may begin without the content addition button 20213 accepting input first, and finally the content switching occurs when the OK button 20202 accepts input, and then the content addition button 20213 accepts input to add content.
[0370] Refer to Figure 21B again. Next, the content requested in S20117 is delivered to the information display device 1000 (S20118).
[0371] Next, the information display device 1000 checks the window-related specification information (a general term for window-related specification information such as the window shape specification information and window front-to-back relationship specification information mentioned above) if such information is available (S20119). Then, based on the window shape specification information and window front-to-back relationship specification information included in the checked window-related specification information, the information display device 1000 displays the third main window (main window 3 in the figure) corresponding to the broadcast signal 3 (S20120).
[0372] Furthermore, if there is related content to the delivered content, the information display device 1000 requests the delivery of the related content (S20121). The related content requested in S20121 is then delivered to the information display device 1000 (S20122). The information display device 1000 then displays the third sub-window (sub-window 3 in the figure). The information display device 1000 requests the delivery of the related content using the launcher shown in the main window.
[0373] At this point, when the third main window is displayed, the audio that was playing up until then switches to the audio of the streamed content. Even after the audio switches, the first main window 20000 and the first sub-window 20001 remain displayed. Therefore, the windows displaying the broadcast program content (first main window 20000 and first sub-window 20001) and the windows displaying the internet content (third main window and third sub-window) are displayed. In this state, if either the first main window 20000 or the first sub-window 20001 is double-clicked, the selected content group switches from the streamed content to the broadcast program content group. The audio being played then switches from the audio of the streamed content to the audio of the broadcast program. Subsequently, if the third main window or the third sub-window is double-clicked, the selected content group switches from the broadcast program content group to the content group corresponding to the streamed content. Then, the audio being played switches from the audio of the broadcast program to the audio of the distributed content.
[0374] In the example described above, after the content was delivered from the internet, the audio switched from the broadcast program's audio to the audio of the delivered content. However, some delivered content does not require audio. If the delivered content does not require audio, the audio may not be switched from the previously selected content group, and the delivered content may be displayed without audio. In this case, for example, as shown in Figure 22F, a button 20222 may be displayed that accepts input to select whether or not to switch the audio to the delivered content after the content has been delivered. Furthermore, if button 20222 accepts input to not switch the audio, the delivered content may be made into the unselected content group, and the content group that continues to play audio may remain as the selected content group.
[0375] Next, we will explain the process of adding recorded program content when only broadcast program content is displayed, mainly using Figures 21C and 22D to highlight the differences from Figure 21A.
[0376] The information display device 1000 confirms the window-related specification information (window-related specification information is a general term for window-related specification information such as the window shape specification information and window front-to-back relationship specification information mentioned above) (S20103).
[0377] Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (S20104).
[0378] After displaying the first main window 20000, the information display device 1000 starts the broadcast linkage application either automatically or based on a startup command received from a viewer (S20107). Then, the execution screen of the broadcast linkage screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0379] With the first main window 20000 and the first sub-window displayed, the information display device 1000 requests playback of recorded content (S20124).
[0380] Next, the information display device 1000 receives a playback signal (indicated as "content playback" in the diagram) for the recorded content that was requested to be played back in S20124 (S20125).
[0381] Next, if the information display device 1000 has window-related specification information (a general term for window-related specification information such as the window shape specification information and window front-to-back relationship specification information mentioned above), it checks this window-related specification information (S20126).
[0382] Next, the information display device 1000 displays the fourth main window (main window 4 in the figure) based on the window shape specification information and window front-to-back relationship specification information included in the confirmed window-related specification information (S20127).
[0383] Next, if there is related content to the distributed content, the information display device 1000 requests playback of the related content (S20128). The process of receiving input information for requesting playback of recorded content using the remote control (described above, Figure 22A) will be explained in detail below using Figures 22D and 22G.
[0384] First, when the content addition button 20213 on the remote control accepts input, and then when the input switching button accepts input, the screen shown in Figure 22D is displayed on the video display unit 173 of the information display device 1000.
[0385] If "Recorder" is provisionally selected and the OK button 20202 accepts input, the video display unit 173 of the information display device 1000 will display the screen shown in Figure 22G.
[0386] The screen shown in Figure 22G displays a recording content list 20223 that accepts input for selecting a newly added (playback requested) recording content. The recording content list 20223 displays a list of recording content names. In Figure 22G, "football 1" is tentatively selected as the recording content to be played back in the recording content list 20223. In this state, when the OK button 20202 accepts input, the information display device 1000 requests playback for the tentatively selected recording content, thereby adding "football 1" as a new content group. Alternatively, the input switching operation may begin first without accepting input from the content add button 20213, and finally, the content switching occurs when the OK button 20202 accepts input, and the content addition is added when the content add button 20213 accepts input.
[0387] Refer to Figure 21C again. The information display device 1000 receives the related content (related content playback in the figure) that was requested to be played in S20128 (S20129). The information display device 1000 then displays the fourth subwindow (subwindow 4 in the figure).
[0388] At this point, when the fourth main window is displayed, the audio that was playing up until then switches to the audio of the recorded content. Even after the audio switches, the first main window 20000 and the first sub-window 20001 remain displayed. Therefore, the windows displaying the broadcast program content (first main window 20000 and first sub-window 20001) and the windows corresponding to the recorded content (fourth main window and fourth sub-window) are displayed. In this state, if either the first main window 20000 or the first sub-window 20001 is double-clicked, the selected content group switches from the recorded content to the broadcast program content group. The audio being played then switches from the audio of the recorded content to the audio of the broadcast program. Subsequently, if the fourth main window or the fourth sub-window is double-clicked, the selected content group switches from the broadcast program to the recorded content group. The audio being played then switches from the audio of the broadcast program to the audio of the recorded content.
[0389] The playback device for recorded content may be built into the information display device or be an external device. Furthermore, the related content of the recorded content may be content available on the internet. In addition, the control method of this embodiment can be applied even when broadcast programs are not being received, as shown in Figure 21D. [Examples]
[0390] The difference between Example 7 and Example 6 is that after the selection of provisionally selected content has been completed, a window frame is displayed that accepts input to specify new content. Below, we will mainly explain the differences between Example 6 and Example 7, and will omit explanations of common points as much as possible.
[0391] When the content addition button 20213 or content switching button 20201 on the remote control (described above, Figure 22A) receives input, the selection of provisionally selected content is completed. After that, when the content addition button 20213 or content switching button 20201 receives input again, the video display unit 173 displays a window frame 20301 that accepts input to specify the content.
[0392] The window frame 20301 shown in Figure 23A displays a content display area 20302, a content selection frame 20303 for specifying the content to be displayed in the content display area 20302, a function button 20304, a window minimize button 20305, a window maximize button 20306, and a window close button 20307.
[0393] Initially, no content is displayed in the content display area 20302. After content is specified in the content selection frame 20303, the specified content will be displayed in the content display area 20302. Specifically, entering a URL in the content selection frame 20303 specifies the content to be displayed in the content display area 20302. The content selection frame 20303 accepts channel input if the specified content is a broadcast program. It also accepts device name input if the specified content is stored on an internal device. Furthermore, it accepts port name input if the specified content is input via an input port.
[0394] Furthermore, the content display area 20302 may initially display frequently selected content according to the viewer's preferences. Alternatively, it may display content that has not been provisionally selected. In the case of broadcast programs, the video of the selected channel may be displayed in the window after the content addition button 20213 on the remote control accepts input, followed by the channel button 20211 accepting input.
[0395] If no content is specified in the content selection frame 20303, and the content addition button 20213 or content switching button 20201 receives input, the video display unit 173 switches the display from the window frame 20301 to the content selection screen. Also, if content is specified and the content end button 20216 on the remote control receives input, the video display unit 173 switches the display from the window frame 20301 to the content selection screen. In this case, the content specified in the window frame 20301 will not be displayed on the content selection screen.
[0396] Function button 20304 is assigned functions such as launching the broadcast-linked application and calling up related content. When function button 20304, which is assigned the functions of launching the broadcast-linked application or calling up related content, receives input, a new window frame 20301 will appear. Sub-content will then be displayed in the newly appeared window frame 20301.
[0397] When the window close button 20307 accepts input, the main window and its corresponding subwindows are closed. It may also be possible to configure whether or not all related subwindows are closed when the main window is closed, on a per-content basis.
[0398] Furthermore, when the window frame launch icon 20308 shown in Figure 23B receives a click input (touch operation in the case of a touchpad 25106) from a pointing device, the window frame 20301 may be displayed.
[0399] Furthermore, the window frame 20301 may be supplied via broadcast waves as a broadcast-linked application. Alternatively, it may be supplied from a server on the internet. Alternatively, it may utilize window frames pre-stored in the information display device 1000. Alternatively, multiple window frames 20301 may be included in the broadcast signal (e.g., AIT) as window frame selection information. Additionally, in the case of recorded content or content on the internet, the window frame selection information may be recorded / distributed as information associated with the content. This allows viewers to select a window frame. Alternatively, the window frame selection information may be included in the window-related specification information. Furthermore, since it is desirable to adjust the window frame design according to the size and pixel count of the information display device 1000, the window frame information may consist of multiple specification pieces corresponding to the size and pixel count of the information display device 1000. [Examples]
[0400] The difference between Example 8 and Example 6 is that when switching content group selections, the sub-window for the program that is not selected is hidden. This makes the display easier to see and improves usability when displaying multiple content groups simultaneously. Below, we will mainly explain the differences between Example 8 and Example 6, and will omit explanations of common points as much as possible.
[0401] In Example 8, the video display unit 173 hides at least some of the information (e.g., subwindows) of the content group when the content group is switched from a selected state to a deselected state. Furthermore, it redisplays the hidden content information when the content group is switched from a deselected state to a selected state.
[0402] The following explanation, using Figure 24, describes the process of switching between content sets (i.e., broadcast programs) while only the content sets of broadcast programs are displayed. Ideally, the display control flow of the information display device 1000 in Figure 24 should be shown on a single line. However, in order to distinguish between the display control flow of the window group related to broadcast program 1 and the display control flow of the window group related to broadcast program 2, it is shown on two lines.
[0403] First, the information display device 1000 accepts an input to select a program for broadcast signal 1 (S20401).
[0404] Next, the information display device 1000 checks the window-related specification information included in the broadcast signal 1 (S20402).
[0405] Next, the information display device 1000 displays the first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1, based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (S20403).
[0406] Next, the information display device 1000 starts the broadcast linkage application either automatically or based on a startup command received from a viewer (S20404).
[0407] Next, the information display device 1000 displays the execution screen of the broadcast linkage screen in the first sub-window 20001 (sub-window 1 in the figure) which corresponds to the broadcast signal 1 (S20405).
[0408] Next, the information display device 1000 accepts an input for selecting a program from the broadcast signal 2 (S20406).
[0409] Next, the information display device 1000 stores the information necessary to display the first subwindow 20001 in its storage device (S20407). This causes the information display device 1000 to save the information necessary to display the first subwindow 20001 to its storage device.
[0410] Next, the information display device 1000 closes the first subwindow 20001 (S20408). That is, the information display device 1000 erases the displayed first subwindow 20001.
[0411] Next, the information display device 1000 checks the window-related specification information included in the broadcast signal 2 (S20409).
[0412] Next, the information display device 1000 displays the second main window 20002 (main window 2 in the figure) corresponding to the broadcast signal 2, based on the window shape specification information and window front-to-back relationship specification information included in the window-related specification information (S20410).
[0413] Next, the information display device 1000 starts the broadcast linkage application, either through automatic startup or by a startup command received from a viewer (S20411).
[0414] Next, the information display device 1000 displays the execution screen of the broadcast linkage screen in the second sub-window 20003 (sub-window 2 in the figure) which corresponds to the broadcast signal 2 (S20412).
[0415] Next, the information display device 1000 accepts an input to re-select a program for broadcast signal 1 (S20413).
[0416] Next, the information display device 1000 stores the information necessary to display the second subwindow 20003 in its storage device (S20414). This causes the information display device 1000 to save the information necessary to display the second subwindow 20003 to its storage device.
[0417] Next, the information display device 1000 closes the second subwindow 20003 (S20415). That is, the information display device 1000 erases the displayed second subwindow 20003.
[0418] Next, the information display device 1000 acquires the information necessary to display the first subwindow 20001, which was stored in S20407 (S20416). In other words, the information display device 1000 restores the information that was saved in S20407.
[0419] Next, based on the information acquired in S20416, the information display device 1000 redisplays the execution screen of the broadcast linkage screen in the first sub-window 20001 corresponding to the broadcast signal 1 (S20417).
[0420] Furthermore, if you close the sub-window for a program that has been deselected and then select the deselected content again, you may choose to automatically redisplay the closed sub-window.
[0421] Additionally, information indicating whether or not to hide the sub-window when not selected may be included as window-related specification information in the broadcast signal (e.g., AIT) or in the accompanying information of internet content or recorded content.
[0422] Additionally, information indicating whether or not to redisplay hidden subwindows when selecting a group of content may be included as window-related specification information in the broadcast signal (e.g., AIT) or in the accompanying information of internet content or recorded content.
[0423] Furthermore, the system may accept input from the viewer specifying whether or not to hide the sub-window when no selection is made. In this case, the information display device 1000 may be programmed to store the viewer's preferences and perform processing accordingly.
[0424] Furthermore, if the subwindow is redisplayed when a group of contents is reselected, the information related to the subwindow may be saved as cache data within the information display device 1000. [Examples]
[0425] The difference between Example 9 and Example 6 is that Example 9 prohibits the automatic launch of the broadcast linkage application for unselected content sets. Below, we will mainly explain the differences between Example 9 and Example 7, and will omit explanations of common points as much as possible.
[0426] Some broadcast-related applications are set to launch automatically. However, if all broadcast-related applications launch automatically, it can lead to an increase in sub-windows and a cluttered screen display.
[0427] In Example 9, the automatic launch of the broadcast linkage application for unselected content groups is prohibited. In other words, only the broadcast linkage application for selected content groups is automatically launched. This reduces the number of subwindows displayed at once, improving screen visibility.
[0428] Alternatively, you can set the broadcast integration application for unselected content groups to a standby state. In this case, the broadcast integration application will launch when the content group is selected.
[0429] Additionally, the option to prohibit automatic startup or put the application into a startup waiting state when not selected may be included as window-related specification information in the broadcast signal (e.g., AIT) or in the accompanying information of internet content or recorded content.
[0430] Furthermore, the system may accept input from the viewer specifying whether to prohibit automatic startup or put the system into a startup standby state when no selection is made. In this case, the information display device 1000 may be programmed to store the viewer's preferences and perform processing accordingly. [Examples]
[0431] The difference between Example 10 and Example 6 is that Example 10 displays a window on the video display unit 173 of the information display device 1000 and on the portable information terminal 25110 connected to the information display device 1000 by wire or wireless connection. Below, we will mainly explain the differences between Example 10 and Example 7, and will omit explanations of common points as much as possible.
[0432] In Example 10, the video display unit 173 of the information display device 1000 displays the main window, and the portable information terminal 25110, which is connected to the information display device 1000 by wire or wireless, displays the sub-window. This allows for effective use of the portable information terminal 25110 when displaying and viewing multiple content sets simultaneously, thereby improving convenience.
[0433] Alternatively, the main content and sub-content included in the group of content that has been deselected on the information display device 1000 may be displayed on the mobile information terminal 25110.
[0434] Alternatively, the video display unit 173 of the information display device 1000 may display multiple content groups, and the audio of the content groups may be output from the earphones of the mobile information terminal 25110. The earphones of the mobile information terminal 25110 may output the audio of one of the content groups displayed on the video display unit 173 of the information display device 1000. This allows multiple viewers to simultaneously view the content groups if they cannot agree on which content group they want to watch, by having each of them play and listen to the audio of the content group they want to watch on their mobile information terminal 25110.
[0435] The audio playback unit 174b / audio output unit 176 of the information display device 1000 may be configured not to play / output audio.
[0436] Additionally, the system may allow viewers to input information specifying the sub-content to be displayed on the mobile information terminal 25110.
[0437] Although the invention made by the present invention has been specifically described above based on embodiments, it goes without saying that the present invention is not limited to the above embodiments and can be modified in various ways without departing from the spirit of the invention.
[0438] For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these fall within the scope of the present invention. Furthermore, the numbers and messages that appear in the text and figures are merely examples, and using different ones will not impair the effects of the present invention.
[0439] The functions of the present invention described above may be implemented in hardware, either partially or entirely, by designing them, for example, using an integrated circuit. Alternatively, they may be implemented in software by having a microprocessor unit or the like interpret and execute an operating program that implements each of these functions. Hardware and software may also be used in combination.
[0440] The software that controls the broadcast receiving device 100 may be pre-stored in the ROM 103 and / or storage unit 110 of the broadcast receiving device 100 at the time of product shipment. Alternatively, it may be acquired after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 121. Furthermore, the software stored on a memory card or optical disc may be acquired via the expansion interface unit 124. Similarly, the software that controls the personal information terminal 700 may be pre-stored in the ROM 703 and / or storage unit 710 of the personal information terminal 700 at the time of product shipment. Alternatively, it may be acquired after product shipment from other application servers 500 on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Furthermore, the software stored on a memory card or optical disc may be acquired via the expansion interface unit 724.
[0441] Furthermore, the present invention is applicable to any device that displays a set of content, even if it does not receive broadcast programs. In other words, the information display device 1000 includes all kinds of devices, not just personal computers, tablet terminals, and smartphones.
[0442] Furthermore, the control lines and information lines shown in the diagram are those deemed necessary for explanation and do not necessarily represent all control lines and information lines on the product. In reality, it is safe to assume that almost all components are interconnected. [Explanation of symbols]
[0443] 100: Broadcast receiving device, 100a: Antenna, 101: Main control unit, 102: System bus, 103: ROM, 104: RAM, 110: Storage unit, 121: LAN communication unit, 124: Expansion interface unit, 125: Digital interface unit, 131: Tuner / demodulation unit, 132: First separation unit, 133: First video decoding unit, 134: First audio decoding unit, 135: First subtitle decoding unit, 141: Data broadcasting reception processing unit, 142: Data broadcasting Engine, 151: Streaming reception processing unit, 152: Second separation unit, 153: Second video decoding unit, 154: Second audio decoding unit, 155: Second subtitle decoding unit, 161: Application control unit, 162: Application engine, 171: Video overlay unit, 172: Audio selection unit, 173: Video display unit, 174: Speaker, 174b: Audio playback unit, 175: Video output unit, 176: Audio output unit, 181: Presentation synchronization control unit, 191: Terminal linkage control unit, 200: Internet, 210: Router device, 300t: Radio tower, 300: Broadcasting station server, 301: Main control unit, 302: System bus, 304: RAM, 310: Storage unit, 321: LAN communication unit, 400: Service provider server, 401: Main control unit, 402: System bus, 404: RAM, 410: Storage unit, 421: LAN communication unit, 500: Other application servers, 600: Mobile telephone communication servers, 600b: Base stations, 700: Mobile Information Terminal, 701: Main Control Unit, 702: System Bus, 703: ROM, 704: RAM, 710: Storage Unit, 720: Communication Processing Unit, 721: LAN Communication Unit, 722: Mobile Telephone Network Communication Unit, 723: NFC Communication Unit, 724: Expansion Interface Unit, 730: Operation Unit, 740: Image Processing Unit, 741: Display Unit, 742: Image Signal Processing Unit, 743: First Image Input Unit, 744: Second Image Input Unit, 750: Voice Processing Unit, 751: Voice Output Unit, 752: Voice Signal Processing Unit, 753: Voice Input Unit, 760: Sensor Unit, 761: GPS Receiver, 762: Gyro Sensor, 763: Geomagnetic Sensor, 764: Acceleration Sensor, 765: Illuminance Sensor, 766: Proximity Sensor 1000: Information display device, 20000: First main window, 20001: First sub-window, 20002: Second main window, 20003: Second sub-window, 20301: Window frame, 25001: Viewer instruction input unit, 25002: Content input unit, 25003: Content playback unit, 25004: Content recording and playback unit, 25005: Control unit, 25102: Remote control, 25104: Mouse, 25106: Touchpad, 25108: Keyboard, 25110: Portable information terminal, 25111: Touch panel.
Claims
[Claim 1] In an application startup method for launching an application to access broadcast resources in a broadcast receiving device, The application for accessing the aforementioned broadcast resources includes a broadcast-managed application activated by application control information contained in the broadcast signal, and an off-broadcast-managed application activated by means other than the application control information contained in the broadcast signal. A receiving step in which a broadcast signal is received, A startup priority confirmation step confirms the startup priority of the broadcast-managed application for data broadcasting based on the PMT (Program Map Table) information contained in the received broadcast signal, A first application startup step in which the broadcast-managed application is started based on the application control information contained in the received broadcast signal, A launcher screen display step, in which the launcher screen of the application launcher provided on the broadcast receiving device is displayed on the broadcast receiving device, A second application launch step in which the non-broadcast managed application is launched based on user operation via the displayed launcher screen, Communication steps for communicating with an external mobile device, A third application startup step in which the non-broadcast managed application is started based on a startup request received in the communication step via the external mobile terminal, A data broadcast screen display step that puts the broadcast receiving device into a data broadcast screen display state based on the BML information contained in the received broadcast signal, A fourth application startup step in which the broadcast-managed application is launched based on user operation in the data broadcast screen display state, Equipped with, The first application startup step involves checking whether the broadcast-managed application is executable if the application control information includes information indicating automatic startup of the broadcast-managed application, and if it is executable, obtaining and starting the broadcast-managed application. The confirmation of whether the aforementioned broadcast-managed application can be executed is performed by referring to the application profile included in the application control information to confirm the functions of the broadcast receiving device required by the broadcast-managed application. In the data broadcasting screen display step, if the broadcast receiving device confirms that it is capable of executing the broadcast-managed application, it is controlled to display an entry button for launching the broadcast-managed application. In the fourth application startup step, the broadcast-managed application is launched based on user operation on the entry button displayed on the data broadcast screen. How to launch the application.