Application start method
By integrating digital broadcasting with broadband services, the method addresses bandwidth limitations in data broadcasting, enabling high-value-added functions and improved screen displays through a broadcasting and communication integration system.
Patent Information
- Application Number
- JP2025123463
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-23
- Publication Date
- 2025-10-22
- Estimated Expiration
- 2034-06-11
AI Technical Summary
The limited bandwidth of radio wave transmission in data broadcasting restricts the ability to achieve high-definition screen displays and sophisticated effects, hindering the implementation of high-value-added functions in digital broadcasting receivers.
A method for launching applications using a broadcast receiving device that integrates digital broadcasting with broadband network services, enabling the execution of high-value-added functions through a broadcasting and communication integration system, utilizing HTML applications and extended BML specifications to manage and control application launch and termination.
Enables the execution of higher value-added functions by integrating digital broadcasting with broadband services, allowing for enhanced screen displays and sophisticated effects.
Smart Images

Figure 2025160306000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an application launch method. [Background technology]
[0002] One of the extension functions of digital broadcasting services is data broadcasting, which transmits digital data via broadcast waves and displays various information such as weather forecasts, news, recommended programs, etc. Many television receivers capable of receiving data broadcasting are already commercially available, and many technologies related to receiving data broadcasting have been published, including Patent Document 1 below. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2001-186486 A Summary of the Invention [Problem to be solved by the invention]
[0004] A feature of data broadcasting is that television receivers that support digital broadcasting services can receive data broadcasting on their own and can acquire and display a variety of information. However, because the amount of data that can be transmitted with data broadcasting is limited due to restrictions on radio wave bandwidth, it is difficult to achieve high-definition screen displays and sophisticated effects. This has made it difficult to implement useful, high-value-added functions on current digital broadcasting receivers.
[0005] An object of the present invention is to provide an application launching method that can execute higher value-added functions. [Means for solving the problem]
[0006] The technology described in the claims is used as a means for solving the above problems.
[0007] To take one example, the technology described in claim 1 is used. [Effects of the Invention]
[0008] By using the technology of the present invention, it is possible to provide an application launching method that can execute functions with higher added value. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a system configuration diagram of a communication system according to an embodiment. [Figure 2A] FIG. 1 is a block diagram of a broadcast receiving device according to an embodiment. [Figure 2B] FIG. 2 is a software configuration diagram of a broadcast receiving device according to an embodiment. [Figure 2C] FIG. 1 is a block diagram of an information display device according to an embodiment. [Figure 2D] FIG. 2 is a diagram illustrating an example of a viewer instruction input unit of the information display device according to the embodiment. [Figure 3] FIG. 2 is a block diagram of a broadcast station server according to an embodiment. [Figure 4] FIG. 2 is a block diagram of a service provider server according to an embodiment. [Figure 5A] FIG. 1 is a block diagram of a portable information terminal according to an embodiment. [Figure 5B] FIG. 2 is a software configuration diagram of the portable information terminal according to the embodiment. [Figure 6] FIG. 3 is a data configuration diagram of application control information according to an embodiment. [Figure 7A] 10 is an operational sequence diagram of the broadcast receiving device according to the embodiment when an application is started. [Figure 7B] 10 is an operational sequence diagram of the broadcast receiving device according to the embodiment when an application is started. [Figure 7C] 10 is an operational sequence diagram of the broadcast receiving device according to the embodiment when an application is started. [Figure 8A] FIG. 10 is an operational sequence diagram when the mobile information terminal according to the embodiment is linked; [Figure 8B] FIG. 10 is an operational sequence diagram when the mobile information terminal according to the embodiment is linked; [Figure 8C] FIG. 10 is an operational sequence diagram when the mobile information terminal according to the embodiment is linked; [Figure 9] 10 is an operational sequence diagram when an application is started in the broadcast receiving device and the mobile information terminal according to the embodiment. [Figure 10A] FIG. 10 is a screen display diagram of a basic screen of a cooperative control application of the mobile information terminal according to the embodiment. [Figure 10B] FIG. 10 is a screen display diagram of a basic screen of a cooperative control application of the mobile information terminal according to the embodiment. [Figure 11] 1 is a diagram showing a screen display of a data broadcast screen of a broadcast receiving device according to an embodiment. [Figure 12A] FIG. 2 is a screen display diagram of a notification screen of the broadcast receiving device according to the embodiment. [Figure 12B] 10 is a diagram showing a screen display of a broadcast cooperative application launcher of the broadcast receiving device according to the embodiment. FIG. [Figure 13A] FIG. 10 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the embodiment. [Figure 13B] FIG. 10 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the embodiment. [Figure 13C] FIG. 10 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the embodiment. [Figure 13D] FIG. 10 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the embodiment. [Figure 14] FIG. 10 is a diagram showing an error display screen of the broadcast receiving device according to the embodiment. [Figure 15] FIG. 10 is a screen display diagram of a broadcast cooperative application execution screen of the mobile information terminal according to the embodiment. [Figure 16A] 1 is a diagram showing an EPG display screen of a broadcast receiving device according to an embodiment. [Figure 16B] 10 is a diagram showing detailed information on an EPG display screen of a broadcast receiving device according to an embodiment. FIG. [Figure 17] 10 is an operational sequence diagram of the broadcast receiving device according to the embodiment when acquiring a broadcast cooperative app. FIG. [Figure 18A] FIG. 10 is an operational sequence diagram during terminal cooperation according to an embodiment. [Figure 18B] FIG. 10 is an operational sequence diagram during terminal cooperation according to an embodiment. [Figure 18C] FIG. 10 is an operational sequence diagram during terminal cooperation according to an embodiment. [Figure 18D] FIG. 10 is an operational sequence diagram during terminal cooperation according to an embodiment. [Figure 19A] 10 is a diagram showing a screen display of a broadcast cooperative application launcher of the broadcast receiving device according to the embodiment. FIG. [Figure 19B] 10 is a diagram showing a screen display of a broadcast cooperative application launcher of the broadcast receiving device according to the embodiment. FIG. [Figure 19C] 10 is a diagram showing a screen display of a broadcast cooperative application launcher of the broadcast receiving device according to the embodiment. FIG. [Figure 19D] 10 is a diagram showing a screen display of a broadcast cooperative application launcher of the broadcast receiving device according to the embodiment. FIG. [Figure 19E] FIG. 2 is a diagram showing a screen display of the broadcast receiving device according to the embodiment. [Figure 19F] FIG. 10 is a diagram illustrating a screen display of a broadcast cooperative application launcher of the portable information terminal according to the embodiment. [Figure 20A] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 20B] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 20C] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 20D] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 21A] FIG. 4 is an operation sequence diagram of the information display device according to the embodiment. [Figure 21B] FIG. 4 is an operation sequence diagram of the information display device according to the embodiment. [Figure 21C] FIG. 4 is an operation sequence diagram of the information display device according to the embodiment. [Figure 21D] FIG. 4 is an operation sequence diagram of the information display device according to the embodiment. [Figure 22A] FIG. 2 is a button layout diagram of a remote control according to an embodiment. [Figure 22B]FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22C] FIG. 2 is a diagram showing a screen display of a portable information terminal according to an embodiment. [Figure 22D] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22E] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22F] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22G] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22H] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22I] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22J] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 22K] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 23A] FIG. 2 is a diagram of a window frame of the information display device according to the embodiment. [Figure 23B] FIG. 2 is a diagram showing a screen display of the information display device according to the embodiment. [Figure 24] FIG. 4 is an operation sequence diagram of the information display device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. [Example]
[0011] First, an example of a digital broadcasting service that can be received by the broadcasting receiving device of this embodiment will be described.
[0012] For example, in an example of BS / terrestrial digital broadcasting that can be received by the broadcast receiving device of this embodiment, multiple transport streams (TS) can be multiplexed and transmitted on one transponder (frequency channel). A TS is a series of TS packets of a predetermined length, each of which is formed by dividing a data sequence, such as a video / audio elementary stream (ES) or program specific information (PSI) / service information (SI), and each of which has a TS header added.
[0013] PSI is a unique information table defined in the MPEG (Moving Picture Experts Group)-2 system standard that identifies which program each ES included in a TS belongs to. PSI is composed of a PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), etc. The PAT defines the list of programs included in a TS using the PID (Packet Identifier) of the PMT. The PMT defines the PID of the components of each program, etc. The CAT includes information related to conditional access.
[0014] SI is an extension of PSI that includes program information and other information, and includes information on the Electronic Program Guide (EPG) specified by the Association of Radio Industries and Businesses (ARIB) in ARIB STD-B10. SI is composed of BIT (Broadcaster Information Table), SDT (Service Description Table), EIT (Event Information Table), TOT (Time Offset Table), etc. BIT includes broadcast station identification information, affiliate information, and broadcast station SI transmission information. SDT includes information such as a network ID for identifying the network, a TS ID for identifying the TS, and a service ID (also known as a channel number) for identifying individual services (also known as channels) within the network. EIT includes a service ID for identifying individual services within the network, and information related to events, such as the name, broadcast date and time, and broadcast content of each event (also known as a program). TOT includes information related to the current date and time.
[0015] The TS also includes PCR (Program Clock Reference) information that serves as a reference for playback timing in a decoder, and a subset of the Broadcast Markup Language (BML) document based on the BML specifications defined in ARIB STD-B24.
[0016] In the broadcast receiving device of this embodiment, by receiving and decoding the TS composed of the video / audio ES and various information, it is possible to provide users with broadcast programs, EPG, data broadcast screens created using BML, etc.
[0017] Furthermore, the broadcast receiving device of this embodiment is compatible with a broadcasting and communication integration system that integrates functions using a broadband network with digital broadcasting services, and combines digital broadcasting services with the acquisition of additional content via the broadband network, computational processing in a server device, and presentation processing in collaboration with a mobile terminal device. To realize the broadcasting and communication integration system, the broadcast receiving device of this embodiment is capable of executing applications written in HTML (Hyper Text Markup Language) or similar. The broadcasting and communication integration system compatible with this broadcasting and communication integration system uses an extended BML specification, application control information (Application Information Table: AIT) in the broadcasting and communication integration system, and extended PSI / SI information required for transmitting applications via broadcast waves. The AIT provides or disseminates various information required to launch applications, such as the source where the application is acquired, and control information for controlling the launch / termination of applications.
[0018] The above explanation is based on the digital broadcasting service in Japan, but the application is not limited to Japan, including the broadcasting and communication cooperation system compatible with the broadcast receiving device of this embodiment.
[0019] Next, a specific configuration example of the embodiment of this example will be described.
[0020] [System Configuration] 1 is a system configuration diagram showing an example of a communication system of this embodiment that realizes a broadcast communication cooperation system. The communication system of this embodiment is composed of a broadcast receiving device 100 and an antenna 100a, a broadband network 200 such as the Internet and a router device 210, a broadcast station radio tower 300t, a broadcast station server 300, a service provider server 400, other application servers 500, a mobile telephone communication server 600 and a base station 600b of a mobile telephone communication network, and a mobile information terminal 700.
[0021] The broadcast receiving device 100 is a television receiver that has a function compatible with the broadcast / communication cooperation system in addition to an existing digital broadcast receiving function. The broadcast receiving device 100 receives broadcast waves transmitted from a radio wave tower 300t via an antenna 100a. The broadcast receiving device 100 can also connect to the Internet 200 via a router device 210, and can transmit and receive data via communication with each server device on the Internet 200.
[0022] Router device 210 is connected to Internet 200 via wireless or wired communication, and is also connected to broadcast receiving device 100 via wireless or wired communication and to mobile information terminal 700 via wireless communication. This allows each server device on Internet 200, broadcast receiving device 100, and mobile information terminal 700 to mutually transmit and receive data via router device 210. Note that communication between broadcast receiving device 100 and mobile information terminal 700 may be performed directly using a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without going through router device 210.
[0023] The radio tower 300t transmits broadcast waves including digital broadcast signals, AIT, control information related to application presentation, etc. from the broadcasting equipment of the broadcasting station. The control information related to application presentation is control information related to the superimposition of broadcast programs and applications on television receivers and whether or not applications can be presented. The broadcasting station is also assumed to have a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata of each broadcast program, such as the program title, program ID, program summary, cast, and broadcast date and time, and is capable of providing the video content and each metadata to a service provider based on a contract. The video content and each metadata may be provided to the service provider via an API (Application Programming Interface) provided by the broadcasting station server 300.
[0024] The service provider server 400 is a server device prepared by a service provider to provide services through the broadcasting and communication collaboration system. The service provider server 400 stores, manages, and distributes video content and metadata provided by the broadcasting station server 300, as well as content and applications created for the broadcasting and communication collaboration system. It also has a function of searching for and providing a list of available applications in response to inquiries from television receivers. The storage, management, and distribution of the content and metadata and the storage, management, and distribution of the applications may be performed by different server devices. The broadcasting station and the service provider may be the same or different providers. Multiple service provider servers 400 may be provided for different services. The functions of the service provider server 400 may also be provided by the broadcasting station server 300.
[0025] The other application server 500 is a known server device that stores, manages, and distributes general applications, operating programs, content, and data other than those related to the broadcasting and communication cooperation system.
[0026] Mobile telephone communication server 600 is connected to Internet 200, and is also connected to mobile information terminal 700 via base station 600b. Mobile telephone communication server 600 manages telephone communications (calls) and data transmission / reception of mobile information terminal 700 via the mobile telephone communication network, and enables transmission / reception of data between mobile information terminal 700 and each server device on Internet 200. Note that communication between mobile information terminal 700 and broadcast receiving device 100 may be performed via base station 600b, mobile telephone communication server 600, Internet 200, and router device 210.
[0027] [Broadcast receiving device hardware configuration] 2A is a block diagram showing an example of the internal configuration of a broadcast receiving device 100. The broadcast receiving device 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an extension interface unit 124, a digital interface unit 125, a tuner / demodulator unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first subtitle decoding unit 135, a data broadcast reception processing unit 141, a data broadcast engine 142, a streaming reception processing unit 151, a second separation unit 152, a second video decoding unit 153, a second audio decoding unit 154, a second subtitle decoding unit 155, an application control unit 161, an application engine 162, a video superimposition unit 171, an audio selection unit 172, a video display unit 173, a speaker 174, a video output unit 175, an audio output unit 176, a presentation synchronization control unit 181, and a terminal cooperation control unit 191.
[0028] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 in accordance with a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block within the broadcast receiving device 100.
[0029] ROM (Read Only Memory) 103 is a memory that stores basic operation programs such as an operating system and other operation programs, and may be a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or flash ROM. RAM (Random Access Memory) 104 serves as a work area when the basic operation programs and other operation programs are executed. ROM 103 and RAM 104 may be integrated with main control unit 101. ROM 103 may also use a partial storage area within storage unit 110, rather than being an independent configuration as shown in FIG. 2A.
[0030] The storage unit 110 stores the operating programs and operation setting values of the broadcast receiving device 100, personal information of the user of the broadcast receiving device 100, etc. It can also store operating programs downloaded from a network and various data created by the operating programs. It can also store content such as moving images, still images, and audio acquired from broadcast waves or downloaded from a network. A portion of the storage unit 110 may replace all or part of the functions of the ROM 103. Furthermore, the storage unit 110 needs to retain the stored information even when power is not supplied to the broadcast receiving device 100 from an external source. Therefore, devices such as semiconductor element memories such as flash ROMs and solid state drives (SSDs), and magnetic disk drives such as hard disk drives (HDDs) are used.
[0031] It should be noted that the operation programs stored in the ROM 103 and the storage unit 110 can be updated and have their functions expanded by downloading them from each server device on the Internet 200 .
[0032] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via a router device 210, and transmits and receives data to and from each server device on the Internet 200. The connection to the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 includes an encoding circuit, a decoding circuit, etc. The broadcast receiving device 100 may further include other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, an infrared communication unit, etc.
[0033] The tuner / demodulator 131 receives broadcast waves from a radio tower 300t via the antenna 100a, and tunes (selects) to a channel of a service desired by the user under the control of the main controller 101. Furthermore, the tuner / demodulator 131 demodulates the received broadcast signal to acquire a TS. Note that while the example shown in FIG. 2A illustrates a configuration with one tuner / demodulator, the broadcast receiving device 100 may be configured to include multiple tuner / demodulators for purposes such as simultaneous display on multiple screens or recording of other programs. Furthermore, under the control of the main controller 101, access restriction control for the demodulated TS may be performed.
[0034] The first separation unit 132 receives the TS output from the tuner / demodulation unit 131, separates it into various data streams such as a video data stream, an audio data stream, a subtitle data stream, a program information data stream, an AIT data stream, and a BML data stream, and outputs the separated data streams. These data streams may be in ES format, for example. The first video decoding unit 133 decodes the video data stream received from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data stream received from the first separation unit 132 and outputs audio information. The first subtitle decoding unit 135 decodes the subtitle data stream received from the first separation unit 132 and outputs subtitle information.
[0035] The data broadcasting reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces a BML document. The data broadcasting engine 142 is a BML browser that executes the BML document, and executes the BML document reproduced by the data broadcasting reception processing unit 141 to output data broadcasting screen information.
[0036] The streaming reception processing unit 151, under the control of the main control unit 101, accesses video content and the like stored in each server device on the Internet 200 via the LAN communication unit 121, and acquires a program stream (PS) of the video content and the like. Also, under the control of the main control unit 101, the streaming reception processing unit 151 may control DRM (Digital Rights Management) processing for the acquired PS.
[0037] Second separator 152 receives the PS output from streaming reception processor 151, separates it into various data streams such as a video data stream, an audio data stream, and a subtitle data stream, and outputs the separated data streams. These data streams may be in ES format, for example. Second video decoder 153, second audio decoder 154, and second subtitle decoder 155 perform the same processing as first video decoder 133, first audio decoder 134, and first subtitle decoder 135, respectively, and therefore their description will be omitted.
[0038] In addition, the first separation unit 132 and the second separation unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, and the first subtitle decoding unit 135 and the second subtitle decoding unit 155 may each be used interchangeably.
[0039] The application control unit 161 controls and manages the life cycle and events of each application by influencing the application engine 162 regarding the application created for the broadcasting and communication cooperation system based on the AIT data string input from the first separation unit or the AIT file acquired from each server device on the Internet 200. The application control unit 161 also controls the function constraints of the application as appropriate depending on the state of the application and the instructions in the AIT. The application engine 162 is an HTML browser that acquires and executes the application created for the broadcasting and communication cooperation system based on the control of the application control unit 161.
[0040] The video superimposition unit 171 receives the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcasting screen information output from the data broadcasting engine 142, the video information output from the second video decoding unit 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162, and performs processing such as selection and / or superimposition. The video superimposition unit 171 includes a video RAM (not shown), and drives the video display unit 173 and the like based on the video information input to the video RAM. Furthermore, under the control of the main control unit 101, the video superimposition unit 171 performs scaling processing, superimposition processing of EPG screen information created based on the program information data string output from the first separation unit 132, and the like, as necessary.
[0041] The audio selection unit 172 inputs audio information output from the first audio decoding unit 134, audio information output from the second audio decoding unit 154, and application execution audio information output from the application engine 162, and selects and outputs the audio information as appropriate in accordance with the control of the main control unit 101.
[0042] The video display unit 173 is a display device such as a liquid crystal panel, and provides the video information that has been selected and / or superimposed by the video superimposing unit 171 to the user of the broadcast receiving device 100. The speaker 174 provides the audio information that has been output from the audio selection unit 172 to the user of the broadcast receiving device 100. The video output unit 175 is a video output interface that outputs the video information that has been selected and / or superimposed by the video superimposing unit 171. The audio output unit 176 is an audio output interface that outputs the audio information that has been output from the audio selection unit 172. As mentioned above, when the broadcast receiving device 100 is a television receiver or the like, the video output unit 175 and the audio output unit 176 are not essential components of the present invention.
[0043] The presentation synchronization control unit 181 controls the presentation synchronization on the video display unit 173 and the speaker 174, or on the video output unit 175 and the audio output unit 176, of the video information, audio information, etc. obtained by decoding the TS obtained from the broadcast waves, the video information, audio information, etc. obtained by decoding the PS obtained from each server device on the Internet 200, and the application execution screen information and application execution audio information output from the application engine 162, based on, for example, PCR information, etc.
[0044] When linking with an external mobile terminal device, the terminal link control unit 191 manages and controls the discovery and authentication of the linked device (mobile terminal device), the connection between the broadcast receiving device 100 and the linked device, the linking of applications, etc.
[0045] The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100, and in this embodiment is configured with an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, etc. The analog video / audio interface inputs analog video signals / audio signals from external video / audio output devices, outputs analog video signals / audio signals to external video / audio input devices, etc. The USB interface connects to a PC or the like to send and receive data. A HDD may be connected to record broadcast programs and content. A keyboard or other USB device may also be connected. The memory interface connects to a memory card or other memory medium to send and receive data.
[0046] The digital interface unit 125 is an interface that outputs or inputs encoded digital video data and / or digital audio data. The digital interface unit 125 is capable of outputting the TS acquired by the tuner / demodulator unit 131 and the PS acquired by the streaming reception processing unit 151 as is. The digital interface unit 125 may also be controlled to input the TS or PS input from the digital interface unit 125 to the first separation unit 132 or the second separation unit 152. The digital content stored in the storage unit 110 may be output or the digital content may be stored in the storage unit 110 via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal, an HDMI terminal, or the like, and may output or input data in a format conforming to the DVI specification, the HDMI specification, or the like. The output or input may be in the form of serial data conforming to the IEEE 1394 specification, or the like.
[0047] The broadcast receiving device 100 may be a television receiver, an optical disc drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disc drive recorder such as an HDD recorder, a set-top box (STB), etc. It may also be a personal computer (PC), tablet terminal, game console, etc. equipped with a digital broadcast receiving function and a broadcast / communication linking function. If the broadcast receiving device 100 is a DVD recorder, HDD recorder, STB, etc., it may not be equipped with the video display unit 173 and the speaker 174. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, it becomes possible to perform the same operation as the broadcast receiving device 100 of this embodiment.
[0048] [Software configuration of broadcast receiving device] 2B is a software configuration diagram of the broadcast receiving device 100 of this embodiment, showing the software configuration in the ROM 103, RAM 104, and storage unit 110. In this embodiment, a basic operation program 1001 and other operation programs are stored in the ROM 103, and a receiving function program 1002, a BML browser program 1003, an HTML browser program 1004, and other operation programs are stored in the storage unit 110. The storage unit 110 is also assumed to include a content storage area 1011 for storing content such as moving images, still images, and audio, an authentication information storage area 1012 for storing authentication information and the like used when linking with an external mobile terminal device, and various information storage areas for storing various other information.
[0049] A basic operation program 1001 stored in ROM 103 is loaded into RAM 104, and the main control unit 101 executes the loaded basic operation program to form a basic operation execution unit 1101. A receiving function program 1002, a BML browser program 1003, and an HTML browser program 1004 stored in the storage unit 110 are loaded into RAM 104, and the main control unit 101 executes each of the loaded operation programs to form a receiving function execution unit 1102, a BML browser engine 1103, and an HTML browser engine 1104. The RAM 104 also includes a temporary storage area for temporarily storing data created when each operation program is executed, as needed.
[0050] For ease of explanation, the process of controlling each operation block by the main control unit 101 expanding the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing it will be described below as if the basic operation execution unit 1101 controls each operation block. Similar descriptions will be used for the other operation programs.
[0051] The reception function execution unit 1102 controls each operational block of the broadcast receiving device 100 to realize the broadcast reception function and the broadcast / communication cooperation function. In particular, the broadcast program playback unit 1102a mainly controls the tuner / demodulator unit 131, the first demultiplexer 132, the first video decoding unit 133, the first audio decoding unit 134, the first subtitle decoding unit 135, the data broadcast reception processing unit 141, and the data broadcast engine 142. The data broadcast engine 142 may be replaced by a BML browser engine 1103 deployed on the RAM 104. The communication content playback unit 1102b mainly controls the streaming reception processing unit 151, the second demultiplexer 152, the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155. The cooperation application control unit 1102c mainly controls the application control unit 161 and the application engine 162. The application engine 162 may be replaced by an HTML browser engine 1104 deployed on the RAM 104. The terminal cooperation management unit 1102d mainly controls the terminal cooperation control unit 191.
[0052] The operation programs may be stored in the ROM 103 and / or the storage unit 110 before the product is shipped. After the product is shipped, the operation programs may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Alternatively, the operation programs may be stored in a memory card, an optical disk, or the like and acquired via the expansion interface unit 124 or the like.
[0053] [Broadcasting station server configuration] 3 is a block diagram showing an example of the internal configuration of the broadcast station server 300. The broadcast station server 300 is made up of a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, and a LAN communication unit 321.
[0054] The main control unit 301 is a microprocessor unit that controls the entire broadcast station server 300 in accordance with a predetermined operation program. The system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block within the broadcast station server 300. The RAM 304 serves as a work area when each operation program is executed.
[0055] The storage unit 310 stores a basic operation program 3001 and a content management / distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. The video content storage area 3011 stores video content and the like of each broadcast program broadcast by a broadcast station. The metadata storage area 3012 stores metadata of each broadcast program, such as the program title, program ID, program summary, cast, broadcast date and time, etc.
[0056] In addition, the basic operation program 3001 and content management / distribution program 3002 stored in the storage unit 310 are each expanded into RAM 304, and the main control unit 301 executes the expanded basic operation program and content management / distribution program to form a basic operation execution unit 3101 and a content management / distribution execution unit 3102.
[0057] For ease of explanation, the process of controlling each operation block by the main control unit 301 expanding the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executing it will be described below as if the basic operation execution unit 3101 were to control each operation block. Similar descriptions will be used for the other operation programs.
[0058] The content management / distribution execution unit 3102 manages the video content and the metadata stored in the video content storage area 3011 and the metadata storage area 3012, and controls the provision of the video content and the metadata to the service provider based on a contract. Furthermore, when providing the video content and the metadata to the service provider, the content management / distribution execution unit 3102 also performs authentication processing of the service provider server 400 based on the contract, as necessary.
[0059] The LAN communication unit 321 is connected to the Internet 200 and communicates with a service provider server 400 and the like on the Internet 200. The LAN communication unit 321 includes an encoding circuit, a decoding circuit, and the like.
[0060] [Service provider server configuration] 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 is made up of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.
[0061] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 in accordance with a predetermined operation program. The system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.
[0062] The storage unit 410 stores a basic operation program 4001, a content management / distribution program 4002, and an application management / distribution program 4003, and further includes a video content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content and the like and each piece of metadata provided from the broadcast station server 300, as well as content produced by the service provider and metadata related to the content. The application storage area 4013 stores applications required to realize each service of the broadcasting / communication cooperation system, which are distributed in response to requests from each television receiver.
[0063] In addition, the basic operation program 4001, content management / distribution program 4002, and application management / distribution program 4003 stored in the storage unit 410 are each expanded into RAM 404, and the main control unit 401 executes the expanded basic operation program, content management / distribution program, and application management / distribution program to form a basic operation execution unit 4101, a content management / distribution execution unit 4102, and an application management / distribution execution unit 4103.
[0064] For ease of explanation, the process of the main control unit 401 controlling each operation block by loading the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executing it will be described below as if the basic operation execution unit 4101 were to control each operation block. Similar descriptions will be used for the other operation programs.
[0065] The content management / distribution execution unit 4102 acquires video content and the like and each piece of metadata from the broadcast station server 300, manages the video content and the like and each piece of metadata stored in the video content storage area 4011 and the metadata storage area 4012, and controls the distribution of the video content and the like and each piece of metadata to each television receiver. The application management / distribution execution unit 4103 manages the applications stored in the application storage area 4013 and controls the distribution of each application in response to a request from each television receiver. Furthermore, when distributing each application to each television receiver, the application management / distribution execution unit 4103 also performs authentication processing of each television receiver as necessary.
[0066] The LAN communication unit 421 is connected to the Internet 200, and communicates with the broadcast receiving device 100 and the mobile information terminal 700 via the broadcast station server 300 on the Internet 200 and the router device 210. The LAN communication unit 421 is assumed to include an encoding circuit, a decoding circuit, etc.
[0067] [Hardware configuration of mobile information terminal] 5A is a block diagram showing an example of the internal configuration of a mobile information terminal 700. The mobile information terminal 700 is composed of a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760.
[0068] The main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700. The system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operating block within the portable information terminal 700.
[0069] The ROM 703 is a memory in which basic operation programs such as an operating system and other operation programs are stored, and a rewritable ROM such as an EEPROM or flash ROM is used. The RAM 704 serves as a work area when the basic operation programs and other operation programs are executed. The ROM 703 and RAM 704 may be integrated with the main control unit 701. Furthermore, the ROM 703 may not be an independent configuration as shown in FIG. 5A, but may use a partial storage area within the storage unit 710.
[0070] The storage unit 710 stores the operating programs and operation setting values of the mobile information terminal 700, personal information of the user of the mobile information terminal 700, etc. It can also store operating programs downloaded from a network and various data created by the operating programs. It can also store content such as moving images, still images, and audio downloaded from a network. A portion of the storage unit 710 may replace all or part of the functions of the ROM 703. The storage unit 710 must also retain the stored information even when power is not being supplied to the mobile information terminal 700 from an external source. Therefore, for example, a flash ROM, SSD, HDD, or other such device is used.
[0071] It should be noted that the operation programs stored in the ROM 703 and storage unit 710 can be updated and have their functions expanded by downloading them from each server device on the Internet 200 .
[0072] The communication processing unit 720 is composed of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via the router device 210 and transmits and receives data to and from each server device on the Internet 200. The connection to the router device 210 is assumed to be wireless, such as via Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (calls) and data transmission and reception via wireless communication with a base station 600b of the mobile telephone network. The NFC communication unit 723 performs wireless communication when in proximity to a compatible reader / writer. The LAN communication unit 721, the mobile telephone network communication unit 722, and the NFC communication unit 723 each include an encoding circuit, a decoding circuit, an antenna, etc. The communication processing unit 720 may further include other communication units, such as a Bluetooth (registered trademark) communication unit or an infrared communication unit.
[0073] The expansion interface unit 724 is a group of interfaces for expanding the functions of the mobile information terminal 700, and in this embodiment is configured with a video / audio interface, a USB interface, a memory interface, etc. The video / audio interface inputs video signals / audio signals from external video / audio output devices, outputs video signals / audio signals to external video / audio input devices, etc. The USB interface connects to a PC or the like to send and receive data. It may also be used to connect a keyboard or other USB device. The memory interface connects to a memory card or other memory medium to send and receive data.
[0074] The operation unit 730 is an instruction input unit that inputs operation instructions to the mobile information terminal 700, and in this embodiment, is configured with a touch panel 730t and operation keys 730k with an array of button switches, which are arranged on top of the display unit 741. Only one of these may be used. The mobile information terminal 700 may be operated using a keyboard or the like connected to the extended interface unit 724. The mobile information terminal 700 may be operated using a separate mobile terminal device connected by wired or wireless communication. The touch panel function may also be provided in the display unit 741.
[0075] The image processing unit 740 is composed of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides image data processed by the image signal processing unit 742 to the user of the mobile information terminal 700. The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on image data input to the video RAM. The image signal processing unit 742 also has functions such as format conversion and superimposition processing of menus and other on-screen display (OSD) signals as necessary. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings or object by converting light input from a lens into an electrical signal using electronic devices such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0076] The audio processing unit 750 is made up of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker, and provides an audio signal processed by the audio signal processing unit 752 to the user of the mobile information terminal 700. The audio input unit 753 is a microphone, and converts the user's voice, etc. into audio data and inputs it.
[0077] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700, and in this embodiment, is composed of a GPS receiver unit 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. These sensors make it possible to detect the position, inclination, direction, and movement of the portable information terminal 700, as well as the ambient brightness and the proximity of surrounding objects. The portable information terminal 700 may further include other sensors such as a barometric pressure sensor.
[0078] The portable information terminal 700 may be a mobile phone, a smartphone, a tablet terminal, etc. It may also be a PDA (Personal Digital Assistant) or a notebook PC. It may also be a digital still camera, a video camera capable of shooting video, a portable game console, or other portable digital devices.
[0079] 5A includes many components that are not essential to this embodiment, such as sensor unit 760, but the effects of this embodiment are not impaired even if these components are not provided. Furthermore, components not shown, such as a digital broadcast receiving function and an electronic money payment function, may be further added.
[0080] [Software configuration of mobile information terminal] 5B is a software configuration diagram of the mobile information terminal 700 of this embodiment, and shows the software configuration in the ROM 703, RAM 704, and storage unit 710. In this embodiment, a basic operation program 7001 and other operation programs are stored in the ROM 703, and a cooperative control program 7002, an HTML browser program 7003, and other operation programs are stored in the storage unit 710. The storage unit 710 is also assumed to include a content storage area 7011 for storing content such as moving images, still images, and audio, an authentication information storage area 7012 for storing authentication information used during cooperative operation with a television receiver, and various information storage areas for storing various other information.
[0081] A basic operation program 7001 stored in ROM 703 is loaded into RAM 704, and the main control unit 701 executes the loaded basic operation program to form a basic operation execution unit 7101. Also, a cooperative control program 7002 and an HTML browser program 7003 stored in the storage unit 710 are loaded into RAM 704, and the main control unit 701 executes each of the loaded operation programs to form a cooperative control execution unit 7102 and an HTML browser engine 7103. Also, the RAM 704 is provided with a temporary storage area for temporarily storing data created when each operation program is executed, as needed.
[0082] For ease of explanation, the process of controlling each operation block by the main control unit 701 loading the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing it will be described below as if the basic operation execution unit 7101 were to control each operation block. Similar descriptions will be used for the other operation programs.
[0083] The cooperative control execution unit 7102 manages device authentication and connection, transmission and reception of various data, etc. when the mobile information terminal 700 performs cooperative operation with the television receiver. The HTML browser engine 7103 is an HTML browser that runs applications created for the broadcasting and communication cooperative system on the mobile information terminal 700.
[0084] The operation programs may be stored in the ROM 703 and / or the storage unit 710 before shipping the product. After shipping the product, the operation programs may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Alternatively, the operation programs may be stored in a memory card, an optical disk, or the like and acquired via the extended interface unit 724 or the like.
[0085] [Application Control Information (AIT) Overview] The application control information (AIT) in this embodiment is information intended to notify a television receiver or the like (the broadcast receiving device 100 in this embodiment) of the existence of an application (hereinafter, sometimes referred to as a broadcast-linked app) that links with a broadcast service and to instruct its control in the broadcast-communication linkage function supported by the broadcast receiving device 100. Note that the broadcast-linked app may be classified into (1) broadcast-managed applications that operate only in a broadcast reception state based on control signals such as start / stop included in a broadcast signal and are permitted to access broadcast resources based on the control signals, (2) non-broadcast-managed applications that are not controlled by broadcast signals for start / stop, etc. and are permitted to access broadcast resources based on means such as application authentication, and (3) other general applications that are not permitted to access broadcast resources.
[0086] The AIT may be transmitted by either of the following methods: transmitting an AIT in section format or extensible markup language (XML) format over broadcast waves using a data carousel (DC) method or the like; or distributing an AIT file in section format or XML format from a server device on the Internet 200 using http (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure) or the like. Other methods may also be used.
[0087] 6 is a data configuration diagram showing an example of the data configuration of an AIT. The AIT is mainly composed of information such as an application type 901, an application identifier 902, an application control code 903, an application profile 904, application acquisition destination information 905, an application boundary and access authority setting 906, a startup priority 907, cache information 908, and a server access distribution parameter 909. In addition, other information may be included.
[0088] The application type 901 specifies the description format of the application. In this embodiment, the description format of the application is assumed to be HTML. The application identifier 902 is identification information for identifying each application, consisting of an organization identifier for identifying the operator and an application identifier assigned to each operator. Note that an application is a set of HTML documents and their reference resources, with the HTML document present in the location specified by the application acquisition destination information 905 being the entry document. The application control code 903 specifies the operation control for the target application, and describes one of (1) auto-start, (2) operable, (3) terminated, or (4) prefetch. The application profile 904 is a value indicating the television receiver functions required by the application, and indicates a combination of optional functions that the television receiver has. By referencing this value, it is determined whether the application can be used.
[0089] The application acquisition destination information 905 is information specifying the acquisition destination of the application, and is location information for acquiring the HTML document that is first referenced when the application is launched. Since it is assumed that the application will be transmitted via broadcast or stored on a server device on a communication network, the location information specified by the application acquisition destination information 905 is also specified to accommodate both broadcast acquisition and communication acquisition. The application boundary and access restriction setting 906 is information indicating the operable range of the broadcast-managed application as a set of one or more areas (URL: Uniform Resource Locator). It also sets access restrictions to broadcast resources for each area on a functional basis. The application boundary and access restriction setting 906 specifies the range of document transitions to prevent unexpected document transitions due to a chain of document transitions from an entry document when the application is launched, or access to inappropriate broadcast resources. It is also possible to set access permissions to specific broadcast resources on an area-by-area basis within the range of the document transitions.
[0090] The launch priority 907 specifies which application is to be launched first when data broadcasting via a broadcasting service and a broadcast-managed application via an HTML document are both present. It is possible to unconditionally specify data broadcasting as the highest priority in the PMT, to specify the launch priority of a specific application type in the PMT, and to specify the launch priority of the target application using the launch priority 907. The cache information 908 is information used for cache control when retaining application resources in preparation for application reuse. This information makes it possible to cache application resources for reuse even after the application has terminated. The server access distribution parameter 909 is a parameter set for distributing access in order to reduce the load on servers that are heavily accessed, such as those that acquire applications. The television receiver may operate to probabilistically delay the application of application control codes according to the parameter settings.
[0091] The operation of the broadcast receiving device 100 of this embodiment will be described below.
[0092] [Application startup sequence] First, a description will be given of the process of launching a broadcast-linked app based on the AIT transmitted by broadcast waves in the broadcast receiving device 100 of this embodiment. In the broadcast receiving device 100 of this embodiment, it is possible to specify which of the two is to be launched first when a data broadcast by a broadcast service and a broadcast-linked app are simultaneously present, based on information on the PMT and information such as the application control code 903 and launch priority 907 in the AIT.
[0093] 7A is an operational sequence diagram showing an example of the operational sequence of a broadcast-linked app when it is specified that the broadcast-linked app is to be launched with priority. The diagram shows a series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it launches a predetermined broadcast-linked app.
[0094] When the tuner / demodulator unit 131 of the broadcast receiving device 100 performs processing for selecting a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S101) and checks the startup priority described in the PMT. If it is confirmed in the processing of S101 that the startup priority of the broadcast-linked app is high (S102), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S103) and checks the application control code 903 of the acquired AIT data sequence (S104). If the application control code 903 is "automatic startup" in the processing of S104, the application control unit 161 further checks the application profile 904 of the acquired AIT data sequence (S105). If it is confirmed that the broadcast-linked app specified in the AIT can be executed, a transmission request for the broadcast-linked app is sent to a predetermined service provider server 400 via the LAN communication unit 121 based on the information described in the application acquisition destination information 905 (S106).
[0095] Upon receiving the request to transmit the broadcast-interactive app, the service provider server 400 performs authentication processing of the broadcast receiving device 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast-interactive app stored in the application storage area 4013 via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication processing, and detailed description thereof will be omitted. Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 launches the predetermined broadcast-interactive app received from the service provider server 400 via the LAN communication unit 121 (S108).
[0096] 7B is an operational sequence diagram showing an example of the operational sequence of a broadcast-linked app when it is specified that data broadcasting by a broadcast service is to be started first. The diagram shows a series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts a predetermined broadcast-linked app.
[0097] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing to select a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132 (S201) and checks the activation priority described in the PMT. If the processing of S201 confirms that the activation priority of data broadcasting by the broadcast service is high (S202), the data broadcasting reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and plays back the BML document (S203). If automatic activation of data broadcasting is set by the BML document, or if the user makes a data broadcasting activation request using an operation terminal (mobile information terminal 700, remote control, etc.) (S204), the data broadcasting engine 142 executes the played BML document to generate data broadcasting screen information and displays it on the video display unit 173 (S205).
[0098] After the process of S205, or simultaneously with the process of S205, the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S206) and checks the application profile 904 of the acquired AIT data sequence (S207). If it is confirmed in the process of S207 that the broadcast-linked application specified in the AIT is executable, an entry button for the executable broadcast-linked application is displayed on the data broadcast screen. The entry button may be always displayed, and its color may be changed from an inactive color to an active color only when the broadcast-linked application is executable. The entry button may be switched between an inactive state and an active state by changing its shape.
[0099] When the user selects the entry button using the operation terminal (S208), the data broadcasting engine 142 executes the BML document and ends the process of generating data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and checks the application acquisition destination information 905 of the acquired AIT data string. Furthermore, based on the information described in the application acquisition destination information 905 checked in S210, a transmission request for the broadcast cooperative app is sent to a predetermined service provider server 400 via the LAN communication unit 121 (S211).
[0100] Upon receiving the request to transmit the broadcast-interactive app, the service provider server 400, under the control of the application management / distribution execution unit 4103, performs authentication processing of the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast-interactive app stored in the application storage area 4013 via the LAN communication unit 421 (S212). Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast-interactive app that has been received from the service provider server 400 via the LAN communication unit 121 (S213).
[0101] 7C is an operational sequence diagram showing an example of the operational sequence of a broadcast-linked app when no priority startup is specified. The diagram shows a series of steps from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts a predetermined broadcast-linked app.
[0102] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing to select a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S301) and checks the startup priority described in the PMT. If it is confirmed in the processing of S301 that the startup priority of the broadcast-linked app is high (S302), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S303) and checks the application control code 903 of the acquired AIT data sequence (S304). If the application control code 903 is "startable" rather than "automatic startup" in the processing of S304, the display of the broadcast program continues without starting either the data broadcast by the broadcast service or the broadcast-linked app.
[0103]
[0073] After the process of S304 is completed, if the user uses the operation terminal to make a request to start data broadcasting (S305), similar to the processes from S205 onwards in Fig. 7B, the acquisition of a BML data string, the playback of a BML document, and the generation of data broadcasting screen information are performed (however, not shown). On the other hand, after the process of S304 is completed, if the user uses the operation terminal to make a request to start a broadcast-linked application launcher (S306), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S307) and checks the application profile 904 of the acquired AIT data string (S308). Furthermore, the application control unit 161 displays a list of executable broadcast-linked applications on the video display unit 173 as a broadcast-linked application launcher (S309).
[0104] When the user uses the operation terminal to select a predetermined broadcast-linked app from the broadcast-linked app launcher displayed in S309 (S310), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S311) and checks the application acquisition destination information 905 of the acquired AIT data string. Furthermore, based on the information described in the application acquisition destination information 905 checked in S311, a transmission request for the broadcast-linked app is sent to the predetermined service provider server 400 via the LAN communication unit 121 (S312).
[0105] Upon receiving the transmission request for the broadcast-interactive app, the service provider server 400, under the control of the application management / distribution execution unit 4103, performs authentication processing for the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast-interactive app stored in the application storage area 4013 via the LAN communication unit 421 (S313). Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast-interactive app that has been received from the service provider server 400 via the LAN communication unit 121 (S314).
[0106] 7A to 7C, an example is described in which the AIT is acquired from a broadcast wave. However, the AIT file may be acquired from a predetermined server device specified by the information description in the PMT or the like. Furthermore, the broadcast-linked app may be acquired from a broadcast wave, rather than from a server device (service provider server 400) on the network. That is, when the location information described in the application acquisition destination information 905 of the AIT indicates a broadcast wave, the application control unit 161 reproduces an HTML document from the HTML data string transmitted by a data carousel method or the like and separated and output by the first separation unit 132, and the application engine 162 executes the reproduced HTML document (broadcast-linked app).
[0107] Note that if there is no information on the PMT specifying the startup priority when data broadcasting by a broadcasting service and a broadcast-linked app exist simultaneously, the startup priority may be confirmed only by information such as the application control code 903 and startup priority 907 of the AIT. Similarly, if acquisition of the information on the PMT fails, the startup priority may be confirmed only by information such as the application control code 903 and startup priority 907 of the AIT. That is, the AIT may be checked periodically regardless of the information on the PMT, and if a broadcast-linked app specified as "automatic startup" in the application control code 903 of the AIT exists, startup of the broadcast-linked app may be prioritized, and if a broadcast-linked app specified as "automatic startup" in the application control code 903 of the AIT does not exist, startup of data broadcasting by a broadcasting service may be prioritized.
[0108] Furthermore, if there is no response from service provider server 400 for a predetermined time or longer when a distribution request for the broadcast-linked app is made in S106, S211, or S312, a message such as "Please wait a moment" may be displayed on video display unit 173. Alternatively, in this case, a message inquiring the user about stopping execution of the broadcast-linked app may be displayed.
[0109] Furthermore, it goes without saying that the start-up sequence of the broadcast-linked app is not limited to the three patterns described above, and the broadcast-linked app may be started up by a different sequence.
[0110] [Operation sequence when linking mobile information terminals] In the broadcast receiving device 100 of this embodiment, it is assumed that the functionality of a broadcast / communication cooperative service can be expanded by cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700. For example, by installing an application (cooperative control app) provided by a television receiver manufacturer, it becomes possible to use the mobile information terminal 700 as a high-function remote control for the broadcast receiving device 100. In addition, by executing the broadcast cooperative app on the mobile information terminal 700, it becomes possible to display, for example, a service linked to a broadcast program being displayed on the broadcast receiving device 100 on the mobile information terminal 700. Note that in order to expand functionality through cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700, it is desirable that the cooperative control app be running on the mobile information terminal 700, and the broadcast cooperative app running on the mobile information terminal 700 operates under the control of the cooperative control app.
[0111] 8A is an operational sequence diagram showing an example of the operational sequence when the cooperative control app is started on the mobile information terminal 700. The diagram shows a series of steps (first time) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until cooperative operation becomes possible. It is assumed that the cooperative control app is installed in advance in the storage unit 710 of the mobile information terminal 700 as a cooperative control program 7002.
[0112] When a user issues an instruction to launch a cooperative control app on the mobile information terminal 700 (S401), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for television receivers on the network that are capable of communication (cooperative operation) (S402) and displays the search results as a list of television receivers on the display unit 741. If no television receivers that are capable of communication are found, a message to that effect is displayed and the processing ends. When the user selects an arbitrary television receiver (broadcast receiving device 100 in this embodiment) from the list of television receivers, the cooperative control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. When the user inputs authentication information (such as a login name and password specified by the broadcast receiving device 100) into the login screen via the operation unit 730 (S403), the cooperative control execution unit 7102 stores the input authentication information in the authentication information storage area 7012 and simultaneously transmits the information to the broadcast receiving device 100 (S404). The authentication information may be transmitted to the broadcast receiving device 100 via the LAN communication unit 721 and the router device 210, or may be transmitted directly to the broadcast receiving device 100 via the NFC communication unit 723.
[0113] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S405). If the received authentication information is confirmed to be correct by the processing of S405, the terminal cooperation control unit 191 stores information about the mobile information terminal 700 in the authentication information storage area 1012 and authenticates the mobile information terminal 700 (S406). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control app (e.g., an advanced remote control screen) on the display unit 741 (S407). If the received authentication information is not confirmed to be correct in S405, the terminal cooperation control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. Through the above processing, cooperation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0114] 8B is an operational sequence diagram showing an example of the operational sequence when the cooperative control app is started on the mobile information terminal 700. The diagram shows a series of steps (from the second time onwards) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until cooperative operation becomes possible.
[0115] When a user instructs the mobile information terminal 700 to launch a cooperative control app (S501), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for television receivers on the network that can communicate with the mobile information terminal 700 and displays the search results as a list of television receivers on the display unit 741. If no television receivers that can communicate with the mobile information terminal 700 are found, a message to that effect is displayed and the processing ends. When the user selects an arbitrary television receiver (broadcast receiving device 100 in this embodiment) from the list of television receivers (S502), and the selected broadcast receiving device 100 is a device that has previously connected (operated cooperatively), the cooperative control execution unit 7102 reads out authentication information for the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S503).
[0116] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S504). If the received authentication information is confirmed to be correct by the processing of S504, it authenticates the mobile information terminal 700 (S505). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control app on the display unit 741 (S506). Through the above processing, cooperation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0117] Note that, when starting up a broadcast cooperative app in the broadcast receiving device 100 following the processing of FIGS. 8A and 8B, the processing of FIGS. 7A to 7C may be performed after the processing of FIGS. 8A and 8B.
[0118] 8C is an operational sequence diagram showing an example of the operational sequence when the cooperative control app is launched on the mobile information terminal 700. The diagram shows a series of steps (from the second time onward) in which the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 and cooperative operation becomes possible. However, the diagram shows an example in which the broadcast receiving device 100, which executes the launch sequence of the broadcast cooperative app, requests the launch of the cooperative control app on the mobile information terminal 700.
[0119] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing to select a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data sequence separated by the first separation unit 132 (S601) and checks the startup priority described in the PMT. If it is confirmed in the processing of S601 that the startup priority of the broadcast-linked application is high (S602), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S603) and checks the application control code 903 of the acquired AIT data sequence (S604). If the application control code 903 is "automatic startup" in the processing of S604, the application control unit 161 further checks the application profile 904 of the acquired AIT data sequence (S605). In the processing of S605, if it is confirmed that the broadcast-linked app specified in the AIT can be executed and if it is determined that linked control of the mobile terminal device is necessary, the terminal linkage control unit 191 selects the mobile information terminal 700 as the mobile terminal device by referring to the authentication information storage area 1012, and sends a linkage control app launch request to the selected mobile information terminal 700 (S606).
[0120] The selection of the mobile information terminal 700 by referring to the authentication information storage area 1012 may be based on the latest information in the authentication information storage area 1012 or the most frequently used information in the authentication information storage area 1012.
[0121] Furthermore, in the process of S606, if a mobile terminal device to which the cooperative control application start-up request should be sent cannot be found, a message indicating this may be displayed on the video display unit 173. Alternatively, in this case, a message inquiring the user about stopping execution of the broadcast cooperative application may be displayed.
[0122] The main control unit 701 of the mobile information terminal 700 launches the collaborative control app (collaborative control execution unit 7102) in response to the collaborative control app launch request received via the LAN communication unit 721 (S607), and the collaborative control execution unit 7102 then reads out the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).
[0123] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S609). If the processing of S609 confirms that the received authentication information is correct, it authenticates the mobile information terminal 700 (S610). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control app on the display unit 741 (S611). Through the above processing, cooperation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0124] Note that, if the broadcast cooperative app is executed on both the broadcast receiving device 100 and the mobile information terminal 700 following the above-described processing, the processing shown in Fig. 9 may be performed. Fig. 9 is an operational sequence diagram showing an example of a start-up sequence of the broadcast cooperative app on the broadcast receiving device 100 and the mobile information terminal 700.
[0125] 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data sequence separated by the first separation unit 132 (S612), and checks the application acquisition destination information 905 of the acquired AIT data sequence. Furthermore, based on the information described in the application acquisition destination information 905 checked in S612, a transmission request for the broadcast cooperative app (TV side) is sent to a predetermined service provider server 400 via the LAN communication unit 121 (S613).
[0126] Upon receiving the transmission request for the broadcast-interactive app (television side), the service provider server 400, under the control of the application management / distribution execution unit 4103, performs authentication processing for the broadcast receiving device 100 as necessary, and then distributes the predetermined broadcast-interactive app (television side) stored in the application storage area 4013 via the LAN communication unit 421 (S614). Under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast-interactive app (television side) that has been received from the service provider server 400 via the LAN communication unit 121 (S615).
[0127] Next, the terminal cooperation control unit 191 of the broadcast receiving device 100 transmits to the mobile information terminal 700, information such as URL information of the acquisition source of the broadcast cooperation app (terminal side) to be executed on the mobile information terminal 700, which information was acquired from the AIT or the broadcast cooperation app (television side) executed in S615 (S616). The cooperation control execution unit 7102 of the mobile information terminal 700 transmits a transmission request of the broadcast cooperation app (terminal side) to a predetermined service provider server 400 via the LAN communication unit 721, based on the URL information of the acquisition source of the broadcast cooperation app (terminal side) received via the LAN communication unit 721 (S617).
[0128] Upon receiving the transmission request for the broadcast-linked app (terminal side), the service provider server 400, under the control of the application management / distribution execution unit 4103, performs authentication processing for the mobile information terminal 700 as necessary, and then distributes the predetermined broadcast-linked app (terminal side) stored in the application storage area 4013 via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 starts the predetermined broadcast-linked app (terminal side) received from the service provider server 400 via the LAN communication unit 721 (S619).
[0129] 7A to 7C , the AIT file can be acquired from a predetermined server device, and the broadcast-linked app can be acquired from broadcast waves rather than from a server device on a network. When the broadcast-linked app is acquired from broadcast waves, the broadcast receiving device 100 may acquire the broadcast-linked app (terminal side) to be executed on the mobile information terminal 700 from the broadcast waves and transfer the acquired broadcast-linked app (terminal side) to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 may acquire the broadcast-linked app (terminal side) to be executed on the mobile information terminal 700 from the broadcast waves and store it in the storage unit 110, and in the process of S616 in FIG. 9 , transmit location information of the storage unit 110 of the broadcast receiving device 100 as URL information to be transmitted to the mobile information terminal 700. The broadcast receiving device 100 may acquire the broadcast-linked app (TV side) from broadcast waves, and the mobile information terminal 700 may acquire the broadcast-linked app (terminal side) from a server device on the network. The mobile information terminal 700 may also acquire the broadcast-linked app (terminal side) directly from broadcast waves using a digital broadcast receiving function that the mobile information terminal 700 has.
[0130] In addition, the operation sequences of Figures 7A to 7C, Figures 8A to 8C, and Figure 9 can be partially combined as appropriate, and some operation steps can be rearranged in order or operated simultaneously with other operation steps as appropriate.
[0131] [Mobile device linkage control app basic screen] 10A is a screen display diagram showing an example of a basic screen of the cooperative control app displayed by the process of S407 in Fig. 8A, the process of S506 in Fig. 8B, the process of S611 in Fig. 8C, etc. In this embodiment, the basic screen 741a of the cooperative control app has the function of a high-performance remote control compatible with the broadcast receiving device 100.
[0132] 10A, the basic screen 741a of the linked control app is configured with a power key 741a1, a network selection key (digital terrestrial, BS, CS) 741a2, number keys (1 to 12) 741a3, volume UP / DOWN keys 741a4, channel UP / DOWN keys 741a5, input switch key 741a6, program guide key 741a7, data key 741a8, linked app key 741a9, menu key 741aa, back key 741ab, cursor keys (up, down, left, right) 741ac, enter key 741ad, and color keys (blue, red, green, yellow) 741ae. Other operation keys may also be displayed.
[0133] For ease of use, the operation keys may have the same key layout / operation as that of a dedicated remote control attached to broadcast receiving device 100. Furthermore, power key 741a1, network selection key 741a2, numeric keys 741a3, etc. have the same functions as the operation keys of a known television remote control, and detailed description thereof will be omitted. Linked application key 741a9 is an operation key provided for the broadcast / communication linking function of this embodiment.
[0134] In the processing of S204 in Fig. 7B and S305 in Fig. 7C, it is assumed that data broadcasting can be started / ended by selecting the data key 741a8. Also, in the processing of S208 in Fig. 7B and S310 in Fig. 7C, it is assumed that the executable broadcast-linked application can be selected by operating the cursor keys 741ac and the enter key 741ad. Also, in the processing of S306 in Fig. 7C, it is assumed that a request to start the broadcast-linked application launcher can be made by selecting the linked application key 741a9.
[0135] In this way, by providing linked application key 741a9 or another operation key having a similar function on basic screen 741a of the linked control application, it becomes possible to easily select / launch each broadcast linked application used in the broadcast linked system of this embodiment. Also, linked application key 741a9 or another operation key having a similar function may be provided on a dedicated remote control attached to broadcast receiving device 100.
[0136] FIG. 10B is a screen display diagram showing an example of the basic screen of the collaborative control app displayed by processing S407 in FIG. 8A, processing S506 in FIG. 8B, processing S611 in FIG. 8C, etc., and is an example different from FIG. 10A.
[0137] The basic screen 741b of the cooperative control app is composed of a cooperative control in progress message 741b1 and a cooperative control app operation screen 741b2. Other objects may also be displayed. The cooperative control in progress message 741b1 is a message display that notifies the user that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. The cooperative control app operation screen 741b2 is an area where any screen display is performed by the cooperative control app, and detailed description thereof will be omitted in this embodiment. For example, the configuration within the cooperative control app operation screen 741b2 may be the same as the configuration of the basic screen 741a of the cooperative control app described above. A sub-screen of a broadcast program being displayed on the broadcast receiving device 100 may also be displayed.
[0138] 10B, by displaying cooperative control in progress message 741b1, the user of mobile information terminal 700 can easily understand that mobile information terminal 700 is operating in cooperative control with broadcast receiving device 100. Note that cooperative control in progress message 741b1 is not limited to text display, and may be symbol display, graphic display, etc. A different background color, etc. may be used as an alternative to cooperative control in progress message 741b1.
[0139] [Data broadcasting screen on broadcast receiving device] Fig. 11 is a screen display diagram showing an example of a data broadcast screen displayed by the processing of S205 in Fig. 7B. In this embodiment, it is assumed that three broadcast cooperative applications, i.e., cooperative application A, cooperative application B, and cooperative application C, are executable on the broadcast receiving device 100 based on the description in the AIT, etc. In this case, an entry button 173a2 for cooperative application A, an entry button 173a3 for cooperative application B, and an entry button 173a4 for cooperative application C are displayed at arbitrary positions on the data broadcast screen 173a.
[0140] On the data broadcasting screen 173a as shown in FIG. 11, when the entry button 173a2, entry button 173a3, entry button 173a4, etc. is selected using the cursor keys 741ac and the decision key 741ad on the basic screen 741a of the collaborative control app, the display of the data broadcasting screen 173a is terminated and collaborative app A, collaborative app B, collaborative app C, etc. are launched under the control of the application control unit 161 and the application engine 162.
[0141] When displaying data broadcast screen 173a, the frame color, interior color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on the type of broadcast cooperative application, security status, etc. For example, if cooperative application A is a broadcast-managed application, the frame color of entry button 173a2 may be blue; if cooperative application B is a non-broadcast-managed application, the frame color of entry button 173a3 may be yellow; if cooperative application C is a general application, the frame color of entry button 173a4 may be red; etc. Alternatively, if cooperative application A is determined to be reliable in terms of security, the frame color of entry button 173a2 may be blue; if cooperative application B is determined not to be necessarily reliable in terms of security, the frame color of entry button 173a3 may be yellow; and if cooperative application C is determined to be a security risk, the frame color of entry button 173a4 may be red; etc.
[0142] In addition, the frame color, interior color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on the function or genre of the broadcast-linked app, or depending on the expiration date of each broadcast-linked app, etc. The frame color, interior color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on whether the broadcast-linked app has already been acquired from the network, etc. For example, if the linked app A has already been acquired from the network (cached in RAM 104 or storage unit 110), the frame color of entry button 173a2 may be blue; if the linked app B is being acquired, the frame color of entry button 173a3 may be yellow; and if the linked app C has not yet been acquired, the frame color of entry button 173a4 may be red.
[0143] In this way, the user of the broadcast receiving device 100 can easily grasp the types of broadcast cooperative applications that can be executed on the broadcast receiving device 100, the security status, and the like.
[0144] [Broadcast-linked app launcher screen on broadcast receiving device] FIG. 12A is a screen display diagram showing an example of a notification screen for making the user aware that there is a broadcast cooperative app that can be launched in the broadcast receiving device 100 of this embodiment.
[0145] For example, in the operation sequence shown in Fig. 7C, after the processing of S304, the display of the broadcast program continues without launching either the data broadcast by the broadcast service or the broadcast-linked app. On the other hand, in this case, if an icon 173b0 as shown in Fig. 12A is displayed to let the user know that there is a broadcast-linked app that can be launched, the usability of the broadcast receiving device 100 is improved. In other words, by displaying the icon 173b0, it is possible to prevent the user from missing the existence of a broadcast-linked app that can be launched.
[0146] The icon 173b0 may be displayed anywhere on the screen, but it is desirable that it be displayed in a location that does not interfere with viewing of the broadcast program. For example, it may be displayed in one of the four corners of the screen. The icon 173b0 may be displayed as text as shown in FIG. 12A, or may be a symbol, graphic, or the like. The icon 173b0 may be displayed all the time, or may be displayed for a predetermined period of time after the power is turned on or the channel is changed. Alternatively, the icon 173b0 may be displayed simultaneously with program information, channel numbers, and the like.
[0147] 12B is a screen display diagram showing an example of a broadcast cooperative app launcher displayed by the processing of S306 in FIG. 7C. In this embodiment, it is assumed that three broadcast cooperative apps, cooperative app A, cooperative app B, and cooperative app C, are executable on the broadcast receiving device 100 based on the description in the AIT or the like. In this case, a broadcast cooperative app launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b, and furthermore, an entry button 173b2 for cooperative app A, an entry button 173b3 for cooperative app B, an entry button 173b4 for cooperative app C, and a back button 173b5 are displayed within the broadcast cooperative app launcher 173b1.
[0148] 12B is displayed, when an entry button 173b2, an entry button 173b3, an entry button 173b4, or the like is selected using cursor keys 741ac and enter key 741ad on the basic screen 741a of the cooperative control app, cooperative app A, cooperative app B, cooperative app C, or the like is started under the control of the application control unit 161 and the application engine 162. When the back button 173b5 is selected, the display of the broadcast cooperative app launcher 173b1 is terminated.
[0149] When displaying the broadcast linked app launcher 173b1 on the broadcast program screen 173b, the frame color, inner color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on the type and security status of the broadcast linked app, the function and genre of the broadcast linked app, the acquisition status of the broadcast app from the network, etc., just as when displaying the entry button of each broadcast linked app on the data broadcast screen 173a of Figure 11.
[0150] Furthermore, the broadcast linked application launcher 173b1 may not be displayed if there is no broadcast linked application that can be executed by the broadcast receiving device 100. Alternatively, in this case, a message such as "There is no available application" may be displayed inside the broadcast linked application launcher 173b1.
[0151] [Broadcast linkage app execution screen on broadcast receiving device] FIG. 13A is a screen display diagram showing an example of a broadcast cooperative app execution screen displayed in the process of S108 in FIG. 7A, the process of S213 in FIG. 7B, the process of S314 in FIG. 7C, the process of S615 in FIG. 9, etc. The broadcast cooperative app of this embodiment is equipped with graphics capabilities and effect capabilities using HTML description, and is capable of overlay display with a broadcast program screen on the video display unit 173. For example, as shown in FIG. 13A, a broadcast cooperative app unit 173c1 that displays information such as a weather forecast and news is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. The broadcast cooperative app unit 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, a background object 173c5, etc. Other objects may also be displayed.
[0152] When the broadcast cooperative app section 173c1 is overlaid on the broadcast program screen 173c, the execution of the broadcast cooperative app can be terminated and the display can be switched to the data broadcast screen by selecting the data key 741a8 on the basic screen 741a of the cooperative control app. Furthermore, the execution of the broadcast cooperative app can be terminated and the display can be switched back to the broadcast program screen 173c only by selecting the cooperative app key 741a9 on the basic screen 741a of the cooperative control app. The above process may be realized by a different operation key.
[0153] In addition, while the broadcast cooperative application section 173c1 is overlaid on the broadcast program screen 173c, the transparency of the broadcast cooperative application section 173c1 can be changed by operating each operation key on the basic screen 741a of the cooperative control application. The transparency change process may be performed collectively on the entire broadcast cooperative application section 173c1, or may be performed individually on the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5. It may also be performed for each predetermined group (for example, multiple objects existing on the same graphics layer).
[0154] When performing the transparency change process, for example, an object is selected using cursor keys 741ac on basic screen 741a of the collaboration control app, and the transparency of the object is increased by pressing the “blue” key on color keys 741ae and decreased by pressing the “yellow” key. The transparency change process may also be performed using different operation keys. By simultaneously setting the transparency of the entire broadcast collaboration app unit 173c1 to 100%, the broadcast collaboration app unit 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed via broadcast waves, the transparency of the entire broadcast collaboration app unit can be set to 100%, and only the broadcast program screen of the emergency broadcast can be displayed on video display unit 173. Alternatively, a commercial detection unit (not shown) may detect that the broadcast program has switched from the main video to a commercial video and control the transparency of the entire broadcast collaboration app unit 173c1 to 100% (or a transparency that allows the broadcast program video to be clearly seen).
[0155] By performing the above-described processing, if you want to check the broadcast program screen in the background while the broadcast linked app is running, you can check the broadcast program screen without terminating the broadcast linked app.
[0156] 13B is a screen display diagram showing an example of the broadcast cooperative app execution screen displayed in the process of S108 in FIG. 7A, the process of S213 in FIG. 7B, the process of S314 in FIG. 7C, the process of S615 in FIG. 9, etc., different from those described above. In the example shown in FIG. 13B, a broadcast cooperative app section 173c6 introducing recommended programs is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. The broadcast cooperative app section 173c6 displays first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, etc. More recommended program information may be displayed by scrolling, page switching, etc.
[0157] The recommended program information may be information on a program recommended in relation to the currently displayed broadcast program (broadcast program screen 173c), information on a program recommended based on the user's viewing history, or information on a program that is currently a hot topic on the Internet, etc. It may also be information on a recommended program sent to the user by a friend of the user of broadcast receiving device 100. The recommended program may also be a program transmitted by broadcast waves of a digital broadcast service, or a VOD (Video On Demand) program distributed from a server device on the Internet 200. It may also be an information screen such as a homepage prepared on a server device on the Internet 200.
[0158] When the broadcast linked application section 173c6 is overlaid on the broadcast program screen 173c, the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. can be selected using the cursor keys 741ac and the decision key 741ad on the basic screen 741a of the linked control application, and the program images recommended in the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. will be displayed in the image display section 173.
[0159] FIG. 13C is a screen display diagram illustrating an example in which a program video recommended by the broadcast cooperative application section 173c6 that introduces recommended programs is displayed. For example, when first recommended program information 173c7 of the broadcast cooperative application section 173c6 is selected using the cursor keys 741ac and the enter key 741ad on the basic screen 741a of the cooperative control application, a program video 173ca of the program recommended by the first recommended program information 173c7 is displayed in the video display section 173. The program video 173ca may be paused or jumped to a specified time by the user's operation of the operation terminal. Furthermore, when displaying the program video 173ca, the original broadcast program screen 173c may be displayed at any position in a picture-in-picture (PIP) format. In this case, the user may be able to change whether the program video 173ca of the recommended program or the original broadcast program screen 173c is the main screen by operating the operation terminal. The window size of the original broadcast program screen 173c may be adjustable by operating the operation terminal.
[0160] Furthermore, by displaying an icon display 173cb at an arbitrary position on the screen, which indicates that the program video 173ca of the recommended program is a video displayed by selecting any of the recommended program information displayed in the broadcast-linked application section 173c6, convenience for the user can be improved. Needless to say, the transparency of the broadcast-linked application section 173c6 may also be changed on the broadcast-linked application execution screen shown in FIG. 13B in the same manner as described above.
[0161] 13D is a screen display diagram showing an example of a broadcast-linked app execution screen different from those described above, which is displayed in the process of S108 in FIG. 7A, the process of S213 in FIG. 7B, the process of S314 in FIG. 7C, the process of S615 in FIG. 9, etc. In the example shown in FIG. 13D, a broadcast-linked app section 173cc, which serves as a portal for an SNS (Social Networking Service) service, is overlaid and displayed at an arbitrary position on a broadcast program screen 173c. The broadcast-linked app section 173cc displays an entry button 173cd for a first SNS service, an entry button 173ce for a second SNS service, an entry button 173cf for a third SNS service, etc. Entry buttons for even more SNS services may be displayed by scrolling, page switching, etc.
[0162] With the broadcast cooperation app section 173cc overlaid on the broadcast program screen 173c, the cursor keys 741ac and the enter key 741ad on the basic screen 741a of the cooperation control app can be used to select an entry button 173cd for the first SNS service, an entry button 173ce for the second SNS service, an entry button 173cf for the third SNS service, or the like, to activate functions assigned to each entry button, such as a chat function, a bulletin board function, or an internet telephone function. This allows users to enjoy the currently displayed broadcast program (broadcast program screen 173c) while exchanging information with others. At the same time, the basic screen 741a of the cooperation control app on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard or a voice input screen for chatting or posting on a bulletin board by voice input.
[0163] Furthermore, in addition to the above-described examples, the broadcast cooperative app executable by the broadcast receiving device 100 of this embodiment may be one that uses a cooperative function between the broadcast receiving device 100 and the mobile information terminal 700, and further synchronizes with the timing of broadcasting a commercial, so that a related commercial app is presented on both the broadcast receiving device 100 and the mobile information terminal 700. Alternatively, for a paid service available on the broadcast receiving device 100, the broadcast cooperative app may check whether the user of the broadcast receiving device 100 has subscribed to the paid service, and change the display of the broadcast receiving device 100 and / or the mobile information terminal 700 depending on the result. In the broadcast receiving device 100 of this embodiment, regardless of which broadcast cooperative app is executed, it is possible to enjoy the effects described using Figures 13A, 13B, etc.
[0164] [Broadcast receiver error display screen] Figure 14 is a screen display diagram showing an example of an error display screen when it is determined that the broadcast-linked app cannot be executed by checking the application profile 904 of the acquired AIT data string in the processing of S105 in Figure 7A, the processing of S207 in Figure 7B, the processing of S308 in Figure 7C, the processing of S605 in Figure 8C, etc., when there is an insufficient description in the AIT, or when acquisition of the AIT has failed.
[0165] In the broadcast receiving device 100 of this embodiment, when it is determined that the broadcast-linked app cannot be executed, the reason why the broadcast-linked app cannot be executed, such as the result of checking the application profile 904, is displayed in an error message 173d1. For example, if the result of checking the application profile 904 indicates that a predetermined optional function is missing from the television receiver, this information is displayed in the error message 173d1. An error code and a link (such as a URL) to the television receiver manufacturer's website containing an explanation of the error code may also be displayed. Alternatively, when the broadcast-linked app is acquired from a network, the network connection status is naturally checked in advance. At this time, if the broadcast-linked app cannot be acquired due to, for example, an improper LAN cable connection, this information is displayed in the error message 173d1. Furthermore, the error message 173d1 may also be displayed when a network connection is established but the broadcast-linked app cannot be properly acquired due to poor error conditions. The error message 173d1 may also be displayed when the broadcast-linked app is not yet ready to be executed while the broadcast-linked app is being acquired. Error message 173d1 may also be displayed when the broadcast wave reception status is unstable and information such as the AIT can be received at first but then becomes unable to be received halfway through, etc. In such a case, if the broadcast-linked app obtained from each server device is cached as is, it can be used as is after the broadcast wave reception status is restored.
[0166] Furthermore, if the result of checking the application profile 904 indicates that the television receiver lacks a predetermined optional function, an error message 173d1 may be displayed recommending checking for or updating the latest television receiver firmware. Alternatively, the broadcast receiving device 100 may automatically check for or update the latest firmware. Alternatively, if the broadcast-linked app can be executed by adding paid optional hardware or optional software to the television receiver, information about the paid optional hardware or optional software may be displayed. Note that the error message 173d1 may be displayed on the mobile information terminal 700 rather than on the broadcast receiving device 100.
[0167] [Broadcast linkage app execution screen on mobile information terminal] Fig. 15 is a screen display diagram showing an example of the broadcast cooperative app (terminal side) execution screen displayed in the processing of S619 in Fig. 9. The broadcast cooperative app execution screen 741c shown in Fig. 15 is composed of a main window 741c1, a sub-window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may also be added.
[0168] In this embodiment, the broadcast cooperative app (terminal side) executed on the mobile information terminal 700 is an application for checking details of a broadcast program being displayed on the broadcast receiving device 100. The main window 741c1 displays the same image as the broadcast program screen being displayed on the broadcast receiving device 100, and the sub-window 741c2 displays an enlarged image of a position designated by a selection marker 741c3. The position of the selection marker 741c3 can be changed by selecting cursor keys 741c4 and 741c5. The commentary display area 714c6 displays commentary subtitles about the broadcast program being displayed on the main window 741c1, comments posted by other users about the broadcast program, and the like. The end button 741c7 is a button for terminating the operation of the broadcast cooperative app (terminal side).
[0169] By running the broadcast cooperative application (terminal side) on the mobile information terminal 700, the broadcast receiving device 100 and the mobile information terminal 700 can operate in cooperation with each other to expand the functionality of the broadcast communication cooperative service.
[0170] [EPG screen of broadcast receiver] 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving device 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcast service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. By selecting the program guide key 741a7 on the basic screen 741a of the cooperation control app, the EPG display screen 173e is displayed on the video display unit 173.
[0171] In this embodiment, the EPG display screen 173e displays detailed information about each broadcast program broadcast on each channel in each time period in a matrix format with the vertical axis representing time and the horizontal axis representing service ID (channel). As shown in Fig. 16A, detailed information 173e1 about each broadcast program is mainly composed of a title area 173e2 and a detailed description area 173e3.
[0172] The title area 173e2 displays the program title of each broadcast program and symbols representing the attributes of each broadcast program. The symbols representing the attributes of each broadcast program are, for example, a symbolized "New" sign indicating that it is a new program, or a symbolized "Replay" sign indicating that it is a rebroadcast program. Alternatively, a symbolized "data" sign indicating that the program is compatible with data broadcasting via a broadcast service may be used. Furthermore, if the broadcast program is available with a broadcast-linked app that can be executed by the broadcast receiving device 100 of this embodiment, a symbolized "Linkage" sign indicating this may be used. The detailed explanation area 173e3 displays related information such as the program content and performers of each broadcast program, the URL of a website introducing each broadcast program, etc.
[0173] Note that the symbolized mark "Linkage" displayed in the title area 173e2 may not be displayed if the result of checking the application profile 904 indicates that the broadcast program cannot be executed on the information display device 100, even if the broadcast program has a broadcast-linked app available. Also, the symbolized mark "Linkage" displayed in the title area 173e2, which indicates that the broadcast program has an executable broadcast-linked app available, may have its color, shape, font, etc. changed depending on whether or not the program can be operated in cooperation with a mobile terminal device. If the program can be operated in cooperation with a mobile terminal device, a symbolized mark "Mobile" may be displayed together with the symbolized mark "Linkage."
[0174] Whether or not to display the symbolic mark "Linkage" or the symbolic mark "Mobile" can be controlled by acquiring information, which is previously written in EIT information including detailed information about each broadcast program, such as whether or not each broadcast program is a broadcast program for which a broadcast-linked app executable by the broadcast receiving device 100 of this embodiment is prepared, and whether or not the executable broadcast-linked app is capable of operating in conjunction with a mobile terminal device. Alternatively, the information acquired from program distribution information of digital broadcast programs prepared in a predetermined server device on the Internet 200 may be added to an electronic program guide created based on a program information data string acquired from broadcast waves of a digital broadcast service.
[0175] As described above, by displaying a symbolic mark "Linkage" indicating that a broadcast program has an executable broadcast-linked app available and a symbolic mark "Mobile" indicating that the program can be linked with a mobile terminal device on the EPG display screen 173e, the user can easily understand the compatibility of each broadcast program with the broadcast-communication linked service on the broadcast receiving device 100. Needless to say, the symbolic mark representing the predetermined characters that represent the attributes of each broadcast program may be replaced with the characters themselves, sentences, etc. The compatibility of each broadcast program with the broadcast-communication linked service may be indicated by changing the background color of the detailed information 173e1 of each broadcast program. Furthermore, the symbolic mark "Linkage" or the symbolic mark "Mobile" may not normally be displayed in the title area 173e2, but may be displayed as a pop-up only when the broadcast program is selected with the program selection cursor 173e4.
[0176] The broadcast receiving device 100 of this embodiment has a function of scheduling viewing and / or recording of each broadcast program on the EPG display screen 173 e. For example, while the EPG display screen 173 e is displayed, the user can use the cursor keys 741 ac on the basic screen 741 a of the cooperative control application to move the program selection cursor 173 e 4 on the EPG display screen 173 e, and select any broadcast program with the enter key 741 ad to schedule viewing and / or recording of the selected broadcast program.
[0177] In the above process, if the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program compatible with a broadcast-communication cooperative service, the viewing reservation and / or recording reservation may be used as a trigger to start acquiring a broadcast-interactive app prepared for the broadcast program without waiting for the broadcast start time of the broadcast program. That is, information specifying the acquisition source of the broadcast-interactive app (location information such as a URL) may be included in EIT information containing detailed information about each broadcast program. In this way, the broadcast receiving device 100 can grasp information about the acquisition source of the broadcast-interactive app prepared for each broadcast program when the broadcast program is selected with the program selection cursor 173e4. Therefore, the broadcast receiving device 100 can start acquiring the broadcast-interactive app before the broadcast start time of the broadcast program.
[0178] In addition, if the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program that supports a broadcast communication cooperative service and is capable of cooperative operation with a mobile terminal device, the broadcast cooperative app (terminal side) prepared for the mobile terminal device may also start acquiring the broadcast cooperative app before the broadcast start time of the broadcast program using the same process as described above. Also, as shown in Fig. 16B, a two-dimensional barcode 173e5 or the like indicating information (location information such as a URL) of the acquisition destination of the broadcast cooperative app (terminal side) prepared for the mobile terminal device may be displayed on the EPG display screen 173e to prompt the user to download the broadcast cooperative app (terminal side) prepared for the mobile terminal device.
[0179] In this way, if the broadcast receiving device 100 refers to the acquisition source information of the broadcast-linked app included in the EPG information and starts acquiring the broadcast-linked app before the broadcast start time of the broadcast program, it becomes possible to distribute the load on the service provider server 400 that stores the broadcast-linked app. Furthermore, even if the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, it becomes possible to effectively use the broadcast-linked app immediately after the broadcast start time of the broadcast program.
[0180] FIG. 17 is an operational sequence diagram showing an example of a broadcast cooperative app acquisition sequence when a broadcast program viewing reservation and / or recording reservation is made on the EPG display screen 173e.
[0181] While viewing a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires a program information data sequence output from the first separation unit 132 (S701). When the user requests the launch of an EPG screen using the operation terminal (S702), an EPG display screen 173e is displayed on the video display unit 173 (S703). When the user selects an arbitrary broadcast program on the EPG display screen 173e using the operation terminal to schedule viewing and / or recording of the broadcast program (S704), the main control unit 101 checks the program information data sequence acquired from the first separation unit 132 (S705), and further checks the location of the acquisition source of a broadcast-linked app linked to the broadcast program scheduled for viewing and / or recording (S706).
[0182] After the process of S706, the application control unit 161 transmits a broadcast-interactive app transmission request to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). The service provider server 400 that has received the broadcast-interactive app transmission request performs authentication processing of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast-interactive app stored in the application storage area 4013 via the LAN communication unit 421 (S708). Next, the application control unit 161 caches the predetermined broadcast-interactive app received from the service provider server 400 via the LAN communication unit 121 in the RAM 104 or the storage unit 110 (S709).
[0183] According to the broadcast receiving device 100 of this embodiment described above, it is possible to execute functions with higher added value. [Example]
[0184] The following describes Example 2 of the present invention. The configuration, effects, etc. of this Example are the same as those of Example 1 unless otherwise specified. Therefore, the following mainly describes the differences between this Example and Example 1, and omits explanations of common points as much as possible to avoid duplication.
[0185] In the first embodiment, an embodiment in which mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) is performed has been described, but a more detailed embodiment will be described below.
[0186] When performing mobile information terminal linkage, there are cases where it is desired to limit the use of terminal linkage to only mobile information terminals 700 that are located in the same home as broadcast receiving device 100 (hereinafter, this restriction will be referred to as "same-home restriction"). For example, this may be the case when, in an application for using broadcast linkage (hereinafter, referred to as "broadcast linkage app"), the display screen of broadcast receiving device 100 and the display screen of mobile information terminal 700 are closely related, or when it is desired to ensure that the user of mobile information terminal 700 can view advertising video displayed on broadcast receiving device 100.
[0187] Note that one point that must be considered in the procedure is whether or not the broadcast-linked app in question imposes a same-house restriction. If it is assumed that all broadcast-linked apps are subject to a same-house restriction, this determination is not necessary. However, if there are cases where there is no restriction, the broadcast receiving device 100 must acquire control information regarding the presence or absence of a same-house restriction and change the operating procedure. This control information regarding the presence or absence of a restriction may be acquired from the broadcast signal (for example, described as an item in the AIT) or may be acquired from a server designated by the broadcast station.
[0188] Including the above procedure, in this embodiment, a procedure for ensuring that the mobile information terminal 700 is present in the same home as the broadcast receiving device 100 will be described.
[0189] Typically, devices that exist within the same home are on a local network that is connected to the same router device 210. Therefore, if the mobile information terminal 700 is connected to the same local network as the broadcast receiving device 100, it can be determined that they exist within the same home. Note that whether or not a target device is connected to a local network can be determined using a known method, and therefore a description thereof will be omitted.
[0190] Furthermore, even if the mobile information terminal 700 is not on the local network, it can be determined that it is present in the same home by directly communicating with the broadcast receiving device 100 using NFC, Bluetooth, infrared communication, etc. In this case, the communication for acquiring the broadcast collaborative app, etc. may be the above-mentioned direct communication or may be via mobile telephone communication.
[0191] As described above, there are several possible methods for confirming that the devices are in the same house. The method to be used is described in, for example, the AIT, which is read by the broadcast receiving device 100.
[0192] Furthermore, once it is confirmed that the mobile information terminal 700 is in the same home, it may be considered to be in the same home until the program ends, or a certain valid time (for example, 10 minutes) may be set, during which it is considered to be in the same home, but once the valid time has elapsed, it is not considered to be in the same home unless a new confirmation is made. This valid time may be written in, for example, the AIT and read by the broadcast receiving device 100.
[0193] Furthermore, for example, an event signal may be set in the broadcast signal at any point during the program, and each time this event signal is received, it may be confirmed that the mobile information terminal 700 is present in the same home.
[0194] Furthermore, the first two methods can be used in combination.
[0195] Next, a specific procedure for permitting terminal linkage only for mobile information terminals 700 present in the same home will be described. In this embodiment, restrictions are imposed when the mobile information terminal 700 acquires a broadcast-linked app or acquires information used in the broadcast-linked app (hereinafter, the broadcast-linked app and the information used in the broadcast-linked app, specifically, HTML documents, streaming video, etc., are collectively referred to as broadcast-linked information). There are two methods for acquiring broadcast-linked information: communication acquisition from the broadcast station server 300 or the provider server 400, and broadcast acquisition from broadcast waves. In the case of communication acquisition, there are two methods: acquisition after broadcast reception starts, and acquisition before broadcast reception starts. Furthermore, in the case of communication acquisition, there are two cases: the broadcast receiving device 100 acquires the information once, and the mobile information terminal 700 acquires it from the broadcast receiving device 100, and there are also cases where the mobile information terminal 700 acquires it directly from the broadcast station server 300 or the provider server 400. There are various methods, but from the viewpoint of the mobile information terminal 700, they can be roughly divided into two: obtaining from the broadcast receiving device 100, and obtaining from the broadcast station server 300 or the operator server 400.
[0196] In this embodiment, a case where the mobile information terminal 700 acquires broadcast cooperation information from the broadcast receiving device 100 will be described, and a case where the information is acquired from a server will be described in the next embodiment.
[0197] FIG. 18A shows the procedure of this example.
[0198] First, before performing terminal linkage, a linkage control app, which is an application that controls terminal linkage, is launched in each of the mobile information terminal 700 and the broadcast receiving device 100 (S10001, S10002). In this state, a terminal linkage request is made from the mobile information terminal 700 to the broadcast receiving device 100 (S10003). Next, an AIT is acquired from the broadcast signal (S10004). From the information in this AIT, it is determined whether the app for the target mobile information terminal has a same-house restriction (S10006). If there is a restriction, the process proceeds to step S10008. In the initial stage where a terminal linkage request is made, the process proceeds to step S10009, where it is determined whether the mobile information terminal 700 that made the terminal linkage request is located in the same home as the broadcast receiver 100 (S10009). If it is determined that they are not located in the same home, a linkage denial response is sent to the linkage control app on the mobile information terminal, and the process ends (S10011).
[0199] Here, if it is assumed that all broadcast-linked apps have the same-house restriction, the determination in S10006 is skipped. If there is a possibility that both apps have the same-house restriction and apps do not, the determination in S10006 is performed.
[0200] If it is determined that the mobile information terminal 700 is located within the same home, or if the app does not have a same-home restriction, the process proceeds to S10012, where a broadcast-linked app-related service is performed. This service (S10012) processes a broadcast-linked information distribution request (S10013) from the mobile information terminal 700, and distributes broadcast-linked information to the mobile information terminal 700 (S10018). This broadcast-linked information may be distributed by the broadcast receiving device 100 from a distribution server that is the provider server 300 (S10014, S10015, S10016), obtained from a broadcast signal (S10017), or stored in the broadcast receiving device 100. The broadcast receiving device 100 may receive the broadcast linked information (S10016, S10017) not only in response to a broadcast linked information distribution request (S10013) from the mobile information terminal 700, but also autonomously by the broadcast receiving device 100 or may acquire the information based on the occurrence of an event from a broadcast signal. Furthermore, the broadcast linked information may also be distributed to the mobile information terminal 700 (S10018) voluntarily by the broadcast receiving device 100.
[0201] After the series of processes of receiving (obtaining) and distributing broadcast linkage information is completed, the broadcast receiving device 100 determines whether the user is continuing to watch the same program (S10019), and if not, responds to the linkage control app on the mobile information terminal that linkage is not permitted, and the process ends (S10020).
[0202] If viewing continues, the process returns to S10005. If there is a home restriction, the process checks whether the mobile information terminal 700 is within the same home (S10009). It then determines whether a preset valid time has elapsed since the last check, or whether a confirmation request (S10007) has been generated from the broadcast signal or distribution server since the last check (S10008). If neither of these conditions is met, the process does not check whether the mobile information terminal 700 is within the same home (S10009), and proceeds via S10010 to the execution of the next broadcast-linked app-related service (S10012). Here, the process describes that the confirmation request from the broadcast signal (S10007) is to be acquired from the broadcast-linked information, but here, the process also describes that the event message is included in the broadcast-linked information. Furthermore, this confirmation request may be described in the AIT.
[0203] The procedure described above is a loop processing procedure involving the broadcast signal, broadcast receiving device 100, mobile information terminal 700, and distribution server in the section indicated by the arrow of S10022. The confirmation request of S10007 may be made at any time within the loop.
[0204] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10015). This makes it possible to confirm that the authentication request is legitimate. Also, by changing the authentication information described in the AIT as the program progresses and configuring the distribution server to not perform authentication unless it uses an authentication key incorporating information synchronized with the program progress, it is possible to confirm that the same program is being continuously viewed. In this case, the information in the AIT is read and updated as appropriate (S10021). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast-linked information in addition to being described in the AIT. Furthermore, as a method of essentially changing the authentication information, a method of changing the URL of the distribution server itself as the program progresses can also be used.
[0205] In this way, while executing the broadcast-linked app-related service (S10012), the mobile information terminal 700 checks whether it is in the same home as the broadcast receiving device 100 at predetermined valid time intervals or whenever there is a confirmation request from a broadcast signal or distribution server, thereby making it possible to appropriately execute broadcast-related apps that are restricted to being in the same home. Furthermore, by using authentication information incorporated in the broadcast signal for authentication by the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information in the broadcast signal, it is also possible to confirm that the same program is being continuously viewed.
[0206] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the same-house restriction for mobile information terminals that cooperate with a broadcast receiving device. [Example]
[0207] In this embodiment, a case will be described in which the mobile information terminal 700 acquires broadcast cooperation information from a distribution server.
[0208] FIG. 18B shows the procedure of this example.
[0209] First, before performing terminal linkage, a linkage control app, which is an application that controls terminal linkage, is launched in each of the mobile information terminal 700 and the broadcast receiving device 100 (S10101, S10102). In this state, the mobile information terminal 700 sends a terminal linkage request to the broadcast receiving device 100 (S10103). Next, an AIT is acquired from the broadcast signal (S10104). Information such as a URL related to the distribution server is acquired from the information in the AIT, and this information is transmitted to the mobile information terminal 700 (S10105). Next, a time confirmation request is issued from the broadcast receiving device 100 to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving device 100 (S10107). This allows the subsequent authentication key issuance (S10115) to be synchronized with the time on the distribution server, but this step may be omitted if the time difference is not a problem.
[0210] After this, the loop control indicated by the arrow at S10127 is entered.
[0211] First, the mobile information terminal 700 issues a request for issuing an authentication key or a broadcast linked information distribution request to the broadcast receiving device 100 (S10109). The authentication key is used in a broadcast linked information distribution request to the distribution server at a later stage (S10125). The broadcast linked distribution request at S10109 is a distribution request for information acquired from a broadcast signal, and corresponds to the procedure at S10126 at a later stage.
[0212] In either case, when the request of S10109 is issued from the mobile information terminal, it is determined whether the broadcast-linked app has a same-household restriction (S10111). If there is a restriction, the process proceeds to the next step S10112. If there is no restriction, step S10112 is skipped and the process proceeds to S10114. If all broadcast-linked apps have a same-household restriction, the determination of S10111 is not performed and the process proceeds to S10112. In S10112, it is determined whether the mobile information terminal that issued the request is within the same home. If not, the device linkage is terminated (S10113). If the mobile information terminal is within the same home, the requested procedure is performed: acquiring broadcast-linked information from the distribution server (S10125) or acquiring broadcast-linked information from the broadcast signal (S10126). Since acquisition from the broadcast signal is possible in addition to acquisition from the distribution server, the procedure of S10126 is also described.
[0213] First, the procedure for acquiring broadcast linkage information from the distribution server (S10125) will be described.
[0214] First, the broadcast receiver 100 issues the authentication key requested by the information-linked terminal 700. At this time, the authentication key includes time information at the time of issuance and is valid only for a predetermined period of time (for example, 10 minutes). The distribution server checks the authentication information, including whether the authentication key is within the valid period, and if the authentication is OK, allows the distribution of broadcast-linked information. Thereafter, the distribution of information is allowed within the valid period, but the distribution stops once the valid period has elapsed. For example, streaming video will no longer be viewable once the valid period has elapsed.
[0215] The preset validity period may be stored in the distribution server, or may be acquired by broadcast receiving device 100 from a broadcast signal (e.g., AIT) and the validity period information may be incorporated into the authentication key. The validity period information may be notified to mobile information terminal 700 in advance, so that the mobile information terminal 700 may request the issuance of an authentication key before the validity period expires. Alternatively, the validity period may be managed by broadcast receiving device 100, and an authentication key may be automatically issued to mobile information terminal 700 from broadcast receiving device 100 before the validity period expires after confirming that the mobile information terminal 700 is within the same home.
[0216] The validity period may be the same for the entire program, or may change as the program progresses. If no validity period is set, authentication may be performed once and remain valid for the duration of the program.
[0217] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10117). This makes it possible to confirm that the authentication request is legitimate. Furthermore, by changing the authentication information described in the AIT as the program progresses and configuring the distribution server to not perform authentication unless it uses an authentication key incorporating information synchronized with the program progress, it is possible to confirm that the same program is being continuously viewed. In this case, the information in the AIT is read and updated as appropriate (S10124). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast-linked information in addition to being described in the AIT. Furthermore, as a method for essentially changing the authentication information, a method can be used in which the URL of the distribution server itself is changed as the program progresses. Note that the URL change in this case is when the distribution server is the same but the entrance is different. However, it is also possible to change to a new distribution server due to a change in the broadcast-linked app, etc. In this case, the procedures of transmitting distribution server information (S10105), requesting time confirmation (S10106), and transmitting time information (S10107) are performed each time a change is made.
[0218] Next, the procedure for acquiring broadcast cooperation information from a broadcast signal (S10126) will be described.
[0219] In this case, after it is confirmed that the mobile information terminal 700 is in the same home, the broadcast receiving device 100 acquires broadcast linkage information from the broadcast signal (S10119) and then distributes the information to the mobile information terminal 700 (S10120).
[0220] In addition, when the broadcast linked information is changed as the program progresses, a notification of the change may be sent from the broadcast signal (S10110), and the notification may trigger the acquisition of the broadcast linked information. In this case, if the broadcast linked information is acquired from the distribution server, the broadcast receiving device 100 issues an authentication key to the mobile information terminal (S10115) and notifies the mobile information terminal of the change notification. If the validity period is within the validity period, the issuance of the authentication key may be omitted and only the change notification may be sent. In the case of acquisition from the broadcast signal, the broadcast receiving device 100 acquires the information (S10119) and distributes it to the mobile information terminal (S10120). In addition, in the case of acquisition from the broadcast signal, it may be possible to confirm that the mobile information terminal 700 is in the same home for each change notification, or, as in the second embodiment, this confirmation may be omitted if the validity period is within the validity period. Here, although the change notification from the broadcast signal (S10110) is described as being acquired from the broadcast linked information, the broadcast linked information is also described as including an event message. Furthermore, this change notice may be included in the AIT.
[0221] After a series of processes for receiving (obtaining) and distributing broadcast linkage information is completed, the broadcast receiving device 100 determines whether the user is continuing to watch the same program (S10121), and if not, responds to the linkage control app on the mobile information terminal that linkage is not permitted, and ends the process (S10123). If viewing is continuing, the process returns to S10108, and loop process S10127 continues.
[0222] In this way, by including time information in the authentication key used to authenticate the distribution server and managing the validity period, it is possible to periodically confirm that the mobile information terminal 700 is in the same home as the broadcast receiving device 100, and to appropriately execute broadcast-linked apps that have same-home restrictions. Furthermore, by using the authentication information embedded in the broadcast signal for authentication by the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information in the broadcast signal, it is also possible to confirm that the same program is being viewed continuously.
[0223] According to the mobile information terminal linkage technology of this embodiment described above, it is possible to achieve same-home restrictions even when a mobile information terminal linked to a broadcast receiving device obtains broadcast linkage information from a distribution server. [Example]
[0224] In the second and third embodiments, procedures for realizing the same-home restriction in terminal linkage were described. However, depending on the broadcast-linked app, use from outside the home may also be permitted. This embodiment describes such a case. For example, when a program itself, such as a television shopping program, is public relations or advertising, it is desirable for the broadcaster if the broadcast-linked app can be used both inside and outside the home. For such programs, once the program is registered in the broadcast receiving device 100, use of the broadcast-linked app may be permitted regardless of whether the mobile information terminal 700 is inside the home. In this case, convenience would be enhanced if there was a broadcast-linked app that converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the Internet. The streaming data may be encrypted by the broadcast receiving device 100 for copyright protection. Whether the broadcast-linked app permits use from outside the home, including distribution of broadcast video outside the home, is specified in data within the broadcast signal (e.g., AIT).
[0225] The specific procedure is shown in FIG. 18C . Since some of the procedure is common to Examples 2 and 3, the description of the overlapping parts with Examples 2 and 3 will be omitted. When a terminal link request (S10203) is received from outside the home, if the application is permitted for use outside the home, the broadcast receiving device 100 confirms whether the requestor is a registered mobile information terminal (S10205) and then permits linkage. Here, if necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving device 100 to protect the copyright of the broadcast video and broadcast linkage information (S10207). In this case, the authentication may be performed by the distribution server (S10207). Information regarding the necessity of copyright protection and information regarding the authentication method for copyright protection are obtained from the broadcast signal (e.g., described in the AIT), and control is performed accordingly. If this information is not stored in the broadcast signal, a predetermined method is followed in the broadcast receiving device 100. For example, a predetermined copyright protection process may be performed. Furthermore, if such information is not stored in the broadcast signal, it may be predetermined that the broadcast receiving device 100 will not perform copyright protection processing.
[0226] Specific examples of authentication for copyright protection are shown below. Each of the following authentications may be performed alone. Alternatively, multiple authentications exemplified below may be performed in combination. Furthermore, the authentications exemplified below may be performed in combination with other authentication processes not exemplified below.
[0227] [ID and password authentication] When the mobile information terminal 700 is registered with the broadcast receiving device 100, an ID and password are issued, and the broadcast receiving device 100 permits cooperation by verifying this ID and password.
[0228] [Encryption key usage] In addition to the authentication using the ID and password, an encryption key for decrypting encrypted video data, etc. is transmitted from the broadcast receiving device 100 to the mobile information terminal. This encryption key may be obtained from the broadcast signal (for example, written in the AIT).
[0229] [Use of distribution server] In this method, an encryption key for decrypting encrypted video data, etc., is issued from the distribution server. The mobile information terminal 700 transmits an ID and password to the distribution server and obtains the encryption key. In this case, security is further enhanced by obtaining location information (specifically, a URL) of the distribution server from the broadcast signal (e.g., written in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700. Since the mobile information terminal 700 cannot decrypt videos, etc. unless it can obtain the encryption key, the broadcast receiving device 100 may request authentication from the distribution server as authentication for copyright protection, or the authentication may be completed by the mobile information terminal 700 notifying the broadcast receiving device 100 that the encryption key has been obtained. Note that the distribution server may perform billing.
[0230] [Mutual authentication of encryption keys] The broadcast receiving device 100 and the mobile information terminal 700 mutually authenticate and confirm the encryption keys they each have, thereby authenticating copyright protection.
[0231] When information stored in a broadcast signal indicates that copyright protection is required by a predetermined method, if the copyright protection cannot be authenticated by the predetermined method, terminal linkage is not permitted. Also, even if there is no designation in the broadcast signal and authentication is performed by a default method of the broadcast receiving device 100, if the copyright protection cannot be authenticated by the default method, terminal linkage is not permitted.
[0232] If terminal linkage is permitted, thereafter, the presence of the mobile information terminal 700 within the same home is not confirmed. Instead, broadcast linkage information is delivered to the mobile information terminal 700 (S10217) and an authentication key for the distribution server is issued (S10212) in accordance with a request from the mobile information terminal 700 (S10211), autonomous control of the broadcast receiving device 100, and a request from the broadcast signal (S10210). In this case, control that sets the validity period does not have to be performed. The mobile information terminal 700 located outside the home acquires broadcast linkage information from the broadcast receiving device 100 or the distribution server using the issued authentication key (S10215). Furthermore, if the authentication key issued by the broadcast receiving device 100 incorporates authentication information acquired from the broadcast signal (e.g., described in the AIT), and the distribution server permits access if the authentication key incorporates the authentication information acquired from the broadcast signal, further optimization of outside-home use can be achieved.
[0233] Furthermore, in some cases, such as when offering a discount as a premium for viewing a program, it may be better not to permit unlimited use of the broadcast-linked app. In such cases, it is preferable to perform authentication once while the mobile information terminal is in the same home, and then permit use of the distribution server even if the mobile information terminal is not in the same home. In this case, it does not matter if the mobile information terminal 700 is not registered in the broadcast receiving device 100.
[0234] Specific procedures for this case are shown in FIG. 18D. Since some of the procedures are common to those shown in FIG. 18C, the overlapping portions will not be described. First, when the mobile information terminal 700 is located in the same home as the broadcast receiving device 100, the mobile information terminal 700 sends a terminal linkage request to the broadcast receiving device 100. The broadcast receiving device 100 confirms that the mobile information terminal 700 is located in the same home (S10305) and then permits linkage. If necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving device 100 to protect the copyright of the broadcast video and broadcast linkage information (S10307). In this case, authentication may be performed by an external distribution server. Information regarding the necessity of copyright protection and information regarding the authentication method for copyright protection are obtained from the broadcast signal (e.g., described in the AIT), and control is performed accordingly. If this information is not stored in the broadcast signal, a predetermined method is followed in the broadcast receiving device 100. For example, a predetermined copyright protection process may be performed. Furthermore, if such information is not stored in the broadcast signal, it may be predetermined that the broadcast receiving device 100 will not perform copyright protection processing.
[0235] Specific examples of authentication for copyright protection are shown below. Each of the following authentications may be performed alone. Alternatively, multiple authentications exemplified below may be performed in combination. Furthermore, the authentications exemplified below may be performed in combination with other authentication processes not exemplified below.
[0236] [Encryption key usage] When the mobile information terminal 700 is in the same home, an encryption key for decrypting encrypted video data, etc. is transmitted from the broadcast receiving device 100 to the mobile information terminal. This encryption key may be obtained from the broadcast signal (for example, written in the AIT). The delivery of this encryption key within the same home constitutes authentication. Furthermore, if the encryption key can only be obtained from the broadcast signal at a certain point in the program and the delivery of the encryption key to the mobile information terminal 700 is limited to within the same home, it is possible to impose a restriction that the user must be in the same home at that time, which can also be used to provide a premium for viewing.
[0237] [Use of distribution server] In this method, a distribution server issues an encryption key for decrypting encrypted video data, etc. The mobile information terminal 700 transmits an ID and password to the distribution server to obtain the encryption key. In this case, security is enhanced by obtaining the distribution server's location information (specifically, a URL) from the broadcast signal (e.g., written in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700. Since the mobile information terminal 700 cannot decrypt video data without obtaining the encryption key, the broadcast receiving device 100 may request authentication from the distribution server to protect copyright, or the mobile information terminal 700 may notify the broadcast receiving device 100 that the encryption key has been obtained to complete authentication. Access to the distribution server can be performed both inside and outside the home. However, by restricting the distribution server's location information to be obtained from the broadcast signal only at a certain point in the program and limiting the transfer of location information to the mobile information terminal 700 to within the same home, a restriction can be imposed, requiring the user to be within the same home at that time. This can also be used to provide a premium for viewing. The distribution server may also charge a fee.
[0238] [Mutual authentication of encryption keys] The broadcast receiving device 100 and the mobile information terminal 700 mutually authenticate and confirm the encryption keys they each have, thereby authenticating copyright protection. This authentication can also be performed either inside or outside the home.
[0239] When information stored in a broadcast signal indicates that copyright protection using a predetermined method is required, if the copyright protection cannot be authenticated using that predetermined method, terminal linkage is not permitted. Also, even if there is no designation in the broadcast signal and authentication is performed using a default method of the broadcast receiver 100, if the copyright protection cannot be authenticated using that default method, terminal linkage is not permitted. The procedure after terminal linkage is permitted is the same as the procedure in Figure 18C, so a description thereof will be omitted.
[0240] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use of a mobile information terminal that cooperates with a broadcast receiving device from outside the home while taking into consideration copyright protection. [Example]
[0241] In actual usage situations, it is more desirable to easily know whether a terminal-linked app is available for a program and which terminal-linked apps are available. In this embodiment, a method for displaying the availability status of terminal-linked apps will be described. A terminal-linked app refers to a broadcast-linked app used in device linkage.
[0242] FIG. 19A shows an example of a broadcast-linked app launcher screen (173b11) when a terminal-linked app is present. The broadcast-linked app is displayed as a boxed text icon. Broadcast-linked apps (173b12-173b14) for the broadcast receiving device 100 linked to the currently viewed program and broadcast-linked apps (173b15-173b17) for the mobile information terminal are displayed. In this example, the thickness of the frame surrounding the text and the color of the box indicate the app status. Main app A and B (173b12, 173b13) and terminal app A and B (173b15, 173b16) are available, while main app C (173b14) and terminal app C (173b17) are unavailable. A terminal app being unavailable means that none of the mobile information terminals 700 that are capable of communicating with the broadcast receiving device 100 have the function to execute the app.
[0243] Fig. 19B is a screen that appears after terminal application A is selected in Fig. 19A. It shows the state of each mobile information terminal 700 related to terminal application A. The mobile information terminals displayed on this screen are terminals that have previously collaborated with or are registered with broadcast receiving device 100.
[0244] Mobile terminal 1 (173b22) and mobile terminal 2 (173b23) whose icons have solid borders are in a state where they can communicate with broadcast receiving device 100, while mobile terminal 3 (173b24) and mobile terminal 4 (173b25) whose icons have dotted borders are not in a state where they can communicate with broadcast receiving device 100. Furthermore, mobile terminal 1 (173b22) and mobile terminal 3 (173b24) whose icons have white borders are capable of executing terminal app A, while mobile terminal 2 (173b23) and mobile terminal 4 (173b25) whose icons have gray borders are not capable of executing terminal app A. Furthermore, if an app is already running on the device, an icon with a design that indicates this may be used.
[0245] Additionally, icons are easier to understand visually if they are made of pictures, as shown below as an example.
[0246] 19C is an example of a launcher screen (173b31) showing a list of broadcast-linked apps. In addition to the broadcast receiving device 100, icons are shown for each type of mobile information terminal 700. Icons 173b32 and 173b33 are icons indicating the broadcast receiving device 100, icons 173b34 and 173b35 are icons indicating a smartphone-type mobile information terminal 700, and icon 173b36 is an icon indicating a head-mounted display-type mobile information terminal 700. Each app is for the device indicated by the icon.
[0247] In FIG. 19C, if the app cannot be used, a mark indicating that it is unavailable (in this case, a circle with a diagonal line) is displayed superimposed on the image of the device. Furthermore, for the broadcast receiving device 100, if the app is already running, a mark indicating this (in this case, a circle with a dot) may be displayed superimposed. This display prevents unnecessary actions such as proceeding with the launcher procedure even though the app is already running. For the mobile information terminal 700, a method is also possible in which a mark indicating that the app is running is displayed when the app is running on all devices that are capable of communicating with the broadcast receiving device and that can run the app.
[0248] FIG. 19D shows a screen (173b41) that appears after selecting application C (173b34) in FIG. 19C. The screen shows the state of a mobile information terminal 700 that is compatible with application C. On this screen, if the mobile information terminal 700 does not have the capability to execute a broadcast-linked application, is not capable of communicating with the broadcast receiving device 100, or is already running the broadcast-linked application, a mark representing that fact is displayed superimposed on the icon. In this example, if the mobile information terminal 700 does not have the capability to execute the application, a circle with a line (173b44, 173b46) is displayed; if the mobile information terminal 700 is not capable of communicating, a triangle with an exclamation point (173b45, 173b46) is displayed; and if the application is already running, a circle with a dot (173b43) is displayed.
[0249] Furthermore, it is desirable to have a display method that allows users to know that a broadcast-linked app is available when the situation changes, without having to start a launcher each time. For example, when the power is turned on, when the channel is changed, at the beginning of a program or during a program, when there is a change in the broadcast-linked app, when there is a change in the communication status between the broadcast receiving device 100 and the mobile information terminal 700, or when the execution status of the app changes, an icon is displayed for a predetermined period of time to show the status at that time.
[0250] An example of this case is shown in Figure 19E. When an icon indicating the type of device is displayed, it indicates that there is a broadcast-linked app that is compatible with that type of device. In this case, a circle with a diagonal line indicates that there are no usable devices of that type that can run the app. A circle with a dot indicates that the app is running on all usable devices of that type.
[0251] FIG. 19F shows a display screen (10401) on the mobile information terminal 700. When requesting terminal linkage from the mobile information terminal 700, it is convenient to know in a list which broadcast receiving devices 100 can use which broadcast-linked apps. FIG. 19F shows an example of such a list (10402). This table shows which broadcast receiving devices 100 in the home can use the broadcast-linked apps corresponding to the program you are looking up. Displaying the status of each broadcast receiving device 100 also enhances convenience, especially when using the device outside the home. This example shows display examples such as receiving the program, receiving another program, available, and having another program scheduled (when another program has been scheduled to be recorded midway through the program). Note that if the broadcast receiving device 100 has multiple tuners, displaying the status for each tuner would further enhance convenience. In table 10202, sub-numbers are used to distinguish between tuners within the same device. For example, receiving device B-1 and receiving device B-2 are tuners within the same broadcast receiving device 100. In the case of terminal linkage, if broadcast video and audio can be received as streaming data, there is no need to use the video section of broadcast receiving device 100, and broadcasting can be used if the tuner within broadcast receiving device 100 can be used, so it is convenient to know the usage status of each tuner.
[0252] In order to perform the display described in this embodiment, it is necessary to have information for each broadcast-linked app as to whether the app is compatible with the broadcast receiving device 100 or what type of mobile information terminal 700 the app is compatible with. Also, information is required for executing the compatible app on the broadcast receiving device 100 and the mobile information terminal 700. This information can be acquired by the broadcast receiving device 100 by, for example, writing it in the AIT.
[0253] According to the mobile information terminal collaboration technology of this embodiment described above, by displaying information about the broadcast collaboration app, the broadcast receiving device 100, and the mobile information terminal 700, it becomes possible to use a more convenient broadcast collaboration service. [Example]
[0254] Hereinafter, in the sixth to tenth embodiments, the broadcast receiving device 100 will be referred to as an information display device.
[0255] First, Example 6 will be described with reference to Figures 2C, 2D, and 20 to 24. The configuration, effects, etc. of Example 6 are the same as those of Example 1 unless otherwise specified. Therefore, the following mainly describes the differences between Example 6 and Example 1, and explanations of commonalities between them will be omitted as much as possible.
[0256] In the first to fifth embodiments, one broadcast program is displayed on the broadcast receiving device 100. On the other hand, the information display device of the sixth embodiment displays a plurality of broadcast programs.
[0257] [Hardware configuration of information display device] 2C is a block diagram of an information display device 1000 according to Example 6. As shown in FIG. 2C, the information display device 1000 includes a video display unit 173, a video output unit 175, an audio playback unit 174b, an audio output unit 176, a viewer instruction input unit 25001 (described later, FIG. 2D), a content input unit 25002, a content playback unit 25003, a content recording / playback unit 25004, and a control unit 25005.
[0258] Viewer instruction input unit 25001 receives instruction information that a device (for example, a remote control (described later, FIG. 22A)) accepts as input from a viewer.
[0259] The content input unit 25002 acquires content (for example, broadcast content, content on the Internet, or recorded content). Specifically, the content input unit 25002 is a tuner / demodulator unit 131 (described above, FIG. 2A) that receives broadcast content, a LAN communication unit 121 (described above, FIG. 2A) that acquires content on the Internet, an expansion interface unit 124 (described above, FIG. 2A) or a digital interface unit 125 (described above, FIG. 2A) when recorded content is input from an external content playback device or the like, or the like.
[0260] The content playback unit 25003 plays back recorded content. Specifically, the content playback unit 25003 is the storage unit 110 (described above, FIG. 2A). More specifically, the storage unit 110 is a drive for an optical disc recording medium or the like.
[0261] The content recording / playback unit 25004 records / plays back content (records / reads out content on the Internet). Specifically, the content recording / playback unit 25004 is the storage unit 110 (see FIG. 2A above), RAM 104 (see FIG. 2A above), or the like.
[0262] The control unit 25005 is a collection of control units including the main control unit 101 (described above, FIG. 2A).
[0263] The control unit 25005 causes the video output unit 175 to output video information for displaying a main window in which the main content, which is the main video of the broadcast program, is displayed, and a sub-window in which the sub-content included in the execution screen of the broadcast cooperative app that cooperates with the broadcast program is displayed. The video output unit 175 outputs the video information output from the control unit 25005 to an external display device (such as a display).
[0264] Furthermore, control unit 25005 displays a main window and a sub-window on video display unit 173. The execution screen of the broadcast cooperative app displays information accompanying the main video of the broadcast program (for example, a weather forecast, responses from viewers of the broadcast program, profiles of performers of the broadcast program, etc.). For example, if the broadcast program is a marathon broadcast, the main window displays video from the broadcaster (for example, video of runners running near the front), and the sub-window displays video of runners running at a position away from the front.
[0265] Furthermore, the control unit 25005 controls the display of windows displayed on the video display unit 173. The control unit 25005 also controls the audio playback unit 174b and the audio output unit 176.
[0266] The audio playback unit 174b plays back audio. Specifically, the audio playback unit 174b is the speaker 174 (described above, FIG. 2A). The audio playback unit 174b also includes earphones.
[0267] The audio output unit 176 outputs audio information. For example, the audio output unit 176 outputs audio information (audio signals) to an external output device (such as a speaker). In the following description, the output of audio from the audio playback unit 174b is referred to as audio playback, in order to distinguish it from the output of audio information (audio signals) from the audio output unit 176.
[0268] Video display unit 173 displays the main window based on the window shape designation information and window anteroposterior relationship designation information included in the window-related designation information (window-related designation information is a general term for window-related designation information such as window shape designation information and window anteroposterior relationship designation information). Also, window shape designation information may be included in a broadcast signal (e.g., AIT). Furthermore, the window shape designation information may include information indicating that part or all of the window-related designation information can be changed by viewer selection. In the case of recorded content, video display unit 173 may display the main window based on window shape designation information stored in advance as content group-related information. In the case of content on the Internet, video display unit 173 may display the main window based on window shape designation information distributed together with the content as content group-related information. Furthermore, since it is desirable to adjust the window size, i.e., the size of the image display area, depending on the size and number of pixels of information display device 1000, the window-related designation information may be a plurality of pieces of designation information corresponding to the size and number of pixels of information display device 1000.
[0269] The video display unit 173 displays a main window that displays the main video of a broadcast program, and a sub-window for displaying an execution screen of a broadcast-linked application that links with the broadcast program.
[0270] Furthermore, video display unit 173 displays recorded programs and content on the Internet in addition to broadcast programs received via broadcast waves. Hereinafter, broadcast content received via broadcast waves, content on the Internet, recorded content, etc. may be collectively referred to as content.
[0271] The video output unit 175 outputs video information to an external display device for displaying a main window that displays the main video of the broadcast program and a sub-window that displays the execution screen of a broadcast-linked app that links with the broadcast program.
[0272] Furthermore, the video output unit 175 outputs video information for displaying recorded programs and content on the Internet, in addition to broadcast programs received via broadcast waves, to an external display device. [Viewer instruction input section]
[0273] 2D is a diagram showing an example of a viewer instruction input unit 25001 of the information display device according to the embodiment. The viewer instruction input unit 25001 receives instruction information that the device accepts as input from a viewer.
[0274] The devices that accept input of instruction information from the viewer are specifically a remote control 25102, a mouse 25104, a touchpad 25106, a keyboard 25108, a mobile information terminal 25110, a touch panel 25111, and the like.
[0275] When these input devices (remote control 25102, mouse 25104, touchpad 25106, keyboard 25108, mobile information terminal 25110, touch panel 25111) are integrated with information display device 1000, the input devices themselves become viewer instruction input unit 25001. On the other hand, when these input devices are not integrated with information display device 1000 but are connected to information display device 1000 wirelessly or via a wire, input ports 25101, 25103, 25105, 25107, and 25109 become viewer instruction input unit 25001. When mobile information terminal 25110 is connected to the information display device via a LAN as an input device, LAN communication unit 121 (described above, FIG. 2A) becomes viewer instruction input unit 25001.
[0276] The keyboard 25108 (including the case where a portable information terminal is used as a character input means) launches an internet browser and accepts character input to the browser when searching for content on the internet.
[0277] The mobile information terminal 25110 and the touch panel 25111 detect a touch operation on the screen display area, and execute a process corresponding to the position where the touch operation is received.
[0278] [Information display screen] An example of a screen in which video display section 173 displays two broadcast programs will be described below with reference to FIG. 20A.
[0279] 20A shows a state in which video display unit 173 displays a first main window 20000 corresponding to broadcast signal 1, a first sub-window 20001 corresponding to broadcast signal 1, a second main window 20002 corresponding to broadcast signal 2, and a second sub-window 20003 corresponding to broadcast signal 2. Here, the first main window 20000 and the second main window 20002 shown in Fig. 20A, which are main windows, display the main video of the broadcast program. Meanwhile, the first sub-window 20001 and the second sub-window 20003, which are sub-windows, display an execution screen of a broadcast-linked app that links with the broadcast program.
[0280] Hereinafter, the content included in a main window such as first main window 20000 or second main window 20002 displayed by video display unit 173 may be referred to as main content. Also, the content included in a sub-window such as first sub-window 20001 or second sub-window 20003 may be referred to as sub-content.
[0281] A collection of content consisting of a main content and sub-contents related to the main content may also be called a content group. Note that there may be cases where there is only the main content, but such cases are also included in the term "content group" herein. Therefore, the content group described below includes a collection of content consisting of the main content and sub-contents related to the main content, or a single main content with no related sub-contents.
[0282] As a specific example, the content group may include the main video of the broadcast program (including broadcast programs received via terrestrial broadcasting and recorded programs) and an execution screen of a broadcast-linked app linked to the broadcast program. As another specific example, the content group may include content on the Internet (e.g., a web page) and streaming video included in the content (e.g., streaming video included in a web page). As another specific example, the content group may include content on the Internet (e.g., a web page) and other content displayed in multiple windows opened by the same application. Note that multiple sub-contents may be included in a sub-window displayed by video display unit 173. In the case of a broadcast-linked app for VOD (Video On Demand) or a recorded program, the app may be deleted from the specified distribution server. In such a case, an alternative process (e.g., connecting to an alternative connection URL) described in the AIT or accompanying information may be performed. If no alternative process is specified, a message indicating this may be displayed in the sub-window and the app may not be launched.
[0283] Video output unit 175 outputs video information for displaying videos of a plurality of content groups in different windows for each content group to an external display device.
[0284] Video display unit 173 displays the videos of a plurality of content groups in different windows for each content group.
[0285] The viewer instruction input unit 25001 receives an input to set a content group to be selected from a plurality of content groups.
[0286] Of the content groups simultaneously displayed by the video display unit 173 (or output by the video output unit 175), only one content group is set to a selected state, and all other content groups are set to a non-selected state. Then, the audio output unit 176 outputs audio information of the audio corresponding to the selected content group. Furthermore, the audio playback unit 174b plays the audio corresponding to the selected content group. This makes it possible to prevent the audio of multiple content groups from being mixed together.
[0287] When an input to switch the content group to be in the selected state is received, the content group after the switch is set as the set state, and the content group that was previously in the selected state is set as the unselected state. Then, the audio playback unit 174b / audio output unit 176 stops playing / outputting the audio that was previously being played, and plays / outputs the audio of the content group that is now in the set state.
[0288] Specifically, a pointing device such as a mouse 25104 or a touchpad 25106 (including when the mobile information terminal 25110 is used as a pointing device) moves the cursor 20004 to a window displaying the content group to be selected, and accepts a click (e.g., double-click) input, thereby accepting an input to switch to the content group to be selected. Also, in the case of the touch panel 25111, the touch panel 25111 accepts an input to switch to the content group to be selected by double-tapping.
[0289] 20A, the content group displayed in first main window 20000 and first sub-window 20001 is in a selected state, and the content group displayed in second main window and second sub-window 20003 is in a non-selected state. Audio playback unit 174b / audio output unit 176 then plays / outputs the audio of the content group in broadcast signal 1 that corresponds to first main window 20000 that is in a selected state.
[0290] The audio played back / output by the audio playback unit 174b / audio output unit 176 may be the audio of the main content or the audio of the sub-content. Furthermore, when the same content group includes multiple audio pieces, the audio playback unit 174b / audio output unit 176 may select one of them to play back / output.
[0291] In the case of VOD (Video On Demand), the menu list may be displayed in the main windows 20000 and 20002, and the video may be displayed in the sub-windows 20001 and 20003.
[0292] The shape, size, and position of the window may also be freely changeable based on input received from the viewer. Specifically, the shape, size, and position of the window are changed based on input received by the touch panel 25111 (for example, input to move the window position by dragging, or input to change the window size by pinching in and out). The shape, size, and position of the window are also changed based on input received by a pointing device such as the mouse 25104 or touchpad 25106 (for example, input by dragging).
[0293] The video display unit displays a window in which a selected content group is displayed and a window in which a non-selected content group is displayed in different modes. For example, video display unit 173 displays the borders of windows in which content from the same content group is displayed in the same mode (for example, in the same color). Furthermore, video display unit 173 displays the borders of windows in which a selected content group is displayed and the borders of windows in which a non-selected content group is displayed in different modes. This makes it easier to distinguish between windows that belong to the same content group.
[0294] The example in Fig. 20A shows that the content groups displayed in the first main window 20000 and the first subwindow 20001 are selected. That is, the borders of the first main window 20000 and the first subwindow 20001 are displayed in bold, while the borders of the second main window and the second subwindow 20003 are displayed in dashed. Note that the borders of windows displaying selected content groups may be displayed in different colors from the borders of windows displaying unselected content groups. Specifically, the display color in a window displaying unselected content groups may be displayed in a lighter color than the display color in a window displaying selected content groups.
[0295] Furthermore, video display unit 173 displays the main window and sub-windows in different modes. For example, as shown in Fig. 20A, video display unit 173 displays marks 20006 and 20007 on the main window. Note that, as shown in Fig. 23A, window attribute display unit 20310 may display whether the window is a main window or a sub-window.
[0296] Here, when windows are in overlapping positions, the issue of which window is displayed in front of the other window becomes an issue. Next, with reference to Figure 20B, we will explain the case where a window displaying a selected content group and a window displaying a non-selected content group overlap.
[0297] 20B, a window displaying a selected content group is displayed overlapping a window displaying a non-selected content group. That is, first main window 20000 and first sub-window 20001 displaying the selected content group are displayed overlapping second main window and second sub-window 20003.
[0298] Note that the broadcast signal (for example, AIT) may contain window anteroposterior relationship designation information that designates the anteroposterior relationship between related windows.
[0299] Furthermore, the window context specification information may include whether part or all of the window-related specification information can be changed by the viewer's selection.
[0300] In the case of recorded content, video display unit 173 may display the main window based on window front-to-back relationship designation information stored in advance as information related to a content group.
[0301] Furthermore, in the case of content on the Internet, video display unit 173 may display the main window based on window front-to-back relationship designation information that is distributed together with the content as information related to the content group.
[0302] Also, it may be possible to determine which window is displayed in front of other windows based on input received from the viewer. Specifically, as shown in FIG. 20C , when a pointing device such as mouse 25104 or touchpad 25106 moves cursor 20004 to first subwindow 20001 and receives a single click input, video display unit 173 displays first main window 20000 and first subwindow 20001 superimposed on second main window and second subwindow 20003. Also, when touch panel 25111 receives a single tap operation on the window to be displayed in front, the window for which the operation was received may be displayed in front. Note that it is preferable that the click operation for switching content groups and the click operation for operating window display be different operations, such as a single click and a double click.
[0303] 20D, a cursor 20004 may be moved to the first sub-window 20001 using a pointing device such as a mouse 25104 or a touchpad 25106, and after a click input is received, a confirmation window 20005 may be displayed. This makes it possible to prevent the selected content group from being switched to an unintended content group.
[0304] The remote control 25102 accepts inputs to switch the content group to be selected (hereinafter, sometimes simply referred to as switching windows) by operating the buttons. The remote control 25102 will be described in detail below with reference to FIG. 22A.
[0305] 22A receives an input, the mode switches to either the switch mode or the add mode. For example, when the add content button 20213 receives an input in the switch mode, the mode switches from the switch mode to the add mode. On the other hand, when the add content button 20213 receives an input in the add mode, the mode switches from the add mode to the switch mode.
[0306] In the switching mode, there is no change in the total number of content groups displayed by the video display unit 173. On the other hand, in the addition mode, the total number of content groups displayed by the video display unit 173 increases.
[0307] In detail, when channel button 20211 receives an input in switching mode, a content group of the broadcast program corresponding to channel button 20211 is added. Then, video display unit 173 erases the window displaying the content group that was previously selected, and displays a new window displaying the added content group. Then, the newly added content group becomes selected, and audio playback unit 174b / audio output unit 176 stops the audio that has been played / output up until now, and plays / outputs the audio of the newly added content group.
[0308] Video display unit 173 may also be configured to erase the window displaying the content group that has been in a non-selected state for the longest time up to the present time, or to accept an input from the viewer to select the content group to stop displaying.
[0309] In the addition mode, when channel button 20211 accepts input, a content group of the broadcast program corresponding to channel button 20211 is added. Then, video display unit 173 displays a new window in which the added content group is displayed. Then, the newly added content group becomes selected, and audio playback unit 174b / audio output unit 176 stops the audio that has been played / output up until now, and plays / outputs the audio of the newly added content group.
[0310] If the total number of added content groups exceeds the number of tuners, video display unit 173 may erase the window displaying the content group that has been in a non-selected state for the longest time up to the present time. Also, the video display unit 173 may accept an input from the viewer to select the content group to stop displaying.
[0311] When content switching button 20201 shown in Fig. 22A receives an input, the content group in the provisionally selected state is switched. After that, when enter button 20202 receives an input, the content group in the provisionally selected state becomes selected. The above process will be specifically described below with reference to Fig. 22B.
[0312] 22B shows an example in which a group of contents displayed in second main window 20002 is in a provisionally selected state. As shown in FIG. 22B, a provisional selection frame 20204 is displayed around second main window 20002.
[0313] Thereafter, when the enter button 20202 accepts an input, the content group displayed in the second main window 20002 is set to a selected state.
[0314] When the back button 20203 receives an input, the provisionally selected state of the content group displayed in the second main window 20002 is cancelled. This makes it possible to provisionally select a content group without switching the content group. Also, the window of the provisionally selected content group may be displayed in front of the windows of other content groups, and the audio may be switched. This makes it possible to check the contents of the content group that is a candidate for switching, improving convenience.
[0315] Furthermore, by receiving an input that combines the content switching button 20201, the channel button 20211, and the color button 20212, a content group may be set to a provisionally selected state or a selected state.
[0316] Furthermore, a number corresponding to channel button 20211 may be displayed in a window displayed by video display unit 173. In this case, by receiving an input from channel button 20211 after receiving an input from content switching button 20201, the window corresponding to channel button 20211, i.e., the content group, is set to a provisionally selected state or a selected state. Also, as shown in Fig. 23A, a number corresponding to channel button 20211 may be displayed in window attribute display portion 20310.
[0317] Furthermore, a part of a window (for example, a window frame) displayed by video display unit 173 may be displayed in a color corresponding to color button 20212. In this case, when content switching button 20201 accepts an input and then channel button 20211 accepts an input, the window corresponding to color button 20212, i.e., the content group, is set to a provisionally selected state or a selected state.
[0318] 22C, a content group may be added by receiving an input on a menu screen displayed by mobile information terminal 25110. On the menu screen shown in FIG. 22C, each content group is iconized. When icon 20206 displayed on mobile information terminal 25110 is selected (for example, by a touch operation), mobile information terminal 25110 receives an input to add a content group. In the example shown in FIG. 22C, "Channel B" is selected as the content group to be added. The border of icon 20206 corresponding to "Channel B" is displayed in a manner different from that of the other icons 20206 (in the example of FIG. 22C, the border is thicker).
[0319] In the above example, an example of a display screen was described along with a process of specifying or adding a content group by operating an input device. Below, a process of adding a content group of broadcast programs by specifying it from the EPG will be described with reference to Figures 22H and 22I.
[0320] As shown in FIG. 22H, the frame of the broadcast program in the tentatively selected state is enclosed by a tentative selection frame 20226.
[0321] When the enter button 20202 on the remote control (described above, FIG. 22A) accepts an input, the video display unit 173 displays a new window in which the added content group is displayed in place of the EPG 173e. Then, the content group of the provisionally selected broadcast program is added.
[0322] When the content add button 20213 on the remote control accepts input, the content group of the broadcast program that is in a provisionally selected state becomes selected. Also, the frame line 20224 of the selected broadcast program is displayed thicker. In this case, the EPG 173e does not close and continues to accept input to add the content group of the broadcast program. Then, a new provisional selection frame 20226 is displayed for selecting the broadcast program to be provisionally selected.
[0323] When the content add button 20213 accepts input in the state shown in FIG. 22H, the content group of the broadcast program that was in a provisionally selected state becomes selected. Furthermore, as shown in FIG. 22I, the frame 20224 of the selected broadcast program is displayed in a thicker line. Furthermore, the content group of the broadcast program that was in a selected state in FIG. 22H becomes semi-selected in FIG. 22I. Furthermore, as shown in FIG. 22I, the frame of the semi-selected broadcast program is displayed in a thicker line, and diagonal lines are displayed in the corners. Thus, when the content add button 20213 accepts input, the content group of the broadcast program that was previously in a selected state becomes semi-selected, and the content group of the broadcast program that was in a provisionally selected state becomes selected. Therefore, each time the content add button 20213 accepts input, a semi-selected content group is added.
[0324] In the state shown in FIG. 22I, when the enter button 20202 on the remote control receives an input, a content group of broadcast programs that is in a semi-selected state and a content group of broadcast programs that is in a selected state are added. Then, the video display unit 173 displays two windows in which the added content groups are displayed. In this case, the audio playback unit 174b / audio output unit 176 play / output the audio of the content group of broadcast programs that was in a selected state in the EPG 173e. In other words, the audio playback unit 174b / audio output unit 176 do not play / output the audio of the content group of broadcast programs that was in a semi-selected state in the EPG 173e. The content group of broadcast programs that was in a semi-selected state in the EPG 173e becomes a non-selected content group when the content groups are displayed. If there is a content group that was in a selected state in the video display unit 173 before the content group was added by the EPG 173e, that content group becomes a non-selected content group.
[0325] After selecting a content group to be released from the selected or semi-selected state in the EPG 173e, the selected or semi-selected state of the content group is released by receiving an input from the content end button 20216. In this case, when the broadcast program to be released from the selected state becomes selected, the semi-selected content group is changed to selected.
[0326] Note that any content group added by specifying it from the EPG 173e may be in a semi-selected state. In this case, if there is a content group that was in a selected state in the video display unit 173 before the content group was added by the EPG 173e, that content group will maintain its selected state.
[0327] Next, the process of adding a content group by receiving input from the remote control (described above, FIG. 22A) while a launcher menu (described below, FIG. 22J) is displayed will be described with reference to FIGS. 22A and 22J.
[0328] When the menu button 20232 on the remote control receives an input, the video display unit 173 displays the launcher menu 20230 shown in FIG. 22J.
[0329] 22J, a list of multiple menu items 20233 for selecting content and apps is displayed in the launcher menu 20230. Note that apps are also selected as part of a content group.
[0330] 22J, the frame of the menu item 20233 in the provisionally selected state is surrounded by a provisional selection frame 20231. When the arrow button 20214 on the remote control (described above, FIG. 22A) accepts an input, the menu item 20233 surrounded by the provisional selection frame 20231 changes, and accordingly, the content group (content or app) in the provisionally selected state changes.
[0331] When the content add button 20213 on the remote control receives an input, the content group (content or application) corresponding to the menu item 20233 that is temporarily selected is placed in a selected state. The border of the selected content group is displayed in a thicker line. As the new content group is placed in a selected state, the content group that was previously selected is placed in a semi-selected state, and the border of the semi-selected content group is displayed in a thicker line and has a diagonal line in the corner. Thereafter, when the enter button 20202 on the remote control receives an input, the audio output unit 176 displays a window displaying each added content group, instead of the launcher menu 20230. In this case, the content group that was semi-selected in the launcher menu 20230 and the content group that was selected are added as new content groups. The audio output unit 176 then outputs the audio of the content group that was selected in the launcher menu 20230. That is, the audio of the semi-selected content group is not output. A content group that was in a semi-selected state in the launcher menu 20230 becomes a content group in an unselected state when the content group is displayed.
[0332] Specifically, in FIG. 22J, "App 3" is provisionally selected. When the add content button 20213 receives an input in this state, the provisionally selected "App 3" becomes selected. Furthermore, the previously selected "Content 3" becomes semi-selected, and the border of "Content 3" becomes thicker and has diagonal lines at the corners. After that, when the enter button 20202 on the remote control receives an input, the semi-selected "Content 1," "Content 3," and "App 2" content group and the selected "App 3" content group are added as a new content group. Then, the video display unit 173 displays a main window displaying the added "Content 1," "Content 2," "App 2," and "App 3." In this case, the audio output unit 176 outputs the audio of "App 3," which was selected in the launcher menu 20230. In other words, the audio of the semi-selected "Content 1," "Content 2," and "App 2" is not output. It should be noted that the added application is only launched if it does not need to be displayed on the video display unit 173. Furthermore, the "content" in the launcher menu 20230 may be the main content, and the "application" may be the sub-content corresponding to the "content."
[0333] After selecting a content group to be released from the selected or semi-selected state in the launcher menu 20230, the content end button 20216 accepts an input, whereby the selected or semi-selected state of the content group is released.
[0334] Next, a process for adding a content group by designating it from the launcher menu using a pointing device such as the mouse 25104 or the touchpad 25106 or the touch panel 25111 will be described with reference to FIGS. 22J and 22K.
[0335] When launcher icon 20240 shown in FIG. 22K receives a click input (a touch operation in the case of touchpad 25106), the screen switches to that of FIG. 22J, and launcher menu 20230 is displayed.
[0336] When a non-selected menu item 20233 receives a click input (a touch operation in the case of the touchpad 25106), the corresponding content group becomes selected. Also, a content group that was previously selected becomes semi-selected.
[0337] Furthermore, when a selected menu item 20233 receives a click input (a touch operation in the case of the touchpad 25106), the corresponding content group becomes semi-selected, and when a semi-selected menu item 20233 receives a click input (a touch operation in the case of the touchpad 25106), the corresponding content group becomes unselected.
[0338] When the enter button 20202 on the remote control accepts input, the video display unit 173 displays a window in which each added content group is displayed, in place of the launcher menu 20230. In this case, the content group that was in a semi-selected state in the launcher menu 20230 and the content group that was in a selected state are added as new content groups. In this case, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the content group of the broadcast program that was in a selected state. The content group that was in a semi-selected state in the launcher menu 20230 becomes a content group in an unselected state when displayed.
[0339] Note that after information display device 1000 is powered on, launcher menu 20230 may be displayed as the initial screen displayed by video display unit 173. After launcher menu 20230 is displayed, frequently selected content or apps may be pre-selected according to the viewer's preferences.
[0340] As shown in FIG. 22D, information display device 1000 may display only content on the Internet without displaying broadcast programs.
[0341] Furthermore, it may be possible to select a group of related contents by selecting a sub-window in addition to the main window.
[0342] [Operation sequence of information display device] 21A to 21D are diagrams illustrating an operation sequence of the information display device 1000 according to Example 6. A process of adding a content group of another broadcast program when only a content group of a broadcast program is displayed will be described with reference to FIG. 21A.
[0343] First, after information display device 1000 is powered on, the main window displays the selected main content of the program being viewed when the power was last interrupted. Here, when a different broadcast channel is selected by accepting input from channel button 20211 on the remote control (described above, FIG. 22A), the displayed content group is switched to the content group corresponding to the selected broadcast channel. Note that when information display device 1000 is powered on, only a window not displaying content may be displayed, and then, when channel button 20211 on the remote control accepts input, the video of the selected channel may be displayed in the window.
[0344] The following description will be given on the assumption that the program of the first broadcast signal (hereinafter, sometimes referred to as broadcast signal 1) has been selected as the main content.
[0345] First, the information display device 1000 acquires a PMT data string (S20101).
[0346] Next, the information display device 1000 acquires the AIT data string (S20102).
[0347] Next, the information display device 1000 checks the window-related designation information (the window-related designation information is a general term for the window-related designation information such as the window shape designation information and the window front-back relationship designation information) (S20103).
[0348] Next, information display device 1000 displays first main window 20000 (main window 1 in the drawing) corresponding to broadcast signal 1 based on the window shape designation information and window front-to-back relation designation information included in the window-related designation information (S20104).
[0349] After displaying the first main window 20000, the information display device 1000 starts the broadcast cooperative application automatically or in response to a start instruction received from the viewer (S20107).
[0350] As a result, the broadcast linked application is executed, and an execution screen of the broadcast linked screen is displayed in the first subwindow 20001 (subwindow 1 in the drawing) corresponding to the broadcast signal 1 (S20108).
[0351] Thereafter, information display device 1000 accepts an input to add a new content group. Specifically, content add button 20213 accepts the input. Thereafter, channel button 20211 corresponding to the second broadcast signal to be added (hereinafter may be referred to as broadcast signal 2) accepts the input, thereby adding the content group corresponding to broadcast signal 2. Furthermore, the content group corresponding to the added broadcast signal 2 becomes the selected content group, and after undergoing the same processing as when broadcast signal 1 is selected (S20109 to S20111, S20113 to S20115), a second main window 20002 (main window 2 in the figure) and a second sub-window 20003 (sub-window 2 in the figure) corresponding to broadcast signal 2 are displayed (S20112, S20116), and the audio is switched to the audio of the content group of broadcast signal 2. Even after the second main window 20002 and the second sub-window 20003 are displayed, the first main window 20000 and the first sub-window 20001 remain displayed.
[0352] In addition, when either the first main window 20000 or the first sub-window 20001 receives a selection input (e.g., a double-click), the selected content group switches to the content group corresponding to broadcast signal 1, and the audio switches to the audio of the content group of broadcast signal 1.
[0353] Here, the number of tuners included in information display device 1000 is limited. If the number of tuners becomes insufficient due to the addition of a content group, information display device 1000 closes the window of the last selected content group. Note that if the last selected content group is being streamed on the Internet, information display device 1000 may switch to the streaming broadcast instead of closing the window.
[0354] Furthermore, when recording ends and the tuner that has been receiving the broadcast signal is released, information display device 1000 may be configured to display the closed window again. Also, when recording ends and the tuner that has been receiving the broadcast signal is released, information display device 1000 may be configured to return the display that has been switched to streaming broadcast to its original state.
[0355] Furthermore, information display device 1000 may be configured to receive an input from the viewer to select a window to close.
[0356] Next, a process for adding a content group distributed via the Internet when only a content group of broadcast programs is displayed will be described with reference to FIG. 21B, focusing mainly on the differences from FIG. 21A.
[0357] The information display device 1000 checks the window-related designation information (the window-related designation information is a general term for the window-related designation information such as the window shape designation information and the window front-back relationship designation information) (S20103).
[0358] Next, information display device 1000 displays first main window 20000 corresponding to broadcast signal 1 based on the window shape designation information and window front-to-back relation designation information included in the window-related designation information (S20104).
[0359] After displaying the first main window 20000, the information display device 1000 starts the broadcast linked application automatically or in response to a start instruction received from the viewer (S20107). Then, an execution screen of the broadcast linked screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0360] The information display device 1000 receives input of information (for example, a URL or a search keyword) for specifying the content to be requested to be delivered, and then requests delivery of the content specified by the received input information (S20117).
[0361] Hereinafter, the process of accepting input of information for identifying content for which a distribution request is made using the remote control (described above, FIG. 22A) will be described in detail with reference to FIGS. 22A, 22D, and 22E.
[0362] First, when the content add button 20213 on the remote control receives an input, and then when the input switch button receives an input, the screen shown in FIG. 22D is displayed on video display section 173 of information display device 1000.
[0363] The screen shown in Fig. 22D displays an input switching menu 20220. The input switching menu 20220 also displays each category of content (TV broadcast, recorder, external input 1, external input 2, internet, etc.). On the screen shown in Fig. 22D, "Internet" is provisionally selected as the category, and the provisionally selected "Internet" is displayed with a thick frame.
[0364] 22D, when input switch menu 20220 is displayed and arrow button 20214 on the remote control accepts input, the provisionally selected category switches from "Internet" to another category. Also, as the provisionally selected category switches, the thick line displayed in the box for "Internet" disappears, and the box for the switched category is displayed with a thick line instead.
[0365] For example, when arrow button 20214 with an upward arrow receives input, the provisionally selected category is switched to "External Input 2," which is located above the currently provisionally selected "Internet." After that, when arrow button 20214 with a downward arrow receives input, the provisionally selected category is switched to "Internet," which is located below the currently provisionally selected "External Input 2."
[0366] When the enter button 20202 on the remote control accepts the input, the provisionally selected category is decided as the category of the newly added content.
[0367] Here, when "Internet" is provisionally selected and enter button 20202 accepts an input, the screen shown in FIG. 22E is displayed on video display unit 173 of information display device 1000.
[0368] The screen shown in FIG. 22E displays a designation window 20221 that accepts input for specifying newly added Internet content. The newly added content is designated by entering a URL or search keyword (Search in FIG. 22E) into a text box included in the designation window 20221. On the screen shown in FIG. 22E, a URL is selected as the input target, and the frame of the text box into which the URL is to be input is displayed with a thick line. When the designation window 20221 is displayed and arrow button 20214 on the remote control accepts input, the input target is switched from a URL to a search keyword. Furthermore, as the input target is switched, the thick line displayed in the frame of the text box into which the URL is to be input disappears, and the frame of the text box into which the search keyword is to be input is displayed with a thick line.
[0369] The channel button 20211 on the remote control also functions as a character input button. When the channel button 20211 accepts input, characters are entered into the input target text box, thereby entering a URL or search keyword. For example, when a URL is entered into the text box and the enter button 20202 accepts input, the information display device 1000 requests delivery of content identified from the URL. Note that the content add button 20213 may first enter an input switching operation without accepting input, and then the content may be switched by finally accepting input by the enter button 20202, and the content may be added by finally accepting input by the content add button 20213.
[0370] Referring again to Fig. 21B, the content requested for distribution in S20117 is then distributed to information display device 1000 (S20118).
[0371] Next, if there is window-related designation information (a general term for window-related designation information such as the window shape designation information and window anteroposterior relation designation information described above), information display device 1000 checks this window-related designation information (S20119). Then, based on the window shape designation information and window anteroposterior relation designation information included in the checked window-related designation information, information display device 1000 displays a third main window (main window 3 in the drawing) corresponding to broadcast signal 3 (S20120).
[0372] Furthermore, if the distributed content has related content, information display device 1000 requests the distribution of the related content (S20121). Then, the related content requested for distribution in S20121 is distributed to information display device 1000 (S20122). Then, information display device 1000 displays a third subwindow (subwindow 3 in the figure). Note that information display device 1000 requests the distribution of related content using a launcher displayed in the main window.
[0373] Here, when the third main window is displayed, the audio that has been played up until now is switched to the audio of the distributed content. Even after the audio is switched, the first main window 20000 and the first subwindow 20001 remain displayed. Therefore, the windows displaying the content group of the broadcast program (first main window 20000 and first subwindow 20001) and the windows displaying the content group on the Internet (third main window and third subwindow) are displayed. In this state, if either the first main window 20000 or the first subwindow 20001 is double-clicked, the selected content group is switched from the distributed content to the content group of the broadcast program. Then, the played audio is switched from the audio of the distributed content to the audio of the broadcast program. After that, if the third main window or the third subwindow is double-clicked, the selected content group is switched from the content group of the broadcast program to the content group corresponding to the distributed content. Then, the audio being played back switches from the audio of the broadcast program to the audio of the distributed content.
[0374] In the above example, after the content on the Internet is distributed, the audio of the broadcast program is switched to the audio of the distributed content. However, some distributed content may not require audio. If the distributed content does not require audio, the audio may not be switched from the previously selected selected content group, and the distributed content may be displayed without audio. In this case, for example, as shown in FIG. 22F, after the content is distributed, button 20222 may be displayed to accept an input to select whether or not to switch the audio to the distributed content. Furthermore, if button 20222 accepts an input to select not to switch the audio, the distributed content may be designated as a non-selected content group, and the content group whose audio continues to be played may remain as a selected content group.
[0375] Next, the process of adding a content group of recorded programs when only a content group of broadcast programs is displayed will be described with reference to FIGS. 21C and 22D, focusing mainly on the differences from FIG. 21A.
[0376] The information display device 1000 checks the window-related designation information (the window-related designation information is a general term for the window-related designation information such as the window shape designation information and the window front-back relationship designation information) (S20103).
[0377] Next, information display device 1000 displays first main window 20000 corresponding to broadcast signal 1 based on the window shape designation information and window front-to-back relation designation information included in the window-related designation information (S20104).
[0378] After displaying the first main window 20000, the information display device 1000 starts the broadcast linked application automatically or in response to a start instruction received from the viewer (S20107). Then, an execution screen of the broadcast linked screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0379] With first main window 20000 and first sub-window displayed, information display device 1000 requests playback of recorded content (S20124).
[0380] Next, the information display device 1000 receives a playback signal (content playback in the drawing) of the recorded content requested to be played back in S20124 (S20125).
[0381] Next, if there is window-related designation information (a general term for window-related designation information such as the window shape designation information and window front-back relationship designation information described above), the information display device 1000 checks this window-related designation information (S20126).
[0382] Next, information display device 1000 displays a fourth main window (main window 4 in the drawing) based on the window shape designation information and window front-to-back relation designation information included in the confirmed window-related designation information (S20127).
[0383] Next, if the distributed content has related content, the information display device 1000 requests playback of the related content (S20128). Below, the process of accepting input of information for requesting playback of recorded content using the remote control (described above, FIG. 22A) will be described in detail with reference to FIGS. 22D and 22G.
[0384] First, when the content add button 20213 on the remote control receives an input, and then when the input switch button receives an input, the screen shown in FIG. 22D is displayed on video display section 173 of information display device 1000.
[0385] Here, when "Recorder" is provisionally selected and enter button 20202 accepts an input, a screen shown in FIG. 22G is displayed on video display unit 173 of information display device 1000.
[0386] The screen shown in FIG. 22G displays a recorded content list 20223 that accepts input to select recorded content to be newly added (requested to play). The recorded content list 20223 displays a list of recorded content names. In FIG. 22G, the recorded content list 20223 tentatively selects "football 1" as the recorded content to be requested to play. In this state, when the enter button 20202 accepts input, the information display device 1000 requests playback of the tentatively selected recorded content, thereby adding "football 1" to a new content group. Note that the content add button 20213 may initially enter an input switching operation without accepting any input, and then the enter button 20202 may finally accept input to switch content, and the content add button 20213 may accept input to add the content.
[0387] 21C again, the related content requested for playback in S20128 (related content playback in the figure) is distributed to information display device 1000 (S20129). Then, information display device 1000 displays a fourth subwindow (subwindow 4 in the figure).
[0388] Here, when the fourth main window is displayed, the audio that has been played back is switched to the audio of the recorded content. Even after the audio is switched, the first main window 20000 and the first subwindow 20001 remain displayed. Therefore, the windows displaying the content group of the broadcast programs (first main window 20000 and first subwindow 20001) and the windows corresponding to the recorded content (fourth main window and fourth subwindow) are displayed. In this state, if either the first main window 20000 or the first subwindow 20001 is double-clicked, the selected content group is switched from the recorded content to the content group of the broadcast programs. Then, the played audio is switched from the audio of the recorded content to the audio of the broadcast programs. After that, if the fourth main window or the fourth subwindow is double-clicked, the selected content group is switched from the content group of the broadcast programs to the content group of the recorded content. Then, the played audio is switched from the audio of the broadcast programs to the audio of the recorded content.
[0389] The playback device for the recorded content may be built into the information display device or may be external. Furthermore, the related content of the recorded content may be content on the Internet. Furthermore, the control of this embodiment can be applied even when a broadcast program is not being received, as shown in FIG. 21D. [Example]
[0390] The seventh embodiment differs from the sixth embodiment in that after a round of selection of provisionally selected content has been completed, a window frame for accepting input to specify new content is displayed. The following mainly describes the differences between the sixth embodiment and the seventh embodiment, and explanations of commonalities between the six and seventh embodiments are omitted as much as possible.
[0391] When the content add button 20213 or the content switch button 20201 on the remote control (described above, FIG. 22A) accepts input, the selection of provisionally selected content is completed, and then, when the content add button 20213 or the content switch button 20201 accepts further input, the video display unit 173 displays a window frame 20301 that accepts input to specify content.
[0392] The window frame 20301 shown in FIG. 23A displays a content display area 20302, a content designation frame 20303 for designating the content to be displayed in the content display area 20302, a function button 20304, a window minimize button 20305, a window maximize button 20306, and a window close button 20307.
[0393] In the initial state, no content is displayed in the content display area 20302. Thereafter, content is specified in the content designation frame 20303, and the specified content is displayed in the content display area 20302. Specifically, the content to be displayed in the content display area 20302 is specified by inputting a URL into the content designation frame 20303. Note that the content designation frame 20303 accepts input of a channel if the specified content is a broadcast program. Also, the content designation frame 20303 accepts input of a device name if the specified content is content stored in an internal device. Also, the content designation frame 20303 accepts input of a port name if the specified content is content input from an input port.
[0394] In addition, content that is frequently selected according to the viewer's preferences may be displayed as an initial state in content display area 20302. Also, content that has not been provisionally selected may be displayed. In the case of a broadcast program, after content add button 20213 on the remote control accepts input, channel button 20211 may accept input, and the video of the selected channel may be displayed in the window.
[0395] If no content is specified in content specification frame 20303 and the add content button 20213 or the content switch button 20201 receives an input, video display unit 173 switches the display from window frame 20301 to a screen for selecting content. Also, if the end content button 20216 on the remote control receives an input while content is specified, video display unit 173 switches the display from window frame 20301 to a screen for selecting content. In this case, the content specified in window frame 20301 is not displayed on the screen for selecting content.
[0396] Functions such as launching a broadcast-linked app and calling up related content are assigned to the function button 20304. When the function button 20304 to which the function of launching a broadcast-linked app or calling up related content is assigned receives an input, a new window frame 20301 is opened. Then, subcontent is displayed in the newly opened window frame 20301.
[0397] When the window close button 20307 receives an input, the main window and the sub-windows corresponding to the main window are closed. Whether or not to close all related sub-windows when closing the main window may be settable for each content.
[0398] Note that the window frame 20301 may be displayed when the window frame launch icon 20308 shown in FIG. 23B receives a click input from a pointing device (a touch operation in the case of the touchpad 25106).
[0399] Furthermore, window frame 20301 may be supplied by broadcast waves as a broadcast-linked app. Alternatively, it may be supplied from a server on the Internet. Alternatively, a window frame pre-stored in information display device 1000 may be used. Alternatively, multiple window frames 20301 may be provided by including window frame selection information in a broadcast signal (e.g., AIT). Furthermore, in the case of recorded content or content on the Internet, window frame selection information may be recorded / distributed as information related to the content. This allows the viewer to select a window frame. Alternatively, window frame selection information may be included in window-related designation information. Furthermore, since it is desirable to adjust the design of the window frame depending on the size and number of pixels of information display device 1000, the window frame information may be multiple pieces of designation information according to the size and number of pixels of information display device 1000. [Example]
[0400] The difference between Example 8 and Example 6 is that the subwindow of a program that has not been selected when switching content group selection is hidden. This makes the display easier to see when multiple content groups are displayed simultaneously, and improves convenience. Below, the differences between Example 8 and Example 6 will be mainly described, and explanations of the commonalities between Example 8 and Example 6 will be omitted as much as possible.
[0401] In the eighth embodiment, the video display unit 173 hides at least part of the information (for example, a subwindow) of the content group when the content group is switched from a selected state to a non-selected state, and re-displays the information of the content that was hidden when the content group is switched from a non-selected state to a selected state.
[0402] The process of switching content groups (i.e., broadcast programs) when only the content groups of broadcast programs are displayed will be described below with reference to Fig. 24. The display control flow of information display device 1000 in Fig. 24 should normally be shown on a single line, but in order to distinguish between the display control flow of the window group related to broadcast program 1 and the display control flow of the window group related to broadcast program 2, it is shown on two lines.
[0403] First, the information display device 1000 receives an input to select a program of the broadcast signal 1 (S20401).
[0404] Next, the information display device 1000 checks the window-related designation information included in the broadcast signal 1 (S20402).
[0405] Next, information display device 1000 displays first main window 20000 (main window 1 in the drawing) corresponding to broadcast signal 1 based on the window shape designation information and window front-to-back relation designation information included in the window-related designation information (S20403).
[0406] Next, the information display device 1000 starts the broadcast cooperative app automatically or in response to a start instruction received from the viewer (S20404).
[0407] Next, the information display device 1000 displays an execution screen for the broadcast linked screen in the first subwindow 20001 (subwindow 1 in the drawing) corresponding to the broadcast signal 1 (S20405).
[0408] Next, the information display device 1000 receives an input to select a program of the broadcast signal 2 (S20406).
[0409] Next, information display device 1000 stores in the storage device the information necessary to display first subwindow 20001 (S20407). As a result, information display device 1000 saves the information necessary to display first subwindow 20001 in the storage device.
[0410] Next, information display device 1000 closes first subwindow 20001 (S20408). That is, information display device 1000 erases first subwindow 20001 that is being displayed.
[0411] Next, the information display device 1000 checks the window-related designation information included in the broadcast signal 2 (S20409).
[0412] Next, information display device 1000 displays second main window 20002 (main window 2 in the drawing) corresponding to broadcast signal 2 based on the window shape designation information and window front-to-back relation designation information included in the window-related designation information (S20410).
[0413] Next, the information display device 1000 starts the broadcast cooperative app automatically or in response to a start instruction received from the viewer (S20411).
[0414] Next, the information display device 1000 displays the execution screen of the broadcast linked screen in the second subwindow 20003 (subwindow 2 in the drawing) corresponding to the broadcast signal 2 (S20412).
[0415] Next, the information display device 1000 accepts an input to reselect the program of the broadcast signal 1 (S20413).
[0416] Next, information display device 1000 stores in the storage device the information necessary to display second subwindow 20003 (S20414). As a result, information display device 1000 saves the information necessary to display second subwindow 20003 in the storage device.
[0417] Next, information display device 1000 closes second subwindow 20003 (S20415). That is, information display device 1000 erases second subwindow 20003 that is being displayed.
[0418] Next, the information display device 1000 acquires the information stored in S20407 that is necessary to display the first subwindow 20001 (S20416). That is, the information display device 1000 restores the information that was saved in S20407.
[0419] Next, the information display device 1000 re-displays the broadcast linked screen execution screen in the first subwindow 20001 corresponding to the broadcast signal 1 based on the information acquired in S20416 (S20417).
[0420] It should be noted that if the subwindow of the unselected program is deleted and then the unselected content group is selected again, the deleted subwindow may be automatically redisplayed.
[0421] Furthermore, information indicating whether or not the subwindow is to be hidden when not selected may be included as window-related designation information in the broadcast signal (for example, AIT) or in the accompanying information of content on the Internet or recorded content.
[0422] In addition, information indicating whether or not to redisplay a subwindow that was hidden when a content group is reselected may be included as window-related specification information in the broadcast signal (e.g., AIT) or in the accompanying information of content on the Internet or recorded content.
[0423] Also, an input specifying whether or not to hide a subwindow when not selected may be accepted from the viewer. In this case, information display device 1000 may store the viewer's preference and perform processing in accordance with that.
[0424] Furthermore, when a subwindow is to be redisplayed when a content group is reselected, information related to the subwindow may be saved as cache data in information display device 1000. [Example]
[0425] The ninth embodiment differs from the sixth embodiment in that the broadcast cooperative app of the non-selected content group is prohibited from being automatically launched. In the following, the differences between the ninth embodiment and the seventh embodiment will be mainly described, and the commonalities between the two embodiments will be omitted as much as possible.
[0426] Some broadcast-linked apps are set to start automatically. If all broadcast-linked apps are set to start automatically, the number of sub-windows will increase, causing a cluttered screen display.
[0427] In the ninth embodiment, broadcast-linked apps for non-selected content groups are prohibited from being automatically launched. In other words, only broadcast-linked apps for selected content groups are automatically launched. This makes it possible to reduce the number of sub-windows displayed at one time, improving screen visibility.
[0428] Note that the broadcast cooperative app for the non-selected content group may be set to a standby state, in which case the broadcast cooperative app that is in the standby state is activated when the content group is selected.
[0429] In addition, whether to prohibit automatic startup when not selected or to put the device into a startup standby state may be included as window-related designation information in the broadcast signal (for example, AIT) or in the accompanying information of content on the Internet or recorded content.
[0430] Also, an input specifying whether to prohibit automatic startup when not selected or to put the device into a startup standby state may be accepted from the viewer. In this case, the viewer's preference may be stored in information display device 1000, and processing may be performed in accordance with that. [Example]
[0431] The tenth embodiment differs from the sixth embodiment in that windows are displayed on the video display unit 173 of the information display device 1000 and on the mobile information terminal 25110 connected by wire or wirelessly to the information display device 1000. The following mainly describes the differences between the tenth embodiment and the seventh embodiment, and explanations of the commonalities between them are omitted as much as possible.
[0432] In the tenth embodiment, the video display unit 173 of the information display device 1000 displays a main window, and the mobile information terminal 25110 connected to the information display device 1000 by wire or wirelessly displays a sub-window. This allows the mobile information terminal 25110 to be used effectively when multiple content groups are displayed and viewed simultaneously, thereby improving convenience.
[0433] Note that the main content and sub-content included in the content group that is in a non-selected state on the information display device 1000 may also be displayed on the mobile information terminal 25110.
[0434] Alternatively, video display unit 173 of information display device 1000 may display multiple content groups, and audio of the content groups may be output from earphones of mobile information terminal 25110. Furthermore, earphones of mobile information terminal 25110 may output audio of any one of the content groups displayed on video display unit 173 of information display device 1000. This allows multiple viewers to simultaneously watch a content group by each playing and listening to the audio of the content group they want to watch on mobile information terminal 25110, even if they cannot agree on which content group they want to watch.
[0435] The audio playback unit 174b / audio output unit 176 of the information display device 1000 may be configured not to play back / output audio.
[0436] Also, an input specifying the sub-content to be displayed on the portable information terminal 25110 may be accepted from the viewer.
[0437] The invention made by the present invention has been specifically described above based on the embodiment, but it goes without saying that the present invention is not limited to the above embodiment and can be modified in various ways without departing from the gist of the invention.
[0438] For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of one embodiment to the configuration of another embodiment. All of these fall within the scope of the present invention. Furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different ones are used.
[0439] The functions of the present invention described above may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. Alternatively, they may be realized by software, such as by a microprocessor unit interpreting and executing an operating program that realizes each function. Hardware and software may also be used in combination.
[0440] The software that controls the broadcast receiving device 100 may be stored in the ROM 103 and / or storage unit 110 of the broadcast receiving device 100 before shipping. Alternatively, the software may be acquired from another application server 500 on the Internet 200 via the LAN communication unit 121 after shipping. Alternatively, the software stored on a memory card, optical disk, or the like may be acquired via the extended interface unit 124. Similarly, the software that controls the mobile information terminal 700 may be stored in the ROM 703 and / or storage unit 710 of the mobile information terminal 700 before shipping. Alternatively, the software may be acquired from another application server 500 on the Internet 200 via the LAN communication unit 721 or mobile telephone network communication unit 722 after shipping. Alternatively, the software stored on a memory card, optical disk, or the like may be acquired via the extended interface unit 724.
[0441] The present invention can also be applied to devices that do not receive broadcast programs, as long as they display a content group. In other words, information display device 1000 includes all types of devices, including personal computers, tablet terminals, and smartphones.
[0442] Furthermore, the control lines and information lines shown in the diagram are those considered necessary for explanation, and do not necessarily represent all the control lines and information lines on the product. In reality, it can be assumed that almost all components are interconnected. [Explanation of symbols]
[0443] 100: Broadcast receiving device, 100a: Antenna, 101: Main control unit, 102: System bus, 103: ROM, 104: RAM, 110: Storage unit, 121: LAN communication unit, 124: Expansion interface unit, 125: Digital interface unit, 131: Tuner / demodulator unit, 132: First separator, 133: First video decoder unit, 134: First audio decoder unit, 135: First subtitle decoder unit, 141: Data broadcast reception processor unit, 142: Data broadcast Engine, 151: streaming reception processing unit, 152: second separation unit, 153: second video decoding unit, 154: second audio decoding unit, 155: second subtitle decoding unit, 161: application control unit, 162: application engine, 171: video superimposition unit, 172: audio selection unit, 173: video display unit, 174: speaker, 174b: audio playback unit, 175: video output unit, 176: audio output unit, 181: presentation synchronization control unit, 191: terminal cooperation control unit, 200: Internet, 210: router device, 300t: radio tower, 300: broadcasting station server, 301: main control unit, 302: system bus, 304: RAM, 310: storage unit, 321: LAN communication unit, 400: Service provider server, 401: Main control unit, 402: System bus, 404: RAM, 410: Storage unit, 421: LAN communication unit, 500: Other application servers, 600: Mobile telephone communication servers, 600b: Base stations, 700: mobile information terminal, 701: main control unit, 702: system bus, 703: ROM, 704: RAM, 710: storage unit, 720: communication processing unit, 721: LAN communication unit, 722: mobile telephone network communication unit, 723: NFC communication unit, 724: expansion interface unit, 730: operation unit, 740: image processing unit, 741: display unit, 742: image signal processing unit, 743: first image input unit, 744: second image input unit, 750: audio processing unit, 751: audio output unit, 752: audio signal processing unit, 753: audio input unit, 760: sensor unit, 761: GPS receiving unit, 762: gyro sensor, 763: geomagnetic sensor, 764: acceleration sensor, 765: illuminance sensor, 766: proximity sensor, 1000: Information display device, 20000: First main window, 20001: First sub-window, 20002: Second main window, 20003: Second sub-window, 20301: Window frame, 25001: viewer instruction input unit, 25002: content input unit, 25003: content playback unit, 25004: content recording and playback unit, 25005: control unit, 25102: remote control, 25104: mouse, 25106: touchpad, 25108: keyboard, 25110: mobile information terminal, 25111: touch panel.
Claims
[Claim 1] 1. An application launch method for launching an application for accessing broadcast resources in a broadcast receiving device, comprising: the applications for accessing the broadcast resources include a broadcast-managed application activated by application control information included in the broadcast signal, and a non-broadcast-managed application activated by information other than the application control information included in the broadcast signal; a receiving step of receiving a broadcast signal; a start-up priority confirmation step of confirming a start-up priority of the broadcast-managed application relative to data broadcasting based on PMT (Program Map Table) information included in the received broadcast signal; a first application activation step of activating the broadcast-managed application based on application control information included in the received broadcast signal; a launcher screen display step of displaying a launcher screen on the broadcast receiving device by an application launcher provided in the broadcast receiving device; a second application launching step of launching the non-broadcast managed application based on a user operation via the displayed launcher screen; a communication step of communicating with an external mobile terminal; a third application launch step of launching the non-broadcast managed application based on a launch request received in the communication step and initiated by a user operation via the external mobile terminal; a data broadcast screen display step of causing the broadcast receiving device to display a data broadcast screen based on BML information included in the received broadcast signal; a fourth application launch step of launching the broadcast managed application based on a user operation in the data broadcast screen display state; Equipped with the first application launch step, when the application control information includes information indicating automatic launch of the broadcast managed application, confirms whether the broadcast managed application is executable, and, if executable, acquires and launches the broadcast managed application; The confirmation of whether the broadcast managed application can be executed is performed by checking the functions of the broadcast receiving device required by the broadcast managed application by referring to an application profile included in the application control information; In the data broadcast screen display step, when it is confirmed that the broadcast receiving device is capable of executing the broadcast managed application, the data broadcast screen display step controls to display an entry button for starting the broadcast managed application; In the fourth application activation step, the broadcast managed application is activated based on a user operation on the entry button displayed in the data broadcast screen display state. How to launch the application.
Citation Information
Patent Citations
Terminal cooperation system and receiver
JP2012243062A
Information processing terminal, application-cooperative content management server and location resolution server
JP2012244286A
Data broadcasting display control device and data broadcasting presence / absence display control method
JP2012256997A
receiver
JP2012257221A
Reception apparatus, reception method, transmission apparatus, transmission method, and program
WO2013154023A1