Application startup method
The integration of digital broadcast reception with broadband networks and mobile terminals enhances functionality by leveraging application control information and extended BML specifications, addressing bandwidth limitations in digital broadcast receivers.
Patent Information
- Application Number
- JP2024114871
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-07-18
- Publication Date
- 2025-08-04
- Estimated Expiration
- 2034-06-11
AI Technical Summary
Digital broadcast receivers face limitations in transmitting high-definition screen displays and high-functional effects due to radio wave band constraints, making it difficult to execute functions with high added value.
A method that combines digital broadcast reception with broadband network capabilities, enabling additional content acquisition and cooperation with mobile terminal devices, utilizing application control information and extended BML specifications to enhance functionality.
Enables execution of functions with higher added value by integrating digital broadcast services with broadband networks and mobile terminals, overcoming bandwidth limitations.
Smart Images

Figure 0007717916000001 
Figure 0007717916000002 
Figure 0007717916000003
Abstract
Description
Technical Field
[0001] The present invention relates to an application startup method.
Background Art
[0002] One of the extended functions of digital broadcast services is data broadcast that transmits digital data by broadcast waves and displays various information such as weather forecasts, news, and recommended programs. A large number of TV receivers capable of receiving data broadcasts are already commercially available, and a number of technologies related to data broadcast reception, including Patent Document 1 below, have been published.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] As a feature of data broadcast, in a TV receiver compatible with digital broadcast services, it is possible to receive data broadcast alone and acquire / display various information. On the other hand, since the amount of data that can be transmitted is limited due to radio wave band limitations in data broadcast, it is difficult to obtain high-definition screen displays or high-functional effects. For this reason, there has been a problem that it is difficult to execute useful functions with high added value on current digital broadcast receivers.
[0005] An object of the present invention is to provide an application startup method capable of executing functions with higher added value.
Means for Solving the Problems
[0006] As a means for solving the above problems, the technology described in the claims is used.
[0007] For example, the technique described in claim 1 is used.
Advantages of the Invention
[0008] By using the technique of the present invention, it is possible to provide an application startup method capable of executing a function with higher added value.
Brief Description of the Drawings
[0009]
Figure 1
Figure 2A
Figure 2B
Figure 2C
Figure 2D
Figure 3
Figure 4
Figure 5A
Figure 5B
Figure 6
Figure 7A
Figure 7B
Figure 7C
Figure 8A
Figure 8B
Figure 8C
Figure 9
Figure 10A
Figure 10B
Figure 11
Figure 12A
Figure 12B
Figure 13A
Figure 13B
Figure 13C
Figure 13D
Figure 14
Figure 15
Figure 16A
Figure 16B
Figure 17
Figure 18A
Figure 18B
Figure 18C
Figure 18D
Figure 19A
Figure 19B
Figure 19C
Figure 19D
Figure 19E
Figure 19F
Figure 20A
Figure 20B
Figure 20C
Figure 20D
Figure 21A
Figure 21B
Figure 21C
Figure 21D
Figure 22A
Figure 22B
Figure 22C
Figure 22D
Figure 22E
Figure 22F
Figure 22G
Figure 22H
Figure 22I
Figure 22J
Figure 22K
Figure 23A
Figure 23B
Figure 24
Mode for Carrying Out the Invention
[0010] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.
Example
[0011] First, an example of a digital broadcast service receivable by the broadcast receiving device of the present embodiment will be described.
[0012] For example, in an example of BS / terrestrial digital broadcasting that can be received by the broadcast receiving apparatus of the present embodiment, a plurality of transport streams (TS) can be multiplexed and transmitted in one transponder (frequency channel). A TS is a continuous sequence of TS packets of a predetermined length obtained by dividing data sequences such as video / audio elementary streams (ES) and program specific information (PSI) / service information (SI) and adding a TS header.
[0013] PSI is a proprietary information table defined by the MPEG (Moving Picture Experts Group)-2 system standard for identifying to which program each ES included in the TS belongs. PSI is composed of a PAT (Program Association Table), a PMT (Program Map Table), a CAT (Conditional Access Table), and the like. The PAT defines a list of programs included in the TS by the PID (Packet Identifier) of the PMT. The PMT defines the PID of the constituent elements of each program and the like. The CAT contains information regarding restricted reception.
[0014] In addition, SI extends PSI and includes program information and the like, and has information regarding the Electronic Program Guide (EPG) defined by the Association of Radio Industries and Businesses (ARIB) in ARIB STD-B10. SI is composed of a Broadcaster Information Table (BIT), a Service Description Table (SDT), an Event Information Table (EIT), a Time Offset Table (TOT), etc. BIT includes broadcaster identification information, network information, SI transmission information of the broadcaster, etc. SDT includes information such as a network ID for identifying a network, a TS ID for identifying a TS, and a service ID (so-called channel number) for identifying individual services (so-called channels) within the network. EIT includes a service ID for identifying individual services within the network and information regarding events, such as the name, broadcast date and time, and broadcast content of each event (so-called program). TOT includes information regarding the current date and time.
[0015] In addition, TS includes Program Clock Reference (PCR) information, which serves as a reference for the playback timing in a decoder, and BML documents subset based on the Broadcast Markup Language (BML) specification defined in ARIB STD-B24.
[0016] In the broadcast receiving apparatus of this embodiment, by receiving and decoding a TS composed of the video / audio ES and various information, etc., it is possible to provide the user with a broadcast program, an EPG, a data broadcast screen produced using BML, etc.
[0017] In addition, the broadcast receiving apparatus of this embodiment can cooperate with a function that uses a broadband network for digital broadcast services, and combines the acquisition of additional content via the broadband network, arithmetic processing in the server apparatus, presentation processing through cooperation with mobile terminal devices, etc. with the digital broadcast service, and is compatible with a broadcast communication cooperation system. In order to realize the broadcast communication cooperation system, it is assumed that the broadcast receiving apparatus of this embodiment can execute an application described in HTML (Hyper Text Markup Language) or the like. Further, in the broadcast communication cooperation system corresponding to this broadcast receiving apparatus, an extended BML specification, application control information (Application Information Table: AIT) in the broadcast communication cooperation system, and extended PSI / SI information necessary for transmitting an application by a broadcast wave are used. Note that AIT is information for providing or notifying various information necessary for starting an application such as the acquisition destination of an application, and control information for controlling the start / end of an application, etc.
[0018] The above description is based on the digital broadcast service in Japan, but it is not limited to applications only in Japan, including the broadcast communication cooperation system corresponding to the broadcast receiving apparatus of this embodiment.
[0019] Next, a specific configuration example of the embodiment in this embodiment will be described.
[0020] [System Configuration] FIG. 1 is a system configuration diagram showing an example of the communication system of this embodiment for realizing a broadcast communication cooperation system. The communication system of this embodiment includes a broadcast receiving apparatus 100, an antenna 100a, a broadband network 200 such as the Internet and a router apparatus 210, a radio tower 300t of a broadcast station, a broadcast station server 300, a service provider server 400, other application servers 500, a mobile phone communication server 600 and a base station 600b of a mobile phone communication network, and a portable information terminal 700.
[0021] The broadcast receiving device 100 is a television receiver that has a function corresponding to the broadcast communication cooperation system in addition to the existing digital broadcast receiving function. The broadcast receiving device 100 receives the broadcast wave transmitted from the radio tower 300t via the antenna 100a. Also, the broadcast receiving device 100 can be connected to the Internet 200 via the router device 210, and can transmit and receive data by communicating with each server device on the Internet 200.
[0022] The router device 210 is connected to the Internet 200 by wireless communication or wired communication, and is connected to the broadcast receiving device 100 by wireless communication or wired communication and to the portable information terminal 700 by wireless communication. As a result, each server device on the Internet 200, the broadcast receiving device 100, and the portable information terminal 700 can mutually transmit and receive data via the router device 210. Note that the communication between the broadcast receiving device 100 and the portable information terminal 700 may be directly performed by a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without passing through the router device 210.
[0023] The radio tower 300t transmits a broadcast wave including a digital broadcast signal, AIT, control information regarding application presentation, etc. from the broadcast facilities of the broadcasting station. Note that the control information regarding application presentation is control information regarding the overlay of a broadcast program and an application on the television receiver and the availability of presenting the application. Also, assume that the broadcasting station includes a broadcasting station server 300. The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata such as the program title, program ID, program overview, cast, broadcast date and time, etc. of each broadcast program, and can provide the video content and each metadata to the service provider based on a contract. Note that the provision of the video content and each metadata to the service provider may be performed through an API (Application Programming Interface) provided in the broadcasting station server 300.
[0024] The service provider server 400 is a server device prepared for the service provider to provide services through the broadcast communication cooperation system. The service provider server 400 stores, manages, and distributes video content and metadata provided by the broadcast station server 300, as well as content and applications produced for the broadcast communication cooperation system. It also has a function of searching for available applications and providing a list in response to inquiries from the television receiver. Note that the storage, management, and distribution of the content and metadata, and the storage, management, and distribution of the applications may be performed by different server devices. The broadcast station and the service provider may be the same or different operators. Multiple service provider servers 400 may be prepared for different services. Also, the functions of the service provider server 400 may be incorporated in the broadcast station server 300.
[0025] The other application server 500 is a known server device that stores, manages, and distributes general applications, operation programs, content, and data other than those related to the broadcast communication cooperation system.
[0026] The mobile phone communication server 600 is connected to the Internet 200 and, on the other hand, is connected to the mobile information terminal 700 via the base station 600b. The mobile phone communication server 600 manages telephone communication (call) and data transmission / reception via the mobile phone communication network of the mobile information terminal 700, enabling data transmission / reception through communication between the mobile information terminal 700 and each server device on the Internet 200. Note that the communication between the mobile information terminal 700 and the broadcast receiving device 100 may also be performed via the base station 600b, the mobile phone communication server 600, the Internet 200, and the router device 210.
[0027] [Hardware Configuration of Broadcast Receiving Device] FIG. 2A is a block diagram showing an example of the internal configuration of the broadcast receiving apparatus 100. The broadcast receiving apparatus 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first subtitle decoding unit 135, a data broadcast reception processing unit 141, a data broadcast engine 142, a streaming reception processing unit 151, a second separation unit 152, a second video decoding unit 153, a second audio decoding unit 154, a second subtitle decoding unit 155, an application control unit 161, an application engine 162, a video superimposing unit 171, an audio selection unit 172, a video display unit 173, a speaker 174, a video output unit 175, an audio output unit 176, a presentation synchronization control unit 181, and a terminal cooperation control unit 191.
[0028] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving apparatus 100 according to a predetermined operation program. The system bus 102 is a data communication path for performing data transmission and reception between the main control unit 101 and each operation block in the broadcast receiving apparatus 100.
[0029] The ROM (Read Only Memory) 103 is a memory in which basic operation programs such as an operating system and other operation programs are stored. For example, a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or a flash ROM is used. The RAM (Random Access Memory) 104 serves as a work area when executing basic operation programs and other operation programs. The ROM 103 and the RAM 104 may be integrally configured with the main control unit 101. Further, the ROM 103 may not be configured independently as shown in FIG. 2A, and a part of the storage area in the storage unit 110 may be used.
[0030] The storage unit 110 stores the operation program and operation setting values of the broadcast receiving apparatus 100, personal information of the user of the broadcast receiving apparatus 100, and the like. Further, it can store an operation program downloaded from the network and various data created by the operation program. It can also store content such as moving images, still images, and audio obtained from a broadcast wave or downloaded from the network. A part of the storage unit 110 may replace all or part of the functions of the ROM 103. Further, the storage unit 110 needs to hold the stored information even when no external power is supplied to the broadcast receiving apparatus 100. Therefore, for example, a semiconductor element memory such as a flash ROM or an SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disc Drive), or the like is used.
[0031] It is assumed that each of the operation programs stored in the ROM 103 and the storage unit 110 can be updated and functionally expanded by a download process from each server device on the Internet 200.
[0032] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via a router device 210 and transmits and receives data to and from each server device on the Internet 200. The connection to the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 is assumed to include an encoding circuit, a decoding circuit, and the like. Further, the broadcast receiving apparatus 100 may further include other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, and an infrared communication unit.
[0033] The tuner / demodulation unit 131 receives broadcast waves from the radio tower 300t via the antenna 100a and tunes (selects a channel) to the channel of the service desired by the user based on the control of the main control unit 101. Further, the tuner / demodulation unit 131 demodulates the received broadcast signal to obtain a TS. In the example shown in FIG. 2A, a configuration in which there is one tuner / demodulation unit is illustrated, but for the purpose of simultaneous display of multiple screens, recording of back programs, etc., the broadcast receiving apparatus 100 may be configured to include a plurality of tuner / demodulation units. Also, based on the control of the main control unit 101, control of access restriction for the demodulated TS may be performed, etc.
[0034] The first separation unit 132 inputs the TS output from the tuner / demodulation unit 131 and separates and outputs it into each data sequence such as a video data sequence, an audio data sequence, a subtitle data sequence, a program information data sequence, an AIT data sequence, a BML data sequence, etc. These data sequences may be in the ES format, for example. The first video decoding unit 133 decodes the video data sequence input from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data sequence input from the first separation unit 132 and outputs audio information. The first subtitle decoding unit 135 decodes the subtitle data sequence input from the first separation unit 132 and outputs subtitle information.
[0035] The data broadcast reception processing unit 141 decodes the BML data sequence input from the first separation unit 132 and plays back the BML document. The data broadcast engine 142 is a BML browser that executes the BML document, and executes the BML document played back by the data broadcast reception processing unit 141 and outputs data broadcast screen information.
[0036] The streaming reception processing unit 151 accesses video content, etc. placed on each server device on the Internet 200 via the LAN communication unit 121 based on the control of the main control unit 101, and obtains a program stream (PS) of the video content, etc. Also, based on the control of the main control unit 101, control of DRM (Digital Rights Management) processing for the obtained PS may be performed, etc.
[0037] The second separation unit 152 inputs the PS output from the streaming reception processing unit 151, and separates and outputs it into each data sequence such as a video data sequence, an audio data sequence, and a subtitle data sequence. These data sequences may be in, for example, the ES format. Since the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155 perform the same processing as the first video decoding unit 133, the first audio decoding unit 134, and the first subtitle decoding unit 135 respectively, the description thereof is omitted.
[0038] Note that the first separation unit 132 and the second separation unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, and the first subtitle decoding unit 135 and the second subtitle decoding unit 155 may be used in common respectively.
[0039] Based on the AIT data sequence input from the first separation unit or the AIT file acquired from each server device on the Internet 200, the application control unit 161 acts on the application engine 162 regarding the application produced for the broadcast communication cooperation system, and controls and manages the life cycle and events of the application in units of applications. Also, depending on the state of the application and the instructions of the AIT, the control of the function constraints of the application is appropriately performed. The application engine 162 is an HTML browser that acquires and executes the application produced for the broadcast communication cooperation system based on the control of the application control unit 161.
[0040] The video superimposing unit 171 inputs the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcast screen information output from the data broadcast engine 142, the video information output from the second video decoding unit 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162, and performs processes such as selection and / or superimposition. The video superimposing unit 171 includes a video RAM (not shown), and the video display unit 173 etc. are driven based on the video information input to the video RAM. Also, based on the control of the main control unit 101, the video superimposing unit 171 performs, as necessary, scaling processing and superimposing processing of EPG screen information created based on the program information data string output from the first separation unit 132 etc.
[0041] The audio selection unit 172 inputs the audio information output from the first audio decoding unit 134, the audio information output from the second audio decoding unit 154, and the application execution audio information output from the application engine 162, and appropriately selects and outputs the audio information according to the control of the main control unit 101.
[0042] The video display unit 173 is a display device such as a liquid crystal panel, etc., and provides the video information subjected to selection and / or superimposing processing by the video superimposing unit 171 to the user of the broadcast receiving apparatus 100. The speaker 174 provides the audio information output from the audio selection unit 172 to the user of the broadcast receiving apparatus 100. The video output unit 175 is a video output interface that outputs the video information subjected to selection and / or superimposing processing by the video superimposing unit 171. The audio output unit 176 is an audio output interface that outputs the audio information output from the audio selection unit 172. Note that, as described above, when the broadcast receiving apparatus 100 is a television receiver etc., the video output unit 175 and the audio output unit 176 are not essential components of the present invention.
[0043] The prompt synchronization control unit 181 controls the prompt synchronization on the video display unit 173 and the speaker 174, or on the video output unit 175 and the audio output unit 176, for video information, audio information, etc. obtained by decoding the TS acquired from the broadcast wave, video information, audio information, etc. obtained by decoding the PS acquired from each server device on the Internet 200, and application execution screen information and application execution audio information output from the application engine 162, based on, for example, PCR information and the like.
[0044] When performing cooperation with an external mobile terminal device, the terminal cooperation control unit 191 performs management and control such as discovery and authentication of the cooperation device (mobile terminal device), connection between the broadcast receiving apparatus 100 and the cooperation device, and cooperation of applications.
[0045] The extended interface unit 124 is a group of interfaces for extending the functions of the broadcast receiving apparatus 100. In this embodiment, it is assumed to be composed of an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. The analog video / audio interface inputs an analog video signal / audio signal from an external video / audio output device, outputs an analog video signal / audio signal to an external video / audio input device, and the like. The USB interface connects to a PC or the like to transmit and receive data. An HDD may be connected to record broadcast programs and contents. Also, a keyboard and other USB devices may be connected. The memory interface connects a memory card and other memory media to transmit and receive data.
[0046] The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. Assume that the digital interface unit 125 can directly output the TS obtained by the tuner / demodulator unit 131 and the PS obtained by the streaming reception processing unit 151. Also, it may be controlled to input the TS and PS input from the digital interface unit 125 to the first separation unit 132 and the second separation unit 152. The output of the digital content stored in the storage unit 110 or the storage of digital content in the storage unit 110 may be performed via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal, an HDMI terminal, etc., and data may be output or input in a format compliant with DVI specifications, HDMI specifications, etc. It may also be output or input in the form of serial data compliant with IEEE1394 specifications, etc.
[0047] In addition to a television receiver, the broadcast receiving apparatus 100 may be an optical disk drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disk drive recorder such as an HDD recorder, an STB (Set Top Box), etc. It may also be a PC (Personal Computer), a tablet terminal, a game machine, etc. equipped with a digital broadcast receiving function and a broadcast communication cooperation function. When the broadcast receiving apparatus 100 is a DVD recorder, an HDD recorder, an STB, etc., the video display unit 173 and the speaker 174 may not be provided. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, the same operation as the broadcast receiving apparatus 100 of this embodiment becomes possible.
[0048] [Software Configuration of Broadcast Receiving Apparatus] FIG. 2B is a software configuration diagram of the broadcast receiving apparatus 100 of the present embodiment, showing the software configuration in the ROM 103, the RAM 104, and the storage unit 110. In the present embodiment, the basic operation program 1001 and other operation programs are stored in the ROM 103, and the receiver function program 1002, the BML browser program 1003, the HTML browser program 1004, and other operation programs are stored in the storage unit 110. Further, the storage unit 110 is provided with a content storage area 1011 for storing contents such as videos, still images, and sounds, an authentication information storage area 1012 for storing authentication information and the like used when cooperating with an external portable terminal device, and various information storage areas for storing various other information.
[0049] The basic operation program 1001 stored in the ROM 103 is expanded in the RAM 104, and further, the main control unit 101 executes the expanded basic operation program, thereby constituting the basic operation execution unit 1101. Also, the receiver function program 1002, the BML browser program 1003, and the HTML browser program 1004 stored in the storage unit 110 are each expanded in the RAM 104, and further, the main control unit 101 executes the expanded operation programs, thereby constituting the receiver function execution unit 1102, the BML browser engine 1103, and the HTML browser engine 1104. Also, the RAM 104 is provided with a temporary storage area for temporarily holding data created when each operation program is executed, as needed.
[0050] In the following, for the sake of simplicity of explanation, the process of controlling each operation block by the main control unit 101 expanding and executing the basic operation program 1001 stored in the ROM 103 in the RAM 104 will be described as being performed by the basic operation execution unit 1101 for controlling each operation block. The same description will be made for other operation programs.
[0051] The reception function execution unit 1102 controls each operation block of the broadcast reception device 100 to implement a broadcast reception function and a broadcast communication cooperation function. In particular, the broadcast program playback unit 1102a mainly controls the tuner / demodulation unit 131, the first separation unit 132, the first video decoding unit 133, the first audio decoding unit 134, the first subtitle decoding unit 135, the data broadcast reception processing unit 141, and the data broadcast engine 142. Note that the data broadcast engine 142 may be replaced by the BML browser engine 1103 deployed on the RAM 104. Further, the communication content playback unit 1102b mainly controls the streaming reception processing unit 151, the second separation unit 152, the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155. The cooperation application control unit 1102c mainly controls the application control unit 161 and the application engine 162. Note that the application engine 162 may be replaced by the HTML browser engine 1104 deployed on the RAM 104. The terminal cooperation management unit 1102d mainly controls the terminal cooperation control unit 191.
[0052] Each of the above operation programs may be stored in the ROM 103 and / or the storage unit 110 in advance at the time of product shipment. After the product is shipped, it may be obtained from another application server 500 on the Internet 200 via the LAN communication unit 121. Further, each of the above operation programs stored in a memory card, an optical disk, or the like may be obtained via the expansion interface unit 124 or the like.
[0053] [Configuration of Broadcast Station Server] FIG. 3 is a block diagram showing an example of the internal configuration of the broadcast station server 300. The broadcast station server 300 includes a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, and a LAN communication unit 321.
[0054] The main control unit 301 is a microprocessor unit that controls the entire broadcast station server 300 according to a predetermined operation program. The system bus 302 is a data communication path for performing data transmission and reception between the main control unit 301 and each operation block in the broadcast station server 300. The RAM 304 serves as a work area when each operation program is executed.
[0055] The storage unit 310 stores the basic operation program 3001 and the content management / delivery program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. The video content storage area 3011 stores video content and the like of each broadcast program broadcast by the broadcast station. The metadata storage area 3012 stores metadata such as the program title, program ID, program summary, performers, broadcast date and time, etc. of each of the above broadcast programs.
[0056] Also, the basic operation program 3001 and the content management / delivery program 3002 stored in the storage unit 310 are respectively expanded into the RAM 304, and further, by the main control unit 301 executing the expanded basic operation program and content management / delivery program, a basic operation execution unit 3101 and a content management / delivery execution unit 3102 are configured.
[0057] In the following, for the sake of simplicity of explanation, the process of the main control unit 301 expanding and executing the basic operation program 3001 stored in the storage unit 310 in the RAM 304 to control each operation block will be described as the basic operation execution unit 3101 performing the control of each operation block. The same description will be made for other operation programs.
[0058] The content management / delivery execution unit 3102 manages the video content and the like and each metadata stored in the video content storage area 3011 and the metadata storage area 3012, and controls the provision of the video content and the like and each metadata to the service provider based on the contract. Further, when providing the video content and the like and each metadata to the service provider, the content management / delivery execution unit 3102 also performs authentication processing and the like of the service provider server 400 based on the contract as necessary.
[0059] The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 and the like on the Internet 200. The LAN communication unit 321 is assumed to include an encoding circuit, a decoding circuit, and the like.
[0060] [Configuration of Service Provider Server] FIG. 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 includes a main control unit 401, a system bus 402, a RAM 404, and a storage unit 410, and a LAN communication unit 421.
[0061] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operation program. The system bus 402 is a data communication path for performing data transmission and reception between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.
[0062] The storage unit 410 stores the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003, and further includes a video content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content and the like provided from the broadcasting station server 300, each metadata, the content produced by the service provider, and the metadata related to the content. The application storage area 4013 stores applications necessary for realizing each service of the broadcast communication cooperation system for distribution in response to requests from each television receiver.
[0063] Also, the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003 stored in the storage unit 410 are respectively expanded in the RAM 404, and further, the main control unit 401 executes the expanded basic operation program, content management / distribution program, and application management / distribution program, thereby constituting a basic operation execution unit 4101, a content management / distribution execution unit 4102, and an application management / distribution execution unit 4103.
[0064] In the following, for the sake of simplicity of explanation, the process in which the main control unit 401 expands and executes the basic operation program 4001 stored in the storage unit 410 in the RAM 404 to control each operation block is described as if the basic operation execution unit 4101 controls each operation block. The same description is made for other operation programs.
[0065] The content management / delivery execution unit 4102 acquires video content and the like and each metadata from the broadcasting station server 300, manages the video content and the like and each metadata stored in the video content storage area 4011 and the metadata storage area 4012, and controls the distribution of the video content and the like and each metadata to each television receiver. Further, the application management / distribution execution unit 4103 manages each application stored in the application storage area 4013, and controls the distribution of each application in response to requests from each television receiver. Furthermore, when distributing each application to each television receiver, the application management / distribution execution unit 4103 also performs authentication processing and the like of each television receiver as necessary.
[0066] The LAN communication unit 421 is connected to the Internet 200, and communicates with the broadcasting station server 300 on the Internet 200, the broadcasting reception device 100, and the mobile information terminal 700 via the router device 210. The LAN communication unit 421 is assumed to include an encoding circuit, a decoding circuit, and the like.
[0067] [Hardware Configuration of Mobile Information Terminal] FIG. 5A is a block diagram showing an example of the internal configuration of the mobile information terminal 700. The mobile information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760.
[0068] The main control unit 701 is a microprocessor unit that controls the entire mobile information terminal 700. The system bus 702 is a data communication path for performing data transmission and reception between the main control unit 701 and each operation block in the mobile information terminal 700.
[0069] The ROM 703 is a memory that stores basic operation programs such as an operating system and other operation programs, and a rewritable ROM such as an EEPROM or a flash ROM is used, for example. The RAM 704 serves as a work area when executing the basic operation program and other operation programs. The ROM 703 and the RAM 704 may be integrally configured with the main control unit 701. Also, the ROM 703 may not have an independent configuration as shown in FIG. 5A, and may use a partial storage area in the storage unit 710.
[0070] The storage unit 710 stores the operation program and operation setting values of the portable information terminal 700, personal information of the user of the portable information terminal 700, etc. Also, it can store operation programs downloaded from the network and various data created by the operation programs. Further, it can store contents such as videos, still images, and audio downloaded from the network. A part of the storage area of the storage unit 710 may be used to replace all or part of the functions of the ROM 703. Also, the storage unit 710 needs to retain the stored information even when no external power is supplied to the portable information terminal 700. Therefore, for example, devices such as flash ROMs, SSDs, and HDDs are used.
[0071] It is assumed that each of the operation programs stored in the ROM 703 and the storage unit 710 can be updated and functionally expanded by a download process from each server device on the Internet 200.
[0072] The communication processing unit 720 is composed of a LAN communication unit 721, a mobile phone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via a router device 210 and transmits and receives data with each server device on the Internet 200. Assume that the connection with the router device 210 is made by wireless connection such as Wi-Fi (registered trademark). The mobile phone network communication unit 722 performs telephone communication (call) and data transmission and reception by wireless communication with a base station 600b of the mobile phone communication network. The NFC communication unit 723 performs wireless communication when in proximity to a corresponding reader / writer. The LAN communication unit 721, the mobile phone network communication unit 722, and the NFC communication unit 723 are each assumed to be equipped with a coding circuit, a decoding circuit, an antenna, etc. Also, the communication processing unit 720 may further be equipped with other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.
[0073] The expansion interface unit 724 is a group of interfaces for expanding the functions of the mobile information terminal 700. In this embodiment, it is assumed to be composed of a video / audio interface, a USB interface, a memory interface, etc. The video / audio interface performs input of video signals / audio signals from external video / audio output devices, output of video signals / audio signals to external video / audio input devices, etc. The USB interface connects to a PC or the like to transmit and receive data. Also, a keyboard or other USB devices may be connected. The memory interface connects a memory card or other memory media to transmit and receive data.
[0074] The operation unit 730 is an instruction input unit for inputting operation instructions to the mobile information terminal 700. In this embodiment, it is assumed to be composed of a touch panel 730t arranged overlapping the display unit 741 and operation keys 730k arranged with button switches. Only one of them may be used. The operation of the mobile information terminal 700 may be performed using a keyboard or the like connected to the expansion interface unit 724. The operation of the mobile information terminal 700 may be performed using a separate mobile terminal device connected by wired communication or wireless communication. Also, the touch panel function may be provided by the display unit 741.
[0075] The image processing unit 740 is composed of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides the image data processed by the image signal processing unit 742 to the user of the portable information terminal 700. The image signal processing unit 742 includes a video RAM (not shown), and drives the display unit 741 based on the image data input to the video RAM. Further, the image signal processing unit 742 is assumed to have functions such as format conversion and superimposing processing of menus and other OSD (On Screen Display) signals as necessary. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings or an object by converting the light input from the lens into an electrical signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0076] The audio processing unit 750 is composed of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker, and provides the audio signal processed by the audio signal processing unit 752 to the user of the portable information terminal 700. The audio input unit 753 is a microphone, and converts the user's voice or the like into audio data and inputs it.
[0077] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700. In this embodiment, it is composed of a GPS receiver 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. With these sensor groups, it becomes possible to detect the position, inclination, direction, movement of the portable information terminal 700, the ambient brightness, the proximity situation of surrounding objects, and the like. Further, the portable information terminal 700 may further include other sensors such as a barometric pressure sensor.
[0078] The mobile information terminal 700 may be a mobile phone, a smartphone, a tablet terminal, etc. It may also be a PDA (Personal Digital Assistants) or a notebook PC. Further, it may be a digital still camera, a video camera capable of video shooting, a portable game machine, or other portable digital devices.
[0079] Note that the configuration example of the mobile information terminal 700 shown in FIG. 5A includes many components that are not essential to this embodiment, such as the sensor unit 760. However, even if these components are not provided, the effects of this embodiment will not be impaired. Further, configurations not shown, such as a digital broadcast reception function and an electronic money settlement function, may be added.
[0080] [Software Configuration of Mobile Information Terminal] FIG. 5B is a software configuration diagram of the mobile information terminal 700 of this embodiment, showing the software configurations in the ROM 703, the RAM 704, and the storage unit 710. In this embodiment, the basic operation program 7001 and other operation programs are stored in the ROM 703, and the cooperation control program 7002, the HTML browser program 7003, and other operation programs are stored in the storage unit 710. Further, the storage unit 710 is assumed to include a content storage area 7011 for storing contents such as videos, still images, and voices, an authentication information storage area 7012 for storing authentication information used during cooperation operations with a television receiver, and other various information storage areas for storing various other information.
[0081] The basic operation program 7001 stored in the ROM 703 is expanded in the RAM 704, and further, the main control unit 701 executes the expanded basic operation program, thereby constituting the basic operation execution unit 7101. Also, the cooperation control program 7002 and the HTML browser program 7003 stored in the storage unit 710 are expanded in the RAM 704 respectively, and further, the main control unit 701 executes the expanded operation programs, thereby constituting the cooperation control execution unit 7102 and the HTML browser engine 7103. Also, the RAM 704 is provided with a temporary storage area for temporarily holding the data created when each operation program is executed as needed.
[0082] Note that hereinafter, for the sake of simplicity of explanation, the process of controlling each operation block by the main control unit 701 expanding and executing the basic operation program 7001 stored in the ROM 703 in the RAM 704 will be described as the basic operation execution unit 7101 performing the control of each operation block. The same description will be made for other operation programs.
[0083] The cooperation control execution unit 7102 manages device authentication and connection, transmission and reception of each data, etc. when the mobile information terminal 700 performs a cooperation operation with the television receiver. The HTML browser engine 7103 is an HTML browser that executes an application created for the broadcast communication cooperation system on the mobile information terminal 700.
[0084] Each of the above operation programs may be stored in the ROM 703 and / or the storage unit 710 in advance at the time of product shipment. After the product is shipped, it may be obtained from other application servers 500 on the Internet 200 etc. via the LAN communication unit 721 or the mobile phone network communication unit 722. Also, each of the above operation programs stored in a memory card, an optical disk, etc. may be obtained via the expansion interface unit 724 etc.
[0085] [Overview of Application Control Information (AIT)] The application control information (AIT) in this embodiment is information that aims to notify the presence of an application (hereinafter sometimes referred to as a broadcast cooperation application) that cooperates with a broadcast service to a television receiver or the like (in this embodiment, the broadcast receiving apparatus 100) in the broadcast communication cooperation function corresponding to the broadcast receiving apparatus 100, and to instruct its control. Note that the broadcast cooperation application may be classified into (1) a broadcast managed application that operates only in a broadcast reception state based on a control signal such as start / end included in a broadcast signal and whose access to broadcast resources is permitted based on the control signal, (2) a non-broadcast managed application whose operation form such as start / end is not controlled by the broadcast signal and whose access to broadcast resources is permitted based on means such as application authentication, and (3) other general applications whose access to broadcast resources is not permitted.
[0086] As a transmission method of AIT, either a method of transmitting AIT in a section format or an XML (eXtensible Markup Language) format by a broadcast wave using a data carousel (DC) method or the like, or a method of distributing the AIT file in the section format or the XML format from a server device on the Internet 200 by http (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure) or the like may be used. Other methods may also be adopted.
[0087] FIG. 6 is a data configuration diagram showing an example of the data configuration of AIT. AIT mainly includes each information such as an application type 901, an application identifier 902, an application control code 903, an application profile 904, application acquisition destination information 905, an application boundary and access right setting 906, a start priority 907, cache information 908, a server access dispersion parameter 909, and the like. Further, other information may be included.
[0088] The application type 901 defines the description method of the application. In this embodiment, it is assumed that the description method of the application is HTML. The application identifier 902 is identification information composed of an organization identifier that identifies the operator and an application identifier numbered for each operator to identify the application unit. Note that the application unit is a set of an HTML document and its reference resources, with the HTML document existing at the location specified by the application acquisition destination information 905 as the entry document. The application control code 903 defines the operation control for the target application, and one of (1) automatic startup, (2) operable, (3) termination, and (4) prefetch is described. The application profile 904 is a value indicating the functions of the TV receiver required by the application, and it indicates a combination of the functions that the TV receiver has as options. Whether the application can be used is determined by referring to this value.
[0089] The application acquisition destination information 905 is information for specifying the acquisition destination of the application, and it is location information for acquiring the HTML document that is first referred to when the application is started. Since the application is assumed to be transmitted by broadcast and placed in a server device on a communication network, the location information specified by the application acquisition destination information 905 is also defined to correspond to both the cases of broadcast acquisition and communication acquisition. The application boundary and access restriction setting 906 is information indicating the operable range as a broadcast managed application as a set of one or more regions (URL: Uniform Resource Locator). Also, the access restriction to the broadcast resources for each region is set in units of functions. The application boundary and access restriction setting 906 specifies the range of document transition to prevent transitions to unexpected documents due to the chain of document transitions from the entry document at the time of application startup and access to inappropriate broadcast resources, etc. Also, within the range of the document transition, the access authority to a specific broadcast resource in units of regions can be set.
[0090] The startup priority 907 defines which of data broadcasting by a broadcast service and a broadcast managed application by an HTML document is to be started preferentially when they coexist. It is assumed that it is possible to unconditionally specify data broadcasting as the top priority on the PMT, to specify the startup priority order of a specific application type on the PMT, and to specify the startup priority of the target application with the startup priority 907. The cache information 908 is information used for cache control when holding application resources in preparation for reuse of an application. With this information, it becomes possible to cache application resources assumed to be reused even after the application ends. The server access dispersion parameter 909 is a parameter set for dispersing access for the purpose of reducing the load on a server where access concentrates, such as the acquisition destination of an application. The television receiver may operate so as to probabilistically delay the application of the application control code according to the setting of this parameter.
[0091] Hereinafter, the operation of the broadcast receiving apparatus 100 of the present embodiment will be described.
[0092] [Operation sequence at application startup] First, the startup process of the broadcast-linked application based on the AIT transmitted by the broadcast wave in the broadcast receiving apparatus 100 of the present embodiment will be described. In the broadcast receiving apparatus 100 of the present embodiment, it is possible to define which of data broadcasting by a broadcast service and a broadcast-linked application is to be started preferentially when they coexist, based on the information on the PMT and the application control code 903, startup priority 907, etc. of the AIT.
[0093] FIG. 7A is an operation sequence diagram showing an example of the operation sequence of the broadcast-linked application when it is defined that the broadcast-linked application is to be started preferentially. The figure shows a series of processes until the broadcast receiving apparatus 100 appropriately checks the PMT and AIT and starts a predetermined broadcast-linked application.
[0094] When the tuner / demodulation unit 131 of the broadcast receiving apparatus 100 performs a channel selection process for a channel desired by the user to acquire a TS, next, the main control unit 101 acquires the PMT data sequence separated by the first separation unit 132 (S101) and checks the activation priority described in the PMT. When it is confirmed in the process of S101 that the activation priority of the broadcast cooperation application is high (S102), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S103) and checks the application control code 903 of the acquired AIT data sequence (S104). In the process of S104, when the application control code 903 is "auto start", further, the application profile 904 of the acquired AIT data sequence is checked (S105). When it is confirmed that the execution of the broadcast cooperation application specified in the AIT is possible, based on the information described in the application acquisition destination information 905, a transmission request for the broadcast cooperation application is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 (S106).
[0095] The service provider server 400 that has received the transmission request for the broadcast cooperation application, based on the control of the application management / distribution execution unit 4103, performs an authentication process for the broadcast receiving apparatus 100 as necessary, and then distributes a predetermined broadcast cooperation application stored in the application storage area 4013 via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication process, and a detailed description thereof is omitted. Next, the application engine 162 of the broadcast receiving apparatus 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 based on the control of the application control unit 161 (S108).
[0096] FIG. 7B is an operation sequence diagram showing an example of an operation sequence of a broadcast cooperation application when it is defined to prioritize data broadcast by a broadcast service for activation. The figure shows a series of processes until the broadcast receiving apparatus 100 appropriately checks the PMT and AIT and activates a predetermined broadcast cooperation application.
[0097] When the tuner / demodulation unit 131 of the broadcast reception apparatus 100 performs a channel selection process for a channel desired by the user to acquire a TS, next, the main control unit 101 acquires the PMT data sequence separated by the first separation unit 132 (S201), and checks the activation priority described in the PMT. When it is confirmed in the process of S201 that the activation priority of data broadcast by the broadcast service is high (S202), the data broadcast reception processing unit 141 acquires the BML data sequence separated by the first separation unit 132 and reproduces the BML document (S203). When automatic activation of data broadcast is set by the BML document, and when the user makes a data broadcast activation request using an operation terminal (such as the mobile information terminal 700, remote control, etc.) (S204), the data broadcast engine 142 generates data broadcast screen information by executing the reproduced BML document and displays it on the video display unit 173 (S205).
[0098] After the process of S205, or simultaneously with the process of S205, the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S206), and checks the application profile 904 of the acquired AIT data sequence (S207). When it is confirmed in the process of S207 that the execution of the broadcast cooperation application specified in the AIT is possible, an entry button to the executable broadcast cooperation application is displayed on the data broadcast screen. The entry button may always be displayed, and the color scheme may be changed from an inactive color to an active color only when the execution of the broadcast cooperation application is possible. By changing the shape, the inactive state and the active state of the entry button may be switched.
[0099] When the user selects the entry button using the operation terminal (S208), the data broadcast engine 142 ends the process of executing the BML document to generate data broadcast screen information (S209). Subsequently, the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S210), and checks the application acquisition destination information 905 of the acquired AIT data sequence. Further, based on the information described in the application acquisition destination information 905 confirmed in S210, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S211).
[0100] Upon receiving the transmission request for the broadcast cooperation application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs the authentication process of the broadcast receiving apparatus 100 as necessary, and then distributes the predetermined broadcast cooperation application stored in the application storage area 4013 via the LAN communication unit 421 (S212). Next, the application engine 162 of the broadcast receiving apparatus 100 starts the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 under the control of the application control unit 161 (S213).
[0101] FIG. 7C is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when no priority startup is defined. The figure shows a series of processes until the broadcast receiving apparatus 100 appropriately checks the PMT and AIT and starts a predetermined broadcast cooperation application.
[0102] When the tuner / demodulation unit 131 of the broadcast reception device 100 performs a channel selection process for a channel desired by the user to acquire a TS, next, the main control unit 101 acquires the PMT data sequence separated by the first separation unit 132 (S301), and checks the activation priority described in the PMT. When it is confirmed that the activation priority of the broadcast cooperation application is high in the process of S301 (S302), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S303), and checks the application control code 903 of the acquired AIT data sequence (S304). In the process of S304, when the application control code 903 is "activatable" instead of "auto-start", neither the data broadcast by the broadcast service nor the broadcast cooperation application is started, and the display of the broadcast program is continued.
[0103] When the user makes a request to start data broadcast using the operation terminal in the state after the process of S304 (S305), similar to the processes after S205 in FIG. 7B, acquisition of the BML data sequence, reproduction of the BML document, generation of data broadcast screen information, etc. are performed (however, not shown). On the other hand, when the user makes a request to start the broadcast cooperation app launcher using the operation terminal in the state after the process of S304 (S306), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S307), and checks the application profile 904 of the acquired AIT data sequence (S308). Further, the application control unit 161 displays a list of executable broadcast cooperation apps as the broadcast cooperation app launcher on the video display unit 173 (S309).
[0104] When the user selects a predetermined broadcast cooperation application from the broadcast cooperation app launcher displayed in S309 using the operation terminal (S310), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S311), and checks the application acquisition destination information 905 of the acquired AIT data sequence. Further, based on the information described in the application acquisition destination information 905 confirmed in S311, a transmission request for the broadcast cooperation application is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 (S312).
[0105] Upon receiving the transmission request for the broadcast cooperation application, the service provider server 400, based on the control of the application management / distribution execution unit 4103, performs authentication processing of the broadcast receiving apparatus 100 as necessary, and then distributes a predetermined broadcast cooperation application stored in the application storage area 4013 via the LAN communication unit 421 (S313). Next, the application engine 162 of the broadcast receiving apparatus 100 starts the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 under the control of the application control unit 161 (S314).
[0106] In the startup sequence of the broadcast cooperation application described with reference to FIGS. 7A to 7C, examples of acquiring AIT from the broadcast wave are all described. However, the AIT file may be acquired from a predetermined server device specified by information description such as PMT. Further, the acquisition of the broadcast cooperation application may be performed from the broadcast wave instead of from a server device (service provider server 400) on the network. That is, when the location information described in the application acquisition destination information 905 of AIT indicates the broadcast wave, the application control unit 161 regenerates an HTML document from the HTML data sequence transmitted by the data carousel method or the like and separated and output by the first separation unit 132, and the application engine 162 may execute the regenerated HTML document (broadcast cooperation application).
[0107] In addition, when there is no information specifying the startup priority in the case where both data broadcasting by a broadcast service and a broadcast-linked application coexist on the PMT, the startup priority may be confirmed based only on information such as the application control code 903 of the AIT and the startup priority 907. Similarly, when the acquisition of the information on the PMT fails, the startup priority may be confirmed based only on information such as the application control code 903 of the AIT and the startup priority 907. That is, regardless of the information on the PMT, the AIT is periodically checked. When there is a broadcast-linked application specified as "automatic startup" in the application control code 903 of the AIT, the startup of the broadcast-linked application is prioritized. When there is no broadcast-linked application specified as "automatic startup" in the application control code 903 of the AIT, the startup of data broadcasting by the broadcast service may be prioritized.
[0108] Also, when there is no response from the service provider server 400 for a predetermined time or longer when a delivery request for the broadcast-linked application is made in S106, S211, and S312, a message such as "Please wait a moment" may be displayed on the video display unit 173. Alternatively, in this case, a message asking the user to confirm the termination of the execution of the broadcast-linked application may be displayed.
[0109] Also, it goes without saying that the startup sequence of the broadcast-linked application is not limited to the above three patterns and may be started by a different sequence.
[0110] [Operation Sequence at the Time of Linking with a Portable Information Terminal] In the broadcast receiving apparatus 100 of this embodiment, it is assumed that the functions of the broadcast communication cooperation service can be extended by the cooperation operation between the broadcast receiving apparatus 100 and the portable information terminal 700. For example, by installing an application (cooperation control application) prepared by the manufacturer of the television receiver, the portable information terminal 700 can be used as a high-function remote control of the broadcast receiving apparatus 100. Also, a broadcast cooperation application can be executed on the portable information terminal 700, and for example, a service linked to the broadcast program being displayed on the broadcast receiving apparatus 100 can also be displayed on the portable information terminal 700. Note that in order to perform function extension by the cooperation operation between the broadcast receiving apparatus 100 and the portable information terminal 700, it is desirable that the cooperation control application is started on the portable information terminal 700, and the broadcast cooperation application operating on the portable information terminal 700 is controlled by the cooperation control application and operates accordingly.
[0111] FIG. 8A is an operation sequence diagram showing an example of the operation sequence when the cooperation control application is started on the portable information terminal 700. This figure shows a series of processes (first time) until the portable information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 and the cooperation operation becomes possible. Note that the cooperation control application is installed in advance in the storage unit 710 of the portable information terminal 700 as the cooperation control program 7002.
[0112] When the user instructs to start the cooperation control application on the mobile information terminal 700 (S401), the cooperation control execution unit 7102 of the mobile information terminal 700 searches for a TV receiver capable of communication (cooperation operation) on the network (S402), and displays the search result as a list of TV receivers on the display unit 741. If a TV receiver capable of communication cannot be found, it displays to that effect and ends the process. When the user selects an arbitrary TV receiver (the broadcast receiving device 100 of the present embodiment) from the list of TV receivers, the cooperation control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. When the user inputs authentication information (login name and password specified by the broadcast receiving device 100, etc.) into the login screen via the operation unit 730 (S403), the cooperation control execution unit 7102 stores the input authentication information in the authentication information storage area 7012 and simultaneously transmits it to the broadcast receiving device 100 (S404). Note that the transmission process of the authentication information to the broadcast receiving device 100 may be performed via the LAN communication unit 721 and the router device 210, or may be directly performed on the broadcast receiving device 100 via the NFC communication unit 723.
[0113] The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S405). If it is confirmed by the process of S405 that the received authentication information is correct, the information of the mobile information terminal 700 is stored in the authentication information storage area 1012 and the mobile information terminal 700 is authenticated (S406). The mobile information terminal 700 that has obtained the authentication of the broadcast receiving device 100 displays the basic screen of the cooperation control application (for example, a high-function remote control screen) on the display unit 741 (S407). If it is not confirmed in S405 that the received authentication information is correct, the terminal cooperation control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. Through the above processing, the cooperation operation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0114] FIG. 8B is an operation sequence diagram showing an example of an operation sequence when the cooperation control application is launched on the portable information terminal 700. This figure shows a series of processes (after the second time) until the portable information terminal 700 performs an authentication process with the broadcast receiving apparatus 100 and the cooperation operation becomes possible.
[0115] When the user instructs to start the cooperation control application on the portable information terminal 700 (S501), the cooperation control execution unit 7102 of the portable information terminal 700 searches for a communicable television receiver on the network, and displays the search result on the display unit 741 as a list of television receivers. If a communicable television receiver cannot be found, it displays to that effect and ends the process. When the user selects an arbitrary television receiver (the broadcast receiving apparatus 100 in this embodiment) from the list of television receivers (S502), and the selected broadcast receiving apparatus 100 is a device that has been connected (cooperated) in the past, the cooperation control execution unit 7102 reads the authentication information of the broadcast receiving apparatus 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving apparatus 100 (S503).
[0116] The terminal cooperation control unit 191 of the broadcast receiving apparatus 100 that has received the authentication information via the LAN communication unit 121 refers to the authentication information storage area 1012 to confirm whether the received authentication information is correct (S504). If it is confirmed by the process of S504 that the received authentication information is correct, the portable information terminal 700 is authenticated (S505). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperation control application on the display unit 741 (S506). Through the above processes, the cooperation operation between the broadcast receiving apparatus 100 and the portable information terminal 700 becomes possible.
[0117] Note that following the processes of FIGS. 8A to 8B, when starting the broadcast cooperation application in the broadcast receiving apparatus 100, the processes of FIGS. 7A to 7C may be performed after the processes of FIGS. 8A to 8B.
[0118] FIG. 8C is an operation sequence diagram showing an example of an operation sequence when the cooperation control application is launched on the portable information terminal 700. This figure shows a series of processes (after the second time) until the portable information terminal 700 performs an authentication process with the broadcast receiving apparatus 100 and the cooperation operation becomes possible. However, in this figure, it is an example in the case where the broadcast receiving apparatus 100 that executes the startup sequence of the broadcast cooperation application requests the startup of the cooperation control application on the portable information terminal 700.
[0119] When the tuner / demodulation unit 131 of the broadcast receiving apparatus 100 performs a channel selection process for a channel desired by the user to acquire a TS, next, the main control unit 101 acquires the PMT data sequence separated by the first separation unit 132 (S601), and confirms the startup priority described in the PMT. When it is confirmed in the process of S601 that the startup priority of the broadcast cooperation application is high (S602), the application control unit 161 acquires the AIT data sequence separated by the first separation unit 132 (S603), and confirms the application control code 903 of the acquired AIT data sequence (S604). In the process of S604, when the application control code 903 is "automatic startup", further, the application profile 904 of the acquired AIT data sequence is confirmed (S605). In the process of S605, when it is confirmed that the execution of the broadcast cooperation application designated in the AIT is possible and it is determined that cooperation control of the portable terminal device is necessary, the terminal cooperation control unit 191 refers to the authentication information storage area 1012, selects the portable information terminal 700 as the portable terminal device, and transmits a cooperation control application startup request to the selected portable information terminal 700 (S606).
[0120] Note that the selection of the portable information terminal 700 by referring to the authentication information storage area 1012 may be made based on the latest information in the authentication information storage area 1012 or based on the information with the highest usage frequency in the authentication information storage area 1012.
[0121] Also, in the process of S606, if a mobile terminal device that should send a cooperation control application startup request cannot be found, a message indicating that may be displayed on the video display unit 173. Or, in this case, a message asking the user to confirm the suspension of the execution of the broadcast cooperation application may be displayed.
[0122] The main control unit 701 of the mobile information terminal 700 activates the cooperation control application (cooperation control execution unit 7102) in response to the cooperation control application startup request received via the LAN communication unit 721 (S607). Further, the cooperation control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).
[0123] The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 refers to the authentication information storage area 1012 to confirm whether the received authentication information is correct (S609). If it is confirmed by the process of S609 that the received authentication information is correct, the mobile information terminal 700 is authenticated (S610). The mobile information terminal 700 that has obtained the authentication of the broadcast receiving device 100 displays the basic screen of the cooperation control application on the display unit 741 (S611). Through the above processes, the cooperation operation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0124] In addition, when the broadcast cooperation application is executed on both the broadcast receiving device 100 and the mobile information terminal 700 following the above-mentioned processes, the processes shown in FIG. 9 may be performed. FIG. 9 is an operation sequence diagram showing an example of the startup sequence of the broadcast cooperation application of the broadcast receiving device 100 and the mobile information terminal 700.
[0125] That is, after the processes of S601 to S611 in FIG. 8C, the application control unit 161 of the broadcast receiving apparatus 100 acquires the AIT data sequence separated by the first separation unit 132 (S612), and checks the application acquisition destination information 905 of the acquired AIT data sequence. Further, based on the information described in the application acquisition destination information 905 checked in S612, a transmission request for the broadcast cooperation application (TV side) is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 (S613).
[0126] Upon receiving the transmission request for the broadcast cooperation application (TV side), the service provider server 400 performs an authentication process for the broadcast receiving apparatus 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes a predetermined broadcast cooperation application (TV side) stored in the application storage area 4013 via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving apparatus 100 activates the predetermined broadcast cooperation application (TV side) distributed from the service provider server 400 received via the LAN communication unit 121 under the control of the application control unit 161 (S615).
[0127] Next, the terminal cooperation control unit 191 of the broadcast receiving apparatus 100 transmits the acquisition destination URL information, etc. of the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700, which is acquired from the AIT or the broadcast cooperation application (TV side) executed in S615, to the mobile information terminal 700 (S616). The cooperation control execution unit 7102 of the mobile information terminal 700 transmits a transmission request for the broadcast cooperation application (terminal side) to a predetermined service provider server 400 via the LAN communication unit 721 based on the acquisition destination URL information, etc. of the broadcast cooperation application (terminal side) received via the LAN communication unit 721 (S617).
[0128] After receiving the transmission request of the broadcast cooperation application (terminal side), the service provider server 400 performs the authentication process of the mobile information terminal 700 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperation application (terminal side) stored in the application storage area 4013 via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 starts the predetermined broadcast cooperation application (terminal side) distributed from the service provider server 400 received via the LAN communication unit 721 (S619).
[0129] Note that the ability to obtain the AIT file from a predetermined server device, the ability to obtain the broadcast cooperation application from a broadcast wave rather than from a server device on the network, etc. are the same as the operation sequences in FIGS. 7A to 7C. When obtaining the broadcast cooperation application from a broadcast wave, the broadcast receiving device 100 may obtain the broadcast cooperation application (terminal side) to be executed by the mobile information terminal 700 from the broadcast wave and transfer the obtained broadcast cooperation application (terminal side) to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 may obtain the broadcast cooperation application (terminal side) to be executed by the mobile information terminal 700 from the broadcast wave and store it in the storage unit 110, and in the process of S616 in FIG. 9, the location information of the storage unit 110 of the broadcast receiving device 100 may be transmitted as the URL information to be transmitted to the mobile information terminal 700. The broadcast receiving device 100 may obtain the broadcast cooperation application (TV side) from the broadcast wave, and the mobile information terminal 700 may obtain the broadcast cooperation application (terminal side) from a server device on the network. The acquisition of the broadcast cooperation application (terminal side) may be directly performed from the broadcast wave using the digital broadcast receiving function of the mobile information terminal 700.
[0130] Also, the operation sequences in FIGS. 7A to 7C, FIGS. 8A to 8C, and FIG. 9 can be partially combined as appropriate. Furthermore, some operation steps can be appropriately reordered, operated simultaneously, etc. with other operation steps.
[0131] [Basic Screen of the Linkage Control App for Mobile Information Terminals] FIG. 10A is a screen display diagram showing an example of the basic screen of the linkage control app displayed by the processing of S407 in FIG. 8A, the processing of S506 in FIG. 8B, the processing of S611 in FIG. 8C, and the like. In the present embodiment, the basic screen 741a of the linkage control app is assumed to have a function as a high-function remote control corresponding to the broadcast receiving device 100.
[0132] As shown in FIG. 10A, the basic screen 741a of the linkage control app is composed of a power key 741a1, a network selection key (terrestrial digital, BS, CS) 741a2, numeric keys (1 to 12) 741a3, a volume UP / DOWN key 741a4, a channel UP / DOWN key 741a5, an input switching key 741a6, a program guide key 741a7, a data key 741a8, a linkage app key 741a9, a menu key 741aa, a back key 741ab, cursor keys (up, down, left, right) 741ac, a decision key 741ad, and color keys (blue, red, green, yellow) 741ae. Other operation keys may be further displayed.
[0133] It is convenient to use if each of the above operation keys has the same key arrangement / operation as the dedicated remote control attached to the broadcast receiving device 100. Also, the power key 741a1, the network selection key 741a2, the numeric keys 741a3, etc. have the same functions as the respective operation keys of a known TV remote control, and thus detailed descriptions thereof are omitted. The linkage app key 741a9 is an operation key prepared for the broadcast communication linkage function of the present embodiment.
[0134] In addition, in the processing of S204 in FIG. 7B and S305 in FIG. 7C, it is assumed that the data broadcast can be started / ended by selecting the data key 741a8. Also, in the processing of S208 in FIG. 7B and S310 in FIG. 7C, it is assumed that the executable broadcast linkage app can be selected by operating the cursor keys 741ac and the decision key 741ad. Further, in the processing of S306 in FIG. 7C, it is assumed that a startup request for the broadcast linkage app launcher can be made by selecting the linkage app key 741a9.
[0135] If a linkage application key 741a9 or other operation key having a similar function is provided on the basic screen 741a of the linkage control application, each broadcast linkage application used in the broadcast linkage system of this embodiment can be easily selected / activated. Also, the linkage application key 741a9 or other operation key having a similar function may be provided on a dedicated remote control attached to the broadcast receiving apparatus 100.
[0136] FIG. 10B is a screen display diagram showing an example of the basic screen of the linkage control application displayed by the processing of S407 in FIG. 8A, the processing of S506 in FIG. 8B, the processing of S611 in FIG. 8C, etc., and is an example different from FIG. 10A.
[0137] The basic screen 741b of the linkage control application is composed of a linkage control in - progress message 741b1 and a linkage control application operation screen 741b2. Other objects may be further displayed. The linkage control in - progress message 741b1 is a message display for allowing the user of the portable information terminal 700 to recognize that the portable information terminal 700 is operating in cooperation with the broadcast receiving apparatus 100. The linkage control application operation screen 741b2 is an area where arbitrary screen displays are performed by the linkage control application, and detailed description is omitted in this embodiment. For example, the configuration within the linkage control application operation screen 741b2 may be the same as the configuration of the basic screen 741a of the aforementioned linkage control application. A sub - screen of the broadcast program being displayed on the broadcast receiving apparatus 100 may be displayed.
[0138] As shown in FIG. 10B, by displaying the linkage control in - progress message 741b1, the user of the portable information terminal 700 can easily grasp that the portable information terminal 700 is operating in cooperation with the broadcast receiving apparatus 100. Note that the linkage control in - progress message 741b1 is not limited to character display, and may be symbol display, graphic display, etc. A difference in background color, etc. may also be used as an alternative to the linkage control in - progress message 741b1.
[0139] [Data broadcast screen of broadcast receiving apparatus] FIG. 11 is a screen display diagram showing an example of a data broadcast screen displayed by the process of S205 in FIG. 7B. In this embodiment, it is assumed that three broadcast cooperation applications, namely cooperation application A, cooperation application B, and cooperation application C, are in a state where they can be executed on the broadcast receiving apparatus 100 based on the description of AIT or the like. In this case, an entry button 173a2 for cooperation application A, an entry button 173a3 for cooperation application B, and an entry button 173a4 for cooperation application C are displayed at arbitrary positions on the data broadcast screen 173a.
[0140] In the data broadcast screen 173a as shown in FIG. 11, when the entry buttons 173a2, 173a3, 173a4, etc. are selected using the cursor key 741ac and the enter key 741ad of the basic screen 741a of the cooperation control application, the display of the data broadcast screen 173a ends, and the cooperation application A, cooperation application B, cooperation application C, etc. are started under the control of the application control unit 161 and the application engine 162.
[0141] Note that when displaying the data broadcast screen 173a, the frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be appropriately changed according to the type of the broadcast cooperation application, the security status, etc. For example, when the cooperation application A is a broadcast managed application, the frame color of the entry button 173a2 is set to blue; when the cooperation application B is a non-broadcast managed application, the frame color of the entry button 173a3 is set to yellow; when the cooperation application C is a general application, the frame color of the entry button 173a4 is set to red, and so on. Alternatively, when the cooperation application A is determined to be reliable in terms of security, the frame color of the entry button 173a2 is set to blue; when the cooperation application B is determined not to be necessarily reliable in terms of security, the frame color of the entry button 173a3 is set to yellow; when the cooperation application C is determined to be dangerous in terms of security, the frame color of the entry button 173a4 is set to red, and so on.
[0142] In addition, according to the functions and genres of the broadcast cooperation applications, or according to the expiration date of use of each broadcast cooperation application, etc., the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed. According to whether the broadcast cooperation application has been acquired from the network or not, etc., the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be appropriately changed. For example, when the cooperation application A has already been acquired from the network (cached in the RAM 104 or the storage unit 110), the frame color of the entry button 173a2 is set to blue, when the cooperation application B is being acquired, the frame color of the entry button 173a3 is set to yellow, and when the cooperation application C has not been acquired, the frame color of the entry button 173a4 is set to red, etc.
[0143] In this way, the user of the broadcast receiving device 100 can easily grasp the types and security status, etc. of the broadcast cooperation applications that can be executed on the broadcast receiving device 100.
[0144] [Broadcast Cooperation Application Launcher Screen of Broadcast Receiving Device] FIG. 12A is a screen display diagram showing an example of a notification screen for making the user recognize that there are broadcast cooperation applications that can be launched in the broadcast receiving device 100 of the present embodiment.
[0145] For example, in the operation sequence shown in FIG. 7C, after the process of S304, the display of the broadcast program is continued without starting either the data broadcast by the broadcast service or the broadcast cooperation application. On the other hand, in this case, in order to make the user recognize that there are broadcast cooperation applications that can be launched, if an icon 173b0 as shown in FIG. 12A is displayed, the usability of the broadcast receiving device 100 is improved. That is, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of the broadcast cooperation applications that can be launched.
[0146] Note that the display position of the icon 173b0 may be any position on the screen, but it is preferably placed where it does not interfere with the viewing of the broadcast program. For example, it can be at the four corners of the screen. Also, the icon 173b0 may be a character display as shown in FIG. 12A, or it may be a symbol, a figure, etc. Further, the icon 173b0 may be always displayed, or it may be displayed for a predetermined time after the power is turned on or after channel switching. Alternatively, it may be displayed simultaneously when program information, channel numbers, etc. are displayed.
[0147] FIG. 12B is a screen display diagram showing an example of a broadcast cooperation application launcher displayed by the process of S306 in FIG. 7C. In this embodiment, it is assumed that three broadcast cooperation applications, namely cooperation application A, cooperation application B, and cooperation application C, are in a state executable on the broadcast receiving apparatus 100 according to the description of AIT. In this case, the broadcast cooperation application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b, and further, an entry button 173b2 for cooperation application A, an entry button 173b3 for cooperation application B, an entry button 173b4 for cooperation application C, and a return button 173b5 are displayed within the broadcast cooperation application launcher 173b1.
[0148] When the entry buttons 173b2, 173b3, 173b4, etc. are selected using the cursor key 741ac and the determination key 741ad on the basic screen 741a of the cooperation control application in the state where the broadcast cooperation application launcher 173b1 as shown in FIG. 12B is displayed, the cooperation application A, the cooperation application B, the cooperation application C, etc. are started under the control of the application control unit 161 and the application engine 162. When the return button 173b5 is selected, the display of the broadcast cooperation application launcher 173b1 ends.
[0149] In addition, when displaying the broadcast cooperation app launcher 173b1 on the broadcast program screen 173b, according to the type and security status of the broadcast cooperation app, the functions and genres of the broadcast cooperation app, the acquisition status of the broadcast app from the network, etc., it is also possible to appropriately change the frame color, internal color, shape, font, size, blinking status, etc. of each entry button, which is the same as the case of displaying the entry buttons of each broadcast cooperation app on the data broadcast screen 173a in FIG. 11.
[0150] Also, when there is no broadcast cooperation app that can be executed by the broadcast receiving device 100, the broadcast cooperation app launcher 173b1 may not be displayed. Or, in this case, a message such as "There is no available application" may be displayed inside the broadcast cooperation app launcher 173b1.
[0151] [Broadcast Cooperation App Execution Screen of Broadcast Receiving Device] FIG. 13A is a screen display diagram showing an example of the broadcast cooperation app execution screen displayed in the processes of S108 in FIG. 7A, S213 in FIG. 7B, S314 in FIG. 7C, S615 in FIG. 9, etc. The broadcast cooperation app of this embodiment has graphics performance and effect performance by HTML description, etc., and it is assumed that it can be overlaid and displayed with the broadcast program screen on the video display unit 173. For example, as shown in FIG. 13A, a broadcast cooperation app unit 173c1 that displays information such as weather forecasts and news at an arbitrary position on the broadcast program screen 173c is overlaid and displayed. The broadcast cooperation app unit 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, a background object 173c5, etc. Other objects may be further displayed.
[0152] With the broadcast cooperation app section 173c1 being overlaid and displayed on the broadcast program screen 173c, by selecting the data key 741a8 of the basic screen 741a of the cooperation control app, it shall be possible to end the execution of the said broadcast cooperation app and shift to the data broadcast screen. Also, by selecting the cooperation app key 741a9 of the basic screen 741a of the cooperation control app, it shall be possible to end the execution of the said broadcast cooperation app and return to the display of only the broadcast program screen 173c. The said processing may be realized by different operation keys.
[0153] Also, with the broadcast cooperation app section 173c1 being overlaid and displayed on the broadcast program screen 173c, by operating each operation key of the basic screen 741a of the cooperation control app, it shall be possible to change the transparency of the broadcast cooperation app section 173c1. The said transparency change processing may be performed collectively for the entire broadcast cooperation app section 173c1, or may be performed separately for each of the first main object 173c2, second main object 173c3, third main object 173c4, and background object 173c5. It may also be performed for each predetermined group (for example, a plurality of objects existing in the same graphics layer).
[0154] When performing the transmittance change process, for example, an object is selected using the cursor key 741ac on the basic screen 741a of the cooperation control application, and the transmittance of the object is increased using the "blue" key of the color key 741ae and decreased using the "yellow" key. The transmittance change process may be performed using different operation keys. If the entire broadcast cooperation application unit 173c1 is set to a transmittance of 100%, the broadcast cooperation application unit 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed via a broadcast wave, it is also possible to set the entire broadcast cooperation application unit to a transmittance of 100% and display only the broadcast program screen of the emergency broadcast on the video display unit 173. Alternatively, a CM detection unit (not shown) may detect that the broadcast program has changed from the main video to a CM video and control the entire broadcast cooperation application unit 173c1 to have a transmittance of 100% (or a transmittance that allows the video of the broadcast program to be clearly confirmed).
[0155] By performing the above-described process, when it is desired to check the broadcast program screen in the background during the execution of the broadcast cooperation application, it is possible to check the broadcast program screen without terminating the broadcast cooperation application.
[0156] FIG. 13B is a screen display diagram showing a different example of the broadcast cooperation application execution screen displayed in the processes of S108 in FIG. 7A, S213 in FIG. 7B, S314 in FIG. 7C, S615 in FIG. 9, etc. In the example shown in FIG. 13B, a broadcast cooperation application unit 173c6 that introduces a recommended program is overlaid at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173c6 displays first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, etc. Even more recommended program information may be displayed by scrolling, page switching, etc.
[0157] Each of the recommended program information may be information of a program recommended in relation to the currently displayed broadcast program (broadcast program screen 173c), or information of a program recommended based on the user's viewing history, or information of a program that is a topic on the Internet or the like. The recommended program information may also be information of a program sent by a friend of the user of the broadcast receiving apparatus 100 to the user. Further, the recommended program may be a program transmitted by a broadcast wave of a digital broadcast service, or a VOD (Video On Demand) program or the like distributed from each server apparatus on the Internet 200. It may also be an information screen such as a homepage prepared in a server apparatus on the Internet 200.
[0158] With the broadcast cooperation application section 173c6 being overlaid and displayed on the broadcast program screen 173c, by using the cursor key 741ac and the decision key 741ad of the basic screen 741a of the cooperation control application, the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. are selected, and each program video recommended by the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. is displayed on the video display section 173.
[0159] FIG. 13C is a screen display diagram showing an example when a program video recommended by the broadcast cooperation app unit 173c6 that introduces recommended programs is displayed. For example, when the first recommended program information 173c7 of the broadcast cooperation app unit 173c6 is selected using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control app, the program video 173ca of the program recommended by the first recommended program information 173c7 is displayed on the video display unit 173. The program video 173ca may be pausable or jumpable by time specification by the operation of the user's operation terminal. Also, when displaying the program video 173ca, the original broadcast program screen 173c may be displayed at an arbitrary position in the PIP (Picture In Picture) format. In this case, by the operation on the user's operation terminal, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c is the main screen. By the operation on the user's operation terminal, the size of the window of the original broadcast program screen 173c may be adjustable.
[0160] Also, if an icon display 173cb indicating that the program video 173ca of the recommended program is a video displayed by selecting any of the recommended program information displayed on the broadcast cooperation app unit 173c6 is displayed at an arbitrary position on the screen, the convenience for the user can be improved. Also, needless to say, on the broadcast cooperation app execution screen shown in FIG. 13B, the transparency of the broadcast cooperation app unit 173c6 may be changeable in the same manner as described above.
[0161] FIG. 13D is a screen display diagram showing a different example of the broadcast cooperation application execution screen displayed in the processes of S108 in FIG. 7A, S213 in FIG. 7B, S314 in FIG. 7C, S615 in FIG. 9, etc., from the foregoing. In the example shown in FIG. 13D, a broadcast cooperation application unit 173cc serving as a portal for a SNS (Social Networking Service) service is overlaid and displayed at an arbitrary position on the broadcast program screen 173c. On the broadcast cooperation application unit 173cc, an entry button 173cd for the first SNS service, an entry button 173ce for the second SNS service, an entry button 173cf for the third SNS service, etc. are displayed. More entry buttons for SNS services may be displayed by scrolling, page switching, or the like.
[0162] With the broadcast cooperation application unit 173cc being overlaid and displayed on the broadcast program screen 173c, by using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application, the entry button 173cd for the first SNS service, the entry button 173ce for the second SNS service, the entry button 173cf for the third SNS service, etc. are selected, whereby the functions assigned to each entry button, such as a chat function, a bulletin board function, and an Internet telephone function, are enabled. Thereby, it becomes possible to enjoy the currently displayed broadcast program (the broadcast program screen 173c) while exchanging information with others. At the same time, the basic screen 741a of the cooperation control application on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard or a voice input screen for performing chat or writing on a bulletin board by voice input.
[0163] In addition, as a broadcast cooperation application that can be executed by the broadcast receiving apparatus 100 of the present embodiment, in addition to the above-described example, using the cooperation function between the broadcast receiving apparatus 100 and the portable information terminal 700, further in synchronization with the CM broadcast timing, a related CM application may be presented to both the broadcast receiving apparatus 100 and the portable information terminal 700. Alternatively, in a paid service available on the broadcast receiving apparatus 100, the broadcast cooperation application may check whether the user of the broadcast receiving apparatus 100 has subscribed to the paid service, and change the display of the broadcast receiving apparatus 100 and / or the portable information terminal 700 according to the result. In the broadcast receiving apparatus 100 of the present embodiment, regardless of which broadcast cooperation application is executed, the effects described with reference to FIGS. 13A, 13B, etc. can be enjoyed.
[0164] [Error display screen of the broadcast receiving apparatus] FIG. 14 is a screen display diagram showing an example of an error display screen when it is determined that the execution of the broadcast cooperation application is not possible by checking the application profile 904 of the acquired AIT data sequence in the processes of S105 in FIG. 7A, S207 in FIG. 7B, S308 in FIG. 7C, S605 in FIG. 8C, etc., when there is a shortage in the description of the AIT, or when the acquisition of the AIT fails.
[0165] In the broadcast receiver 100 of the present embodiment, when it is determined that the execution of the broadcast cooperation application is not possible, the reason why the execution of the broadcast cooperation application, such as the confirmation result of the application profile 904, is displayed in the error message 173d1. For example, if, as a result of the confirmation of the application profile 904, a predetermined optional function is lacking on the TV receiver side, that fact is displayed in the error message 173d1. It may also display an error code and a guidance (URL, etc.) on the homepage of the TV receiver manufacturer that describes the explanation of the error code. Alternatively, when the broadcast cooperation application is acquired from the network, it is natural to check the network connection status in advance. At this time, for example, if the acquisition of the broadcast cooperation application is not possible due to incomplete connection of the LAN cable or the like, that fact is displayed in the error message 173d1. Also, if the network connection is established but the acquisition of the broadcast cooperation application cannot be performed correctly because the error situation is poor, the error message 173d1 may be displayed. The error message 173d1 may be displayed when the acquisition of the broadcast cooperation application is being executed and the broadcast cooperation application has not yet reached a state where it can be executed. Also, the error message 173d1 may be displayed when the reception status of the broadcast wave is not stable and, although information such as AIT could be received initially, the reception of information such as AIT becomes impossible midway. In such a case, if the broadcast cooperation application acquired from each server device is cached as it is, it can be used as it is after the reception status of the broadcast wave is restored.
[0166] Also, as a result of checking the application profile 904, if a predetermined optional function is lacking on the TV receiver side, a message may be displayed in the error message 173d1 to recommend checking or updating the latest firmware for the TV receiver. Alternatively, the broadcast receiving apparatus 100 may automatically check or update the latest firmware. Alternatively, when the broadcast cooperation application can be executed by adding paid optional hardware or optional software to the TV receiver, a guidance for the paid optional hardware or optional software may be displayed. Note that the error message 173d1 may be displayed on the mobile information terminal 700 instead of the broadcast receiving apparatus 100.
[0167] [Broadcast cooperation application execution screen of mobile information terminal] FIG. 15 is a screen display diagram showing an example of a broadcast cooperation application (terminal side) execution screen displayed in the process of S619 in FIG. 9. The broadcast cooperation application execution screen 741c shown in FIG. 15 is composed of a main window 741c1, a sub-window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may be further added.
[0168] In this embodiment, it is assumed that the broadcast cooperation application (terminal side) executed on the portable information terminal 700 is an application for checking the details of the broadcast program being displayed on the broadcast receiving apparatus 100. Also, the same video as the broadcast program screen displayed on the broadcast receiving apparatus 100 is displayed on the main window 741c1, and an enlarged video of the position specified by the selection marker 741c3 is displayed on the sub-window 741c2. It is assumed that the position of the selection marker 741c3 can be changed by selecting the cursor keys 741c4 and 741c5. It is assumed that the commentary display section 714c6 displays commentary subtitle text regarding the broadcast program being displayed on the main window 741c1, comments posted by other users regarding the broadcast program, and the like. The end button 741c7 is a button for ending the operation of the broadcast cooperation application (terminal side).
[0169] By operating the broadcast cooperation application (terminal side) on the portable information terminal 700, it becomes possible to expand the functions of the broadcast communication cooperation service through the cooperation operation between the broadcast receiving apparatus 100 and the portable information terminal 700.
[0170] [EPG Screen of Broadcast Receiving Apparatus] FIG. 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving apparatus 100 of this embodiment. The EPG display screen 173e is a broadcast program delivery schedule in the digital broadcast service of this embodiment created by the main control unit 101 based on the program information data string output from the first separation unit 132. It is assumed that the EPG display screen 173e is displayed on the video display unit 173 by selecting the program guide key 741a7 on the basic screen 741a of the cooperation control application.
[0171] In this embodiment, the EPG display screen 173e has a matrix shape with the vertical axis representing time display and the horizontal axis representing service ID (channel) display, and displays detailed information of each broadcast program broadcast on each channel in each time slot. As shown in FIG. 16A, the detailed information 173e1 of each broadcast program mainly consists of a title area 173e2 and a detailed explanation area 173e3.
[0172] In the title area 173e2, the program title of each broadcast program and symbols representing the attributes of each broadcast program are displayed. The symbols representing the attributes of each broadcast program are, for example, a symbolized mark of "New" meaning a new program, a symbolized mark of "Replay" meaning a rebroadcast program, and the like. Alternatively, it may be a symbolized mark of "data" meaning corresponding to data broadcasting by a broadcast service. Further, in the case of a broadcast program for which a broadcast cooperation application executable on the broadcast receiving apparatus 100 of the present embodiment is prepared, it may be a symbolized mark of "Linkage" indicating that fact. The detailed explanation area 173e3 displays related information such as the program content and performers of each broadcast program, and the URL of the homepage introducing each broadcast program.
[0173] Note that the symbolized mark of "Linkage" or the like displayed in the title area 173e2 may not be displayed even when a broadcast cooperation application is prepared for the broadcast program, if execution on the information display apparatus 100 is not possible as a result of confirmation of the application profile 904. Further, the symbolized mark of "Linkage" indicating that the broadcast program for which the executable broadcast cooperation application is prepared is displayed in the title area 173e2 may further change its color, shape, font, etc. depending on whether or not a cooperation operation with a mobile terminal device is possible. When a cooperation operation with a mobile terminal device is possible, a symbolized mark of "Mobile" may be displayed in addition to the symbolized mark of "Linkage".
[0174] Note that whether or not the symbolized mark of "Linkage" or the symbolized mark of "Mobile" is displayed is controlled by obtaining information such as whether each broadcast program is a broadcast program for which a broadcast cooperation application executable on the broadcast receiving apparatus 100 of the present embodiment is prepared, which is pre-described in the EIT information including the detailed information of each broadcast program, and whether the executable broadcast cooperation application can perform a cooperation operation with a mobile terminal device. Alternatively, the information obtained from the program distribution information of the digital broadcast program prepared in a predetermined server device on the Internet 200 may be added to the electronic program guide created based on the program information data string obtained from the broadcast wave of the digital broadcast service.
[0175] As described above, by displaying on the EPG display screen 173e a symbolized mark of "Linkage" indicating that a broadcast program for which an executable broadcast cooperation application is prepared and a symbolized mark of "Mobile" indicating that a cooperation operation with a mobile terminal device is possible, the user can easily grasp the correspondence status of each broadcast program in the broadcast receiving apparatus 100 to the broadcast communication cooperation service. Needless to say, the symbolized mark of a predetermined character representing the attribute of each broadcast program may be substituted with the character itself, a sentence, or the like. By changing the background color of the detailed information 173e1 of each broadcast program, the correspondence status of each broadcast program to the broadcast communication cooperation service may be indicated. Further, the symbolized mark of "Linkage", the symbolized mark of "Mobile", etc. may not be normally displayed in the title area 173e2 and may be pop-up displayed only when each broadcast program is selected by the program selection cursor 173e4.
[0176] The broadcast receiving apparatus 100 of the present embodiment has a function of making a viewing reservation and / or a recording reservation for each broadcast program from the EPG display screen 173e. For example, in a state where the EPG display screen 173e is displayed, the program selection cursor 173e4 on the EPG display screen 173e is moved using the cursor key 741ac of the basic screen 741a of the cooperation control application, and an arbitrary broadcast program is selected by the decision key 741ad, thereby making a viewing reservation and / or a recording reservation for the selected broadcast program.
[0177] In the above-described process, when the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program corresponding to the broadcast communication cooperation service, upon triggering by the fact that the viewing reservation and / or recording reservation has been made, without waiting for the broadcast start time of the broadcast program, the acquisition of the broadcast cooperation application prepared for the broadcast program may be started. That is, information (location information such as a URL) specifying the acquisition destination of the broadcast cooperation application is described in the EIT information including the detailed information of each broadcast program and the like. In this way, the broadcast receiving apparatus 100 can grasp the information on the acquisition destination of the broadcast cooperation application prepared for each broadcast program at the time when the broadcast program is selected by the program selection cursor 173e4. Therefore, the broadcast receiving apparatus 100 can start the acquisition of the broadcast cooperation application before the broadcast start time of the broadcast program.
[0178] In addition, when the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program corresponding to the broadcast communication cooperation service and is a broadcast program capable of a cooperation operation with a portable terminal device, the broadcast cooperation application (terminal side) prepared for the portable terminal device may also be started for acquisition before the broadcast start time of the broadcast program by the same process as described above. Also, as shown in FIG. 16B, a two-dimensional bar code 173e5 or the like indicating the information on the acquisition destination (location information such as a URL) of the broadcast cooperation application (terminal side) prepared for the portable terminal device may be displayed on the EPG display screen 173e to prompt the user to download the broadcast cooperation application (terminal side) prepared for the portable terminal device.
[0179] In this way, if the broadcast receiver 100 refers to the acquisition destination information of the broadcast cooperation application included in the EPG information and starts acquiring the broadcast cooperation application before the broadcast start time of the broadcast program, it is possible to distribute the load on the service provider server 400 that stores the broadcast cooperation application. Further, even when the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast cooperation application can be effectively utilized immediately after the start of the broadcast of the broadcast program.
[0180] FIG. 17 is an operation sequence diagram showing an example of an acquisition sequence of a broadcast cooperation application when a viewing reservation and / or a recording reservation of a broadcast program is made from the EPG display screen 173e.
[0181] During the viewing of a digital broadcast service, the main control unit 101 of the broadcast receiver 100 acquires the program information data string output from the first separation unit 132 (S701). When the user makes a request to start the EPG screen using the operation terminal (S702), the EPG display screen 173e is displayed on the video display unit 173 (S703). When the user selects an arbitrary broadcast program using the operation terminal on the EPG display screen 173e to make a viewing reservation and / or a recording reservation of the broadcast program (S704), the main control unit 101 checks the program information data string acquired from the first separation unit 132 (S705), and further checks the location of the acquisition destination of the broadcast cooperation application linked to the broadcast program for which the viewing reservation and / or the recording reservation has been made (S706).
[0182] After the process of S706, based on the confirmed URL, the application control unit 161 transmits a transmission request for the broadcast cooperation application to a predetermined service provider server 400 via the LAN communication unit 121 (S707). The service provider server 400 that has received the transmission request for the broadcast cooperation application, based on the control of the application management / distribution execution unit 4103, after performing the authentication process of the broadcast receiving device 100 as necessary, distributes a predetermined broadcast cooperation application stored in the application storage area 4013 via the LAN communication unit 421 (S708). Subsequently, the application control unit 161 caches the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 in the RAM 104 or the storage unit 110 (S709).
[0183] According to the broadcast receiving device 100 of the present embodiment described above, functions with higher added value can be executed.
Embodiment
[0184] Hereinafter, Embodiment 2 of the present invention will be described. Note that the configurations, effects, etc. in this embodiment are the same as those in Embodiment 1 unless otherwise specified. For this reason, hereinafter, the differences between this embodiment and Embodiment 1 will be mainly described, and the description of the common points will be omitted as much as possible to avoid duplication.
[0185] Although the implementation mode in the case of performing mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) was also described in Embodiment 1, a more detailed implementation mode will be described.
[0186] When performing mobile information terminal cooperation, there may be a case where it is desired to limit the use of terminal cooperation only to the mobile information terminal 700 in the same house as the broadcast receiving device 100 (hereinafter this limitation is referred to as the same-house limitation). For example, in an application for using broadcast cooperation (hereinafter referred to as a broadcast cooperation application), when the display screen of the broadcast receiving device 100 and the display screen of the mobile information terminal 700 are closely related, or when it is desired to ensure that the user of the mobile information terminal 700 views the advertisement video displayed on the broadcast receiving device 100, etc.
[0187] Note that, as a procedure that must be considered, there is a determination as to whether the target broadcast cooperation application imposes the same-household restriction. If it is assumed that all broadcast cooperation applications are subject to the same-household restriction, this determination is unnecessary. However, if there are cases where there is no restriction, the broadcast receiving apparatus 100 needs to acquire control information regarding the presence or absence of the same-household restriction and change the operation procedure. This control information regarding the presence or absence of the restriction may be acquired from the broadcast signal (for example, described as an item of AIT), or may be acquired from a server designated by the broadcasting station.
[0188] Including the above procedures, in this embodiment, a procedure for ensuring that the portable information terminal 700 exists within the same house as the broadcast receiving apparatus 100 will be described.
[0189] Normally, devices existing within the same house are present on the local network connected to the same router device 210. Therefore, by determining that the portable information terminal 700 is connected to the same local network as the broadcast receiving apparatus 100, it can be determined that they exist within the same house. Note that a known method may be used to determine whether the target device is connected to the local network, and the description thereof will be omitted.
[0190] Also, even if the portable information terminal 700 is not on the local network, by directly communicating with the broadcast receiving apparatus 100 via NFC, Bluetooth, infrared communication, etc., it can also be determined that it exists within the same house. In this case, the communication for acquiring the broadcast cooperation application or the like may be the above direct communication or may be by mobile phone communication.
[0191] As described above, there are multiple methods for confirming the existence within the same house. However, which method to use is, for example, described in AIT and read by the broadcast receiving apparatus 100.
[0192] Furthermore, once it is confirmed that the portable information terminal 700 exists within the same household, it may be regarded as remaining within the same household until the program ends. Alternatively, a certain effective time (e.g., 10 minutes) may be set, and it is regarded as remaining within the same household within the effective time. However, when the effective time has passed, it is not regarded as remaining within the same household unless newly confirmed. This effective time can be described in, for example, the AIT and read by the broadcast receiving apparatus 100.
[0193] Furthermore, for example, at an arbitrary point during program progress, an event signal may be set in the broadcast signal, and each time this event signal is received, it may be confirmed that the portable information terminal 700 exists within the same household.
[0194] Furthermore, it is also possible to use a combination of the above two methods.
[0195] Next, a specific procedure for permitting terminal cooperation only with the portable information terminal 700 existing within the same household will be described. In this embodiment, when the portable information terminal 700 acquires a broadcast cooperation application or acquires information used in the broadcast cooperation application, restrictions are imposed (hereinafter, the broadcast cooperation application and the information used in the broadcast cooperation application, specifically HTML documents, streaming videos, etc., are collectively referred to as broadcast cooperation information). There are two types of methods for acquiring broadcast cooperation information: communication acquisition from the broadcast station server 300 or the operator server 400, and broadcast acquisition from the broadcast wave. In the case of communication acquisition, there are two types: acquisition after the start of broadcast reception and acquisition in advance before the start of broadcast reception. Furthermore, in the case of communication acquisition, there are cases where the broadcast receiving apparatus 100 acquires it first and then the portable information terminal 700 acquires it from the broadcast receiving apparatus 100, and cases where the portable information terminal 700 directly acquires it from the broadcast station server 300 or the operator server 400. Although there are various methods, from the perspective of the portable information terminal 700, they can be broadly classified into two types: acquisition from the broadcast receiving apparatus 100 and acquisition from the broadcast station server 300 or the operator server 400.
[0196] In this embodiment, the case where the mobile information terminal 700 acquires broadcast cooperation information from the broadcast receiving apparatus 100 will be described. The case of acquiring from a server will be described in the following embodiment.
[0197] FIG. 18A shows the procedure of this embodiment.
[0198] First, before performing terminal cooperation, on each of the mobile information terminal 700 and the broadcast receiving apparatus 100, a cooperation control application that controls terminal cooperation is started (S10001, S10002). In this state, a terminal cooperation request is sent from the mobile information terminal 700 to the broadcast receiving apparatus 100 (S10003). Next, AIT is acquired from the broadcast signal (S10004). From this AIT information, it is determined whether the application for the target mobile information terminal has a same-household restriction (S10006). If there is a restriction, the process proceeds to the procedure of S10008. At the first stage when there is a terminal cooperation request, the process proceeds to step S10009 to determine whether the mobile information terminal 700 that has made the terminal cooperation request is in the same household as the broadcast receiver 100 (S10009). As a result of the determination, if it is determined that they are not in the same household, a non-permission response for cooperation is sent to the cooperation control application on the mobile information terminal side, and the process ends (S10011).
[0199] Here, originally, when it is assumed that all broadcast cooperation applications have a same-household restriction, the determination of S10006 is not performed and is skipped. The determination of S10006 is performed when there may be both an application with a same-household restriction and an application without a same-household restriction.
[0200] If it is determined that the mobile information terminal 700 is in the same house, or in the case of an application without in-house restrictions, the process proceeds to S10012, and a broadcast cooperation application-related service is performed. In this service (S10012), a broadcast cooperation information distribution request (S10013) from the mobile information terminal 700 is processed, and broadcast cooperation information is distributed to the mobile information terminal 700 (S10018). This broadcast cooperation information includes information received by the broadcast receiving device 100 from a distribution server that is the operator server 300 (S10014, S10015, S10016), information obtained from a broadcast signal (S10017), information stored in the broadcast receiving device 100, and the like. The reception (acquisition) of broadcast cooperation information by the broadcast receiving device 100 (S10016, S10017) is not limited to the case of a broadcast cooperation information distribution request (S10013) from the mobile information terminal 700, and it may also be obtained autonomously by the broadcast receiving device 100 or obtained based on the occurrence of an event from a broadcast signal. Also, the distribution of broadcast cooperation information to the mobile information terminal 700 (S10018) may be spontaneous from the broadcast receiving device 100 side.
[0201] After the series of processes of receiving (acquiring) and distributing broadcast cooperation information are completed, it is determined whether the broadcast receiving device 100 continues to watch the same program (S10019). If not, a response of non-permission of cooperation is sent to the cooperation control application on the mobile information terminal side, and the process ends (S10020).
[0202] If the viewing continues, return to the procedure of S10005. If there are in-house restrictions, check whether the portable information terminal 700 is in the same house (S10009). However, it is determined whether the preset valid time has elapsed since the previous check or whether a confirmation request (S10007) has occurred from the broadcast signal or the distribution server since the previous check (S10008). If neither condition is met, the check for whether it is in the same house (S10009) is not performed, and via S10010, the process moves to the execution of the next broadcast cooperation application-related service (S10012). Here, although it is described that the confirmation request (S10007) from the broadcast signal is obtained from the broadcast cooperation information, here it is described that the event message is also included in the broadcast cooperation information. Furthermore, this confirmation request may be described in the AIT.
[0203] Note that the procedure described above is a loop processing procedure for the broadcast signal, the broadcast receiving device 100, the portable information terminal 700, and the entire distribution server in the section indicated by the arrow of S10022. The confirmation request of S10007 may be at any timing within the loop.
[0204] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication (S10015) in the distribution server. This makes it possible to confirm that it is a legitimate authentication request. Also, if the authentication information described in the AIT is changed as the program progresses and the distribution server does not perform authentication unless the authentication key incorporates information synchronized with the progress of the program, it is possible to confirm that the same program is being continuously viewed. In this case, the information of the AIT shall be read and updated as appropriate (S10021). Note that the authentication information incorporated into the broadcast signal may be incorporated not only in the AIT but also as broadcast cooperation information. Furthermore, as a method that will substantially change the authentication information, it is also possible to use a method of changing the URL of the distribution server itself according to the progress of the program.
[0205] In this way, while executing the broadcast cooperation application-related service (S10012), the mobile information terminal 700 checks whether it is in the same house as the broadcast receiving device 100 at preset effective time intervals, or every time there is a confirmation request from the broadcast signal or the distribution server, so that the execution of the broadcast-related application with the same-house restriction can be appropriately performed. Furthermore, by using the authentication information incorporated in the broadcast signal for authentication at the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information of the broadcast signal, it is also possible to confirm that the same program is being continuously viewed.
[0206] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the same-house restriction for the mobile information terminal that cooperates with the broadcast receiving device.
Embodiment
[0207] In this embodiment, a case where the mobile information terminal 700 acquires broadcast cooperation information from the distribution server will be described.
[0208] Fig. 18B shows the procedure of this embodiment.
[0209] First, before performing terminal cooperation, the cooperation control application, which is an application for controlling terminal cooperation, is launched on each of the mobile information terminal 700 and the broadcast receiving device 100 (S10101, S10102). In this state, a terminal cooperation request is sent from the mobile information terminal 700 to the broadcast receiving device 100 (S10103). Next, the AIT is acquired from the broadcast signal (S10104). Information such as the URL related to the distribution server is acquired from the information of this AIT, and the information is transmitted to the mobile information terminal 700 (S10105). Next, a time confirmation request is sent from the broadcast receiving device 100 to the distribution server (S10106), and based on this request, time information is transmitted from the distribution server to the broadcast receiving device 100 (S10107). Thereby, the subsequent authentication key issuance (S10115) can be performed according to the time of the distribution server, but it can be omitted if there is no problem with the time deviation.
[0210] Thereafter, the loop control indicated by the arrow of S10127 is entered.
[0211] First, the mobile information terminal 700 issues an authentication key issuance request or a broadcast cooperation information distribution request to the broadcast receiver 100 (S10109). The authentication key is used in the broadcast cooperation information distribution request to the distribution server in the subsequent stage (S10125). The broadcast cooperation distribution request in S10109 is a distribution request for information obtained from the broadcast signal and corresponds to the procedure of S10126 in the subsequent stage.
[0212] In any case, when the request of S10109 is issued from the mobile information terminal, it is determined whether it is a broadcast cooperation application with the same-home restriction (S10111). If there is a restriction, the process proceeds to the next step S10112. If not, the procedure of S10112 is skipped and the process proceeds to S10114. When all broadcast cooperation applications have the same-home restriction, the determination of S10111 is not performed and the process proceeds to S10112. In S10112, it is determined whether the mobile information terminal that issued the request is within the same home. If not, the terminal cooperation is terminated (S10113). If it is within the same home, the requested procedure, the acquisition of broadcast cooperation information from the distribution server (S10125) or the acquisition of broadcast cooperation information from the broadcast signal (S10126) is performed. Since the acquisition from the broadcast signal may be performed in addition to the acquisition from the distribution server, the procedure of S10126 is also described.
[0213] First, the procedure for acquiring broadcast cooperation information from the distribution server (S10125) will be described.
[0214] First, the broadcast receiver 100 issues the authentication key requested from the information cooperation terminal 700. At this time, it is assumed that the authentication key is valid only within a predetermined time (for example, 10 minutes) including the time information at the time of issuance. The distribution server also confirms the authentication information including whether the authentication key is within the valid time. If the authentication is OK, the distribution of the broadcast cooperation information is permitted. Thereafter, if it is within the valid time, the distribution of the information is permitted, but the distribution is stopped when the valid time has passed. For example, when the streaming video has passed the valid time, it can no longer be viewed.
[0215] The preset valid time may be held by the distribution server, or the broadcast receiving apparatus 100 may obtain it from the broadcast signal (e.g., AIT) and incorporate the valid time information into the authentication key. The portable information terminal 700 may be notified of the valid time information in advance, and it may be configured to request the issuance of an authentication key before the valid time expires. Alternatively, the valid time may be managed by the broadcast receiving apparatus 100, and before the valid time expires, the broadcast receiving apparatus 100 may automatically issue an authentication key to the portable information terminal 700 after confirming that the portable information terminal 700 is within the same household.
[0216] The valid time may be the same within one program, or it may be changed according to the progress of the program. Also, if there is no setting for the valid time, it may be handled such that once authentication is performed, the authentication remains valid during program viewing.
[0217] Furthermore, the authentication information described in AIT may be incorporated into the authentication key used for authentication (S10117) in the distribution server. Thereby, it can be confirmed that it is a legitimate authentication request. Also, if the authentication information described in AIT is changed as the program progresses, and in the distribution server, authentication is not performed unless the authentication key incorporates information synchronized with the progress of the program, it can be confirmed that the same program is being continuously viewed. In this case, the information in AIT shall be appropriately read and updated (S10124). Note that, in addition to being described in AIT, the authentication information incorporated into the broadcast signal may also be incorporated as broadcast cooperation information. Furthermore, as a method that would substantially change the authentication information, a method of changing the URL of the distribution server itself according to the progress of the program can also be used. Note that in this case, the URL change means that the distribution server is the same but the entrance is different, but it is also possible to change to a new distribution server due to a change in the broadcast cooperation application or the like. In this case, the procedures of distribution server information transmission (S10105), time confirmation request (S10106), and time information transmission (S10107) shall be performed each time there is a change.
[0218] Next, the procedure (S10126) for obtaining broadcast cooperation information from the broadcast signal will be described.
[0219] In this case, after it is confirmed that the mobile information terminal 700 is in the same household, the broadcast receiving apparatus 100 acquires broadcast cooperation information from the broadcast signal (S10119), and subsequently distributes the information to the mobile information terminal 700 (S10120).
[0220] When changing the broadcast cooperation information as the program progresses, a change notification is sent from the broadcast signal (S10110). Triggered by this notification, it may be possible to acquire the broadcast cooperation information. In that case, if it is acquired from the distribution server, the broadcast receiving apparatus 100 issues an authentication key to the mobile information terminal (S10115) and notifies that there has been a change notification. If it is within the valid time, the issuance of the authentication key may be omitted, and only the notification of the change notification may be sufficient. In the case of acquisition from the broadcast signal, the broadcast receiving apparatus 100 acquires the information (S10119) and distributes it to the mobile information terminal (S10120). In the case of acquisition from the broadcast signal, the mobile information terminal 700 may confirm that it is in the same household for each change notification, or as in the second embodiment, the confirmation may be omitted if it is within the valid time. Here, although the change notification (S10110) from the broadcast signal is described as being acquired from the broadcast cooperation information, here it is described that the event message is also included in the broadcast cooperation information. Furthermore, this change notification may be described in the AIT.
[0221] After the series of processes of receiving (acquiring) and distributing the broadcast cooperation information are completed, the broadcast receiving apparatus 100 determines whether it is continuing to watch the same program (S10121). If not, it responds with non - permission to cooperate to the cooperation control application on the mobile information terminal side and ends the process (S10123). If watching is continuing, it returns to S10108 and continues the loop process S10127.
[0222] In this way, by including time information in the authentication key used for authentication of the distribution server and managing the validity period, it is possible to periodically confirm that the portable information terminal 700 is in the same house as the broadcast receiving apparatus 100, and appropriately execute the broadcast cooperation application with the same-house restriction. Furthermore, by using the authentication information incorporated in the broadcast signal for authentication at the distribution server, the legitimacy of the distribution request can be ensured, and if the authentication information of the broadcast signal is appropriately changed, it is also possible to confirm that the same program is being continuously viewed.
[0223] According to the portable information terminal cooperation technology according to the present embodiment described above, even when the portable information terminal that cooperates with the broadcast receiving apparatus acquires the broadcast cooperation information from the distribution server, it is possible to realize the same-house restriction.
Embodiment
[0224] In Embodiments 2 and 3, the procedure for realizing the same-house restriction in terminal cooperation has been described, but depending on the broadcast cooperation application, use from outside the house may be permitted. This embodiment will describe such a case. For example, when the program itself such as television shopping is for publicity and promotion, it is desirable for the broadcast business operator that the broadcast cooperation application can be used regardless of whether it is inside or outside the house. In the case of such a program, once registered in the broadcast receiving apparatus 100, the use of the broadcast cooperation application may be permitted regardless of whether the portable information terminal 700 is inside the house. In this case, the convenience is further enhanced if there is a broadcast cooperation application that makes the broadcast video itself into streaming data and distributes it from the broadcast receiving apparatus 100 to the portable information terminal 700 via the Internet. For copyright protection, the streaming data may be encrypted by the broadcast receiving apparatus 100. Whether the broadcast cooperation application permits use from outside the house, including distribution of the broadcast video outside the house, is described in the data (for example, AIT etc.) in the broadcast signal.
[0225] The specific procedure is shown in Fig. 18C. Since some of the procedures are common to those in Embodiments 2 and 3, the description of the overlapping parts with Embodiments 2 and 3 will be omitted. When there is a terminal cooperation request (S10203) from outside the house, if it is an application for which outside-house use is permitted, the broadcast receiving apparatus 100 checks whether the requester is a registered portable information terminal (S10205), and then permits the cooperation. Here, if necessary, authentication may be performed between the portable information terminal 700 and the broadcast receiving apparatus 100 for copyright protection of the broadcast video and broadcast cooperation information (S10207). At that time, the authentication may be authentication in the distribution server (S10207). Information on whether copyright protection is required and information on the copyright protection authentication method are obtained from the broadcast signal (for example, the one described in AIT), and control is performed accordingly. If these pieces of information are not stored in the broadcast signal, the broadcast receiving apparatus 100 follows a predetermined method. For example, a predetermined copyright protection process may be performed. Also, if these pieces of information are not stored in the broadcast signal, it may be predetermined in the broadcast receiving apparatus 100 not to perform the copyright protection process.
[0226] Specific examples of authentication for copyright protection are shown below. Only one of the following authentications may be performed respectively. Or, a combination of a plurality of the authentications exemplified below may be performed. Also, a combination of the authentications exemplified below and other authentication processes not exemplified below may be performed.
[0227] [Authentication by ID and Password] When registering the portable information terminal 700 with the broadcast receiving apparatus 100, an ID and a password are issued, and the broadcast receiving apparatus 100 permits the cooperation by confirming this ID and password.
[0228] [Use of Encryption Key] In addition to the authentication by the above ID and password, an encryption key for decrypting encrypted video data or the like is transmitted from the broadcast receiving apparatus 100 to the portable information terminal. This encryption key may also be obtained from the broadcast signal (for example, described in AIT).
[0229] [Use of Distribution Server] A method of issuing an encryption key for decrypting encrypted video data or the like from a distribution server. The mobile information terminal 700 transmits an ID and a password to the distribution server to obtain the encryption key. In this case, the location information (specifically, the URL) of the distribution server is obtained from a broadcast signal (for example, described in AIT), and this location information is transmitted from the broadcast receiving apparatus 100 to the mobile information terminal 700, thereby enhancing security. Since the mobile information terminal 700 cannot decrypt video or the like without obtaining the encryption key, it may be used as authentication for copyright protection by requesting authentication at the distribution server from the broadcast receiving apparatus 100, or authentication may be completed by notifying the broadcast receiving apparatus 100 from the mobile information terminal 700 that the encryption key has been obtained. Note that charging by the distribution server may be performed.
[0230] [Mutual Authentication of Encryption Key] Mutual authentication of the encryption keys respectively held by the broadcast receiving apparatus 100 and the mobile information terminal 700 and taking confirmation is used as authentication for copyright protection.
[0231] When the information stored in the broadcast signal indicates that copyright protection by a predetermined method is required, if authentication for copyright protection cannot be performed by the predetermined method, terminal cooperation is not permitted. Also, even when there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiving apparatus 100, if authentication for copyright protection cannot be performed by the default method, terminal cooperation is not permitted.
[0232] When terminal connection is permitted, thereafter, it is not necessary to check whether the mobile information terminal 700 exists within the same house. In accordance with a request from the mobile information terminal 700 (S10211), autonomous control of the broadcast receiving apparatus 100, and a request from the broadcast signal (S10210), the broadcast cooperation information is distributed to the mobile information terminal 700 (S10217), and an authentication key for the distribution server is issued (S10212). In this case, control for setting an expiration time does not have to be performed. The mobile information terminal 700 outside the house acquires the broadcast cooperation information from the distribution server using the broadcast receiving apparatus 100 or the issued authentication key (S10215). Further, if the authentication information acquired from the broadcast signal (for example, assume it is described in AIT) is incorporated into the authentication key issued by the broadcast receiving apparatus 100, and the distribution server permits access if the authentication key incorporates the authentication information acquired from the broadcast signal, it is possible to further optimize the use outside the house.
[0233] Furthermore, there may be cases where it is better not to permit unlimited use of the broadcast cooperation application, such as when giving a discount as a premium for program viewing. In such cases, it is preferable to perform authentication once with the mobile information terminal existing within the same house, and then permit use of the distribution server even if not within the same house. In this case, the mobile information terminal 700 does not have to be registered with the broadcast receiving apparatus 100.
[0234] The specific procedure in this case is shown in FIG. 18D. Since some of the procedures are common to FIG. 18C above, the description of the overlapping parts will be omitted. First, in a state where the portable information terminal 700 is in the same house as the broadcast receiving apparatus 100, a terminal cooperation request is sent from the portable information terminal 700 to the broadcast receiving apparatus 100, and the broadcast receiving apparatus 100 permits the cooperation after confirming that the portable information terminal 700 is in the same house (S10305). Here, if necessary, authentication may be performed between the portable information terminal 700 and the broadcast receiving apparatus 100 for copyright protection of the broadcast video and the broadcast cooperation information (S10307). At that time, the authentication may be authentication by an external distribution server. Information about whether copyright protection is necessary and information about the copyright protection authentication method are obtained from the broadcast signal (for example, assume it is described in AIT), and control is performed accordingly. If these pieces of information are not stored in the broadcast signal, the broadcast receiving apparatus 100 follows a predetermined method. For example, a predetermined copyright protection process may be performed. Also, if these pieces of information are not stored in the broadcast signal, it may be predetermined in the broadcast receiving apparatus 100 not to perform the copyright protection process.
[0235] Specific examples of authentication for copyright protection are shown below. Only one of the following authentications may be performed, respectively. Or, a combination of a plurality of the authentications exemplified below may be performed. Also, a combination of the authentication exemplified below and other authentication processes not exemplified below may be performed.
[0236] [Use of Encryption Key] With the portable information terminal 700 in the same house, an encryption key for decrypting encrypted video data and the like is transmitted from the broadcast receiving apparatus 100 to the portable information terminal. This encryption key may also be obtained from the broadcast signal (for example, described in AIT). The transfer of this encryption key within the same house is regarded as authentication. Furthermore, if the encryption key cannot be obtained from the broadcast signal unless it is a certain point in time of the program, and the transfer of the encryption key to the portable information terminal 700 is limited to within the same house, a restriction may be set that one must be in the same house at that time, and it can also be used for premium provision for viewing.
[0237] [Use of the distribution server] A method of issuing an encryption key for decrypting encrypted video data and the like from a distribution server. The mobile information terminal 700 transmits an ID and a password to the distribution server to obtain the encryption key. In this case, the location information (specifically, the URL) of the distribution server is obtained from the broadcast signal (for example, described in AIT), and this location information is transmitted from the broadcast receiving device 100 to the mobile information terminal 700, thereby enhancing security. Since the mobile information terminal 700 cannot decrypt video and the like if it cannot obtain the encryption key, it is possible to use it as authentication for copyright protection by requesting authentication from the broadcast receiving device 100 at the distribution server, or it is also possible to complete the authentication by notifying the broadcast receiving device 100 from the mobile information terminal 700 that the encryption key has been obtained. Access to the distribution server may be performed either indoors or outdoors, but the location information of the distribution server cannot be obtained from the broadcast signal unless it is at a certain point in the program. By limiting the transfer of the location information to the mobile information terminal 700 to the same house, a restriction can be set that one must be in the same house at that time, and it can also be used for premium conferment for viewing. Note that charging by the distribution server may be performed.
[0238] [Mutual authentication of encryption keys] The encryption keys respectively held by the broadcast receiving device 100 and the mobile information terminal 700 are mutually authenticated and confirmed to be used as authentication for copyright protection. This authentication may be performed either indoors or outdoors.
[0239] When the information stored in the broadcast signal indicates that copyright protection by a predetermined method is required, if the copyright protection authentication cannot be performed by the predetermined method, terminal cooperation is not permitted. Also, even when there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100, if the copyright protection authentication cannot be performed by the default method, terminal cooperation is not permitted. The procedures after permitting terminal cooperation are common to the procedures in FIG. 18C, so the description is omitted.
[0240] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use from outside the home while paying attention to copyright protection for the mobile information terminal that cooperates with the broadcast receiving device.
Embodiment
[0241] In the actual usage situation, it is more desirable to easily know whether there is a terminal cooperation application for the program and which terminal cooperation application is available. In this embodiment, a method for displaying the available status of the terminal cooperation application will be described. The terminal cooperation application refers to the broadcast cooperation application used in the terminal cooperation.
[0242] FIG. 19A is an example of a launcher screen (173b11) of the broadcast cooperation application when there is a terminal cooperation application. The broadcast cooperation application is displayed as an icon with framed text. Broadcast cooperation applications (173b12 to 173b14) for the broadcast receiving device 100 linked to the program being viewed and broadcast cooperation applications (173b15 to 173b17) for the mobile information terminal are displayed. In the case of this example, the status of the application is indicated by the thickness of the frame line surrounding the character string and the color inside the frame. The main body applications A and B (173b12, 173b13) and the terminal applications A and B (173b15, 173b16) are in an available state, and the main body application C (173b14) and the terminal application C (173b17) are in an unavailable state. The state where the terminal application is unavailable means that among the mobile information terminals 700 that are in a state capable of communicating with the broadcast receiving device 100, there is no device having a function to execute the application.
[0243] FIG. 19B is a screen after selecting the terminal application A in FIG. 19A. It shows the status of each mobile information terminal 700 regarding the terminal application A. The mobile information terminals displayed on this screen are the terminals that have been linked with or registered with the broadcast receiving device 100 in the past.
[0244] The mobile terminal 1 (173b22) and the mobile terminal 2 (173b23) with solid icon frame lines are in a state where they can communicate with the broadcast receiving device 100, indicating that the mobile terminal 3 (173b24) and the mobile terminal 4 (173b25) with dotted icon frame lines are not in a state where they can communicate with the broadcast receiving device 100. Also, the mobile terminal 1 (173b22) and the mobile terminal 3 (173b24) with white interiors of the icon have the function of executing the terminal app A, indicating that the mobile terminal 2 (173b23) and the mobile terminal 4 (173b25) with gray interiors of the icon do not have the function of executing the terminal app A. Furthermore, when an app is already running on the terminal, an icon design representing this can be used.
[0245] Also, since it is more visually understandable to use patterns for icons, an example is shown below.
[0246] Figure 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperation apps. Icons are shown according to the types of the mobile information terminal 700 in addition to the broadcast receiving device 100. 173b32 and 173b33 are icons indicating the broadcast receiving device 100, 173b34 and 173b35 are icons indicating the smartphone type mobile information terminal 700, and 173b36 is an icon indicating the head-mounted display type mobile information terminal 700. Each app is for the device indicated by the icon.
[0247] In Figure 19C, when the app cannot be used, a mark indicating non-availability (in this case, a slanted line in a circle) is displayed over the device pattern. Also, regarding the broadcast receiving device 100, when the app is already running, a mark indicating this (in this case, a dot in a circle) can be overlaid and displayed. By this display, it is possible to prevent a wasteful operation of proceeding with the launcher procedure even though the app is already running. In the case of the mobile information terminal 700, it is also possible to use a method of displaying a mark indicating that the app is running when the app is running on all terminals that are in a state where they can communicate with the broadcast receiving device and the app is executable.
[0248] FIG. 19D shows a screen (173b41) after selecting application C (173b34) in FIG. 19C. The state of the mobile information terminal 700 of the type corresponding to application C is shown. In this screen, when the mobile information terminal 700 does not have the execution function of the broadcast cooperation application, when it is not in a communicable state with the broadcast receiving apparatus 100, or when the broadcast cooperation application is already being executed, marks indicating those situations are superimposed on the icons. In this example, when it does not have the execution function, a mark of a circle with a diagonal line (173b44, 173b46) is displayed; when it is not in a communicable state, a mark of a triangle with an exclamation mark (173b45, 173b46) is displayed; and when it is already being executed, a mark of a circle with a dot (173b43) is displayed.
[0249] Furthermore, it is desirable to have a display method that allows the user to know that there is a broadcast cooperation application when the situation changes, without having to launch the launcher each time. For example, when the power is turned on, when the channel is changed, at the beginning of a program, when there is a change in the broadcast cooperation application even during the program, when there is a change in the communication state between the broadcast receiving apparatus 100 and the mobile information terminal 700, or when the execution status of the application changes, the icon is displayed for a predetermined time to indicate the state at that time.
[0250] FIG. 19E shows an example of that case. When icons indicating the types of the respective devices are displayed, it indicates that there is a broadcast cooperation application corresponding to the device of that type. In this case, the mark of a circle with a diagonal line indicates that there is no application that can be executed on the device of that type that is in a usable state. The mark of a circle with a dot indicates that the application is being executed on all devices of that type that are in a usable state.
[0251] FIG. 19F is a display screen (10401) on the mobile information terminal 700. When requesting terminal cooperation from the mobile information terminal 700, it is more convenient to know in a list which broadcast receiving device 100 and which broadcast cooperation application are available. An example of such a list is shown in FIG. 19F (10402). This table shows which broadcast cooperation applications corresponding to the program to be investigated are available on which broadcast receiving device 100 in the house. Also, if the status of each broadcast receiving device 100 is also displayed, the convenience is further enhanced, especially when using from outside the house. In this example, display examples such as receiving the program, receiving other programs, vacant, having a reservation for other programs (when recording other programs is reserved from the middle of the program) are shown. Here, when there are a plurality of tuners in the broadcast receiving device 100, the convenience is further enhanced if the status is displayed for each tuner. In Table 10202, the branch numbers indicate the distinction of the tuners in the same device. For example, receiving device B-1 and receiving device B-2 are tuners in the same broadcast receiving device 100. In the case of terminal cooperation, if streaming data can receive the distribution of broadcast video and audio, there is no need to use the video unit of the broadcast receiving device 100, and if the tuner in the broadcast receiving device 100 can be used, the broadcast can be used. Therefore, it is convenient to know the usage status of each tuner.
[0252] Note that in order to perform the display described in this embodiment, for each broadcast cooperation application, information on whether it is an application corresponding to the broadcast receiving device 100 or an application corresponding to what type of mobile information terminal 700 is required. Also, information for executing the corresponding application is required in the broadcast receiving device 100 and the mobile information terminal 700. These information can be obtained by the broadcast receiving device 100, for example, by being described in the AIT.
[0253] According to the mobile information terminal cooperation technology according to the present embodiment described above, by displaying information on the broadcast cooperation application, the broadcast receiving device 100, and the mobile information terminal 700, a more convenient broadcast cooperation service can be used.
Embodiment
[0254] Hereinafter, in Examples 6 to 10, the broadcast receiving apparatus 100 is referred to as an information display apparatus.
[0255] First, Example 6 will be described with reference to FIGS. 2C, 2D, 20 to 24. Note that the configuration and effects in Example 6 are the same as those in Example 1 unless otherwise specified. Therefore, hereinafter, the differences between Example 6 and Example 1 will be mainly described, and the common points will be omitted as much as possible.
[0256] In Examples 1 to 5, there is one broadcast program displayed on the broadcast receiving apparatus 100. On the other hand, there are a plurality of broadcast programs displayed on the information display apparatus of Example 6.
[0257] [Hardware Configuration of Information Display Apparatus] FIG. 2C is a block diagram of the information display apparatus 1000 according to Example 6. As shown in FIG. 2C, the information display apparatus 1000 includes a video display unit 173, a video output unit 175, an audio reproduction unit 174b, an audio output unit 176, a viewer instruction input unit 25001 (described later, FIG. 2D), a content input unit 25002, a content reproduction unit 25003, a content recording and reproduction unit 25004, and a control unit 25005.
[0258] Instruction information received from a viewer by a device (for example, a remote control (described later, FIG. 22A)) is input to the viewer instruction input unit 25001.
[0259] The content input unit 25002 acquires content (for example, broadcast content, content on the Internet, recorded content). Specifically, the content input unit 25002 is a tuner / demodulation unit 131 (described above, FIG. 2A) that receives broadcast content, a LAN communication unit 121 (described above, FIG. 2A) that acquires content on the Internet, an extended interface unit 124 (described above, FIG. 2A) or a digital interface unit 125 (described above, FIG. 2A) when inputting recorded content from an external content playback device or the like.
[0260] The content playback unit 25003 plays back the recorded content. Specifically, the content playback unit 25003 is the storage unit 110 (described above, Fig. 2A). Also specifically, the storage unit 110 is a drive for an optical disk recording medium or the like.
[0261] The content recording and playback unit 25004 records / plays back content (records / reads out in the case of content on the Internet). Specifically, the content recording and playback unit 25004 is the storage unit 110 (described above, Fig. 2A), the RAM 104 (described above, Fig. 2A), etc.
[0262] The control unit 25005 is a set of control units including the main control unit 101 (described above, Fig. 2A).
[0263] The control unit 25005 causes the video output unit 175 to output video information for displaying a main window in which main content, which is the main video of a broadcast program, is displayed, and a sub-window for displaying sub-content included in the execution screen of a broadcast cooperation application that cooperates with the broadcast program. The video output unit 175 outputs the video information output from the control unit 25005 to an external display device (such as a display).
[0264] Also, the control unit 25005 causes the main window and the sub-window to be displayed on the video display unit 173. Note that on the execution screen of the broadcast cooperation application, information associated with the main video of the broadcast program (for example, weather forecasts, responses from viewers of the broadcast program, profiles of the performers of the broadcast program, etc.) is displayed. For example, when the broadcast program is a marathon broadcast, in the main window, video from the relay (for example, video of a runner near the front) is displayed, and in the sub-window, video of a runner running at a position far from the front is displayed.
[0265] Also, the control unit 25005 controls the display of the window group displayed on the video display unit 173. Also, the control unit 25005 controls the audio playback unit 174b and the audio output unit 176.
[0266] The audio playback unit 174b plays back audio. Specifically, the audio playback unit 174b is the speaker 174 (described above, Fig. 2A). Note that the audio playback unit 174b also includes earphones.
[0267] The audio output unit 176 outputs audio information. For example, the audio output unit 176 outputs audio information (audio signal) to an external output device (such as a speaker). In the following description, in order to distinguish from the case of outputting audio information (audio signal) from the audio output unit 176, the case of outputting audio from the audio playback unit 174b is expressed as audio playback.
[0268] The video display unit 173 displays the main window based on the window shape specification information and the window front-rear relationship specification information included in the window-related specification information (the window-related specification information is a general term for window-related specification information such as window shape specification information and window front-rear relationship specification information). Also, it is possible to include the window shape specification information in the broadcast signal (for example, AIT). Furthermore, it is possible to include in the window shape specification information whether part or all of the window-related specification information can be changed by the viewer's selection. Also, in the case of recorded content, the video display unit 173 may display the main window based on the window shape specification information stored in advance as content group-related information. Also, in the case of content on the Internet, the video display unit 173 may display the main window based on the window shape specification information distributed together with the content as content group-related information. Also, since it is desirable to adjust the size of the window, that is, the size of the image display area, according to the size and number of pixels of the information display device 1000, the window-related specification information may be a plurality of specification information corresponding to the size and number of pixels of the information display device 1000.
[0269] The video display unit 173 displays a main window for displaying the main video of the broadcast program and a sub-window for displaying the execution screen of the broadcast cooperation application that cooperates with the broadcast program.
[0270] In addition to the broadcast program received from the broadcast wave, the video display unit 173 also displays recorded programs and Internet content. Hereinafter, broadcast content received from the broadcast wave, Internet content, recorded content, etc. may be collectively referred to as content.
[0271] The video output unit 175 outputs video information for displaying a main window that displays the main video of the broadcast program and a sub-window for displaying the execution screen of the broadcast cooperation application that cooperates with the broadcast program to an external display device.
[0272] In addition to the broadcast program received from the broadcast wave, the video output unit 175 also outputs video information for displaying recorded programs and Internet content to an external display device. [Viewer Instruction Input Unit]
[0273] FIG. 2D is a diagram showing an example of the viewer instruction input unit 25001 of the information display device according to the embodiment. Instruction information input by the device from the viewer is input to the viewer instruction input unit 25001.
[0274] Devices that receive input of instruction information from the viewer are specifically a remote control 25102, a mouse 25104, a touch pad 25106, a keyboard 25108, a mobile information terminal 25110, a touch panel 25111, etc.
[0275] When these input devices (remote control 25102, mouse 25104, touch pad 25106, keyboard 25108, portable information terminal 25110, touch panel 25111) are integrated with the information display device 1000, the input device itself serves as the viewer instruction input unit 25001. On the other hand, when these input devices are not integrated with the information display device 1000 and are connected to the information display device 1000 via wireless or wired means, the input ports 25101, 25103, 25105, 25107, 25109 serve as the viewer instruction input unit 25001. Also, when the portable information terminal 25110 is used as an input device and connected to the information display device via LAN, the LAN communication unit 121 (described above, Figure 2A) serves as the viewer instruction input unit 25001.
[0276] The keyboard 25108 (including the case where a portable information terminal is used as a character input means) launches an Internet browser and accepts character input to the browser when searching for a group of contents on the Internet.
[0277] The portable information terminal 25110 and the touch panel 25111 detect a touch operation on the screen display area and execute processing corresponding to the position where the touch operation is received.
[0278] [Screen Display of Information Display Device] Hereinafter, with reference to Figure 20A, an example of a screen when the video display unit 173 displays two broadcast programs will be described.
[0279] FIG. 20A shows a state where the video display unit 173 displays a first main window 20000 corresponding to broadcast signal 1, a first sub-window 20001 corresponding to broadcast signal 1, a second main window 20002 corresponding to broadcast signal 2, and a second sub-window 20003 corresponding to broadcast signal 2. Here, in the first main window 20000 and the second main window 20002, which are main windows shown in FIG. 20A, the main video of the broadcast program is displayed. On the other hand, on the first sub-window 20001 and the second sub-window 20003, which are sub-windows, the execution screen of the broadcast cooperation application linked to the broadcast program is displayed.
[0280] Hereinafter, the content included in the main window such as the first main window 20000 or the second main window 20002 displayed by the video display unit 173 may be referred to as main content. Also, the content included in the sub-window such as the first sub-window 20001 or the second sub-window 20003 may be referred to as sub-content.
[0281] Also, a set of content consisting of main content and sub-content related to the main content may be referred to as a content group. Note that there may be a case where there is only main content, but here, even in such a case, it is referred to as a content group. Therefore, the content group described below includes a set of content consisting of main content and sub-content related to the main content or a single main content having no related sub-content.
[0282] Also, as a specific example, the content group consists of the main video of the above-described broadcast program (including the broadcast program received from over-the-air waves and the recorded program), and the execution screen of the broadcast cooperation application that cooperates with the broadcast program. Also, as another specific example, the content group consists of the content on the Internet (e.g., a web page) and the streaming video included in the content (e.g., the streaming video included in the web page). Also, as another specific example, the content group consists of the content on the Internet (e.g., a web page) and other content displayed in a plurality of windows opened by the same application. Note that a plurality of sub-contents may be included in the sub-window displayed by the video display unit 173. Also, in the case of a VOD (Video On Demand) or a broadcast cooperation application of a recorded program, the application may be deleted from the designated distribution server. In such a case, it is possible to perform the alternative process (e.g., connection to the alternative connection URL) described in the AIT or the attached information, or, if there is no provision for the alternative process, to display the fact to that effect in the sub-window and not to start the application.
[0283] The video output unit 175 outputs video information for displaying the videos of a plurality of content groups in different windows for each content group to an external display device.
[0284] The video display unit 173 displays the videos of a plurality of content groups in different windows for each content group.
[0285] The viewer instruction input unit 25001 receives an input for setting the content group to be in a selected state from a plurality of content groups.
[0286] Each content group that the image display unit 173 simultaneously displays (or the video output unit 175 outputs) has only one content group set to the selected state, and all other content groups are set to the non-selected state. Then, the audio output unit 176 outputs the audio information of the audio corresponding to the content group in the selected state. Also, the audio playback unit 174b plays the audio corresponding to the content group in the selected state. This can prevent the audio of multiple content groups from being mixed.
[0287] When an input for switching the content group to be in the selected state is received, the content group after the switching is set as the set state, and the content group that has been in the selected state until now is set as the non-selected state. Then, the audio playback unit 174b / audio output unit 176 stops the playback / output of the audio that has been played so far, and plays / outputs the audio of the content group newly set to the set state.
[0288] Specifically, a pointing device such as a mouse 25104 or a touch pad 25106 (including the case where the portable information terminal 25110 is used as a pointing device) moves the cursor 20004 to the window that displays the content group to be in the selected state, and receives an input of clicking (for example, double-clicking), thereby receiving an input for switching to the content group to be in the selected state. Also, in the case of the touch panel 25111, the touch panel 25111 receives an input for switching to the content group to be in the selected state by double-tapping.
[0289] In the case shown in FIG. 20A, the content groups displayed in the first main window 20000 and the first sub-window 20001 are in the selected state, and the content groups displayed in the second main window and the second sub-window 20003 are in the non-selected state. Then, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the content group of the broadcast signal 1 corresponding to the first main window 20000 in the selected state.
[0290] Note that the audio reproduced / output by the audio reproduction unit 174b / audio output unit 176 may be the audio of the main content or the audio of the sub-content. Further, when a plurality of audios are included in the same content group, the audio reproduction unit 174b / audio output unit 176 may select one of them and reproduce / output it.
[0291] Also, in the case of VOD (Video On Demand), the menu list may be displayed in the main windows 20000, 20002, and the video may be displayed in the sub-windows 20001, 20003.
[0292] Also, based on the input received from the viewer, the shape, size, and position of the window may be freely changed. Specifically, based on the input received by the touch panel 25111 (for example, an input to move the position of the window by dragging, or an input to change the size of the window by pinching in or pinching out), the shape, size, and position of the window are changed. Also, based on the input received by a pointing device such as the mouse 25104 or the touch pad 25106 (for example, an input by a drag operation), the shape, size, and position of the window are changed.
[0293] The video display unit displays the window in which the selected content group is displayed and the window in which the non-selected content group is displayed in different manners. For example, the video display unit 173 displays the frame lines of the windows in which the contents of the same content group are displayed in the same manner (for example, displayed in the same color). Also, the video display unit 173 displays the frame lines of the window in which the selected content group is displayed and the frame lines of the window in which the non-selected content group is displayed in different manners. This makes it easier to identify that they are windows belonging to the same content group.
[0294] In the example of FIG. 20A, it shows that the content groups displayed in the first main window 20000 and the first sub-window 20001 are in a selected state. That is, while the frame lines of the first main window 20000 and the first sub-window 20001 are displayed in thick lines, the frame lines of the second main window and the second sub-window 20003 are displayed in dashed lines. Note that the color of the frame line of the window displaying the selected content group and the color of the frame line of the window displaying the non-selected content group may be displayed in different colors. Specifically, the display color within the window displaying the non-selected content group may be displayed in a lighter color than the display color within the window displaying the selected content group.
[0295] Also, the video display unit 173 displays the main window and the sub-window in different modes. For example, as shown in FIG. 20A, the video display unit 173 displays marks 20006 and 20007 in the main window. Note that, as shown in FIG. 23A, the window attribute display unit 20310 may display the distinction between the main window and the sub-window.
[0296] Here, when the windows overlap, the front-back relationship such as which window is displayed in front of the other window becomes a problem. Next, with reference to FIG. 20B, the case where the window displaying the selected content group and the window displaying the non-selected content group overlap will be described.
[0297] As shown in FIG. 20B, the window displaying the content group in the selected state is displayed superimposed on the window displaying the content group in the non-selected state. That is, the first main window 20000 and the first sub-window 20001 that display the content group in the selected state are displayed superimposed on the second main window and the second sub-window 20003.
[0298] Note that window context specification information for specifying the context between related windows may be included in the broadcast signal (e.g., AIT).
[0299] Also, window context specification information may include whether part or all of the window-related specification information can be changed by the viewer's selection.
[0300] Also, in the case of recorded content, the video display unit 173 may display the main window based on the window context specification information stored in advance as information related to the content group.
[0301] Also, in the case of content on the Internet, the video display unit 173 may display the main window based on the window context specification information distributed together with the content as information related to the content group.
[0302] Also, based on the input received from the viewer, it may be determined which window is displayed in front of other windows. Specifically, as shown in FIG. 20C, when a pointing device such as the mouse 25104 or the touch pad 25106 moves the cursor 20004 to the first sub-window 20001 and receives a single click input, the video display unit 173 superimposes and displays the first main window 20000 and the first sub-window 20001 on the second main window and the second sub-window 20003. Also, when the touch panel 25111 receives an operation of single-tapping the window to be displayed in the front, the window that has received the operation may be displayed in the front. Note that it is preferable that the click operation for switching the content group and the click operation for the window display operation be different operations, such as a single click and a double click.
[0303] Also, as shown in FIG. 20D, after a pointing device such as a mouse 25104 or a touch pad 25106 moves the cursor 20004 up to the first sub-window 20001 and receives an input to click, a confirmation window 20005 may be displayed. This can prevent the content group in the selected state from switching to an unintended content group.
[0304] The remote control 25102 receives an input (hereinafter, may simply be referred to as switching the window) to switch the content group to be in the selected state by a button operation. Hereinafter, the remote control 25102 will be described in detail with reference to FIG. 22A.
[0305] When the content addition button 20213 shown in FIG. 22A receives an input, the mode switches to either the switching mode or the addition mode. For example, in the switching mode, when the content addition button 20213 receives an input, the mode switches from the switching mode to the addition mode. On the other hand, in the addition mode, when the content addition button 20213 receives an input, the mode switches from the addition mode to the switching mode.
[0306] In the switching mode, the total number of the content groups displayed by the video display unit 173 does not change. On the other hand, in the addition mode, the total number of the content groups displayed by the video display unit 173 increases.
[0307] Specifically, in the switching mode, when the channel button 20211 receives an input, the content group of the broadcast program corresponding to the channel button 20211 is added. Then, the video display unit 173 erases the window that displays the content group that was in the selected state immediately before, and displays a new window in which the added content group is displayed. Then, the newly added content group becomes the selected state, and the audio playback unit 174b / audio output unit 176 stops the audio that has been played / output so far, and plays / outputs the audio of the newly added content group.
[0308] Note that the video display unit 173 may erase the window that displays the content group with the longest elapsed time from the non - selected state to the current time. Also, it may be configured to accept an input for selecting a content group for which the viewer stops the display.
[0309] In the addition mode, when the channel button 20211 receives an input, the content group of the broadcast program corresponding to the channel button 20211 is added. Then, the video display unit 173 displays a new window in which the added content group is displayed. Then, the newly added content group becomes the selected state, and the audio playback unit 174b / audio output unit 176 stops the audio that has been played / output so far and plays / outputs the audio of the newly added content group.
[0310] Note that when the total number of the added content groups exceeds the number of tuners, the video display unit 173 may erase the window that displays the content group with the longest elapsed time from the non - selected state to the current time. Also, it may be configured to accept an input for selecting a content group for which the viewer stops the display.
[0311] When the content switching button 20201 shown in FIG. 22A receives an input, the content group in the temporarily selected state is switched. Then, when the decision button 20202 receives an input, the content group in the temporarily selected state becomes the selected state. Hereinafter, the above - mentioned processing will be specifically described with reference to FIG. 22B.
[0312] FIG. 22B shows an example when the content group displayed in the second main window 20002 is in the temporarily selected state. As shown in FIG. 22B, a temporary selection frame 20204 is displayed around the second main window 20002.
[0313] Thereafter, when the decision button 20202 receives an input, the content group displayed in the second main window 20002 is set to the selected state.
[0314] When the return button 20203 accepts an input, the temporary selection state of the content group displayed in the second main window 20002 is cancelled. As a result, it becomes possible not to switch the content group even if it is temporarily selected. Also, the window of the content group in the temporary selection state may be displayed in front of the window of another content group, and the audio may be switched. This enables the content of the content group that is a switching candidate to be confirmed, improving convenience.
[0315] Also, by accepting an input that combines the content switching button 20201, the channel button 20211, and the color button 20212, the content group may be set to the temporary selection state or the selection state.
[0316] Furthermore, the number corresponding to the channel button 20211 may be displayed in the window displayed by the video display unit 173. In this case, when the channel button 20211 accepts an input after the content switching button 20201 accepts an input, the window corresponding to the channel button 20211, that is, the content group, is set to the temporary selection state or the selection state. Also, the number corresponding to the channel button 20211 may be displayed in the window attribute display unit 20310 as shown in Fig. 23A.
[0317] Furthermore, a part of the window (for example, the frame line of the window) displayed by the video display unit 173 may be displayed in the color corresponding to the color button 20212. In this case, when the channel button 20211 accepts an input after the content switching button 20201 accepts an input, the window corresponding to the color button 20212, that is, the content group, is set to the temporary selection state or the selection state.
[0318] Also, as shown in FIG. 22C, when the menu screen displayed on the mobile information terminal 25110 accepts an input, the content group may be added. In the menu screen shown in FIG. 22C, each content group is iconified. Then, when the icon 20206 displayed on the mobile information terminal 25110 is selected (for example, a touch operation), the mobile information terminal 25110 accepts an input to add the content group. In the example shown in FIG. 22C, "Channel B" is selected as the content group to be added. And the frame line of the icon 20206 corresponding to "Channel B" is displayed in a different manner (thicker frame line in the example of FIG. 22C) from other icons 20206.
[0319] In the above-described example, together with the example of the display screen, the process of specifying or adding a content group by operating the input device has been described. Hereinafter, the process of adding a content group of a broadcast program by specifying from the EPG will be described with reference to FIGS. 22H and 22I.
[0320] As shown in FIG. 22H, the frame line of the broadcast program in the temporary selection state is surrounded by the temporary selection frame 20226.
[0321] When the determination button 20202 of the remote control (described above, FIG. 22A) accepts an input, the video display unit 173 displays a new window in which the content group added in place of the EPG173e is displayed. Then, the content group of the broadcast program in the temporary selection state is added.
[0322] When the content addition button 20213 of the remote control accepts an input, the content group of the broadcast program in the temporary selection state becomes the selection state. Also, the frame line 20224 of the broadcast program in the selection state is displayed thickly. In this case, the EPG173e remains open and continues to accept an input to add a content group of a broadcast program. And a new temporary selection frame 20226 for selecting a broadcast program to be in the temporary selection state is displayed.
[0323] In the state shown in FIG. 22H, when the content addition button 20213 receives an input, the content group of the broadcast program that was in the provisional selection state becomes the selected state. Also, as shown in FIG. 22I, the frame line 20224 of the broadcast program that has become the selected state is displayed thickly. Also, the content group of the broadcast program that was in the selected state in FIG. 22H becomes the semi-selected state in FIG. 22I. And, as shown in FIG. 22I, the frame line of the broadcast program that has become the semi-selected state is displayed thickly and diagonal lines are displayed at the corners. In this way, when the content addition button 20213 receives an input, the content group of the broadcast program that was previously in the selected state becomes the semi-selected state, and the content group of the broadcast program that was in the provisional selection state becomes the selected state. Therefore, each time the content addition button 20213 receives an input, the semi-selected content group is added.
[0324] In the state shown in FIG. 22I, when the enter button 20202 of the remote control receives an input, the content group of the broadcast program that is in the semi-selected state and the content group of the broadcast program that is in the selected state are added. Then, the video display unit 173 displays two windows in which the added content groups are displayed. In this case, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the content group of the broadcast program that was in the selected state in the EPG 173e. That is, the audio playback unit 174b / audio output unit 176 does not play / output the audio of the content group of the broadcast program that was in the semi-selected state in the EPG 173e. The content group of the broadcast program that was in the semi-selected state in the EPG 173e becomes a non-selected content group when the content group is displayed. If there is a content group that was in the selected state in the video display unit 173 before the addition of the content group by the EPG 173e, that content group becomes the non-selected state.
[0325] After selecting a group of content whose selected or semi - selected state is to be cancelled in the EPG173e, when the content end button 20216 accepts an input, the selected or semi - selected state of the content group is cancelled. In that case, when the broadcast program whose selected state has been cancelled becomes selected, the content group that has become semi - selected is changed to the selected state.
[0326] Note that all content groups added by being specified from the EPG173e may be set to the semi - selected state. In this case, if there is a content group that was in the selected state in the video display unit 173 before the addition of the content group by the EPG173e, that content group maintains the selected state.
[0327] Next, with the launcher menu (described later, Fig. 22J) being displayed, the process of adding a content group when the remote control (described above, Fig. 22A) accepts an input will be described with reference to Fig. 22A and Fig. 22J.
[0328] When the menu button 20232 of the remote control accepts an input, the video display unit 173 displays the launcher menu 20230 shown in Fig. 22J.
[0329] As shown in Fig. 22J, the launcher menu 20230 displays a list of a plurality of menu items 20233 for selecting content and applications. Note that an application also becomes selected as one of the content groups.
[0330] Also, as shown in Fig. 22J, the frame of the menu item 20233 in the temporary selection state is surrounded by a temporary selection frame 20231. When the arrow button 20214 of the remote control (described above, Fig. 22A) accepts an input, the menu item 20233 surrounded by the temporary selection frame 20231 is switched, and accordingly, the content group (content or application) in the temporary selection state is switched.
[0331] When the content addition button 20213 of the remote control accepts an input, the content group (content or application) corresponding to the menu item 20233 in the temporary selection state becomes the selected state. Also, the frame line of the selected content group is displayed thickly. Further, as a new content group becomes the selected state, the content group that has been in the selected state until now becomes the semi-selected state, and the frame line of the semi-selected content group is displayed thickly and diagonal lines are displayed at the corners. Then, when the confirmation button 20202 of the remote control accepts an input, the voice output unit 176 displays a window in which each added content group is displayed, instead of the launcher menu 20230. In this case, the content group that was in the semi-selected state and the content group that was in the selected state in the launcher menu 20230 are added as new content groups. And the voice output unit 176 outputs the voice of the content group that was in the selected state in the launcher menu 20230. That is, the voice of the content group that was in the semi-selected state is not output. The content group that was in the semi-selected state in the launcher menu 20230 becomes a non-selected content group when the content group is displayed.
[0332] Specifically, in FIG. 22J, “App 3” is temporarily selected. In this state, when the content addition button 20213 accepts an input, the temporarily selected “App 3” becomes selected. Also, “Content 3,” which has been in the selected state until now, becomes semi-selected, and the frame line of “Content 3” is displayed thickly, and diagonal lines are displayed at the corners. Then, when the enter button 20202 of the remote control accepts an input, the content groups of “Content 1,” “Content 3,” “App 2” in the semi-selected state and “App 3” in the selected state are added as a new content group. Then, the video display unit 173 displays a main window that displays the added “Content 1,” “Content 2,” “App 2,” and “App 3.” In this case, the audio output unit 176 outputs the audio of “App 3” that was in the selected state in the launcher menu 20230. That is, the audio of “Content 1,” “Content 2,” and “App 2” in the semi-selected state is not output. If the added app is an app that does not require display on the video display unit 173, only the app is launched. Also, the “Content” in the launcher menu 20230 may be the main content, and the “App” may be the sub-content corresponding to the “Content.”
[0333] After selecting a content group that cancels the selected or semi-selected state in the launcher menu 20230, when the content end button 20216 accepts an input, the selected or semi-selected state of the content group is cancelled.
[0334] Next, the process of adding a content group by specifying using a pointing device such as the mouse 25104 or touch pad 25106 or the touch panel 25111 from the launcher menu will be described with reference to FIGS. 22J and 22K.
[0335] When an input of clicking the launcher icon 20240 shown in FIG. 22K (in the case of the touch pad 25106, a touch operation) is accepted, the screen switches to the screen of FIG. 22J, and the launcher menu 20230 is displayed.
[0336] When the unselected menu item 20233 receives an input of a click (in the case of the touch pad 25106, a touch operation), the corresponding content group becomes selected. Also, the content group that has been in the selected state so far becomes semi - selected.
[0337] Also, when the selected menu item 20233 receives an input of a click (in the case of the touch pad 25106, a touch operation), the corresponding content group becomes semi - selected, and when the semi - selected menu item 20233 receives an input of a click (in the case of the touch pad 25106, a touch operation), the corresponding content group becomes unselected.
[0338] When the determination button 20202 of the remote control receives an input, the video display unit 173 displays a window in which each added content group is displayed, instead of the launcher menu 20230. In this case, the content group that was in the semi - selected state and the content group that was in the selected state in the launcher menu 20230 are added as new content groups. In this case, the audio playback unit 174b / audio output unit 176 plays / outputs the audio of the content group of the broadcast program that was in the selected state. The content group that was in the semi - selected state in the launcher menu 20230 becomes an unselected content group when being displayed.
[0339] Note that after the information display device 1000 is powered on, the launcher menu 20230 may be displayed as the screen that the video display unit 173 displays as the initial screen. Also, after the launcher menu 20230 is displayed, according to the viewer's preference, the frequently selected content or applications may be pre - set to the selected state.
[0340] Note that as shown in FIG. 22D, the information display device 1000 may be configured to display only the content on the Internet without displaying the broadcast program.
[0341] In addition, not only the main window but also the sub-window may be selectable so that the related content group can be selected by selecting the sub-window.
[0342] [Operation Sequence of Information Display Device] Figs. 21A to 21D show the operation sequence diagrams of the information display device 1000 according to the sixth embodiment. Using Fig. 21A, a process of further adding a content group of another broadcast program in a state where only the content group of the broadcast program is displayed will be described.
[0343] First, after the power of the information display device 1000 is turned on, the main content in the selected state among the programs viewed when the previous power was interrupted is displayed in the main window. Here, when a different broadcast channel is selected by receiving an input from the channel button 20211 of the remote controller (described above, Fig. 22A), the displayed content group is switched to the content group corresponding to the selected broadcast channel. Note that when the information display device 1000 is powered on, only the window that is not displaying content is displayed, and then, when an input is received from the channel button 20211 of the remote controller, the video of the selected channel may be displayed in the window.
[0344] Hereinafter, it will be described on the premise that a program of the first broadcast signal (hereinafter, may be referred to as broadcast signal 1) is selected as the main content.
[0345] First, the information display device 1000 acquires a PMT data string (S20101).
[0346] Next, the information display device 1000 acquires an AIT data string (S20102).
[0347] Next, the information display device 1000 checks window-related designation information (window-related designation information is a general term for window-related designation information such as the above-described window shape designation information and window front-back relationship designation information) (S20103).
[0348] Next, the information display device 1000 displays a first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1 based on the window shape specification information and the window front-rear relationship specification information included in the window-related specification information (S20104).
[0349] After displaying the first main window 20000, the information display device 1000 starts a broadcast cooperation application according to an automatic startup or a startup instruction received from the viewer (S20107).
[0350] As a result, the broadcast cooperation application is executed, and an execution screen of the broadcast cooperation screen is displayed on a first sub-window 20001 (sub-window 1 in the figure) corresponding to the broadcast signal 1 (S20108).
[0351] Thereafter, the information display device 1000 receives an input for adding a new content group. Specifically, the content addition button 20213 receives the input. Thereafter, by receiving an input of a channel button 20211 corresponding to a second broadcast signal (hereinafter sometimes referred to as broadcast signal 2) to be added, a content group corresponding to the broadcast signal 2 is added. Also, the content group corresponding to the added broadcast signal 2 becomes the selected content group, and through the same processing (S20109~S20111, S20113~S20115) as when the broadcast signal 1 is selected, a second main window 20002 (main window 2 in the figure) corresponding to the broadcast signal 2 and a second sub-window 20003 (sub-window 2 in the figure) are displayed (S20112, S20116), and the audio is switched to the audio of the content group of the broadcast signal 2. After the second main window 20002 and the second sub-window 20003 are displayed, the first main window 20000 and the first sub-window 20001 remain displayed.
[0352] When either the first main window 20000 or the first sub-window 20001 receives an input (e.g., double-click) selected by the user, the content group in the selected state switches to the content group corresponding to the broadcast signal 1, and the audio switches to the audio of the content group of the broadcast signal 1.
[0353] Here, the number of tuners provided in the information display device 1000 is limited. When the number of tuners becomes insufficient due to the addition of a content group in the information display device 1000, the window of the content group selected last is closed. If the content group selected last is being streamed on the Internet, the information display device 1000 may switch to the streaming broadcast instead of closing the window.
[0354] Furthermore, when the tuner that has finished recording and is receiving the broadcast signal is released, the information display device 1000 may display the closed window again. Also, when the tuner that has finished recording and is receiving the broadcast signal is released, the information display device 1000 may restore the display switched to the streaming broadcast.
[0355] In addition, the information display device 1000 may receive an input from the viewer to select the window to be closed.
[0356] Next, the process of further adding the content group distributed via the Internet in a state where only the content group of the broadcast program is displayed will be mainly described with reference to FIG. 21B, which is different from FIG. 21A.
[0357] The information display device 1000 checks window-related designation information (window-related designation information is a general term for window-related designation information such as the above-described window shape designation information and window context designation information) (S20103).
[0358] Next, the information display device 1000 displays a first main window 20000 corresponding to the broadcast signal 1 based on the window shape specification information and the window front-back relationship specification information included in the window-related designation information (S20104).
[0359] After displaying the first main window 20000, the information display device 1000 starts a broadcast cooperation application by automatic startup or a startup instruction received from the viewer (S20107). Then, an execution screen of the broadcast cooperation screen is displayed on a first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0360] The information display device 1000 receives an input of information (e.g., URL or search keyword) for specifying the content to request distribution, and then requests distribution of the content specified from the received information (S20117).
[0361] Hereinafter, a process of receiving an input of information for specifying the content to request distribution using a remote controller (described above, FIG. 22A) will be described in detail with reference to FIGS. 22A, 22D, and 22E.
[0362] First, when the content addition button 20213 of the remote controller receives an input, and then the input switching button receives an input, a screen shown in FIG. 22D is displayed on the video display unit 173 of the information display device 1000.
[0363] An input switching menu 20220 is displayed on the screen shown in FIG. 22D. Also, each category of content (TV broadcast, recorder, external input 1, external input 2, Internet, etc.) is displayed in the input switching menu 20220. In the screen shown in FIG. 22D, "Internet" is temporarily selected as a category, and the frame of the temporarily selected "Internet" is displayed in bold lines.
[0364] Also, as shown in FIG. 22D, when the arrow button 20214 of the remote control receives an input while the input switching menu 20220 is being displayed, the temporarily selected category switches from "Internet" to another category. Also, along with the switching of the temporarily selected category, the thick line displayed in the frame of "Internet" disappears, and the frame of the category after switching is displayed with a thick line.
[0365] For example, when the arrow button 20214 with an upward arrow shown receives an input, the category that is temporarily selected switches to "External Input 2" located above the currently temporarily selected "Internet". After that, when the arrow button 20214 with a downward arrow shown receives an input, the category that is temporarily selected switches to "Internet" located below the currently temporarily selected "External Input 2".
[0366] When the enter button 20202 of the remote control receives an input, the temporarily selected category is determined as the category of the newly added content.
[0367] Here, when the enter button 20202 receives an input while "Internet" is temporarily selected, the screen shown in FIG. 22E is displayed on the video display unit 173 of the information display device 1000.
[0368] On the screen shown in FIG. 22E, a designation window 20221 for receiving an input for designating Internet content to be newly added is displayed. By entering a URL or a search keyword (Search in FIG. 22E) into the text box included in the designation window 20221, the content to be newly added is designated. On the screen shown in FIG. 22E, a URL is selected as the input target, and the frame of the text box into which the URL is entered is displayed with a thick line. When the arrow button 20214 of the remote control receives an input while the designation window 20221 is being displayed, the input target is switched from the URL to the search keyword. Also, along with the switching of the input target, the thick line displayed in the frame of the text box into which the URL is entered disappears, and the frame of the text box into which the search keyword is entered is displayed with a thick line.
[0369] The channel button 20211 of the remote control also functions as a character input button. When the channel button 20211 receives an input, characters are entered into the text box of the input target, whereby a URL or a search keyword is entered. For example, after a URL is entered into the text box and then the enter button 20202 receives an input, the information display device 1000 requests delivery of the content specified from the URL. Note that it may be configured such that the input is switched without first receiving an input to the content addition button 20213, and the content is switched when the enter button 20202 receives an input last, and the content is added when the content addition button 20213 receives an input.
[0370] Referring to FIG. 21B again. Next, the content requested for delivery in S20117 is delivered to the information display device 1000 (S20118).
[0371] Next, if the information display device 1000 has window-related designation information (a general term for window-related designation information such as the window shape designation information and window front-back relationship designation information described above), it checks this window-related designation information (S20119). Then, based on the window shape designation information and window front-back relationship designation information included in the checked window-related designation information, the information display device 1000 displays a third main window (main window 3 in the figure) corresponding to the broadcast signal 3 (S20120).
[0372] Also, when there is related content for the distributed content, the information display device 1000 requests the distribution of the related content (S20121). Then, the related content requested for distribution in S20121 is distributed to the information display device 1000 (S20122). Then, the information display device 1000 displays a third sub-window (sub-window 3 in the figure). Note that the information display device 1000 requests the distribution of related content using the launcher shown in the main window.
[0373] Here, when the third main window is displayed, the audio that has been played so far switches to the audio of the delivered content. Even after the audio switches, the displays of the first main window 20000 and the first sub-window 20001 remain. Therefore, a state is reached where the window (the first main window 20000 and the first sub-window 20001) in which the content group of the broadcast program is displayed and the window (the third main window and the third sub-window) in which the content group on the Internet is displayed are shown. In this state, when either the first main window 20000 or the first sub-window 20001 is double-clicked, the selected content group switches from the delivered content to the content group of the broadcast program. And the played audio switches from the audio of the delivered content to the audio of the broadcast program. After that, when the third main window or the third sub-window is double-clicked, the selected content group switches from the content group of the broadcast program to the corresponding content group of the delivered content. And the played audio switches from the audio of the broadcast program to the audio of the delivered content.
[0374] Note that in the example described above, after the content on the Internet is delivered, the audio is switched from the audio of the broadcast program to the audio of the delivered content. However, among the delivered content, there are also those that do not require audio. When the delivered content does not require audio, instead of switching the audio from the previously selected content group, the delivered content may be displayed without audio. In this case, for example, as shown in Fig. 22F, after the content is delivered, a button 20222 for receiving an input to select whether to switch the audio to the delivered content may be displayed. Further, when the button 20222 receives an input to select not to switch the audio, the delivered content may be set as the non-selected content group, and the content group for which the audio continues to be played may be left as the selected content group.
[0375] Next, with only the content group of the broadcast program being displayed, the differences from FIG. 21A in the process of further adding the content group of the recorded program will be mainly described with reference to FIGS. 21C and 22D.
[0376] The information display device 1000 checks window-related designation information (the window-related designation information is a general term for window-related designation information such as the above-described window shape designation information and window front-back relationship designation information) (S20103).
[0377] Next, based on the window shape designation information and window front-back relationship designation information included in the window-related designation information, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 (S20104).
[0378] After displaying the first main window 20000, the information display device 1000 starts the broadcast cooperation application by automatic startup or a startup instruction received from the viewer (S20107). Then, an execution screen of the broadcast cooperation screen is displayed on the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).
[0379] With the first main window 20000 and the first sub-window being displayed, the information display device 1000 requests playback of the recorded content (S20124).
[0380] Next, the information display device 1000 receives a playback signal (content playback in the figure) of the recorded content requested for playback in S20124 (S20125).
[0381] Next, if there is window-related designation information (a general term for window-related designation information such as the above-described window shape designation information and window front-back relationship designation information), the information display device 1000 checks this window-related designation information (S20126).
[0382] Next, the information display device 1000 displays the fourth main window (main window 4 in the figure) based on the window shape specification information and the window front-back relationship specification information included in the confirmed window-related specification information (S20127).
[0383] Next, if there is related content for the distributed content, the information display device 1000 requests playback of the related content (S20128). Hereinafter, the process of accepting input of information for requesting playback of recorded content using the remote controller (described above, Fig. 22A) will be described in detail with reference to Fig. 22D and Fig. 22G.
[0384] First, when the content addition button 20213 of the remote controller accepts an input and then the input switching button accepts an input, the screen shown in Fig. 22D is displayed on the video display unit 173 of the information display device 1000.
[0385] Here, when the decision button 20202 accepts an input in a state where "recorder" is temporarily selected, the screen shown in Fig. 22G is displayed on the video display unit 173 of the information display device 1000.
[0386] On the screen shown in Fig. 22G, a recorded content list 20223 for accepting an input to select a recorded content to be newly added (playback requested) is displayed. In the recorded content list 20223, the names of the recorded contents are displayed in a list. In Fig. 22G, "football 1" is temporarily selected as the recorded content for which playback is requested in the recorded content list 20223. In this state, when the decision button 20202 accepts an input, the information display device 1000 requests playback for the temporarily selected recorded content, whereby "football 1" is added as a new content group. Note that it is also possible to perform content switching by entering the input switching operation without first accepting an input from the content addition button 20213 and finally accepting an input from the decision button 20202, and to add content by accepting an input from the content addition button 20213.
[0387] Referring to FIG. 21C again, the related content (related content playback in the figure) requested for playback at S20128 is distributed to the information display device 1000 (S20129). Then, the information display device 1000 displays the fourth sub-window (sub-window 4 in the figure).
[0388] Here, when the fourth main window is displayed, the audio that has been played so far is switched to the audio of the recorded content. Even after the audio is switched, the displays of the first main window 20000 and the first sub-window 20001 remain. Therefore, the windows (the first main window 20000 and the first sub-window 20001) in which the content group of the broadcast program is displayed and the windows (the fourth main window and the fourth sub-window) corresponding to the recorded content are displayed. In this state, when either the first main window 20000 or the first sub-window 20001 is double-clicked, the selected content group is switched from the recorded content to the content group of the broadcast program. And the audio to be played is switched from the audio of the recorded content to the audio of the broadcast program. Then, when the fourth main window or the fourth sub-window is double-clicked, the selected content group is switched from the broadcast program to the content group of the recorded content. And the audio to be played is switched from the audio of the broadcast program to the audio of the recorded content.
[0389] Note that the playback device for the recorded content may be built into the information display device or external. Furthermore, the related content of the recorded content may be content on the Internet. Also, the control of this embodiment is applicable even when the broadcast program is not received, as shown in FIG. 21D.
Example
[0390] The difference between Example 7 and Example 6 is that after the selection of the temporarily selected content makes a full circle, a window frame for receiving an input for specifying new content is displayed. Below, the differences between Example 6 and Example 7 will be mainly described, and the common points will be omitted from the description as much as possible.
[0391] When the content addition button 20213 or the content switching button 20201 of the remote controller (described above, Fig. 22A) receives an input, the selection of the temporarily selected content makes a full circle, and then, when the content addition button 20213 or the content switching button 20201 further receives an input, the video display unit 173 displays a window frame 20301 for receiving an input for specifying content.
[0392] In the window frame 20301 shown in Fig. 23A, a content display area 20302, a content specification frame 20303 for specifying the content displayed in the content display area 20302, function buttons 20304, a window minimization button 20305, a window maximization button 20306, and a window close button 20307 are displayed.
[0393] In the content display area 20302, no content is displayed as an initial state. Thereafter, when content is specified in the content specification frame 20303, the specified content is displayed in the content display area 20302. Specifically, when a URL is input into the content specification frame 20303, the content displayed in the content display area 20302 is specified. Note that if the content to be specified is a broadcast program, the content specification frame 20303 receives an input of a channel. Also, if the content to be specified is content stored in a built-in device, the content specification frame 20303 receives an input of a device name. Further, if the content to be specified is content input from an input port, the content specification frame 20303 receives an input of a port name.
[0394] Note that in the content display area 20302, content that is frequently selected may be displayed as the initial state according to the preferences of the viewer. Also, content that has not been temporarily selected may be displayed. Further, in the case of a broadcast program, after the content addition button 20213 of the remote control receives an input, when the channel button 20211 receives an input, the video of the selected channel may be displayed in the window.
[0395] When the content addition button 20213 or the content switching button 20201 receives an input without the content being specified in the content designation frame 20303, the video display unit 173 switches the display from the window frame 20301 to the screen for selecting content. Also, when the content end button 20216 of the remote control receives an input while the content is specified, the video display unit 173 switches the display from the window frame 20301 to the screen for selecting content. In that case, the content specified in the window frame 20301 is not displayed on the screen for selecting content.
[0396] Functions such as starting the broadcast-linked application and calling related content are assigned to the function button 20304. When the function button 20304 to which the functions of starting the broadcast-linked application and calling related content are assigned receives an input, a new window frame 20301 appears. And sub-content is displayed in the newly appeared window frame 20301.
[0397] When the window close button 20307 receives an input, the main window and the sub-window corresponding to the main window are closed. Note that whether to close all related sub-windows when closing the main window may be settable for each content.
[0398] In addition, when the window frame launch icon 20308 shown in FIG. 23B receives an input to click (a touch operation in the case of the touch pad 25106) by a pointing device, the window frame 20301 may be displayed.
[0399] Further, the window frame 20301 may be supplied by a broadcast wave as a broadcast cooperation application. Further, it may be supplied from a server on the Internet. Further, a window frame pre-stored in the information display device 1000 may be used. Further, a plurality of window frames 20301 may be included in a broadcast signal (for example, AIT) as window frame selection information. Further, in the case of recorded content or content on the Internet, the window frame selection information may be recorded / distributed as information related to the content. As a result, the viewer can select a window frame. Further, the window frame selection information may be included in the window related designation information. Further, since it is desirable to adjust the design of the window frame according to the size and the number of pixels of the information display device 1000, the window frame information may be a plurality of designation information according to the size and the number of pixels of the information display device 1000.
Example
[0400] The difference between Example 8 and Example 6 is that the sub-window of the program that becomes non-selected when switching the content group selection is made non-display. As a result, when a plurality of content groups are displayed simultaneously, the display becomes easier to see and the convenience can be improved. Hereinafter, the differences between Example 8 and Example 6 will be mainly described, and the common points will be omitted as much as possible.
[0401] In Example 8, the video display unit 173 makes at least a part of the information (for example, the sub-window) of the content group non-displayed when the content group is switched from the selected state to the non-selected state. Further, the information of the content that has been made non-displayed when the content group is switched from the non-selected state to the selected state is re-displayed.
[0402] Next, with reference to FIG. 24, the process of switching the content group (i.e., the broadcast program) will be described in a state where only the content group of the broadcast program is displayed. Originally, the display control flow of the information display device 1000 in FIG. 24 should be described on a single line, but it is described on two lines in order to distinguish the display control flow of the window group related to the broadcast program 1 and the display control flow of the window group related to the broadcast program 2.
[0403] First, the information display device 1000 receives an input for selecting the program of the broadcast signal 1 (S20401).
[0404] Next, the information display device 1000 checks the window-related designation information included in the broadcast signal 1 (S20402).
[0405] Next, based on the window shape designation information and the window front-back relationship designation information included in the window-related designation information, the information display device 1000 displays the first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1 (S20403).
[0406] Next, the information display device 1000 starts the broadcast cooperation application by automatic start or a start instruction received from the viewer (S20404).
[0407] Next, the information display device 1000 displays the execution screen of the broadcast cooperation screen on the first sub-window 20001 (sub-window 1 in the figure) corresponding to the broadcast signal 1 (S20405).
[0408] Next, the information display device 1000 receives an input for selecting the program of the broadcast signal 2 (S20406).
[0409] Next, the information display device 1000 stores the information necessary to display the first sub-window 20001 in the storage device (S20407). Thereby, the information display device 1000 saves the information necessary to display the first sub-window 20001 in the storage device.
[0410] Next, the information display device 1000 closes the first sub-window 20001 (S20408). That is, the information display device 1000 erases the displayed first sub-window 20001.
[0411] Next, the information display device 1000 checks the window-related designation information included in the broadcast signal 2 (S20409).
[0412] Next, based on the window shape designation information and the window front-back relationship designation information included in the window-related designation information, the information display device 1000 displays the second main window 20002 (main window 2 in the figure) corresponding to the broadcast signal 2 (S20410).
[0413] Next, the information display device 1000 starts the broadcast cooperation application by automatic startup or a startup instruction received from the viewer (S20411).
[0414] Next, the information display device 1000 displays the execution screen of the broadcast cooperation screen on the second sub-window 20003 (sub-window 2 in the figure) corresponding to the broadcast signal 2 (S20412).
[0415] Next, the information display device 1000 receives an input for reselecting the program of the broadcast signal 1 (S20413).
[0416] Next, the information display device 1000 stores the information necessary to display the second sub-window 20003 in the storage device (S20414). Thereby, the information display device 1000 saves the information necessary to display the second sub-window 20003 in the storage device.
[0417] Next, the information display device 1000 closes the second sub-window 20003 (S20415). That is, the information display device 1000 erases the displayed second sub-window 20003.
[0418] Next, the information display device 1000 acquires the information necessary to display the first sub-window 20001 stored in S20407 (S20416). That is, the information display device 1000 restores the information saved in S20407.
[0419] Next, based on the information acquired in S20416, the information display device 1000 redisplay the execution screen of the broadcast cooperation screen on the first sub-window 20001 corresponding to the broadcast signal 1 (S20417).
[0420] Note that after deleting the sub-window of the unselected program, if the unselected content group is selected again, the deleted sub-window may be automatically redisplayed.
[0421] Also, information indicating whether to hide the sub-window when it is not selected may be included in the broadcast signal (for example, AIT) or the accompanying information of the content on the Internet or the recorded content as window-related designation information.
[0422] Also, information indicating whether to redisplay the hidden sub-window when the content group is reselected may be included in the broadcast signal (for example, AIT) or the accompanying information of the content on the Internet or the recorded content as window-related designation information.
[0423] Also, an input for specifying whether to hide the sub-window when it is not selected may be accepted from the viewer. In this case, the information display device 1000 may store the viewer's preference and perform processing according to it.
[0424] Also, when the sub-window is to be redisplayed when the content group is reselected, the information related to the sub-window may be stored as cache data in the information display device 1000.
Example
[0425] The difference between Example 9 and Example 6 is that it prohibits the automatic startup of the broadcast cooperation apps for the non-selected content group. Below, the differences between Example 9 and Example 7 will be mainly described, and the common points will be omitted as much as possible.
[0426] Some of the broadcast cooperation apps are set to start automatically. Here, if all the broadcast cooperation apps start automatically, there is a problem that the number of sub-windows increases and the screen display becomes messy.
[0427] In Example 9, it prohibits the automatic startup of the broadcast cooperation apps for the non-selected content group. That is, only the broadcast cooperation apps for the selected content group are automatically started. By this, it becomes possible to reduce the number of sub-windows displayed at one time, and the visibility of the screen is improved.
[0428] Note that the broadcast cooperation apps for the non-selected content group may be set to a standby state for startup. In this case, when the content group is selected, the broadcast cooperation apps in the standby state for startup will start.
[0429] Also, whether to prohibit automatic startup or set to a standby state for startup when not selected may be included in the broadcast signal (for example, AIT) or the accompanying information of the content on the Internet or the recorded content as window-related specified information.
[0430] Also, an input for specifying whether to prohibit automatic startup or set to a standby state for startup when not selected may be received from the viewer. In this case, the information display device 1000 may store the viewer's preference and perform processing according to it.
Example
[0431] The difference between Example 10 and Example 6 is that windows are displayed on the video display unit 173 of the information display device 1000 and on the portable information terminal 25110 connected to the information display device 1000 by wire or wirelessly. Below, the differences between Example 10 and Example 7 will be mainly described, and the description of the common points will be omitted as much as possible.
[0432] In Example 10, the video display unit 173 of the information display device 1000 displays the main window, and the portable information terminal 25110 connected to the information display device 1000 by wire or wirelessly displays the sub-window. As a result, when simultaneously displaying and viewing a plurality of content groups, the portable information terminal 25110 can be effectively utilized, and the convenience can be enhanced.
[0433] Note that the main content and sub-content included in the content group that has become non-selected in the information display device 1000 may be displayed on the portable information terminal 25110.
[0434] Also, the video display unit 173 of the information display device 1000 may display a plurality of content groups, and the audio of the content groups may be output from the earphone of the portable information terminal 25110. Also, the earphone of the portable information terminal 25110 outputs the audio of any one of the content groups displayed on the video display unit 173 of the information display device 1000. As a result, when there are a plurality of viewers and the opinions on the content groups they want to view are not unified, each can play and listen to the audio of the content group they want to view on the portable information terminal 25110, enabling simultaneous viewing of the content groups by a plurality of viewers.
[0435] Note that the audio playback unit 174b / audio output unit 176 of the information display device 1000 may not play / output audio.
[0436] Also, an input for designating the sub-content to be displayed on the portable information terminal 25110 may be received from the viewer.
[0437] As described above, the invention made according to the present invention has been specifically described based on the embodiments. However, it goes without saying that the present invention is not limited to the above embodiments, and various modifications can be made without departing from the gist thereof.
[0438] For example, part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can also be added to the configuration of one embodiment. All of these belong to the scope of the present invention. Also, the numerical values, messages, etc. appearing in the text and drawings are merely examples, and using different ones will not impair the effects of the present invention.
[0439] The functions, etc. of the present invention described above may be realized in hardware by designing part or all of them, for example, with an integrated circuit. Also, they may be realized in software by a microprocessor unit or the like interpreting and executing an operation program that realizes each function, etc. Hardware and software may be used in combination.
[0440] Note that the software for controlling the broadcast receiving apparatus 100 may be stored in advance in the ROM 103 and / or the storage unit 110, etc. of the broadcast receiving apparatus 100 at the time of product shipment. It may be acquired from other application servers 500, etc. on the Internet 200 via the LAN communication unit 121 after product shipment. Also, the software stored in a memory card, an optical disk, etc. may be acquired via the expansion interface unit 124, etc. Similarly, the software for controlling the portable information terminal 700 may be stored in advance in the ROM 703 and / or the storage unit 710, etc. of the portable information terminal 700 at the time of product shipment. It may be acquired from other application servers 500, etc. on the Internet 200 via the LAN communication unit 721 or the mobile phone network communication unit 722, etc. after product shipment. Also, the software stored in a memory card, an optical disk, etc. may be acquired via the expansion interface unit 724, etc.
[0441] In addition, the present invention is applicable to devices that do not receive broadcast programs as long as they are devices for displaying a content group. That is, the information display device 1000 includes all devices in various forms, in addition to personal computers, tablet terminals, and smartphones.
[0442] In addition, the control lines and information lines shown in the drawings indicate those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In fact, it may be considered that almost all components are interconnected.
Explanation of Signs
[0443] 100: Broadcast receiving device, 100a: Antenna, 101: Main control unit, 102: System bus, 103: ROM, 104: RAM, 110: Storage unit, 121: LAN communication unit, 124: Expansion interface unit, 125: Digital interface unit, 131: Tuner / demodulation unit, 132: First separation unit, 133: First video decoding unit, 134: First audio decoding unit, 135: First subtitle decoding unit, 141: Data broadcast reception processing unit, 142: Data broadcast engine, 151: Streaming reception processing unit, 152: Second separation unit, 153: Second video decoding unit, 154: Second audio decoding unit, 155: Second subtitle decoding unit, 161: Application control unit, 162: Application engine, 171: Video superimposing unit, 172: Audio selection unit, 173: Video display unit, 174: Speaker, 174b: Audio playback unit, 175: Video output unit, 176: Audio output unit, 181: Presentation synchronization control unit, 191: Terminal cooperation control unit 200: Internet, 210: Router device 300t: Radio tower, 300: Broadcast station server, 301: Main control unit, 302: System bus, 304: RAM, 310: Storage unit, 321: LAN communication unit 400: Service provider server, 401: Main control unit, 402: System bus, 404: RAM, 410: Storage unit, 421: LAN communication unit 500: Other application servers, 600: Mobile phone communication server, 600b: Base station 700: Mobile information terminal, 701: Main control unit, 702: System bus, 703: ROM, 704: RAM, 710: Storage unit, 720: Communication processing unit, 721: LAN communication unit, 722: Mobile phone network communication unit, 723: NFC communication unit, 724: Expansion interface unit, 730: Operation unit, 740: Image processing unit, 741: Display unit, 742: Image signal processing unit, 743: First image input unit, 744: Second image input unit, 750: Audio processing unit, 751: Audio output unit, 752: Audio signal processing unit, 753: Audio input unit, 760: Sensor unit, 761: GPS receiver, 762: Gyro sensor, 763: Geomagnetic sensor, 764: Acceleration sensor, 765: Illuminance sensor, 766: Proximity sensor, 1000: Information display device, 20000: First main window, 20001: First sub-window, 20002: Second main window, 20003: Second sub-window, 20301: Window frame, 25001: Viewer instruction input unit, 25002: Content input unit, 25003: Content playback unit, 25004: Content recording and playback unit, 25005: Control unit, 25102: Remote control, 25104: Mouse, 25106: Touch pad, 25108: Keyboard, 25110: Mobile information terminal, 25111: Touch panel.
Claims
【Claim 1】 In an application startup method for starting an application for accessing broadcast resources in a broadcast receiving device, the application for accessing the broadcast resources includes a broadcast managed application activated by application control information included in a broadcast signal and a non-broadcast managed application activated by information other than the application control information included in the broadcast signal, a receiving step of receiving a broadcast signal, a startup priority confirmation step of confirming the startup priority of the broadcast managed application for data broadcast based on PMT (Program Map Table) information included in the received broadcast signal, a first application startup step of starting the broadcast managed application based on the application control information included in the received broadcast signal, a launcher screen display step of displaying a launcher screen on the broadcast receiving device by an application launcher provided in the broadcast receiving device, a second application startup step of starting the non-broadcast managed application based on a user operation via the displayed launcher screen, a communication step of communicating with an external mobile terminal, a third application startup step of starting the non-broadcast managed application based on a startup request by a user operation via the external mobile terminal received in the communication step, a data broadcast screen display step of setting the broadcast receiving device to a data broadcast screen display state based on BML information included in the received broadcast signal, a fourth application startup step of starting the broadcast managed application based on a user operation in the data broadcast screen display state, comprising the first application startup step is to check whether the broadcast managed application is executable when the application control information includes information indicating automatic startup of the broadcast managed application, and if it is executable, obtain and start the broadcast managed application, in the data broadcast screen display step, when it is confirmed that the broadcast receiving device is capable of executing the broadcast managed application, control is performed to display an entry button for starting the broadcast managed application. In the fourth application startup step, the broadcast managed application is started based on a user operation on the entry button displayed in the data broadcast screen display state. Application startup method.
Citation Information
Patent Citations
Broadcasting system for data broadcast in tv broadcast
JP2001186486A
Terminal cooperation system and receiver
JP2012243062A
Information processing terminal, application-cooperative content management server and location resolution server
JP2012244286A
Data broadcasting display control device and data broadcasting presence / absence display control method
JP2012256997A
receiver
JP2012257221A