How to start an application
By implementing the application startup method in a digital broadcast receiver, the problem of difficulty in realizing high-resolution screen display and high-function effects in the prior art is solved, and richer functions and high value-added effects are achieved.
Patent Information
- Application Number
- JP2024020296
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-02-14
- Publication Date
- 2025-05-14
- Estimated Expiration
- 2034-03-28
AI Technical Summary
Existing digital broadcast receivers are difficult to achieve high-resolution screen display and high-function effects, resulting in the inability to effectively perform high-value-added functions.
The application startup method is realized in the broadcast receiving device, including receiving a broadcast signal, analyzing application control information, launching a broadcast management application and an external broadcast management application, displaying a startup screen, and launching the application through user operations.
It realizes richer functions, improves the added value of digital broadcast receivers, and can make more efficient use of limited broadcast band resources.
Smart Images

Figure 0007676609000001 
Figure 0007676609000002 
Figure 0007676609000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an application launch method. [Background technology]
[0002] One of the expanded functions of the digital broadcasting service is data broadcasting, which transmits digital data via broadcast waves and displays various information such as weather forecasts, news, recommended programs, etc. Many television receivers capable of receiving data broadcasting are already commercially available, and many technologies related to receiving data broadcasting have been published, including Patent Document 1 below. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2001-186486 A Summary of the Invention [Problem to be solved by the invention]
[0004] A feature of data broadcasting is that television receivers that support digital broadcasting services can receive data broadcasting on their own and can obtain / display a variety of information. However, because the amount of data that can be transmitted with data broadcasting is limited due to restrictions on radio wave bands, it is difficult to achieve high-definition screen displays and sophisticated effects, and this has led to the issue that it is difficult to implement useful functions with high added value on current digital broadcasting receivers.
[0005] An object of the present invention is to realize an application startup method capable of executing functions with higher added value. [Means for solving the problem]
[0006] As a means for solving the above problems, the technology described in the claims is used.
[0007] As an example, in an application startup method for starting an application for accessing a broadcast resource in a broadcast receiving device, the application for accessing the broadcast resource includes a broadcast managed application started by application control information included in a broadcast signal, and a non-broadcast managed application started by a method other than the application control information included in the broadcast signal, and the method includes a receiving step of receiving the broadcast signal, a first application startup step of starting the broadcast managed application based on the application control information included in the received broadcast signal, a launcher screen display step of displaying on the broadcast receiving device a launcher screen by an application launcher provided in the broadcast receiving device, and a broadcast managed application started by a user operation via the displayed launcher screen. The method includes a second application startup step of starting an external managed application, an authentication step of authenticating an external portable terminal on which a cooperative control application for operating in cooperation with the broadcast receiving device is installed, a communication step of communicating with the external portable terminal authenticated in the authentication step, and a third application startup step of starting the external managed application based on a startup request received in the communication step by a user operation via the external portable terminal, wherein the first application startup step uses an application startup method which, when the application control information includes information indicating automatic startup of the broadcast managed application, checks whether the broadcast managed application is executable, and, if executable, acquires and starts the broadcast managed application. Effect of the Invention
[0008] By using the technique of the present invention, it is possible to realize an application launching method capable of executing functions with higher added value. [Brief description of the drawings]
[0009] [Figure 1]FIG. 1 is a system configuration diagram of a communication system according to a first embodiment. [Figure 2A] FIG. 1 is a block diagram of a broadcast receiving device according to a first embodiment. [Figure 2B] FIG. 2 is a software configuration diagram of the broadcast receiving device according to the first embodiment. [Diagram 3] FIG. 2 is a block diagram of a broadcast station server according to the first embodiment. [Figure 4] FIG. 2 is a block diagram of a service provider server according to the first embodiment. [Figure 5A] FIG. 2 is a block diagram of a portable information terminal according to the first embodiment. [Figure 5B] FIG. 2 is a software configuration diagram of the portable information terminal according to the first embodiment. [Figure 6] FIG. 4 is a data configuration diagram of application control information according to the first embodiment. [Figure 7A] FIG. 4 is an operational sequence diagram of the broadcast receiving device according to the first embodiment when an application is started. [Figure 7B] FIG. 4 is an operational sequence diagram of the broadcast receiving device according to the first embodiment when an application is started. [Figure 7C] FIG. 4 is an operational sequence diagram of the broadcast receiving device according to the first embodiment when an application is started. [Figure 8A] FIG. 4 is an operation sequence diagram when the mobile information terminal according to the first embodiment cooperates with another mobile information terminal; [Figure 8B] FIG. 4 is an operation sequence diagram when the mobile information terminal according to the first embodiment cooperates with another mobile information terminal; [Figure 8C] FIG. 4 is an operation sequence diagram when the mobile information terminal according to the first embodiment cooperates with another mobile information terminal; [Figure 9] 4 is an operational sequence diagram when an application is started in the broadcast receiving device and the portable information terminal according to the first embodiment. [Figure 10A] FIG. 4 is a screen display diagram of a basic screen of a cooperative control application of the portable information terminal according to the first embodiment. [Figure 10B] FIG. 4 is a screen display diagram of a basic screen of a cooperative control application of the portable information terminal according to the first embodiment. [Figure 11] FIG. 2 is a screen display diagram of a data broadcast screen of the broadcast receiving device according to the first embodiment. [Figure 12A] FIG. 4 is a screen display diagram of a notification screen of the broadcast receiving device according to the first embodiment. [Figure 12B] 4 is a screen display diagram of a broadcast cooperative application launcher of the broadcast receiving device according to the first embodiment. FIG. [Figure 13A] FIG. 4 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the first embodiment. [Figure 13B] FIG. 4 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the first embodiment. [Figure 13C] FIG. 4 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the first embodiment. [Figure 13D] FIG. 4 is a screen display diagram of a broadcast cooperative application execution screen of the broadcast receiving device according to the first embodiment. [Figure 14] FIG. 4 is a screen display diagram of an error display screen of the broadcast receiving device according to the first embodiment. [Figure 15] FIG. 4 is a screen display diagram of a broadcast cooperative application execution screen of the portable information terminal according to the first embodiment. [Figure 16A] FIG. 2 is a screen display diagram of an EPG display screen of the broadcast receiving device according to the first embodiment. [Figure 16B] FIG. 4 is a diagram showing detailed information on an EPG display screen of the broadcast receiving device according to the first embodiment. [Figure 17] 4 is an operational sequence diagram of the broadcast receiving device according to the first embodiment when acquiring a broadcast cooperative application. FIG. [Figure 18A] FIG. 11 is an operational sequence diagram when terminals cooperate with each other according to the second embodiment. [Figure 18B] FIG. 11 is an operational sequence diagram when terminals cooperate with each other according to the third embodiment. [Figure 18C] FIG. 13 is an operational sequence diagram when terminals cooperate with each other according to the fourth embodiment. [Figure 18D] FIG. 13 is an operational sequence diagram when terminals cooperate with each other according to the fourth embodiment. [Figure 19A] FIG. 13 is a screen display diagram of a broadcast cooperative application launcher of a broadcast receiving device according to a fifth embodiment. [Figure 19B] FIG. 13 is a screen display diagram of a broadcast cooperative application launcher of a broadcast receiving device according to a fifth embodiment. [Figure 19C] FIG. 13 is a screen display diagram of a broadcast cooperative application launcher of a broadcast receiving device according to a fifth embodiment. [Figure 19D] FIG. 13 is a screen display diagram of a broadcast cooperative application launcher of a broadcast receiving device according to a fifth embodiment. [Figure 19E] FIG. 13 is a screen display diagram of a broadcast receiving device according to a fifth embodiment. [Figure 19F] FIG. 13 is a screen display diagram of a broadcast cooperative application launcher of a portable information terminal according to a fifth embodiment. [Figure 20] A diagram showing the concept of transition between HTML documents and broadcast-linked apps. [Figure 21] FIG. 11 is a diagram showing an example of an HTML document of a broadcast cooperative application. [Figure 22] 13 is a diagram showing an example of an HTML document of a broadcast cooperative application in which a command for presenting a broadcast program screen is not described. [Diagram 23] FIG. 23 is a diagram showing an application execution video of an HTML document 20201 according to the sixth embodiment. [Figure 24] FIG. 13 is an operation sequence diagram of a broadcast receiving device according to a sixth embodiment. [Diagram 25] FIG. 23 is a diagram showing a display example of a necessity confirmation display unit according to the sixth embodiment. [Figure 26] FIG. 23 is a diagram showing a display example of a broadcast program screen according to the sixth embodiment. [Figure 27] FIG. 23 is a diagram showing a display example of another broadcast program screen according to the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. EXAMPLES
[0011] First, an example of a digital broadcasting service that can be received by the broadcasting receiving device of this embodiment will be described.
[0012] For example, in one example of BS / terrestrial digital broadcasting that can be received by the broadcast receiving device of this embodiment, a plurality of transport streams (TS) can be multiplexed and transmitted on one transponder (frequency channel). A TS is a series of TS packets of a predetermined length, which are obtained by dividing a data sequence such as a video / audio elementary stream (ES) or program specific information (PSI) / service information (SI) and the like, and adding a TS header.
[0013] PSI is a unique information table defined in the MPEG (Moving Picture Experts Group)-2 system standard that identifies which program each ES included in a TS belongs to. PSI is composed of a PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), etc. The PAT defines the list of programs included in a TS by the PID (Packet Identifier) of the PMT. The PMT defines the PIDs of the components of each program, etc. The CAT includes information related to conditional access.
[0014] Moreover, SI is an extension of PSI to include program information, etc., and includes information on the Electronic Program Guide (EPG) defined by the Association of Radio Industries and Businesses (ARIB) in ARIB STD-B10. SI is composed of BIT (Broadcaster Information Table), SDT (Service Description Table), EIT (Event Information Table), TOT (Time Offset Table), etc. BIT includes broadcast station identification information, series information, SI transmission information of broadcast stations, etc. SDT includes information such as a network ID for identifying a network, a TS ID for identifying a TS, and a service ID (so-called channel number) for identifying individual services (so-called channels) within the network. EIT includes a service ID for identifying individual services within the network, and information on events such as the name, broadcast date and time, and broadcast contents of each event (so-called program). TOT includes information on the current date and time.
[0015] The TS also includes PCR (Program Clock Reference) information that serves as a reference for playback timing in a decoder, and a subset of Broadcast Markup Language (BML) documents based on the BML specifications defined in ARIB STD-B24.
[0016] In the broadcast receiving device of this embodiment, by receiving and decoding a TS composed of the video / audio ES and various information, it is possible to provide the user with broadcast programs, EPGs, data broadcast screens produced using BML, etc.
[0017] The broadcast receiving device of the present embodiment is compatible with a broadcasting and communication cooperation system that combines a digital broadcasting service with a function using a broadband network, acquisition of additional content via a broadband network, computation processing in a server device, presentation processing in cooperation with a mobile terminal device, and the like, with the digital broadcasting service. In order to realize the broadcasting and communication cooperation system, the broadcast receiving device of the present embodiment is capable of executing applications written in HTML (Hyper Text Markup Language) or the like. In addition, the broadcasting and communication cooperation system compatible with the present broadcasting receiving device uses an extended BML specification, application control information (Application Information Table: AIT) in the broadcasting and communication cooperation system, and extended PSI / SI information required when transmitting an application by broadcast waves. The AIT is information for providing or disseminating various information required to start an application, such as the acquisition destination of the application, and control information for controlling the start / end of the application.
[0018] The above explanation is based on the digital broadcasting service in Japan, but the application of the broadcast receiving device of this embodiment, including the broadcast and communication cooperation system, is not limited to Japan.
[0019] Next, a specific configuration example of the embodiment of this embodiment will be described.
[0020] [System Configuration] 1 is a system configuration diagram showing an example of a communication system of this embodiment that realizes a broadcast communication cooperation system. The communication system of this embodiment is composed of a broadcast receiving device 100, an antenna 100a, a broadband network 200 such as the Internet and a router device 210, a radio tower 300t of a broadcast station, a broadcast station server 300, a service provider server 400, other application servers 500, a mobile telephone communication server 600, a base station 600b of a mobile telephone communication network, and a mobile information terminal 700.
[0021] The broadcast receiving device 100 is a television receiver having a function corresponding to the broadcast communication cooperation system in addition to an existing digital broadcast receiving function. The broadcast receiving device 100 receives broadcast waves transmitted from a radio wave tower 300t via an antenna 100a. The broadcast receiving device 100 can also connect to the Internet 200 via a router device 210, and can transmit and receive data by communicating with each server device on the Internet 200.
[0022] Router device 210 is connected to Internet 200 by wireless or wired communication, and is also connected to broadcast receiving device 100 by wireless or wired communication, and to mobile information terminal 700 by wireless communication. This allows each server device on Internet 200, broadcast receiving device 100, and mobile information terminal 700 to transmit and receive data to and from each other via router device 210. Note that communication between broadcast receiving device 100 and mobile information terminal 700 may be performed directly using a method such as BlueTooth (registered trademark) or NFC (Near Field Communication) without going through router device 210.
[0023] The radio tower 300t transmits broadcast waves including digital broadcast signals, AIT, control information related to application presentation, and the like from the broadcasting equipment of the broadcasting station. The control information related to application presentation is control information related to the superimposition of a broadcast program and an application on a television receiver and whether or not an application can be presented. The broadcasting station is also assumed to have a broadcasting station server 300. The broadcasting station server 300 is assumed to store broadcast programs (video content, etc.) and metadata of each broadcast program, such as the program title, program ID, program summary, cast, broadcast date and time, and to provide the video content and each metadata to a service provider based on a contract. The video content and each metadata may be provided to the service provider through an API (Application Programming Interface) provided in the broadcasting station server 300.
[0024] The service provider server 400 is a server device prepared by a service provider to provide a service by the broadcasting and communication cooperation system. The service provider server 400 stores, manages, and distributes video content and metadata provided by the broadcasting station server 300, and content and applications created for the broadcasting and communication cooperation system. In addition, the service provider server 400 also has a function of searching for and providing a list of available applications in response to an inquiry from a television receiver. The storage, management, and distribution of the content and metadata and the storage, management, and distribution of the applications may be performed by different server devices. The broadcasting station and the service provider may be the same or different providers. A plurality of service provider servers 400 may be prepared for each different service. In addition, the broadcasting station server 300 may have the function of the service provider server 400.
[0025] The other application server 500 is a known server device that stores, manages, and distributes general applications, operating programs, contents, and data other than those related to the broadcasting and communication cooperation system.
[0026] The mobile telephone communication server 600 is connected to the Internet 200, and is also connected to the mobile information terminal 700 via a base station 600b. The mobile telephone communication server 600 manages telephone communication (calls) and data transmission / reception of the mobile information terminal 700 via the mobile telephone communication network, and enables data transmission / reception by communication between the mobile information terminal 700 and each server device on the Internet 200. Note that communication between the mobile information terminal 700 and the broadcast receiving device 100 may be performed via the base station 600b, the mobile telephone communication server 600, the Internet 200, and the router device 210.
[0027] [Hardware configuration of broadcast receiving device] 2A is a block diagram showing an example of the internal configuration of the broadcast receiving device 100. The broadcast receiving device 100 is composed of a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an extension interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first subtitle decoding unit 135, a data broadcast reception processing unit 141, a data broadcast engine 142, a streaming reception processing unit 151, a second separation unit 152, a second video decoding unit 153, a second audio decoding unit 154, a second subtitle decoding unit 155, an application control unit 161, an application engine 162, a video superimposition unit 171, an audio selection unit 172, a video display unit 173, a speaker 174, a video output unit 175, an audio output unit 176, a presentation synchronization control unit 181, and a terminal cooperation control unit 191.
[0028] The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 in accordance with a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block in the broadcast receiving device 100.
[0029] ROM (Read Only Memory) 103 is a memory in which basic operation programs such as an operating system and other operation programs are stored, and a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or a flash ROM is used. RAM (Random Access Memory) 104 serves as a work area when the basic operation programs and other operation programs are executed. ROM 103 and RAM 104 may be integrated with main control unit 101. ROM 103 may use a part of the storage area in storage unit 110 instead of being an independent configuration as shown in FIG. 2A.
[0030] The storage unit 110 stores the operation program and operation setting values of the broadcast receiving device 100, personal information of the user of the broadcast receiving device 100, etc. It can also store operation programs downloaded from a network and various data created by the operation programs. It can also store content such as moving images, still images, and audio acquired from broadcast waves or downloaded from a network. A part of the storage unit 110 may replace all or part of the functions of the ROM 103. The storage unit 110 needs to hold the stored information even when power is not supplied from the outside to the broadcast receiving device 100. Therefore, for example, devices such as flash ROM, semiconductor element memories such as SSD (Solid State Drive), and magnetic disk drives such as HDD (Hard Disk Drive) are used.
[0031] It is assumed that the operation programs stored in the ROM 103 and the storage unit 110 can be updated and their functions expanded by downloading from each server device on the Internet 200 .
[0032] The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 210, and transmits and receives data to and from each server device on the Internet 200. The connection to the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 includes an encoding circuit, a decoding circuit, and the like. The broadcast receiving device 100 may further include other communication units such as a BlueTooth (registered trademark) communication unit, an NFC communication unit, an infrared communication unit, and the like.
[0033] The tuner / demodulator 131 receives broadcast waves from a radio tower 300t via the antenna 100a, and tunes (selects) a channel of a service desired by the user under the control of the main controller 101. Furthermore, the tuner / demodulator 131 demodulates the received broadcast signal to acquire a TS. Note that, although the example shown in FIG. 2A illustrates a configuration with one tuner / demodulator, the broadcast receiving device 100 may be configured to include multiple tuner / demodulators for the purpose of simultaneous display of multiple screens, recording of a different program, etc. Also, under the control of the main controller 101, control of access restriction to the demodulated TS may be performed.
[0034] The first separation unit 132 inputs the TS output from the tuner / demodulation unit 131, separates it into each data string such as a video data string, an audio data string, a subtitle data string, a program information data string, an AIT data string, a BML data string, and outputs it. These data strings may be in ES format, for example. The first video decoding unit 133 decodes the video data string input from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data string input from the first separation unit 132 and outputs audio information. The first subtitle decoding unit 135 decodes the subtitle data string input from the first separation unit 132 and outputs subtitle information.
[0035] The data broadcasting reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces the BML document. The data broadcasting engine 142 is a BML browser that executes the BML document, and executes the BML document reproduced by the data broadcasting reception processing unit 141 to output data broadcasting screen information.
[0036] The streaming reception processing unit 151, under the control of the main control unit 101, accesses video content and the like stored in each server device on the Internet 200 via the LAN communication unit 121, and acquires a program stream (PS) of the video content and the like. In addition, under the control of the main control unit 101, the streaming reception processing unit 151 may control DRM (Digital Rights Management) processing for the acquired PS.
[0037] The second separation unit 152 receives the PS output from the streaming reception processing unit 151, separates it into each data stream such as a video data stream, an audio data stream, and a subtitle data stream, and outputs the separated data streams. These data streams may be in ES format, for example. The second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155 perform the same processes as the first video decoding unit 133, the first audio decoding unit 134, and the first subtitle decoding unit 135, respectively, and therefore their explanations are omitted.
[0038] In addition, the first separation unit 132 and the second separation unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, and the first subtitle decoding unit 135 and the second subtitle decoding unit 155 may each be used interchangeably.
[0039] The application control unit 161 controls and manages the life cycle and events of each application by influencing the application engine 162 with respect to the application created for the broadcasting and communication cooperation system based on the AIT data string input from the first separation unit or the AIT file acquired from each server device on the Internet 200. Also, depending on the state of the application and the instruction of the AIT, it appropriately controls the function constraints of the application. The application engine 162 is an HTML browser that acquires and executes the application created for the broadcasting and communication cooperation system based on the control of the application control unit 161.
[0040] The video superimposing unit 171 inputs the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcast screen information output from the data broadcasting engine 142, the video information output from the second video decoding unit 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162, and performs processing such as selection and / or superimposition. The video superimposing unit 171 includes a video RAM (not shown), and the video display unit 173 and the like are driven based on the video information input to the video RAM. Furthermore, the video superimposing unit 171 performs scaling processing, superimposition processing of EPG screen information created based on the program information data string output from the first separation unit 132, and the like, based on the control of the main control unit 101, as necessary.
[0041] The audio selection unit 172 inputs the audio information output from the first audio decoding unit 134, the audio information output from the second audio decoding unit 154, and the application execution audio information output from the application engine 162, and selects and outputs the audio information as appropriate in accordance with the control of the main control unit 101.
[0042] The video display unit 173 is a display device such as a liquid crystal panel, and provides the video information selected and / or superimposed by the video superimposition unit 171 to the user of the broadcast receiving device 100. The speaker 174 provides the audio information output from the audio selection unit 172 to the user of the broadcast receiving device 100. The video output unit 175 is a video output interface that outputs the video information selected and / or superimposed by the video superimposition unit 171. The audio output unit 176 is an audio output interface that outputs the audio information output from the audio selection unit 172. As described above, when the broadcast display device 100 is a television receiver or the like, the video output unit 175 and the audio output unit 176 are not essential components of the present invention.
[0043] The presentation synchronization control unit 181 controls the presentation synchronization on the video display unit 173 and the speaker 174, or on the video output unit 175 and the audio output unit 176, of the video information, audio information, etc. obtained by decoding the TS obtained from the broadcast waves, the video information, audio information, etc. obtained by decoding the PS obtained from each server device on the Internet 200, and the application execution screen information and application execution audio information output from the application engine 162, based on, for example, PCR information, etc.
[0044] When linking with an external mobile terminal device, the terminal link control unit 191 manages and controls discovery and authentication of the linked device (mobile terminal device), connection between the broadcast receiving device 100 and the linked device, application linkage, and the like.
[0045] The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100, and in this embodiment, is configured with an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, etc. The analog video / audio interface inputs analog video signals / audio signals from an external video / audio output device, outputs analog video signals / audio signals to an external video / audio input device, etc. The USB interface connects to a PC or the like to send and receive data. A HDD may be connected to record broadcast programs and content. A keyboard or other USB device may also be connected. The memory interface connects to a memory card or other memory medium to send and receive data.
[0046] The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface unit 125 is capable of outputting the TS acquired by the tuner / demodulator unit 131 and the PS acquired by the streaming reception processing unit 151 as is. The digital interface unit 125 may also control the TS and PS inputted from the digital interface unit 125 to be inputted to the first separation unit 132 and the second separation unit 152. The output of digital content stored in the storage unit 110 or the storage of digital content in the storage unit 110 may be performed via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal or an HDMI terminal, etc., and may output or input data in a format conforming to the DVI specification, the HDMI specification, etc. The output or input may be in the form of serial data conforming to the IEEE1394 specification, etc.
[0047] The broadcast receiving device 100 may be a television receiver, an optical disk drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disk drive recorder such as a HDD recorder, a STB (Set Top Box), etc. It may also be a PC (Personal Computer), a tablet terminal, a game machine, etc. equipped with a digital broadcast receiving function and a broadcast communication linking function. If the broadcast receiving device 100 is a DVD recorder, a HDD recorder, an STB, etc., it may not be equipped with the video display unit 173 and the speaker 174. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, the same operation as the broadcast receiving device 100 of this embodiment can be performed.
[0048] [Software configuration of broadcast receiving device] 2B is a software configuration diagram of the broadcast receiving device 100 of this embodiment, and shows the software configuration in the ROM 103, the RAM 104, and the storage unit 110. In this embodiment, a basic operation program 1001 and other operation programs are stored in the ROM 103, and a receiving function program 1002, a BML browser program 1003, an HTML browser program 1004, and other operation programs are stored in the storage unit 110. The storage unit 110 is also assumed to include a content storage area 1011 for storing content such as moving images, still images, and audio, an authentication information storage area 1012 for storing authentication information and the like used when linking with an external mobile terminal device, and various information storage areas for storing various other information.
[0049] A basic operation program 1001 stored in ROM 103 is loaded into RAM 104, and the main control unit 101 executes the loaded basic operation program to constitute a basic operation execution unit 1101. A receiving function program 1002, a BML browser program 1003, and an HTML browser program 1004 stored in the storage unit 110 are loaded into RAM 104, and the main control unit 101 executes each of the loaded operation programs to constitute a receiving function execution unit 1102, a BML browser engine 1103, and an HTML browser engine 1104. The RAM 104 is also provided with a temporary storage area for temporarily holding data created when each operation program is executed, as necessary.
[0050] In the following, for the sake of simplicity, the process of controlling each operation block by the main control unit 101 expanding the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing it will be described as the basic operation execution unit 1101 controlling each operation block. Similar descriptions will be used for the other operation programs.
[0051] The receiving function execution unit 1102 controls each operation block of the broadcast receiving device 100 to realize the broadcast receiving function and the broadcast communication cooperation function. In particular, the broadcast program reproduction unit 1102a mainly controls the tuner / demodulation unit 131, the first separation unit 132, the first video decoding unit 133, the first audio decoding unit 134, the first subtitle decoding unit 135, the data broadcast reception processing unit 141, and the data broadcast engine 142. The data broadcast engine 142 may be replaced by the BML browser engine 1103 expanded on the RAM 104. The communication content reproduction unit 1102b mainly controls the streaming reception processing unit 151, the second separation unit 152, the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155. The cooperation application control unit 1102c mainly controls the application control unit 161 and the application engine 162. The application engine 162 may be replaced by the HTML browser engine 1104 expanded on the RAM 104. The terminal cooperation management unit 1102d mainly controls the terminal cooperation control unit 191.
[0052] The operation programs may be stored in the ROM 103 and / or the storage unit 110 beforehand at the time of product shipment. After product shipment, the operation programs may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Moreover, the operation programs may be stored in a memory card, an optical disk, or the like and acquired via the extended interface unit 124 or the like.
[0053] [Broadcasting station server configuration] 3 is a block diagram showing an example of the internal configuration of the broadcast station server 300. The broadcast station server 300 is made up of a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, and a LAN communication unit 321.
[0054] The main control unit 301 is a microprocessor unit that controls the entire broadcast station server 300 in accordance with a predetermined operation program. The system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block in the broadcast station server 300. The RAM 304 serves as a work area when each operation program is executed.
[0055] The storage unit 310 stores a basic operation program 3001 and a content management / distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. The video content storage area 3011 stores video content and the like of each broadcast program broadcast by a broadcast station. The metadata storage area 3012 stores metadata such as the program title, program ID, program summary, cast, broadcast date and time, etc., of each broadcast program.
[0056] In addition, the basic operation program 3001 and the content management / distribution program 3002 stored in the storage unit 310 are each expanded into the RAM 304, and the main control unit 301 executes the expanded basic operation program and content management / distribution program to form a basic operation execution unit 3101 and a content management / distribution execution unit 3102.
[0057] In the following, for ease of explanation, the process in which the main control unit 301 loads the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executes it to control each operation block will be described as being performed by the basic operation execution unit 3101. Similar descriptions will be used for the other operation programs.
[0058] The content management / distribution execution unit 3102 manages the video content and each piece of metadata stored in the video content storage area 3011 and the metadata storage area 3012, and controls the provision of the video content and each piece of metadata to the service provider based on a contract. Furthermore, when providing the video content and each piece of metadata to the service provider, the content management / distribution execution unit 3102 also performs authentication processing of the service provider server 400 based on the contract, as necessary.
[0059] The LAN communication unit 321 is connected to the Internet 200, and communicates with a service provider server 400 and the like on the Internet 200. The LAN communication unit 321 includes an encoding circuit, a decoding circuit, and the like.
[0060] [Service provider server configuration] 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 is made up of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.
[0061] The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 in accordance with a predetermined operation program. The system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.
[0062] The storage unit 410 stores a basic operation program 4001, a content management / distribution program 4002, and an application management / distribution program 4003, and further includes a video content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content and the like and each piece of metadata provided by the broadcast station server 300, as well as content created by the service provider and metadata related to the content and the like. The application storage area 4013 stores applications required to realize each service of the broadcasting / communication cooperation system, which are to be distributed in response to requests from each television receiver.
[0063] In addition, the basic operation program 4001, content management / distribution program 4002, and application management / distribution program 4003 stored in the storage unit 410 are each expanded into RAM 404, and the main control unit 401 further executes the expanded basic operation program, content management / distribution program, and application management / distribution program to form a basic operation execution unit 4101, a content management / distribution execution unit 4102, and an application management / distribution execution unit 4103.
[0064] In the following, for ease of explanation, the process in which the main control unit 401 loads the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executes it to control each operation block will be described as the basic operation execution unit 4101 controlling each operation block. Similar descriptions will be used for the other operation programs.
[0065] The content management / distribution execution unit 4102 acquires video content and the like and each piece of metadata from the broadcast station server 300, manages the video content and the like and each piece of metadata stored in the video content storage area 4011 and the metadata storage area 4012, and controls the distribution of the video content and the like and each piece of metadata to each television receiver. The application management / distribution execution unit 4103 manages the applications stored in the application storage area 4013, and controls the distribution of the applications in response to requests from each television receiver. Furthermore, when distributing the applications to each television receiver, the application management / distribution execution unit 4103 also performs authentication processing of each television receiver as necessary.
[0066] The LAN communication unit 421 is connected to the Internet 200, and communicates with the broadcast receiving device 100 and the mobile information terminal 700 via the broadcast station server 300 on the Internet 200 and the router device 210. The LAN communication unit 421 includes an encoding circuit, a decoding circuit, and the like.
[0067] [Mobile information terminal hardware configuration] 5A is a block diagram showing an example of the internal configuration of a portable information terminal 700. The portable information terminal 700 is composed of a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760.
[0068] The main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700. The system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operation block in the portable information terminal 700.
[0069] ROM 703 is a memory in which basic operation programs such as an operating system and other operation programs are stored, and a rewritable ROM such as an EEPROM or flash ROM is used. RAM 704 serves as a work area when the basic operation programs and other operation programs are executed. ROM 703 and RAM 704 may be integrated with main control unit 701. ROM 703 may use a part of the storage area in storage unit 710 instead of being an independent configuration as shown in FIG. 5A.
[0070] The storage unit 710 stores the operation program and operation setting values of the mobile information terminal 700, personal information of the user of the mobile information terminal 700, etc. It can also store operation programs downloaded from a network and various data created by the operation programs. It can also store content such as moving images, still images, and audio downloaded from a network. A part of the area of the storage unit 710 may replace all or part of the functions of the ROM 703. The storage unit 710 needs to hold the stored information even when power is not being supplied from an external source to the mobile information terminal 700. Therefore, for example, a flash ROM, SSD, HDD, or other device is used.
[0071] It should be noted that the operation programs stored in the ROM 703 and the storage unit 710 can be updated and their functions expanded by downloading from each server device on the Internet 200 .
[0072] The communication processing unit 720 is composed of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via the router device 210, and transmits and receives data to and from each server device on the Internet 200. The connection to the router device 210 is assumed to be made via a wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (calls) and data transmission and reception through wireless communication with a base station 600b of the mobile telephone network. The NFC communication unit 723 performs wireless communication when in close proximity to a corresponding reader / writer. The LAN communication unit 721, the mobile telephone network communication unit 722, and the NFC communication unit 723 each include an encoding circuit, a decoding circuit, an antenna, and the like. The communication processing unit 720 may further include other communication units such as a BlueTooth (registered trademark) communication unit and an infrared communication unit.
[0073] The expansion interface unit 724 is a group of interfaces for expanding the functions of the portable information terminal 700, and in this embodiment, is composed of a video / audio interface, a USB interface, a memory interface, etc. The video / audio interface inputs video signals / audio signals from an external video / audio output device, outputs video signals / audio signals to an external video / audio input device, etc. The USB interface connects to a PC or the like to send and receive data. It may also be used to connect a keyboard or other USB device. The memory interface connects to a memory card or other memory medium to send and receive data.
[0074] The operation unit 730 is an instruction input unit that inputs operation instructions to the mobile information terminal 700, and in this embodiment, is configured with a touch panel 730t arranged on top of the display unit 741 and operation keys 730k arranged with button switches. Only one of them may be used. The mobile information terminal 700 may be operated using a keyboard or the like connected to the extended interface unit 724. The mobile information terminal 700 may be operated using a separate mobile terminal device connected by wired or wireless communication. The touch panel function may be provided in the display unit 741.
[0075] The image processing unit 740 is composed of a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides image data processed by the image signal processing unit 742 to the user of the mobile information terminal 700. The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on image data input to the video RAM. The image signal processing unit 742 also has a function of performing format conversion, superimposition processing of menus and other OSD (On Screen Display) signals, etc., as necessary. The first image input unit 743 and the second image input unit 744 are camera units that input image data of the surroundings and objects by converting light input from a lens into an electrical signal using electronic devices such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
[0076] The audio processing unit 750 is composed of an audio output unit 751, an audio signal processing unit 752, and an audio input unit 753. The audio output unit 751 is a speaker, and provides an audio signal processed by the audio signal processing unit 752 to the user of the mobile information terminal 700. The audio input unit 753 is a microphone, and converts the user's voice, etc. into audio data and inputs it.
[0077] The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700, and in this embodiment, is composed of a GPS receiver unit 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. These sensors make it possible to detect the position, inclination, direction, and movement of the portable information terminal 700, as well as the brightness of the surroundings, the proximity of surrounding objects, and the like. The portable information terminal 700 may further include other sensors, such as an air pressure sensor.
[0078] The portable information terminal 700 may be a mobile phone, a smartphone, a tablet terminal, etc. It may also be a PDA (Personal Digital Assistant) or a notebook PC. It may also be a digital still camera, a video camera capable of shooting moving images, a portable game machine, or other portable digital devices.
[0079] 5A includes many components that are not essential to this embodiment, such as the sensor unit 760, but the effects of this embodiment are not impaired even if these components are not included. In addition, components not shown, such as a digital broadcast receiving function and an electronic money settlement function, may be added.
[0080] [Mobile information terminal software configuration] 5B is a software configuration diagram of the mobile information terminal 700 of this embodiment, and shows the software configuration in the ROM 703, the RAM 704, and the storage unit 710. In this embodiment, a basic operation program 7001 and other operation programs are stored in the ROM 703, and a cooperative control program 7002, an HTML browser program 7003, and other operation programs are stored in the storage unit 710. The storage unit 710 is also assumed to include a content storage area 7011 for storing content such as moving images, still images, and audio, an authentication information storage area 7012 for storing authentication information used during cooperative operation with a television receiver, and various information storage areas for storing various other information.
[0081] A basic operation program 7001 stored in ROM 703 is loaded into RAM 704, and the main control unit 701 executes the loaded basic operation program to constitute a basic operation execution unit 7101. Also, a cooperative control program 7002 and an HTML browser program 7003 stored in the storage unit 710 are loaded into RAM 704, and the main control unit 701 executes each of the loaded operation programs to constitute a cooperative control execution unit 7102 and an HTML browser engine 7103. Also, the RAM 704 is provided with a temporary storage area for temporarily holding data created when each operation program is executed, as necessary.
[0082] In the following, for ease of explanation, the process of the main control unit 701 loading the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing it to control each operation block will be described as being performed by the basic operation execution unit 7101 to control each operation block. Similar descriptions will be used for the other operation programs.
[0083] The cooperative control execution unit 7102 manages device authentication and connection, transmission and reception of each data, etc., when the mobile information terminal 700 performs cooperative operation with the television receiver. The HTML browser engine 7103 is an HTML browser that executes an application created for the broadcast communication cooperative system on the mobile information terminal 700.
[0084] The operation programs may be stored in the ROM 703 and / or the storage unit 710 beforehand at the time of product shipment. After product shipment, the operation programs may be acquired from other application servers 500 on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Moreover, the operation programs stored in a memory card, an optical disk, or the like may be acquired via the extended interface unit 724 or the like.
[0085] [Application Control Information (AIT) Overview] The application control information (AIT) in this embodiment is information intended to inform a television receiver or the like (broadcast receiving device 100 in this embodiment) of the existence of an application (hereinafter, sometimes referred to as a broadcast-linked application) that links with a broadcast service in the broadcast communication linking function supported by the broadcast receiving device 100, and to instruct the control of the application. The broadcast-linked application may be classified into (1) a broadcast-managed application that operates only in a broadcast reception state based on a control signal such as start / end included in a broadcast signal, and is permitted to access broadcast resources based on the control signal, (2) a non-broadcast-managed application that is in an operating form that is not controlled by a broadcast signal for start / end, and is permitted to access broadcast resources based on means such as application authentication, and (3) other general applications that are not permitted to access broadcast resources.
[0086] The AIT may be transmitted by either of the following methods: transmitting an AIT in section format or in XML (eXtensible Markup Language) format by broadcast waves using a Data Carousel (DC) method or the like; or distributing an AIT file in section format or in XML format from a server device on the Internet 200 using http (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure), etc. Other methods may also be used.
[0087] 6 is a data configuration diagram showing an example of the data configuration of an AIT. The AIT is mainly composed of information such as an application type 901, an application identifier 902, an application control code 903, an application profile 904, application acquisition destination information 905, an application boundary and access authority setting 906, a startup priority 907, cache information 908, and a server access distribution parameter 909. In addition, other information may be included.
[0088] The application type 901 specifies the description format of the application. In this embodiment, the description format of the application is HTML. The application identifier 902 is identification information for identifying an application unit, which is composed of an organization identification for identifying a business operator and an application identification numbered for each business operator. Note that an application unit is a set of HTML documents and their reference resources, with the HTML document existing in the location specified by the application acquisition destination information 905 as the entry document. The application control code 903 specifies the operation control for the target application, and one of (1) automatic start, (2) operable, (3) terminated, and (4) prefetch is described. The application profile 904 is a value indicating the function of the television receiver required by the application, and indicates a combination of optional functions of the television receiver. By referring to this value, the availability of the application is determined.
[0089] The application acquisition destination information 905 is information for specifying the acquisition destination of the application, and is location information for acquiring the HTML document that is first referenced when the application is started. Since it is assumed that the application is transmitted by broadcasting and that it is placed in a server device on a communication network, the location information specified by the application acquisition destination information 905 is also regulated for both cases of broadcast acquisition and communication acquisition. The application boundary and access restriction setting 906 is information indicating the operable range of the broadcast managed application as a set of one or more areas (URL: Uniform Resource Locator). In addition, the access restriction to the broadcast resource for each area is set on a functional basis. The application boundary and access restriction setting 906 specifies the range of document transition to prevent transition to an unexpected document due to a chain of document transitions from an entry document at the time of application startup, access to an inappropriate broadcast resource, etc. In addition, it is possible to set access authority to a specific broadcast resource on an area basis within the range of the document transition.
[0090] The start priority 907 specifies which of the two applications is to be started first when data broadcasting by a broadcasting service and a broadcast-managed application by an HTML document are present at the same time. It is possible to unconditionally specify data broadcasting as the highest priority on the PMT, to specify the start priority of a specific application type on the PMT, and to specify the start priority of the target application in the start priority 907. The cache information 908 is information used for cache control when holding application resources in preparation for reuse of the application. This information makes it possible to cache application resources that are assumed to be reused even after the application is terminated. The server access distribution parameter 909 is a parameter set for distributing access in order to reduce the load on a server where access is concentrated at the application acquisition destination, etc. The television receiver may operate to probabilistically delay the application of the application control code according to the setting of this parameter.
[0091] The operation of the broadcast receiving device 100 of this embodiment will be described below.
[0092] [Application startup sequence] First, a description will be given of a process of starting a broadcast linked app based on an AIT transmitted by a broadcast wave in the broadcast receiving device 100 of this embodiment. In the broadcast receiving device 100 of this embodiment, it is possible to specify which of a data broadcast by a broadcast service and a broadcast linked app is to be started with priority when they exist simultaneously, based on information on the PMT and information such as the application control code 903 and start priority 907 in the AIT.
[0093] 7A is an operation sequence diagram showing an example of an operation sequence of a broadcast cooperative app when it is specified that the broadcast cooperative app is to be started with priority. The figure shows a series of flows from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts a predetermined broadcast cooperative app.
[0094] When the tuner / demodulator 131 of the broadcast receiving device 100 performs a process of selecting a channel desired by the user and acquires a TS, the main control unit 101 then acquires a PMT data sequence separated by the first separation unit 132 (S101) and checks the start priority described in the PMT. When it is confirmed in the process of S101 that the start priority of the broadcast-linked application is high (S102), the application control unit 161 acquires an AIT data sequence separated by the first separation unit 132 (S103) and checks the application control code 903 of the acquired AIT data sequence (S104). In the process of S104, if the application control code 903 is "automatic start", the application control unit 161 further checks the application profile 904 of the acquired AIT data sequence (S105). If it is confirmed that the broadcast-linked application specified in the AIT can be executed, a transmission request for the broadcast-linked application is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 based on the information described in the application acquisition destination information 905 (S106).
[0095] The service provider server 400 that has received the transmission request for the broadcast cooperative app performs authentication processing of the broadcast receiving device 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app stored in the application storage area 4013 via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication processing, and detailed explanations will be omitted. Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast cooperative app that has been received via the LAN communication unit 121 and distributed from the service provider server 400 under the control of the application control unit 161 (S108).
[0096] 7B is an operation sequence diagram showing an example of an operation sequence of a broadcast linked app when it is specified that data broadcasting by a broadcast service is to be preferentially started. The figure shows a series of flows from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts a predetermined broadcast linked app.
[0097] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing to select a channel desired by the user and acquires a TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132 (S201) and checks the start priority described in the PMT. If it is confirmed in the processing of S201 that the start priority of the data broadcast by the broadcast service is high (S202), the data broadcast reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and plays the BML document (S203). If the automatic start of the data broadcast is set by the BML document, and if the user makes a start request of the data broadcast using an operation terminal (mobile information terminal 700, remote control, etc.) (S204), the data broadcast engine 142 executes the played BML document to generate data broadcast screen information and displays it on the video display unit 173 (S205).
[0098] After the process of S205 or simultaneously with the process of S205, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S206), and checks the application profile 904 of the acquired AIT data string (S207). In the process of S207, if it is confirmed that the broadcast-linked application specified in the AIT can be executed, an entry button to the executable broadcast-linked application is displayed on the data broadcast screen. The entry button may be always displayed, and the color scheme may be changed from an inactive color to an active color only when the broadcast-linked application can be executed. The entry button may be switched between an inactive state and an active state by changing its shape.
[0099] When the user selects the entry button using the operation terminal (S208), the data broadcasting engine 142 executes the BML document and ends the process of generating data broadcasting screen information (S209). Next, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and checks the application acquisition destination information 905 of the acquired AIT data string. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S210, a transmission request for the broadcast cooperative application is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 (S211).
[0100] The service provider server 400 that has received the transmission request for the broadcast cooperative app performs authentication processing of the broadcast receiving device 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app stored in the application storage area 4013 via the LAN communication unit 421 (S212). Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast cooperative app that has been received from the service provider server 400 via the LAN communication unit 121 under the control of the application control unit 161 (S213).
[0101] 7C is an operation sequence diagram showing an example of the operation sequence of a broadcast cooperative app when no priority start is specified. The figure shows a series of flows from when the broadcast receiving device 100 appropriately checks the PMT and AIT to when it starts a predetermined broadcast cooperative app.
[0102] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing for selecting a channel desired by the user and acquires a TS, the main control unit 101 then acquires a PMT data sequence separated by the first separation unit 132 (S301) and checks the startup priority described in the PMT. When it is confirmed in the processing of S301 that the startup priority of the broadcast linked application is high (S302), the application control unit 161 acquires an AIT data sequence separated by the first separation unit 132 (S303) and checks the application control code 903 of the acquired AIT data sequence (S304). In the processing of S304, if the application control code 903 is "startable" rather than "automatic startup", the display of the broadcast program is continued without starting either the data broadcast by the broadcast service or the broadcast linked application.
[0103] When the user makes a request to start data broadcasting using the operation terminal after the process of S304 is completed (S305), the process obtains the BML data string, plays the BML document, and generates data broadcasting screen information, as in the process of S205 and subsequent steps in Fig. 7B (however, not shown). On the other hand, when the user makes a request to start a broadcast linked application launcher using the operation terminal after the process of S304 is completed (S306), the application control unit 161 obtains the AIT data string separated by the first separation unit 132 (S307) and checks the application profile 904 of the obtained AIT data string (S308). Furthermore, the application control unit 161 displays a list of executable broadcast linked applications on the video display unit 173 as a broadcast linked application launcher (S309).
[0104] When the user uses the operation terminal to select a predetermined broadcast cooperative app from the broadcast cooperative app launcher displayed in S309 (S310), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S311) and checks the application acquisition destination information 905 of the acquired AIT data string. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S311, a transmission request for the broadcast cooperative app is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S312).
[0105] The service provider server 400 that has received the transmission request for the broadcast cooperative app performs authentication processing of the broadcast receiving device 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app stored in the application storage area 4013 via the LAN communication unit 421 (S313). Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast cooperative app that has been received from the service provider server 400 via the LAN communication unit 121 under the control of the application control unit 161 (S314).
[0106] In addition, in the start-up sequence of the broadcast-linked application described with reference to Fig. 7A to Fig. 7C, an example is described in which the AIT is acquired from a broadcast wave, but the AIT file may be acquired from a predetermined server device specified by the information description of the PMT or the like. Also, the broadcast-linked application may be acquired from a broadcast wave, not from a server device (service provider server 400) on the network. That is, when the location information described in the application acquisition destination information 905 of the AIT indicates a broadcast wave, the application control unit 161 reproduces an HTML document from the HTML data string transmitted by a data carousel method or the like and separated and output by the first separation unit 132, and the application engine 162 executes the reproduced HTML document (broadcast-linked application).
[0107] In addition, if there is no information on the PMT specifying the start priority when data broadcasting by a broadcasting service and a broadcast linked application exist simultaneously, the start priority may be confirmed only by information such as the application control code 903 of the AIT and the start priority 907. Similarly, if acquisition of the information on the PMT fails, the start priority may be confirmed only by information such as the application control code 903 of the AIT and the start priority 907. That is, regardless of the information on the PMT, the AIT may be checked periodically, and if a broadcast linked application specified as "automatic start" in the application control code 903 of the AIT exists, the start of the broadcast linked application may be prioritized, and if a broadcast linked application specified as "automatic start" in the application control code 903 of the AIT does not exist, the start of data broadcasting by a broadcasting service may be prioritized.
[0108] Furthermore, if there is no response from the service provider server 400 for a predetermined period of time or longer when a distribution request for the broadcast cooperative app is made in S106, S211, or S312, a message such as "Please wait a moment" may be displayed on the video display unit 173. Alternatively, in this case, a message inquiring the user about stopping execution of the broadcast cooperative app may be displayed.
[0109] Further, it goes without saying that the start-up sequence of the broadcast cooperative app is not limited to the three patterns described above, and the broadcast cooperative app may be started up by a different sequence.
[0110] [Operation sequence when linking mobile information terminals] In the broadcast receiving device 100 of this embodiment, it is assumed that the function of the broadcast communication cooperative service can be expanded by cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700. For example, by installing an application (cooperative control app) prepared by a television receiver manufacturer, it is possible to use the mobile information terminal 700 as a high-function remote control for the broadcast receiving device 100. In addition, it is possible to execute the broadcast cooperative app on the mobile information terminal 700 and display, for example, a service linked to a broadcast program being displayed on the broadcast receiving device 100 on the mobile information terminal 700. Note that, in order to expand the function by cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700, it is preferable that the cooperative control app is running on the mobile information terminal 700, and the broadcast cooperative app operating on the mobile information terminal 700 is controlled by the cooperative control app.
[0111] 8A is an operational sequence diagram showing an example of an operational sequence when the cooperative control application is started up on the mobile information terminal 700. The diagram shows a series of flows (first time) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until cooperative operation becomes possible. It is assumed that the cooperative control application is installed in advance in the storage unit 710 of the mobile information terminal 700 as a cooperative control program 7002.
[0112] When a user instructs the mobile information terminal 700 to start a cooperative control application (S401), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for television receivers capable of communication (cooperative operation) on the network (S402), and displays the search results as a list of television receivers on the display unit 741. If a television receiver capable of communication cannot be found, the processing is terminated after displaying a message to that effect. When a user selects an arbitrary television receiver (the broadcast receiving device 100 of this embodiment) from the list of television receivers, the cooperative control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. When a user inputs authentication information (such as a login name and password designated by the broadcast receiving device 100) on the login screen via the operation unit 730 (S403), the cooperative control execution unit 7102 stores the input authentication information in the authentication information storage area 7012 and simultaneously transmits the input authentication information to the broadcast receiving device 100 (S404). The authentication information may be transmitted to the broadcast receiving device 100 via the LAN communication unit 721 and the router device 210, or may be transmitted directly to the broadcast receiving device 100 via the NFC communication unit 723.
[0113] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S405). If the received authentication information is confirmed to be correct by the process of S405, information on the mobile information terminal 700 is stored in the authentication information storage area 1012 and the mobile information terminal 700 is authenticated (S406). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays a basic screen (for example, a high-function remote control screen) of the cooperation control application on the display unit 741 (S407). If the received authentication information is not confirmed to be correct in S405, the terminal cooperation control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. By the above process, the broadcast receiving device 100 and the mobile information terminal 700 are enabled to operate in cooperation with each other.
[0114] 8B is an operational sequence diagram showing an example of an operational sequence when the cooperative control application is started up on the mobile information terminal 700. The diagram shows a series of flows (from the second time onward) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 until cooperative operation becomes possible.
[0115] When a user instructs the mobile information terminal 700 to start a cooperative control application (S501), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for television receivers on the network that can communicate, and displays the search results as a list of television receivers on the display unit 741. If a television receiver that can communicate cannot be found, the processing ends with a message to that effect. When a user selects an arbitrary television receiver (broadcast receiving device 100 of this embodiment) from the list of television receivers (S502), and the selected broadcast receiving device 100 is a device that has previously been connected (operated cooperatively), the cooperative control execution unit 7102 reads out authentication information of the broadcast receiving device 100 from the authentication information storage area 7012, and transmits it to the broadcast receiving device 100 (S503).
[0116] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S504). If the received authentication information is confirmed to be correct by the processing of S504, the mobile information terminal 700 is authenticated (S505). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control app on the display unit 741 (S506). By the above processing, cooperation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0117] Note that, when starting a broadcast cooperative app in the broadcast receiving device 100 following the processing in FIGS. 8A and 8B, the processing in FIGS. 7A to 7C may be performed after the processing in FIGS. 8A to 8B.
[0118] 8C is an operation sequence diagram showing an example of the operation sequence when the cooperative control app is started on the mobile information terminal 700. The figure shows a series of flows (from the second time onward) in which the mobile information terminal 700 performs authentication processing with the broadcast receiving device 100 and cooperative operation becomes possible. However, the figure shows an example in which the broadcast receiving device 100, which executes the start sequence of the broadcast cooperative app, requests the start of the cooperative control app on the mobile information terminal 700.
[0119] When the tuner / demodulator 131 of the broadcast receiving device 100 performs processing for selecting a channel desired by the user and acquires a TS, the main control unit 101 then acquires a PMT data sequence separated by the first separation unit 132 (S601) and checks the startup priority described in the PMT. When it is confirmed in the processing of S601 that the startup priority of the broadcast cooperative application is high (S602), the application control unit 161 acquires an AIT data sequence separated by the first separation unit 132 (S603) and checks the application control code 903 of the acquired AIT data sequence (S604). In the processing of S604, if the application control code 903 is "automatic startup", the application profile 904 of the acquired AIT data sequence is further checked (S605). In the processing of S605, if it is confirmed that the broadcast cooperative app specified in the AIT can be executed and if it is determined that cooperative control of the mobile terminal device is necessary, the terminal cooperative control unit 191 selects the mobile information terminal 700 as the mobile terminal device by referring to the authentication information memory area 1012, and transmits a cooperative control app launch request to the selected mobile information terminal 700 (S606).
[0120] In addition, the selection of the portable information terminal 700 by referring to the authentication information storage area 1012 may be made based on the latest information in the authentication information storage area 1012 or based on the most frequently used information in the authentication information storage area 1012.
[0121] Furthermore, in the process of S606, if a mobile terminal device to which a cooperative control application start request should be transmitted cannot be found, a message indicating that fact may be displayed on the video display unit 173. Alternatively, in this case, a message inquiring the user about stopping execution of the broadcast cooperative application may be displayed.
[0122] The main control unit 701 of the mobile information terminal 700 launches the collaborative control app (collaborative control execution unit 7102) in response to the collaborative control app launch request received via the LAN communication unit 721 (S607), and further, the collaborative control execution unit 7102 reads out authentication information of the broadcast receiving device 100 from the authentication information memory area 7012 and transmits it to the broadcast receiving device 100 (S608).
[0123] The terminal cooperation control unit 191 of the broadcast receiving device 100, which has received the authentication information via the LAN communication unit 121, checks whether the received authentication information is correct by referring to the authentication information storage area 1012 (S609). If the received authentication information is confirmed to be correct by the processing of S609, the mobile information terminal 700 is authenticated (S610). The mobile information terminal 700, which has been authenticated by the broadcast receiving device 100, displays the basic screen of the cooperation control app on the display unit 741 (S611). By the above processing, cooperation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.
[0124] In addition, when the broadcast cooperative app is executed in both the broadcast receiving device 100 and the mobile information terminal 700 following the above-mentioned processing, the processing shown in Fig. 9 may be performed. Fig. 9 is an operation sequence diagram showing an example of a start-up sequence of the broadcast cooperative app in the broadcast receiving device 100 and the mobile information terminal 700.
[0125] 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data sequence separated by the first separation unit 132 (S612), and checks the application acquisition destination information 905 of the acquired AIT data sequence. Furthermore, based on the information described in the application acquisition destination information 905 confirmed in S612, a transmission request for the broadcast cooperative application (TV side) is transmitted to a predetermined service provider server 400 via the LAN communication unit 121 (S613).
[0126] The service provider server 400 that has received the transmission request for the broadcast cooperative app (television side) performs authentication processing of the broadcast receiving device 100 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app (television side) stored in the application storage area 4013 via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast cooperative app (television side) that has been received from the service provider server 400 and distributed via the LAN communication unit 121 under the control of the application control unit 161 (S615).
[0127] Next, the terminal cooperation control unit 191 of the broadcast receiving device 100 transmits to the mobile information terminal 700, information such as the URL of the broadcast cooperative app (terminal side) to be executed on the mobile information terminal 700, which information was acquired from the AIT or the broadcast cooperative app (TV side) executed in S615 (S616). The cooperation control execution unit 7102 of the mobile information terminal 700 transmits a transmission request for the broadcast cooperative app (terminal side) to a predetermined service provider server 400 via the LAN communication unit 721, based on the URL of the broadcast cooperative app (terminal side) received via the LAN communication unit 721 (S617).
[0128] The service provider server 400, which has received the transmission request for the broadcast cooperative app (terminal side), performs authentication processing for the mobile information terminal 700 as necessary under the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app (terminal side) stored in the application storage area 4013 via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 starts the predetermined broadcast cooperative app (terminal side) received from the service provider server 400 via the LAN communication unit 721 (S619).
[0129] 7A to 7C in that the AIT file can be acquired from a predetermined server device, and the broadcast cooperative app can be acquired from a broadcast wave rather than from a server device on the network. When the broadcast cooperative app is acquired from a broadcast wave, the broadcast receiving device 100 may acquire the broadcast cooperative app (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, and transfer the acquired broadcast cooperative app (terminal side) to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 may acquire the broadcast cooperative app (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave and store it in the storage unit 110, and in the process of S616 in FIG. 9, location information of the storage unit 110 of the broadcast receiving device 100 may be transmitted as URL information to be transmitted to the mobile information terminal 700. The broadcast receiving device 100 may acquire the broadcast cooperative app (television side) from the broadcast wave, and the mobile information terminal 700 may acquire the broadcast cooperative app (terminal side) from a server device on the network. The mobile information terminal 700 may directly acquire the broadcast cooperative app (terminal side) from the broadcast wave using a digital broadcast receiving function that the mobile information terminal 700 has.
[0130] In addition, the operation sequences of Figures 7A to 7C, 8A to 8C, and 9 can be partially combined as appropriate, and some operation steps can be rearranged in order or operated simultaneously with other operation steps as appropriate.
[0131] [Basic screen of mobile information terminal linkage control app] Fig. 10A is a screen display diagram showing an example of a basic screen of the cooperative control app displayed by the process of S407 in Fig. 8A, the process of S506 in Fig. 8B, the process of S611 in Fig. 8C, etc. In this embodiment, the basic screen 741a of the cooperative control app is assumed to have a function as a high-performance remote control compatible with the broadcast receiving device 100.
[0132] 10A, the basic screen 741a of the cooperative control application is composed of a power key 741a1, a network selection key (digital terrestrial, BS, CS) 741a2, number keys (1 to 12) 741a3, a volume UP / DOWN key 741a4, a channel UP / DOWN key 741a5, an input switching key 741a6, a program guide key 741a7, a data key 741a8, a cooperative application key 741a9, a menu key 741aa, a back key 741ab, cursor keys (up, down, left, right) 741ac, a decision key 741ad, and color keys (blue, red, green, yellow) 741ae. Other operation keys may also be displayed.
[0133] For ease of use, each of the operation keys may have the same key arrangement / operation as that of a dedicated remote control attached to the broadcast receiving device 100. In addition, the power key 741a1, network selection key 741a2, numeric keys 741a3, etc. have the same functions as the operation keys of a known television remote control, and detailed explanations thereof will be omitted. The linked application key 741a9 is an operation key provided for the broadcast linked communication function of this embodiment.
[0134] In the process of S204 in Fig. 7B and S305 in Fig. 7C, it is assumed that data broadcasting can be started / ended by selecting the data key 741a8. In the process of S208 in Fig. 7B and S310 in Fig. 7C, it is assumed that the executable broadcast linked application can be selected by operating the cursor key 741ac and the decision key 741ad. In the process of S306 in Fig. 7C, it is assumed that a request to start the broadcast linked application launcher can be made by selecting the linked application key 741a9.
[0135] In this way, by providing the linked application key 741a9 or another operation key having a similar function on the basic screen 741a of the linked control application, it becomes possible to easily select / launch each broadcast linked application used in the broadcast linked system of this embodiment. In addition, the linked application key 741a9 or another operation key having a similar function may be provided on a dedicated remote control attached to the broadcast receiving device 100.
[0136] FIG. 10B is a screen display diagram showing an example of the basic screen of the collaborative control app displayed by processing S407 in FIG. 8A, processing S506 in FIG. 8B, processing S611 in FIG. 8C, etc., and is an example different from FIG. 10A.
[0137] The basic screen 741b of the cooperative control app is composed of a cooperative control message 741b1 and a cooperative control app operation screen 741b2. Other objects may be further displayed. The cooperative control message 741b1 is a message display for making the user recognize that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. The cooperative control app operation screen 741b2 is an area in which an arbitrary screen display is performed by the cooperative control app, and detailed description is omitted in this embodiment. For example, the configuration in the cooperative control app operation screen 741b2 may be the same as the basic screen 741a of the cooperative control app described above. A sub-screen of a broadcast program displayed on the broadcast receiving device 100, etc. may be displayed.
[0138] 10B, by displaying the cooperative control in progress message 741b1, the user of the mobile information terminal 700 can easily understand that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. Note that the cooperative control in progress message 741b1 is not limited to a character display, and may be a symbol display, a graphic display, or the like. A difference in background color, or the like, may be used as an alternative to the cooperative control in progress message 741b1.
[0139] [Data broadcasting screen on broadcast receiving device] Fig. 11 is a screen display diagram showing an example of a data broadcast screen displayed by the process of S205 in Fig. 7B. In this embodiment, it is assumed that three broadcast cooperative applications, cooperative application A, cooperative application B, and cooperative application C, are executable by the broadcast receiving device 100 due to the description of the AIT, etc. In this case, an entry button 173a2 for cooperative application A, an entry button 173a3 for cooperative application B, and an entry button 173a4 for cooperative application C are displayed at arbitrary positions on the data broadcast screen 173a.
[0140] On the data broadcast screen 173a as shown in FIG. 11, when the entry button 173a2, the entry button 173a3, the entry button 173a4, etc. are selected using the cursor keys 741ac and the decision key 741ad on the basic screen 741a of the linked control app, the display of the data broadcast screen 173a is terminated and linked app A, linked app B, linked app C, etc. are launched under the control of the application control unit 161 and the application engine 162.
[0141] When displaying the data broadcast screen 173a, the frame color, inner color, shape, font, size, blinking state, etc. of each entry button may be changed as appropriate according to the type of broadcast cooperative application, security status, etc. For example, if the cooperative application A is a broadcast managed application, the frame color of the entry button 173a2 is blue, if the cooperative application B is a non-broadcast managed application, the frame color of the entry button 173a3 is yellow, if the cooperative application C is a general application, the frame color of the entry button 173a4 is red, etc. Alternatively, if the cooperative application A is determined to be reliable in terms of security, the frame color of the entry button 173a2 is blue, if the cooperative application B is determined to be not necessarily reliable in terms of security, the frame color of the entry button 173a3 is yellow, if the cooperative application C is determined to be dangerous in terms of security, the frame color of the entry button 173a4 is red, etc.
[0142] In addition, the frame color, inner color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on the function or genre of the broadcast cooperative application, or depending on the expiration date of use of each broadcast cooperative application. The frame color, inner color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on whether the broadcast cooperative application has been acquired from the network or not. For example, if the cooperative application A has already been acquired from the network (already cached in RAM 104 or storage 110), the frame color of the entry button 173a2 is set to blue, if the cooperative application B is being acquired, the frame color of the entry button 173a3 is set to yellow, and if the cooperative application C has not been acquired, the frame color of the entry button 173a4 is set to red, etc.
[0143] In this way, the user of the broadcast receiving device 100 can easily grasp the types of broadcast cooperative applications that can be executed on the broadcast receiving device 100, the security status, and the like.
[0144] [Broadcast linkage app launcher screen on broadcast receiving device] FIG. 12A is a screen display diagram showing an example of a notification screen for making a user recognize that there is a broadcast cooperative application that can be activated in the broadcast receiving device 100 of this embodiment.
[0145] For example, in the operation sequence shown in Fig. 7C, after the process of S304, neither the data broadcast by the broadcast service nor the broadcast linked application is started, and the display of the broadcast program continues. On the other hand, in this case, if the icon 173b0 as shown in Fig. 12A is displayed to make the user aware that there is a broadcast linked application that can be started, the usability of the broadcast receiving device 100 is improved. In other words, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of a broadcast linked application that can be started.
[0146] The display position of the icon 173b0 may be any position on the screen, but it is preferable that the icon 173b0 is displayed in a place that does not interfere with viewing of a broadcast program. For example, the four corners of the screen. The icon 173b0 may be a character display as shown in FIG. 12A, or may be a symbol, a figure, or the like. The icon 173b0 may be displayed at all times, or may be displayed for a predetermined time after the power is turned on or the channel is changed. Alternatively, the icon 173b0 may be displayed simultaneously with the display of program information, channel number, or the like.
[0147] Fig. 12B is a screen display diagram showing an example of a broadcast cooperative application launcher displayed by the process of S306 in Fig. 7C. In this embodiment, it is assumed that three broadcast cooperative applications, cooperative application A, cooperative application B, and cooperative application C, are executable by the broadcast receiving device 100 due to the description of the AIT, etc. In this case, the broadcast cooperative application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b, and further, an entry button 173b2 of the cooperative application A, an entry button 173b3 of the cooperative application B, an entry button 173b4 of the cooperative application C, and a back button 173b5 are displayed in the broadcast cooperative application launcher 173b1.
[0148] 12B, when an entry button 173b2, an entry button 173b3, an entry button 173b4, or the like is selected using cursor keys 741ac and decision key 741ad on a basic screen 741a of the linkage control application, linkage application A, linkage application B, linkage application C, or the like is started under the control of the application control unit 161 and the application engine 162. When a back button 173b5 is selected, the display of the broadcast linkage application launcher 173b1 is terminated.
[0149] In addition, when displaying the broadcast linked app launcher 173b1 on the broadcast program screen 173b, the frame color, inner color, shape, font, size, blinking status, etc. of each entry button may be changed appropriately depending on the type and security status of the broadcast linked app, the function and genre of the broadcast linked app, the acquisition status of the broadcast app from the network, etc., just as in the case of displaying the entry buttons of each broadcast linked app on the data broadcast screen 173a of Figure 11.
[0150] Also, the broadcast cooperative application launcher 173b1 may not be displayed when there is no broadcast cooperative application executable by the broadcast receiving device 100. Alternatively, in this case, a message such as "There is no available application" may be displayed inside the broadcast cooperative application launcher 173b1.
[0151] [Broadcast linkage app execution screen on broadcast receiving device] FIG. 13A is a screen display diagram showing an example of a broadcast cooperative application execution screen displayed in the process of S108 in FIG. 7A, the process of S213 in FIG. 7B, the process of S314 in FIG. 7C, the process of S615 in FIG. 9, etc. The broadcast cooperative application of this embodiment has graphics capabilities and effect capabilities by HTML description, and is capable of overlay display with a broadcast program screen on the video display unit 173. For example, as shown in FIG. 13A, a broadcast cooperative application unit 173c1 that displays information such as a weather forecast and news is overlaid at an arbitrary position on the broadcast program screen 173c. The broadcast cooperative application unit 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, and a background object 173c5, etc. Other objects may be further displayed.
[0152] In a state where the broadcast cooperative application section 173c1 is overlaid on the broadcast program screen 173c, by selecting a data key 741a8 on the basic screen 741a of the cooperative control application, it is possible to terminate the execution of the broadcast cooperative application and move to a data broadcast screen. Also, by selecting a cooperative application key 741a9 on the basic screen 741a of the cooperative control application, it is possible to terminate the execution of the broadcast cooperative application and return to the display of only the broadcast program screen 173c. The above process may be realized by a different operation key.
[0153] In addition, in a state where the broadcast cooperative application section 173c1 is overlaid on the broadcast program screen 173c, the transparency of the broadcast cooperative application section 173c1 can be changed by operating each operation key of the basic screen 741a of the cooperative control application. The process of changing the transparency may be performed collectively for the entire broadcast cooperative application section 173c1, or may be performed individually for each of the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5. It may also be performed for each predetermined group (for example, a plurality of objects existing in the same graphics layer).
[0154] When performing the above-mentioned process of changing the transparency, for example, the cursor key 741ac on the basic screen 741a of the cooperation control application is used to select an object, and the "blue" key of the color key 741ae is used to increase the transparency of the object, and the "yellow" key is used to decrease the transparency of the object. The above-mentioned process of changing the transparency may be performed using different operation keys. If the entire broadcast cooperation application section 173c1 is collectively set to a transparency of 100%, the broadcast cooperation application section 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed by broadcast waves, it is possible to set the entire broadcast cooperation application section to a transparency of 100% and display only the broadcast program screen of the emergency broadcast on the video display section 173. Alternatively, a CM detection section (not shown) may detect that the broadcast program has changed from the main video to the CM video, and control the entire broadcast cooperation application section 173c1 to a transparency of 100% (or a transparency at which the video of the broadcast program can be clearly confirmed) collectively.
[0155] By performing the above-described processing, if you want to check the broadcast program screen in the background while the broadcast linked app is running, you can check the broadcast program screen without terminating the broadcast linked app.
[0156] Fig. 13B is a screen display diagram showing an example of the broadcast cooperative application execution screen displayed in the process of S108 in Fig. 7A, the process of S213 in Fig. 7B, the process of S314 in Fig. 7C, the process of S615 in Fig. 9, etc., different from the above. In the example shown in Fig. 13B, a broadcast cooperative application section 173c6 introducing recommended programs is overlaid at an arbitrary position on the broadcast program screen 173c. The broadcast cooperative application section 173c6 displays first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, etc. More recommended program information may be displayed by scrolling, page switching, etc.
[0157] The recommended program information may be information on a program recommended in relation to the broadcast program being displayed (broadcast program screen 173c), information on a program recommended based on the user's viewing history, or information on a program that is currently a hot topic on the Internet or the like. It may also be information on a recommended program sent to the user by a friend of the user of the broadcast receiving device 100. The recommended program may also be a program transmitted by broadcast waves of a digital broadcast service, or a VOD (Video On Demand) program or the like distributed from each server device on the Internet 200. It may also be an information screen such as a homepage prepared in a server device on the Internet 200.
[0158] When the broadcast linking application section 173c6 is overlaid on the broadcast program screen 173c, the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. are selected using the cursor keys 741ac and the decision key 741ad on the basic screen 741a of the linking control application, whereby the program videos recommended in the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. are displayed on the display section 173.
[0159] FIG. 13C is a screen display diagram showing an example in which a program video recommended by the broadcast cooperative application section 173c6 that introduces a recommended program is displayed. For example, when the first recommended program information 173c7 of the broadcast cooperative application section 173c6 is selected using the cursor key 741ac and the decision key 741ad on the basic screen 741a of the cooperative control application, the program video 173ca of the program recommended by the first recommended program information 173c7 is displayed on the display section 173. The program video 173ca may be paused or jumped to a specified time by the user's operation of the operation terminal. In addition, when the program video 173ca is displayed, the original broadcast program screen 173c may be displayed at an arbitrary position in a PIP (Picture In Picture) format. In this case, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c is to be the main screen by the user's operation of the operation terminal. It may be possible to adjust the size of the window of the original broadcast program screen 173c by the user's operation of the operation terminal.
[0160] In addition, if an icon display 173cb indicating that the program video 173ca of the recommended program is a video displayed by selecting any of the recommended program information displayed in the broadcast cooperative application section 173c6 is displayed at an arbitrary position on the screen, the user's convenience can be improved. Needless to say, the transparency of the broadcast cooperative application section 173c6 may be changed in the broadcast cooperative application execution screen shown in FIG. 13B in the same manner as described above.
[0161] Fig. 13D is a screen display diagram showing an example of the broadcast linked application execution screen displayed in the process of S108 in Fig. 7A, the process of S213 in Fig. 7B, the process of S314 in Fig. 7C, the process of S615 in Fig. 9, etc., different from the above. In the example shown in Fig. 13D, a broadcast linked application section 173cc serving as a portal of a social networking service (SNS) service is overlaid and displayed at an arbitrary position on a broadcast program screen 173c. An entry button 173cd for a first SNS service, an entry button 173ce for a second SNS service, an entry button 173cf for a third SNS service, etc. are displayed on the broadcast linked application section 173cc. Entry buttons for even more SNS services may be displayed by scrolling, page switching, etc.
[0162] In a state where the broadcast cooperation application section 173cc is overlaid on the broadcast program screen 173c, by using the cursor keys 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application to select the entry button 173cd of the first SNS service, the entry button 173ce of the second SNS service, the entry button 173cf of the third SNS service, or the like, the functions assigned to each entry button, such as a chat function, a bulletin board function, an Internet telephone function, or the like, are enabled. This makes it possible to enjoy the broadcast program being displayed (broadcast program screen 173c) while exchanging information with others. At the same time, the basic screen 741a of the cooperation control application on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard, or a voice input screen for chatting or posting on a bulletin board by voice input, or the like.
[0163] In addition to the above-mentioned examples, the broadcast cooperative app executable by the broadcast receiving device 100 of this embodiment may be one that uses a cooperative function between the broadcast receiving device 100 and the mobile information terminal 700, and further synchronizes with the broadcast timing of a commercial, and presents a related commercial app to both the broadcast receiving device 100 and the mobile information terminal 700. Alternatively, in a paid service available on the broadcast receiving device 100, the broadcast cooperative app may check whether or not the user of the broadcast receiving device 100 has subscribed to the paid service, and change the display of the broadcast receiving device 100 and / or the mobile information terminal 700 according to the result. In the broadcast receiving device 100 of this embodiment, regardless of which broadcast cooperative app is executed, it is possible to enjoy the effects described using FIG. 13A, FIG. 13B, etc.
[0164] [Broadcast receiving device error display screen] FIG. 14 is a screen display diagram showing an example of an error display screen when it is determined that the broadcast linked application cannot be executed by checking the application profile 904 of the acquired AIT data string in the processing of S105 in FIG. 7A, the processing of S207 in FIG. 7B, the processing of S308 in FIG. 7C, the processing of S605 in FIG. 8C, etc., when there is an insufficient description of the AIT, or when acquisition of the AIT has failed, etc.
[0165] In the broadcast receiving device 100 of the present embodiment, when it is determined that the broadcast cooperative app cannot be executed, the reason why the broadcast cooperative app cannot be executed, such as the result of checking the application profile 904, is displayed in the error message 173d1. For example, when the result of checking the application profile 904 indicates that a predetermined optional function is lacking on the television receiver side, the fact is displayed in the error message 173d1. An error code and a guide (such as a URL) to the television receiver manufacturer's homepage in which an explanation of the error code is described may be displayed. Alternatively, when the broadcast cooperative app is acquired from a network, the network connection status is naturally checked in advance. At this time, when the broadcast cooperative app cannot be acquired due to, for example, a defective connection of a LAN cable, the fact is displayed in the error message 173d1. In addition, the error message 173d1 may be displayed when the network connection is established but the broadcast cooperative app cannot be acquired correctly due to a poor error situation. The error message 173d1 may be displayed when the broadcast cooperative app is not yet in a state where it can be executed while the broadcast cooperative app is being acquired. The error message 173d1 may also be displayed when the broadcast wave reception is unstable and, although the AIT and other information was initially received, the AIT and other information can no longer be received halfway through. In such a case, if the broadcast-linked app acquired from each server device is cached as is, it can be used as is after the broadcast wave reception is restored.
[0166] Also, if the result of checking the application profile 904 shows that the television receiver lacks a predetermined optional function, an error message 173d1 may be displayed to recommend checking or updating the latest firmware for the television receiver. Alternatively, the broadcast receiving device 100 may automatically check or update the latest firmware. Alternatively, if the broadcast linked app can be executed by adding paid optional hardware or optional software to the television receiver, a guide to the paid optional hardware or optional software may be displayed. Note that the error message 173d1 may be displayed on the mobile information terminal 700 instead of the broadcast receiving device 100.
[0167] [Broadcast linkage app execution screen on mobile information terminal] Fig. 15 is a screen display diagram showing an example of the broadcast cooperative application (terminal side) execution screen displayed in the process of S619 in Fig. 9. The broadcast cooperative application execution screen 741c shown in Fig. 15 is composed of a main window 741c1, a sub window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may be further added.
[0168] In this embodiment, the broadcast cooperative application (terminal side) executed by the mobile information terminal 700 is an application for checking details of a broadcast program being displayed on the broadcast receiving device 100. The main window 741c1 displays the same image as the broadcast program screen being displayed on the broadcast receiving device 100, and the sub window 741c2 displays an enlarged image of a position designated by a selection marker 741c3. The position of the selection marker 741c3 can be changed by selecting cursor keys 741c4 and 741c5. The commentary display section 714c6 displays commentary subtitles about the broadcast program being displayed on the main window 741c1 and comments posted by other users about the broadcast program. The end button 741c7 is a button for ending the operation of the broadcast cooperative application (terminal side).
[0169] By running the broadcast cooperative application (terminal side) on the mobile information terminal 700, the broadcast receiving device 100 and the mobile information terminal 700 can operate in cooperation with each other to expand the functionality of the broadcast communication cooperative service.
[0170] [EPG screen of broadcast receiving device] 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving device 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcast service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. It is assumed that the EPG display screen 173e is displayed on the video display unit 173 by selecting the program guide key 741a7 on the basic screen 741a of the cooperative control application.
[0171] In this embodiment, the EPG display screen 173e is in a matrix shape with the vertical axis representing time and the horizontal axis representing service ID (channel), and displays detailed information about each broadcast program broadcast on each channel during each time period. As shown in Fig. 16A, detailed information 173e1 about each broadcast program is mainly composed of a title area 173e2 and a detailed description area 173e3.
[0172] The title area 173e2 displays the program title of each broadcast program and a symbol representing the attributes of each broadcast program. The symbol representing the attributes of each broadcast program is, for example, a symbol representing "New" meaning that it is a new program, or a symbol representing "Replay" meaning that it is a rebroadcast program. Alternatively, a symbol representing "data" meaning that it is compatible with data broadcasting by a broadcasting service may be used. In addition, if the broadcast program is prepared for a broadcast linkage application that can be executed by the broadcast receiving device 100 of this embodiment, a symbol representing "Linkage" indicating this may be used. The detailed explanation area 173e3 displays related information such as the program content and performers of each broadcast program, and the URL of a homepage introducing each broadcast program.
[0173] In addition, the symbolized mark of "Linkage" displayed in the title area 173e2 may not be displayed if the result of checking the application profile 904 indicates that the broadcast program cannot be executed on the information display device 100, even if a broadcast-linked application is prepared for the broadcast program. Furthermore, the symbolized mark of "Linkage" displayed in the title area 173e2, which indicates that the broadcast program has an executable broadcast-linked application prepared, may further have its color, shape, font, etc. changed depending on whether or not a linked operation with a mobile terminal device is possible. If a linked operation with a mobile terminal device is possible, a symbolized mark of "Mobile" may be displayed together with the symbolized mark of "Linkage".
[0174] The presence or absence of the mark symbolizing "Linkage" or the mark symbolizing "Mobile" may be controlled by acquiring information, which is previously described in EIT information including detailed information of each broadcast program, such as whether each broadcast program is a broadcast program for which a broadcast-linking app executable by the broadcast receiving device 100 of this embodiment is prepared, whether the executable broadcast-linking app is capable of operating in conjunction with a mobile terminal device, etc. Alternatively, the information acquired from program distribution information of a digital broadcast program prepared in a predetermined server device on the Internet 200 may be added to an electronic program guide created based on a program information data string acquired from the broadcast waves of a digital broadcast service.
[0175] As described above, by displaying on the EPG display screen 173e a symbolized mark of "Linkage" indicating that the broadcast program is prepared for an executable broadcast-linked application and a symbolized mark of "Mobile" indicating that a linked operation with a mobile terminal device is possible, the user can easily grasp the compatibility of each broadcast program with the broadcast-communication linked service in the broadcast receiving device 100. Needless to say, the symbolized mark of a predetermined character indicating the attribute of each broadcast program may be replaced with the character itself or a sentence. The compatibility of each broadcast program with the broadcast-communication linked service may be indicated by changing the background color of the detailed information 173e1 of each broadcast program. Also, the symbolized mark of "Linkage" or the symbolized mark of "Mobile" may not be displayed in the title area 173e2 normally, but may be displayed in a pop-up only when each broadcast program is selected by the program selection cursor 173e4.
[0176] The broadcast receiving device 100 of this embodiment has a function of making a reservation for viewing and / or recording of each broadcast program on the EPG display screen 173e. For example, while the EPG display screen 173e is displayed, the program selection cursor 173e4 on the EPG display screen 173e is moved using the cursor keys 741ac on the basic screen 741a of the cooperative control application, and an arbitrary broadcast program is selected using the enter key 741ad, thereby making a reservation for viewing and / or recording of the selected broadcast program.
[0177] In the above process, if the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program compatible with the broadcast communication cooperation service, the viewing reservation and / or recording reservation may be used as a trigger to start acquiring a broadcast cooperative app prepared for the broadcast program without waiting for the broadcast start time of the broadcast program. That is, information specifying the acquisition destination of the broadcast cooperative app (location information such as a URL) is written in EIT information including detailed information of each broadcast program. In this way, the broadcast receiving device 100 can grasp the information on the acquisition destination of the broadcast cooperative app prepared for each broadcast program at the time the broadcast program is selected with the program selection cursor 173e4. Therefore, the broadcast receiving device 100 can start acquiring the broadcast cooperative app before the broadcast start time of the broadcast program.
[0178] In addition, if the broadcast program for which the viewing reservation and / or recording reservation has been made is a broadcast program compatible with the broadcast communication cooperation service and is capable of cooperation with a mobile terminal device, the broadcast cooperation app (terminal side) prepared for the mobile terminal device may also start acquiring the broadcast cooperation app before the broadcast start time of the broadcast program in the same manner as described above. Also, as shown in Fig. 16B, a two-dimensional barcode 173e5 or the like indicating information on the acquisition destination (location information such as a URL) of the broadcast cooperation app (terminal side) prepared for the mobile terminal device may be displayed on the EPG display screen 173e to prompt the user to download the broadcast cooperation app (terminal side) prepared for the mobile terminal device.
[0179] In this way, if the broadcast receiving device 100 refers to the acquisition destination information of the broadcast linked app included in the EPG information and starts acquiring the broadcast linked app before the broadcast start time of the broadcast program, it becomes possible to distribute the load of the service provider server 400 that stores the broadcast linked app. Also, even if the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, it becomes possible to effectively use the broadcast linked app immediately after the broadcast start of the broadcast program.
[0180] FIG. 17 is an operational sequence diagram showing an example of a broadcast cooperative app acquisition sequence when a broadcast program viewing reservation and / or recording reservation is made on the EPG display screen 173e.
[0181] During viewing of a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires a program information data sequence output from the first separation unit 132 (S701). When a user requests the start of an EPG screen using an operation terminal (S702), an EPG display screen 173e is displayed on the video display unit 173 (S703). When a user selects an arbitrary broadcast program on the EPG display screen 173e using an operation terminal to schedule viewing and / or recording of the broadcast program (S704), the main control unit 101 checks the program information data sequence acquired from the first separation unit 132 (S705), and further checks the location of the acquisition destination of a broadcast linked app linked to the broadcast program scheduled for viewing and / or recording (S706).
[0182] After the process of S706, the application control unit 161 transmits a transmission request for the broadcast cooperative app to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). The service provider server 400 that has received the transmission request for the broadcast cooperative app performs authentication processing for the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then distributes the predetermined broadcast cooperative app stored in the application storage area 4013 via the LAN communication unit 421 (S708). Next, the application control unit 161 caches the predetermined broadcast cooperative app received from the service provider server 400 via the LAN communication unit 121 in the RAM 104 or the storage 110 (S709).
[0183] According to the above-described transmitting / receiving device 100 of this embodiment, it is possible to execute functions with higher added value. EXAMPLES
[0184] The following describes the second embodiment of the present invention. The configuration and effects of the second embodiment are the same as those of the first embodiment unless otherwise specified. Therefore, the following mainly describes the differences between the second embodiment and the first embodiment, and omits descriptions of common points as much as possible to avoid duplication.
[0185] In the first embodiment, a mobile information terminal cooperation process (hereinafter referred to as terminal cooperation) is performed. Having described the above, further detailed embodiments will now be described.
[0186] When performing mobile information terminal cooperation, there are cases where it is desired to restrict the use of terminal cooperation to only mobile information terminals 700 that are in the same house as broadcast receiving device 100 (hereinafter, this restriction will be referred to as "same-house restriction"). For example, in an application for using broadcast cooperation (hereinafter, referred to as "broadcast cooperation application"), the display screen of broadcast receiving device 100 and the display screen of mobile information terminal 700 are closely related, or when it is desired to ensure that the user of mobile information terminal 700 can view advertising video displayed on broadcast receiving device 100.
[0187] Note that one point to consider in the procedure is whether or not the broadcast-linked app in question imposes a same-house restriction. If it is assumed that all broadcast-linked apps are subject to a same-house restriction, this determination is not necessary. However, if there are cases where there is no restriction, the broadcast receiving device 100 needs to obtain control information regarding the presence or absence of a same-house restriction and change the operation procedure. This control information regarding the presence or absence of a restriction may be obtained from a broadcast signal (for example, described as an item in the AIT) or may be obtained from a server designated by the broadcast station.
[0188] Including the above procedure, in this embodiment, a procedure for ensuring that the portable information terminal 700 is present in the same home as the broadcast receiving device 100 will be described.
[0189] Usually, devices existing in the same home are on a local network connected to the same router device 210. Therefore, when the mobile information terminal 700 is connected to the same local network as the broadcast receiving device 100, it can be determined that the devices are in the same home. Note that whether or not a target device is connected to a local network can be determined using a known method, and therefore a description thereof will be omitted.
[0190] Furthermore, even if the mobile information terminal 700 is not on the local network, it can be determined that it is present in the same house by directly communicating with the broadcast receiving device 100 by NFC, BlueTooth, infrared communication, etc. In this case, the communication for acquiring the broadcast cooperative app, etc. may be the above-mentioned direct communication or may be by mobile telephone communication.
[0191] As described above, there are multiple possible methods for confirming that the devices are in the same house. The method to be used is described, for example, in the AIT, which is read by the broadcast receiving device 100.
[0192] Furthermore, once it is confirmed that the mobile information terminal 700 is in the same home, it may be regarded as being in the same home until the program ends, or a certain valid time (for example, 10 minutes) may be set, during which it is regarded as being in the same home, but once the valid time has elapsed, it is not regarded as being in the same home unless a new confirmation is made. This valid time may be written in, for example, the AIT, and read by the broadcast receiving device 100.
[0193] Furthermore, for example, an event signal may be set in the broadcast signal at any time during the progress of a program, and whenever this event signal is received, it may be confirmed that the mobile information terminal 700 is present in the same home.
[0194] Furthermore, the first two methods can be used in combination.
[0195] Next, a specific procedure for permitting terminal cooperation only to the mobile information terminal 700 present in the same home will be described. In this embodiment, restrictions are set when the mobile information terminal 700 acquires a broadcast cooperation app or when it acquires information used in the broadcast cooperation app (hereinafter, the broadcast cooperation app and the information used in the broadcast cooperation app, specifically, HTML documents and streaming video, are collectively referred to as broadcast cooperation information). There are two types of methods for acquiring broadcast cooperation information: communication acquisition from the broadcast station server 300 or the business server 400, and broadcast acquisition from broadcast waves. In the case of communication acquisition, there are two types: acquisition after broadcast reception starts and acquisition before broadcast reception starts. Furthermore, in the case of communication acquisition, there are cases where the broadcast receiving device 100 acquires the information once and the mobile information terminal 700 acquires it from the broadcast receiving device 100, and cases where the mobile information terminal 700 acquires it directly from the broadcast station server 300 or the business server 400. There are various methods, but from the viewpoint of the mobile information terminal 700, they can be broadly divided into two: obtaining the information from the broadcast receiving device 100, and obtaining the information from the broadcast station server 300 or the business server 400.
[0196] In this embodiment, a case where the mobile information terminal 700 acquires broadcast cooperation information from the broadcast receiving device 100 will be described, and a case where the information is acquired from a server will be described in the next embodiment.
[0197] FIG. 18A shows the procedure of this embodiment.
[0198] First, before terminal cooperation is performed, a cooperation control application, which is an application for controlling terminal cooperation, is started in each of the mobile information terminal 700 and the broadcast receiving device 100 (S10001, S10002). In this state, the mobile information terminal 700 requests terminal cooperation from the broadcast receiving device 100 (S10003). Next, an AIT is acquired from the broadcast signal (S10004). From the information in this AIT, it is determined whether the application for the target mobile information terminal has a same-house restriction (S10006). If there is a restriction, the procedure proceeds to S10008. At the first stage where a terminal cooperation request is made, the procedure proceeds to step S10009, and it is determined whether the mobile information terminal 700 that made the terminal cooperation request is in the same house as the broadcast receiver 100 (S10009). If it is determined that they are not in the same house as a result of the determination, a response of cooperation non-permission is made to the cooperation control application on the mobile information terminal side, and the process ends (S10011).
[0199] Here, if it is assumed that all terminal link applications have the same-house restriction, the determination in S10006 is skipped. If there are both applications with and without the same-house restriction, the determination in S10006 is performed.
[0200] If it is determined that the mobile information terminal 700 is in the same house, or if the application does not have the same house restriction, the process proceeds to S10012, and a broadcast cooperative application related service is performed. In this service (S10012), a broadcast cooperative information distribution request (S10013) from the mobile information terminal 700 is processed, and broadcast cooperative information is distributed to the mobile information terminal 700 (S10018). This broadcast cooperative information includes information distributed by the broadcast receiving device 100 from a distribution server (S10014, S10015, S10016), information acquired from a broadcast signal (S10017), information stored in the broadcast receiving device 100, and the like. The broadcast receiving device 100 may receive the broadcast cooperative information (S10016, S10017) not only in response to a broadcast cooperative information distribution request (S10013) from the mobile information terminal 700, but also autonomously by the broadcast receiving device 100 or based on an event occurrence from a broadcast signal. The broadcast linkage information may be delivered to the portable information terminal 700 (S10018) voluntarily from the broadcast receiving device 100 side.
[0201] After a series of processes for receiving (obtaining) and distributing broadcast-related information is completed, the broadcast receiving device 100 determines whether or not the user is continuing to watch the same program (S10019), and if not, responds to the collaboration control app on the mobile information terminal side that collaboration is not permitted, and the process ends (S10020).
[0202] If viewing is continued, the procedure returns to S10005, and if there is a home restriction, it is confirmed whether the mobile information terminal 700 is in the same home (S10009), but it is determined whether a preset valid time has elapsed since the last confirmation, or whether a confirmation request (S10007) has occurred from a broadcast signal or distribution server since the last confirmation (S10008). If neither of these conditions is met, it does not check whether it is in the same home (S10009), and goes through S10010 to execute the next broadcast linked app related service (S10012). Here, the confirmation request from the broadcast signal (S10008) is described to be obtained from the broadcast linked information, but here, the event message is also described as being included in the broadcast linked information. Furthermore, this confirmation request may be described in the AIT.
[0203] The procedure described above is a loop processing procedure involving the broadcast signal, broadcast receiving device 100, mobile information terminal 700, and distribution server in the section indicated by the arrow of S10022. The confirmation request of S10007 may be made at any time within the loop.
[0204] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10015). This makes it possible to confirm that the authentication request is legitimate. Also, by changing the authentication information described in the AIT as the program progresses and not performing authentication unless the authentication key in the authentication server incorporates information synchronized with the program progress, it is possible to confirm that the same program is being continuously viewed. In this case, the information in the AIT is read and updated as appropriate (S10021). Note that the authentication information to be incorporated in the broadcast signal may be incorporated as broadcast linkage information in addition to being described in the AIT. Furthermore, as a method for practically changing the authentication information, a method of changing the URL of the distribution server itself as the program progresses can also be used.
[0205] In this way, while executing the broadcast-linked app-related service (S10012), the mobile information terminal 700 checks whether it is in the same house as the broadcast receiving device 100 at every preset valid time or every time there is a confirmation request from a broadcast signal or a distribution server, thereby making it possible to appropriately execute broadcast-related apps with same-house restrictions. Furthermore, by using authentication information incorporated in the broadcast signal for authentication at the distribution server, it is possible to ensure the legitimacy of the distribution request, and by appropriately changing the authentication information of the broadcast signal, it is also possible to confirm that the same program is being continuously viewed.
[0206] According to the mobile information terminal cooperation technique according to the present embodiment described above, it is possible to realize the same-home restriction for mobile information terminals that cooperate with a broadcast receiving device. EXAMPLES
[0207] In this embodiment, a case will be described in which the portable information terminal 700 acquires broadcast cooperation information from a distribution server.
[0208] FIG. 18B shows the procedure of this embodiment.
[0209] First, before terminal cooperation is performed, a cooperation control application, which is an application for controlling terminal cooperation, is started in each of the mobile information terminal 700 and the broadcast receiving device 100 (S10101, S10102). In this state, the mobile information terminal 700 issues a terminal cooperation request to the broadcast receiving device 100 (S10103). Next, an AIT is acquired from the broadcast signal (S10104). Information such as a URL related to the distribution server is acquired from the information in the AIT, and the information is transmitted to the mobile information terminal 700 (S10105). Next, a time confirmation request is issued from the broadcast receiving device 100 to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving device 100 (S10107). This allows the subsequent authentication key issuance (S10115) to be performed in accordance with the time of the distribution server, but if the time difference is not a problem, this may be omitted.
[0210] From this point on, the process enters the loop control indicated by the arrow at S10127.
[0211] First, the mobile information terminal 700 issues an authentication key issuance request or a broadcast linked information distribution request to the broadcast receiving device 100 (S10109). The authentication key is used in a broadcast linked information distribution request to the distribution server in the following step (S10125). The broadcast linked distribution request in S10109 is a distribution request for information acquired from a broadcast signal, and corresponds to the procedure in S10126 in the following step.
[0212] In any case, when the request of S10109 is issued from the mobile information terminal, it is determined whether the broadcast linked application has a same-house restriction (S10111), and if there is a restriction, proceed to the next step S10112, and if not, skip the step S10112 and proceed to S10114. If all broadcast linked applications have a same-house restriction, the determination of S10111 is not performed and proceed to S10112. In S10112, it is determined whether the mobile information terminal that issued the request is in the same house, and if not, the terminal linkage is terminated (S10113). If it is in the same house, the requested procedure is performed, that is, acquisition of broadcast linked information from the distribution server (S10125) or acquisition of broadcast linked information from the broadcast signal (S10126). Since acquisition from the broadcast signal may occur in addition to acquisition from the distribution server, the procedure of S10126 is also described.
[0213] First, the procedure for acquiring broadcast linkage information from the distribution server (S10125) will be described.
[0214] First, the broadcast receiver 100 issues the authentication key requested by the information linking terminal 700. At this time, the authentication key includes time information at the time of issuance and is valid only for a predetermined period of time (for example, 10 minutes). The distribution server checks the authentication information, including whether the authentication key is within the valid period, and allows the distribution of broadcast linking information if the authentication is OK. Thereafter, the distribution of information is allowed within the valid period, but the distribution is stopped when the valid period has elapsed. For example, streaming video cannot be viewed after the valid period has elapsed.
[0215] The preset validity time may be stored in a distribution server, or may be acquired by broadcast receiving device 100 from a broadcast signal (e.g., AIT) and the validity time information may be incorporated into the authentication key. The validity time information is notified to mobile information terminal 700 in advance, and the mobile information terminal 700 is made to request issuance of an authentication key before the validity time expires. Alternatively, the validity time may be managed by broadcast receiving device 100, and an authentication key may be automatically issued to mobile information terminal 700 from broadcast receiving device 100 before the validity time expires after confirming that mobile information terminal 700 is in the same home.
[0216] The validity period may be the same throughout a program, or may change as the program progresses. If no validity period is set, authentication may be valid for the duration of the program once authentication is performed.
[0217] Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10117). This makes it possible to confirm that the authentication request is legitimate. Also, by changing the authentication information described in the AIT as the program progresses and not performing authentication unless the authentication key in the authentication server has information synchronized with the program progress incorporated, it is possible to confirm that the same program is being continuously viewed. In this case, the information in the AIT is read and updated as appropriate (S10124). Note that the authentication information to be incorporated in the broadcast signal may be incorporated as broadcast linkage information in addition to being described in the AIT. Furthermore, as a method for practically changing the authentication information, a method of changing the URL of the distribution server itself as the program progresses can also be used. Note that the URL change in this case is when the distribution server is the same but the entrance is different, but it may also be changed to a new distribution server due to a change in the broadcast linkage app, etc. In this case, the procedures of transmitting distribution server information (S10105), requesting time confirmation (S10106), and transmitting time information (S10107) are performed each time a change is made.
[0218] Next, the procedure for acquiring broadcast linkage information from a broadcast signal (S10126) will be described.
[0219] In this case, after it is confirmed that the portable information terminal 700 is in the same home, the broadcast receiving device 100 acquires broadcast cooperation information from the broadcast signal (S10119), and then distributes the information to the portable information terminal 700 (S10120).
[0220] In addition, when the broadcast linked information is changed as the program progresses, a notification of the change may be issued from the broadcast signal (S10110), and the notification may trigger the acquisition of the broadcast linked information. In this case, if the information is acquired from a distribution server, the broadcast receiving device 100 issues an authentication key to the mobile information terminal (S10115) and notifies the mobile information terminal that a change notification has been received. If the information is acquired within a valid time, the issuance of the authentication key may be omitted, and only the change notification may be notified. In the case of acquisition from a broadcast signal, the broadcast receiving device 100 acquires information (S10120) and distributes it to the mobile information terminal (S10120). In addition, in the case of acquisition from a broadcast signal, it may be confirmed that the mobile information terminal 700 is in the same house for each change notification, and if the information is within a valid time, as in the second embodiment, the confirmation may be omitted. Here, the change notification from the broadcast signal (S10110) is described as being acquired from the broadcast linked information, but here, the event message is also described as being included in the broadcast linked information. Furthermore, this change notice may be included in the AIT.
[0221] After a series of processes for receiving (obtaining) and distributing broadcast-related information is completed, the broadcast receiving device 100 judges whether or not the user is continuing to watch the same program (S10121), and if not, responds to the cooperative control application on the mobile information terminal side that cooperation is not permitted, and ends the process (S10123). If the user is continuing to watch, the process returns to S10108, and the loop process S10127 continues.
[0222] In this way, by including time information in the authentication key used for authenticating the distribution server and managing the valid time, it is possible to periodically confirm that the mobile information terminal 700 is in the same home as the broadcast receiving device 100, and to appropriately execute broadcast-related applications that have same-home restrictions. Furthermore, by using the authentication information embedded in the broadcast signal for authentication at the distribution server, the legitimacy of the distribution request can be ensured, and by appropriately changing the authentication information of the broadcast signal, it is also possible to confirm that the same program is being continuously viewed.
[0223] According to the mobile information terminal linkage technology of this embodiment described above, it is possible to realize the same-home restriction even when a mobile information terminal linked to a broadcast receiving device obtains broadcast linkage information from a distribution server. EXAMPLES
[0224] In the second and third embodiments, the procedure for realizing the same-house restriction in terminal cooperation has been described, but depending on the broadcast cooperation app, use from outside the home may also be permitted. In this embodiment, such a case will be described. For example, when a program such as a TV shopping program itself is public relations and advertising, it is desirable for the broadcaster to be able to use the broadcast cooperation app regardless of whether the program is in the home or outside the home. In the case of such a program, once it is registered in the broadcast receiving device 100, the broadcast cooperation app may be permitted to be used regardless of whether the mobile information terminal 700 is in the home. In this case, convenience is further improved if there is a broadcast cooperation app that converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the Internet. The streaming data may be encrypted by the broadcast receiving device 100 for copyright protection. Whether or not the broadcast cooperation app permits use from outside the home, including distribution of the broadcast video to outside the home, is described in data (e.g., AIT) in the broadcast signal.
[0225] A specific procedure is shown in FIG. 18C. Since some of the procedures are common to the second and third embodiments, the explanation of the overlapping parts with the second and third embodiments will be omitted. When there is a terminal link request from outside the home (S10203), if the application is permitted for use outside the home, the broadcast receiving device 100 checks whether the request source is a registered mobile information terminal (S10205) and then permits the link. Here, if necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving device 100 for copyright protection of the broadcast video and broadcast link information (S10207). At that time, the authentication may be authentication in an authentication server (S10207). Information on whether copyright protection is necessary and information on the authentication method for copyright protection are obtained from the broadcast signal (for example, described in the AIT), and control is performed accordingly. If the information is not stored in the broadcast signal, a predetermined method is followed in the broadcast receiving device 100. For example, a predetermined copyright protection process may be performed. Also, if these pieces of information are not stored in the broadcast signal, it may be predetermined that copyright protection processing will not be performed in the broadcast receiving device 100. Specific examples of authentication for copyright protection are shown below. Only one of the following authentications may be performed. Alternatively, a combination of the multiple authentications exemplified below may be performed. Also, the authentications exemplified below may be performed in combination with other authentication processes not exemplified below.
[0226] [ID and password authentication] When the mobile information terminal 700 is registered in the broadcast receiving device 100, an ID and a password are issued, and the broadcast receiving device 100 permits cooperation by verifying this ID and password.
[0227] [Encryption key usage] In addition to the authentication using the ID and password described above, an encryption key for decrypting encrypted video data, etc. is transmitted from the broadcast receiving device 100 to the mobile information terminal. This encryption key may be obtained from a broadcast signal (for example, written in the AIT).
[0228] [Using an authentication server] In this method, an encryption key for decrypting encrypted video data, etc. is issued from an authentication server. The mobile information terminal 700 transmits an ID and a password to the authentication server and obtains the encryption key. In this case, security is further improved by obtaining location information (specifically, a URL) of the authentication server from a broadcast signal (e.g., described in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700. If the mobile information terminal 700 cannot obtain the encryption key, it cannot decrypt the video data, etc., so that the broadcast receiving device 100 may request authentication from the authentication server to serve as authentication for copyright protection, or the mobile information terminal 700 may notify the broadcast receiving device 100 that the encryption key has been obtained, thereby completing the authentication. Note that the authentication server may perform billing.
[0229] [Mutual authentication of encryption keys] The broadcast receiving device 100 and the mobile information terminal 700 mutually authenticate and confirm the encryption keys that they each have, thereby authenticating copyright protection.
[0230] When information stored in a broadcast signal indicates that copyright protection is required by a specified method, if the copyright protection cannot be authenticated by the specified method, terminal linkage is not permitted. Even if there is no designation in the broadcast signal and authentication is performed by a default method of the broadcast receiver 100, if the copyright protection cannot be authenticated by the default method, terminal linkage is not permitted.
[0231] If terminal linkage is permitted, thereafter, it is not confirmed whether the mobile information terminal 700 exists in the same house, and broadcast linkage information is distributed to the mobile information terminal 700 (S10217) and an authentication key for the distribution server is issued (S10212) in accordance with a request from the mobile information terminal 700 (S10211), autonomous control of the broadcast receiving device 100, and a request from the broadcast signal (S10210). In this case, control with a set valid time does not have to be performed. The mobile information terminal 700 outside the house acquires the broadcast linkage information from the broadcast receiving device 100 or the distribution server using the issued authentication key (S10215). In addition, if the authentication key issued by the broadcast receiving device 100 incorporates authentication information acquired from the broadcast signal (for example, described in the AIT), and the distribution server allows access if the authentication key incorporates the authentication information acquired from the broadcast signal, it is possible to further improve the appropriateness of outside use.
[0232] Furthermore, in some cases, such as when offering a discount as a premium for viewing a program, it may be better not to permit unlimited use of the broadcast-linked app. In such cases, it is preferable to perform authentication once while the mobile information terminal is in the same home, and then permit use of the distribution server even if the mobile information terminal is not in the same home. In this case, it does not matter if the mobile information terminal 700 is not registered in the broadcast receiving device 100.
[0233] A specific procedure in this case is shown in FIG. 18D. Some of the procedures are common to those in FIG. 18C, so the description of the overlapping parts will be omitted. First, when the portable information terminal 700 is in the same house as the broadcast receiving device 100, the portable information terminal 700 makes a terminal cooperation request to the broadcast receiving device 100, and the broadcast receiving device 100 confirms that the portable information terminal 700 is in the same house (S10305) and then permits cooperation. Here, if necessary, authentication may be performed between the portable information terminal 700 and the broadcast receiving device 100 for copyright protection of the broadcast video and broadcast cooperation information (S10307). In this case, the authentication may be authentication in an external authentication server. Information on whether copyright protection is necessary and information on the authentication method of copyright protection are obtained from the broadcast signal (for example, described in the AIT), and control is performed accordingly. If the information is not stored in the broadcast signal, a predetermined method is followed in the broadcast receiving device 100. For example, a predetermined copyright protection process may be performed. Furthermore, if such information is not stored in the broadcast signal, it may be determined in advance that the broadcast receiving device 100 will not perform copyright protection processing.
[0234] Specific examples of authentication for copyright protection are shown below. Each of the following authentications may be performed alone. Alternatively, a combination of the following authentications may be performed. Also, the following authentications may be performed in combination with other authentication processes not shown in the following examples.
[0235] [Encryption key usage] When the mobile information terminal 700 is in the same home, an encryption key for decrypting encrypted video data, etc. is transmitted from the broadcast receiving device 100 to the mobile information terminal. This encryption key may be obtained from a broadcast signal (for example, written in the AIT). The delivery of this encryption key within the same home constitutes authentication. Furthermore, if the encryption key can only be obtained from the broadcast signal at a certain point in the program and the delivery of the encryption key to the mobile information terminal 700 is limited to within the same home, a restriction can be imposed that the user must be in the same home at that time, which can also be used to give a premium to viewing.
[0236] [Using an authentication server] A method in which an authentication server issues an encryption key for decrypting encrypted video data, etc. The mobile information terminal 700 transmits an ID and a password to the authentication server and obtains an encryption key. In this case, security is improved by obtaining location information (specifically, a URL) of the authentication server from a broadcast signal (for example, written in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700. If the mobile information terminal 700 cannot obtain an encryption key, it cannot decrypt the video or the like. Therefore, the broadcast receiving device 100 may request authentication from the authentication server to protect copyright, or the mobile information terminal 700 may notify the broadcast receiving device 100 that it has obtained the encryption key to complete the authentication. The authentication server may be accessed either inside or outside the home, but if the location information of the authentication server can be obtained from the broadcast signal only at a certain point in the program and the location information is only passed to the mobile information terminal 700 within the same home, a restriction can be imposed that the user must be in the same home at that time, and this can also be used to give a premium to viewing. The authentication server may charge a fee.
[0237] [Mutual authentication of encryption keys] The broadcast receiving device 100 and the mobile information terminal 700 mutually authenticate and confirm the encryption keys that they each have, thereby authenticating copyright protection. This authentication may be performed either inside or outside the home.
[0238] When information stored in a broadcast signal indicates that copyright protection is required by a specified method, if the copyright protection cannot be authenticated by the specified method, terminal linkage is not permitted. Also, even if there is no designation in the broadcast signal and authentication is performed by a default method of the broadcast receiver 100, if the copyright protection cannot be authenticated by the default method, terminal linkage is not permitted. The procedure after terminal linkage is permitted is the same as the procedure in Fig. 18C, so the explanation will be omitted.
[0239] According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use of a mobile information terminal that cooperates with a broadcast receiving device from outside the home while paying attention to copyright protection. EXAMPLES
[0240] In actual usage, it is more desirable to easily know whether a terminal link application is available for a program and which terminal link application is available. In this embodiment, a method for displaying the availability status of a terminal link application will be described.
[0241] FIG. 19A is an example of a launcher screen (173b11) of a broadcast cooperative application when a terminal cooperative application is present. The broadcast cooperative application is displayed as an icon of framed characters. Broadcast cooperative applications (173b12-173b14) for the broadcast receiving device 100 and broadcast cooperative applications (173b15-173b17) for the mobile information terminals that are linked to the program being viewed are displayed. In this example, the thickness of the frame surrounding the character string and the color of the frame indicate the status of the application. The main application A and B (173b12, 173b13) and the terminal application A and B (173b15, 173b16) are in an available state, and the main application C (173b14) and the terminal application (173b17) are in an unavailable state. The unavailable state of the terminal application means that none of the mobile information terminals 700 that are in a state capable of communicating with the broadcast receiving device 100 has a function to execute the application.
[0242] Fig. 19B is a screen that appears after terminal application A is selected in Fig. 19A. It shows the state of each mobile information terminal 700 related to terminal application A. The mobile information terminals displayed on this screen are terminals that have cooperated with broadcast receiving device 100 in the past or are registered.
[0243] The icons with solid borders indicate that mobile terminal 1 (173b22) and mobile terminal 2 (173b23) are in a state where they can communicate with the broadcast receiving device 100, while the icons with dotted borders indicate that they are not in a state where they can communicate with the broadcast receiving device 100. In addition, the icons with white borders indicate that mobile terminal 1 (173b22) and mobile terminal 3 (173b24) have the function of executing terminal application A, while the icons with gray borders indicate that mobile terminal 2 (173b23) and mobile terminal 4 (173b25) do not have the function of executing terminal application A. Furthermore, if the application is already running on the terminal, an icon with a design that indicates this may be used.
[0244] Additionally, icons are easier to understand visually if they are made out of pictures, as shown in the following example.
[0245] 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperative applications. In addition to the broadcast receiving device 100, icons are shown for each type of mobile information terminal 700. Icons 173b32 and 173b33 are icons indicating the broadcast receiving device 100, icons 173b34 and 173b35 are icons indicating a smartphone type mobile information terminal 700, and an icon 173b36 is an icon indicating a head mounted display type mobile information terminal 700. Each application is for the device indicated by the icon.
[0246] In Fig. 19C, when the application cannot be used, a mark indicating that the application cannot be used (in this case, a circle with a diagonal line) is displayed superimposed on the image of the device. Also, for the broadcast receiving device 100, when the application is already running, a mark indicating this (in this case, a circle with a dot) may be displayed superimposed. This display makes it possible to prevent a wasteful operation of proceeding with the launcher procedure even though the application is already running. In the case of the mobile information terminal 700, a method is also possible in which a mark indicating that the application is running is displayed when the application is running on all terminals that are capable of communicating with the broadcast receiving device and that can run the application.
[0247] FIG. 19D is a screen (173b41) after selecting application C (173b34) in FIG. 19C. The state of the mobile information terminal 700 of the type corresponding to application C is shown. In this screen, when the mobile information terminal 700 does not have the execution function of the broadcast cooperative application, when it is not in a state in which communication with the broadcast receiving device 100 is possible, or when the broadcast cooperative application is already being executed, a mark representing each of these is displayed superimposed on the icon. In this example, when it does not have the execution function, a circle with a line (173b44, 173b46) is displayed, when it is not in a state in which communication is possible, a triangle with an exclamation point (173b45, 173b46) is displayed, and when it is already being executed, a circle with a dot (173b43) is displayed.
[0248] Furthermore, it is desirable to have a display method that allows users to know that there is a broadcast-linked app when the situation changes without having to start a launcher each time. For example, when the power is turned on, when the channel is changed, when the broadcast-linked app is changed at the beginning or middle of a program, when the communication status between the broadcast receiving device 100 and the mobile information terminal 700 changes, or when the execution status of the app changes, an icon is displayed for a predetermined period of time to show the status at that time.
[0249] An example of this case is shown in Figure 19E. When an icon showing the type of device is displayed, it indicates that there is a broadcast-linked app that is compatible with that type of device. In this case, a circle with a diagonal line indicates that there is no device of that type that is in a usable state that can run the app. A circle with a dot indicates that the app is running on all devices of that type that are in a usable state.
[0250] FIG. 19F shows a display screen (10401) on the mobile information terminal 700. When requesting terminal cooperation from the mobile information terminal 700, it is convenient to know which broadcast cooperation app can be used on which broadcast receiving device 100 in a list. FIG. 19F shows an example of the list (10402). This table shows which broadcast receiving device 100 in the home can use the broadcast cooperation app corresponding to the program to be searched. If the status of each broadcast receiving device 100 is also displayed, it is more convenient, especially when using from outside the home. In this example, display examples such as receiving the program, receiving another program, free, and other program reservation (when recording of another program is reserved from the middle of the program) are shown. Note that here, if there are multiple tuners in the broadcast receiving device 100, it is even more convenient to display the status for each of the multiple tuners. In table 10202, tuners in the same device are distinguished by sub-numbers. For example, receiving device B-1 and receiving device B-2 are tuners in the same broadcast receiving device 100. In the case of terminal linkage, if broadcast video and audio can be received as streaming data, there is no need to use the video unit of the broadcast receiving device 100, and broadcasting can be used if the tuner in the broadcast receiving device 100 can be used, so it is convenient to know the usage status of each tuner.
[0251] In order to perform the display described in this embodiment, information is required for each broadcast cooperative app as to whether the app is compatible with the broadcast receiving device 100 or what type of mobile information terminal 700 the app is compatible with. Also, information is required for the broadcast receiving device 100 and the mobile information terminal 700 to execute the compatible app. This information can be obtained by the information receiving device 100 by describing it in the AIT, for example.
[0252] According to the mobile information terminal cooperation technology of this embodiment described above, by displaying information related to the broadcast cooperation app, the broadcast receiving device 100, and the mobile information terminal 700, it becomes possible to use a more convenient broadcast cooperation service. EXAMPLES
[0253] The following describes Example 6 of the present invention. Note that unless otherwise specified, the configuration and effects of this example are the same as those of Examples 1 to 5. Therefore, the following mainly describes the differences between this example and Examples 1 to 5, and omits descriptions of common points as much as possible to avoid duplication.
[0254] In the above first to fifth embodiments, the launch of the broadcast cooperative application has been mainly described, but the broadcast cooperative application is configured with an HTML document as described above. That is, transition between HTML documents is possible by a link.
[0255] FIG. 20 is a diagram showing the concept of transition between HTML documents and broadcast cooperative apps.
[0256] As described above, when the broadcast receiving device 100 is receiving a broadcast signal or is executing a BML document to display data broadcast screen information (20000), a broadcast cooperative application is started. This is referred to as a first broadcast cooperative application 20110. The first broadcast cooperative application 20110 is started automatically by the AIT or by a user instruction. When the first broadcast cooperative application 20110 is started, a first HTML document 20111, which is an entry document, is executed.
[0257] As shown in the drawing, the first broadcast cooperative application 20110 includes four HTML documents 20111 to 20114. Therefore, here, the four HTML documents 20111 to 20114 become the application boundary of the first broadcast cooperative application 20110. Also, in each HTML document, a link to other HTML documents is arranged, and mutual transitions between the respective HTML documents are possible.
[0258] Furthermore, a transition can be made from the third HTML document 20113 of the first broadcast cooperative app 20110 to the second broadcast cooperative app 20120. The second broadcast cooperative app 20120 is composed of two HTML documents 20121 and 20122, and these two HTML documents 20121 and 20122 are the application boundary of the second broadcast cooperative app 20120. Similarly to the first broadcast cooperative app 20110, a transition can be made between the two HTML documents 20121 and 20122.
[0259] Next, the operation of this embodiment will be described using as an example a broadcast cooperative application that overlays a broadcast cooperative application section 173c1 such as a weather forecast on a broadcast program screen (broadcast program video) 173c as shown in Fig. 13A. An example of an HTML document of this broadcast cooperative application is shown in Fig. 21. As shown in Fig. 21, an HTML document 20200 of the broadcast cooperative application is made up of a document declaration 20210 and an html element 20220.
[0260] The document declaration 20210 indicates the type and version of HTML description used in the HTML document 20200, and is shown in FIG.<!DOCTYPE html> indicates compliance with the HTML5 standard.
[0261] The html element 20220 includes a head element 20230 and a body element 20240. The head element 20230 includes a title element indicating the title of the HTML document 20200, a meta element, a link element, etc. Note that the contents of the head element are omitted in FIG.
[0262] The body element 20220 represents the main body of the HTML document 20200, and describes a command 20251 for presenting the broadcast program screen 173c on the video display unit 173, a command 20252 for displaying the broadcast cooperative application unit 173c1, and the like. An example of the command 20251 for presenting the broadcast program screen 173c is <object type="”video / x-iptvf-broadcast”">< / object>A detailed description of the command 20252 for displaying the broadcast cooperative application section 173c and other commands will be omitted.
[0263] In the above, we have explained the case where an HTML document contains a command to display a broadcast program screen (broadcast program video), but as a result of transitioning between HTML documents, there may be cases where an HTML document is executed that does not contain a command to display a broadcast program screen.
[0264] Fig. 22 is an example of an HTML document of a broadcast cooperative application in which a command for presenting a broadcast program screen is not described. The HTML document 20201 includes a document declaration 20211 and an html element 20221, and the html element 20221 includes a head element 20231, a body element 20241, and the like. As shown in the figure, the body element 20241 does not include a command for presenting a broadcast program screen. An application execution image of this HTML document 20201 is shown in Fig. 23. As shown in the figure, only the broadcast cooperative application section 173c1 is displayed on the video display section 173.
[0265] In normal use, the user does not check the contents of the HTML document, and therefore, unless the HTML document is executed, the user cannot know whether the command for presenting the broadcast program screen is written in the HTML document. That is, when the HTML document is executed and the broadcast program screen is not displayed on the video display unit 173, the user realizes that the command for presenting the broadcast program screen is not written. The original function of the broadcast receiving device 100 is to watch a broadcast program, but if the HTML document does not have a command for not displaying the broadcast program video, the original function cannot be executed. Therefore, in the sixth embodiment, the broadcast program video can be displayed even if the HTML document does not have a command for not displaying the broadcast program video. The broadcast receiving device 100 of the sixth embodiment operates as follows.
[0266] 24 is a diagram showing an operation sequence of the broadcast receiving device 100 in Example 6. This flowchart shows operations when a new HTML document is executed, such as starting / transitioning a broadcast cooperative app and transitioning an HTML document.
[0267] When a new HTML document is executed, the HTML is first read (S20001), and the read HTML document is executed (S20002). That is, step S2002 is the execution of the broadcast cooperative application, and the operation is the same as that of the above-mentioned embodiments 1 to 5.
[0268] In the broadcast receiving device 100 in the sixth embodiment, the following process is performed in parallel with step S20002 for executing the HTML document. First, it is confirmed whether or not a command for presenting a broadcast program screen is present in the description of the read HTML (S20003). This is done, for example, when the HTML document contains <object type="”video / x-iptvf-broadcast”">< / object> If there is no command to present a broadcast program screen (S20003-No), the process proceeds to step S20004 to check whether the broadcast program screen is being displayed on video display unit 173. If it is not being displayed (S20004-No), necessity confirmation display unit 173f, which is a confirmation of necessity of displaying the broadcast program screen, is displayed on video display unit 173 (S20005).
[0269] 25 is a display example of the necessity confirmation display section 173f. As shown in the figure, in addition to the broadcast cooperative application section 173c1, the necessity confirmation display section 173f is displayed by OSD processing or the like to notify the user that the broadcast program screen will not be displayed in the broadcast cooperative application being executed. Also, here, a Yes button 173f1 and a No button 173f2 are displayed so that the user can select. Here, when the Yes button 173f1 is selected (S20006-Yes), a sub-window 173g1 is created (S20007), and the broadcast program screen is displayed in the sub-window 173g1 (S20008).
[0270] 26 is a display example of sub-window 173g1. As shown in the figure, sub-window 173g1 is provided on broadcast cooperative application section 173c1, and a broadcast program screen is displayed therein. In this way, even if the HTML document to be executed does not contain a command to present a broadcast program screen, the broadcast program screen is displayed, thereby enabling viewing of a broadcast program, which is the original purpose of broadcast receiving device 100.
[0271] After displaying the broadcast program screen in the sub-window 173g1, the process proceeds to step S20009 to confirm whether the erase button has been selected. The erase button is provided on the operating terminal (mobile information terminal 700, remote control, etc.), and when the user selects the erase button (S20009-Yes), the sub-window 173g1 is deleted (hidden) (S20010). In step S20004 to confirm whether the broadcast program screen is being displayed in the video display unit 173, if the broadcast program screen is displayed (S20004-Yes), the process proceeds to step S20009 to confirm whether the erase button has been selected, and when the user selects the erase button (S20009-Yes), the sub-window 173g1 is deleted (hidden) (S20010). This is a state in which the broadcast program screen has been displayed in the sub-window 173g1 since before transition to the currently executed HTML document. Therefore, the display of the broadcast program screen by the sub-window 173g1 continues until the user selects the erase button. Here, the reason why the erase button or the operation unit for executing the above-mentioned erase function is provided is to accommodate the case where the user wishes to hide the broadcast program screen after the broadcast program screen has been displayed.
[0272] If the No button 173f2 is selected in the necessity confirmation display section 173f (S20006-No), that is, if the user does not want to display the broadcast program screen, the process proceeds to step S20009, where it is confirmed whether the display button has been selected. The display button, like the erase button, is provided on the operation terminal (mobile information terminal 700, remote control, etc.), and if the user selects the display button (S20013-Yes), the process proceeds to step S20007, where a sub-window 173g1 is created. Here, the display button or the operation section for executing the display function is provided in response to the case where the user wants to display the broadcast program screen after hiding it. The operations from step S20007 onwards are the same as those after the Yes button 173f1 is selected, and therefore will not be described.
[0273] In step S20003, it is confirmed whether a command to present a broadcast program screen exists in the description of the HTML that has been read. If the command exists (S20003-Yes), in step S20011, it is confirmed whether a sub-window 173g1 exists. Since a sub-window 173g1 may be created and a broadcast program screen may be displayed before transitioning to the currently executed HTML document, in step S20009, it is confirmed whether a broadcast program screen is displayed. Furthermore, if a command to present a broadcast program screen exists in the description of HTML, the broadcast program screen will be displayed on the video display unit 173 in step S20002, in which the HTML document is executed. Therefore, if a sub-window 173g1 exists (S20011-Yes), the sub-window 173g1 overlaps with the broadcast program screen displayed in step S20002, so the sub-window 173g1 is deleted (S20012), and this process ends. If the sub-window 173g1 does not exist (S20011-No), the broadcast program screen is displayed in step S20002, so this process ends.
[0274] In the above explanation, the erase button and the display button are provided on the operation terminal (mobile information terminal 700, remote control, etc.), but they may be displayed as icons on the video display unit 173 and the user may select them.
[0275] The operations after step S20003 described above (processing A within the area surrounded by a dotted line in FIG. 24) are performed in parallel with the execution of the broadcast cooperative application. When a transition is made to another HTML document or another broadcast cooperative application, processing A is terminated.
[0276] In the above explanation, an example (FIG. 26) is shown in which a sub-window 173g1 is provided over the broadcast linked application section 173c1 and a broadcast program screen is displayed therein. However, there are cases in which part of the broadcast linked application section 173c1 is hidden by the sub-window 173g1 and cannot be seen.
[0277] Fig. 27 shows another example of the display of a broadcast program screen. As shown in Fig. 27, a region 173g2 (called a main window) is provided in addition to a sub-window 173g1 that displays a broadcast program screen, and the broadcast linked application section 173c1 is displayed in the main window 173g2. At this time, the broadcast linked application section 173c1 is displayed in a reduced size according to the size of the main window 173g2. In this way, by separating the sub-window 173g1 and the main window 173g2, the entire broadcast linked application section 173c1 can be displayed.
[0278] In addition, in the above, an example has been described in which the broadcast linked app section 173c1 is displayed in a portion of the screen, but this is not limited to this, and the broadcast linked app section may be displayed on the entire screen.
[0279] Furthermore, the broadcast program screen may be displayed in the background and the broadcast cooperative application section 173c1 may be displayed in the foreground. In this case, the broadcast program screen may be displayed in full screen. When the broadcast cooperative application section 173c1 is displayed in the foreground and the broadcast program screen is displayed in full screen, the display will be as shown in FIG. 13A. Also, the display position of the broadcast cooperative application section 173c1 may be moved to a position where it does not overlap with the sub-window 173g1.
[0280] As described above, in the broadcast receiving device 100 according to the sixth embodiment of the present invention, if the HTML document to be executed does not contain a description of a command to present a broadcast program screen, a sub-window 173g1 is created and a broadcast program screen is displayed therein, thereby enabling viewing of a broadcast program, which is an inherent function of the broadcast receiving device 100. Note that in the sixth embodiment, step S20005 is provided for displaying the necessity confirmation display section 173f for confirming whether or not the broadcast program screen is to be displayed, but the necessity or non-necessity of the broadcast program screen display may be set in advance, and processing may be performed automatically according to the setting. For example, if the necessity is set, step S20004 for confirming whether or not the broadcast program screen is being displayed on the video display section 173 is followed by step S20007 for creating a sub-window. If the necessity is set, the operation may be such that the process proceeds from step S20004 for confirming whether or not the broadcast program screen is being displayed on the video display section 173 to step S20013 for confirming whether or not the display button has been selected.
[0281] Although the above describes examples of the embodiment of the present invention using Examples 1 to 6, it goes without saying that the configuration for realizing the technology of the present invention is not limited to the above examples, and various modified examples are possible. For example, it is possible to replace a part of the configuration of one example with the configuration of another example, and it is also possible to add the configuration of another example to the configuration of one example. All of these belong to the scope of the present invention. In addition, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the effect of the present invention is not impaired even if different ones are used.
[0282] The functions of the present invention described above may be realized in part or in whole by hardware, for example by designing them as integrated circuits. They may also be realized by software, with a microprocessor unit or the like interpreting and executing an operating program that realizes each function. Hardware and software may also be used in combination.
[0283] The software for controlling the broadcast receiving device 100 may be stored in the ROM 103 and / or the storage unit 110 of the broadcast receiving device 100 beforehand at the time of product shipment. The software may be acquired from another application server 500 on the Internet 200 via the LAN communication unit 121 after product shipment. The software stored in a memory card, an optical disk, or the like may be acquired via the extended interface unit 124. Similarly, the software for controlling the mobile information terminal 700 may be stored in the ROM 703 and / or the storage unit 710 of the mobile information terminal 700 beforehand at the time of product shipment. The software may be acquired from another application server 500 on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722 after product shipment. The software stored in a memory card, an optical disk, or the like may be acquired via the extended interface unit 724.
[0284] In addition, the control lines and information lines shown in the diagram are those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In reality, it can be considered that almost all components are connected to each other. [Explanation of symbols]
[0285] 100: broadcast receiving device, 100a: antenna, 101: main control unit, 102: system bus, 103: ROM, 104: RAM, 110: storage unit, 121: LAN communication unit, 124: expansion interface unit, 125: digital interface unit, 131: tuner / demodulation unit, 132: first separation unit, 133: first video decoding unit, 134: first audio decoding unit, 135: first subtitle decoding unit, 141: data broadcast reception processing unit, 142 : Data broadcasting engine, 151: Streaming reception processing unit, 152: Second separation unit, 153: Second video decoding unit, 154: Second audio decoding unit, 155: Second subtitle decoding unit, 161: Application control unit, 162: Application engine, 171: Video superimposition unit, 172: Audio selection unit, 173: Video display unit, 174: Speaker, 175: Video output unit, 176: Audio output unit, 181: Presentation synchronization control unit, 191: Terminal cooperation control unit, 200: Internet, 210: router device, 300t: radio tower, 300: broadcasting station server, 301: main control unit, 302: system bus, 304: RAM, 310: storage unit, 321: LAN communication unit, 400: service provider server, 401: main control unit, 402: system bus, 404: RAM, 410: storage unit, 421: LAN communication unit, 500: other application servers, 600: mobile telephone communication servers, 600b: base stations, 700: portable information terminal, 701: main control unit, 702: system bus, 703: ROM, 704: RAM, 710: storage unit, 720: communication processing unit, 721: LAN communication unit, 722: mobile telephone network communication unit, 723: NFC communication unit, 724: expansion interface unit, 730: operation unit, 740: image processing unit, 741: display unit, 742: image signal processing unit, 743: first image input unit, 744: second image input unit, 750: audio processing unit, 751: audio output unit, 752: audio signal processing unit, 753: audio input unit, 760: sensor unit, 761: GPS receiving unit, 762: gyro sensor, 763: geomagnetic sensor, 764: acceleration sensor, 765: illuminance sensor, 766: proximity sensor
Claims
[Claim 1] 1. An application startup method for starting an application for accessing a broadcast resource in a broadcast receiving device, comprising: The application for accessing the broadcast resource includes a broadcast managed application activated by application control information included in the broadcast signal, and a non-broadcast managed application activated by a method other than the application control information included in the broadcast signal; a receiving step of receiving the broadcast signal; a first application launch step of launching the broadcast managed application based on application control information included in the received broadcast signal; a launcher screen display step of displaying a launcher screen on the broadcast receiving device by an application launcher provided in the broadcast receiving device; a second application launch step of launching the non-broadcast managed application based on a user operation via the displayed launcher screen; an authentication step of authenticating an external mobile terminal having a cooperative control application installed thereon for operating in cooperation with the broadcast receiving device; a communication step of communicating with the external mobile terminal authenticated in the authentication step; a third application starting step of starting the non-broadcast managed application based on a start request by a user operation via the external mobile terminal received in the communication step; Equipped with The first application startup step, when a PMT included in the broadcast signal includes information indicating that the startup priority of the broadcast managed application is high and when the application control information includes information indicating automatic startup of the broadcast managed application, confirms whether the broadcast managed application is executable, and if executable, acquires and starts the broadcast managed application. How to launch the application.
Citation Information
Patent Citations
Broadcasting system for data broadcast in tv broadcast
JP2001186486A
Terminal cooperation system and receiver
JP2012243062A
Information processing terminal, application-cooperative content management server and location resolution server
JP2012244286A