Information processing apparatus, information processing system, and server system

Abstract

To provide an information processing apparatus capable of improving convenience for a user.SOLUTION: An information processing apparatus according to one embodiment of the present disclosure comprises a circuit capable of generating control information for light emission control for light emitted from an operating terminal and transmitting the control information to the operating terminal. The operation terminal is capable of remotely controlling the operation of the apparatus itself based on an operation by a user. The light emission control includes controlling, based on the control information, one or more of light emission start, light emission end, light emission brightness, light emission color, light emission time, and light emission cycle of a plurality of buttons provided on the operation terminal. The circuit is capable of generating the control information based on notification information for the user. The control information is information for causing one or more buttons, among the plurality of buttons provided on the operation terminal, which are associated with the notification information, to emit light.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing system, and a server system operated by an operation terminal. [Background technology]

[0002] Information processing devices are often configured to be operable by an operation terminal such as a remote control device, etc. For example, Patent Document 1 discloses a television receiver that can be operated by a remote control device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-110517 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, information processing devices are desired to be highly convenient for users, and further improvements in convenience are expected.

[0005] It is desirable to provide an information processing device, an information processing system, and a server system that can improve user convenience. [Means for solving the problem]

[0006] A first information processing device according to an embodiment of the present disclosure includes a circuit capable of generating control information for controlling the emission of light emitted from an operation terminal and transmitting the control information to the operation terminal. The operation terminal is capable of remotely controlling its own operation based on a user's operation. The emission control includes controlling one or more of the emission start, emission end, emission brightness, emission color, emission time, and emission cycle of multiple buttons provided on the operation terminal based on the control information. The circuit is capable of generating the control information based on notification information for the user. The control information is information for causing one or more buttons associated with the notification information among multiple buttons provided on the operation terminal to emit light.

[0007] An information processing system according to an embodiment of the present disclosure includes a display device, an operation terminal, and a distribution server. The display device has a control unit capable of generating control information and a network communication unit capable of communicating with the distribution server. The operation terminal is capable of receiving the control information from the control unit. The control unit is capable of generating a notification message indicating that software to be updated is available on the distribution server. The control unit is capable of transmitting control information including notification information corresponding to the notification message to the operation terminal.

[0008] The second information processing device according to an embodiment of the present disclosure includes: a control unit that generates control information; The system includes a network communication unit capable of communicating with the distribution server and an operation terminal capable of receiving control information from a control unit. The control unit is capable of generating a notification message indicating that the software to be updated is available on the distribution server. The control unit is capable of transmitting control information including notification information corresponding to the notification message to the operation terminal.

[0009] A server system according to an embodiment of the present disclosure includes a content server connected to the Internet and a server connected to the Internet. The content server is capable of communicating with a network communication unit of a display device that is capable of transmitting notification information corresponding to a notification message to an operation terminal as part of control information. The server is capable of receiving voice data from the operation terminal and analyzing the voice data. A voice assistant processor of the display device is capable of performing processing corresponding to the voice data based on the information analyzed by the server. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example configuration of a display system according to a first embodiment of the present disclosure. [Figure 2] FIG. 2 is an explanatory diagram illustrating an example of a configuration of an operation terminal according to an embodiment. [Figure 3] 2 is a flowchart illustrating an example of the operation of the operation terminal illustrated in FIG. 1. [Figure 4] 2 is an explanatory diagram illustrating an example of an operation of the control unit 37 shown in FIG. 1. [Figure 5] 2 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. 1. [Figure 6A] 2 is a timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6B] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6C] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6D] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6E] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6F] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6G] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 6H] 1. FIG. 4 is another timing chart illustrating an example of the operation of the light emission control unit 37 and the light emitting unit 32 shown in FIG. [Figure 7] 10 is a flowchart illustrating an example of the operation of the operation terminal according to a modified example of the first embodiment. [Figure 8] 10 is a flowchart illustrating an example of the operation of a display device according to a modified example of the first embodiment. [Figure 9] FIG. 10 is a sequence diagram illustrating an example of an operation of a display system according to a modified example of the first embodiment. [Figure 10] FIG. 10 is a block diagram illustrating an example of the configuration of a display system according to another modified example of the first embodiment. [Figure 11] FIG. 10 is a block diagram illustrating an example of the configuration of a display system according to another modified example of the first embodiment. [Figure 12] FIG. 10 is an explanatory diagram illustrating an example of the configuration of an operation terminal according to another modified example of the first embodiment. [Figure 13] FIG. 10 is a block diagram illustrating an example of the configuration of a display system according to a second embodiment. [Figure 14] 14 is a flowchart illustrating an example of an operation of the display device shown in FIG. [Figure 15] FIG. 14 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. [Figure 16] FIG. 10 is a block diagram illustrating an example of the configuration of a display system according to a third embodiment. [Figure 17] 17 is a flowchart illustrating an example of an operation of the display device shown in FIG. [Figure 18] FIG. 17 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. [Figure 19] FIG. 10 is a block diagram illustrating an example of the configuration of a display system according to a fourth embodiment. [Figure 20A] 20 is a flowchart illustrating an example of an operation of the display device shown in FIG. [Figure 20B]20 is a flowchart illustrating an example of an operation of the display device shown in FIG. [Figure 21] FIG. 20 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. [Figure 22] FIG. 13 is a block diagram illustrating an example of the configuration of a display system according to a fifth embodiment. [Figure 23] 23 is a flowchart illustrating an example of an operation of the display device shown in FIG. 22. [Figure 24] FIG. 23 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. 22. [Figure 25] FIG. 13 is a block diagram illustrating an example of the configuration of a display system according to a modified example of the fifth embodiment. [Figure 26] 26 is a flowchart illustrating an example of an operation of the display device shown in FIG. 25. [Figure 27] FIG. 13 is a block diagram illustrating an example of the configuration of a display system according to another modified example of the fifth embodiment. [Figure 28] FIG. 13 is a block diagram illustrating an example of the configuration of a display system according to a sixth embodiment. [Figure 29] 29 is a flowchart illustrating an example of an operation of the display device shown in FIG. 28. [Figure 30] FIG. 29 is a sequence diagram illustrating an example of an operation of the display system shown in FIG. 28. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. The description will be made in the following order. 1. First embodiment (example of controlling light emission operation based on environmental brightness) 2. Second embodiment (example of controlling light emission based on displayed content) 3. Third embodiment (example of controlling light emission based on the color of the displayed image) 4. Fourth embodiment (example of controlling light emission operation based on notification information to user) 5. Fifth embodiment (example of controlling light-emitting operation based on selected voice assistant) 6. Sixth embodiment (example of controlling light emission operation based on external device used)

[0012] <1. First embodiment> [Configuration example] 1 shows an example of the configuration of a display system 1 including an information processing device (display device 10) according to a first embodiment. Note that an information processing method according to an embodiment of the present disclosure is embodied by this embodiment, and will be described together. The display system 1 includes the display device 10 and an operation terminal 30.

[0013] (Display device 10) The display device 10 is a so-called television receiver, and includes a tuner 11, an infrared receiving unit 12, a wireless communication unit 13, an external device interface 14, a network communication unit 15, a display unit 16, a speaker 17, an illuminance sensor 18, a power supply unit 19, and a control unit 21.

[0014] The tuner 11 is configured to select a desired video signal (stream) from the digital broadcast wave received by the antenna 9.

[0015] The infrared light receiving unit 12 is configured to receive an infrared signal transmitted from the operation terminal 30 and instructing the operation of the display device 10 .

[0016] The wireless communication unit 13 is configured to exchange information with the operation terminal 30 using short-range wireless communication. In this example, the wireless communication unit 13 communicates with the operation terminal 30 using Bluetooth (registered trademark). However, this is not limiting, and for example, Zigbee (registered trademark) or a wireless LAN (Local Area Network) may also be used. As will be described later, the wireless communication unit 13 is configured to transmit control information INF to the operation terminal 30 for controlling the light emitting operation of the light emitting unit 32 in the operation terminal 30.

[0017] The external device interface 14 is configured to communicate with an external device such as a hard disk recorder, etc. The external device interface 14 is configured to communicate with the external device using, for example, HDMI (registered trademark).

[0018] The network communication unit 15 is connected to the Internet NET and is configured to perform network communication with a communication partner via the Internet NET. The network communication unit 15 is configured to receive video information by streaming from, for example, a content server 201 of a video streaming service.

[0019] The display unit 16 is configured to display a video based on, for example, a video signal selected by the tuner 11. The display unit 16 is configured using, for example, a liquid crystal display or an organic EL (Electro Luminescence) display.

[0020] The speaker 17 is configured to emit sound based on the video signal selected by the tuner 11, for example.

[0021] Illuminance sensor 18 is configured to detect the brightness of the environment surrounding display device 10. Control unit 21 adjusts the display brightness of display unit 16 based on the detection result of illuminance sensor 18. Furthermore, in display system 1, as will be described later, the operation of light-emitting unit 32 in operation terminal 30 is controlled based on the detection result of illuminance sensor 18.

[0022] The power supply unit 19 is configured to generate various power supply voltages based on power supply signals supplied from, for example, a commercial power supply, and supply these power supply voltages to each block within the display device 10.

[0023] The control unit 21 is configured to control the operation of each block of the display device 10, thereby controlling the operation of the display device 10. The control unit 21 is configured using, for example, a processor capable of executing a program. The control unit 21 has a control information generation unit 22. The control information generation unit 22 is configured to generate control information INF for controlling the light-emitting operation of the light-emitting unit 32 in the operation terminal 30, based on the detection result of the illuminance sensor 18. The control unit 21 is then configured to transmit the control information INF generated by the control information generation unit 22 to the operation terminal 30 via the wireless communication unit 13.

[0024] (Operation terminal 30) The operation terminal 30 is a so-called remote control terminal that controls the operation of the display device 10 by remote control based on a user's operation. The operation terminal 30 has an operation unit 31, a light emitting unit 32, an acceleration sensor 33, an infrared light emitting unit 34, a wireless communication unit 35, a power supply unit 36, and a control unit 37.

[0025] The operation unit 31 is configured to receive user operations. The operation unit 31 has a plurality of buttons B. The control unit 37 is configured to cause the infrared light emitting unit 34 to transmit an infrared signal based on the user's operations on the plurality of buttons B.

[0026] 2 shows an example of the configuration of the operation terminal 30. A plurality of buttons B are arranged on the operation surface S of the operation terminal 30. The plurality of buttons B include a power button B1, a video service selection button B2, number buttons B3, color buttons B4, a voice assistant call button B5, a settings button B6, an input switch button B7, a cursor button B8, a decision button B9, a back button B10, a channel button B11, a volume button B12, a mute button B13, an audio switch button B14, a subtitle button B15, a video content operation button B16, a recording list button B17, a help button B18, and a data broadcasting button B19.

[0027] The power button B1 is operated to turn the display device 10 on or off. The video service selection button B2 is operated to select a video streaming service. In this example, the video service selection button B2 includes six buttons corresponding to six different video streaming services (services S1 to S6). The number buttons B3 are operated to select a channel to watch or to input numbers. In this example, the number buttons B3 include 12 buttons. The color buttons B4 are operated to perform a selection operation, for example, in data broadcasting compatible content or an electronic program guide. The voice assistant call button B5 is operated to call the voice assistant. The setting button B6 is operated to display a setting screen for configuring the display device 10. The input switch button B7 is operated to select the source of the video to be displayed, for example, from the tuner 11 or an external device connected to the external device interface 14. The cursor button B8 is operated to move the cursor, for example, in data broadcasting compatible content or an electronic program guide. The enter button B9 is operated to perform a enter operation. The back button B10 is operated, for example, to return to the previous menu. The channel button B11 is operated to select the channel you want to watch. The volume button B12 is operated to adjust the volume. The mute button B13 is operated to mute the sound. The audio switch button B14 is operated, for example, to select the audio in content that supports audio multiplex broadcasting. Specifically, the audio switch button B14 is operated, for example, to select English or Japanese in content that supports multiple languages, and to select the main audio and the secondary audio in content that includes main and secondary audio. The subtitle button B15 is operated to set the subtitle display on or off in content that supports subtitles. The video content operation button B16 is operated to play video content. In this example, the video content operation buttons B16 include a play button, a fast rewind button, a fast forward button, a previous button, a next button, a stop button, and a pause button.The recording list button B17 is operated to display a list of recorded content, for example, when a recording / playback device is connected to the external device interface 14. The help button B18 is operated to display help information, such as guidance on operation methods. The data broadcast button B19 is selected to display data broadcasting for data broadcasting-compatible content.

[0028] As described above, the operation unit 31 has a plurality of buttons B. These buttons B are configured so that they can be highlighted by light emitted from the light-emitting units 32 provided on the back of the buttons B. Specifically, for example, the buttons B can be configured using a translucent material so that the buttons B transmit the light emitted from the light-emitting units 32, thereby highlighting the buttons B. However, this is not a limitation, and for example, the buttons B can be configured using an opaque material so that the light emitted from the light-emitting units 32 leaks through gaps around the buttons B, thereby highlighting the buttons B.

[0029] The light-emitting unit 32 is configured to highlight the multiple buttons B on the operation unit 31 by emitting light. The light-emitting unit 32 has multiple light-emitting elements. The multiple light-emitting elements are, for example, configured so that the light-emitting operation can be controlled individually. The multiple light-emitting elements are, for example, provided on the backs of the multiple buttons B. Specifically, for example, the light-emitting unit 32 has six light-emitting elements corresponding to the six buttons included in the video service selection button B2. Therefore, the light-emitting unit 32 can highlight these six buttons individually by having the six light-emitting elements individually emit light. Also, for example, the light-emitting unit 32 has one light-emitting element corresponding to the 12 buttons included in the number buttons B3. Therefore, the light-emitting unit 32 can collectively highlight these 12 buttons by having the light-emitting element emit light.

[0030] The acceleration sensor 33 is configured to detect the movement of the operation terminal 30. Although the acceleration sensor 33 is provided in this example, the present invention is not limited to this and any sensor that can detect the movement of the operation terminal 30 may be used. Specifically, for example, a gyro sensor may be provided.

[0031] The infrared light emitting unit 34 is configured to transmit an infrared signal to the infrared light receiving unit 12 of the operation terminal 30, instructing the operation of the display device 10.

[0032] The wireless communication unit 35 is configured to exchange information with the wireless communication unit 13 of the display device 10 using short-range wireless communication. The wireless communication unit 35 is configured to receive control information INF for controlling the light-emitting operation of the light-emitting unit 32, which is transmitted from the display device 10, as will be described later.

[0033] The power supply unit 36 ​​is configured to supply voltage supplied from, for example, a battery to each block in the operation terminal 30. The battery that supplies power to the power supply unit 36 ​​may be a rechargeable battery. The rechargeable battery may be one that can be charged using wireless power supply such as Qi (registered trademark).

[0034] The control unit 37 is configured to control the operation of each block of the operation terminal 30, thereby controlling the operation of the operation terminal 30. Furthermore, the control unit 37 can set the operation state of the operation terminal 30 to a sleep state or a normal operation state by controlling the operation of each block of the operation terminal 30. In the sleep state, for example, the power supply unit 36 ​​stops supplying voltage to various blocks except for the operation unit 31, the acceleration sensor 33, and the control unit 37. The control unit 37 is configured, for example, using a processor capable of executing programs. The control unit 37 has a light-emission control unit 38. The light-emission control unit 38 is configured to control the light-emission operation of the light-emitting unit 32 based on control information INF transmitted from the display device 10.

[0035] With this configuration, in the display system 1, the control information generation unit 22 of the display device 10 generates control information INF for controlling the light-emitting operation of the light-emitting unit 32 in the operation terminal 30, based on the detection result of the illuminance sensor 18. Then, the wireless communication unit 13 of the display device 10 transmits this control information INF to the wireless communication unit 35 of the operation terminal 30. The light-emitting control unit 38 of the operation terminal 30 controls the light-emitting operation of the light-emitting unit 32 based on this control information INF. As a result, in the display system 1, for example, when the surroundings of the display device 10 are dark, the operation unit 31 can be highlighted by the light emitted from the light-emitting unit 32, allowing the user to easily operate the operation terminal 30.

[0036] In this example, the operation terminal 30 does not have a network communication unit connectable to the Internet NET, but is configured to be able to transmit information to an external device or receive information from an external device using an infrared light emitting unit 34 or a wireless communication unit 35. However, without being limited to this, the operation terminal 30 may have a network communication unit connectable to the Internet NET. In this case, the operation terminal 30 can utilize network communication, thereby realizing various functions. Furthermore, the operation terminal may be realized using, for example, a smartphone or a tablet terminal.

[0037] Here, the display device 10 corresponds to a specific example of an "information processing device" in the present disclosure. The control unit 21 and the wireless communication unit 13 correspond to a specific example of a "circuit" in the present disclosure. The control information INF corresponds to a specific example of "control information" in the present disclosure. The operation terminal 30 corresponds to a specific example of an "operation terminal" in the present disclosure. The light-emitting unit 32 corresponds to a specific example of a "light-emitting unit" in the present disclosure.

[0038] [Actions and Actions] Next, the operation and function of the display system 1 of this embodiment will be described.

[0039] (Overview of overall operation) First, referring to FIG. 1, an overview of the overall operation of the display system 1 will be described. In the display device 10, the tuner 11 selects a desired video signal from broadcast waves received by the antenna 9. The infrared receiver 12 receives an infrared signal that instructs the operation of the display device 10, transmitted from the infrared emitter 34 of the operation terminal 30. The wireless communication unit 13 exchanges information with the wireless communication unit 35 of the operation terminal 30 using short-range wireless communication. The external device interface 14 communicates with external devices. The network communication unit 15 receives video information from multiple content servers 201 via video streaming. The display unit 16 displays video, for example, based on the video signal selected by the tuner 11. The speaker 17 emits sound, for example, based on the video signal selected by the tuner 11. The illuminance sensor 18 detects the brightness of the environment surrounding the display device 10. The power supply unit 19 generates various power supply voltages based on power signals supplied, for example, from a commercial power source, and supplies these power supply voltages to each block within the display device 10. The control unit 21 controls the operation of each block of the display device 10, thereby controlling the operation of the display device 10.

[0040] In the operation terminal 30, a plurality of buttons B of the operation unit 31 accepts user operations. The light-emitting unit 32 highlights the plurality of buttons B of the operation unit 31 by emitting light. The acceleration sensor 33 detects the movement of the operation terminal 30. The infrared light-emitting unit 34 transmits an infrared signal to the infrared light-receiving unit 12 of the operation terminal 30, instructing the operation of the display device 10. The wireless communication unit 35 exchanges information with the wireless communication unit 13 of the display device 10 using short-range wireless communication. The power supply unit 36 ​​supplies voltage, for example, from a battery, to each block within the operation terminal 30. The control unit 37 controls the operation of each block of the operation terminal 30, thereby controlling the operation of the operation terminal 30.

[0041] The control information generator 22 of the display device 10 generates control information INF for controlling the light-emitting operation of the light-emitting unit 32 in the operation terminal 30, based on the detection result of the illuminance sensor 18. The wireless communication unit 13 transmits the control information INF generated by the control information generator 22 to the operation terminal 30. The wireless communication unit 35 of the operation terminal 30 receives the control information INF transmitted from the display device 10. The light-emitting control unit 38 controls the light-emitting operation of the light-emitting unit 32, based on the control information INF.

[0042] (Detailed operation) 3 shows an example of the operation of the operation terminal 30. When the operation terminal 30 detects a movement or a user operation on the operation unit 31, it requests the display device 10 to transmit control information INF. Then, the operation terminal 30 controls the light-emitting operation of the light-emitting unit 32 based on the control information INF transmitted from the display device 10. This operation will be described in detail below.

[0043] First, the control unit 37 checks whether or not a movement of the operation terminal 30 has been detected based on the detection result of the acceleration sensor 33 (step S101). For example, when a user picks up the operation terminal 30 placed on a desk, the control unit 37 detects the movement of the operation terminal 30.

[0044] In step S101, if movement of the operation terminal 30 has not been detected ("N" in step S101), the control unit 37 checks whether a user operation on the operation unit 31 has been detected (step S102). For example, if a user operates button B on the operation terminal 30 placed on a desk, the control unit 37 detects the user operation on the operation unit 31. If a user operation on the operation unit 31 has not been detected ("N" in step S102), the process returns to step S101, and the control unit 37 repeats steps S101 and S102 until movement of the operation terminal 30 is detected or a user operation on the operation unit 31 is detected.

[0045] Here, the control unit 37 of the operation terminal 30 may control the acceleration sensor 33 to detect the movement of the operation terminal 30 at a predetermined interval. Furthermore, when the control unit 37 detects the movement of the operation terminal 30 or a user operation on the operation unit 31, the control unit 37 may detect the movement of the operation terminal 30 at an interval different from that before the movement or user operation was detected. For example, as shown in FIG. 4 , the control unit 37 can normally detect acceleration (movement of the operation terminal 30) at a detection interval T of 500 ms. Furthermore, when the control unit 37 detects the movement of the operation terminal 30 or a user operation on the operation unit 31, the control unit 37 may detect the acceleration at a detection interval T of 100 ms. Then, the light emission control unit 38 may cause the light emitting unit 32 to emit light, and after the light emission has stopped, the detection interval T may be returned to 500 ms after a predetermined time (e.g., 30 seconds) has elapsed. This makes it possible to reduce the delay between when a user lifts the operation terminal 30 and when the light emitting unit 32 emits light.

[0046] If movement of the operation terminal 30 is detected in step S101 ("Y" in step S101), or if user operation on the operation unit 31 is detected in step S102 ("Y" in step S102), the control unit 37 changes the operating state of the operation terminal 30 from a sleep state to a normal operating state (step S103).

[0047] Next, the control unit 37 requests the display device 10 to transmit control information INF via the wireless communication unit 35 (step S104). In this example, the control information INF includes sensor information INF1 that indicates the detection result of the illuminance sensor 18. Then, the control unit 37 receives the control information INF transmitted from the display device 10 in response to this transmission request via the wireless communication unit 35.

[0048] Next, the light-emission control unit 38 of the control unit 37 checks whether the environmental brightness indicated by the sensor information INF1 included in the control information INF is darker than a predetermined brightness (step S105). If the environmental brightness is brighter than the predetermined brightness ("N" in step S105), this flow ends. In other words, if the environmental brightness is brighter than the predetermined brightness, the user can easily see each button B of the operation unit 31 of the operation terminal 30, and therefore the light-emission control unit 38 does not cause the light-emitting unit 32 to emit light, and this flow ends.

[0049] In step S105, if the environmental brightness indicated by the sensor information INF1 is darker than a predetermined brightness ("Y" in step S105), the light-emission control unit 38 generates light-emission control information INFBL that instructs the light-emission operation of the light-emitting unit 32 based on this sensor information INF1 (step S106). This light-emission control information INFBL includes information on the light-emission start, light-emission end, light-emission brightness, light-emission time, light-emission cycle, etc. of each light-emitting element of the light-emitting unit 32, for example.

[0050] Then, the light emission control unit 38 controls the light emitting operation of the light emitting unit 32 based on this light emission control information INFBL (step S107). As a result, the operation unit 31 of the operation terminal 30 is highlighted by the light emitted from the light emitting unit 32.

[0051] This is the end of this flow.

[0052] FIG. 5 shows an example of the operation of the display system 1 when a user picks up the operation terminal 30 placed on a desk in a dark environment.

[0053] When the user lifts the operation terminal 30, the control unit 37 of the operation terminal 30 detects the movement of the operation terminal 30 and changes the operation state of the operation terminal 30 from the sleep state to the normal operation state (step S121). Then, the control unit 37 requests the display device 10 to transmit control information INF including the sensor information INF1 via the wireless communication unit 35 (step S122). The control unit 21 of the display device 10 receives this transmission request via the wireless communication unit 13.

[0054] In response to this transmission request, the control information generator 22 of the display device 10 acquires the detection result of the illuminance sensor 18 as sensor information INF1 (step S123). In this example, the sensor information INF1 includes information about the environmental brightness that is darker than a predetermined brightness. Then, the controller 21 transmits the control information INF including this sensor information INF1 to the operation terminal 30 via the wireless communication unit 13 (step S124). The controller 37 of the operation terminal 30 receives this control information INF via the wireless communication unit 35.

[0055] The light-emission control unit 38 of the operating terminal 30 generates light-emission control information INFBL based on the sensor information INF1 included in this control information INF (step S125). That is, in this example, the environmental brightness is darker than a predetermined brightness, so the light-emission control unit 38 generates light-emission control information INFBL based on this sensor information INF1. In this example, the light-emission control information INFBL is information that instructs all light-emitting elements in the light-emitting unit 32 to emit light for a predetermined time.

[0056] Next, the light-emission control unit 38 starts emitting light from the light-emitting unit 32 based on the light-emission control information INFBL (step S126). As a result, the operation unit 31 of the operation terminal 30 is highlighted by the light emitted from the light-emitting unit 32. Then, based on the light-emission control information INFBL, the light-emission control unit 38 stops emitting light from the light-emitting unit 32 after a predetermined time has elapsed (step S127).

[0057] This completes the sequence.

[0058] The light-emission control unit 38 may control the light-emitting unit 32 to change its light-emission method at either or both of the start and end of light emission. For example, the light-emitting unit 32 may gradually change its brightness from the current brightness to the target brightness at the start and end of light emission, and then emit light at a constant brightness after reaching the target brightness. The length of the period during which the brightness gradually changes and the length of the period during which the constant brightness is maintained may be a predetermined time, or may change dynamically depending on the usage status of the operation terminal 30. FIGS. 6A to 6H show examples of light-emission methods of the light-emitting unit 32.

[0059] (Case C1, when the button B pressing time TP is short) In the example of FIG. 6A, when the user operates the operation unit 31, the brightness of the light-emitting unit 32 changes gradually when light emission starts and ends. In this example, the user is pressing button B. The time from when light emission starts to when light emission ends is set to 3 seconds, and the light emission time at the target brightness is set to 1 second. Specifically, the brightness of the light-emitting unit 32 gradually increases from when light emission starts, reaches the target brightness after 1 second, is maintained at a constant brightness for 1 second, and then gradually decreases to 0 (zero) after 1 second. For example, if the pressing time TP of button B is sufficiently short (e.g., 1 second or less), the light-emitting unit 32 emits light for 3 seconds from when light emission starts to when light emission ends (turns off), as described above.

[0060] (Case C2, when the button B is pressed for a long time TP) In the example of FIG. 6B, similarly to the case of FIG. 6A, when the time from the start to the end of light emission is set to 3 seconds, the user presses button B for a longer time than in the case of FIG. 6A. If the button B pressing time TP exceeds 1 second, the brightness of light-emitting unit 32 gradually increases to the target brightness over 1 second while the user is pressing button B, and is then maintained at a constant brightness. The brightness of light-emitting unit 32 is then maintained at a constant brightness until 1 second has elapsed since the user finished pressing button B. After 1 second has elapsed since the user finished pressing button B, the brightness of light-emitting unit 32 gradually decreases and becomes 0 (zero) after 1 second.

[0061] (Case C3: When the pressing time TP of Button B exceeds the specified time) In the example of Fig. 6C, similar to the case of Fig. 6A, when the time from the start to the end of light emission is set to 3 seconds, the user presses button B for a longer time than in Fig. 6B. If the pressing time TP of button B exceeds 1 second and further exceeds a predetermined time (e.g., 60 seconds), the brightness of light-emitting unit 32 gradually increases to the target brightness over 1 second while the user is pressing button B, and then is maintained at a constant brightness until the predetermined time (e.g., 60 seconds) has elapsed. After this predetermined time has elapsed, the brightness of light-emitting unit 32 gradually decreases and becomes 0 (zero) after 1 second.

[0062] (Case C4: Button B is pressed while the light is off) In the example of FIG. 6D , similarly to the case of FIG. 6A , when the time from the start of light emission to the end of light emission is set to 3 seconds, the user presses button B again during the end of light emission. At this time, the brightness of light-emitting unit 32 gradually increases from the brightness at the time when the user presses button B again to the target brightness. The time from the time when button B is pressed until the brightness reaches the target brightness may be the same as the time from the start of the light emission end operation until button B is pressed. The brightness of light-emitting unit 32 is maintained for 1 second after reaching the target brightness again, and then gradually decreases and becomes 0 (zero) after 1 second. In this example, a case where the user presses button B again during the end of light emission has been described. However, if the user presses button B again while light-emitting unit 32 is maintaining the target brightness, the light emission end operation may be initiated 1 second after the user presses button B again.

[0063] (Case C5, when acceleration is detected while brightness is increasing) In the example of Fig. 6E, the time from the start of light emission to the end of light emission is set to three seconds, as in the case of Fig. 6A. In this example, at the start of light emission, the user performs a user operation by moving the operation terminal 30. In this way, if acceleration corresponding to the user operation is detected only during the period when the luminance of the light-emitting unit 32 is increasing (one second in this example), the light-emitting unit 32 emits light for three seconds from the start of light emission to the end of light emission (turning off), as in the case of Fig. 6A.

[0064] (Case C6, when acceleration is detected while maintaining brightness) 6E, in the example of Fig. 6F, when the time from the start to the end of light emission is set to 3 seconds, one second has passed since the start of light emission and acceleration corresponding to a user operation is further detected during the period in which light-emitting unit 32 is maintaining the target brightness. At this time, one second has passed since the timing at which acceleration was detected during the period in which the target brightness is maintained, and the brightness of light-emitting unit 32 gradually decreases and becomes 0 (zero) one second later.

[0065] (Case C7, when acceleration is detected while light emission is stopped) In the example of Fig. 6G, similarly to the case of Fig. 6E, when the time from the start of light emission to the end of light emission is set to 3 seconds, acceleration in response to a user operation is further detected during the end of light emission. At this time, the brightness of the light-emitting unit 32 gradually increases from the brightness at the timing when acceleration is first detected during the end of light emission to the target brightness. The time from the timing when acceleration is first detected until the brightness reaches the target brightness may be the same as the time from the start of the light emission end operation to the first detection of acceleration.

[0066] (Case C8, when acceleration is detected after pressing button B) In the example of FIG. 6H , similarly to the case of FIG. 6A , when the time from the start of light emission to the end of light emission is set to 3 seconds, the light-emitting unit 32 emits light in response to the pressing of button B, and then emits light in response to the detection of acceleration. Here, similarly to the example of FIG. 6C , the user first presses button B for longer than a predetermined time (e.g., 60 seconds). As a result, the light-emitting unit 32 performs the light-emitting process in response to the pressing of button B for a total of 61 seconds, and then sets the brightness to 0. If acceleration caused by the user moving the operation terminal 30 is detected thereafter, the light-emitting unit 32 performs the light-emitting process again. Note that, as shown in FIG. 4 , in one embodiment, the detection interval T of the acceleration sensor 33 is shorter than usual until a predetermined time (e.g., 30 seconds) has elapsed since the pressing of button B or the detection of acceleration. Therefore, if light emission in response to the detection of acceleration occurs within a predetermined time from the light emission in response to the pressing of button B, the response time from the user moving the operation terminal 30 until the light-emitting unit 32 emits light is shortened.

[0067] As described above, examples of light emission control for cases C1 to C8 have been shown using FIGS. 6A to 6H. However, the above-described light emission control is merely an example and is not limited to these examples. For example, in the example of case C1, the time required to change from the start of light emission to the target luminance, the time required to maintain the target luminance, and the time required to end light emission are each set to one second. However, this is not limited to this and may be shorter or longer than one second. Furthermore, while the luminance of the light-emitting unit 32 is set to change gradually both at the start of light emission and at the end of light emission, this is not limited to this. For example, the luminance of the light-emitting unit 32 may change gradually only at either the start of light emission or the end of light emission. Furthermore, the luminance of the light-emitting unit 32 may not change gradually both at the start of light emission and at the end of light emission. In this case, the luminance of the light-emitting unit 32 changes to the target luminance (a constant luminance state or a luminance state) in a short time. Furthermore, the luminance of the light-emitting unit 32 may change to the target luminance in a short time, rather than gradually, only when pressing button B or acceleration is detected during the end of light emission.

[0068] As described above, in the display system 1, the control information generation unit 22 of the display device 10 utilizes the illuminance sensor 18 for adjusting the display brightness of the display unit 16 to generate control information INF according to the detection result of the illuminance sensor 18, and the light-emission control unit 38 of the operation terminal 30 controls the light-emitting operation of the light-emitting unit 32 based on this control information INF. As a result, in the display system 1, for example, when the surroundings of the display device 10 are dark, the operation unit 31 can be highlighted by the light from the light-emitting unit 32, allowing the user to easily operate the operation terminal 30. As a result, the display system 1 can improve user convenience.

[0069] Furthermore, in the display system 1, when the environmental brightness is darker than a predetermined brightness, the light-emitting operation of the light-emitting unit 32 is controlled, so that when the surroundings of the display device 10 are bright, the light-emitting unit 32 does not emit light, thereby reducing power consumption. As a result, in the display system 1, for example, the number of times the battery used in the operation terminal 30 needs to be replaced or charged can be reduced, thereby improving user convenience.

[0070] Furthermore, in the display system 1, the light-emitting operation of the light-emitting unit 32 is controlled based on the control information INF, so that, for example, the light-emitting unit 32 can stop emitting light after a predetermined time has elapsed since the light-emitting unit 32 started emitting light. This makes it possible to limit the light-emitting time of the light-emitting unit 32, thereby reducing power consumption. As a result, in the display system 1, for example, the number of times the battery used in the operation terminal 30 needs to be replaced or charged can be reduced, thereby improving user convenience.

[0071] Furthermore, in the display system 1, the illuminance sensor 18 provided in the display device 10 is used to adjust the display brightness of the display unit 16, so there is no need to provide an illuminance sensor in the operation terminal 30, which reduces the number of components in the operation terminal 30. As a result, in the display system 1, it is possible to reduce the cost of the operation terminal 30, for example.

[0072] [effect] As described above, in this embodiment, the control information generation unit of the display device generates control information according to the detection results of the illuminance sensor, and the light emission control unit of the operating terminal controls the light emission operation of the light emitting unit based on this control information.Therefore, for example, when the area around the display device is dark, the operating unit can be highlighted by light from the light emitting unit, thereby improving user convenience.

[0073] In this embodiment, the light-emitting operation of the light-emitting unit is controlled when the brightness of the environment is darker than a predetermined brightness, so that, for example, the number of times the battery used in the operating terminal needs to be replaced or charged can be reduced, thereby improving user convenience.

[0074] In this embodiment, the light emitting operation of the light emitting unit is controlled based on the control information, so that, for example, the light emitting unit can stop emitting light after a predetermined time has elapsed since the light emitting unit started emitting light. This can reduce the number of times the battery used in the operating terminal needs to be replaced or charged, thereby improving user convenience.

[0075] In this embodiment, an illuminance sensor provided in the display device is used to adjust the display brightness of the display unit, so that the cost of the operation terminal can be reduced.

[0076] [Variation 1-1] In the above embodiment, the control information INF includes the sensor information INF1, but is not limited to this and may include various information for controlling the light-emitting operation of the light-emitting unit 32 in the operating terminal 30. An example in which the control information INF includes light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 32 will be described in detail below.

[0077] A display system 1A according to this modification includes a display device 10A and an operation terminal 30A, similar to the above embodiment (FIG. 1). The display device 10A includes a control unit 21A. The control unit 21A includes a control information generation unit 22A. The control information generation unit 22A is configured to generate control information INF including light-emission control information INFBL based on the detection result of the illuminance sensor 18. The operation terminal 30A includes a control unit 37A. The control unit 37A includes a light-emission control unit 38A. The light-emission control unit 38A is configured to control the light-emission operation of the light-emitting unit 32 based on the control information INF including the light-emission control information INFBL.

[0078] FIG. 7 shows an example of the operation of the operation terminal 30A.

[0079] First, the control unit 37A checks whether or not a movement of the operation terminal 30A has been detected based on the detection result of the acceleration sensor 33 (step S101). If a movement of the operation terminal 30A has not been detected ("N" in step S101), the control unit 37A checks whether or not a user operation on the operation unit 31 has been detected (step S102). If a user operation on the operation unit 31 has not been detected ("N" in step S102), the process returns to step S101.

[0080] If movement of the operating terminal 30A is detected in step S101 ("Y" in step S101), or if user operation on the operating unit 31 is detected in step S102 ("Y" in step S102), the control unit 37A changes the operating state of the operating terminal 30A from a sleep state to a normal operating state (step S103).

[0081] Next, the control unit 37A requests the display device 10A to transmit control information INF via the wireless communication unit 35 (step S134). In this example, the control information INF includes light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 32. Then, the control unit 37A receives the control information INF transmitted from the display device 10A in response to this transmission request via the wireless communication unit 35.

[0082] Next, light-emission control unit 38A of control unit 37A controls the light-emitting operation of light-emitting unit 32 based on light-emission control information INFBL included in this control information INF (step S137). As a result, operation unit 31 of operation terminal 30A is highlighted by the light emitted from light-emitting unit 32. This ends the flow.

[0083] FIG. 8 shows an example of the operation of the display device 10A.

[0084] First, the display device 10A checks whether a transmission request for control information INF including light-emission control information INFBL has been received from the operation terminal 30A (step S141). If a transmission request for control information INF has been received ("Y" in step S141), the control information generator 22A of the controller 21A acquires the detection result of the illuminance sensor 18 as sensor information INF1 (step S142).

[0085] Next, the control information generator 22A checks whether the brightness of the environment indicated by the sensor information INF1 is darker than a predetermined brightness (step S143). If the brightness is darker than the predetermined brightness ("Y" in step S143), the control information generator 22A generates light-emission control information INFBL based on this sensor information INF1, including an instruction to cause the light-emitting unit 32 to emit light (step S144). If the brightness is brighter than the predetermined brightness ("N" in step S143), the control information generator 22A generates light-emission control information INFBL based on this sensor information INF1, including an instruction not to cause the light-emitting unit 32 to emit light (step S145).

[0086] Then, the control unit 21A transmits the control information INF including this light emission control information INFBL to the operation terminal 30A via the wireless communication unit 13 (step S146). This is the end of this flow.

[0087] FIG. 9 shows an example of the operation of the display system 1A when a user operates the operation unit 31 of the operation terminal 30A placed on a desk in a dark environment.

[0088] When a user operates the operation unit 31 of the operation terminal 30A, the control unit 37A of the operation terminal 30A detects the user operation and changes the operation state of the operation terminal 30A from the sleep state to the normal operation state (step S151). Then, the control unit 37A requests the display device 10A to transmit control information INF including light emission control information INFBL via the wireless communication unit 35 (step S152). The wireless communication unit 13 of the display device 10A receives this transmission request.

[0089] In response to this transmission request, the control information generator 22A of the display device 10A acquires the detection result of the illuminance sensor 18 as sensor information INF1 (step S153). In this example, the sensor information INF1 includes information about the environmental brightness, which is darker than a predetermined brightness. Then, the control information generator 22A generates light-emission control information INFBL based on this sensor information INF1 (step S154). In this example, the environmental brightness is darker than the predetermined brightness, so the control information generator 22A generates light-emission control information INFBL based on this sensor information INF1, which instructs all light-emitting elements in the light-emitting unit 32 to emit light for a predetermined time. Then, the controller 21A transmits the control information INF including this light-emission control information INFBL to the operation terminal 30A via the wireless communication unit 13 (step S155). The controller 37A of the operation terminal 30A receives this control information INF via the wireless communication unit 35.

[0090] Next, the light-emission control unit 38A of the operating terminal 30A starts emitting light from the light-emitting unit 32 based on the light-emission control information INFBL included in this control information INF (step S126). As a result, the operating unit 31 of the operating terminal 30A is highlighted by the light emitted from the light-emitting unit 32. Then, based on the light-emission control information INFBL, the light-emission control unit 38A stops the light-emission of the light-emitting unit 32 after a predetermined time has elapsed (step S127). This ends the sequence.

[0091] [Variation 1-2] In the above embodiment, the light-emission control unit 38 generates light-emission control information INFBL that instructs all light-emitting elements in the light-emitting unit 32 to emit light when the environmental brightness indicated by the sensor information INF1 is darker than a predetermined brightness, but this is not limited to this. Instead, for example, the light-emission control unit 38 may generate light-emission control information INFBL that instructs all light-emitting elements in the light-emitting unit 32 to emit light at a higher light emission brightness as the environmental brightness indicated by the sensor information INF1 becomes darker.

[0092] [Variation 1-3] In the above embodiment, the control information generator 22 generates the control information INF based on the brightness of the environment detected by the illuminance sensor 18, but this is not limited to this. The control information generator may also generate the control information INF based on other parameters related to the environment. This modification will be described in detail below with some examples.

[0093] 10 shows an example of the configuration of a display system 1B according to this modification. The display system 1B includes a display device 10B and an operation terminal 30B.

[0094] The display device 10B includes a color sensor 18B and a control unit 21B.

[0095] Color sensor 18B is configured to detect the color of the environment surrounding display device 10. Specifically, color sensor 18B is configured to detect, for example, the color of the lighting in the room in which display device 10B is placed. Control unit 21B is configured to adjust the display color on display unit 16 based on the detection result of color sensor 18B.

[0096] The control unit 21B has a control information generation unit 22B. The control information generation unit 22B is configured to generate control information INF based on the detection results of the illuminance sensor 18 and the detection results of the color sensor 18B. In other words, the control information generation unit 22B is configured to generate control information INF based on the brightness and color of the environment.

[0097] The operation terminal 30B includes a light emitting unit 32B and a control unit 37B.

[0098] The light-emitting unit 32B is configured to emit light to highlight the multiple buttons B on the operation unit 31. The light-emitting unit 32B has, for example, multiple light-emitting elements. The multiple light-emitting elements include, for example, a light-emitting element that emits red light, a light-emitting element that emits green light, and a light-emitting element that emits blue light.

[0099] The control unit 37B has a light-emission control unit 38B. The light-emission control unit 38B is configured to control the light-emitting operation of the light-emitting unit 32B based on control information INF transmitted from the display device 10B. Specifically, for example, when the lighting color of the room in which the display device 10B is placed is daylight white, the light-emission control unit 38B generates light-emission control information INFBL that instructs the light-emitting unit 32B to emit each light-emitting element so as to emit white light. Furthermore, for example, when the lighting color of the room in which the display device 10B is placed is warm white, the light-emission control unit 38B generates light-emission control information INFBL that instructs the light-emitting unit 32B to emit each light-emitting element so as to emit light of a warm color. That is, in this example, the light-emission control information INFBL also includes information about the emission color of the light-emitting unit 32B.

[0100] With this configuration, the display system 1B can control the light-emitting operation of the light-emitting unit 32B based on information about the brightness of the environment obtained by the illuminance sensor 18 and information about the color of the environment obtained by the color sensor 18B.

[0101] 11 shows an example of the configuration of another display system 1C according to this modification. The display system 1C includes a display device 10C and an operation terminal 30B. The display device 10C includes a camera 18C and a control unit 21C.

[0102] The camera 18C is configured to generate a captured image by capturing an image of a user in front of the display device 10C. The display device 10C can use the captured image to realize, for example, a videophone function. The captured image includes information about the brightness and color of the environment.

[0103] Control unit 21C has control information generation unit 22C. Control information generation unit 22C is configured to generate control information INF based on a captured image obtained by camera 18C. That is, while control information generation unit 22B of display device 10B (FIG. 10) generated control information INF based on information about environmental brightness obtained by illuminance sensor 18 and information about environmental color obtained by color sensor 18B, control information generation unit 22C generates control information INF based on information about environmental brightness and environmental color obtained by camera 18C.

[0104] With this configuration, the display system 1C can control the light emitting operation of the light emitting unit 32B based on information about the brightness and color of the environment obtained by the camera 18C.

[0105] [Variation 1-4] In the above embodiment, as shown in FIG. 2, the operation terminal 30 has multiple buttons B. However, this is not limited to this. Instead, for example, as shown in FIG. 12, an operation terminal 30D may have a display unit 39D in addition to the multiple buttons B. The display unit 39D may be configured using, for example, a liquid crystal display or an organic electroluminescence (EL) display. In this case, the light-emitting unit 32 may emit light to highlight the multiple buttons B, as in the above embodiment. The light-emission control unit 38D according to this modification may control the light-emitting operation of the light-emitting unit 32 and also the display operation of the display unit 39D based on the control information INF. Specifically, the light-emission control unit 38D may, for example, cause the light-emitting unit 32 to emit light and display information on the display unit 39D based on the control information INF.

[0106] Furthermore, for example, the operation terminal may have a touch panel in addition to the display unit. In this case, the user can perform operations by touching button images displayed on the display unit. The light-emission control unit can control the display operation of the display unit based on the control information INF so that the display unit highlights the button images. For example, a smartphone may be used as the operation terminal.

[0107] [Variation 1-5] In the above embodiment, the illuminance sensor 18 is provided in the display device 10, but this is not limiting, and the illuminance sensor may be provided in the operation terminal 30. The light-emission control unit 38 of the operation terminal 30 may control the light-emitting operation of the light-emitting unit 32 based on the detection result of the illuminance sensor 18 of the display device 10 and the detection result of the illuminance sensor of the operation terminal 30. Furthermore, if the light-emitting operation can be controlled without using the illuminance sensor 18 of the display device 10 by using the illuminance sensor provided in the operation terminal 30, the light-emission control unit 38 may control the light-emitting operation using only the detection result of the illuminance sensor in the operation terminal 30. In this case, the illuminance sensor 18 does not need to be provided in the display device 10.

[0108] Similarly, for example, in the display system 1B ( FIG. 10 ) of Modification 1-3, the illuminance sensor 18 and the color sensor 18B are provided in the display device 10B. However, this is not limiting, and the illuminance sensor and the color sensor may be provided in the operation terminal 30B. The light-emission control unit 38B may control the light-emitting operation of the light-emitting unit 32 based on the detection results of the illuminance sensor 18 and the color sensor 18B of the display device 10B and the detection results of the illuminance sensor and the color sensor of the operation terminal 30B. Furthermore, if the light-emitting operation can be controlled without using the illuminance sensor 18 and the color sensor 18B of the display device 10B by using one or both of the illuminance sensor and the color sensor of the operation terminal 30B, the light-emission control unit 38B may control the light-emitting operation using only the detection results of the sensors in the operation terminal 30B. In this case, the display device 10B does not need to be provided with one or both of the illuminance sensor 18 and the color sensor 18B.

[0109] Furthermore, the control unit 21B of the display device 10B may control the operation of the display device 10B by receiving, from the operation terminal 30B, environmental information (e.g., environmental brightness and environmental color) acquired by one or both of an illuminance sensor and a color sensor provided in the operation terminal 30B. Specifically, for example, the control unit 21B may adjust the display brightness of the display unit 16 based on the information about the environmental brightness acquired by the illuminance sensor of the operation terminal 30B. Also, for example, the control unit 21B may adjust the display contrast of the display unit 16 based on the information about the environmental color acquired by the color sensor of the operation terminal 30B. In this way, by using the information from the environmental sensor provided in the operation terminal 30B, it is possible to acquire environmental information that reduces the influence of reflection of light emitted from the display unit 16 of the display device 10B. Note that the control of the display device 10B based on the environmental sensor of the operation terminal 30B is not limited to control of the display unit 16, and any setting of the display device 10B may be changed. Furthermore, the sensor information transmitted from the environmental sensor of the operation terminal 30B to the display device 10B may be information corresponding to the sensor information INF1 or the control information INF.

[0110] Furthermore, if the operation terminal 30B is provided with an environmental sensor such as an illuminance sensor or a color sensor, the power supply unit 36 ​​may supply power supply voltage to the environmental sensor of the operation terminal 30B only for a short period corresponding to the detection timing, based on detection of movement of the operation terminal 30B or detection of a user operation on the operation unit 31. Furthermore, if the operation terminal 30B transmits an infrared signal, the timing of transmitting the infrared signal and the timing of the illuminance detection process may be shifted from each other to reduce the effects of fluctuations in the infrared signal and power supply voltage on the illuminance sensor of the operation terminal 30B. Specifically, for example, when the user presses button B of the operation unit 31, the control unit 37B may detect information about the brightness of the environment using the illuminance sensor, and after the detection process by the illuminance sensor is completed, the control unit 37B may control the infrared emitter 34 to transmit an infrared signal corresponding to button B to the device to be operated, such as the display device 10B.

[0111] Furthermore, control unit 21B may operate display device 10B using not only the detection results of the environmental sensor of operation terminal 30B but also the detection results of acceleration sensor 33. Specifically, when control unit 21B determines that operation terminal 30 has been turned upside down, for example, based on the detection results of the illuminance sensor or acceleration sensor 33 of operation terminal 30B, control unit 21B may stop the supply of power supply voltage to display unit 16 or turn off the power supply of display device 10B. At this time, display device 10B may receive, for example, sensor information from operation terminal 30B indicating that operation surface S on which operation unit 31 and the illuminance sensor are provided has been turned vertically downward.

[0112] [Other variations] Two or more of these variations may also be combined.

[0113] <2. Second Embodiment> Next, a display system 2 according to a second embodiment will be described. The display system 2 according to this embodiment is configured to control the light-emitting operation of the light-emitting unit of the operating terminal in accordance with the content displayed by the display device. Note that components that are substantially the same as those in the display system 1 according to the first embodiment are given the same reference numerals, and descriptions thereof will be omitted where appropriate.

[0114] 13 shows an example of the configuration of the display system 2. The display system 2 includes a display device 40 and an operation terminal 50.

[0115] The display device 40 has a control unit 41. The control unit 41 has a content analysis unit 43 and a control information generation unit .

[0116] The content analysis unit 43 is configured to analyze the content displayed by the display unit 16 of the display device 40. Specifically, when the display unit 16 displays a video based on a video signal selected by the tuner 11, for example, the content analysis unit 43 analyzes the content by analyzing broadcast metadata included in the video signal.

[0117] The control information generation unit 42 is configured to generate control information INF for controlling the light emitting operation of the light emitting unit 32 in the operation terminal 50 based on the analysis result of the content analysis unit 43. Then, the display device 40 is configured to transmit the control information INF generated by the control information generation unit 42 to the operation terminal 50 via the wireless communication unit 13.

[0118] The operation terminal 50 has a control unit 57. The control unit 57 has a light-emitting control unit 58. The light-emitting control unit 58 is configured to control the light-emitting operation of the light-emitting unit 32 based on control information INF transmitted from the display device 40.

[0119] FIG. 14 shows an example of the operation of the display device 40. In FIG.

[0120] First, the control unit 41 checks whether the infrared light receiving unit 12 has received an infrared signal transmitted from the operation terminal 50 (step S201).

[0121] If the infrared receiver 12 receives an infrared signal ("Y" in step S201), the control unit 41 checks whether the user has performed a channel change operation (step S202). Specifically, the control unit 41 checks whether the infrared signal is a signal corresponding to the operation of the numeric button B3 or the channel button B11 shown in FIG. 2, thereby checking whether the user has performed a channel change operation.

[0122] In step S202, if the user performs a channel change operation ("Y" in step S202), the content analysis unit 43 checks whether the displayed content is audio multiplex broadcast compatible content based on the broadcast metadata included in the video signal corresponding to the channel newly selected by the channel change operation (step S203). Audio multiplex broadcast compatible content includes, for example, content that supports multiple languages ​​and content that includes main audio and secondary audio. If the displayed content is audio multiplex broadcast compatible content ("Y" in step S203), the control information generation unit 42 generates content information INF2 including information that the displayed content is audio multiplex broadcast compatible content (step S204).

[0123] Next, the content analysis unit 43 checks whether the displayed content is subtitle-compatible content based on the broadcast metadata (step S205). If the displayed content is subtitle-compatible content ("Y" in step S205), the control information generation unit 42 generates content information INF2 including information that the displayed content is subtitle-compatible content (step S206).

[0124] Next, the content analysis unit 43 checks whether the displayed content is data broadcasting compatible content based on the broadcast metadata (step S207). If the displayed content is data broadcasting compatible content ("Y" in step S207), the control information generation unit 42 generates content information INF2 including information that the displayed content is data broadcasting compatible content (step S208). Then, the process proceeds to step S211.

[0125] In step S202, if the user has not performed a channel change operation ("N" in step S201), the control unit 41 checks whether the user has performed an operation to select a video streaming service (step S209). Specifically, the control unit 41 checks whether the user has performed an operation to select a video streaming service, for example, by checking whether the infrared signal is a signal corresponding to the operation of the video service selection button B2 shown in FIG. 2. If the user has not performed an operation to select a video streaming service ("N" in step S209), this flow ends.

[0126] In step S209, if the user selects a video streaming service ("Y" in step S209), the control information generator 42 generates content information INF2 including information that the displayed content is provided by a video streaming service (step S210), and then proceeds to step S211.

[0127] Then, when the control information generator 42 generates the content information INF2, the controller 41 transmits the control information INF including the content information INF2 to the operation terminal 50 via the wireless communication unit 13 (step S211). This ends the flow.

[0128] FIG. 15 shows an example of the operation of the display system 2 when the user performs a channel change operation.

[0129] When the user changes the channel by, for example, operating the numeric button B3 or the channel button B11 of the operation terminal 50, the control unit 57 of the operation terminal 50 detects this operation and changes the operating state of the operation terminal 50 from the sleep state to the normal operating state (step S221). Then, the infrared light emitter 34 transmits an infrared signal corresponding to this channel change operation (step S222). The infrared light receiver 12 of the display device 40 receives this infrared signal.

[0130] The tuner 11 of the display device 40 changes the channel based on the information about the channel change operation included in the infrared signal (step S223). Then, the content analysis unit 43 analyzes the content by analyzing the broadcast metadata included in the video signal selected by the tuner 11 (step S224). The control information generation unit 42 generates content information INF2 based on the analysis result of the content analysis unit 43 (step S225). Then, the control unit 41 transmits the control information INF including the content information INF2 to the operation terminal 50 via the wireless communication unit 13 (step S226). The control unit 57 of the operation terminal 50 receives the control information INF via the wireless communication unit 35.

[0131] The light emission control unit 58 of the operation terminal 50 generates light emission control information INFBL based on the content information INF2 included in this control information INF (step S227).

[0132] For example, if the content information INF2 includes information indicating that the displayed content is audio multiplex broadcast compatible content, the light emission control unit 58 generates light emission control information INFBL that instructs the light emitting element corresponding to the audio switch button B14 (Figure 2) in the light emitting unit 32 to emit light for a predetermined period of time.

[0133] Furthermore, for example, if the content information INF2 includes information indicating that the displayed content is subtitle-compatible content, the light emission control unit 58 generates light emission control information INFBL that instructs the light emitting element corresponding to the subtitle button B15 (Figure 2) in the light emitting unit 32 to emit light for a predetermined period of time.

[0134] Furthermore, for example, if the content information INF2 includes information indicating that the displayed content is data broadcast compatible content, the light-emitting control unit 58 generates light-emitting control information INFBL instructing the light-emitting elements of the light-emitting unit 32 corresponding to the data broadcast button B19, color buttons B4, and numeric buttons B3 (FIG. 2) to emit light for a predetermined time. Note that this is not a limitation. For example, if the displayed content is data broadcast compatible content and does not accept operation of the color buttons B4 or numeric buttons B3, the light-emitting control unit 58 may generate light-emitting control information INFBL instructing the light-emitting elements corresponding to the data broadcast button B19 to emit light for a predetermined time. For example, if the displayed content is data broadcast compatible content and accepts operation of the color buttons B4 or numeric buttons B3, the light-emitting control unit 58 may generate light-emitting control information INFBL instructing the light-emitting elements corresponding to the data broadcast button B19 to emit light for a predetermined time.

[0135] Furthermore, for example, if the content information INF2 includes information indicating that the displayed content is content provided by a video streaming service, the light emission control unit 58 generates light emission control information INFBL that instructs the light emitting element corresponding to the video content operation button B16 (Figure 2) in the light emitting unit 32 to emit light for a predetermined period of time.

[0136] Next, the light-emission control unit 58 starts emitting light from the light-emitting unit 32 based on this light-emission control information INFBL (step S228). As a result, button B on the operation unit 31 of the operation terminal 50, which is specified by the light-emission control information INFBL, is highlighted by the light emitted from the light-emitting unit 32. Then, based on this light-emission control information INFBL, the light-emission control unit 58 stops emitting light from the light-emitting unit 32 after a predetermined time has elapsed (step S229). This ends the sequence.

[0137] As described above, in the display system 2, the control information generation unit 42 of the display device 40 generates control information INF according to the content being displayed on the display device 40, and the light-emission control unit 58 of the operation terminal 50 controls the light-emitting operation of the light-emitting unit 32 based on this control information INF. As a result, in the display system 2, the button B that is likely to be operated by the user can be emphasized by the light from the light-emitting unit 32. Therefore, for example, the user can easily find the button B that he or she wants to operate among multiple buttons B. As a result, the display system 2 can improve user convenience.

[0138] As described above, in this embodiment, the control information generating unit of the display device generates control information according to the content displayed on the display device, and the light-emitting control unit of the operating terminal controls the light-emitting operation of the light-emitting unit based on this control information, so that, for example, the user can easily find the button he or she wants to operate, thereby improving user convenience. Other effects are the same as in the first embodiment.

[0139] [Variation 2-1] In the above embodiment, the control information INF includes content information INF2, but this is not limited to this. For example, as in variant example 1-1 of the first embodiment, the control information INF may include light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 32.

[0140] [Variation 2-2] In the above embodiment, when the displayed content is audio multiplex broadcast compatible content, subtitle compatible content, data broadcast compatible content, or content provided by a video streaming service, the button B corresponding to that content is highlighted by the light from the light-emitting unit 32, but this is not limited to this. For example, it is also possible to highlight the corresponding button B for three or less types of content out of these four types of content. Specifically, for example, when the displayed content is audio multiplex broadcast compatible content, subtitle compatible content, or content provided by a video streaming service, the button B corresponding to that content may be highlighted, and when the displayed content is data broadcast compatible content, the corresponding button B may not be highlighted.

[0141] <3. Third Embodiment> Next, a display system 3 according to a third embodiment will be described. The display system 3 according to this embodiment is configured to analyze the displayed image and control the light-emitting operation of the light-emitting unit of the operating terminal according to the analysis results. Note that components that are substantially the same as those in the display system 1 according to the first embodiment are given the same reference numerals, and descriptions thereof will be omitted as appropriate.

[0142] 16 shows an example of the configuration of the display system 3. The display system 3 includes a display device 60 and an operation terminal .

[0143] The display device 60 has a control unit 61. The control unit 61 has an image analysis unit 63 and a control information generation unit 62.

[0144] The image analysis unit 63 is configured to analyze the image displayed by the display unit 16 based on the video signal. Specifically, the image analysis unit 63 generates information about the average color of all pixels in a frame image based on, for example, the video signal. Note that in this example, the image analysis unit 63 of the display device 60 analyzes the image, but this is not limited to this, and instead, for example, an external server may analyze the image.

[0145] The control information generation unit 62 is configured to generate control information INF for controlling the light emitting operation of the light emitting unit 72 in the operation terminal 70 based on the analysis result of the image analysis unit 63. Then, the control unit 61 is configured to transmit the control information INF generated by the control information generation unit 62 to the operation terminal 70 via the wireless communication unit 13.

[0146] The operation terminal 70 includes a light emitting unit 72 and a control unit 77 .

[0147] The light-emitting unit 72 is configured to be able to emit light from the entire surface of the operation surface S. Specifically, for example, the housing and buttons B of the operation terminal 70 can be configured using a translucent material, and the light-emitting unit 72 can emit light so that light is emitted from the operation surface S. The light-emitting unit 72 includes, for example, a light-emitting element that emits red light, a light-emitting element that emits green light, and a light-emitting element that emits blue light.

[0148] The control unit 77 has a light emission control unit 78. The light emission control unit 78 is configured to control the light emitting operation of the light emitting unit 72 based on control information INF transmitted from the display device 60.

[0149] 17 shows an example of the operation of the display device 60. The display device 60 repeatedly performs the following operation every time a predetermined time (for example, about several seconds) has elapsed.

[0150] First, the image analysis unit 63 analyzes the image displayed by the display unit 16 based on the video signal (step S301).

[0151] Next, the control information generator 62 generates image color information INF3 based on the analysis results of the image analyzer 63 (step S302). In this example, the image color information INF3 includes information about the average color in the frame image. The image color information INF3 can be expressed using, for example, a luminance signal (Y) and color difference signals (Cr, Cb). However, this is not limited to this, and the image color information INF3 may also be expressed using a red signal (R), a green signal (G), and a blue signal (B).

[0152] Then, the control unit 61 transmits the control information INF including this image color information INF3 to the operation terminal 70 via the wireless communication unit 13 (step S303). This is the end of this flow.

[0153] FIG. 18 shows an example of the operation of the display system 3.

[0154] The image analysis unit 63 of the display device 60 analyzes the image based on the video signal (step S321), and the control information generation unit 62 generates image color information INF3 based on the image analysis results (step S322). Then, the control unit 61 transmits control information INF including this image color information INF3 to the operation terminal 70 via the wireless communication unit 13 (step S323). The control unit 77 of the operation terminal 70 receives this control information INF via the wireless communication unit 35.

[0155] The light emission control unit 78 of the operation terminal 70 generates light emission control information INFBL based on the image color information INF3 included in this control information INF (step S324).

[0156] For example, if the display unit 16 is displaying a scene of something burning, the image color information INF3 includes information about the color red. In this case, the light-emission control unit 78 generates the light-emission control information INFBL by setting the light-emission brightness of each light-emitting element so that the light-emitting unit 72 emits red light. Alternatively, if the display unit 16 is displaying a forest scene, the image color information INF3 includes information about the color green. In this case, the light-emission control unit 78 generates the light-emission control information INFBL that instructs the light-emitting unit 72 to emit each light-emitting element so as to emit green light. Alternatively, if the display unit 16 is displaying an ocean scene or a blue sky scene, the image color information INF3 includes information about the color blue. In this case, the light-emission control unit 78 generates the light-emission control information INFBL that instructs the light-emitting unit 72 to emit each light-emitting element so as to emit blue light.

[0157] Next, the light emission control unit 78 controls the light emission operation of the light emitting unit 72 based on the light emission control information INFBL (step S325). As a result, light of a color corresponding to the scene displayed on the display unit 16 is emitted from the operation surface S of the operation terminal 70.

[0158] This is the end of the sequence. By repeating this sequence, the operation terminal 70 can continue to emit light of a color that corresponds to the scene being displayed on the display unit 16.

[0159] In this way, in the display system 3, the control information generation unit 62 of the display device 60 generates control information INF corresponding to the color displayed by the display unit 16, and the light emission control unit 78 of the operation terminal 70 controls the light emission operation of the light emitting unit 72 based on this control information INF. This allows the operation terminal 70 to emit light of a color corresponding to the scene displayed by the display unit 16, thereby enabling, for example, a user viewing content to feel a more realistic sensation.

[0160] As described above, in this embodiment, the control information generation unit of the display device generates control information according to the color displayed by the display unit, and the light emission control unit of the operating terminal controls the light emission operation of the light emitting unit based on this control information, allowing the user to feel a greater sense of realism.

[0161] [Variation 3-1] In the above embodiment, the control information INF includes image color information INF3, but this is not limited to this. For example, as in the case of the display system 1A relating to variant example 1-1 of the first embodiment, the control information INF may include light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 72.

[0162] [Variation 3-2] In the above embodiment, the light-emitting unit 72 capable of emitting light from the entire surface of the operation surface S is provided, but the present invention is not limited to this. For example, similar to the display system 1B according to Modification 1-3 of the first embodiment, a light-emitting unit 32B may be provided that emits light to highlight multiple buttons B on the operation unit 31. In this case as well, by controlling the light emission brightness of the light-emitting elements of each color included in the light-emitting unit 32B, it is possible to emit light of a color corresponding to the scene displayed by the display unit 16 from the operation surface S.

[0163] <4. Fourth embodiment> Next, a display system 4 according to a fourth embodiment will be described. The display system 4 according to this embodiment is configured to control the light-emitting operation of the light-emitting unit of the operating terminal in accordance with the information to be notified when the display device notifies the user of information. Note that components that are substantially the same as those in the display system 1 according to the first embodiment are given the same reference numerals, and descriptions thereof will be omitted where appropriate.

[0164] 19 shows an example of the configuration of the display system 4. The display system 4 includes a display device 80 and an operation terminal 90.

[0165] The display device 80 includes a control unit 81. The control unit 81 includes a notification processing unit 83 and a control information generating unit .

[0166] The notification processing unit 83 is configured to check whether there is information to be notified to the user, and if there is information to be notified to the user, to generate a notification message to be displayed on the display unit 16, for example.

[0167] The control information generation unit 82 is configured to generate control information INF for controlling the light emitting operation of the light emitting unit 32 in the operation terminal 90 based on the processing of the notification processing unit 83. Then, the control unit 81 is configured to transmit the control information INF generated by the control information generation unit 82 to the operation terminal 90 via the wireless communication unit 13.

[0168] The operation terminal 90 has a control unit 97. The control unit 97 has a light emission control unit 98. The light emission control unit 98 is configured to control the light emitting operation of the light emitting unit 32 based on control information INF transmitted from the display device 80.

[0169] In this example, a software distribution server 202 is connected to the Internet NET. The software distribution server 202 is configured to distribute software such as firmware to the display device 60. Here, the software distribution server 202 corresponds to a specific example of a "distribution server" in the present disclosure.

[0170] 20A and 20B show an example of the operation of the display device 80. FIG.

[0171] First, the control unit 81 checks whether software to be updated has been newly registered in the software distribution server 202 (step S401). If software to be updated has been newly registered ("Y" in step S401), the notification processing unit 83 generates a notification message indicating that software to be updated exists, and the display unit 16 displays this notification message (step S402). Then, the control information generation unit 82 generates notification information INF4 including information indicating that software to be updated exists (step S403).

[0172] Next, the control unit 81 checks whether a new external device has been connected to the external device interface 14 (step S404). If a new external device has been connected to the external device interface 14, the notification processing unit 83 generates a notification message indicating that a new external device has been connected, and the display unit 16 displays this notification message (step S405). Then, the control information generation unit 82 generates notification information INF4 including information indicating that a new external device has been connected (step S406).

[0173] Next, when a recording / playback device is connected to the external device interface 14, the control unit 81 checks whether the recording / playback device has newly recorded content (step S407). If newly recorded content exists ("Y" in step S407), the notification processing unit 83 generates a notification message indicating that newly recorded content exists, and the display unit 16 displays this notification message (step S408). Then, the control information generation unit 82 generates notification information INF4 including information indicating that newly recorded content exists (step S409).

[0174] Next, the control unit 81 checks whether there is a setting change proposal for the user (step S410). If there is a setting change proposal ("Y" in step S410), the notification processing unit 83 generates a notification message about the content of the setting change to be proposed, and the display unit 16 displays this notification message (step S411). Then, the control information generation unit 82 generates notification information INF4 including information that there is a setting change proposal (step S412).

[0175] Next, the control unit 81 checks whether new content has been registered in the content server 201 of the video streaming service (step S413). If new content has been registered ("Y" in step S413), the notification processing unit 83 generates a notification message indicating that new content has been registered in the video streaming service, and the display unit 16 displays this notification message (step S414). Then, the control information generation unit 82 generates notification information INF4 including information indicating that new content has been registered in the video streaming service (step S415).

[0176] Then, the control unit 81 transmits the control information INF including this notification information INF4 to the operation terminal 90 via the wireless communication unit 13 (step S416). This is the end of this flow.

[0177] FIG. 21 shows an example of the operation of the display system 4.

[0178] The notification processing unit 83 of the display device 80 generates a notification message, and the display unit 16 displays this notification message (step S421). The control information generation unit 82 generates notification information INF4 based on the processing of the notification processing unit 83 (step S422). Then, the control unit 81 transmits control information INF including this notification information INF4 to the operation terminal 90 via the wireless communication unit 13 (step S423). The control unit 97 of the operation terminal 90 receives this control information INF via the wireless communication unit 35.

[0179] The light emission control unit 98 of the operation terminal 90 generates light emission control information INFBL based on the notification information INF4 included in this control information INF (step S424).

[0180] For example, if the notification information INF4 includes information indicating that there is software that needs to be updated, the light-emitting control unit 98 generates light-emitting control information INFBL that instructs the light-emitting element corresponding to the help button B18 (Figure 2) in the light-emitting unit 32 to emit light for a predetermined period of time.

[0181] Also, for example, if the notification information INF4 includes information that a new external device has been connected, the light-emitting control unit 98 generates light-emitting control information INFBL that instructs the light-emitting element corresponding to the input switch button B7 (Figure 2) in the light-emitting unit 32 to emit light for a predetermined period of time.

[0182] Also, for example, if the notification information INF4 includes information indicating that newly recorded content is available, the light emission control unit 98 generates light emission control information INFBL that instructs the light emitting element corresponding to the recording list button B17 (Figure 2) in the light emitting unit 32 to emit light for a predetermined period of time.

[0183] Also, for example, if the notification information INF4 includes information indicating that there is a suggestion for changing settings, the light emission control unit 98 generates light emission control information INFBL that instructs the light emitting element corresponding to the setting button B6 (Figure 2) in the light emitting unit 32 to emit light for a predetermined period of time.

[0184] Furthermore, for example, if the notification information INF4 includes information that new content has been registered in a video streaming service, the light-emission control unit 98 generates light-emission control information INFBL that instructs the light-emitting element corresponding to the video service selection button B2 (FIG. 2) in the light-emitting unit 32 to emit light for a predetermined period of time. Specifically, for example, if new content has been registered in service S1 of the video streaming services, the light-emission control unit 98 can generate light-emission control information INFBL that instructs the light-emitting element corresponding to button B of the video service selection buttons B2 that corresponds to service S1 to emit light.

[0185] Next, the light-emission control unit 98 starts emitting light from the light-emitting unit 32 based on this light-emission control information INFBL (step S425). As a result, button B on the operation unit 31 of the operation terminal 90, which is specified by the light-emission control information INFBL, is highlighted by the light emitted from the light-emitting unit 32. Then, based on this light-emission control information INFBL, the light-emission control unit 98 stops emitting light from the light-emitting unit 32 after a predetermined time has elapsed (step S426). This ends the sequence.

[0186] As described above, in the display system 4, the control information generation unit 82 of the display device 80 generates control information INF according to information to be notified to the user, and the light-emission control unit 98 of the operation terminal 90 controls the light-emitting operation of the light-emitting unit 32 based on this control information INF. As a result, in the display system 4, the button B that is likely to be operated by the user can be emphasized by the light from the light-emitting unit 32. Therefore, for example, the user can easily find the button B that he or she wants to operate among multiple buttons B. As a result, the display system 4 can improve user convenience.

[0187] As described above, in this embodiment, the control information generating unit of the display device generates control information corresponding to the information to be notified to the user, and the light-emitting control unit of the operating terminal controls the light-emitting operation of the light-emitting unit based on this control information, so that, for example, the user can easily find the button he or she wants to operate, thereby improving user convenience. Other effects are the same as in the first embodiment.

[0188] [Variation 4-1] In the above embodiment, the control information INF includes notification information INF4, but this is not limited to this. For example, as in the case of the display system 1A relating to variant example 1-1 of the first embodiment, the control information INF may include light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 32.

[0189] [Variation 4-2] In the above embodiment, the software is distributed by the software distribution server 202, but this is not limiting. For example, a broadcasting station may distribute the software using digital broadcast waves. In this case, the control unit 81 may check whether the software has been updated based on the software supplied using the digital broadcast waves.

[0190] [Variation 4-3] In the above embodiment, as shown in steps S425 and S426, button B on operation terminal 90 corresponding to the information to be notified is highlighted for a predetermined period of time by light from light-emitting unit 32, but this is not limited to this. Instead, for example, when display unit 16 of display device 80 displays a notification message in step S421, button B corresponding to the notification message may be highlighted while display unit 16 is displaying the notification message.

[0191] [Variation 4-4] In the above embodiment, several examples of information to be notified to the user have been described, but the present invention is not limited to these. For example, when content related to the content viewed by the user is available via broadcasting or a video streaming service, the display unit 16 may display a notification message to that effect, and the button B corresponding to the notification message may be highlighted with light from the light-emitting unit 32.

[0192] Specifically, in the display device 80, for example, when a user finishes watching a broadcast movie, the notification processing unit 83 generates a notification message informing the user that other movies related to the director of the broadcast movie are available for viewing on service S1 of the video streaming services, and the display unit 16 displays this notification message. The control information generation unit 82 generates notification information INF4 in response to this notification message, and the control unit 81 transmits control information INF including this notification information INF4 to the operation terminal 90 via the wireless communication unit 13. Based on the notification information INF4 included in this control information INF, the operation terminal 90 highlights button B corresponding to service S1 among the video service selection buttons B2 with light from the light-emitting unit 32.

[0193] Furthermore, for example, when a user views an official trailer for a drama via a video streaming service, the notification processing unit 83 creates a notification message indicating that the drama can be viewed via a VOD (Video On Demand) service of a set-top box connected to the external device interface 14, and the display unit 16 displays this notification message. The control information generation unit 82 generates notification information INF4 in accordance with this notification message, and the control unit 81 transmits control information INF including this notification information INF4 to the operation terminal 90 via the wireless communication unit 13. The operation terminal 90 highlights the input switch button B7 with light from the light-emitting unit 32 based on the notification information INF4 included in this control information INF.

[0194] In this way, the display device 80 can recommend content to the user by displaying a notification message based on the content that the user has viewed. The operation terminal 90 then highlights the button B corresponding to the method by which the recommended content can be viewed, allowing the user to easily find the button that should be operated to view the content, thereby improving user convenience.

[0195] [Variation 4-5] In the above embodiment, the light-emitting unit 32 of the operation terminal 90 emits light based on the content-related notification information INF4 transmitted from the display device 80. However, this is not limiting. For example, the notification processing unit 83 of the display device 80 may generate a notification message based on the status of the battery built into the operation terminal 90, and the display unit 16 may display this notification message. Specifically, when the remaining charge of the battery built into the operation terminal 90 falls below a predetermined level or when the battery built into the operation terminal 90 is being charged, the operation terminal 90 may transmit information regarding the battery status to the display device 80, and the display unit 16 of the display device 80 may display a notification message corresponding to the received information regarding the battery status. In this case, the notification information, such as the information regarding the battery status, transmitted from the operation terminal 90 to the display device 80 may be information corresponding to the notification information INF4 or the control information INF, or may be information exchanged via the wireless communication units 35 and 13.

[0196] The operation terminal 90 may also cause the light-emitting unit 32 to emit light depending on the status of the built-in battery. In this case, one or more buttons B may be highlighted in a predetermined color or at a predetermined timing. Specifically, when the remaining battery power falls below a predetermined level, the power button B1 may be controlled to flash in red, or when battery charging begins, the power button B1 may be highlighted in a color other than red. At this time, multiple buttons B (e.g., the power button B1 and the numeric button B3) may be highlighted. The display device 80 or the operation terminal 90 may also correspond the highlighted expression of the button B of the operation terminal 90 to the notification message displayed on the display unit 16. Specifically, the color or timing at which the light-emitting unit 32 emits light may correspond to the color or timing of the notification message displayed on the display unit 16. In this case, for example, when the remaining battery power of the operation terminal 90 falls below a predetermined level or when battery charging begins, the color or frequency of the light-emitting unit 32 may be controlled to be the same as the color or frequency of the notification message displayed on the display unit 16. In addition, if the battery of the operation terminal 30 is charged by wireless power supply, the operation terminal 90 may transmit information regarding the light emission of the light-emitting unit 32 or the battery status to the display device 80 when placed on a wireless power supply charger.

[0197] <5. Fifth Embodiment> Next, a display system 5 according to a fifth embodiment will be described. The display system 5 according to this embodiment is configured to control the light-emitting operation of the light-emitting unit of the operating terminal in accordance with the voice assistant selected by the user when multiple voice assistants are installed in the display device. Note that components that are substantially the same as those in the display system 1 according to the first embodiment are given the same reference numerals, and descriptions thereof will be omitted as appropriate.

[0198] 22 shows an example of the configuration of the display system 5. The display system 5 includes a display device 100 and an operation terminal 110.

[0199] The display device 100 has a control unit 101. The control unit 101 has two voice assistant processing units 103 (voice assistant processing units 103A and 103B) and a control information generation unit .

[0200] The voice assistant processing unit 103 is configured to perform processing according to user instructions contained in the user's voice data, based on the user's voice data. The voice assistant processing unit 103A realizes the function of the voice assistant VA, and the voice assistant processing unit 103B realizes the function of the voice assistant VB. The user selects the voice assistant to be used from the voice assistants VA and VB by operating the voice assistant call button B5 of the operation terminal 110. The control unit 101 of the display device 100 selects one of the voice assistants VA and VB based on a button operation code corresponding to the operation of the voice assistant call button B5, which is received from the operation terminal 110 via the wireless communication unit 13.

[0201] When the button operation code transmitted from the operation terminal 110 indicates a selection operation of the voice assistant VA by the user, the voice assistant processing unit 103A transmits the voice data subsequently transmitted from the operation terminal 110 to the server 204A connected to the Internet NET. Then, the voice assistant processing unit 103A performs processing according to the user's instructions contained in the voice data based on the information analyzed by the server 204A.

[0202] When the button operation code transmitted from the operation terminal 110 indicates a selection operation of the voice assistant VB by the user, the voice assistant processing unit 103B transmits the voice data transmitted from the operation terminal 110 to the server 204B connected to the Internet NET. Then, the voice assistant processing unit 103B performs processing according to the user's instructions contained in the voice data based on the information analyzed by the server 204B.

[0203] The control information generation unit 102 is configured to generate control information INF for controlling the light emitting operation of the light emitting unit 112 in the operation terminal 110 according to the voice assistant selected by the user from the two voice assistants VA and VB. Then, the control unit 101 is configured to transmit the control information INF generated by the control information generation unit 102 to the operation terminal 110 via the wireless communication unit 13.

[0204] The operation terminal 110 includes a light emitting unit 112 , a microphone 113 , and a control unit 117 .

[0205] The light emitting unit 112 is configured to emit light to highlight the plurality of buttons B on the operation unit 31. The light emitting unit 112 has, for example, a plurality of light emitting elements. The plurality of light emitting elements includes, for example, a light emitting element that emits red light, a light emitting element that emits green light, and a light emitting element that emits blue light.

[0206] The microphone 113 is configured to convert, for example, the user's voice into an electrical signal. The control unit 117 generates voice data based on the electrical signal supplied from the microphone 113 and transmits the voice data to the display device 100 via the wireless communication unit 35.

[0207] For example, when the user operates the voice assistant call button B5 (FIG. 2), the control unit 117 transmits a button operation code via the wireless communication unit 35. The button operation code includes a press code indicating that the voice assistant call button B5 has been pressed, and a release code indicating that the pressed voice assistant call button B5 has been released.

[0208] The control unit 117 has a light emission control unit 118. The light emission control unit 118 is configured to control the light emitting operation of the light emitting unit 112 based on control information INF transmitted from the display device 100.

[0209] Here, content server 201 corresponds to a specific but not limitative example of a "content server" in the present disclosure. Servers 204A and 204B correspond to a specific but not limitative example of a "server" in the present disclosure.

[0210] FIG. 23 shows an example of the operation of the display device 100.

[0211] First, the control unit 101 checks whether a user operation on the voice assistant call button B5 has been detected (step S501). For example, to select voice assistant VA, the user presses the voice assistant call button B5 (FIG. 2) on the operation terminal 110 for a short time, and to select voice assistant VB, the user presses the voice assistant call button B5 (FIG. 2) for a long time. If the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 (FIG. 2) has been pressed for a short time, the control unit 101 selects the voice assistant VA. If the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 (FIG. 2) has been pressed for a long time, the control unit 101 selects the voice assistant VA. If a user operation on the voice assistant call button B5 has not been detected ("N" in step S501), this flow ends.

[0212] In this example, the selection operation of the voice assistants VA and VB is performed based on the length of time the voice assistant call button B5 is pressed, but this is not limited to this, and for example, the selection operation of the voice assistants VA and VB may be performed based on the number of times the voice assistant call button B5 is pressed. For example, the control unit 101 may select the voice assistant VA when the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 has been pressed once, and may select the voice assistant VB when the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 has been pressed twice in succession.

[0213] In step S501, when a user operation on the voice assistant call button B5 is detected, the control unit 101 transmits a microphone activation code to the operation terminal 110 via the wireless communication unit 13 (step S502).

[0214] Next, it is confirmed whether the voice assistant VA has been selected (step S503). If the voice assistant VA has been selected ("Y" in step S503), the control information generation unit 102 generates assistant information INF5 including information that the voice assistant VA has been selected (step S504). If the voice assistant VB has been selected ("N" in step S503), the control information generation unit 102 generates assistant information INF5 including information that the voice assistant VB has been selected (step S505).

[0215] Then, the control unit 101 transmits the control information INF including this assistant information INF5 to the operation terminal 110 via the wireless communication unit 13 (step S506). This is the end of this flow.

[0216] FIG. 24 shows an example of the operation of the display system 5 when the user operates the voice assistant call button B5.

[0217] When the user operates the voice assistant call button B5 of the operation terminal 110, the control unit 117 of the operation terminal 110 detects this operation and changes the operating state of the operation terminal 110 from a sleep state to a normal operating state (step S521). Then, the control unit 117 transmits a button operation code corresponding to the operation of the voice assistant call button B5 via the wireless communication unit 35 (step S522). The control unit 101 of the display device 100 receives this button operation code via the wireless communication unit 13.

[0218] Next, control unit 101 of display device 100 transmits a microphone activation code to operation terminal 110 via wireless communication unit 13 (step S523). Control unit 117 of operation terminal 110 receives this microphone activation code via wireless communication unit 35. Control unit 117 activates microphone 113 based on this microphone activation code. This allows operation terminal 110 to accept voice input.

[0219] The control unit 101 of the display device 100 selects one of the voice assistants VA and VB based on information about the operation of the voice assistant call button B5 included in the microphone activation code (step S524). The control information generation unit 102 generates assistant information INF5 based on the selection result of the voice assistant (step S525). Then, the control unit 101 transmits control information INF including this assistant information INF5 to the operation terminal 110 via the wireless communication unit 13 (step S526). The control unit 117 of the operation terminal 110 receives this control information INF via the wireless communication unit 35.

[0220] The light emission control unit 118 of the operating terminal 110 generates light emission control information INFBL based on the assistant information INF5 included in this control information INF (step S527).

[0221] For example, if the assistant information INF5 includes information indicating that the voice assistant VA has been selected, the light-emitting control unit 118 generates light-emitting control information INFBL that instructs each light-emitting element in the light-emitting unit 112 to emit light so that the voice assistant call button B5 (Figure 2) is highlighted, for example, in orange, for the period during which the voice assistant VA is accepting voice input.

[0222] Also, for example, if the assistant information INF5 includes information indicating that the voice assistant VB has been selected, the light-emitting control unit 118 generates light-emitting control information INFBL that instructs each light-emitting element in the light-emitting unit 112 to emit light so that the voice assistant call button B5 (Figure 2) is highlighted in blue, for example, for the period during which the voice assistant VB is accepting voice input.

[0223] Next, the light-emission control unit 118 starts emitting light from the light-emitting unit 112 based on this light-emission control information INFBL (step S528). As a result, the voice assistant call button B5 on the operation unit 31 of the operation terminal 110 is highlighted by the light emitted from the light-emitting unit 112. Then, based on this light-emission control information INFBL, the light-emission control unit 118 stops emitting light from the light-emitting unit 112 after the period during which the voice assistant accepts voice input has ended (step S529). This completes the sequence.

[0224] In this way, in the display system 5, the control information generation unit 102 of the display device 100 generates control information INF according to the selected voice assistant, and the light emission control unit 118 of the operation terminal 110 controls the light emission operation of the light emitting unit 112 based on this control information INF. As a result, in the display system 5, the user can easily know which of the two voice assistants VA and VB has been selected, and can easily know whether the selected voice assistant is accepting voice input. As a result, the display system 5 can improve user convenience.

[0225] As described above, in this embodiment, the control information generation unit of the display device generates control information according to the selected voice assistant, and the light-emitting control unit of the operating terminal controls the light-emitting operation of the light-emitting unit based on this control information. Therefore, for example, the user can easily know the selected voice assistant, thereby improving user convenience. Other effects are the same as in the first embodiment.

[0226] [Variation 5-1] In the above embodiment, the control information INF includes assistant information INF5, but this is not limited to this. For example, as in the case of the display system 1A relating to variant example 1-1 of the first embodiment above, the control information INF may include light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 112.

[0227] [Variation 5-2] In the above embodiment, the user operates the voice assistant call button B5 to select the voice assistant to be used from the voice assistants VA and VB, but this is not limited to this. Instead, for example, the user may select the voice assistant to be used from the voice assistants VA and VB by uttering the voice assistant call words (call words WA and WB) associated with the voice assistants VA and VB, respectively. This modified example will be described in detail below.

[0228] 25 shows an example of the configuration of a display system 5A according to this modification. The display system 5A includes a display device 100A and an operation terminal 110A.

[0229] The display device 100A has a control unit 101A. The control unit 101 has two voice assistant processing units 103 (voice assistant processing units 103A and 103B). The user selects the voice assistant to be used from the voice assistants VA and VB by speaking voice assistant call words (call words WA and WB) associated with the voice assistant processes 103A and 103B, respectively, into the microphone 113 of the operation terminal 110A. The control unit 101A of the display device 100A selects one of the voice assistants VA and VB based on an assistant selection code received from the operation terminal 110A via the wireless communication unit 13 and including information about the voice assistant to be used.

[0230] The operation terminal 110A has a control unit 117A. Unlike the above embodiment, the control unit 117A controls the microphone 113 to always accept voice input. The control unit 117A has two voice processing units 119 (voice processing units 119A and 119B). The voice processing unit 119A generates an assistant selection code that instructs the selection of the voice assistant VA when the voice data acquired by the microphone 113 includes a voice assistant call word (call word WA) associated with the voice assistant VA. Similarly, the voice processing unit 119B generates an assistant selection code that instructs the selection of the voice assistant VB when the voice data acquired by the microphone 113 includes a voice assistant call word (call word WB) associated with the voice assistant VB. The control unit 117A transmits the generated assistant selection code to the display device 100A via the wireless communication unit 35.

[0231] FIG. 26 shows an example of the operation of the display device 100A.

[0232] First, control unit 101A checks whether an assistant selection code has been received via wireless communication unit 13 (step S531). If an assistant selection code has not been received ("N" in step S531), this flow ends.

[0233] In step S531, when an assistant selection code is received, the control unit 101A checks whether the voice assistant VA is selected (step S503). If the voice assistant VA is selected ("Y" in step S503), the control information generation unit 102 generates assistant information INF5 including information that the voice assistant VA is selected (step S504). Also, if the voice assistant VB is selected ("N" in step S503), the control information generation unit 102 generates assistant information INF5 including information that the voice assistant VB is selected (step S505).

[0234] Then, the control unit 101A transmits the control information INF including this assistant information INF5 to the operating terminal 110A via the wireless communication unit 13 (step S506). This is the end of this flow.

[0235] [Variation 5-3] In the above embodiment, the microphone 113 is provided in the operation terminal 110, but this is not limiting. Alternatively, for example, a microphone may be provided in the display device, as in the display system 5B shown in FIG. 27 . The display system 5B includes a display device 100B and an operation terminal 110B. The display device 100B includes a microphone 108B and a control unit 101B. The operation terminal 110B includes a control unit 117B. In this example, the control unit 101B of the display device 100B generates voice data based on an electrical signal supplied from the microphone 108B of the display device 100B. When the voice assistant VA is selected, the control information generation unit 102 of the display device 100B generates assistant information INF5 including information that the voice assistant VA has been selected. When the voice assistant VB is selected, the control information generation unit 102 of the display device 100B generates assistant information INF5 including information that the voice assistant VB has been selected. The control unit 101B transmits the control information INF including the assistant information INF5 to the operation terminal 110B via the wireless communication unit 13.

[0236] [Variation 5-4] In the above embodiment, the display device 100 is provided with two voice assistant processing units 103. However, this is not limiting. One voice assistant processing unit may be provided in the display device, and one voice assistant processing unit may be provided in an external device connected to the display device. The external device is, for example, a smart speaker. The display device and the external device are connected, for example, via a wireless LAN. In this example, the smart speaker generates voice data based on the user's voice and transmits the voice data to a server associated with the smart speaker and connected to the Internet NET. The server analyzes the voice data. If the user's instruction included in the voice data is an operation instruction for the display device, the server transmits information about the operation instruction to the display device. When the voice assistant processing unit of the display device receives an operation instruction for the display device from the server, it generates assistant information INF5 including information that the voice assistant of the display device has been selected. The control unit of the display device then transmits control information INF including the assistant information INF5 to the operation terminal 110 via the wireless communication unit 13.

[0237] [Variation 5-5] In the above embodiment, the voice assistant call button B5 (FIG. 2) is highlighted by the light emitted by the light-emitting unit 32 in accordance with the selected voice assistant, but this is not limited to this. Instead, for example, all buttons B on the operating terminal 110 may be highlighted by the light emitted by the light-emitting unit 32 in accordance with the selected voice assistant.

[0238] [Variation 5-6] In the above embodiment, the voice assistant operates in accordance with the selected voice assistant, but this is not limited to this. For example, in accordance with a user instruction included in the voice data, the button B associated with the instruction may be highlighted by light emitted by the light-emitting unit 32. For example, if the voice data is an instruction to view content of service S1, the button B corresponding to service S1 among the video service selection buttons B2 may be highlighted by light emitted by the light-emitting unit 32.

[0239] 6. Sixth Embodiment Next, a display system 6 according to a sixth embodiment will be described. When an external device such as a set-top box is connected to the display device, the display system 6 according to this embodiment is configured to control the light-emitting operation of the light-emitting unit of the operation terminal in accordance with the connected external device. Note that components that are substantially the same as those in the display system 1 according to the first embodiment are given the same reference numerals, and descriptions thereof will be omitted where appropriate.

[0240] 28 shows an example of the configuration of the display system 6. The display system 6 includes a display device 120 and an operation terminal .

[0241] The display device 120 has a control unit 121. The control unit 121 has an external device detection unit 123, a switching control unit 124, and a control information generation unit 122. In this example, a set-top box 203 is connected to the external device interface 14 of the display device 120.

[0242] When an external device (in this example, a set-top box 203) is connected to the external device interface 14, the external device detection unit 123 is configured to detect that an external device has been connected, and to acquire information about the type of device this external device is by communicating with this external device via the external device interface 14. The types of external devices include, for example, a set-top box, a recording / playback device, a playback device, etc.

[0243] The switching control unit 124 is configured to set the source of the video to be displayed based on information about the operation of the input switching button B7 included in the infrared signal, and to set the control target by the operation terminal 130 according to the set source. Specifically, for example, if the set-top box 203 connected to the external device interface 14 is set as the source of the video to be displayed, when the user operates, for example, the number buttons B3, the cursor button B8, the enter button B9, the channel button B11, the video content operation button B16, and the recording list button B17, the switching control unit 124 changes the control target based on these user operations to the set-top box 203. As a result, in the display system 6, for example, when the display device 120 is displaying an image based on a video signal selected by the tuner 11, the user can remotely control the display device 120 by operating the operation unit 31 of the operation terminal 130, and when the display device 120 is displaying an image based on a video signal supplied from the set-top box 203, the user can remotely control the set-top box 203 by operating the operation unit 31 of the operation terminal 130.

[0244] The control information generation unit 122 is configured to generate control information INF for controlling the light emitting operation of the light emitting unit 32 in the operation terminal 130 in accordance with the external device when the user operates the input switching button B7, for example, to select an external device connected to the external device interface 14 as the source of the video to be displayed. Then, the control unit 121 transmits the control information INF generated by the control information generation unit 122 to the operation terminal 130 via the wireless communication unit 13.

[0245] The operation terminal 130 has a control unit 137. The control unit 137 has a light emission control unit 138. The light emission control unit 138 is configured to control the light emitting operation of the light emitting unit 32 based on control information INF transmitted from the display device 120.

[0246] 29 shows an example of the operation of the display device 120. In this example, the set-top box 203 has already been connected to the external device interface 14, and the external device detection unit 123 has detected that the set-top box 203 is connected.

[0247] First, the control unit 121 checks whether or not an input switching operation to an external device has been detected (step S601). Specifically, for example, when the infrared signal received by the infrared receiving unit 12 indicates that the input switching button B7 has been operated, the control unit 121 checks whether or not the external device will be selected as the source of the video to be displayed after the input switching.

[0248] In step S601, if an input switching operation to an external device is detected (“Y” in step S601), the switching control unit 124 sets the video source to that external device (step S602), and sets the external device as the control target by the operation terminal 130 (step S603).

[0249] Next, the control information generator 122 generates external device information INF6 corresponding to the connected external device based on the detection result of the external device detector 123 (step S604). Specifically, for example, when a set-top box is connected as an external device, the control information generator 122 generates external device information INF6 including information that a set-top box is connected.

[0250] Then, the control unit 121 transmits the control information INF including this external device information INF6 to the operation terminal 130 via the wireless communication unit 13 (step S605), and this flow then ends.

[0251] Furthermore, in step S601, if an input switching operation to the display device 120 is detected ("N" in step S601), the switching control unit 124 sets the video source to the display device 120 (step S606), and sets the object to be controlled by the operation terminal 130 to the display device 120 (step S607). This ends the flow.

[0252] FIG. 30 shows an example of the operation of the display system 6 when the set-top box 203 is connected to the display device 120 and input switching to the set-top box 203 is performed.

[0253] When the user operates the input switching button B7 of the operation terminal 110, the control unit 137 of the operation terminal 130 detects this operation, and the control unit 137 changes the operating state of the operation terminal 130 from the sleep state to the normal operating state (step S621). Then, the infrared light emitter 34 transmits an infrared signal corresponding to the operation of the input switching button B7 (step S622). The infrared light receiver 12 of the display device 120 receives this infrared signal.

[0254] Based on the information about the operation of the input switching button B7 included in the infrared signal, the switching control unit 124 of the display device 120 sets the video source to the set-top box 203 (step S623), and sets the object to be controlled by the operation terminal 130 to the set-top box 203 (step S624). Then, based on the detection result of the external device detection unit 123, the control information generation unit 122 generates external device information INF6 including information that a set-top box is connected (step S625). The control unit 121 transmits the control information INF including this external device information INF6 to the operation terminal 130 via the wireless communication unit 13 (step S626). The control unit 137 of the operation terminal 130 receives this control information INF via the wireless communication unit 35.

[0255] The light-emission control unit 138 of the operation terminal 130 generates light-emission control information INFBL based on the external device information INF6 included in this control information INF (step S627). In this example, the external device information INF6 includes information indicating that a set-top box is connected, so the light-emission control unit 138 generates light-emission control information INFBL instructing the light-emitting elements of the light-emitting unit 32 corresponding to the buttons B used for viewing content through the set-top box 203 to emit light for a predetermined period of time. Specifically, the light-emission control unit 138 generates light-emission control information INFBL instructing the light-emitting elements corresponding to, for example, the numeric buttons B3, cursor button B8, enter button B9, back button B10, channel button B11, volume button B12, video content operation button B16, and recording list button B17 to emit light for a predetermined period of time.

[0256] Next, the light-emission control unit 138 starts emitting light from the light-emitting unit 32 based on this light-emission control information INFBL (step S628). As a result, button B, which is used for viewing content from the set-top box 203 on the operation unit 31 of the operation terminal 130, is highlighted by the light emitted from the light-emitting unit 32. Then, based on this light-emission control information INFBL, the light-emission control unit 138 stops emitting light from the light-emitting unit 32 after a predetermined time has elapsed (step S629). This ends the sequence.

[0257] In this way, in the display system 6, the control information generation unit 122 of the display device 120 generates control information INF according to the connected external device, and the light emission control unit 138 of the operation terminal 130 controls the light emitting operation of the light emitting unit 32 based on this control information INF. This allows the user in the display system 6 to easily know which buttons B can be used when viewing content supplied from the connected external device. As a result, the display system 6 can improve user convenience.

[0258] As described above, in this embodiment, the control information generating unit of the display device generates control information according to the connected external device, and the light emission control unit of the operating terminal controls the light emission operation of the light emitting unit based on this control information, so that the user can easily know, for example, which button B is available, thereby improving user convenience. Other effects are the same as in the first embodiment.

[0259] [Variation 6-1] In the above embodiment, the control information INF includes external device information INF6, but this is not limited to this. For example, as in the case of the display system 1A relating to variant example 1-1 of the first embodiment, the control information INF may include light-emitting control information INFBL that instructs the light-emitting operation of the light-emitting unit 32.

[0260] Although the present technology has been described above by giving several embodiments and modifications, the present technology is not limited to these embodiments and the like, and various modifications are possible.

[0261] For example, in each of the above embodiments, the operation terminal is provided with an infrared light emitting unit 34 and the display device is provided with an infrared light receiving unit 12, and the operation terminal controls the operation of the display device by transmitting an infrared signal to the display device, but this is not limited to this. Alternatively, the infrared light emitting unit 34 and the infrared light receiving unit 12 may be omitted, and the operation terminal may control the operation of the display device using communication between the wireless communication unit 35 of the operation terminal and the wireless communication unit 13 of the display device.

[0262] For example, in each of the above-described embodiments, the present technology has been applied to a display device, but the present technology is not limited thereto and can be applied to various home electronic devices, such as a hard disk recorder, a Blu-ray disc player, a Blu-ray disc recorder, a set-top box, a smart speaker, and a game console. Specifically, when the present technology is applied to a set-top box, the operation terminal may be a remote control terminal that remotely controls the operation of the set-top box based on a user's operation. A display device such as a television receiver is connected to the set-top box. Furthermore, when the present technology is applied to a game console, the operation terminal may be a controller for the game console.

[0263] For example, in each of the above embodiments, the light-emitting element corresponding to button B is illuminated, but this is not limited to this, and it is also possible to illuminate a light-emitting element that is not associated with button B, such as various indicators provided on the operating terminal.

[0264] Furthermore, for example, two or more of the above-described embodiments and modifications may be combined.

[0265] The effects described in this specification are merely examples and are not limiting, and other effects may also be present. [Explanation of symbols]

[0266] 1, 1A, 1B, 1C, 2 to 5, 5A, 5B, 6... Display system, 10, 10A, 10B, 10C, 40, 60, 80, 100, 100A, 120... Display device, 11... Tuner, 12... Infrared receiving unit, 13... Wireless communication unit, 14... External device interface, 15... Network communication unit, 16... Display unit, 17... Speaker, 18... Illuminance sensor, 18B... Color sensor, 18C... Camera, 19... Power supply unit, 21, 21B, 21C, 41, 61, 81, 101, 101A, 121... Control unit, 22, 22B, 22C, 42, 62, 82, 1 02, 122... control information generation unit, 30, 30A, 30B, 30D, 50, 70, 90, 110, 110A, 110B, 130... operation terminal, 31... operation unit, 32, 32B, 72, 112... light emitting unit, 33... acceleration sensor, 34... infrared light emitting unit, 35... wireless communication unit, 36... power supply unit, 37, 37B, 57, 77, 97, 117, 117A, 117B, 137... control unit, 38, 38B, 58, 78, 98, 118, 138... light emitting control unit, 39D... display unit, 43... content analysis unit, 63... image analysis unit, 83... notification processing unit, 103, 1 03A, 103B...Voice assistant processing unit, 108B...Microphone, 113...Microphone, 119A, 119B...Audio processing unit, 123...External device detection unit, 124...Switching control unit, 201...Content server, 202...Software distribution server, 203...Set-top box, 204A, 244B...Server, B...Button, B1...Power button, B2...Video service selection button, B3...Number buttons, B4...Color button, B5...Voice assistant call button, B6...Settings button, B7...Input switching button, B8...Cursor button, B9 ... Decision button, B10... Back button, B11... Channel button, B12... Volume button, B13... Mute button, B14... Audio switch button, B15... Subtitle button, B16... Video content operation button, B17... Recording list button, B18... Help button, B19... Data broadcasting button, INF... Control information, INFBL... Light emission control information, INF1... Sensor information, INF2... Content information, INF3... Image color information, INF4... Notification information, INF5... Assistant information, INF6... External device information, VA, VB... Voice assistant.

Claims

1. a circuit capable of generating control information for controlling the emission of light emitted from an operation terminal and transmitting the control information to the operation terminal; the operation terminal is capable of remotely controlling the operation of the device itself based on an operation by a user; the light emission control includes controlling one or more of a light emission start, a light emission end, a light emission brightness, a light emission color, a light emission time, and a light emission cycle of a plurality of buttons provided on the operation terminal based on the control information; the circuit is capable of generating the control information based on notification information for a user; The control information is information for causing one or more buttons associated with the notification information among the plurality of buttons provided on the operation terminal to emit light. Information processing device.

2. The circuitry is further capable of generating the notification information including information indicating that software needs to be updated. The information processing device according to claim 1 .

3. The circuit is further capable of generating the notification information including information indicating that an external device has been newly connected to the device.

3. The information processing device according to claim 1.

4. The circuit is further capable of generating the notification information including information indicating that the device has newly recorded content.

3. The information processing device according to claim 1.

5. The circuit is further capable of generating the notification information including information indicating that there is a proposal for changing the setting of the device.

3. The information processing device according to claim 1.

6. The circuit is further capable of generating the notification information including information indicating that new content has been registered in a streaming service.

3. The information processing device according to claim 1.

7. The operation terminal has an operation surface including the plurality of buttons and a housing.

3. The information processing device according to claim 1.

8. The operation terminal has a light emitting unit capable of emitting light through the plurality of buttons. The information processing device according to claim 7 .

9. The plurality of buttons are made of a translucent material. The information processing device according to claim 8 .

10. The circuitry is further capable of checking whether the software of the device has been updated. The information processing device according to claim 1 .

11. The circuit is further capable of generating the notification information including information indicating a battery status of the operation terminal.

3. The information processing device according to claim 1.

12. The circuitry is further operable to use the control information to cause one of the one or more buttons to flash when a battery level falls below a predetermined level.

3. The information processing device according to claim 1.

13. The circuitry is further operable to use the control information to cause the button of the one or more buttons to flash with light of a first color when a battery level falls below a predetermined level. The information processing device according to claim 12.

14. The circuitry is further operable to use the control information to cause the button of the one or more buttons to illuminate with light of a second color when charging of a battery is initiated. The information processing device according to claim 13.

15. The circuit is further capable of checking whether the software of the device itself has been updated based on software supplied via broadcast waves. The information processing device according to claim 2 .

16. A display device; An operation terminal; Distribution server and Equipped with The display device includes: a control unit capable of generating control information; a network communication unit capable of communicating with the distribution server; and the operation terminal is capable of receiving the control information from the control unit, the control unit is capable of generating a notification message indicating that the software to be updated is available on the distribution server; The control unit is capable of transmitting the control information including notification information corresponding to the notification message to the operation terminal. Information processing system.

17. a control unit that generates control information; a network communication unit capable of communicating with a distribution server; an operation terminal capable of receiving the control information from the control unit; Equipped with the control unit is capable of generating a notification message indicating that the software to be updated is available on the distribution server; The control unit is capable of transmitting the control information including notification information corresponding to the notification message to the operation terminal. Information processing device.

18. a content server connected to the Internet; a server connected to the Internet; Equipped with the content server is capable of communicating with a network communication unit of a display device that is capable of transmitting control information including notification information corresponding to a notification message to an operation terminal; the server is capable of receiving voice data from the operation terminal and analyzing the voice data; The voice assistant processing unit of the display device is capable of performing processing corresponding to the voice data based on the information analyzed by the server. Server system.

Images