Information processing apparatus, information processing system, and server system

Abstract

The invention relates to an information processing apparatus, an information processing system, and a server system. The information processing apparatus includes circuitry configured to: generate control information for performing light emission control of light emitted from an operation terminal; and sending the control information to the operation terminal; wherein the operation terminal controls the action of the information processing equipment through remote operation based on the operation of a user; wherein the light emission control includes controlling, based on the control information, one or more of a light emission start, a light emission end, a light emission luminance, a light emission color, a light emission time, and a light emission period of one or more buttons included in the operation terminal; wherein the circuitry is configured to generate control information based on notification information to a user; the control information causes the emitted light to correspond to one or more buttons associated with the notification information among a plurality of buttons included in the operation terminal.

Description

[0001] This application is a divisional application of the PCT application for International Application No. PCT / JP2020 / 020185, filed on May 21, 2020, entitled "Information Processing Apparatus, Operation Terminal, and Information Processing Method", which entered the national phase in the People's Republic of China on November 23, 2021, and has Application No. 202080038513.5, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] The present disclosure relates to an information processing apparatus operated by an operation terminal, an operation terminal, and an information processing method to be used in such an information processing apparatus. BACKGROUND

[0003] An information processing apparatus is generally configured to be operable by an operation terminal such as a remote control apparatus. For example, Patent Literature 1 discloses a television receiver operable by a remote control apparatus.

[0004] LIST OF CITATIONS

[0005] PATENT LITERATURE

[0006] Patent Literature 1: Japanese Unexamined Patent Application Publication No. 2014-110517 SUMMARY

[0007] Incidentally, it is desirable for an information processing apparatus to achieve high convenience for a user, and it is desirable to further improve the convenience.

[0008] It is desirable to provide an information processing apparatus, an operation terminal, and an information processing method that make it possible to improve the convenience for a user.

[0009] An information processing apparatus according to one embodiment of the present disclosure includes a generator and a transmitter. The generator is configured to generate control information for performing light emission control of a light emission unit provided in an operation terminal. The transmitter is configured to transmit the control information to the operation terminal.

[0010] An operation terminal according to one embodiment of the present disclosure includes an operation unit, a light emission unit, a receiver, and a controller. The operation unit is configured to accept an operation of a user. The light emission unit is configured to emit light from an operation surface of the operation unit. The receiver is configured to receive control information transmitted from an information processing apparatus. The controller is configured to perform light emission control of the light emission unit based on the control information.

[0011] The information processing method according to one embodiment of the present disclosure includes: generating, by an information processing device, control information for performing light emission control of a light emitting unit provided in an operation terminal; transmitting, by the information processing device, the control information to the operation terminal; and performing, by the operation terminal, the light emission control of the light emitting unit based on the control information transmitted from the information processing device.

[0012] In the information processing device and the information processing method according to one embodiment of the present disclosure, control information for performing light emission control of a light emitting unit provided in an operation terminal is generated, and the control information is transmitted to the operation terminal.

[0013] In the operation terminal and the information processing method according to one embodiment of the present disclosure, control information transmitted from an information processing device is received, and light emission control of a light emitting unit provided in the operation terminal is performed based on the control information. BRIEF DESCRIPTION OF DRAWINGS

[0014] FIG. 1 is a block diagram illustrating a configuration example of a display system according to a first embodiment of the present disclosure.

[0015] FIG. 2 is an explanatory diagram illustrating a configuration example of an operation terminal according to one embodiment.

[0016] FIG. 3 is a flowchart illustrating FIG. 1 an action example of the operation terminal illustrated in FIG. 8.

[0017] FIG. 4 is an explanatory diagram illustrating FIG. 1 an action example of the control unit 37 illustrated in FIG. 8.

[0018] FIG. 5 is a sequence chart illustrating FIG. 1 an action example of the display system illustrated in FIG. 8.

[0019] FIG. 6A is a timing chart illustrating FIG. 1 an action example of the control unit 37 and the light emitting unit 32 illustrated in FIG. 8.

[0020] FIG. 6B is another timing chart illustrating FIG. 1 an action example of the control unit 37 and the light emitting unit 32 illustrated in FIG. 8.

[0021] FIG. 6C is another timing chart illustrating FIG. 1 an action example of the control unit 37 and the light emitting unit 32 illustrated in FIG. 8.

[0022] FIG. 6D is another timing chart illustrating FIG. 1Another timing chart showing an example of the operation of the control unit 37 and the light emitting unit 32 is shown.

[0023] FIG. 6E It shows FIG. 1 Another timing chart showing an example of the operation of the control unit 37 and the light emitting unit 32 is shown.

[0024] FIG. 6F It shows FIG. 1 Another timing chart showing an example of the operation of the control unit 37 and the light emitting unit 32 is shown.

[0025] FIG. 6G It shows FIG. 1 Another timing chart showing an example of the operation of the control unit 37 and the light emitting unit 32 is shown.

[0026] FIG. 6H It shows FIG. 1 Another timing chart showing an example of the operation of the control unit 37 and the light emitting unit 32 is shown.

[0027] FIG. 7 is a flowchart illustrating an action example of the operation terminal according to the modified example of the first embodiment.

[0028] FIG. 8 is a flowchart illustrating an action example of the display device according to the modified example of the first embodiment.

[0029] FIG. 9 is a sequence diagram illustrating an action example of the display system according to the modified example of the first embodiment.

[0030] FIG. 10 is a block diagram showing a configuration example of a display system according to another modification example of the first embodiment.

[0031] FIG. 11 is a block diagram showing a configuration example of a display system according to another modification example of the first embodiment.

[0032] FIG. 12 is an explanatory diagram showing a configuration example of an operation terminal according to another modified example of the first embodiment.

[0033] FIG. 13 is a block diagram showing a configuration example of a display system according to a second embodiment.

[0034] FIG. 14 It shows FIG. 13 The flowchart shown is an example of the operation of the display device.

[0035] FIG. 15 It shows FIG. 13 The sequence diagram shown is an example of the operation of the display system.

[0036] FIG. 16 is a block diagram showing a configuration example of a display system according to a third embodiment.

[0037] FIG. 17 is a block diagram showing a configuration example of a display system according to a fourth embodiment. FIG. 16 is a flowchart showing an action example of a display device shown in

[0038] FIG. 18 is a sequence chart showing an action example of a display system shown in FIG. 16

[0039] FIG. 19 is a block diagram showing a configuration example of a display system according to a fifth embodiment.

[0040] FIG. 20A is a flowchart showing an action example of a display device shown in FIG. 19

[0041] FIG. 20B is a flowchart showing an action example of a display device shown in FIG. 19

[0042] FIG. 21 is a sequence chart showing an action example of a display system shown in FIG. 19

[0043] FIG. 22 is a block diagram showing a configuration example of a display system according to a fifth embodiment.

[0044] FIG. 23 is a flowchart showing an action example of a display device shown in FIG. 22

[0045] FIG. 24 is a sequence chart showing an action example of a display system shown in FIG. 22

[0046] FIG. 25 is a block diagram showing a configuration example of a display system according to a fifth embodiment.

[0047] FIG. 26 is a flowchart showing an action example of a display device shown in FIG. 25

[0048] FIG. 27 is a block diagram showing a configuration example of a display system according to a fifth embodiment.

[0049] FIG. 28 is a block diagram showing a configuration example of a display system according to a sixth embodiment.

[0050] FIG. 29 is a flowchart showing an action example of a display device shown in​​​​​​​FIG. 28 a flowchart of an action example of the display device shown.

[0051] FIG. 30 is a sequence diagram showing FIG. 28 a sequence diagram of an action example of the display system shown. DETAILED DESCRIPTION

[0052] Hereinafter, some embodiments of the present disclosure are described in detail with reference to the drawings. Note that the description is given in the following order.

[0053] 1. First embodiment (example of controlling light emission action based on ambient brightness)

[0054] 2. Second embodiment (example of controlling light emission action based on content being displayed)

[0055] 3. Third embodiment (example of controlling light emission action based on color of image being displayed)

[0056] 4. Fourth embodiment (example of controlling light emission action based on notification information to user)

[0057] 5. Fifth embodiment (example of controlling light emission action based on selected voice assistant)

[0058] 6. Sixth embodiment (example of controlling light emission action based on external device to be used)

[0059] <1. First embodiment>

[0060] [Configuration example]

[0061] FIG. 1 A configuration example of a display system 1 including an information processing device (display device 10) according to the first embodiment is shown. Note that because the information processing method according to one embodiment of the present disclosure is implemented by the present embodiment, it will be described together. The display system 1 includes the display device 10 and an operation terminal 30.

[0062] (Display device 10)

[0063] The display device 10 is a so-called television receiver, and includes a tuner 11, an infrared receiver 12, a wireless communication unit 13, an external device interface 14, a network communication unit 15, a display unit 16, a speaker 17, an illuminance sensor 18, a power supply unit 19, and a control unit 21.

[0064] The tuner 11 is configured to select a desired video signal (stream) from a digital broadcast wave received by an antenna 9.

[0065] The infrared receiver 12 is configured to receive an infrared signal transmitted from the operation terminal 30 and giving an instruction of an action of the display device 10.

[0066] The wireless communication unit 13 is configured to exchange information with the operation terminal 30 by using short-range wireless communication. In this example, the wireless communication unit 13 communicates with the operation terminal 30 by using Bluetooth (registered trademark). Note that it is not limited thereto, and for example, Zigbee (registered trademark), wireless local area network (LAN), or the like can be used. The wireless communication unit 13 transmits control information INF for controlling the light emission action of the light emission unit 32 in the operation terminal 30 to the operation terminal 30, as will be described later.

[0067] The external device interface 14 is configured to communicate with an external device such as a hard disk recorder, for example. The external device interface 14 communicates with the external device by using HDMI (registered trademark), for example.

[0068] The network communication unit 15 is coupled to the Internet NET, and is configured to perform network communication with a communication partner via the Internet NET. For example, the network communication unit 15 can receive video information from a content server 201 of a moving image streaming service by streaming.

[0069] The display unit 16 is configured to display a video based on a video signal selected by the tuner 11, for example. The display unit 16 is configured by using a liquid crystal display, an organic electroluminescence (EL) display, or the like, for example.

[0070] The speaker 17 is configured to emit a sound based on a video signal selected by the tuner 11, for example.

[0071] The illuminance sensor 18 is configured to detect the brightness of the environment around the display device 10. The control unit 21 adjusts the display brightness in the display unit 16 based on the detection result of the illuminance sensor 18. Furthermore, in the display system 1, the action of the light emission unit 32 in the operation terminal 30 is controlled based on the detection result of the illuminance sensor 18, as will be described later.

[0072] The power supply unit 19 is configured to generate various power supply voltages based on a power supply signal supplied from a commercial power supply, for example, and supply these power supply voltages to the blocks in the display device 10.

[0073] The control unit 21 is configured to control the action of the display device 10 by controlling the action of the blocks of the display device 10. The control unit 21 is configured by using a processor configured to execute a program, for example. The control unit 21 includes a control information generator 22. The control information generator 22 is configured to generate control information INF for controlling the light emission action of the light emission unit 32 in the operation terminal 30 based on the detection result of the illuminance sensor 18. Then, the control unit 21 transmits the control information INF generated by the control information generator 22 to the operation terminal 30 via the wireless communication unit 13.

[0074] (operation terminal 30)

[0075] The operation terminal 30 is a so-called remote control terminal that controls the action of the display device 10 by remote operation based on the user's operation. The operation terminal 30 includes an operation unit 31, a light emitting unit 32, an acceleration sensor 33, an infrared transmitter 34, a wireless communication unit 35, a power supply unit 36, and a control unit 37.

[0076] The operation unit 31 is configured to accept the user's operation. The operation unit 31 includes a plurality of buttons B. The control unit 37 causes the infrared transmitter 34 to transmit an infrared signal based on the user's operation of the plurality of buttons B.

[0077] FIG. 2 A configuration example of the operation terminal 30 is shown. The plurality of buttons B are provided on an operation surface S of the operation terminal 30. The plurality of buttons B include a power button B1, a moving image service selection button B2, a number button B3, a color button B4, a voice assistant call button B5, a setting button B6, an input selection button B7, a cursor button B8, a determination button B9, a return button B10, a channel button B11, a volume button B12, a mute button B13, an audio selection button B14, a subtitle button B15, a moving image content operation button B16, a recording list button B17, a help button B18, and a data broadcast button B19.

[0078] The power button B1 is operated when the display device 10 is turned on or off. The moving image service selection button B2 is operated when a moving image stream service is selected. In this example, the moving image service selection button B2 includes six buttons corresponding to six different moving image stream services (service S1 to service S6) from each other. The number button B3 is operated when a channel or an input number that a user wants to watch is selected. In this example, the number button B3 includes 12 buttons. The color button B4 is operated when a selection operation is performed in, for example, data broadcast content or an electronic program guide. The voice assistant call button B5 is operated when a voice assistant is called. The setting button B6 is operated when a setting screen for setting the display device 10 is displayed. The input selection button B7 is operated when a video source to be displayed is selected from, for example, the tuner 11, an external device coupled to the external device interface 14, or the like. The cursor button B8 is operated when a cursor is moved in, for example, data broadcast content or an electronic program guide. The determination button B9 is operated when a determination operation is performed. For example, the back button B10 is operated when a previous menu is returned. The channel button B11 is operated when a channel that a user wants to watch is selected. The volume button B12 is operated when a volume is adjusted. The mute button B13 is operated when it is muted. The audio selection button B14 is operated when audio is selected in, for example, an audio multiplex broadcast content. Specifically, the audio selection button B14 is operated when English or Japanese is selected in a multi-lingual content, and the audio selection button B14 is operated when a main audio and a sub audio are selected in a content including the main audio and the sub audio. The subtitle button B15 is operated when a subtitle display is turned on or off in a subtitle content. The moving image content operation button B16 is operated when a moving image content is played back. In this example, the moving image content operation button B16 includes a play button, a rewind button, a fast forward button, a previous button, a next button, a stop button, and a pause button. The recording list button B17 is operated when a list of recorded contents is displayed in a case where, for example, a recording and playback device is coupled to the external device interface 14. The help button B18 is operated when, for example, help information such as guidance on an operation method is displayed. The data broadcast button B19 is selected when a data broadcast is displayed in a data broadcast content.

[0079] Accordingly, the operation unit 31 includes a plurality of buttons B. These buttons B are configured to be highlighted by light emitted by the light emitting unit 32 provided on the back of these buttons B. Specifically, for example, the buttons B can be configured by using a translucent material and enabled to be highlighted by transmitting light emitted from the light emitting unit 32 through the buttons B. Note that not limited thereto, for example, the buttons B can be configured by using a material that is not translucent and enabled to be highlighted by leaking from a gap around the buttons B by light emitted from the light emitting unit 32.

[0080] The light emitting unit 32 is configured to highlight the plurality of buttons B in the operation unit 31 by emitting light. The light emitting unit 32 includes a plurality of light emitting devices. For example, the light emitting action of the plurality of light emitting devices can be individually controlled. The plurality of light emitting devices are provided, for example, on the back of the plurality of buttons B. Specifically, the light emitting unit 32 includes, for example, six light emitting devices corresponding to the respective six buttons included in the moving image service selection button B2. Thus, by the six light emitting devices individually emitting light, the light emitting unit 32 can individually highlight the six buttons. Further, for example, the light emitting unit 32 includes one light emitting device corresponding to the 12 buttons included in the numeral button B3. Thus, by the light emitting device emitting light, the light emitting unit 32 can collectively highlight the 12 buttons.

[0081] The acceleration sensor 33 is configured to detect the motion of the operation terminal 30. Note that although the acceleration sensor 33 is provided in this example, the present disclosure is not limited thereto. The sensor can be any sensor capable of detecting the motion of the operation terminal 30. Specifically, for example, a gyro sensor can be provided.

[0082] The infrared transmitter 34 is configured to transmit an infrared signal giving an instruction of the action of the display device 10 to the infrared receiver 12 of the operation terminal 30.

[0083] The wireless communication unit 35 is configured to exchange information with the wireless communication unit 13 of the display device 10 by using short-range wireless communication. The wireless communication unit 35 receives control information INF transmitted from the display device 10 for controlling the light emitting action of the light emitting unit 32, as will be described later.

[0084] The power supply unit 36 is configured to supply, for example, a voltage supplied from a battery to the blocks in the operation terminal 30. The battery that supplies power to the power supply unit 36 can be a rechargeable battery. The rechargeable battery can be charged, for example, by using a wireless power such as Qi (registered trademark).

[0085] The control unit 37 is configured to control the action of the operation terminal 30 by controlling the action of the blocks of the operation terminal 30. In addition, the control unit 37 can turn the action state of the operation terminal 30 into a sleep state or a normal action state by controlling the action of the blocks of the operation terminal 30. For example, in the sleep state, the power supply unit 36 stops supplying a voltage to the various blocks other than the operation unit 31, the acceleration sensor 33, and the control unit 37. The control unit 37 is configured by using, for example, a processor configured to execute a program. The control unit 37 includes a light emitting controller 38. The light emitting controller 38 is configured to control the light emitting action of the light emitting unit 32 based on the control information INF transmitted from the display device 10.

[0086] With this configuration, in the display system 1, the control information generator 22 of the display device 10 generates control information INF for controlling the light emission action of the light emission unit 32 in the operation terminal 30, on the basis of the detection result of the illuminance sensor 18. Then, the wireless communication unit 13 of the display device 10 transmits the control information INF to the wireless communication unit 35 of the operation terminal 30. The light emission controller 38 of the operation terminal 30 controls the light emission action of the light emission unit 32 on the basis of the control information INF. Thus, in the display system 1, for example, in the case where it is dark around the display device 10, the operation unit 31 can be highlighted by the light emitted from the light emission unit 32. Therefore, the user can easily operate the operation terminal 30.

[0087] In this example, the operation terminal 30 does not include a network communication unit couplable to the Internet NET, and is configured to be able to transmit or receive information to or from an external device by using the infrared emitter 34 or the wireless communication unit 35. Note that the operation terminal 30 can include a network communication unit couplable to the Internet NET, without being limited thereto. In this case, the operation terminal 30 is able to use network communication, and thus is able to realize various functions. Further, the operation terminal can be realized by using, for example, a smartphone or a tablet terminal.

[0088] Here, the display device 10 corresponds to a specific example of the "information processing device" according to the present disclosure. The control information generator 22 corresponds to a specific example of the "generator" according to the present disclosure. The control information INF corresponds to a specific example of the "control information" according to the present disclosure. The wireless communication unit 13 corresponds to a specific example of the "transmitter" according to the present disclosure. The illuminance sensor 18 corresponds to a specific example of the "environment sensor" according to the present disclosure. The operation terminal 30 corresponds to a specific example of the "operation terminal" according to the present disclosure. The operation unit 31 corresponds to a specific example of the "operation unit" according to the present disclosure. The light emission unit 32 corresponds to a specific example of the "light emission unit" according to the present disclosure. The wireless communication unit 35 corresponds to a specific example of the "receiver" according to the present disclosure. The light emission controller 38 corresponds to a specific example of the "controller" according to the present disclosure.

[0089] [Action and effect]

[0090] Next, the action and effect of the display system 1 according to the present embodiment will be described.

[0091] (Summary of overall action)

[0092] First, the display system 1 according to the present embodiment will be described with reference to FIG. 1An overview of the overall operation of the display system 1 is described. In the display device 10, the tuner 11 selects a desired video signal from a broadcast wave received by the antenna 9. The infrared receiver 12 receives an infrared signal transmitted from the infrared transmitter 34 of the operation terminal 30 and giving an instruction of the operation of the display device 10. The wireless communication unit 13 exchanges information with the wireless communication unit 35 of the operation terminal 30 by using short-range wireless communication. The external device interface 14 communicates with an external device. The network communication unit 15 receives video information from a plurality of content servers 201 through a moving picture stream. The display unit 16 displays a video based on, for example, a video signal selected by the tuner 11. The speaker 17 emits a sound based on, for example, a video signal selected by the tuner 11. The illuminance sensor 18 detects the brightness of the environment around the display device 10. The power supply unit 19 generates various power supply voltages based on, for example, a power supply signal supplied from a commercial power supply, and supplies the power supply voltages to the blocks in the display device 10. The control unit 21 controls the operation of the display device 10 by controlling the operations of the blocks of the display device 10.

[0093] In the operation terminal 30, a plurality of buttons B of the operation unit 31 accept the user's operation. The light emitting unit 32 highlights the plurality of buttons B in the operation unit 31 by emitting light. The acceleration sensor 33 detects the motion of the operation terminal 30. The infrared transmitter 34 transmits an infrared signal giving an instruction of the operation of the display device 10 to the infrared receiver 12 of the operation terminal 30. The wireless communication unit 35 exchanges information with the wireless communication unit 13 of the display device 10 by using short-range wireless communication. The power supply unit 36 supplies, for example, a voltage supplied from a battery to the blocks in the operation terminal 30. The control unit 37 controls the operation of the operation terminal 30 by controlling the operations of the blocks of the operation terminal 30.

[0094] The control information generator 22 of the display device 10 generates control information INF for controlling the light emission operation of the light emitting unit 32 in the operation terminal 30 based on the detection result of the illuminance sensor 18. The wireless communication unit 13 transmits the control information INF generated by the control information generator 22 to the operation terminal 30. The wireless communication unit 35 of the operation terminal 30 receives the control information INF transmitted from the display device 10. The light emission controller 38 controls the light emission operation of the light emitting unit 32 based on the control information INF.

[0095] (Detailed operation)

[0096] FIG. 3 An example of the operation of the operation terminal 30 is shown. In a case where motion is detected, or in a case where the user's operation of the operation unit 31 is detected, the operation terminal 30 issues a transmission request of the control information INF to the display device 10. Then, the operation terminal 30 controls the light emission operation of the light emitting unit 32 based on the control information INF transmitted from the display device 10. The operation is described in detail below.

[0097] First, the control unit 37 checks whether the movement of the operation terminal 30 has been detected based on the detection result of the acceleration sensor 33 (step S101). For example, when the user lifts the operation terminal 30 placed on the table, the control unit 37 detects the movement of the operation terminal 30.

[0098] If the movement of the operation terminal 30 is not detected in step S101 ("No" in step S101), the control unit 37 checks whether a user operation on the operation unit 31 has been detected (step S102). For example, in the case where the user operates button B of the operation terminal 30 placed on the table, the control unit 37 detects the user operation on the operation unit 31. If the user operation on the operation unit 31 is not detected ("No" in step S102), the process returns to step S101, and the control unit 37 repeats steps S101 and S102 until the movement of the operation terminal 30 is detected or the user operation on the operation unit 31 is detected.

[0099] Here, the control unit 37 of the operation terminal 30 may control the acceleration sensor 33 to detect the movement of the operation terminal 30 at predetermined intervals. In addition, when the movement of the operation terminal 30 or the user operation on the operation unit 31 is detected, the control unit 37 may detect the movement of the operation terminal 30 at intervals different from the intervals before the movement or user operation is detected. For example, FIG. 4 As shown, the control unit 37 is typically capable of detecting acceleration (movement of the operation terminal 30) at a detection interval T of 500 ms. Furthermore, when the control unit 37 detects movement of the operation terminal 30 or a user operation on the operation unit 31, the control unit 37 can detect acceleration at a detection interval T of 100 ms. After the light controller 38 causes the light-emitting unit 32 to emit light and then stops emitting light, the detection interval T can return to 500 ms after a predetermined period of time (e.g., 30 seconds). Thus, for example, it is possible to suppress the delay between the light-emitting unit 32 emitting light after the user lifts the operation terminal 30.

[0100] If the movement of the operation terminal 30 has been detected in step S101 ("Yes" in step S101), or if the user operation on the operation unit 31 has been detected in step S102 ("Yes" in step S102), the control unit 37 changes the action state of the operation terminal 30 from the sleep state to the normal action state (step S103).

[0101] Next, the control unit 37 issues a transmission request for the control information INF to the display device 10 via the wireless communication unit 35 (step S104). In this example, the control information INF includes sensor information INF1 indicating the detection result of the illuminance sensor 18. Then, the control unit 37 receives the control information INF transmitted from the display device 10 via the wireless communication unit 35 in response to the transmission request.

[0102] Next, the light emission controller 38 of the control unit 37 checks whether the brightness of the environment indicated by the sensor information INF1 included in the control information INF is darker than a predetermined brightness (step S105). If the brightness of the environment is brighter than the predetermined brightness (NO in step S105), the flow ends. That is, in the case where the brightness of the environment is brighter than the predetermined brightness, the user can easily visually recognize the buttons B of the operation unit 31 of the operation terminal 30. Therefore, the flow ends without the light emission controller 38 causing the light emission unit 32 to emit light.

[0103] If the brightness of the environment indicated by the sensor information INF1 is darker than the predetermined brightness (YES in step S105), the light emission controller 38 generates light emission control information INFBL giving an instruction to give a light emission action of the light emission unit 32 on the basis of the sensor information INF1 (step S106). The light emission control information INFBL includes, for example, information on the light emission start, light emission end, light emission luminance, light emission time, light emission period, and the like of each light emitting device of the light emission unit 32.

[0104] Then, the light emission controller 38 controls the light emission action of the light emission unit 32 on the basis of the light emission control information INFBL (step S107). Therefore, the operation unit 31 of the operation terminal 30 is highlighted by the light emitted from the light emission unit 32.

[0105] The flow ends here.

[0106] FIG. 5 An action example of the display system 1 is shown in the case where the user picks up the operation terminal 30 placed on a table in a dark environment.

[0107] When the user picks up the operation terminal 30, the control unit 37 of the operation terminal 30 detects the movement of the operation terminal 30 and changes the action state of the operation terminal 30 from the sleep state to the normal action state (step S121). Then, the control unit 37 issues a transmission request for the control information INF including the sensor information INF1 to the display device 10 via the wireless communication unit 35 (step S122). The control unit 21 of the display device 10 receives the transmission request via the wireless communication unit 13.

[0108] The control information generator 22 of the display device 10 acquires the detection result of the illuminance sensor 18 as the sensor information INF1 in response to the transmission request (step S123). In this example, the sensor information INF1 includes information on the brightness of the environment that is darker than the predetermined brightness. Then, the control unit 21 transmits the control information INF including the sensor information INF1 to the operation terminal 30 via the wireless communication unit 13 (step S124). The control unit 37 of the operation terminal 30 receives this control information INF via the wireless communication unit 35.

[0109] The light emission controller 38 of the operation terminal 30 generates the light emission control information INFBL based on the sensor information INF1 included in the control information INF (step S125). That is, in this example, because the brightness of the environment is darker than the predetermined brightness, the light emission controller 38 generates the light emission control information INFBL based on the sensor information INF1. In this example, the light emission control information INFBL is information that gives an instruction to cause all the light emitting devices in the light emission unit 32 to emit light for a predetermined period of time.

[0110] Next, the light emission controller 38 causes the light emission unit 32 to start emitting light based on the light emission control information INFBL (step S126). Thus, the operation unit 31 of the operation terminal 30 is highlighted by the light emitted from the light emission unit 32. Then, the light emission controller 38 causes the light emission unit 32 to end emitting light after the predetermined period of time elapses based on the light emission control information INFBL (step S127).

[0111] This sequence ends here.

[0112] The light emission controller 38 can perform control to change the light emission method of the light emission unit 32 at the start of light emission, the end of light emission, or both the start and the end of light emission. For example, at the start and the end of light emission, the light emission unit 32 can gradually change the luminance from the current luminance to the target luminance, and emit light at a constant luminance after reaching the target luminance. Furthermore, the length of the period of time during which the luminance is gradually changed and the length of the period of time during which the luminance is kept constant can each be a predetermined period of time, or can be dynamically changed depending on the usage state of the operation terminal 30. FIG. 6A to FIG. 6H Examples of the light emission method of the light emission unit 32 are shown.

[0113] (Case C1, case where the press time TP of the button B is short)

[0114] In FIG. 6AIn the example of , when the user operates the operation unit 31, the luminance of the light-emitting unit 32 gradually changes at the start and end of the light-emitting. In this example, the user presses button B. The time from the start of light emission to the end of light emission is set to 3 seconds, and the light-emitting time at the target luminance is set to 1 second. Specifically, the luminance of the light-emitting unit 32 gradually rises from the start of light emission, reaches the target luminance after 1 second, maintains a constant luminance for 1 second, and then gradually decreases to 0 (zero) after 1 second. For example, when the pressing time TP of button B is short enough (for example, 1 second or less), as described above, the light-emitting unit 32 emits light for 3 seconds from the start of light emission to the end of light emission (off).

[0115] (Case C2: When the pressing time TP of button B is long)

[0116] exist FIG. 6B In the example, with FIG. 6A As in the case of , the time from the start of light emission to the end of light emission is set to 3 seconds. In this case, the time for the user to press button B is longer than in FIG. 6A If the pressing time TP of button B exceeds 1 second, while the user is pressing button B, the luminance of the light emitting unit 32 gradually rises to the target luminance within 1 second and then remains at a constant luminance. The luminance of the light emitting unit 32 then remains at a constant luminance until 1 second has passed after the user has completed pressing button B. After 1 second has passed after the user has completed pressing button B, the luminance of the light emitting unit 32 gradually decreases and reaches 0 (zero) after 1 second.

[0117] (Case C3: When the pressing time TP of the button B exceeds the predetermined time period)

[0118] exist FIG. 6C In the example shown, with FIG. 6A As in the case of , the time from the start of light emission to the end of light emission is set to 3 seconds. In this case, the time for the user to press button B is longer than in FIG. 6B In the case of a longer press time TP of the button B, if the pressing time TP of the button B exceeds 1 second and further exceeds a predetermined time period (e.g., 60 seconds), while the user is pressing the button B, the luminance of the light emitting unit 32 gradually rises to the target luminance within 1 second, and then remains at a constant luminance until the predetermined time period (e.g., 60 seconds) has passed. After the predetermined time period has passed, the luminance of the light emitting unit 32 gradually decreases and becomes 0 (zero) after 1 second.

[0119] (Case C4: Pressing Button B While Lighting is Finished)

[0120] exist FIG. 6D In the example of FIG, when the time from the start of light emission to the end of light emission is set to 3 seconds, as shown in FIG. FIG. 6AIn this case, the user presses the button B again in the course of ending the light emission. In this case, the luminance of the light emitting unit 32 gradually increases from the luminance when the user presses the button B again to the target luminance. The time from the timing of pressing the button B to the time when the luminance reaches the target luminance can be the same as the time from the start of the light emission ending operation to the pressing of the button B. The luminance of the light emitting unit 32 is maintained for 1 second after reaching the target luminance again, and then gradually decreases to 0 (zero) after 1 second. This example describes the case where the user presses the button B again in the course of ending the light emission. In the case where the user presses the button B again while the light emitting unit 32 is maintained at the target luminance, the light emitting unit 32 can be shifted to the light emission ending operation after 1 second from the timing of the user pressing the button B again.

[0121] (Case C5, case where acceleration is detected while luminance is increasing)

[0122] In the example of 6E, as in the case of FIG. 6A , the time from the start of the light emission to the end of the light emission is set to 3 seconds. In this example, when the light emission starts, the user performs the user operation by moving the operation terminal 30. Therefore, in the case where the acceleration corresponding to the user operation is detected only in the period in which the luminance of the light emitting unit 32 increases (1 second in this example), the light emitting unit 32 emits light for 3 seconds from the start of the light emission to the end (turn-off) of the light emission, as in the case of FIG. 6A .

[0123] (Case C6, case where acceleration is detected while luminance is maintained)

[0124] In the example of FIG. 6F , in the case where the time from the start of the light emission to the end of the light emission is set to 3 seconds, as in the case of FIG. 6E , the acceleration corresponding to the user operation is further detected in the period in which 1 second has passed from the start of the light emission and the light emitting unit 32 is maintained at the target luminance. In this case, the luminance of the light emitting unit 32 gradually decreases to 0 (zero) after 1 second from the timing at which the acceleration is detected in the period in which the target luminance is maintained.

[0125] (Case C7, case where acceleration is detected in the course of ending the light emission)

[0126] In the example of FIG. 6G , in the case where the time from the start of the light emission to the end of the light emission is set to 3 seconds, as in the case of FIG. 6EIn this case, the luminance of the light emitting unit 32 gradually increases from the luminance at the timing at which the acceleration is first detected in the process of ending the light emission to the target luminance. The time from the timing at which the acceleration is first detected to the time at which the luminance reaches the target luminance can be the same as the time from the start of the light emission ending operation to the time at which the acceleration is first detected.

[0127] (Case C8, case in which acceleration is detected after pressing the button B)

[0128] In the example of FIG. 6H , in a case in which the time from the start of the light emission to the end of the light emission is set to 3 seconds, the light emitting unit 32 performs the light emission corresponding to the detection of the acceleration after the light emission corresponding to the pressing of the button B, as in FIG. 6A . Here, as in the example of FIG. 6C , the user first presses the button B for more than a predetermined period of time (for example, 60 seconds). Therefore, the light emitting unit 32 performs the light emission process corresponding to the pressing of the button B for a total of 61 seconds, and then sets the luminance to 0. Thereafter, in a case in which the acceleration caused by the user moving the terminal 30 is detected, the light emitting unit 32 again performs the light emission process. Note that, as shown in FIG. 4 , in some embodiments, the detection interval T of the acceleration sensor 33 is shorter than usual until a predetermined period of time (for example, 30 seconds) elapses from the pressing of the button B or the detection of the acceleration. Therefore, in a case in which the light emission corresponding to the detection of the acceleration is performed within the predetermined period of time from the light emission corresponding to the pressing of the button B, the response time until the light emitting unit 32 emits light after the user moves the terminal 30 is shorter.

[0129] Although the examples of the light emission control in Cases C1 to C8 have been described by using FIG. 6A to FIG. 6H , the above-described light emission control is an example, and the present disclosure is not limited to these examples. For example, in the example of Case C1, the time from the start of the light emission to the change of the target luminance, the time for which the target luminance is maintained, and the time taken to end the light emission are each 1 second. Not limited thereto, for example, it can be shorter than 1 second, or it can be longer than 1 second. Furthermore, the luminance of the light emitting unit 32 is caused to gradually change at both the start of the light emission and the end of the light emission, but not limited thereto. For example, the luminance of the light emitting unit 32 can be caused to gradually change only at either one of the start of the light emission and the end of the light emission. Furthermore, for example, the luminance of the light emitting unit 32 can be caused not to gradually change at both the start of the light emission and the end of the light emission. In this case, the luminance of the light emitting unit 32 becomes the target luminance (the constant luminance state or the luminance 0 state) in a short time. Furthermore, in a case in which the pressing of the button B is detected or the acceleration is detected only in the process of ending the light emission, the luminance of the light emitting unit 32 can be caused to become the target luminance in a short time, instead of gradually changing.

[0130] As described above, in the display system 1, the control information generator 22 of the display device 10 uses the illuminance sensor 18 to adjust the display luminance of the display unit 16 to generate the control information INF corresponding to the detection result of the illuminance sensor 18. The light emission controller 38 of the operation terminal 30 controls the light emission action of the light emission unit 32 based on the control information INF. Therefore, in the display system 1, for example, in a case where it is dark around the display device 10, the operation unit 31 can be highlighted by the light from the light emission unit 32, which enables the user to easily operate the operation terminal 30. Therefore, the display system 1 can improve the convenience of the user.

[0131] Further, in the display system 1, the light emission action of the light emission unit 32 is controlled in a case where the brightness of the environment is darker than the predetermined brightness. Therefore, the light emission unit 32 does not have to emit light in a case where it is bright around the display device 10, which makes it possible to reduce the power consumption. Therefore, in the display system 1, it is possible to reduce, for example, the number of times of replacing the battery used in the operation terminal 30 and the number of times of charging the battery. This makes it possible to improve the convenience of the user.

[0132] Further, in the display system 1, the light emission action of the light emission unit 32 is controlled based on the control information INF. Therefore, for example, after a predetermined period of time elapses after the light emission unit 32 starts to emit light, the light emission unit 32 can be caused to end the light emission. This makes it possible to limit the light emission time of the light emission unit 32, which makes it possible to reduce the power consumption. Therefore, in the display system 1, it is possible to reduce, for example, the number of times of replacing the battery used in the operation terminal 30 and the number of times of charging the battery. This makes it possible to improve the convenience of the user.

[0133] Further, the display system 1 uses the illuminance sensor 18 provided in the display device 10 to adjust the display luminance of the display unit 16. Therefore, it is not necessary to provide the illuminance sensor in the operation terminal 30, which makes it possible to reduce the number of components of the operation terminal 30. Therefore, in the display system 1, for example, it is possible to reduce the cost of the operation terminal 30.

[0134] [Effects]

[0135] As described above, in the present embodiment, the control information generator of the display device generates the control information corresponding to the detection result of the illuminance sensor. The light emission controller of the operation terminal controls the light emission action of the light emission unit based on the control information. Therefore, for example, in a case where it is dark around the display device, the operation unit can be highlighted by the light from the light emission unit, which makes it possible to improve the convenience of the user.

[0136] In the present embodiment, the light emitting operation of the light emitting unit is controlled in a case where the brightness of the environment is darker than a predetermined brightness. This makes it possible to reduce the number of times of replacing the battery used in the operation terminal and the number of times of charging the battery, for example. This makes it possible to improve the convenience of the user.

[0137] In the present embodiment, the light emitting operation of the light emitting unit is controlled based on the control information. Therefore, for example, the light emission of the light emitting unit can be ended after a predetermined period of time elapses after the light emission of the light emitting unit is started. This makes it possible to reduce the number of times of replacing the battery used in the operation terminal and the number of times of charging the battery, for example. This makes it possible to improve the convenience of the user.

[0138] The present embodiment adjusts the display luminance of the display unit using the illuminance sensor provided in the display device. This makes it possible to reduce the cost of the operation terminal.

[0139] [Modified Example 1-1]

[0140] In the above-described embodiment, the control information INF includes the sensor information INF1. Not being limited thereto, the control information INF can include various information for controlling the light emitting operation of the light emitting unit 32 in the operation terminal 30. The following is a detailed description of an example in which the control information INF includes light emission control information INFBL that gives an instruction of the light emitting operation of the light emitting unit 32.

[0141] As in the case of the above-described embodiment ( FIG. 1 ), the display system 1A according to the present modified example includes the display device 10A and the operation terminal 30A. The display device 10A includes the control unit 21A. The control unit 21A includes the control information generator 22A. The control information generator 22A is configured to generate the control information INF including the light emission control information INFBL based on the detection result of the illuminance sensor 18. The operation terminal 30A includes the control unit 37A. The control unit 37A includes the light emission controller 38A. The light emission controller 38A is configured to control the light emitting operation of the light emitting unit 32 based on the control information INF including the light emission control information INFBL.

[0142] FIG. 7 An action example of the operation terminal 30A is shown.

[0143] First, the control unit 37A checks whether the motion of the operation terminal 30A has been detected based on the detection result of the acceleration sensor 33 (Step S101). If the motion of the operation terminal 30A has not been detected (NO in Step S101), the control unit 37A checks whether the user operation to the operation unit 31 has been detected (Step S102). If the user operation to the operation unit 31 has not been detected (NO in Step S102), the flow returns to Step S101.

[0144] If the movement of the operation terminal 30A has been detected in step S101 (YES in step S101), or if the user operation to the operation unit 31 has been detected in step S102 (YES in step S102), the control unit 37A changes the action state of the operation terminal 30A from the sleep state to the normal action state (step S103).

[0145] Next, the control unit 37A issues a transmission request of the control information INF to the display device 10A via the wireless communication unit 35 (step S134). In this example, the control information INF includes the light emission control information INFBL that gives an instruction of the light emission action of the light emission unit 32. Then, the control unit 37A receives the control information INF transmitted from the display device 10A via the wireless communication unit 35 in response to the transmission request.

[0146] Next, the light emission controller 38A of the control unit 37A controls the light emission action of the light emission unit 32 based on the light emission control information INFBL included in the control information INF (step S137). Thus, the operation unit 31 of the operation terminal 30A is highlighted by the light emitted from the light emission unit 32. This flow ends here.

[0147] FIG. 8 An action example of the display device 10A is shown.

[0148] First, the display device 10A checks whether or not a transmission request of the control information INF including the light emission control information INFBL has been received from the operation terminal 30A (step S141). If the transmission request of the control information INF has been received (YES in step S141), the control information generator 22A of the control unit 21A acquires the detection result of the illuminance sensor 18 as the sensor information INF1 (step S142).

[0149] Next, the control information generator 22A checks whether or not the brightness of the environment indicated by the sensor information INF1 is darker than a predetermined brightness (step S143). If the brightness of the environment is darker than the predetermined brightness (YES in step S143), the control information generator 22A generates the light emission control information INFBL including an instruction to cause the light emission unit 32 to emit light based on this sensor information INF1 (step S144). Further, if the brightness of the environment is brighter than the predetermined brightness (NO in step S143), the control information generator 22A generates the light emission control information INFBL including an instruction not to cause the light emission unit 32 to emit light based on the sensor information INF1 (step S145).

[0150] Then, the control unit 21A transmits the control information INF including the light emission control information INFBL to the operation terminal 30A via the wireless communication unit 13 (Step S146). This sequence ends here.

[0151] FIG. 9 An example of the operation of the display system 1A is shown in a case where the user operates the operation unit 31 of the operation terminal 30A placed on a table in a dark environment.

[0152] When the user operates the operation unit 31 of the operation terminal 30A, the control unit 37A of the operation terminal 30A detects the user operation and changes the action state of the operation terminal 30A from the sleep state to the normal action state (Step S151). Then, the control unit 37A makes a transmission request for the control information INF including the light emission control information INFBL to the display device 10A via the wireless communication unit 35 (Step S152). The wireless communication unit 13 of the display device 10A receives the transmission request.

[0153] The control information generator 22A of the display device 10A acquires the detection result of the illuminance sensor 18 as the sensor information INF1 in response to the transmission request (Step S153). In this example, the sensor information INF1 includes information on the brightness of the environment which is darker than the predetermined brightness. Then, the control information generator 22A generates the light emission control information INFBL based on the sensor information INF1 (Step S154). In this example, because the brightness of the environment is darker than the predetermined brightness, the control information generator 22A generates the light emission control information INFBL which gives an instruction to cause all the light emitting devices in the light emission unit 32 to emit light for a predetermined period of time based on the sensor information INF1. Then, the control unit 21A transmits the control information INF including the light emission control information INFBL to the operation terminal 30A via the wireless communication unit 13 (Step S155). The control unit 37A of the operation terminal 30A receives the control information INF via the wireless communication unit 35.

[0154] Next, the light emission controller 38A of the operation terminal 30A causes the light emission unit 32 to start emitting light based on the light emission control information INFBL included in the control information INF (Step S126). Thus, the operation unit 31 of the operation terminal 30A is highlighted by the light emitted from the light emission unit 32. Then, the light emission controller 38A causes the light emission unit 32 to end emitting light after the predetermined period of time elapses based on the light emission control information INFBL (Step S127). This sequence ends here.

[0155] [Modified Example 1-2]

[0156] In the above-described embodiment, in a case where the brightness of the environment indicated by the sensor information INF1 is darker than the predetermined brightness, the light emission controller 38 generates the light emission control information INFBL that gives an instruction to cause all the light emitting devices in the light emission unit 32 to emit light, but not limited to this. Alternatively, for example, the light emission controller 38 can generate the light emission control information INFBL that gives an instruction to cause all the light emitting devices in the light emission unit 32 to emit light at a higher light emission luminance as the brightness of the environment indicated by the sensor information INF1 is darker.

[0157] [Modified Example 1-3]

[0158] In the above-described embodiment, the control information generator 22 generates the control information INF based on the brightness of the environment detected by the illuminance sensor 18, but not limited to this. The control information generator can also generate the control information INF based on other parameters about the environment. The following is a detailed description of this modified example with reference to some examples.

[0159] FIG. 10 A configuration example of a display system 1B according to this modified example is shown. The display system 1B includes a display device 10B and an operation terminal 30B.

[0160] The display device 10B includes a color sensor 18B and a control unit 21B.

[0161] The color sensor 18B is configured to detect the color of the environment around the display device 10. Specifically, the color sensor 18B can detect, for example, the color of the lighting of the room in which the display device 10B is provided. The control unit 21B adjusts the display color on the display unit 16 based on the detection result of the color sensor 18B. Here, the illuminance sensor 18 and the color sensor 18B correspond to a specific example of the “environment sensor” according to the present disclosure.

[0162] The control unit 21B includes a control information generator 22B. The control information generator 22B is configured to generate the control information INF based on the detection result of the illuminance sensor 18 and the detection result of the color sensor 18B. That is, the control information generator 22B generates the control information INF based on the brightness of the environment and the color of the environment.

[0163] The operation terminal 30B includes a light emission unit 32B and a control unit 37B.

[0164] The light emission unit 32B is configured to highlight the plurality of buttons B in the operation unit 31 by light emission. The light emission unit 32B, for example, includes a plurality of light emitting devices. The plurality of light emitting devices, for example, include a light emitting device that emits red light, a light emitting device that emits green light, and a light emitting device that emits blue light.

[0165] The control unit 37B includes a light emission controller 38B. The light emission controller 38B is configured to control the light emission action of the light emission unit 32B on the basis of the control information INF transmitted from the display device 10B. Specifically, for example, in a case where the color of the lighting of the room in which the display device 10B is installed is natural white, the light emission controller 38B generates instruction light emission control information INFBL that gives an instruction to cause the light emission means to emit light so that the light emission unit 32B emits white light. Further, for example, in a case where the color of the lighting of the room in which the display device 10B is installed is warm white, the light emission controller 38B generates light emission control information INFBL that gives an instruction to cause the light emission means to emit light so that the light emission unit 32B emits warm color light. That is, in this example, the light emission control information INFBL also includes information on the light emission color of the light emission unit 32B.

[0166] This configuration makes it possible for the display system 1B to control the light emission action of the light emission unit 32B on the basis of the information on the brightness of the environment obtained by the illuminance sensor 18 and the information on the color of the environment obtained by the color sensor 18B.

[0167] FIG. 11 A configuration example of another display system 1C according to the present modification example is shown. The display system 1C includes a display device 10C and the operation terminal 30B. The display device 10C includes a camera 18C and a control unit 21C.

[0168] The camera 18C is configured to generate a captured image by imaging a user in front of the display device 10C. The display device 10C is able to use the captured image to implement a function of, for example, a video phone. The captured image includes information on the brightness of the environment and the color of the environment. Here, the camera 18C corresponds to a specific example of the “environment sensor” according to the present disclosure.

[0169] The control unit 21C includes a control information generator 22C. The control information generator 22C is configured to generate the control information INF on the basis of the captured image obtained by the camera 18C. That is, the control information generator 22C is different from the control information generator 22B related to the display device 10B FIG. 10 ) generates the control information INF on the basis of the information on the brightness of the environment obtained by the illuminance sensor 18 and the information on the color of the environment obtained by the color sensor 18B. In contrast, the control information generator 22C generates the control information INF on the basis of the information on the brightness of the environment and the color of the environment obtained by the camera 18C.

[0170] This configuration makes it possible for the display system 1C to control the light emission action of the light emission unit 32B on the basis of the information on the brightness of the environment and the color of the environment obtained by the camera 18C.

[0171] [Modification Example 1-4]

[0172] In the above-described embodiments, as shown in FIG. 2 the operation terminal 30 includes a plurality of buttons B, but is not limited thereto. Alternatively, for example, in addition to the plurality of buttons B, a display unit 39D can be included, as in the operation terminal 30D shown in FIG. 12 The display unit 39D is configured by using, for example, a liquid crystal display, an organic EL display, or the like. In this case, the light emitting unit 32 can highlight the plurality of buttons B by emitting light, as in the case of the above-described embodiments. The light emission controller 38D according to the present modification example can control the light emission action of the light emitting unit 32 based on the control information INF, and also control the display action of the display unit 39D. Specifically, the light emission controller 38D can cause the light emitting unit 32 to emit light and cause the display unit 39D to display information, for example, based on the control information INF.

[0173] Further, for example, in addition to the display unit, the operation terminal can include a touch panel. In this case, the user can be able to perform an operation by touching a button image displayed on the display unit. The light emission controller can control the display action of the display unit based on the control information INF to cause the display unit to display a highlighted button image. For example, a smartphone can be used as the operation terminal.

[0174] [Modification Example 1-5]

[0175] In the above-described embodiments, the illuminance sensor 18 is provided in the display device 10. Not limited thereto, the illuminance sensor can be provided in the operation terminal 30. Then, the light emission controller 38 of the operation terminal 30 can control the light emission action of the light emitting unit 32 based on the detection result of the illuminance sensor 18 of the display device 10 and the detection result of the illuminance sensor of the operation terminal 30. Further, in a case where it is made possible to control the light emission action using the illuminance sensor provided in the operation terminal 30 without using the illuminance sensor 18 provided in the display device 10, the light emission controller 38 can control the light emission action by using only the detection result of the illuminance sensor in the operation terminal 30. In this case, the illuminance sensor 18 can not be provided in the display device 10.

[0176] Similarly, in the case of the operation terminal 30 according to Modification Example 1-3 FIG. 10In the display system 1B, for example, the illuminance sensor 18 and the color sensor 18B are provided in the display device 10B. Not being limited thereto, the illuminance sensor and the color sensor can be provided in the operation terminal 30B. Then, the light emission controller 38B can control the light emission operation of the light emission unit 32B based on the detection results of the illuminance sensor 18 and the color sensor 18B of the display device 10B and the detection results of the illuminance sensor and the color sensor of the operation terminal 30B. Further, in a case where the light emission operation is controlled using one or both of the illuminance sensor and the color sensor provided in the operation terminal 30B without using one or both of the illuminance sensor 18 and the color sensor 18B provided in the display device 10B, the light emission controller 38B can control the light emission operation by using only the detection results of the sensor in the operation terminal 30B. In this case, one or both of the illuminance sensor 18 and the color sensor 18B can not be provided in the display device 10B.

[0177] Further, the control unit 21B of the display device 10B can control the operation of the display device 10B by receiving, from the operation terminal 30B, the environmental information (for example, the brightness of the environment or the color of the environment) acquired by one or both of the illuminance sensor and the color sensor provided on the operation terminal 30B. Specifically, for example, the control unit 21B can adjust the display brightness of the display unit 16 based on the information related to the brightness of the environment and acquired by the illuminance sensor of the operation terminal 30B. Further, for example, the control unit 21B can adjust the display contrast of the display unit 16 based on the information related to the color of the environment and acquired by the color sensor of the operation terminal 30B. Thus, using the information of the environmental sensor provided in the operation terminal 30B makes it possible to acquire the environmental information that enables reduction of the influence due to the reflection of the light emitted from the display unit 16 of the display device 10B. Note that the control of the display device 10B based on the environmental sensor of the operation terminal 30B is not limited to the control of the display unit 16, and any setting of the display device 10B can be changed. Further, the sensor information transmitted from the environmental sensor of the operation terminal 30B to the display device 10B can be information corresponding to the sensor information INF1 or the control information INF.

[0178] Further, in a case where an environmental sensor such as an illuminance sensor or a color sensor is provided in the operation terminal 30B, based on detection of a motion of the operation terminal 30B or detection of a user operation of the operation unit 31, the power supply unit 36 can supply a power supply voltage to the environmental sensor of the operation terminal 30B only for a short period of time corresponding to a detection timing. In addition, in a case where the operation terminal 30B transmits an infrared signal, the transmission timing of the infrared signal and the timing of the illuminance detection process can be offset from each other to reduce the influence of fluctuations in the infrared signal and the power supply voltage on the illuminance sensor of the operation terminal 30B. Specifically, for example, when the user presses a button B of the operation unit 31, the control unit 37B can detect information related to the brightness of the environment by using the illuminance sensor, and after the detection process of the illuminance sensor ends, can control the infrared transmitter 34 to transmit an infrared signal corresponding to the button B to a device to be operated such as the display device 10B.

[0179] In addition, the control unit 21B can operate the display device 10B by using the detection results of the acceleration sensor 33 and the environmental sensor of the operation terminal 30B. Specifically, for example, in a case where it is determined based on the detection results of the illuminance sensor or the acceleration sensor 33 of the operation terminal 30B that the operation terminal 30B is flipped, the control unit 21B can stop supplying a power supply voltage to the display unit 16, or can turn off the power of the display device 10B. In this case, the display device 10B can receive, for example, sensor information indicating that the operation surface S on which the operation unit 31 and the illuminance sensor are provided is directed downward in the vertical direction from the operation terminal 30B.

[0180] [Other Modification Examples]

[0181] In addition, two or more of these modification examples can be combined with each other.

[0182] <2. Second Embodiment>

[0183] Next, a description will be given regarding a display system 2 according to a second embodiment. The display system 2 according to the present embodiment is configured to control a light emission action of a light emission unit of an operation terminal in accordance with content displayed by a display device. Note that components substantially the same as the display system 1 according to the first embodiment are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0184] FIG. 13 A configuration example of the display system 2 is shown. The display system 2 includes a display device 40 and an operation terminal 50.

[0185] The display device 40 includes a control unit 41. The control unit 41 includes a content analyzer 43 and a control information generator 42.

[0186] The content analyzer 43 is configured to analyze the content displayed by the display unit 16 of the display device 40. Specifically, in a case where the display unit 16 displays a video based on a video signal selected by the tuner 11, for example, the content analyzer 43 analyzes the content by analyzing the broadcast metadata included in the video signal.

[0187] The control information generator 42 is configured to generate control information INF for controlling the light emission action of the light emission unit 32 in the operation terminal 50 based on the analysis result of the content analyzer 43. Then, the display device 40 transmits the control information INF generated by the control information generator 42 to the operation terminal 50 via the wireless communication unit 13.

[0188] The operation terminal 50 includes a control unit 57. The control unit 57 includes a light emission controller 58. The light emission controller 58 is configured to control the light emission action of the light emission unit 32 based on the control information INF transmitted from the display device 40.

[0189] FIG. 14 An action example of the display device 40 is shown.

[0190] First, the control unit 41 checks whether the infrared receiver 12 has received an infrared signal transmitted from the operation terminal 50 (step S201).

[0191] If the infrared receiver 12 has received the infrared signal (YES in step S201), the control unit 41 checks whether the user has performed a channel change operation (step S202). Specifically, the control unit 41 checks whether the user has performed the channel change operation by, for example, checking whether the infrared signal is a signal corresponding to an operation of the number button B3 or the channel button B11 shown in FIG. 1. FIG. 2 The channel button B11 is a button for changing the channel of the video signal selected by the tuner 11.

[0192] If the user has performed the channel change operation in step S202 (YES in step S202), the content analyzer 43 checks whether the content being displayed is audio multiplex broadcast content based on the broadcast metadata included in the video signal corresponding to the channel newly selected by the channel change operation (step S203). Examples of the audio multiplex broadcast content include multi-language content and content including a main audio and a sub audio. If the content being displayed is the audio multiplex broadcast content (YES in step S203), the control information generator 42 generates the content information INF2 including information indicating that the content being displayed is the audio multiplex broadcast content (step S204).

[0193] Next, the content analyzer 43 checks whether the content being displayed is subtitle content based on the broadcast metadata (step S205). If the content being displayed is subtitle content ("Yes" in step S205), the control information generator 42 generates the content information INF2 including information indicating that the content being displayed is subtitle content (step S206).

[0194] Next, the content analyzer 43 checks whether the content being displayed is data broadcast content based on the broadcast metadata (step S207). If the content being displayed is data broadcast content ("Yes" in step S207), the control information generator 42 generates the content information INF2 including information indicating that the content being displayed is data broadcast content (step S208). Then, the flow proceeds to step S211.

[0195] If the user has not performed the channel change operation in step S202 ("No" in step S201), the control unit 41 checks whether the user has performed an operation of selecting a moving image stream service (step S209). Specifically, the control unit 41 checks whether the user has performed an operation of selecting a moving image stream service by, for example, checking whether the infrared signal is a signal corresponding to an operation of the moving image service selection button B2 shown in Fig. 1. FIG. 2 If the user has not performed an operation of selecting a moving image stream service ("No" in step S209), the flow ends.

[0196] If the user has performed an operation of selecting a moving image stream service in step S209 ("Yes" in step S209), the control information generator 42 generates the content information INF2 including information indicating that the content being displayed is content provided by a moving image stream service (step S210). Then, the flow proceeds to step S211.

[0197] Then, in a case where the control information generator 42 has generated the content information INF2, the control unit 41 transmits the control information INF including the content information INF2 to the operation terminal 50 via the wireless communication unit 13 (step S211). The flow ends here.

[0198] FIG. 15 An action example of the display system 2 in a case where the user performs a channel change operation is shown.

[0199] When the user performs a channel change operation by, for example, operating the number buttons B3 or the channel buttons B11 of the operation terminal 50, the control unit 57 of the operation terminal 50 detects the operation and changes the action state of the operation terminal 50 from the sleep state to the normal action state (step S221). Then, the infrared transmitter 34 emits an infrared signal corresponding to the channel change operation (step S222). The infrared receiver 12 of the display device 40 receives the infrared signal.

[0200] The tuner 11 of the display device 40 switches the channel based on the information on the channel change operation included in the infrared signal (step S223). Then, the content analyzer 43 analyzes the content by analyzing the broadcast metadata included in the video signal selected by the tuner 11 (step S224). The control information generator 42 generates the content information INF2 based on the analysis result of the content analyzer 43 (step S225). Then, the control unit 41 transmits the control information INF including the content information INF2 to the operation terminal 50 via the wireless communication unit 13 (step S226). The control unit 57 of the operation terminal 50 receives the control information INF via the wireless communication unit 35.

[0201] The light emission controller 58 of the operation terminal 50 generates the light emission control information INFBL based on the content information INF2 included in the control information INF (step S227).

[0202] For example, in a case where the content information INF2 includes information indicating that the content being displayed is audio multiplex broadcast content, the light emission controller 58 generates the light emission control information INFBL giving an instruction to cause the light emitting means corresponding to the audio selection button B14 FIG. 2 ) of the light emission unit 32 to emit light for a predetermined period of time.

[0203] Further, for example, in a case where the content information INF2 includes information indicating that the content being displayed is subtitle content, the light emission controller 58 generates the light emission control information INFBL giving an instruction to cause the light emitting means corresponding to the subtitle button B15 FIG. 2 ) of the light emission unit 32 to emit light for a predetermined period of time.

[0204] Further, for example, in a case where the content information INF2 includes information indicating that the content being displayed is data broadcast content, the light emission controller 58 generates the light emission control information INFBL giving an instruction to cause the light emitting means corresponding to the data broadcast button B19, the color button B4, and the number button B3 FIG. 2the light-emitting control information INFBL giving an instruction to cause the light-emitting device corresponding to the data broadcast button B19 to emit light for a predetermined period of time. Further, for example, in a case where the content being displayed is data broadcast content and the content accepts operations on the color buttons B4 and the number buttons B3, the light-emitting controller 58 can generate the light-emitting control information INFBL giving an instruction to cause the light-emitting devices corresponding to the data broadcast button B19, the color buttons B4, and the number buttons B3 to emit light for a predetermined period of time.

[0205] Further, for example, in a case where the content information INF2 includes information indicating that the content being displayed is content provided by a moving image stream service, the light-emitting controller 58 generates the light-emitting control information INFBL giving an instruction to cause the light-emitting device in the light-emitting unit 32 corresponding to the moving image content operation button B16 FIG. 2 ) to emit light for a predetermined period of time.

[0206] Next, the light-emitting controller 58 causes the light-emitting unit 32 to start emitting light based on the light-emitting control information INFBL (step S228). Thus, the buttons B in the operation unit 31 of the operation terminal 50 indicated by the light-emitting control information INFBL are highlighted by the light emitted from the light-emitting unit 32. Then, the light-emitting controller 58 causes the light-emitting unit 32 to end emitting light after a predetermined period of time elapses based on the light-emitting control information INFBL (step S229). This sequence ends here.

[0207] As described above, in the display system 2, the control information generator 42 of the display device 40 generates the control information INF corresponding to the content being displayed by the display device 40. The light-emitting controller 58 of the operation terminal 50 controls the light-emitting action of the light-emitting unit 32 based on the control information INF. Thus, in the display system 2, it is possible to highlight the buttons B that can be operated by the user by the light from the light-emitting unit 32. This enables the user to easily find the button B that the user wants to operate, for example, from among a plurality of buttons B. Thus, the display system 2 can improve the convenience of the user.

[0208] As described above, in the present embodiment, the control information generator of the display device generates the control information corresponding to the content being displayed by the display device, and the light-emitting controller of the operation terminal controls the light-emitting action of the light-emitting unit based on the control information. This enables the user to easily find the button that the user wants to operate, for example, which makes it possible to improve the convenience of the user. Other effects are similar to those in the case of the first embodiment.

[0209] [Modified Example 2-1]

[0210] In the above-described embodiment, the control information INF includes the content information INF2. Not being limited thereto, for example, the control information INF can include light emission control information INFBL giving an instruction of a light emission action of the light emission unit 32, as in the case of the modified example 1-1 of the first embodiment.

[0211] [Modified Example 2-2]

[0212] In the above-described embodiment, in a case where the content being displayed is an audio multiplex broadcast content, a subtitle content, a data broadcast content, or a content provided by a moving image stream service, the button B corresponding to the content is highlighted by light from the light emission unit 32, but the present disclosure is not limited thereto. For example, for three or less types of contents among the four types of contents, the corresponding button B can be highlighted. Specifically, for example, in a case where the content being displayed is an audio multiplex broadcast content, a subtitle content, or a content provided by a moving image stream service, the button B corresponding to the content can be highlighted, and in a case where the content being displayed is a data broadcast content, the corresponding button B can not be highlighted.

[0213] <3. Third Embodiment>

[0214] Next, a description will be given regarding a display system 3 according to a third embodiment. The display system 3 according to the present embodiment is configured to analyze a video being displayed, and control a light emission action of a light emission unit of an operation terminal according to an analysis result. Note that components substantially the same as the display system 1 according to the first embodiment are denoted by the same reference numerals, and a description thereof will be appropriately omitted.

[0215] FIG. 16 A configuration example of the display system 3 is shown. The display system 3 includes a display device 60 and an operation terminal 70.

[0216] The display device 60 includes a control unit 61. The control unit 61 includes an image analyzer 63 and a control information generator 62.

[0217] The image analyzer 63 is configured to analyze an image displayed by the display unit 16 on the basis of a video signal. Specifically, the image analyzer 63 generates information regarding an average color of all pixels in a frame image, for example, on the basis of the video signal. Note that although the image analyzer 63 of the display device 60 analyzes the image in this example, the present disclosure is not limited thereto. Alternatively, for example, an external server can analyze the image.

[0218] The control information generator 62 is configured to generate control information INF for controlling the light emission action of the light emission unit 72 in the operation terminal 70, based on the analysis result of the image analyzer 63. Then, the control unit 61 transmits the control information INF generated by the control information generator 62 to the operation terminal 70 via the wireless communication unit 13.

[0219] The operation terminal 70 includes a light emission unit 72 and a control unit 77.

[0220] The light emission unit 72 is configured to be capable of emitting light from the entire surface of the operation surface S. Specifically, for example, by configuring the housing and the button B of the operation terminal 70 using a translucent material and by the light emission unit 72 emitting light, it is possible to make light emit from the operation surface S. The light emission unit 72 includes, for example, a light emission device that emits red light, a light emission device that emits green light, and a light emission device that emits blue light.

[0221] The control unit 77 includes a light emission controller 78. The light emission controller 78 is configured to control the light emission action of the light emission unit 72 based on the control information INF transmitted from the display device 60.

[0222] FIG. 17 An action example of the display device 60 is shown. The display device 60 repeatedly performs the following actions each time a predetermined period of time (for example, about several seconds) elapses.

[0223] First, the image analyzer 63 analyzes the image displayed by the display unit 16 based on the video signal (step S301).

[0224] Next, the control information generator 62 generates image color information INF3 based on the analysis result of the image analyzer 63 (step S302). In this example, the image color information INF3 includes information on the average color in the frame image. The image color information INF3 can be expressed, for example, by using a luminance signal (Y) and a chroma signal (Cr, Cb). Note that it is not limited thereto, and can be expressed by using a red signal (R), a green signal (G), and a blue signal (B).

[0225] Then, the control unit 61 transmits the control information INF including the image color information INF3 to the operation terminal 70 via the wireless communication unit 13 (step S303). This flow ends here.

[0226] FIG. 18 An action example of the display system 3 is shown.

[0227] The image analyzer 63 of the display device 60 analyzes the image based on the video signal (step S321), and the control information generator 62 generates the image color information INF3 based on the image analysis result (step S322). Then, the control unit 61 transmits the control information INF including the image color information INF3 to the operation terminal 70 via the wireless communication unit 13 (step S323). The control unit 77 of the operation terminal 70 receives this control information INF via the wireless communication unit 35.

[0228] The light emission controller 78 of the operation terminal 70 generates the light emission control information INFBL based on the image color information INF3 included in the control information INF (step S324).

[0229] For example, in a case where the display unit 16 is displaying a scene in which something is burning, the image color information INF3 includes information on red, for example. In this case, the light emission controller 78 generates the light emission control information INFBL by setting the light emission luminance of each light emission device so that the light emission unit 72 emits red light. Further, for example, in a case where the display unit 16 is displaying a scene of a forest, the image color information INF3 includes information on green, for example. In this case, the light emission controller 78 generates the light emission control information INFBL giving an instruction to cause the light emission device to emit light so that the light emission unit 72 emits green light. Further, for example, in a case where the display unit 16 is displaying a scene of the sea or a scene of a blue sky, the image color information INF3 includes information on blue, for example. In this case, the light emission controller 78 generates the light emission control information INFBL giving an instruction to cause the light emission device to emit light so that the light emission unit 72 emits blue light.

[0230] Next, the light emission controller 78 controls the light emission action of the light emission unit 72 based on the light emission control information INFBL (step S325). Thus, the light corresponding to the color of the scene displayed by the display unit 16 is emitted from the operation surface S of the operation terminal 70.

[0231] This sequence ends here. By repeating this sequence, the operation terminal 70 can keep emitting the light corresponding to the color of the scene being displayed by the display unit 16.

[0232] As described above, in the display system 3, the control information generator 62 of the display device 60 generates the control information INF corresponding to the color of the scene being displayed by the display unit 16. The light emission controller 78 of the operation terminal 70 controls the light emission action of the light emission unit 72 based on the control information INF. Thus, the operation terminal 70 is able to emit the light corresponding to the color of the scene displayed by the display unit 16, which makes the user who is watching the content, for example, feel more realistic.

[0233] As described above, in the present embodiment, the control information generator of the display apparatus generates control information corresponding to the color being displayed by the display unit, and the light emission controller of the operation terminal controls the light emission action of the light emission unit based on the control information. This makes the user feel more realistic.

[0234] [Modified Example 3-1]

[0235] In the above-described embodiment, the control information INF includes the image color information INF3. Not limited thereto, for example, the control information INF can include light emission control information INFBL giving an instruction of the light emission action of the light emission unit 72, as in the case of the display system 1A according to Modified Example 1-1 of the first embodiment.

[0236] [Modified Example 3-2]

[0237] In the above-described embodiment, the light emission unit 72 capable of emitting light from the entire surface of the operation surface S is provided, but the present disclosure is not limited thereto. For example, the light emission unit 72 capable of highlighting a plurality of buttons B in the operation unit 31 by light emission can be provided, as in the display system 1B according to Modified Example 1-3 of the first embodiment. Also in this case, by controlling the light emission luminance of the light emission device of each color included in the light emission unit 72, light corresponding to the color of the scene displayed by the display unit 16 can be emitted from the operation surface S.

[0238] <4. Fourth Embodiment>

[0239] Next, a description will be given regarding a display system 4 according to a fourth embodiment. The display system 4 according to the present embodiment is configured to control the light emission action of the light emission unit of the operation terminal in accordance with the information to be notified to the user when the display apparatus notifies the user of the information. Note that components substantially the same as the display system 1 according to the first embodiment are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0240] FIG. 19 A configuration example of the display system 4 is shown. The display system 4 includes a display apparatus 80 and an operation terminal 90.

[0241] The display apparatus 80 includes a control unit 81. The control unit 81 includes a notification processor 83 and a control information generator 82.

[0242] The notification processor 83 is configured to check whether there is information to be notified to the user, and for example, in the case where there is information to be notified to the user, generate a notification message to be displayed on the display unit 16.

[0243] The control information generator 82 is configured to generate control information INF for controlling the light emission action of the light emission unit 32 in the operation terminal 90 based on the processing of the notification processor 83. Then, the control unit 81 transmits the control information INF generated by the control information generator 82 to the operation terminal 90 via the wireless communication unit 13.

[0244] The operation terminal 90 includes a control unit 97. The control unit 97 includes a light emission controller 98. The light emission controller 98 is configured to control the light emission action of the light emission unit 32 based on the control information INF transmitted from the display device 80.

[0245] Further, in this example, the software distribution server 202 is coupled to the Internet NET. The software distribution server 202 is configured to deliver software such as firmware to the display device 80.

[0246] FIG. 20A and FIG. 20B An action example of the display device 80 is shown.

[0247] First, the control unit 81 checks whether software to be updated has been newly recorded in the software distribution server 202 (step S401). If the software to be updated has been newly recorded (YES in step S401), the notification processor 83 generates a notification message indicating that there is software to be updated, and the display unit 16 displays the notification message (step S402). Then, the control information generator 82 generates notification information INF4 including information indicating that there is software to be updated (step S403).

[0248] Next, the control unit 81 checks whether an external device has been newly coupled to the external device interface 14 (step S404). If an external device has been newly coupled to the external device interface 14, the notification processor 83 generates a notification message indicating that an external device has been newly coupled, and the display unit 16 displays the notification message (step S405). Then, the control information generator 82 generates notification information INF4 including information indicating that an external device has been newly coupled (step S406).

[0249] Next, in a case where a recording and playback device is coupled to the external device interface 14, for example, the control unit 81 checks whether there is newly recorded content in the recording and playback device (step S407). If there is newly recorded content (YES in step S407), the notification processor 83 generates a notification message indicating that there is newly recorded content, and the display unit 16 displays the notification message (step S408). Then, the control information generator 82 generates notification information INF4 including information indicating that there is newly recorded content (step S409).

[0250] Next, the control unit 81 checks whether there is a suggestion about a setting change to the user (step S410). If there is a suggestion about a setting change (YES in step S410), the notification processor 83 generates a notification message about details of the setting change to be suggested, and the display unit 16 displays the notification message (step S411). Then, the control information generator 82 generates the notification information INF4 including information indicating the suggestion about the setting change (step S412).

[0251] Next, the control unit 81 checks whether content has been newly recorded into the content server 201 of the moving image streaming service (step S413). If content has been newly recorded (YES in step S413), the notification processor 83 generates a notification message indicating that content has been newly recorded into the moving image streaming service, and the display unit 16 displays the notification message (step S414). Then, the control information generator 82 generates the notification information INF4 including information indicating that content has been newly recorded into the moving image streaming service (step S415).

[0252] Then, the control unit 81 transmits the control information INF including the notification information INF4 to the operation terminal 90 via the wireless communication unit 13 (step S416). This flow ends here.

[0253] FIG. 21 An action example of the display system 4 is shown.

[0254] The notification processor 83 of the display device 80 generates a notification message, and the display unit 16 displays the notification message (step S421). The control information generator 82 generates the notification information INF4 based on the processing of the notification processor 83 (step S422). Then, the control unit 81 transmits the control information INF including the notification information INF4 to the operation terminal 90 via the wireless communication unit 13 (step S423). The control unit 97 of the operation terminal 90 receives this control information INF via the wireless communication unit 35.

[0255] The light emission controller 98 of the operation terminal 90 generates the light emission control information INFBL based on the notification information INF4 included in the control information INF (step S424).

[0256] For example, in a case where the notification information INF4 includes information indicating that there is software to be updated, the light emission controller 98 generates the light emission control information INFBL giving an instruction to cause the light emitting means in the light emitting unit 32 corresponding to the help button B18 FIG. 2 ) to emit light for a predetermined period of time.

[0257] Further, for example, in a case where the notification information INF4 includes information indicating that the external device is newly coupled, the light emission controller 98 generates light emission control information INFBL giving an instruction to cause the light emitting means in the light emission unit 32 corresponding to the input selection button B7 FIG. 2 ) to emit light for a predetermined period of time.

[0258] Further, for example, in a case where the notification information INF4 includes information indicating that there is a newly recorded content, the light emission controller 98 generates light emission control information INFBL giving an instruction to cause the light emitting means in the light emission unit 32 corresponding to the recording list button B17 FIG. 2 ) to emit light for a predetermined period of time.

[0259] Further, for example, in a case where the notification information INF4 includes information indicating that there is a suggestion of a setting change, the light emission controller 98 generates light emission control information INFBL giving an instruction to cause the light emitting means in the light emission unit 32 corresponding to the setting button B6 FIG. 2 ) to emit light for a predetermined period of time.

[0260] Further, for example, in a case where the notification information INF4 includes information indicating that a content has been newly recorded in the moving image stream service, the light emission controller 98 generates light emission control information INFBL giving an instruction to cause the light emitting means in the light emission unit 32 corresponding to the moving image service selection button B2 FIG. 2 ) to emit light for a predetermined period of time. Specifically, for example, in a case where the content is newly recorded in the service S1 of the moving image stream service, the light emission controller 98 can generate light emission control information INFBL giving an instruction to cause the light emitting means in the moving image service selection button B2 corresponding to the button B of the service S1 to emit light.

[0261] Next, the light emission controller 98 causes the light emission unit 32 to start emitting light based on the light emission control information INFBL (step S425). Thus, the button B in the operation unit 31 of the operation terminal 90 indicated by the light emission control information INFBL is highlighted by the light emitted from the light emission unit 32. Then, the light emission controller 98 causes the light emission unit 32 to end emitting light after a predetermined period of time elapses based on the light emission control information INFBL (step S426). This sequence ends here.

[0262] As described above, in the display system 4, the control information generator 82 of the display device 80 generates the control information INF corresponding to the information to be notified to the user. The light emission controller 98 of the operation terminal 90 controls the light emission action of the light emission unit 32 based on the control information INF. Therefore, in the display system 4, it is possible to highlight the button B that can be operated by the user by the light from the light emission unit 32. This enables the user to easily find the button B that the user wants to operate, for example, from among a plurality of buttons B. Therefore, the display system 4 is able to improve the convenience of the user.

[0263] As described above, in the present embodiment, the control information generator of the display device generates the control information corresponding to the information to be notified to the user, and the light emission controller of the operation terminal controls the light emission action of the light emission unit based on the control information. This enables the user to easily find the button that the user wants to operate, for example, which makes it possible to improve the convenience of the user. Other effects are similar to those in the case of the first embodiment.

[0264] [Modification Example 4-1]

[0265] In the above-described embodiment, the control information INF includes the notification information INF4. Not limited to this, for example, the control information INF can include the light emission control information INFBL that gives an instruction of the light emission action of the light emission unit 32, as in the case of the display system 1A according to the modification example 1-1 of the first embodiment.

[0266] [Modification Example 4-2]

[0267] In the above-described embodiment, the software distribution server 202 distributes the software, but the present disclosure is not limited to this. For example, a broadcasting station can distribute the software by using a digital broadcasting wave. In this case, the control unit 81 can check whether the software has been updated based on the software provided by using the digital broadcasting wave.

[0268] [Modification Example 4-3]

[0269] In the above-described embodiment, as shown in step S425 and step S426, the button B corresponding to the notification information in the operation terminal 90 is highlighted by the light from the light emission unit 32 for a predetermined period of time, but the present disclosure is not limited to this. Alternatively, for example, when the display unit 16 of the display device 80 displays the notification message in step S421, the button B corresponding to the notification message can be highlighted in the period in which the display unit 16 displays the notification message.

[0270] [Modification Example 4-4]

[0271] Although the above embodiments describe information to be notified to the user with reference to some examples, the present disclosure is not limited thereto. For example, in a case where content associated with content viewed by the user is viewable through a broadcast, a moving image streaming service, or the like, the display unit 16 can display a notification message indicating the case, and a button B corresponding to the notification message can be highlighted by light from the light emitting unit 32.

[0272] Specifically, in the display device 80, for example, when the user finishes viewing a broadcast movie, the notification processor 83 generates a notification message indicating that other movies related to a movie director of the movie are viewable in a service S1 in a moving image streaming service, and the display unit 16 displays the notification message. The control information generator 82 generates notification information INF4 corresponding to the notification message, and the control unit 81 transmits control information INF including the notification information INF4 to the operation terminal 90 via the wireless communication unit 13. Based on the notification information INF4 included in the control information INF, the operation terminal 90 highlights a button B corresponding to the service S1 in the moving image service selection button B2 by light from the light emitting unit 32.

[0273] Further, for example, in a case where the user views an official trailer of a drama via a moving image streaming service, the notification processor 83 creates a notification message indicating that the drama is viewable via a video on demand (VOD) service of a set-top box coupled to the external device interface 14, and the display unit 16 displays the notification message. The control information generator 82 generates notification information INF4 corresponding to the notification message, and the control unit 81 transmits control information INF including the notification information INF4 to the operation terminal 90 via the wireless communication unit 13. The operation terminal 90 highlights the input selection button B7 by light from the light emitting unit 32 based on the notification information INF4 included in the control information INF.

[0274] As described above, the display device 80 is able to recommend content to the user by displaying a notification message based on content viewed by the user. Then, the operation terminal 90 highlights a button B corresponding to a manner in which recommended content is viewable. This enables the user to easily find a button to be operated to view the content, which makes it possible to improve convenience for the user.

[0275] [Modified Example 4-5]

[0276] In the above-described embodiments, the light emitting unit 32 of the operation terminal 90 emits light based on the notification information INF4 transmitted from the display device 80 and associated with the content, but the present disclosure is not limited to this. For example, the notification processor 83 of the display device 80 can generate a notification message according to the state of the battery contained in the operation terminal 90, and the display unit 16 can display the notification message. Specifically, in a state in which the remaining amount of the battery contained in the operation terminal 90 has fallen below a predetermined level, or in a case where the battery contained in the operation terminal 90 is being charged, the operation terminal 90 can transmit information related to such a state of the battery to the display device 80, and the display unit 16 of the display device 80 can display a notification message corresponding to the received information related to the state of the battery. In this case, the notification-related information (such as information related to the state of the battery) transmitted from the operation terminal 90 to the display device 80 can be information corresponding to the notification information INF4 or the control information INF, or can be information exchanged via the wireless communication unit 35 and the wireless communication unit 13.

[0277] Further, the operation terminal 90 can cause the light emitting unit 32 to emit light according to the state of the contained battery. In this case, in the light emission, one or a plurality of the buttons B can be highlighted in a predetermined color and a predetermined timing. Specifically, when the battery remaining amount falls below a predetermined level, the power button B1 can be controlled to flash in red, and when charging of the battery is started, the power button B1 can be highlighted in a color other than red. In this case, a plurality of buttons B (for example, the power button B1 and the number button B3) can be highlighted. Further, the display device 80 or the operation terminal 90 can cause the highlighted representation of the buttons B of the operation terminal 90 and the notification message displayed on the display unit 16 to correspond to each other. Specifically, the color or timing of the light emission of the light emitting unit 32 and the color or timing of the notification message displayed on the display unit 16 can be caused to correspond to each other. In this case, for example, if the battery remaining amount of the operation terminal 90 falls below a predetermined level, or if charging of the battery is started, the color and the flashing frequency of the light emission of the light emitting unit 32 can be controlled to be the same as the color and the flashing frequency of the notification message displayed on the display unit 16. Further, in a case where the battery of the operation terminal 90 is charged by a wireless power supply, when placed on a wireless power supply charger, the operation terminal 90 can transmit information related to the light emission of the light emitting unit 32 or the state of the battery to the display device 80.

[0278] <5. Fifth Embodiment>

[0279] Next, a description will be given regarding a display system 5 according to a fifth embodiment. The display system 5 according to the present embodiment is configured to control a light emission action of a light emission unit of an operation terminal according to a voice assistant selected by a user in a case where a plurality of voice assistants are installed on a display device. Note that components substantially the same as the display system 1 according to the first embodiment are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0280] FIG. 22 A configuration example of the display system 5 is shown. The display system 5 includes a display device 100 and an operation terminal 110.

[0281] The display device 100 includes a control unit 101. The control unit 101 includes two voice assistant processors (voice assistant processors 103A and 103B) and a control information generator 102.

[0282] The voice assistant processors are configured to perform processing corresponding to an instruction of a user included in voice data based on the voice data of the user. The voice assistant processor 103A implements a function of a voice assistant VA, and the voice assistant processor 103B implements a function of a voice assistant VB. The user selects a voice assistant to be used from the voice assistants VA and VB by operating a voice assistant call button B5 of the operation terminal 110. The control unit 101 of the display device 100 selects one of the voice assistants VA and VB based on a button operation code corresponding to an operation of the voice assistant call button B5 received from the operation terminal 110 via a wireless communication unit 13.

[0283] In a case where the button operation code transmitted from the operation terminal 110 indicates an operation in which the user selects the voice assistant VA, the voice assistant processor 103A transmits voice data subsequently transmitted from the operation terminal 110 to a server 204A coupled to the Internet NET. Then, the voice assistant processor 103A performs processing corresponding to an instruction of the user included in the voice data based on information analyzed by the server 204A.

[0284] In a case where the button operation code transmitted from the operation terminal 110 indicates an operation in which the user selects the voice assistant VB, the voice assistant processor 103B transmits voice data subsequently transmitted from the operation terminal 110 to a server 204B coupled to the Internet NET. Then, the voice assistant processor 103B performs processing corresponding to an instruction of the user included in the voice data based on information analyzed by the server 204B.

[0285] The control information generator 102 is configured to generate control information INF for controlling a light emission action of the light emission unit 112 in the operation terminal 110 in accordance with the voice assistant selected by the user from among the two voice assistants VA and VB. Then, the control unit 101 transmits the control information INF generated by the control information generator 102 to the operation terminal 110 via the wireless communication unit 13.

[0286] The operation terminal 110 includes the light emission unit 112, the microphone 113, and the control unit 117.

[0287] The light emission unit 112 is configured to highlight the plurality of buttons B in the operation unit 31 by light emission. The light emission unit 112 includes, for example, a plurality of light emission devices. The plurality of light emission devices include, for example, a light emission device that emits red light, a light emission device that emits green light, and a light emission device that emits blue light.

[0288] The microphone 113 is configured to convert, for example, a voice of the user into an electric signal. The control unit 117 generates voice data based on the electric signal supplied from the microphone 113, and transmits the voice data to the display device 100 via the wireless communication unit 35.

[0289] For example, in a case where the user operates the voice assistant call button B5( FIG. 2 ), the control unit 117 transmits a button operation code via the wireless communication unit 35. The button operation code includes a press code indicating that the voice assistant call button B5 has been pressed, and a release code indicating that the voice assistant call button B5 has been released from the press.

[0290] The control unit 117 includes a light emission controller 118. The light emission controller 118 is configured to control a light emission action of the light emission unit 112 based on the control information INF transmitted from the display device 100.

[0291] Here, the display device 100 corresponds to a specific example of the “information processing device” according to the present disclosure. The control information generator 102 corresponds to a specific example of the “generator” according to the present disclosure. The voice assistant processor corresponds to a specific example of the “voice analyzer” according to the present disclosure.

[0292] FIG. 23 An action example of the display device 100 is shown.

[0293] First, the control unit 101 checks whether or not a user operation on the voice assistant call button B5 has been detected (step S501). For example, in a case where the voice assistant VA is selected, the user presses the voice assistant call button B5 in the operation terminal 110 for a short time ( FIG. 2 ). In a case where the voice assistant VB is selected, the user presses the voice assistant call button B5 for a long time ( FIG. 2). The control unit 101 selects the voice assistant VA in a case where the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 ( FIG. 2 ) has been pressed for a short time, and selects the voice assistant VB in a case where the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 ( FIG. 2 ) has been pressed for a long time. If no user operation on the voice assistant call button B5 is detected (NO in step S501), the flow ends.

[0294] Note that, in this example, the operation of selecting the voice assistant VA or VB is performed based on the length of time the voice assistant call button B5 is pressed, but is not limited thereto. For example, the operation of selecting the voice assistant VA or VB can be performed based on the number of times the voice assistant call button B5 is pressed. For example, the control unit 101 can select the voice assistant VA in a case where the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 has been pressed once, and can select the voice assistant VB in a case where the button operation code received via the wireless communication unit 13 indicates that the voice assistant call button B5 has been pressed twice in succession.

[0295] If a user operation on the voice assistant call button B5 is detected in step S501, the control unit 101 transmits a microphone activation code to the operation terminal 110 via the wireless communication unit 13 (step S502).

[0296] Next, it is checked whether the voice assistant VA has been selected (step S503). If the voice assistant VA has been selected (YES in step S503), the control information generator 102 generates the assistant information INF5 including information indicating that the voice assistant VA has been selected (step S504). Further, if the voice assistant VB has been selected (NO in step S503), the control information generator 102 generates the assistant information INF5 including information indicating that the voice assistant VB has been selected (step S505).

[0297] Then, the control unit 101 transmits the control information INF including the assistant information INF5 to the operation terminal 110 via the wireless communication unit 13 (step S506). The flow ends here.

[0298] FIG. 24 An action example of the display system 5 in a case where the voice assistant call button B5 is operated by the user is shown.

[0299] When the user operates the voice assistant call button B5 of the operation terminal 110, the control unit 117 of the operation terminal 110 detects the operation and changes the action state of the operation terminal 110 from the sleep state to the normal action state (step S521). Then, the control unit 117 transmits a button operation code corresponding to the operation of the voice assistant call button B5 via the wireless communication unit 35 (step S522). The control unit 101 of the display device 100 receives the button operation code via the wireless communication unit 13.

[0300] Next, the control unit 101 of the display device 100 transmits a microphone activation code to the operation terminal 110 via the wireless communication unit 13 (step S523). The control unit 117 of the operation terminal 110 receives the microphone activation code via the wireless communication unit 35. The control unit 117 activates the microphone 113 on the basis of the microphone activation code. The operation terminal 110 thus accepts voice input.

[0301] The control unit 101 of the display device 100 selects one of the voice assistants VA and VB on the basis of the information on the operation of the voice assistant call button B5 included in the microphone activation code (step S524). The control information generator 102 generates assistant information INF5 on the basis of the selection result of the voice assistant (step S525). Then, the control unit 101 transmits control information INF including the assistant information INF5 to the operation terminal 110 via the wireless communication unit 13 (step S526). The control unit 117 of the operation terminal 110 receives the control information INF via the wireless communication unit 35.

[0302] The light emission controller 118 of the operation terminal 110 generates light emission control information INFBL on the basis of the assistant information INF5 included in the control information INF (step S527).

[0303] For example, in a case where the assistant information INF5 includes information indicating that the voice assistant VA has been selected, the light emission controller 118 generates light emission control information INFBL giving an instruction to cause the light emitting devices in the light emission unit 112 to emit light to highlight the voice assistant call button B5 (for example, in orange) for a period in which the voice assistant VA is accepting voice input. FIG. 2 ).

[0304] Further, for example, in a case where the assistant information INF5 includes information indicating that the voice assistant VB has been selected, the light emission controller 118 generates light emission control information INFBL giving an instruction to cause the light emitting devices in the light emission unit 112 to emit light to highlight the voice assistant call button B5 (for example, in blue) for a period in which the voice assistant VB is accepting voice input. FIG. 2

[0305] ​Next, the light emission controller 118 causes the light emission unit 112 to start emitting light based on the light emission control information INFBL (step S528). Thus, the voice assistant call button B5 in the operation unit 31 of the operation terminal 110 is highlighted by the light emitted from the light emission unit 112. Then, based on the light emission control information INFBL, the light emission controller 118 causes the light emission unit 112 to end the light emission after the period in which the voice assistant accepts the voice input (step S529). This sequence ends here.

[0306] As described above, in the display system 5, the control information generator 102 of the display device 100 generates the control information INF corresponding to the selected voice assistant. The light emission controller 118 of the operation terminal 110 controls the light emission action of the light emission unit 112 based on the control information INF. Thus, the display system 5 enables the user to easily understand the selected voice assistant among the two voice assistants VA and VB and easily understand whether the selected voice assistant is accepting the voice input. Thus, the display system 5 can improve the convenience of the user.

[0307] As described above, in the present embodiment, the control information generator of the display device generates the control information corresponding to the selected voice assistant, and the light emission controller of the operation terminal controls the light emission action of the light emission unit based on the control information. This enables the user to easily understand the selected voice assistant, for example, which makes it possible to improve the convenience of the user. Other effects are similar to those in the case of the first embodiment.

[0308] [Modification Example 5-1]

[0309] In the above-described embodiment, the control information INF includes the assistant information INF5. Not limited to this, for example, the control information INF can include the light emission control information INFBL that gives an instruction of the light emission action of the light emission unit 112, as in the case of the display system 1A according to Modification Example 1-1 of the first embodiment.

[0310] [Modification Example 5-2]

[0311] In the above-described embodiment, the voice assistant to be used among the voice assistants VA and VB is selected by the user operating the voice assistant call button B5, but the present disclosure is not limited to this. Alternatively, for example, the user can select the voice assistant to be used from among the voice assistants VA and VB by uttering the voice assistant call words (call words WA and WB) associated with the voice assistants VA and VB, respectively. The following is a detailed description of the present modification example.

[0312] FIG. 25 A configuration example of a display system 5A according to the present modification example is shown. The display system 5A includes a display device 100A and an operation terminal 110A.

[0313] The display device 100A includes a control unit 101A. The control unit 101 includes two voice assistant processors (voice assistant processors 103A and 103B). The user selects a voice assistant to be used from among the voice assistants VA and VB by issuing a voice assistant call word (call words WA and WB) associated with the voice assistant processors 103A and 103B, respectively, to the microphone 113 of the operation terminal 110A. The control unit 101A of the display device 100A selects one of the voice assistants VA and VB based on an assistant selection code received from the operation terminal 110A via the wireless communication unit 13 and including information on the voice assistant to be used.

[0314] The operation terminal 110A includes a control unit 117A. Unlike the case of the above-described embodiment, the control unit 117A performs control to cause the microphone 113 to always accept voice input. The control unit 117A includes two voice processors (voice processors 119A and 119B). In a case where the voice data acquired by the microphone 113 includes a voice assistant call word (call word WA) associated with the voice assistant VA, the voice processor 119A generates an assistant selection code giving an instruction to select the voice assistant VA. Similarly, in a case where the voice data acquired by the microphone 113 includes a voice assistant call word (call word WB) associated with the voice assistant VB, the voice processor 119B generates an assistant selection code giving an instruction to select the voice assistant VB. The control unit 117A transmits the generated assistant selection code to the display device 100A via the wireless communication unit 35.

[0315] FIG. 26 An action example of the display device 100A is shown.

[0316] First, the control unit 101A checks whether an assistant selection code has been received via the wireless communication unit 13 (step S531). If no assistant selection code has been received (NO in step S531), the flow ends.

[0317] If an assistant selection code has been received in step S531, the control unit 101A checks whether the voice assistant VA has been selected (step S503). If the voice assistant VA has been selected (YES in step S503), the control information generator 102 generates the assistant information INF5 including information indicating that the voice assistant VA has been selected (step S504). Further, if the voice assistant VB has been selected (NO in step S503), the control information generator 102 generates the assistant information INF5 including information indicating that the voice assistant VB has been selected (step S505).

[0318] Then, the control unit 101A transmits the control information INF including the assistant information INF5 to the operation terminal 110A via the wireless communication unit 13 (Step S506). This flow ends here.

[0319] [Modified Example 5-3]

[0320] In the above-described embodiment, the microphone 113 is provided in the operation terminal 110, but is not limited thereto. Alternatively, for example, a microphone can be provided in a display device, like FIG. 27 the display system 5B shown. The display system 5B includes a display device 100B and an operation terminal 110B. The display device 100B includes a microphone 108B and a control unit 101B. The operation terminal 110B includes a control unit 117B. In this example, the control unit 101B of the display device 100B generates voice data based on an electric signal provided from the microphone 108B of the display device 100B. The control information generator 102 of the display device 100B generates the assistant information INF5 including information indicating that the voice assistant VA has been selected in a case where the voice assistant VA has been selected, and generates the assistant information INF5 including information indicating that the voice assistant VB has been selected in a case where the voice assistant VB has been selected. The control unit 101B transmits the control information INF including the assistant information INF5 to the operation terminal 110B via the wireless communication unit 13.

[0321] [Modified Example 5-4]

[0322] In the above-described embodiment, two voice assistant processors are provided in the display device 100B, but the present disclosure is not limited thereto. One voice assistant processor can be provided in a display device, and one voice assistant processor can be provided in an external device coupled to the display device. For example, the external device is a smart speaker. The display device and the external device are coupled to each other by, for example, wireless LAN. In this example, the smart speaker generates voice data based on a user’s voice, and transmits the voice data to a server coupled to the Internet NET and associated with the smart speaker. The server analyzes the voice data. In a case where an instruction of the user included in the voice data is an instruction to operate the display device, the server transmits information on the operation instruction to the display device. In a case where the instruction to operate the display device is received from the server, the voice assistant processor of the display device generates the assistant information INF5 including information indicating that the voice assistant of the display device has been selected. Then, the control unit of the display device transmits the control information INF including the assistant information INF5 to the operation terminal 110B via the wireless communication unit 13.

[0323] [Modified Example 5-5]

[0324] In the above-described embodiments, the voice assistant call button B5( FIG. 2 ) is highlighted according to the light emitted by the light emitting unit 112 in accordance with the selected voice assistant, but the present disclosure is not limited thereto. Alternatively, for example, all the buttons B in the operation terminal 110B can be highlighted according to the light emitted by the light emitting unit 112 in accordance with the selected voice assistant.

[0325] [Modified Example 5-6]

[0326] In the above-described embodiments, the action is performed in accordance with the selected voice assistant, but the present disclosure is not limited thereto. For example, in accordance with the user's instruction included in the voice data, a button B related to the instruction can be highlighted according to the light emitted by the light emitting unit 112. For example, in a case where the voice data is an instruction to view content of a service S1, a button B corresponding to the service S1 in the moving image service selection button B2 can be highlighted according to the light emitted by the light emitting unit 112.

[0327] <6. Sixth Embodiment>

[0328] Next, a description will be given regarding a display system 6 according to a sixth embodiment. The display system 6 according to the present embodiment is configured to control the light emission action of the light emitting unit of the operation terminal in accordance with the coupled external device in a case where an external device such as a set-top box is coupled to the display device. Note that components substantially the same as the display system 1 according to the first embodiment are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0329] FIG. 28 A configuration example of the display system 6 is shown. The display system 6 includes a display device 120 and an operation terminal 130.

[0330] The display device 120 includes a control unit 121. The control unit 121 includes an external device detector 123, a switching controller 124, and a control information generator 122. In this example, a set-top box 203 is coupled to the external device interface 14 of the display device 120.

[0331] The external device detector 123 is configured to detect that the external device is coupled in a case where an external device (in this example, the set-top box 203) is coupled to the external device interface 14, and acquire information regarding what type of device the external device is by communicating with the external device via the external device interface 14. The type of the external device includes, for example, a set-top box, a recording and playback device, and a playback device.

[0332] The switch controller 124 is configured to set a video source to be displayed based on information about operation of the input selection button B7 included in the infrared signal, and set a target to be controlled by the operation terminal 130 in accordance with the set source. Specifically, for example, a case where a set-top box 203 coupled to the external device interface 14 is set as a video source to be displayed is assumed. In this case, when the user operates, for example, the number button B3, the cursor button B8, the determination button B9, the channel button B11, the moving image content operation button B16, and the recording list button B17, the switch controller 124 changes the control target to the set-top box 203 based on these user operations, for example. Thus, in the display system 6, for example, in a case where the display device 120 displays a video based on a video signal selected by the tuner 11, the user can remotely operate the display device 120 by operating the operation unit 31 of the operation terminal 130. In a case where the display device 120 displays a video based on a video signal supplied from the set-top box 203, the user can remotely operate the set-top box 203 by operating the operation unit 31 of the operation terminal 130.

[0333] The control information generator 122 is configured to generate control information INF for controlling a light emission action of the light emission unit 112 in the operation terminal 130 in accordance with an external device in a case where the external device coupled to the external device interface 14 is selected as a video source to be displayed by the user who operates the input selection button B7, for example. Then, the control unit 121 transmits the control information INF generated by the control information generator 122 to the operation terminal 130 via the wireless communication unit 13.

[0334] The operation terminal 130 includes a control unit 137. The control unit 137 includes a light emission controller 138. The light emission controller 138 is configured to control a light emission action of the light emission unit 112 based on the control information INF transmitted from the display device 120.

[0335] Here, the display device 120 corresponds to a specific example of the “information processing device” according to the present disclosure. The control information generator 122 corresponds to a specific example of the “generator” according to the present disclosure. The external device interface 14 corresponds to a specific example of the “connection unit” according to the present disclosure. The set-top box 203 corresponds to a specific example of the “external device” according to the present disclosure. The external device detector 123 corresponds to a specific example of the “acquisition unit” according to the present disclosure.

[0336] FIG. 29 An action example of the display device 120 is shown. In this example, the set-top box 203 has been coupled to the external device interface 14, and the external device detector 123 has detected that the set-top box 203 is coupled.

[0337] First, the control unit 121 checks whether or not, for example, an operation of input switching to an external device has been detected (step S601). Specifically, for example, in a case where an infrared signal received by the infrared receiver 12 indicates an operation input selection button B7, the control unit 121 checks whether or not the external device is selected as a video source to be displayed after the input switching.

[0338] If the operation of input switching to the external device has been detected in step S601 (YES in step S601), the switching controller 124 sets the external device as a video source (step S602), and sets the external device as a target to be controlled by the operation terminal 130 (step S603).

[0339] Next, the control information generator 122 generates external device information INF6 corresponding to the coupled external device based on the detection result of the external device detector 123 (step S604). Specifically, for example, in a case where a set-top box is coupled as an external device, the control information generator 122 generates external device information INF6 including information indicating that the set-top box is coupled.

[0340] Then, the control unit 121 transmits control information INF including the external device information INF6 to the operation terminal 130 via the wireless communication unit 13 (step S605). Then, the flow ends.

[0341] Further, if the input switching operation to the display device 120 has not been detected in step S601 (NO in step S601), the switching controller 124 sets the display device 120 as a video source (step S606), and sets the display device 120 as a target to be controlled by the operation terminal 130 (step S607). The flow ends here.

[0342] FIG. 30 An action example of the display system 6 in a case where the set-top box 203 is coupled to the display device 120 and input switching to the set-top box 203 is performed is shown.

[0343] When the user operates the input selection button B7 of the operation terminal 130, the control unit 137 of the operation terminal 130 detects the operation, and the control unit 137 changes the action state of the operation terminal 130 from the sleep state to the normal action state (step S621). Then, the infrared transmitter 34 emits an infrared signal corresponding to the operation of the input selection button B7 (step S622). The infrared receiver 12 of the display device 120 receives the infrared signal.

[0344] Based on the information including the operation of the input selection button B7 in the infrared signal, the switching controller 124 of the display device 120 sets the set-top box 203 as a video source (step S623), and sets the set-top box 203 as a target to be controlled by the operation terminal 130 (step S624). Then, the control information generator 122 generates external device information INF6 including information indicating the coupling of the set-top box based on the detection result of the external device detector 123 (step S625). The control unit 121 transmits the control information INF including the external device information INF6 to the operation terminal 130 via the wireless communication unit 13 (step S626). The control unit 137 of the operation terminal 130 receives this control information INF via the wireless communication unit 35.

[0345] The light emission controller 138 of the operation terminal 130 generates light emission control information INFBL based on the external device information INF6 included in the control information INF (step S627). In this example, because the external device information INF6 includes information indicating the coupling of the set-top box, the light emission controller 138 generates the light emission control information INFBL giving an instruction to cause the light emission means in the light emission unit 112 corresponding to the buttons B for viewing the content provided from the set-top box 203 to emit light for a predetermined period of time. Specifically, the light emission controller 138, for example, generates the light emission control information INFBL giving an instruction to cause the light emission means corresponding to the numeric buttons B3, the cursor button B8, the determination button B9, the return button B10, the channel button B11, the volume button B12, the moving image content operation button B16, and the recording list button B17 to emit light for a predetermined period of time.

[0346] Next, the light emission controller 138 causes the light emission unit 112 to start emitting light based on the light emission control information INFBL (step S628). Thus, the buttons B for viewing the content provided from the set-top box 203 in the operation unit 31 of the operation terminal 130 are highlighted by the light emitted from the light emission unit 112. Then, the light emission controller 138 causes the light emission unit 112 to end emitting light after the elapse of the predetermined period of time based on the light emission control information INFBL (step S629). This sequence ends here.

[0347] As described above, in the display system 6, the control information generator 122 of the display device 120 generates the control information INF corresponding to the coupled external device. The light emission controller 138 of the operation terminal 130 controls the light emission action of the light emission unit 112 based on the control information INF. Thus, the display system 6 enables the user to easily understand the buttons B available when viewing the content provided from the coupled external device. Therefore, the display system 6 is able to improve the convenience of the user.

[0348] As described above, in the present embodiment, the control information generator of the display device generates control information corresponding to the coupled external device, and the light emission controller of the operation terminal controls the light emission action of the light emission unit based on the control information. This enables the user to easily understand the available button B, for example, which makes it possible to improve the convenience of the user. Other effects are similar to those in the case of the first embodiment.

[0349] [Modified Example 6-1]

[0350] In the above-described embodiment, the control information INF includes the external device information INF6. Not limited thereto, for example, the control information INF can include light emission control information INFBL that gives an instruction of the light emission action of the light emission unit 112, as in the case of the display system 1A according to Modified Example 1-1 of the first embodiment.

[0351] Although the present technology has been described with reference to some embodiments and modified examples, the present technology is not limited to these embodiments and the like, and various modifications can be made.

[0352] For example, in the above-described embodiment, the infrared transmitter 34 is provided in the operation terminal, the infrared receiver 12 is provided in the display device, and the action of the display device is controlled by the operation terminal that transmits an infrared signal to the display device, but not limited thereto. Alternatively, the infrared transmitter 34 and the infrared receiver 12 can be omitted, and the operation terminal can control the action of the display device by using communication between the wireless communication unit 35 of the operation terminal and the wireless communication unit 13 of the display device.

[0353] For example, the present technology is applied to the display device in the above-described embodiment, but not limited thereto. For example, the present technology can be applied to various home electronic devices such as a hard disk recorder, a Blu-ray disc player, a Blu-ray disc recorder, a set-top box, a smart speaker, or a game console. Specifically, in the case where the present technology is applied to the set-top box, the operation terminal can be a remote control terminal that controls the action of the set-top box by remote control based on the user's operation. The display device (for example, a television receiver) is coupled to the set-top box. In addition, in the case where the present technology is applied to the game console, the operation terminal can be a controller of the game console.

[0354] For example, in the above-described embodiment, the light emission device corresponding to the button B is caused to emit light. Not limited thereto, for example, a light emission device (such as various indicators provided in the operation terminal) that is not associated with the button B can be caused to emit light.

[0355] Further, for example, two or more of the above-described embodiments and modified examples can be combined with each other.

[0356] It should be noted that the effects described in this specification are merely illustrative and not limiting, and other effects can be provided.

[0357] Note that the present technology can be configured as follows. According to the present technology having the following configuration, the convenience of the user can be improved.

[0358] (1) An information processing device comprising:

[0359] a generator configured to generate control information for performing light emission control of a light emitting unit provided in an operation terminal; and

[0360] a transmitter configured to transmit the control information to the operation terminal.

[0361] (2) The information processing device according to (1), wherein the light emission control includes controlling one or more of a light emission start, a light emission end, a light emission luminance, a light emission color, a light emission time, and a light emission period.

[0362] (3) The information processing device according to (1) or (2), further comprising: an environment sensor configured to detect an environment of the information processing device, wherein

[0363] the generator is configured to generate the control information based on a detection result of the environment sensor.

[0364] (4) The information processing device according to (3), wherein the environment sensor includes a sensor configured to detect a brightness of the environment.

[0365] (5) The information processing device according to (4), wherein the light emitting unit is configured to emit light in a case where the brightness is darker than a predetermined brightness based on the control information.

[0366] (6) The information processing device according to (4), wherein the light emitting unit is configured to emit light at a first luminance in a case where the brightness is a first brightness based on the control information, and emit light at a second luminance brighter than the first luminance in a case where the brightness is a second brightness darker than the first brightness.

[0367] (7) The information processing device according to any one of (3) to (6), wherein the control information includes the detection result of the environment sensor.

[0368] (8) The information processing device according to (1) or (2), wherein the generator is configured to generate the control information based on content that is a processing target of the information processing device.

[0369] (9) The information processing device according to (8), further comprising: a content analyzer, wherein

[0370] the content includes metadata,

[0371] the content analyzer is configured to analyze the metadata, and

[0372] The generator is configured to generate the control information based on a result of the analysis by the content analyzer.

[0373] (10) The information processing device according to (8), wherein

[0374] The content includes image information, and

[0375] The generator is configured to generate the control information based on a result of the analysis of the image information.

[0376] (11) The information processing device according to (1) or (2), wherein the generator is configured to generate the control information based on notification information to the user.

[0377] (12) The information processing device according to (11), further comprising a notification processor configured to generate the notification information, wherein

[0378] The control information includes information that causes the light emitting unit to emit light to correspond to a button associated with the notification information presented to the user among a plurality of buttons included in the operation terminal.

[0379] (13) The information processing device according to (1) or (2), further comprising a voice processor configured to process voice information accepted from the user, wherein

[0380] The generator is configured to generate the control information based on a processing by the voice processor.

[0381] (14) The information processing device according to (13), wherein

[0382] The voice processor includes a plurality of processors and is configured to select one processor among the plurality of processors in response to an operation by the user, and

[0383] The control information includes information corresponding to the processor selected from the plurality of processors.

[0384] (15) The information processing device according to (1) or (2), further comprising

[0385] a connection unit that is couplable to an external device; and

[0386] an acquisition unit that acquires information related to a function of the external device, wherein

[0387] The generator is configured to generate the control information based on the information related to the function of the external device.

[0388] (16) The information processing device according to (15), wherein the control information includes information that causes the light emitting unit to emit light to correspond to a button associated with an operation on the external device among a plurality of buttons included in the operation terminal.

[0389] (17) An operation terminal, comprising:

[0390] an operation unit configured to accept an operation of a user;

[0391] a light emitting unit configured to emit light from an operation surface of the operation unit;

[0392] a receiver configured to receive control information transmitted from an information processing apparatus; and

[0393] a controller configured to perform light emission control of the light emitting unit based on the control information.

[0394] (18) The operation terminal according to (17), wherein the control information includes information corresponding to a detection result of an environmental sensor provided in the information processing apparatus and configured to detect an environment of the information processing apparatus.

[0395] (19) The operation terminal according to (17), wherein the control information includes information corresponding to a processing of a voice processor provided in the information processing apparatus and configured to process voice information.

[0396] (20) An information processing method, comprising:

[0397] generating, by an information processing apparatus, control information for performing light emission control of a light emitting unit provided in an operation terminal;

[0398] transmitting, by the information processing apparatus, the control information to the operation terminal; and

[0399] performing, by the operation terminal, the light emission control of the light emitting unit based on the control information transmitted from the information processing apparatus.

[0400] This application claims the benefit of Japanese Priority Patent Application No. 2019-100957, filed May 30, 2019, and Japanese Priority Patent Application No. 2019-235744, filed December 26, 2019, in the Japan Patent Office, the entire contents of each of which are incorporated herein by reference.

[0401] It should be understood that various modifications, combinations, sub-combinations, and alterations can be made according to design requirements and other factors, as those skilled in the art will appreciate, without departing from the scope of the appended claims or their equivalents.

Claims

1. An information processing device, comprising: The circuit is configured as: generating control information for performing light emission control of light emitted from the operation terminal; as well as sending the control information to the operation terminal; Wherein, the operation terminal controls the action of the information processing device through remote operation based on the user's operation; The lighting control includes controlling one or more of lighting start, lighting end, lighting brightness, lighting color, lighting time, and lighting cycle of one or more buttons included in the operation terminal based on the control information; wherein the circuit is configured to generate the control information based on notification information to the user; The control information causes the emitted light to correspond to the one or more buttons associated with the notification information among a plurality of buttons included in the operation terminal.

2. The information processing device according to claim 1, in, The circuit is further configured to generate the notification information including information indicating that there is software to be updated.

3. The information processing device according to claim 1 or 2, in, The circuit is further configured to generate the notification information including information indicating that an external device is newly coupled.

4. The information processing device according to claim 1 or 2, in, The circuit is further configured to generate the notification information including information indicating the presence of newly recorded content.

5. The information processing device according to claim 1 or 2, in, The circuitry is further configured to generate the notification information including information indicating a suggestion regarding a setting change.

6. The information processing device according to claim 1 or 2, in, The circuit is further configured to generate the notification information including information indicating that content has been newly recorded into a streaming service.

7. The information processing device according to claim 1 or 2, in, The operation terminal includes an entire surface, which is an operation surface configured with a housing accommodating the one or more buttons.

8. The information processing device according to claim 7, in, The operation terminal includes a light emitting unit that emits light to illuminate the one or more buttons.

9. The information processing device according to claim 8, in, The one or more buttons include a translucent material.

10. The information processing device according to claim 1, in, The circuit is further configured to confirm whether the software has been updated.

11. The information processing device according to claim 1 or 2, in, The circuit is further configured to generate the notification information including information indicating a status of a battery of the operation terminal.

12. The information processing device according to claim 1 or 2, in, The circuit is further configured to cause one of the one or more buttons to flash when the battery charge is below a predetermined value.

13. The information processing device according to claim 12, in, The circuit is further configured such that when the battery charge is below the predetermined value, the one of the one or more buttons flashes to emit light of one color.

14. The information processing device according to claim 13, in, The circuit is further configured such that when charging of the battery begins, the one button illuminates in a color different from the one color.

15. The information processing device according to claim 2, in, The circuitry is further configured to confirm whether the software is to be updated.

16. The information processing device according to claim 2, in, The circuit is further configured to confirm whether the software is to be updated based on the software supplied through broadcast waves.

17. An information processing system comprising: Display devices, including: a control unit that generates control information; and a network communication unit that is coupled to the control unit; a remote control terminal that receives the control information from the control unit; and at least one distribution server configured to interact with the network communication unit, wherein the network communication unit relays updated software from the at least one distribution server to the control unit, wherein the control unit generates a notification message indicating the updated software; and The control unit sends the notification message as a part of the control information to the remote control terminal.

18. An information processing device comprising: A control unit generates control information; a network communication unit coupled to the control unit and configured to interact with at least one distribution server; as well as A remote control terminal receives the control information from the control unit, wherein the network communication unit relays updated software from the at least one distribution server to the control unit, wherein the control unit generates a notification message indicating the updated software; and The control unit sends the notification message as a part of the control information to the remote control terminal.

19. An information processing system comprising: Display devices, including: a control unit that generates control information; and a network communication unit that is coupled to the control unit; a remote control terminal that receives the control information from the control unit; and at least one distribution server configured to interact with the network communication unit, wherein the network communication unit relays updated software from the at least one distribution server to the control unit, wherein the control unit generates a notification message indicating the updated software; and The control unit sends the notification message as a part of the control information to the remote control terminal.

20. A server system comprising: at least one content server; as well as at least one server coupled to the Internet, wherein the at least one content server communicates with a network communication unit of a display device including a control unit, the control unit sends the notification message as part of the control information to the remote control terminal, and The at least one server is configured to receive voice data from the remote control terminal, so that the voice assistant processor in the display device performs processing corresponding to the voice data based on information analyzed by the at least one server.

Images