Display device, program, display method

Abstract

To provide a technique that can change conditions for transition to power-saving mode when a wireless connection is set up.SOLUTION: The present invention is a display device 20 that displays video received from a terminal device 40. The display device includes: a first communication unit that receives a first video from the terminal device through a wired connection; a second communication unit that receives a second video from the terminal device through a wireless connection; an output unit that outputs the first video or the second video based on an input setting in which whether either the first video or the second video should be displayed is set; a power supply control unit that causes transition to power-saving mode when a transition condition from an output-enabled mode in which video can be displayed to the power-saving mode is satisfied; and a change unit that changes the transition condition when the input setting is the wireless connection.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a display device, a program, and a display method.

Background Art

[0002] There is known a technology in which a terminal device such as a smartphone or a PC (Personal Computer) performs wireless communication with a display device such as a display or a projector, and video and audio are wirelessly output from the terminal device to the display device. Further, there is also known a technology in which not only video and audio but also a touch signal touched by a user on the display device is transmitted from the display device to the terminal device by wireless communication, and the terminal device is operated from the display device.

[0003] When there is no video input from the terminal device, the display device shifts to the sleep state, and when video is input, the power consumption can be reduced by returning from the sleep state (see, for example, Patent Document 1). Patent Document 1 discloses an operation unit that returns from the sleep state when a connection request for short-range wireless communication is received from a client terminal.

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, there is a problem that the transition conditions when shifting to the power-saving mode are the same for wireless connection and wired connection. For example, when the terminal device and the display device are wired-connected, if the user connects the terminal device and the display device with a video cable, the terminal device can transmit video to the display device, so it is difficult for the display device to shift to the power-saving mode during work. However, in the case of wireless connection, if the user has trouble with the settings for wirelessly connecting the display device to the terminal device, the display device may shift to the power-saving mode during that time. When the display device shifts to the power-saving mode, the terminal device cannot make a wireless connection, but in order to resume the display device, the user needs to manually resume the display device.

[0005] In view of the above problems, the present invention aims to provide a technology that can change the conditions for transitioning to power-saving mode when a wireless connection is set up. [Means for solving the problem]

[0006] In view of the above problems, the present invention provides a display device for displaying video received from a terminal device, comprising: a first communication unit that receives a first video from the terminal device via a wired connection; a second communication unit that receives a second video from the terminal device via a wireless connection; an output unit that outputs either the first video or the second video based on an input setting which specifies whether to display the first video or the second video; a power control unit that switches the device to a power saving mode when the conditions for transitioning from an output-enabled mode capable of displaying video to a power saving mode are met; and a modification unit that changes the transition conditions when the input setting is a wireless connection. [Effects of the Invention]

[0007] The present invention can provide a technology that allows changing the conditions for transitioning to power-saving mode when a wireless connection is established. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram illustrates the general operation of a display system in which multiple display devices output video and audio displayed by a terminal device. [Figure 2] This is a system configuration diagram of an example of a display system. [Figure 3] This is an example block diagram showing the hardware configuration of a display device. [Figure 4] This is a block diagram illustrating an example of the hardware configuration of a terminal device. [Figure 5] This is an example of a functional block diagram that explains the functions of terminal devices and display devices by dividing them into blocks. [Figure 6] This figure shows the power states that a display device can take, and an example of the conditions for transitioning to or returning to power-saving mode. [Figure 7]This is an example flowchart illustrating the process by which a display device transitions from output-enabled mode to power-saving mode and then back to output-enabled mode. [Figure 8] This figure shows an example of an input settings switching dialog box displayed by a display device. [Figure 9] This figure shows an example of the power states that the display device can take when the input setting is wireless, and the conditions for transitioning to or returning to power-saving mode. [Figure 10] This is a flowchart (part 1) illustrating an example of the process by which a display device that suppresses the transition to power-saving mode transitions from output-enabled mode to power-saving mode and then returns from power-saving mode to output-enabled mode. [Figure 11] This figure shows an example of the power states that the display device can take when the input setting is wireless, and the conditions for transitioning to or returning to power-saving mode. [Figure 12] This is a flowchart (part 2) illustrating an example of the process by which a display device that suppresses the transition to power-saving mode transitions from output-enabled mode to power-saving mode, and then returns from power-saving mode to output-enabled mode. [Figure 13] This figure shows an example of the power states that the display device can take when the input setting is wireless, and the conditions for transitioning to or returning to power-saving mode. [Figure 14] This is a flowchart (part 3) illustrating an example of the process by which a display device that suppresses the transition to power-saving mode transitions from output-enabled mode to power-saving mode, and then returns from power-saving mode to output-enabled mode. [Figure 15] This figure shows an example of a mode transition dialog box displayed by a display device. [Figure 16] This is an example flowchart (part 4) illustrating the process by which a display device that suppresses the transition to power-saving mode transitions from output-enabled mode to power-saving mode, and then returns from power-saving mode to output-enabled mode. [Figure 17] This is an example flowchart illustrating the process by which a display device automatically displays video sent by the user, regardless of the input settings.

Mode for Carrying Out the Invention

[0009] Hereinafter, as an example of a mode for carrying out the present invention, a display system and a display method performed by the display system will be described with reference to the drawings.

[0010] <Outline of Processing> FIG. 1 is a diagram for explaining the general operation of a display system 100 in which a plurality of display devices 20 output video and audio displayed by a terminal device 40. The display device 20 has wireless connection means such as Bluetooth (registered trademark, hereinafter omitted) and Wi-Fi (registered trademark, hereinafter omitted). However, the wireless connection means always operates and senses the connection destination to maintain a standby state unless it is in a power-saving mode. When there is no video input for a certain period of time by wired or wireless connection, the display device 20 shifts to the power-saving mode.

[0011] In FIG. 1(a), there are two terminal devices 40 and one display device 20. In FIG. 1(a), the terminal device 40A and the display device 20 are wirelessly connected (without an access point), and the terminal device 40B and the display device 20 are wired-connected.

[0012] In FIG. 1(b), the terminal device 40A and the display device 20 are wirelessly connected (with an access point 8), and the terminal device 40B and the display device 20 are wired-connected. In the present embodiment, the access point 8 may or may not be present.

[0013] When the display device 20 is activated by turning on the power, it is set to display the video from the terminal device 40 in accordance with the wired or wireless connection input setting set when the power was turned off.

[0014] When the input setting is a wired connection, when the terminal device 40B inputs video to the display device 20 through a video cable, the video of the terminal device 40B is displayed on the display panel 102 of the display device 20. When the input setting is a wireless connection, when the terminal device 40A inputs video to the display device 20 by wireless communication, the video of the terminal device 40A is displayed on the display panel 102 of the display device 20.

[0015] In the comparative technology compared with the present embodiment, regardless of whether the input setting is a wired connection or a wireless connection, when a certain period of time has elapsed since the video input is stopped, the display device 20 shifts to the power saving mode.

[0016] In addition, if the terminal devices 40A and 40B are wired-connected to the display device 20, the display device 20 displays both of the terminal devices 40A and 40B (screen splitting), or one of them (user selection, automatic selection).

[0017] And when the display device 20 of the present embodiment sets the input setting of the video to be displayed on the display panel 102 to a wireless connection, it does not shift to the power saving mode even after a certain period of time has elapsed since the video input is stopped, or the time until it shifts is longer than that in the case of a wired connection. However, when the remaining battery level becomes low, the display device 20 shifts to the power saving mode as usual.

[0018] By performing the above power control, the display device 20 can achieve both power saving and smooth wireless connection. For example, even if the user has trouble with the wireless connection setting of the terminal device 40, the display device 20 does not automatically shift to the power saving mode, so it is possible to prevent the display device 20 from entering the power saving mode and becoming unable to make a wireless connection while having trouble with the wireless connection setting.

[0019] <Regarding terms> The input setting determines whether the display device 20 outputs video and audio received wirelessly or via a wired connection. This setting can be configured by the user, or it may switch automatically. When the input setting is wired, the display device 20 discards or does not receive video and audio received via the wireless connection. When the input setting is wireless, the display device 20 discards or does not receive video and audio received via the wired connection.

[0020] A wired connection means that the system is configured to output video or audio received via a wired cable. It is not necessary for the system to actually be communicating via a wired connection. A wireless connection means that the system is configured to output video or audio received wirelessly. It is not necessary for the system to actually be communicating wirelessly. On the other hand, in the case of a wired connection, it may be possible to actually receive video or audio via a wired connection, and in the case of a wireless connection, it may be possible to actually receive video or audio wirelessly.

[0021] Transition conditions are the conditions required to transition from output-enabled mode to power-saving mode. Recovery conditions are the conditions required to return from power-saving mode to output-enabled mode. Changing the transition conditions means making it at least more difficult to transition from output-enabled mode to power-saving mode.

[0022] <Regarding usage scenarios> One possible use case for the display system 100 is in a cram school, where the teacher uses the terminal device 40 and the students use the display device 20. The teacher can conduct the lecture while sharing the screen data of the terminal device 40 with the students. Students can input their answers to assignments and questions into the display device 20 and share them with the teacher. In addition, handwritten data entered by one student into the display device 20 can be shared between the terminal device 40 and the display devices 20 of other students.

[0023] In addition, various usage scenarios are conceivable, such as meetings, product briefings, or presentations, where the presenter uses the terminal device 40 to share screen data with participants.

[0024] The display device 20 is a thin, portable display device with a built-in battery. Therefore, the display device 20 can be carried together with the terminal device 40 and connected to the terminal device 40 when in use, allowing it to be used as an extended display for the terminal device 40.

[0025] For example, the display device 20 can be used by sales representatives as an extended display for presentations at client sites. Alternatively, the display device 20 can be used as a dual display for office work in conjunction with a terminal device 40 such as a PC. Furthermore, the display device 20 can be connected to a smartphone used by an individual outside the office, allowing it to be used as an extended display for watching videos or for working from home.

[0026] <Example System Configuration> Referring to Figure 2, an example of the system configuration of the display system 100 will be explained. Figure 2 shows the system configuration diagram of the display system 100. The terminal device 40 and the display device 20 can communicate wirelessly. The wireless communication method can be, for example, Wi-Fi Direct or Bluetooth, but there are no particular restrictions on the communication method. Also, the communication method does not have to be one-to-one communication (P2P), but may be communication via the access point 8 (Wi-Fi router). Alternatively, the terminal device 40 and the display device 20 may communicate via the same server device. In this case, the terminal device 40 and the display device 20 are associated with the server device, and the server device transmits video and audio from the terminal device 40 to the display device 20 and transmits touch signals from the display device 20 to the terminal device 40.

[0027] Furthermore, Miracast, Google Cast, and Airplay (all registered trademarks; the names of registered trademarks are omitted hereafter) are known communication standards that enable wireless communication between the terminal device 40 and the display device 20. The terminal device 40 and the display device 20 can communicate using these communication standards or improved communication methods. For example, Miracast is a display transmission technology developed by the Wi-Fi Alliance that uses one-to-one wireless communication. Miracast uses streaming technology to send images, audio, and video from a host to another wirelessly paired device. Miracast is a technology that makes display displays, which are normally connected by a dedicated cable, wireless, and is sometimes called wireless HDMI because it wirelessly implements the functions that HDMI (High Definition Multimedia Interface; registered trademark; omitted hereafter) provides.

[0028] Furthermore, the connection between the terminal device 40 and the display device 20 may be made via a wired video output interface such as HDMI, DisplayPort®, or Thunderbolt®. Regardless of the connection method, the terminal device 40 can transmit at least one of video or audio to the display device 20, and the display device 20 can transmit touch signals, etc., to the terminal device 40. Therefore, communication between the terminal device 40 and the display device 20 is bidirectional. However, transmission from the display device 20 to the terminal device 40 may have a narrow bandwidth or may not be required.

[0029] The terminal device 40 is, for example, a PC 40a (desktop PC, notebook PC, etc.), a smartphone 40b, or a tablet device used by the user. The terminal device 40 only needs to be able to run applications that support wireless communication and applications that play videos. The terminal device 40 is mainly portable by the user, but it may also be a stationary type. The terminal device 40 can have a general-purpose configuration, and no special hardware or installation of applications specific to this embodiment is required. However, if a dedicated application is installed on the display device 20 of this embodiment, user convenience will be further improved.

[0030] Furthermore, a device that transmits content (source) to be output, such as the terminal device 40, is called a source device. A source device does not refer to a specific device, but rather to the source of the content transmission. Similarly, a device that receives content to be output, such as the display device 20, is called a sink device. A sink device does not refer to a specific device, but rather to the destination of the content transmission. Therefore, the terminal device 40 can be a sink device, and the display device 20 can be a source device.

[0031] The display device 20 is, for example, a display 20a such as an LCD or OLED, a PC 20b (integrated display type), a television receiver 20c, a set-top box 20d, a projector 20e, or a wireless communication device 20f. The display device 20 only needs to have wireless communication functionality, but may also have display means. The display 20a, PC 20b, television receiver 20c, and projector 20e have display means, while the set-top box 20d and wireless communication device 20f do not.

[0032] The display device 20 (excluding the wireless communication device 20f) may have a built-in wireless communication function or an external wireless communication function. Since the wireless communication device 20f is the wireless communication function itself, it may be externally attached to the display device 20 excluding the wireless communication device 20f. For example, by connecting the wireless communication device 20f to the USB I / F of a display 20a, PC 20b, television receiver 20c, set-top box 20d, or projector 20e that does not have a built-in wireless communication function, these devices can communicate wirelessly with the terminal device 40. The state in which the wireless communication device 20f is connected to a display 20a, PC 20b, television receiver 20c, set-top box 20d, or projector 20e is sometimes referred to as a wireless video display system.

[0033] Examples of set-top boxes 20d include cable television receivers and satellite broadcasting receivers. Examples of wireless communication devices 20f include devices compatible with Miracast, Google Cast, and Airplay, as well as stick-type PCs.

[0034] The display device 20 may have a wireless communication application or function pre-installed, or it may be possible to install such an application. Some or all of the function may be implemented by hardware circuitry.

[0035] Furthermore, it is preferable that the display device 20 has a touch panel. The display device 20 wirelessly transmits touch signals from the user's touch to the terminal device 40, enabling the user to operate the terminal device 40 on the display device 20.

[0036] <Example Hardware Configuration> Referring to Figures 3 and 4, the hardware configuration of the display device 20 and the terminal device 40 will be described.

[0037] <<Display device>> Figure 3 is a block diagram showing the hardware configuration of a display device 20 according to one embodiment. The display device 20 shown in Figure 3 has a display panel 102 on the front of a housing (not shown), and is a device that can receive a video signal from a terminal device 40 via wireless communication or a video cable 110, and display an image corresponding to the video signal on the display panel 102.

[0038] As shown in Figure 3, the display device 20 includes a control unit 101, a display panel 102, a communication interface 103, hard keys 104, a speaker 109, a USB interface 105, an HDMI interface 111, a power supply unit 107, and a battery 108.

[0039] The control unit 101 controls the overall operation of the display device 20. For example, the control unit 101 is implemented by a control circuit such as an IC (Integrated Circuit) equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc.

[0040] The display panel 102 displays various images (videos, still images, etc.) corresponding to the video signal supplied from the control unit 101. For example, a liquid crystal panel or an organic EL (Electro-Luminescence) panel can be used as the display panel 102. A touch sensor 102a is provided on the front of the display panel 102, superimposed on the display panel 102. The speaker 109 outputs various sounds corresponding to the audio signal supplied from the control unit 101.

[0041] Communication I / F 103 is an interface that controls the wireless connection (including wireless communication) with the terminal device 40. Communication I / F 103 communicates wirelessly with the terminal device 40 (e.g., a laptop computer, smartphone, etc.) and transmits and receives control signals, video signals, etc. (wireless communication) with the terminal device 40. Wireless communication standards used by Communication I / F 103 include, for example, Wi-Fi.

[0042] The hard keys 104 are an interface that accepts user input when operated by the user. For example, the display device 20 has multiple buttons as hard keys 104, which are located on the side or front of the casing. These buttons are, for example, a power button, a select button, a confirm button, a back button, etc. However, the display device 20 is not limited to these, and may also have a screen mute key as a hard key 104, for example, a screen mute icon that disables screen operation. For example, the display device 20 can be turned on and off, and various settings such as brightness and contrast can be adjusted by operating the hard keys 104 through user operation.

[0043] The USB I / F 105 is an interface for connecting terminal devices 40. The USB I / F 105 has a USB port 105A that conforms to the USB standard, and a USB cable such as a video cable 110 is connected to this USB port 105A. In this way, the USB I / F 105 is connected to the terminal device 40 via the USB cable. For example, when a terminal (e.g., a laptop computer, smartphone, etc.) is connected as terminal device 40, the USB I / F 105 can transmit and receive control signals, video signals, power, etc. between the terminal and the USB I / F 105. Also, for example, when an external power supply is connected as terminal device 40, the USB I / F 105 can receive power supplied from the external power supply.

[0044] The display device 20 often has multiple USB I / F 105 ports, and each of these can be connected to a terminal device 40. In Figure 3, for illustrative purposes, there is only one USB I / F 105 port, but the display device 20 may have two or more USB I / F 105 ports.

[0045] The HDMI I / F 111 is an interface for connecting the terminal device 40. The HDMI I / F 105 has an HDMI port 111A that conforms to the HDMI standard, and an HDMI cable such as a video cable 110 is connected to this HDMI port 111A. In this way, the HDMI I / F 111 is connected to the terminal device 40 via the HDMI cable. For example, when a terminal (e.g., a laptop computer, smartphone, etc.) is connected as the terminal device 40, the HDMI I / F 111 can transmit and receive control signals, video signals, power, etc. between the terminal and the HDMI I / F 111.

[0046] The power supply unit 107 controls the supply of power for driving each part of the display device 20. For example, if power is not supplied from the terminal device 40 (external power supply, terminal, etc.), or if the power supplied from the terminal device 40 (external power supply, terminal, etc.) is insufficient, the power supply unit 107 can supply power stored in the battery 108 to each part of the display device 20. Also, for example, if power is supplied from the terminal device 40 (external power supply, terminal, etc.), the power supply unit 107 can supply the power supplied from the terminal device 40 to each part of the display device 20. Furthermore, for example, the power supply unit 107 can pass through power supplied from one terminal device 40 (external power supply, terminal, etc.) connected to one USB I / F 105 or HDMI I / F 111 and supply it to another terminal device 40 (terminal, etc.) connected to another USB I / F 105 or HDMI I / F 111.

[0047] Battery 108 stores power for driving the display device 20. Various rechargeable secondary batteries (e.g., lithium-ion batteries, lithium polymer batteries, etc.) are used for battery 108. The display device 20 (e.g., power supply unit 107) can charge battery 108 using power supplied from a terminal device 40 (external power supply, terminal, etc.) connected to a USB I / F 105 or HDMI I / F 111.

[0048] <<Terminal device>> Figure 4 is a block diagram showing an example of the hardware configuration of a terminal device 40. In Figure 4, a smartphone is used as an example of the terminal device 40. As shown in Figure 4, the terminal device 40 includes a CPU 401, ROM 402, RAM 403, EEPROM 404, CMOS sensor 405, image sensor I / F 406, acceleration / direction sensor 407, media I / F 409, and GPS receiver 411.

[0049] Of these, the CPU 401 controls the operation of the entire terminal device 40. The ROM 402 stores programs used to drive the CPU 401, such as the CPU 401 and the IPL. The RAM 403 is used as the work area for the CPU 401.

[0050] The EEPROM 404 reads or writes various data, such as programs for the terminal device 40, according to the control of the CPU 401.

[0051] The CMOS (Complementary Metal Oxide Semiconductor) sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) and obtains image data according to the control of the CPU 401. The CMOS sensor may also be replaced with other imaging means such as a CCD (Charge Coupled Device) sensor.

[0052] The image sensor interface 406 is a circuit that controls the drive of the CMOS sensor 405. The acceleration and orientation sensor 407 is a variety of sensors, such as an electronic magnetic compass, gyrocompass, and acceleration sensor that detect the Earth's magnetic field.

[0053] The media interface 409 controls the reading or writing (storage) of data to or from the recording medium 408, such as flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0054] Furthermore, the terminal device 40 includes a long-range communication circuit 412, a CMOS sensor 413, an image sensor interface 414, a microphone 415, a speaker 416, an audio input / output interface 417, a display 418, an external device connection interface 419, a short-range communication circuit 420, an antenna 420a for the short-range communication circuit 420, and a touch panel 421.

[0055] Of these, the long-distance communication circuit 412 is a circuit that communicates with other devices via a wired or wireless network. The long-distance communication circuit 412 is capable of wireless communication such as Wi-Fi. The CMOS sensor 413 is a type of built-in imaging means that captures an image of a subject and obtains image data according to the control of the CPU 401.

[0056] The image sensor interface 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into electrical signals.

[0057] Speaker 416 is a built-in circuit that converts electrical signals into physical vibrations to produce sound such as music and speech. The sound input / output interface 417 is a circuit that processes the input and output of sound signals between the microphone 415 and speaker 416 according to the control of the CPU 401.

[0058] Display 418 is a type of display means, such as liquid crystal or organic EL (electroluminescence), that displays images of the subject and various icons. External device connection I / F 419 is an interface for connecting various external devices.

[0059] The short-range communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth. The touch panel 421 is a type of input means that allows the user to operate the terminal device 40 by pressing the display 418.

[0060] Furthermore, the terminal device 40 is equipped with a bus line 410. The bus line 410 is an address bus, data bus, etc., for electrically connecting each component, such as the CPU 401 shown in Figure 4.

[0061] <About the features> Next, the functions of the terminal device 40 and the display device 20 will be explained with reference to Figure 5. Figure 5 is a functional block diagram that explains the functions of the terminal device 40 and the display device 20 by dividing them into blocks.

[0062] <<Terminal device>> The terminal device 40 includes a playback unit 41, a display control unit 42, an operation reception unit 43, a wired communication unit 44, a wireless communication unit 45, and a screen data acquisition unit 46. Each of these functional units of the terminal device 40 is a function or means realized by the CPU 401 shown in Figure 4 executing instructions contained in one or more programs installed in the terminal device 40. This program is, for example, a playback application 301 and a mirroring application 302. The playback application 301 is an application that plays various content, but since the terminal device 40 can transmit the screen itself displayed on the display 418, the playback application 301 is not necessary. The mirroring application 302 is an application that acquires (captures) the screen displayed on the display 418 and transmits it to the display device 20. There is no problem if the playback application 301 and the mirroring application 302 are integrated.

[0063] The playback unit 41 decodes and decompresses video, which is in a data format specific to video, and reconstructs it into frames (images for one screen). The playback unit 41 can also change the resolution of the image to match the resolution of the display panel, or interpolate frames.

[0064] The display control unit 42 displays the frames generated by the playback unit 41 on the display panel 102. The frame rate is, for example, 30fps to 120fps.

[0065] The operation reception unit 43 receives user operations on the playback application 301. For example, the operation reception unit 43 receives operations related to video playback, such as starting, stopping, rewinding by a certain number of seconds, fast-forwarding by a certain number of seconds, adjusting the volume, or adjusting the brightness. The operation reception unit 43 also receives similar operations via touch signals received from the display device 20 by the wired communication unit 44 or the wireless communication unit 45. In addition, the operation reception unit 43 receives wireless connection setting operations performed by the user on the terminal device 40.

[0066] The screen data acquisition unit 46 captures (acquires) the entire screen or a portion of the screen (content portion of a playback application, an arbitrary application, or a user-selected area) displayed on the display 418 as screen data at a predetermined speed (number of times per second).

[0067] The wired communication unit 44 repeatedly transmits the screen data acquired by the screen data acquisition unit 46 to each of the multiple display devices 20 using a video cable such as an HDMI cable, USB cable, or DisplayPort cable (registered trademark).

[0068] The wireless communication unit 45 repeatedly transmits the screen data acquired by the screen data acquisition unit 46 to each of the multiple display devices 20 using wireless communication such as Wi-Fi or Bluetooth.

[0069] The speed at which the wireless communication unit 45 or the wired communication unit 44 transmits screen data to one display device 20 (the number of screen data points transmitted per second) is called the transmission frame rate.

[0070] <<Display device>> Next, the display device 20 will be described. The functions of the display device 20 are mainly in three layers, from bottom to top: the hardware control unit 30, the OS 27 (Operating System), and the connected application 39. Although there are other applications that run on the OS 27, only the main applications are shown in this embodiment.

[0071] The hardware control unit 30 includes a touch control unit 28, a wireless control unit 29, a wired control unit 31, an image and sound control unit 32, and a power supply control unit 33. Each of these functions of the hardware control unit 30 may be implemented, for example, by a device driver.

[0072] The touch control unit 28 converts the signal input from the touch sensor 102a into coordinates (X,Y coordinates with the upper left corner of the display panel 102 as the origin) and sends them to the OS 27. The touch control unit 28 may further convert the signal input into the touched area or the pressure contained in the signal input and send them to the OS 27.

[0073] The wireless control unit 29 processes the radio waves of the wireless communication received by the communication interface 103, performing filtering, amplification, demodulation, A / D conversion, etc., to convert them into digital signals, decapsulating them according to the communication protocol, and extracting the data. The wireless control unit 29 sends the data to the OS 27. This data consists of video data and audio data from the terminal device 40. The wireless control unit 29 also acquires data from the OS 27, performs data encapsulation, D / A conversion, modulation, and amplification according to the communication protocol, and transmits radio waves of wireless communication from the communication interface 103. An example of this data is a touch signal.

[0074] The wired control unit 31 decodes the compressed video and audio signals received via the wired cable by the USB I / F 105 or HDMI I / F 111. The wired control unit 31 detects horizontal and vertical synchronization signals for the video to generate scan line divisions and sends this display video data to the OS 27. The wired control unit 31 also acquires data from the OS 27 and transmits it to the terminal device 40 via the wired cable through a predetermined pin terminal. An example of this data is a touch signal.

[0075] The image and sound control unit 32 converts the video data acquired from the OS 27 into a format compatible with the display panel 102, such as RGB, and stores it in video memory. The image and sound control unit 32 applies voltage to each cell of the display panel 102 according to the video data acquired from video memory. The image and sound control unit 32 also generates a differential signal using the audio data acquired from the OS 27 and outputs it to the positive and negative terminals of the speaker.

[0076] The power control unit 33 controls the power supply from the battery or from an external power source depending on the shutdown process from the OS 27 or the input status of the power switch or external power supply. If there is sufficient power from the external power source, the power control unit 33 charges the battery. The power control unit 33 also manages the battery level.

[0077] The power control unit 33 performs power control, specifically controlling the transition to power-saving mode and the return from power-saving mode. The power control differs depending on whether the input setting is wireless or wired; details will be described later.

[0078] The connection application 39 includes a first communication unit 21, a second communication unit 22, an operation reception unit 23, an output unit 24, a switching unit 25, and a modification unit 26. Each function of the connection application 39 is a function or means realized by the CPU of the control unit 101 executing the instructions included in the connection application 39.

[0079] The first communication unit 21 receives video data and audio data via the wired control unit 31 and passes them to the output unit 24. The first communication unit 21 also transmits the touch signal received by the operation reception unit 23 to the terminal device 40 via the wired control unit 31.

[0080] The second communication unit 22 sends the SSID (Service Set Identifier) ​​and encryption key to the wireless control unit 29, instructing it to start, maintain, and end wireless communication with the terminal device 40. The second communication unit 22 receives video data and audio data via the wireless control unit 29 and passes them to the output unit 24. The second communication unit 22 also transmits the touch signal received by the operation reception unit 23 to the terminal device 40 via the wireless control unit 29. The second communication unit 22 can communicate directly with the terminal device 40, or it can communicate with the terminal device 40 via the access point 8.

[0081] The operation reception unit 23 receives touch operations on icons and touch operations on video from the terminal device 40. The operation reception unit 23 accepts an icon press if the touch coordinates are within the bounding rectangle of the icon, and accepts an operation to the terminal device 40 (handwriting input, button operation, etc.) if the touch coordinates are not within the bounding rectangle of the icon but within the display range of the video. Touch coordinates within the display range of the video are transmitted to the terminal device 40 as a touch signal, and touch coordinates on icons are accepted as operations on the display device 20.

[0082] When operating the terminal device 40, the first communication unit 21 or the second communication unit 22 transmits a touch signal to the terminal device 40. The touch signal is obtained by converting the touch coordinates on the display device 20 into coordinates in the effective pixel area of ​​the display 418 of the terminal device 40. The converted coordinates are, for example, the ratio of the X coordinate to the width of the image on the display device 20, and the ratio of the Y coordinate to the height.

[0083] The output unit 24 acquires video data and audio data (at least one of them) received by the first communication unit 21 or the second communication unit 22 from the terminal device 40, and controls the output of these by the image and audio control unit 32. The output unit 24 displays the video from the terminal device 40 on the source video display layer and outputs the audio from the speaker 109.

[0084] The switching unit 25 has an input setting 25a. The input setting 25a is set to either "wireless connection" or "wired connection". The switching unit 25 automatically switches the input setting 25a. That is, the input setting 25a can be set manually by the user, or it can be switched automatically in predetermined cases. The switching unit 25 automatically switches the input setting 25a when the system is started up or when video or audio is received. Note that the location of the input setting 25a is not limited to the switching unit 25, but can be anywhere in the display device 20, such as the OS 27, wireless control unit 29, wired control unit 31, etc.

[0085] The output unit 24 outputs video received via wireless connection or video received via wired connection, based on the input setting 25a. If the input setting 25a is a wired connection, the output unit 24 outputs the video and audio received by the first communication unit 21, and if the input setting 25a is a wireless connection, the output unit 24 outputs the video and audio received by the second communication unit 22.

[0086] The modification unit 26 changes the transition conditions for the power control unit 33 to enter power-saving mode when the input setting 25a is a wireless connection. The modification also includes preventing the transition to power-saving mode. Details will be described later.

[0087] <Power Control> Referring to Figure 6, power state transitions and recovery will be described as comparative techniques. Comparative techniques are techniques that are contrasted with the techniques described in this embodiment and are not necessarily prior art. Figure 6 is a diagram showing the power states that the display device 20 can take and the conditions for transitioning to or returning to power saving mode.

[0088] As shown in Figure 6, the display device 20 has two power states: output-enabled mode 220 and power-saving mode 230. Output-enabled mode 220 is a power state in which video or audio can be output regardless of whether it is actually being output. In output-enabled mode 220, the brightness of the display panel 102 is set to normal brightness. Power-saving mode is a power state that consumes less power than output-enabled mode 220, and in this embodiment, it refers to a power state in which wireless connection is not possible. In power-saving mode 230, the brightness of the display panel 102 is set to a brightness lower than normal.

[0089] The display device 20 may have different power states within the power saving mode 230. For example, there may be a power saving mode 230 that reduces the brightness of the display panel 102 and a separate power saving mode that disables wireless connectivity. However, in this embodiment, one of the features is to suppress the transition to the state where wireless connectivity is disabled, so there is only one power saving mode 230.

[0090] In the comparative technology, the conditions for transitioning to power saving mode and the conditions for returning from power saving mode are the same regardless of whether input setting 25a is a wired or wireless connection, and are as follows.

[0091] Conditions for transitioning from output mode 220 to power saving mode 230 If there is no operation and no wired or wireless video input for a certain period of time, It would be ideal if the user could set a specific time period. This period could be, for example, 30 seconds to a few minutes, and should be set in a way that is easy for the user to use and provides power-saving benefits.

[0092] Conditions for returning from power-saving mode 230 to output-enabled mode 220 Wired video input, or user operation These are merely examples, and other conditions may be added to the transition or recovery conditions, or the conditions may be relaxed. The reason why the system recovers with wired video input when input setting 25a is wireless is that in power saving mode 230, the terminal device 40 cannot establish a wireless connection with the display device 20.

[0093] <Operating Procedure> Referring to Figure 7, the transition or return conditions in the comparative technology will be explained. Figure 7 is a flowchart illustrating the process by which the display device 20 transitions from output-enabled mode 220 to power-saving mode 230 and returns from power-saving mode 230 to output-enabled mode 220. The process in Figure 7 starts when the display device 20 is powered on and started up.

[0094] When the device is powered on, the wireless control unit 29 starts operating (S1). The wireless control unit 29 then initiates wireless communication, repeatedly transmitting its own identification information, IP address, MAC address, etc., to notify the device of its presence. This information is transmitted in a format that can be decoded by the mirroring application corresponding to the display device 20, allowing the mirroring application to receive the wireless communication and detect the presence of the display device 20.

[0095] Next, the power control unit 33 checks the input setting 25a set in the switching unit 25 (S2). The input setting 25a at startup automatically stores whether the display device 20 was set to wireless or wired connection when it was powered off.

[0096] If input setting 25a is a wireless connection, the power control unit 33 determines whether the wireless control unit 29 has received a connection request from the terminal device 40 (S3). A connection request means, for example, sending information such as the version of the mirroring application, the encryption method supported by the terminal device 40, the compression method, the frame rate, etc., to the display device 20 and inquiring whether a connection is currently possible.

[0097] The user connects the terminal device 40 to the display device 20 by performing the necessary wireless connection settings on the terminal device 40. The wireless connection settings vary depending on the OS of the terminal device 40 and the mirroring application, but for example, one setting may be to display a list of display devices 20 that indicate the presence of the user's device and select a display device 20 from that list.

[0098] If there is no connection request (No. S3), the power control unit 33 determines whether a certain period of time has elapsed without any operation and no wired or wireless video input (S4). Until a certain period of time has elapsed (No. S4), the process proceeds to step S12.

[0099] If a certain period of time has elapsed (Yes in S4), the power control unit 33 switches to power saving mode (S5).

[0100] Subsequently, the power control unit 33 determines whether the recovery condition has been met (S6). Until the recovery condition is met (No in S6), the process returns to step S5. If the recovery condition is met (Yes in S6), the process returns to step S1.

[0101] If a connection request is made (Yes in S3), the power control unit 33 determines whether the wireless control unit 29 has established a connection with the terminal device 40 (S7). Establishing a connection means, for example, establishing a connection before data transfer, and means that the 3-way handshake at the TCP layer has been successful. If a connection with the terminal device 40 is not established (No in S7), the process proceeds to step S12.

[0102] If a connection with the terminal device 40 is established (Yes in S7), the power control unit 33 determines whether the second communication unit 22 has received video or audio from the terminal device 40 via the wireless control unit 29 (S8). Since video and audio data (IP packets) contain data type information indicating that they are video or audio, the first communication unit 21, for example, can make this determination. If no video or audio is input (No in S8), the process proceeds to step S4.

[0103] If video or audio is input (Yes in S8), the second communication unit 22 passes the video and audio to the output unit 24, the output unit 24 passes the video and audio to the image and audio control unit 32, and the image and audio control unit 32 displays the video (an example of the second video) on the display panel 102 and outputs the audio from the speaker (S9).

[0104] While video or audio is being output, the operation reception unit 23 determines whether or not it has received a request to switch the input setting 25a (S10). As shown in the input setting switching dialog box 200 described later, the user can switch the input setting 25a. If there is no switch in the input setting 25a (No in S10), the process returns to step S8.

[0105] If input setting 25a is switched (Yes in S10), the switching unit 25 switches input setting 25a to wired connection (S11). As a result, if video is input via wired connection, the first communication unit 21 passes the video and audio to the output unit 24, the output unit 24 passes the video and audio to the image and audio control unit 32, the image and audio control unit 32 displays the video on the display panel 102 and outputs the audio from the speaker.

[0106] In step S12, the operation reception unit 23 determines whether or not it has received a request to switch the input setting 25a (S12). This process may be the same as in step S10.

[0107] If input setting 25a is switched (Yes in S12), output unit 24 switches input setting 25a to wired connection (S13). This process can be the same as in step S11.

[0108] Let's return to step S2 for explanation. If input setting 25a is a wired connection, the power control unit 33 determines whether the first communication unit 21 has received video or audio via the wired control unit 31 (S21). For example, in an HDMI cable, the TMDS (Transition Minimized Differential Signaling) pins are the video and audio pins. The wired control unit 31 detects video and audio input by checking whether a signal is input to the TMDS pins, and the first communication unit 21 receives it.

[0109] If there is video or audio input (Yes in S21), the first communication unit 21 passes the video and audio to the output unit 24, the output unit 24 passes the video and audio to the image and audio control unit 32, and the image and audio control unit 32 displays the video (an example of the first video) on the display panel 102 and outputs the audio from the speaker (S22).

[0110] While video or audio is being output, the operation reception unit 23 determines whether or not it has received a request to switch the input setting 25a (S23). This process may be the same as in step S10. If there is no input switch (No. in S23), the process returns to step S21.

[0111] If an input switch occurs (Yes in S23), the switching unit 25 switches the input setting 25a to wireless connection (S24). As a result, if video is input via wireless connection, the second communication unit 22 passes the video and audio to the output unit 24, the output unit 24 passes the video and audio to the image and audio control unit 32, the image and audio control unit 32 displays the video on the display panel 102 and outputs the audio from the speaker. Next, the process returns to step S2.

[0112] If there is no video input (No. in S21), the power control unit 33 determines whether a certain period of time has elapsed without any operation and without wired or wireless video input (S25). Until that period of time has elapsed (No. in S25), the process proceeds to step S28.

[0113] If a certain period of time has elapsed (Yes in S25), the power control unit 33 switches to power saving mode (S26).

[0114] Subsequently, the power control unit 33 determines whether the recovery condition has been met (S27). Until the recovery condition is met (No in S27), the process returns to step S26. If the recovery condition is met (Yes in S27), the process returns to step S1.

[0115] Until a certain period of time has elapsed (No. S25), the operation reception unit 23 determines whether or not it has received a switch for input setting 25a (S28). This process may be the same as in step S10. If there is no input switch (No. S28), the process returns to step S2.

[0116] If an input switch occurs (Yes in S28), the switching unit 25 switches the input setting 25a to wireless connection (S29). This process can be the same as in step S24.

[0117] In this comparative technology, if the result is determined to be "No" in step S3 or S8, the display device 20 will switch to power-saving mode after a certain period of time. There is a possibility that the display device 20 may enter power-saving mode while the user is having trouble setting up the wireless connection, making it impossible to establish a wireless connection.

[0118] <<Input Settings Switching Dialog Box>> Figure 8 shows the input setting switching dialog box 200 displayed by the display device 20. As shown in Figure 8, the terminal device 40 communicates wirelessly with the display device 20. The terminal device 40 displays video on the display 418 and transmits the displayed video to the display device 20. The display device 20 displays the video on the display panel 102, so the user can view the video on a relatively large screen.

[0119] The output unit 24 displays a setting icon 10. To change the input setting 25a, the user presses the setting icon 10 to access the menu for changing the input setting 25a. This displays the input setting switching dialog box 200. The input setting switching dialog box 200 contains a message 201 asking "Do you want to switch the input setting?", a wireless connection button 202, and a wired connection button 203. The wireless connection button 202 and the wired connection button 203 reflect the current input setting 25a and are displayed in a highlighted color. The user can check the current setting and then change the input setting 25a by pressing either the wireless connection button 202 or the wired connection button 203. The input setting 25a set by the user is saved in the switching unit 25 as an example.

[0120] The input settings switching dialog box 200 is automatically dismissed when the user presses the wireless connection button 202 or the wired connection button 203, or when the elapsed time since its display exceeds a threshold.

[0121] Note that input setting 25a may be set using the hard key 104 instead of the soft key as shown in Figure 8.

[0122] <Controlling the transition to power saving mode when the input setting is wireless 1> Next, referring to Figures 9 and 10, the transition and recovery conditions in this embodiment will be explained. Figure 9 shows the power states that the display device 20 can take when the input setting 25a is a wireless connection, and the conditions for transitioning to or returning to power-saving mode. The explanation of Figure 9 will mainly focus on the differences from Figure 6. The transition and recovery conditions for a wired connection may be the same as in Figure 6.

[0123] As shown in Figure 9, when input setting 25a is a wireless connection, the power control unit 33 does not switch to power saving mode 230. In other words, even if there is no operation and no wired or wireless video input, the display device 20 does not switch to power saving mode 230. This prevents the display device 20 from entering power saving mode and losing wireless connection while the user is having trouble setting up the wireless connection. However, it is preferable to switch to power saving mode exceptionally if the battery level of the display device 20 is below a threshold.

[0124] Figure 10 is a flowchart (part 1) illustrating the process by which a display device 20, which has suppressed the transition to power-saving mode 230, transitions from output-enabled mode 220 to power-saving mode 230, and then returns from power-saving mode 230 to output-enabled mode 220. Note that the explanation of Figure 10 may mainly focus on explaining the differences from Figure 7.

[0125] The processing in steps S1, S2, and S3 is the same as in Figure 7, and the processing in steps S31 to S35 is the same as in steps S7 to S11 in Figure 7. However, the following points are different.

[0126] In step S2, the modification unit 26 checks the input setting 25a set in the output unit 24. If the input setting 25a is a wireless connection, the modification unit 26 disables the conditions for transitioning to power saving mode 230 (S2-2). Therefore, as explained in the flowchart in Figure 10 below, the power control unit 33 does not transition to power saving mode 230.

[0127] If the result in step S3 is "No", the process proceeds to step S12, so even if there is no connection request, the system does not switch to power-saving mode 230.

[0128] If the result in step S31 is "No", the process proceeds to step S12, and the system does not switch to power-saving mode 230 even if a connection is not established.

[0129] If the result in step S32 is "No", the process proceeds to step S12, and the system does not switch to power-saving mode 230 even if no video is input via wireless connection.

[0130] - In step S35, when input setting 25a is switched to wired connection, the modification unit 26 resets the conditions for transitioning to power saving mode 230 (S35-2). In this way, when input setting 25a is wired connection, the power control unit 33 can transition to power saving mode 230.

[0131] The control process for the wired connection (S21-S29) is the same as in Figure 7. However, if the input setting 25a is switched to wireless connection in steps S24 and S29, the modification unit 26 may change the transition condition (disable the transition condition) at this time. Even if the transition condition is not changed in steps S24 and S29, it will be changed in step S2-2, so changing the transition condition in steps S24 and S29 is not mandatory.

[0132] According to the transition control shown in Figure 10, the display device 20 does not switch to power-saving mode 230, so even if the user takes a long time to set up the wireless connection, they will not lose the wireless connection.

[0133] <Controlling the transition to power saving mode when the input setting is wireless 2> Next, referring to Figures 11 and 12, the transition conditions or return conditions of this embodiment will be described as the second transition control. Figure 11 shows the power states that the display device 20 can take when the input setting 25a is a wireless connection, and the conditions for transitioning to or returning to power saving mode. The explanation of Figure 11 will mainly describe the differences from Figure 6.

[0134] As shown in Figure 11, when input setting 25a is a wireless connection, the transition conditions are as follows.

[0135] Conditions for transitioning from output mode 220 to power saving mode 230 No operation is performed, and there is no wired or wireless video input for the extended transition time (> a certain period of time). In other words, by extending the fixed time to the extended transition time, the display device 20 becomes less likely to switch to power-saving mode 230. If the fixed time is the transition time when input setting 25a is a wired connection, the extended transition time is longer than the fixed time, for example, two to several times longer. It would be desirable for the user to be able to set the extended transition time on the display device 20. The user can set an appropriate extended transition time considering how long it takes them to set up the wireless connection on the terminal device 40.

[0136] The extended transition time may gradually increase. If the system switches to power-saving mode after a certain period of time, but the user immediately operates the display device 20 to return to power-saving mode, the modification unit 26 will extend the specified time by a predetermined amount each time.

[0137] This prevents the display device 20 from entering power-saving mode and losing wireless connectivity while the user is struggling with the wireless connection settings. It also prevents power from being consumed without the display device 20 entering power-saving mode 230.

[0138] Furthermore, if the battery level of the display device 20 is below a threshold, it is preferable to either revert the extended transition time back to a fixed time, or, exceptionally, transition immediately.

[0139] Figure 12 is a flowchart (part 2) illustrating the process by which the display device 20, which has suppressed the transition to power-saving mode 230, transitions from output-enabled mode 220 to power-saving mode 230, and then returns from power-saving mode 230 to output-enabled mode 220. Note that the explanation of Figure 12 may mainly focus on explaining the differences from Figure 7.

[0140] In Figure 12, the process in step S41 differs from that in step S4 in Figure 7. Except for step S41, the processes in S42 to S48 are the same as steps S5 to S11 in Figure 7.

[0141] In step S2, the modification unit 26 checks the input setting 25a set in the switching unit 25. If the input setting 25a is a wireless connection, the modification unit 26 changes the transition time to an extended transition time (> constant time), which is one of the conditions for transitioning to power saving mode 230 (S2-3). Therefore, as explained in the flowchart in Figure 12 below, the time until the power control unit 33 determines that the transition condition has been met becomes longer.

[0142] In step S41, the power control unit 33 determines whether the extended transition time has elapsed since the state of no operation and no wired or wireless video input (S41). If the extended transition time has elapsed (Yes in S41), the power control unit 33 switches to power saving mode (S42).

[0143] - In step S48, when input setting 25a is switched to wired connection, the modification unit 26 returns the conditions for transitioning to power saving mode 230 to their original state (S48-2). That is, the modification unit 26 returns the extended transition time to a fixed time. In this way, when input setting 25a is wired connection, the power control unit 33 can transition to power saving mode 230 when there is no operation and no wired or wireless video input for a certain period of time.

[0144] Since the transition time after extension is longer than a certain period, the display device 20 is less likely to switch to power-saving mode 230. Even if the user takes a long time to set up the wireless connection, there is less chance of losing the wireless connection. In addition, it is possible to suppress power consumption by the display device 20 without it switching to power-saving mode 230.

[0145] <Controlling the transition to power saving mode when the input setting is wireless 3> Next, referring to Figures 13 and 14, the transition conditions or return conditions in this embodiment will be described as the third transition control. Figure 13 shows the power states that the display device 20 can take when the input setting 25a is a wireless connection, and the conditions for transitioning to or returning to power saving mode. The explanation of Figure 13 will mainly focus on the differences from Figure 6.

[0146] As shown in Figure 13, when input setting 25a is a wireless connection, the transition conditions are as follows.

[0147] Conditions for transitioning from output mode 220 to power saving mode 230 If there is no operation, and no wired or wireless video input for a certain period of time, and furthermore, if the user grants permission, In other words, after a certain period of time has elapsed and the user grants permission, the device will switch to power-saving mode 230. If the user does not grant permission, the device will not switch to power-saving mode 230, so the display device 20 will not enter power-saving mode and lose wireless connectivity while the user is having trouble setting up the wireless connection. If the user grants permission, the device will switch to power-saving mode 230, which prevents power consumption by the display device 20 without switching to power-saving mode 230.

[0148] Figure 14 is a flowchart (part 3) illustrating the process by which a display device 20, which has suppressed the transition to power-saving mode 230, transitions from output-enabled mode 220 to power-saving mode 230, and then returns from power-saving mode 230 to output-enabled mode 220. Note that the explanation of Figure 14 may mainly focus on explaining the differences from Figure 7.

[0149] In Figure 14, steps S52 and S53 are added. Except for steps S52 and S53, the processing from S51 to S60 is the same as steps S4 to S11 in Figure 7.

[0150] In step S2, the modification unit 26 checks the input setting 25a set in the switching unit 25. If the input setting 25a is a wireless connection, the modification unit 26 adds user permission to the conditions for transitioning to power saving mode 230 (S2-4). Therefore, the mode transition dialog box 210 is displayed, as explained in the flowchart in Figure 14 below.

[0151] In step S52, after a certain period of time has elapsed, the output unit 24 displays a mode transition dialog box 210 containing the message, "Do you want to switch to power saving mode?" (S52). An example of the mode transition dialog box 210 is shown in Figure 15.

[0152] In step S53, the operation reception unit 23 determines whether or not it has received input from the user to transition to the mode in the mode transition dialog box 210 (S53). If the determination in step S53 is No, the process proceeds to step S12; if the determination in step S53 is Yes, the process proceeds to step S54. If the determination in step S53 is No, the power control unit 33 resets the timer that measures a certain period of time. The power control unit 33 measures a certain period of time again, and if the display device 2 is inactive and there is no wired or wireless video input for a certain period of time, the output unit 24 displays the mode transition dialog box 210 again. This prevents the dialog box from being displayed repeatedly in a short period of time due to a Yes determination in step S51.

[0153] - In step S60, when input setting 25a is switched to wired connection, the modification unit 26 restores the conditions for transitioning to power saving mode 230 (S60-2). That is, the modification unit 26 removes user permission from the conditions for transitioning to power saving mode 230. In this way, when input setting 25a is wired connection, the power control unit 33 can transition to power saving mode 230 after a certain period of time.

[0154] Therefore, according to the process in Figure 14, the device will not switch to power-saving mode 230 unless the user grants permission, so the display device 20 will not enter power-saving mode and lose wireless connectivity while the user is having trouble setting up the wireless connection. If the user grants permission, the device will switch to power-saving mode 230, thus preventing power consumption by the display device 20 from remaining in power-saving mode 230.

[0155] Furthermore, "Power saving mode transition control 3 when input setting is wireless connection" can be executed in combination with "Power saving mode transition control 2 when input setting is wireless connection".

[0156] <<Mode Transition Dialog Box>> Figure 15 shows an example of the mode transition dialog box 210. At the time the mode transition dialog box 210 is displayed, the video from the wireless connection is not being displayed, so the mode transition dialog box 210 is displayed as a pop-up on the standby screen or similar.

[0157] The mode transition dialog box 210 has a message 211 that says "Do you want to switch to power saving mode 230?", a Yes button 212, and a No button 213 (an example of a display component). The user can press the Yes button 212 to switch to power saving mode 230, or press the No button 213 to not switch.

[0158] While the mode transition dialog box 210 is displayed, the power control unit 33 stops the countdown for a set period of time. This prevents the system from switching to power-saving mode 230 even if the user is operating the terminal device 40 and does not notice the mode transition dialog box 210. Alternatively, while the mode transition dialog box 210 is displayed, the power control unit 33 may slow down the countdown speed for a set period of time. This allows the display device 20 to switch to power-saving mode 230 if the user has to move away from the display device 20 for an urgent matter. The output unit 24 may also display the value of the timer counting down for a set period of time in real time on the mode transition dialog box 210.

[0159] <Controlling the transition to power saving mode when the input setting is wireless 4> For example, if the power button of the display device 20 is accidentally pressed in a bag, and the input setting 25a is set to wireless connection, the process in Figure 10 will not transition to power-saving mode 230, and the battery will continue to be consumed. Therefore, it is effective for the power control unit 33 to set the input setting 25a to wired connection when the power is turned on. The conditions for transitioning to power-saving mode 230 are the same as in Figure 9.

[0160] Figure 16 is a flowchart (part 4) illustrating the process by which a display device 20, which has suppressed the transition to power-saving mode 230, transitions from output-enabled mode 220 to power-saving mode 230, and then returns from power-saving mode 230 to output-enabled mode 220. Note that the explanation of Figure 16 may mainly focus on explaining the differences from Figure 10.

[0161] In Figure 16, step S30 is added before step S1. In step S30, the switching unit 25 sets the input setting 25a to wired connection immediately after startup (S30). This ensures that the input setting 25a is always wired connection upon startup, so even if the device is started by accident, the display device 20 will not switch to power-saving mode 230, preventing it from continuously consuming the battery. Alternatively, the switching unit 25 may set the input setting 25a to wired connection when the power is off to achieve a similar effect.

[0162] Furthermore, "Power saving mode transition control 4 when input setting is wireless connection" may also be applied to "Power saving mode transition control 2,3 when input setting is wireless connection".

[0163] <Automatic switching of displayed video> Although not directly mentioned in the above-mentioned controls 1-4 for transitioning to power-saving mode 230 when input setting 25a is a wireless connection, regardless of input setting 25a, the video transmitted by the user may take priority and be automatically displayed on the display device 20.

[0164] Figure 17 is a flowchart illustrating the process by which the display device 20 automatically displays the video transmitted by the user, regardless of the input setting 25a. The process in Figure 17 is executed periodically while the display device 20 is running.

[0165] The switching unit 25 determines whether the input setting 25a is a wireless connection and whether the output unit 24 is displaying video via the wireless connection (S101). If the determination in step S101 is No, the process proceeds to step S104.

[0166] If the determination in step S101 is Yes, the switching unit 25 determines whether the user has transmitted video from the terminal device 40 via a wired connection (S102). For example, the switching unit 25 determines whether the wired control unit 31 has received the video. If the determination in step S102 is No, the video can remain displayed via wireless connection, and the process in Figure 17 is terminated.

[0167] If the determination in step S102 is Yes, the switching unit 25 switches the input setting 25a to a wired connection (S103). As a result, even if the input setting 25a is a wireless connection, the switching unit 25 switches the input setting 25a to a wired connection, and the output unit 24 can display the wired video on the display panel 102.

[0168] In step S104, the switching unit 25 determines whether the input setting 25a is a wired connection and whether the output unit 24 is displaying video via the wired connection (S104). If the determination in step S104 is No, the process in Figure 17 ends. In this case, the transition control to the power saving mode 230, as described in transition control 1 to 4, is performed.

[0169] If the determination in step S104 is Yes, the switching unit 25 determines whether the user has transmitted video from the terminal device 40 via wireless connection (S105). For example, the switching unit 25 determines whether the wireless control unit 29 has received the video. If the determination in step S105 is No, the wired video can remain displayed, and the process in Figure 17 is terminated.

[0170] If the determination in step S105 is Yes, the switching unit 25 switches the input setting 25a to a wireless connection (S106). As a result, even if the input setting 25a is a wired connection, the switching unit 25 switches the input setting 25a to a wireless connection, and the video from the wireless connection can be displayed on the display panel.

[0171] The output unit 24 may display both wired and wireless connections by splitting the display panel, without switching between them. Also, the order in which the decisions in steps S101 and S104 are made does not matter.

[0172] <Main effects> As explained above, the display device 20 can achieve both power saving and smooth wireless connectivity. For example, even if the user has trouble setting up the wireless connection on the terminal device 40, the display device 20 does not automatically switch to power saving mode, thus preventing the display device 20 from entering power saving mode and losing wireless connectivity while the user is having trouble setting up the wireless connection.

[0173] <Other application examples> Although the best mode for carrying out the present invention has been described above using examples, the present invention is not limited in any way to these examples, and various modifications and substitutions can be made without departing from the spirit of the present invention.

[0174] For example, although this embodiment mainly describes the case where the display device 20 displays video, this embodiment can also be suitably applied to cases where the display device 20 receives only audio and outputs only audio.

[0175] Furthermore, if the wireless connection is active and the device has entered power-saving mode, but the user immediately operates the display device 20 to restore it, the modification unit 26 may automatically change the transition conditions. In other words, the display device 20 can detect that the user had difficulty with the wireless connection settings and change the transition conditions.

[0176] Furthermore, although this embodiment mentions a portable display device 20, the display device 20 may also be a stationary type. In a conference room or similar setting, each user can display the video from their terminal device 40 on a large display device 20. Examples of large display devices 20 include electronic whiteboards and digital signage.

[0177] Furthermore, the terminal device 40 and the display device 20 may be the same model. For example, if both the terminal device 40 and the display device 20 are electronic whiteboards, they can share their screens to conduct a remote conference, and both can be muted by muting the screen of one device.

[0178] Furthermore, the configuration examples shown in Figure 5 and other figures are divided according to their main functions to facilitate understanding of the processing performed by the display device 20. The present invention is not limited by the way the processing units are divided or the names of those units. The processing of the display device 20 can be further divided into many more processing units depending on the processing content. It can also be divided so that one processing unit includes even more processing.

[0179] Furthermore, each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above.

[0180] Embodiments of the present invention bring about significant improvements in the capabilities and functionality of computers. These improvements enable users to utilize computers that provide more efficient and robust interaction with tables, which are methods for storing and presenting information in information processing devices. Furthermore, embodiments of the present invention provide a better user experience through the use of a more efficient, powerful, and robust user interface. Such a user interface provides better interaction between humans and machines.

[0181] <Additional notes regarding claims> [Claim 1] A display device that displays video received from a terminal device, A first communication unit that receives the first video from the aforementioned terminal device via a wired connection, A second communication unit that receives a second video from the aforementioned terminal device via wireless connection, An output unit that outputs either the first video or the second video based on an input setting which specifies whether to display the first video or the second video, A power control unit that switches to the power saving mode when the conditions for transitioning from an output mode capable of displaying video to a power saving mode are met, If the input setting is a wireless connection, the change unit changes the transition conditions, A display device. [Claim 2] The aforementioned modification disables the transition condition, The display device according to claim 1, characterized in that the power control unit does not switch to the power saving mode. [Claim 3] The transition conditions are that the display device is idle and there is no wired or wireless video input for a certain period of time. The modified part extends the aforementioned fixed time, The display device according to claim 1, characterized in that the power control unit switches to the power saving mode when the display device is idle and there is no extended wired or wireless video input for a certain period of time. [Claim 4] The transition conditions are that the display device is idle and there is no wired or wireless video input for a certain period of time. The aforementioned modification adds user permission to the transition conditions, If the display device is idle and there is no wired or wireless video input for a certain period of time, the output unit displays a display component indicating whether or not to switch to the power-saving mode. The display device according to claim 1 or 3, characterized in that, upon receiving an input indicating a transition to the power-saving mode, the power control unit causes the device to transition to the power-saving mode. [Claim 5] The display device according to claim 4, characterized in that, when it receives an input indicating that it will not switch to the power-saving mode, the power control unit does not switch to the power-saving mode. [Claim 6] The display device according to claim 5, characterized in that, upon receiving an input indicating that it will not switch to the power-saving mode, the power control unit resets the timer that counts the fixed time. [Claim 7] The display device according to any one of claims 4 to 6, characterized in that the power control unit does not switch to the power saving mode while the output unit is displaying the display component. [Claim 8] The display device has a switching unit that switches to the input setting for displaying the first video when the display device is started, The display device according to any one of claims 1 to 7, characterized in that, when the input setting is a wired connection, the power control unit switches to power saving mode when the transition condition is met. [Claim 9] While the output unit is displaying the first video via the wired connection, When the second communication unit receives the second video via the wireless connection, it has a switching unit that switches from the input setting for displaying the first video to the input setting for displaying the second video. The display device according to any one of claims 1 to 8, characterized in that the output unit displays the second video. [Claim 10] While the output unit is displaying the second video via the wireless connection, When the first communication unit receives the first video via the wired connection, it has a switching unit that switches from the input setting for displaying the second video to the input setting for displaying the first video. The display device according to any one of claims 1 to 9, characterized in that the output unit displays the first video. [Claim 11] It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 2, characterized in that the modified part re-enables the disabled transition condition. [Claim 12] It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 3, characterized in that the modified part restores the extended fixed time to its original state. [Claim 13] It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 4, characterized in that the modified part removes the user's permission from the transition conditions. [Claim 14] If the modification unit changes the transition condition when the input setting is a wireless connection, The second communication unit determines whether or not there is a request for wireless connection from the terminal device. Even if there is no request for the aforementioned wireless connection, the power control unit will not switch to power saving mode. When a request for the aforementioned wireless connection is made, the second communication unit determines whether or not a wireless connection has been established with the terminal device. Even if the aforementioned wireless connection is not established, the power control unit will not switch to power saving mode. When the wireless connection is established, the second communication unit determines whether or not there is a video input from the terminal device. The display device according to claim 2, characterized in that the power control unit does not switch to power saving mode even when there is no video input. [Explanation of symbols]

[0182] 20 Display device 40 Terminal devices 100 Display Systems [Prior art documents] [Patent Documents]

[0183] [Patent Document 1] Patent No. 6558227

Claims

1. A display device that displays video received from a terminal device, A first communication unit that receives the first video from the terminal device via a wired connection, A second communication unit that receives a second video from the aforementioned terminal device via wireless connection, An output unit that outputs either the first video or the second video based on an input setting which specifies whether to display the first video or the second video, A power control unit that switches to the power saving mode when the conditions for transitioning from an output mode capable of displaying video to a power saving mode are met, If the input setting is a wireless connection, the change unit changes the transition conditions, A display device.

2. The aforementioned modification disables the transition condition, The display device according to claim 1, characterized in that the power control unit does not switch to the power saving mode.

3. The transition conditions are that the display device is idle and there is no wired or wireless video input for a certain period of time. The modified part extends the aforementioned fixed time, The display device according to claim 1, characterized in that the power control unit switches to the power saving mode when the display device is idle and there is no extended wired or wireless video input for a certain period of time.

4. The transition conditions are that the display device is idle and there is no wired or wireless video input for a certain period of time. The aforementioned modification adds user permission to the transition conditions, If the display device is idle and there is no wired or wireless video input for a certain period of time, the output unit displays a display component indicating whether or not to switch to the power-saving mode. The display device according to claim 1, characterized in that when it receives an input indicating that it will switch to the power-saving mode, the power control unit switches to the power-saving mode.

5. The display device according to claim 4, characterized in that, when it receives an input indicating that it will not switch to the power-saving mode, the power control unit does not switch to the power-saving mode.

6. If an input is received indicating that the power saving mode will not be entered, the power control unit resets the timer that counts the fixed time, measures the fixed time again, and The display device according to claim 5, characterized in that, if the display device is idle and there is no wired or wireless video input for a certain period of time, the output unit displays again a display component that accepts whether or not to switch to the power-saving mode.

7. The display device according to claim 4, characterized in that the power control unit does not switch to the power saving mode while the output unit is displaying the display component.

8. The display device has a switching unit that switches to the input setting for displaying the first video when the display device is started, The display device according to claim 2, characterized in that, when the input setting is a wired connection, the power control unit switches to power saving mode when the transition condition is met.

9. While the output unit is displaying the first video via the wired connection, When the second communication unit receives the second video via the wireless connection, it has a switching unit that switches from the input setting for displaying the first video to the input setting for displaying the second video. The display device according to claim 1, characterized in that the output unit displays the second image.

10. While the output unit is displaying the second video via the wireless connection, When the first communication unit receives the first video via the wired connection, it has a switching unit that switches from the input setting for displaying the second video to the input setting for displaying the first video. The display device according to claim 1, characterized in that the output unit displays the first image.

11. It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 2, characterized in that the modified part re-enables the disabled transition condition.

12. It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 3, characterized in that the modified part restores the extended fixed time to its original state.

13. It has an operation receiving unit that accepts an operation to switch the aforementioned input settings, When the operation reception unit receives an operation to switch the input setting from the wireless connection to the wired connection, it has a switching unit that switches to the input setting that displays the first video, The display device according to claim 4, characterized in that the modified part removes the user's permission from the transition conditions.

14. If the modification unit changes the transition condition when the input setting is a wireless connection, The second communication unit determines whether or not there is a request for wireless connection from the terminal device. Even if there is no request for the aforementioned wireless connection, the power control unit will not switch to power saving mode. When a request for the aforementioned wireless connection is made, the second communication unit determines whether or not a wireless connection has been established with the terminal device. Even if the aforementioned wireless connection is not established, the power control unit will not switch to power saving mode. When the wireless connection is established, the second communication unit determines whether or not there is a video input from the terminal device. The display device according to claim 2, characterized in that the power control unit does not switch to power saving mode even when there is no video input.

15. A display device that displays video received from a terminal device, A first communication unit that receives the first video from the terminal device via a wired connection, A second communication unit that receives a second video from the aforementioned terminal device via wireless connection, An output unit that outputs either the first video or the second video based on an input setting which specifies whether to display the first video or the second video, A power control unit that switches to the power saving mode when the conditions for transitioning from an output mode capable of displaying video to a power saving mode are met, If the input setting is a wireless connection, the change unit changes the transition conditions. A program designed to function as such.

16. A display method in which a display device displays video received from a terminal device, The process of receiving the first video from the terminal device via a wired connection, The process of receiving a second video from the aforementioned terminal device via wireless connection, A process to output either the first video or the second video based on an input setting which specifies whether to display the first video or the second video, A process to switch to the power-saving mode when the conditions for transitioning from an output mode capable of displaying video to a power-saving mode are met, If the input setting is a wireless connection, the process of changing the transition conditions is performed. A method for displaying the execution.

Images