Display apparatus and method of operating the same
By adjusting display properties such as image size and virtual keyboard size according to the user's input type, the problem of inconvenient touch operation on large-size displays is solved, and the user experience and input efficiency are optimized.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2022-05-30
- Publication Date
- 2026-05-05
AI Technical Summary
When the size of the terminal display is larger than a certain inch, it becomes difficult for users to input effectively via touch, causing inconvenience.
The display properties are adjusted based on the type of user input (remote control input or touch input), including adjusting image size, brightness, and virtual keyboard size, to optimize the user experience.
By adapting to different input types, improving input convenience, reducing user hand movement, preventing glare, and providing an appropriately sized GUI, user interaction efficiency is enhanced.
Smart Images

Figure CN116527972B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to a display device. Background Technology
[0002] Recently, the functions of terminals have become increasingly diversified. For example, they can perform data and voice communication, take photos and videos with a camera, record audio, play music files through a speaker system, and output images or videos to a display.
[0003] Some terminals have added video game functionality or perform multimedia playback functions.
[0004] As the functions of terminals become more diverse, terminals are implemented in the form of multimedia devices (multimedia players) equipped with complex functions such as capturing still or moving images, reproducing music or video files, playing games, and receiving broadcasts.
[0005] When the display size of a terminal is larger than a certain inch (e.g., 27 inches), it becomes difficult for the user to touch the display.
[0006] In other words, in display devices larger than a certain size, more finger movement is required to perform the same operations as touch operations on display devices of the same size as traditional flat panels, which causes inconvenience to users. Summary of the Invention
[0007] This disclosure provides a display device that optimizes usability by changing display properties according to the type of user input to the display device.
[0008] This disclosure provides a display device that optimizes the use of touch.
[0009] According to embodiments of the present disclosure, a display device may include: a display configured to display an image; a user input interface configured to receive remote control input from a remote controller; and a controller configured to receive user input, obtain the type of the received user input, and change the display properties according to the obtained user input type, wherein the user input type is one of a remote control input type or a touch input.
[0010] According to embodiments of this disclosure, a GUI of appropriate size can be provided based on the type of user input, thus greatly improving the convenience of input.
[0011] According to embodiments of this disclosure, the screen is shrunk relative to the touch input point, thus optimizing the user's touch experience.
[0012] According to embodiments of this disclosure, glare can be prevented by adjusting the output brightness of the image based on the type of user input when the user controls the input via touch.
[0013] According to embodiments of this disclosure, the size of an image is reduced based on touch input, thereby preventing inconvenience for the user while viewing the image. Attached Figure Description
[0014] Figure 1 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.
[0015] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present disclosure.
[0016] Figure 3 An example of an actual configuration of a remote control device according to an embodiment of the present disclosure is shown.
[0017] Figure 4 An example of using a remote control device according to an embodiment of the present disclosure is shown.
[0018] Figure 5A and Figure 5B This is a diagram used to describe the horizontal and vertical modes of a vertical display device according to embodiments of the present disclosure.
[0019] Figure 6 This is a flowchart describing an operation method of a display device according to an embodiment of the present disclosure.
[0020] Figure 7 This is a flowchart illustrating an example of how the properties of a virtual keyboard change based on the type of user input.
[0021] Figure 8A This is an illustration used to describe an example of displaying a first virtual keyboard when remote control input is received, according to an embodiment of the present disclosure.
[0022] Figure 8B This is an illustration used to describe an example of displaying a second virtual keyboard when touch input is received, according to an embodiment of the present disclosure.
[0023] Figure 8C It is a diagram used to describe the process of applying input to a first virtual keyboard via touch input according to the prior art.
[0024] Figure 8D This is a diagram illustrating the process of reducing the size of a screen when touch input is received on a display, according to an embodiment of the present disclosure.
[0025] Figure 8E This is a diagram illustrating the process of displaying a virtual keyboard based on keyboard information set in a mobile device connected to a display device when touch input is performed, according to an embodiment of the present disclosure.
[0026] Figure 8F and Figure 8G This is a diagram illustrating an implementation of providing different types of virtual keyboards depending on the orientation of the display device.
[0027] Figure 8H This is a diagram illustrating an implementation that provides the same type of virtual keyboard even when the orientation of the display device changes.
[0028] Figure 9 This is a flowchart illustrating a process of providing different screen brightness modes based on the type of user input, according to another embodiment of this disclosure.
[0029] Figure 10A and Figure 10B This is a diagram used to illustrate an example of providing different screen brightness modes based on the type of user input.
[0030] Figure 11 This is a flowchart illustrating the process of providing images of different sizes based on the type of user input.
[0031] Figure 12A and Figure 12B This is a diagram used to illustrate an example of providing different screen sizes based on the type of user input.
[0032] Figures 13 to 14B This is a diagram used to describe an implementation that provides images of different sizes based on the type of user input.
[0033] Figures 15 to 16B An implementation method is shown for describing the operation based on whether or not the touch mode is maintained. Detailed Implementation
[0034] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The suffixes “module” and “unit or part” used for components in the following description are provided for convenience in preparing this specification only, and therefore are not given a specific meaning or function.
[0035] The display device according to embodiments of this disclosure is, for example, a smart display device, in which computer support functions are added to the broadcast receiving function, and faithfully reproduces the broadcast receiving function while adding internet functionality, such as a handwriting input device or a touchscreen. Alternatively, a more user-friendly interface, such as a spatial remote control, may be provided. Furthermore, it connects to the internet and a computer supporting wired or wireless internet functionality, thereby enabling functions such as email, web browsing, banking, or gaming. A standardized general-purpose operating system can be used for these various functions.
[0036] Therefore, in the display device described in this disclosure, various user-friendly functions can be implemented because various applications can be freely added or removed, for example, on a general-purpose OS kernel. More specifically, the display device can be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and in some cases, it can be applied to smartphones.
[0037] Figure 1 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.
[0038] Reference Figure 1 The display device 100 may include a broadcast receiver 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, a display 180, a speaker 185, and a power supply circuit 190.
[0039] The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface 133.
[0040] Tuner 131 can select a specific broadcast channel according to a channel selection command. Tuner 131 can receive the broadcast signal of the selected specific broadcast channel.
[0041] The demodulator 132 can separate the received broadcast signal into image signals, audio signals and data signals related to the broadcast program, and restore the separated image signals, audio signals and data signals into an output format.
[0042] External device interface 135 can receive applications or application lists from adjacent external devices and send them to controller 170 or memory 140.
[0043] External device interface 135 provides a connection path between display device 100 and external devices. External device interface 135 can receive one or more images and audio outputs from external devices connected to display device 100 via wired or wireless means, and transmit them to controller 170. External device interface 135 may include multiple external input terminals. These external input terminals may include RGB terminals, one or more High Definition Multimedia Interface (HDMI) terminals, and component terminals.
[0044] Image signals from external devices input via external device interface 135 can be output via display 180. Audio signals from external devices input via external device interface 135 can be output via speaker 185.
[0045] The external device that can be connected to the external device interface 135 can be any of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB storage device, and home theater system, but this is just an example.
[0046] Network interface 133 provides an interface for connecting the display device 100 to a wired / wireless network, including the Internet. Network interface 133 can send or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.
[0047] Additionally, a portion of the content data stored in the display device 100 may be sent to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device 100.
[0048] Network interface 133 can access the reserved webpage via the connected network or other networks linked to the connected network. That is, it can access the reserved webpage via the network and send data to or receive data from the corresponding server.
[0049] Additionally, network interface 133 can receive content or data provided by content providers or network operators. That is, network interface 133 can receive content and related information such as movies, advertisements, games, VOD, and broadcast signals from content providers or network providers via the network.
[0050] In addition, network interface 133 can receive firmware update information and update files provided by network operators, and can send data to the Internet or content providers or network operators.
[0051] Network interface 133 can select and receive desired applications from publicly available applications via the network.
[0052] The memory 140 may store programs for signal processing and control of the controller 170, and may also store image, audio or data signals that have been processed.
[0053] Additionally, the memory 140 can perform functions for temporarily storing image, audio, or data signals input from the external device interface 135 or the network interface 133, and can store information about a predetermined image through a channel storage function.
[0054] The memory 140 can store applications or application lists input from the external device interface 135 or the network interface 133.
[0055] The display device 100 can play back content files (moving image files, still image files, music files, document files, application files, etc.) stored in the memory 140 and provide them to the user.
[0056] User input interface 150 can send user-input signals to controller 170 or send signals from controller 170 to the user. For example, user input interface 150 can receive and process control signals such as power on / off, channel selection, and screen settings from remote control device 200 according to various communication methods such as Bluetooth, WB (Ultra-Wideband), ZigBee, RF (Radio Frequency), or Infrared (IR) communication methods, or can perform processing to send control signals from controller 170 to remote control device 200.
[0057] Additionally, the user input interface 150 can send control signals input from local keys such as the power button, channel button, volume button, and setting value (not shown) to the controller 170.
[0058] The image signal processed by the controller 170 can be input to the display 180 and displayed as an image corresponding to the corresponding image signal. In addition, the image signal processed by the controller 170 can be input to an external output device through the external device interface 135.
[0059] The audio signal processed by the controller 170 can be output to the speaker 185. In addition, the audio signal processed by the controller 170 can be input to an external output device through the external device interface 135.
[0060] In addition, the controller 170 can control the overall operation of the display device 100.
[0061] Additionally, the controller 170 can control the display device 100 based on user commands or internal programs input through the user input interface 150 and connect to the network to download applications, application lists, or user-desired applications to the display device 100.
[0062] The controller 170 allows the user to select channel information, along with processed image or audio signals, and output them through the display 180 or speaker 185.
[0063] Additionally, the controller 170 can output image or audio signals via the display 180 or speaker 185 according to a command to play back an image from an external device via the user input interface 150. The image or audio signals are input from an external device (e.g., a camera or camcorder) via the external device interface 135.
[0064] Furthermore, the controller 170 may allow the display 180 to display images, such as broadcast images input via the tuner 131, externally input images input via the external device interface 135, images input via the network interface unit, or images stored in the memory 140. In this case, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.
[0065] Additionally, the controller 170 can allow playback of content stored in the display device 100, received broadcast content, or externally input content, and the content can take various forms such as broadcast images, externally input images, audio files, still images, accessed web pages, and document files.
[0066] The wireless communication interface 173 can communicate with external devices via wired or wireless communication. The wireless communication interface 173 can perform short-range communication with external devices. Therefore, the wireless communication interface 173 can support the use of Bluetooth. TM The wireless communication interface 173 supports short-range communication between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the network where the display device 100 (or an external server) resides, via a wireless local area network. The wireless local area network can be a wireless personal area network (WLAN).
[0067] Here, the other display device 100 may be a wearable device (e.g., a smartwatch, smart glasses, or head-mounted display (HMD), or a mobile terminal such as a smartphone) capable of exchanging data (or communicating) with the display device 100 according to this disclosure. The wireless communication interface 173 can detect (or identify) wearable devices capable of communicating around the display device 100.
[0068] Furthermore, when the detected wearable device is an authentication device communicating with the display device 100 according to this disclosure, the controller 170 can transmit at least a portion of the data processed by the display device 100 to the wearable device via the wireless communication interface 173. Therefore, the user of the wearable device can use the data processed by the display device 100 through the wearable device.
[0069] The display 180 can convert the image signals, data signals, and OSD signals processed by the controller 170 or the image signals or data signals received from the external device interface 135 into R, G, and B signals, and generate drive signals.
[0070] In addition, due to Figure 1 The display device 100 shown is only an embodiment of this disclosure, so some of the components shown may be integrated, added or omitted depending on the specifications of the actual display device 100.
[0071] That is, if necessary, two or more components can be combined into one component, or one component can be divided into two or more components. Furthermore, the functions performed in each block are for describing embodiments of this disclosure, and their specific operations or apparatus do not limit the scope of this disclosure.
[0072] According to another embodiment of this disclosure, with Figure 1 The display device 100 shown is different. The display device 100 can receive images via network interface 133 or external device interface 135 without tuner 131 and demodulator 132, and play back images.
[0073] For example, the display device 100 may be divided into an image processing device (e.g., a set-top box) that receives broadcast signals or content according to various network services and a content playback device that plays back content input from the image processing device.
[0074] In this case, the operation method of the display device according to the embodiments of the present disclosure, which will be described below, can be used not only by referring to Figure 1 The described display device 100 is implemented and can be implemented by one of an image processing device such as a separate set-top box and a content playback device including a display 180 and / or a speaker 185.
[0075] Next, we will refer to Figures 2 to 3 A remote control device according to an embodiment of the present disclosure is described.
[0076] Figure 2 This is a block diagram of a remote control device according to an embodiment of the present disclosure. Figure 3 An example of a practical configuration of a remote control device 200 according to an embodiment of the present disclosure is shown.
[0077] First, refer to Figure 2 The remote control device 200 may include a fingerprint reader 210, a wireless communication circuit 220, a user input interface 230, a sensor 240, an output interface 250, a power supply circuit 260, a memory 270, a controller 280, and a microphone 290.
[0078] Reference Figure 2The wireless communication circuit 220 can send signals to and receive signals from any of the display devices according to the embodiments of the present disclosure described above.
[0079] The remote control device 200 may include an RF circuit 221 capable of transmitting and receiving signals to and from the display device 100 according to an RF communication standard, and an IR circuit 223 capable of transmitting and receiving signals to and from the display device 100 according to an IR communication standard. Additionally, the remote control device 200 may include a wireless communication unit 225 capable of transmitting and receiving signals to and from the display device 100 according to a Bluetooth communication standard. Furthermore, the remote control device 200 may include an NFC circuit 227 capable of transmitting and receiving signals to and from the display device 100 according to an NFC (Near Field Communication) communication standard, and a WLAN circuit 229 capable of transmitting and receiving signals to and from the display device 100 according to a Wireless LAN (WLAN) communication standard.
[0080] In addition, the remote control device 200 can send a signal containing information about the movement of the remote control device 200 to the display device 100 via the wireless communication circuit 220.
[0081] In addition, the remote control device 200 can receive signals sent by the display device 100 through the RF circuit 221, and if necessary, send commands to the display device 100 regarding power on / off, channel change, volume adjustment, etc. through the IR circuit 223.
[0082] User input interface 230 may include a keypad, buttons, a touchpad, a touchscreen, etc. Users can input commands related to the display device 100 to the remote control device 200 by operating user input interface 230. When user input interface 230 includes hard keys, users can input commands related to the display device 100 to the remote control device 200 by pressing the hard keys. Details will be referred to... Figure 3 describe.
[0083] Reference Figure 3 The remote control device 200 may include multiple buttons. The multiple buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, a channel change button 237, an OK button 238, and a playback button 239.
[0084] The fingerprint recognition button 212 can be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button 212 can allow a push-press operation, and therefore can receive both push-press and fingerprint recognition operations.
[0085] The power button 231 can be a button used to turn the power of the display device 100 on / off.
[0086] The home button 232 can be a button used to navigate to the home screen of the display device 100.
[0087] The live button 233 can be a button used to display live broadcast programs.
[0088] The external input button 234 can be a button for receiving external input connected to the display device 100.
[0089] The volume control button 235 can be a button used to adjust the volume level output by the display device 100.
[0090] The voice recognition button 236 can be a button used to receive the user's voice and recognize the received voice.
[0091] The channel change button 237 can be a button used to receive broadcast signals from a specific broadcast channel.
[0092] OK button 238 can be a button for selecting a specific function, and replay button 239 can be a button for returning to the previous screen.
[0093] Will refer again Figure 2 Provide a description.
[0094] When the user input interface 230 includes a touch screen, the user can input commands related to the display device 100 to the remote control device 200 by touching the soft keys on the touch screen. Additionally, the user input interface 230 may include various types of input methods operable by the user, such as scroll keys or tap keys; this embodiment does not limit the scope of this disclosure.
[0095] Sensor 240 may include gyroscope sensor 241 or accelerometer sensor 243, wherein gyroscope sensor 241 can sense information about the movement of remote control device 200.
[0096] For example, the gyroscope sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the accelerometer sensor 243 can sense information about the moving speed of the remote control device 200. Furthermore, the remote control device 200 may also include a distance measurement sensor to sense the distance between the display device 100 and the display 180.
[0097] The output interface 250 can output image or audio signals corresponding to the operation of the user input interface 230 or signals sent from the display device 100.
[0098] Users can use the output interface 250 to identify whether the user input interface 230 is being operated or whether the display device 100 is being controlled.
[0099] For example, when the user input interface 230 is operated or sends signals to and receives signals from the display device 100 via the wireless communication unit 225, the output interface 450 may include an LED 251 that emits light, a vibrator 253 that generates vibrations, a speaker 255 that outputs sound, or a display 257 that outputs images.
[0100] In addition, the power supply circuit 260 can supply power to the remote control device 200, and stop supplying power when the remote control device 200 has not moved for a predetermined time, so as to reduce power consumption.
[0101] When a preset key in the remote control device 200 is activated, the power supply circuit 260 can be restarted.
[0102] The memory 270 can store various types of programs and application data required for the control or operation of the remote control device 200.
[0103] When the remote control device 200 wirelessly transmits and receives signals through the display device 100 and the RF circuit 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band.
[0104] The controller 280 of the remote control device 200 can store and reference information in the memory 270 about the frequency bands that enable it to wirelessly send signals to and receive signals from the display device 100 paired with the remote control device 200.
[0105] The controller 280 can control all matters related to the control of the remote control device 200. The controller 280 can send signals corresponding to predetermined key operations of the user input interface 230 or signals corresponding to the movement of the remote control device 200 sensed by the sensor 240 via the wireless communication unit 225.
[0106] Additionally, the microphone 290 of the remote control device 200 can receive speech.
[0107] Multiple microphones 290 are available.
[0108] Next, we will refer to Figure 4 Provide a description.
[0109] Figure 4 An example of using a remote control device according to an embodiment of the present disclosure is shown.
[0110] exist Figure 4 In the image, (a) shows a pointer 205 corresponding to the remote control device 200 displayed on the display 180.
[0111] The user can move or rotate the remote control device 200 in all directions. The pointer 205 displayed on the monitor 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, the pointer 205 moves and is displayed in 3D space according to the movement of the remote control device 200, therefore the remote control device 200 can be called a spatial remote control device.
[0112] exist Figure 4 In (b), it is shown that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the display device 100 moves to the left accordingly.
[0113] Information regarding the movement of the remote control device 200, detected by its sensors, is sent to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 based on the information regarding the movement of the remote control device 200. The display device 100 can then display the pointer 205 in accordance with the calculated coordinates.
[0114] exist Figure 4 In (c), it is shown that the user moves the remote control device 200 away from the display 180 while pressing a specific button on the remote control device 200. As a result, the selected area on the display 180 corresponding to the pointer 205 can be zoomed in and magnified.
[0115] Conversely, when the user moves the remote control device 200 closer to the display 180, the selected area on the display 180 corresponding to the pointer 205 can be zoomed out and reduced in size.
[0116] On the other hand, when the remote control device 200 moves away from the display 180, the selected area can be pulled further away, and when the remote control device 200 moves closer to the display 180, the selected area can be pulled closer.
[0117] Furthermore, when a specific button in the remote control device 200 is pressed, the recognition of up, down, left, or right movement can be excluded. That is, when the remote control device 200 moves away from or closer to the display 180, up, down, left, or right movement is not recognized; only forward and backward movement is recognized. When the specific button in the remote control device 200 is not pressed, only the pointer 205 moves according to the up, down, left, or right movement of the remote control device 200.
[0118] Furthermore, the moving speed or direction of the pointer 205 can correspond to the moving speed or direction of the remote control device 200.
[0119] Furthermore, in this specification, a pointer refers to an object displayed on the display 180 in response to an operation of the remote control device 200. Therefore, objects of various shapes other than the arrow shape shown in the figure can serve as pointer 205. For example, objects can include concepts such as points, cursors, prompts, and rough outlines. In addition, pointer 205 can be displayed corresponding to any one of the points on the horizontal and vertical axes of the display 180, and can also be displayed corresponding to multiple points such as lines and surfaces.
[0120] Figure 5A and Figure 5B This is a diagram used to describe the horizontal and vertical modes of a vertical display device according to embodiments of the present disclosure.
[0121] Reference Figure 5A and Figure 5B The vertical display device 100 is shown.
[0122] The shaft 103 and the bracket base 105 can be connected to the display device 100.
[0123] Axis 103 can connect the display device 100 and the support base 105 to each other. Axis 103 can extend vertically.
[0124] The lower end of shaft 103 can be connected to the edge of bracket base 105.
[0125] The lower end of shaft 103 can be rotatably connected to the edge of bracket base 105.
[0126] The display device 100 and the shaft 103 can rotate about a vertical axis relative to the support base 105.
[0127] The upper part of shaft 103 can be connected to the rear surface of display device 100.
[0128] The stand base 105 can be used to support the display device 100.
[0129] The display device 100 can be configured to include an axis 103 and a support base 105.
[0130] The display device 100 can rotate about the point where the upper part of the axis 103 contacts the rear surface of the display 180.
[0131] Figure 5A The display 180 is shown operating in a landscape mode where the horizontal length is greater than the vertical length. Figure 5B The display 180 is shown operating in a portrait mode where the vertical length is greater than the horizontal length.
[0132] Users can move the vertical display device while holding it. That is, unlike fixed devices, the improved mobility of the vertical display device allows users to be free from placement restrictions.
[0133] Figure 6 This is a flowchart describing an operation method of a display device according to an embodiment of the present disclosure.
[0134] Reference Figure 6 The controller 170 of the display device 100 can receive user input (S601).
[0135] In this implementation, the user input can be any one of control input, touch input, and mouse input received from the remote control device 200.
[0136] The controller 170 can receive user input while displaying an image on the display 180, and determine the type of user input received.
[0137] The controller 170 of the display device 100 can obtain the type of the received user input (S603).
[0138] The controller 170 can determine the type of user input based on the path through which the user input is received.
[0139] The user input type can be any of the following: remote control input, touch input, or mouse input.
[0140] In one implementation, when user input is received through user input interface 150, controller 170 can determine the type of user input as remote control input type.
[0141] When user input is received via display 180, controller 170 can determine the type of user input as touch input.
[0142] When user input is received via external device interface 135, controller 170 can determine the type of user input as mouse input. The mouse can be connected to a USB port provided in external device interface 135.
[0143] The controller 170 of the display device 100 can change the display properties according to the type of user input obtained (S605).
[0144] In an implementation, display properties may include one or more of the size, brightness, and position of the image displayed on the display 180.
[0145] In another embodiment, display properties may include one or more of the size, brightness, and position of graphical user interface (GUI) elements displayed on the display 180.
[0146] In another implementation, changing the display properties can indicate a change in the display mode.
[0147] In this implementation, mouse input can be handled in a similar manner to touch input. This is because the distance between the display device 100 and the user can be relatively close in both mouse and touch input scenarios.
[0148] The controller 170 of the display device 100 can output a screen with changed display properties through the display 180 (S607).
[0149] When the first display property changes to the second display property based on the type of user input, the controller 170 can reflect the changed property to display an image or GUI.
[0150] This will be described in detail with reference to the following example.
[0151] Figure 7 This is a flowchart illustrating an example of how the properties of a virtual keyboard change based on the type of user input.
[0152] Figure 7 The implementation method can be illustrated in detail in steps S603 to S607.
[0153] Reference Figure 7 The controller 170 can determine whether the user input type is a remote control input type (S701).
[0154] When it is determined that the user input type is a remote control input type, the controller 170 can display a first virtual keyboard with a first property on the display 180 (S703).
[0155] When it is determined that the user input type is touch input type (S705), the controller 170 can display a second virtual keyboard with a second property on the display 180 (S707).
[0156] In this implementation, the size of the first virtual keyboard may be larger than the size of the second virtual keyboard. That is, this property indicates the size of the virtual keyboard.
[0157] When a user controls the operation of the display device 100 via the remote control device 200 and then controls the operation of the display device 100 via touch input, the distance between the user and the display device 100 can become closer.
[0158] In this situation, when the size of the virtual keyboard displayed during control via remote control device 200 remains unchanged, there is an increased inconvenience to the user's hand movements.
[0159] Therefore, according to an embodiment of this disclosure, when the user input type changes from remote control input type to touch input type, the controller 170 can reduce the size of the virtual keyboard.
[0160] Figure 8A This is an illustration used to describe an example of displaying a first virtual keyboard when remote control input is received, according to an embodiment of the present disclosure. Figure 8B This is an illustration used to describe an example of displaying a second virtual keyboard when touch input is received, according to an embodiment of the present disclosure. Figure 8C It is a diagram used to describe the process of applying input to a first virtual keyboard via touch input according to the prior art.
[0161] Reference Figure 8A The display device 100 can display a screen 800 including a search window 810 on the monitor 180.
[0162] The monitor 180 can be any size, such as 27 inches, 29 inches, or 31 inches, but this is just an example.
[0163] The user can control the movement of the pointer 205 (also called the cursor), which is controlled by the movement of the remote control device 200 (also called the remote control).
[0164] When pointer 205 is on search window 810 and a text input command is received from remote control device 200, display device 100 may display a first virtual keyboard 820 with a first size on display 180.
[0165] Reference Figure 8B This illustrates an example of a user touching the search window 810. When touch input is received through the search window 810, the display device 100 may display a second virtual keyboard 830 with a second size smaller than the first size on the display 180.
[0166] That is, when it is determined that the user input type is touch input, the display device 100 can change the first virtual keyboard 820 to the second virtual keyboard 830.
[0167] Users can more easily apply touch input using a smaller virtual keyboard.
[0168] Reference Figure 8C According to the prior art, even if the first virtual keyboard 820 is displayed when touch input is applied, the first virtual keyboard 820 is too large for general users, so the user's hand movement will be significantly increased.
[0169] This makes touch input inconvenient for users.
[0170] When the user input type is changed back to the remote control input type, the display device 100 can... Figure 8A The image shows a first virtual keyboard 820 with a first size.
[0171] That is, the fact that the user is using the remote control device 200 indicates an increase in the distance between the display device 100 and the user. In this case, it is easier for the user to input text via the pointer 205 when the virtual keyboard is larger.
[0172] As described above, according to embodiments of the present disclosure, the display device 100 may be provided with a virtual keyboard of appropriate size according to the type of user input, thereby greatly improving the convenience of input.
[0173] Furthermore, according to another embodiment of this disclosure, when it is determined that the user input type is touch input, not only the size of the virtual keyboard but also the size of the displayed screen can be reduced.
[0174] Figure 8D This is a diagram illustrating the process of reducing the size of a screen when touch input is received on a display, according to an embodiment of the present disclosure.
[0175] exist Figure 8A In the current screen state, the display device 100 can receive touch input at a specific point.
[0176] The display device 100 can be as follows Figure 8D The image shows the size of screen 800 being changed to a smaller screen 801. Therefore, as shown... Figure 8D As shown, the first virtual keyboard 820 can be scaled down to match the scale of the scaled-down screen 801.
[0177] That is, the minimized screen 801 and the minimized virtual keyboard 821 can be displayed around the touch point 840.
[0178] Reducing the screen size by 801 allows it to correspond to the size of a tablet PC.
[0179] The controller 170 of the display device 100 can convert the coordinate system of the existing screen 800 to the coordinate system of the scaled-down screen 801 based on the scaling ratio and the touch point 840.
[0180] That is, the controller 170 can perform a coordinate system transformation, so that the size of the screen 800 is reduced relative to the touch point 840.
[0181] As described above, according to the embodiments of this disclosure, the screen is reduced in size relative to the touch input point, thus optimizing the user's touch experience.
[0182] Furthermore, when a point other than the zoomed-out screen 801 is selected, the display device 100 can switch from the zoomed-out screen 801 and the zoomed-out virtual keyboard 821 back to the original screen 800 and the original virtual keyboard 820.
[0183] As another example, when there is no touch input for a predetermined time, the display device 100 can switch from the minimized screen 801 and minimized virtual keyboard 821 to the original screen 800 and original virtual keyboard 820.
[0184] As another example, the display device 100 can switch from the minimized screen 801 and minimized virtual keyboard 821 to the original screen 800 and original virtual keyboard 820 based on the selection of a button (not shown) included in the minimized virtual keyboard 821.
[0185] Figure 8E This is a diagram illustrating the process of displaying a virtual keyboard based on keyboard information set in a mobile device connected to a display device when touch input is performed, according to an embodiment of the present disclosure.
[0186] The display device 100 and the mobile device 880 can connect to each other via wireless communication standards such as Wi-Fi.
[0187] When touch input is received, the display device 100 can receive information about the keyboard type set in the mobile device 880. The display device 100 can obtain information about the keyboard type from the mobile device 880 before receiving touch input.
[0188] The display device 100 can perform keyboard type matching of the second virtual keyboard 830 based on the received information about the keyboard type to have the keyboard type set in the mobile device 880.
[0189] For example, when the keyboard type of the mobile device 880 is a standard keyboard (qwerty) type, the keyboard type of the second virtual keyboard 830 can also be displayed as a standard keyboard type based on touch input.
[0190] Therefore, users can use the keyboard type used in the mobile device 880 as is, without changing the keyboard type settings of the display device 100, thus greatly improving convenience.
[0191] Figure 8F and Figure 8G This is a diagram illustrating an implementation of providing different types of virtual keyboards depending on the orientation of the display device.
[0192] The display device 100 can operate in either a horizontal or vertical mode depending on its orientation. The horizontal mode can be a horizontal mode where the horizontal length is greater than the vertical length, and the vertical mode can be a vertical mode where the horizontal length is less than the vertical length.
[0193] exist Figure 8F In the middle, the display device 100 is in landscape mode. Figure 8G In the middle, the display device 100 is in portrait mode.
[0194] Reference Figure 8F When a touch input is received in landscape mode, the display device 100 may display a second virtual keyboard 830 having a first keyboard type set in the display device 100.
[0195] Reference Figure 8G When a touch input is received in portrait mode, the display device 100 may display a third virtual keyboard 890 having a second keyboard type set in the mobile device 880 connected to the display device 100.
[0196] That is, when the display device 100 receives touch input after switching from landscape mode to portrait mode, the display device 100 can switch from a second virtual keyboard 830 having a first keyboard type to a third virtual keyboard 890 having a second keyboard type.
[0197] As described above, according to embodiments of the present disclosure, virtual keyboards with different keyboard types can be provided depending on the orientation of the display device 100, thereby providing an improved user experience.
[0198] Figure 8H This is a diagram illustrating an implementation that provides the same type of virtual keyboard even when the orientation of the display device changes.
[0199] Reference Figure 8H The display device 100 can display a second virtual keyboard 830 with a first keyboard type in landscape mode.
[0200] In this state, when the orientation of the display device 100 changes from landscape mode to portrait mode, the display device 100 can display a second virtual keyboard 830 of the same type as the first keyboard in portrait mode.
[0201] In this situation, when the keyboard type changes according to the orientation of the display device 100, the user may be confused about keyboard input due to the change in keyboard layout.
[0202] According to embodiments of this disclosure, when the second virtual keyboard 830 is displayed, even when the orientation of the display device 100 changes from landscape mode to portrait mode, the display device 100 can provide a virtual keyboard with the same keyboard type to prevent the user from being confused by keyboard input.
[0203] Similarly, when the second virtual keyboard 830 is displayed, the display device 100 can still display a virtual keyboard with the same keyboard type even when the orientation of the display device 100 changes from portrait mode to landscape mode.
[0204] Figure 9This is a flowchart illustrating a process of providing different screen brightness modes according to the type of user input, according to another embodiment of this disclosure.
[0205] Figure 9 The implementation method can be Figure 6 Detailed illustrations of steps S603 to S607.
[0206] Reference Figure 9 The controller 170 can determine whether the user input type is a remote control input type (S901).
[0207] When it is determined that the user input type is a remote control input type, the controller 170 can set the brightness mode of the display device 100 to the first screen brightness mode (S903).
[0208] When it is determined that the user input type is touch input (S905), the controller 170 can set the brightness mode of the display device 100 to the second screen brightness mode (S907).
[0209] The brightness modes of the display device 100 may include a first screen brightness mode for outputting a default brightness and a second screen brightness mode for outputting a brightness lower than the default brightness in order to save power.
[0210] Figure 10A and Figure 10B This is a diagram used to illustrate an example of providing different screen brightness modes based on the type of user input.
[0211] Reference Figure 10A When the user input type is remote control input, the display device 100 can display a first image 1001 with a first brightness on the display 180. At the same time, the display device 100 can display a first brightness pop-up window 1010 on the display 180, indicating that the display device operates in a first screen brightness mode corresponding to the default brightness.
[0212] Reference Figure 10B When the user input type changes to touch input type, the display device 100 can display a second image 1003 with a second brightness on the display 180. That is, when the user input type changes from remote control input type to touch input type, the brightness of the image can change from a first brightness to a second brightness.
[0213] The display device 100 may display a second brightness pop-up window 1030 on the display 180, which indicates that the display device operates in a second screen brightness mode. The second screen brightness mode is a power-saving mode, not the default brightness.
[0214] When the user input type is touch input, the brightness is reduced to prevent glare when the user is viewing the image due to the user being close to the display device 100.
[0215] As described above, according to embodiments of this disclosure, glare can be prevented by adjusting the output brightness of the image according to the type of user input when the user controls the input via touch.
[0216] In another embodiment, when touch input is received, instead of the brightness pop-up window 1030, the display device 100 may display a message asking to change the brightness mode or a brightness adjustment menu for adjusting the brightness.
[0217] Figure 11 This is a flowchart illustrating the process of providing images of different sizes based on the type of user input.
[0218] Figure 11 The implementation method can be Figure 6 Detailed illustrations of steps S603 to S607.
[0219] Reference Figure 11 The controller 170 can determine whether the user input type is a remote control input type (S1101).
[0220] When it is determined that the user input type is a remote control input type, the controller 170 may display a first image with a first size on the display 180 (S1103).
[0221] According to the implementation method, the first size can be the size of the entire screen of the display 180.
[0222] When it is determined that the user input type is touch input type (S1105), the controller 170 may display a second image with a second size smaller than the first image on the display 180 (S1107).
[0223] In one implementation, the second dimension may be 3 / 4 of the first dimension, but this is just an example.
[0224] Figure 12A and Figure 12B This is a diagram used to illustrate an example of providing different screen sizes based on the type of user input.
[0225] When the user input type is remote control input type, the display device 100 can display a first image 1210 with a first size on the display 180.
[0226] Reference Figure 12BWhen the user input type changes to touch input type, the display device 100 can display a second image 1230 with a second size smaller than the first size on the display 180. That is, when the user input type changes from remote control input type to touch input type, the size of the image can be reduced.
[0227] When the user input type is touch input, the image size is reduced because the image may not be clearly visible when the user is close to the display device 100.
[0228] As described above, according to embodiments of this disclosure, the size of the image is adjusted according to the type of user input so that the image can be clearly seen when controlled by the user's touch input.
[0229] According to another embodiment of this disclosure, when the user input type changes from remote control input type to touch input type, the display device 100 can reduce the size of the image from a first size to a second size, and at the same time reduce the brightness of the image from a first brightness to a second brightness.
[0230] That is, in Figure 11 In the implementation method, the following can be applied simultaneously: Figure 9 The implementation method.
[0231] Figures 13 to 14B This is a diagram used to describe an implementation that provides images of different sizes based on the type of user input.
[0232] Figure 13 The implementation method can be Figure 6 Detailed illustrations of steps S603 to S607.
[0233] exist Figures 13 to 14B In this implementation, it is assumed that the display device 100 provides a screen sharing (screen mirroring) service with the mobile device 880.
[0234] Reference Figure 13 The controller 170 can determine whether the user input type is a remote control input type (S1301).
[0235] When it is determined that the user input type is a remote control input type, the controller 170 may display a first mirror image with a first size on the display 180 (S1303).
[0236] According to the implementation method, the first size can be the size of the entire screen of the display 180.
[0237] The first mirror image may be an image corresponding to the image currently being displayed on the mobile device 880.
[0238] When it is determined that the user input type is touch input type (S1305), the controller 170 may display a second mirror image with a second size that is smaller than the first mirror image on the display 180 (S1307).
[0239] The second size could be a size that corresponds to 3 / 4 of the first size, but this is just an example.
[0240] Reference Figure 14A In portrait mode, the display device 100 may display a first mirror image 1410 on the display 180 before receiving touch input. Thereafter, when touch input is received, the display device 100 may switch from the first mirror image 1410 having a first size to a second mirror image 1430 having a second size.
[0241] This is to reduce the size of the mirrored image to facilitate touch input for users and to make the mirrored image easy to see at a glance.
[0242] Subsequently, the controller 170 can send the converted UIBC coordinate information corresponding to the touch input point on the second mirror image 1430 to the mobile device 880 via the wireless communication interface 173 (S1309).
[0243] The controller 170 can receive touch input for touching a point of the second mirror image 1430 and obtain the UIBC (User Input Reverse Channel) coordinates of the touch input point.
[0244] The user input reverse channel may be a channel for sending control signals to the mobile device 880 corresponding to touch inputs received by the display device 100 that receives images from the mobile device 880.
[0245] The controller 170 can convert the first UIBC coordinates of the touch point into second UIBC coordinates. The first UIBC coordinates can be the coordinates of the point on the first mirror image 1410 that receives the touch input, and the second UIBC coordinates can be the coordinates of the point on the second mirror image 1430, which is a scaled-down version of the first mirror image 1410.
[0246] The controller 170 can convert the first UIBC coordinates into second UIBC coordinates to match the image scaling ratio, and send the converted second UIBC coordinates to the mobile device 880. The mobile device 880 can select the corresponding point based on the received second UIBC coordinates.
[0247] Reference Figure 14B When the display device 100 receives touch input in landscape mode, the process of switching from the third mirror image 1450 being displayed to the fourth mirror image 1470 is shown.
[0248] Similar to Figure 14A In one implementation, the fourth mirror image 1470 may have a size that is scaled down compared to the third mirror image 1450.
[0249] Figures 15 to 16B An implementation method is shown for describing the operation based on whether or not the touch mode is maintained.
[0250] Figure 15 The implementation method can be Figure 6 Detailed illustrations of steps S603 to S607.
[0251] Reference Figure 15 The controller 170 can determine whether the user input type is a remote control input type (S1501).
[0252] When it is determined that the user input type is a remote control input type, the controller 170 may display a first image with a first size on the display 180 (S1503).
[0253] According to the implementation method, the first size can be the size of the entire screen of the display 180.
[0254] When it is determined that the user input type is touch input type (S1505), the controller 170 may display a second image with a second size smaller than the first image and a touch menu on the display 180 (S1507).
[0255] According to one embodiment, the touch menu may be a menu that provides a button for setting whether to maintain the touch mode. The display device 100 can receive one of an ON input for maintaining the touch mode and an OFF input for releasing the touch mode via the touch menu.
[0256] Touch mode is a mode in which the operation of the display device 100 is controlled via touch input. In touch mode, the image size can be reduced, and the image brightness can also be reduced.
[0257] Reference Figure 16A When a touch input is received, the display device 100 may display a scaled-down second image 1610 and an open touch menu 1620 on the display 180.
[0258] The controller 170 can determine whether an OFF input for turning off the touch mode is received (S1509), and when an OFF input is received, it switches from the reduced second image to the first image with the original size (S1511).
[0259] At the same time, the controller 170 can control the screen output to the original brightness of the first image.
[0260] The controller 170 can close the touch menu 1620 upon receiving an OFF input, and can switch from a scaled-down second image 1610 to a first image 1630 with the original size.
[0261] While applying the gradient effect, the scaled-down second image 1610 can be switched to the first image 1630.
[0262] In another implementation, even if no OFF input is received, the touch mode can be released when no touch input is received for a predetermined period of time.
[0263] As described above, according to embodiments of the present disclosure, when touch input is received, a selection option for maintaining the touch mode is provided to the user, thus allowing the user to more actively control the operation of the display device 100.
[0264] According to embodiments of this disclosure, the above method can be implemented on a medium containing a program using processor-readable code. Examples of processor-readable media include ROM (Read-Only Memory), Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
[0265] The display device described above is not limited to the configuration and method of the above embodiments, but can be configured by selectively combining all or part of the various embodiments, so that various modifications can be made.
Claims
1. A display device, the display device comprising: A display configured to display images; A user input interface configured to receive remote control input from a remote control. as well as A controller configured to receive user input, determine the type of the received user input, and adjust display properties based on the type of the received user input. Wherein, the type of user input is either remote control input or touch input, and The controller is configured as follows: When the user input type is the remote control input type, a first virtual keyboard with a first size is displayed on the screen, and When the user input type changes from the remote control input type to the touch input type, a second virtual keyboard with a second size smaller than the first size is displayed on the screen. The controller is configured to selectively shrink only the second virtual keyboard when switching from the first virtual keyboard to the second virtual keyboard, while maintaining the size of other display elements, including the search window. The second size is optimized for touch input operations located immediately adjacent to the display, while the first size is optimized for pointer-based operations located further away from the display.
2. The display device according to claim 1, wherein, The controller is configured to display a scaled-down image of the image and the second virtual keyboard around the point receiving the touch input on the display, and The second virtual keyboard is dynamically positioned based on the location of the touch input point to minimize hand movement during touch operations.
3. The display device according to claim 1, further comprising: A wireless communication interface configured to perform wireless communication with a mobile device. The controller is configured to set the keyboard type of the second virtual keyboard to the keyboard type set in the mobile device when the display device is connected to the mobile device.
4. The display device according to claim 1, wherein, The controller is configured to display a virtual keyboard with a preset keyboard type when a touch input is received while the display is in landscape mode, and to display a virtual keyboard with a keyboard type set in a mobile device connected to the display device when a touch input is received while the display is in portrait mode.
5. The display device according to claim 1, wherein, The controller is configured to output the image at a first brightness when the user input is of the remote control input type, and to output the image at a second brightness lower than the first brightness when the user input is of the touch input type. When touch input is detected, the second brightness is automatically set based on the inference that the user is close to the display, without the need for a separate distance sensor.
6. The display device according to claim 5, wherein, The controller is configured to display a first brightness pop-up window indicating that the image is output at the first brightness when the user input type is the remote control input type, and to display a second brightness pop-up window indicating that the image is output at the second brightness when the user input type is the touch input type.
7. The display device according to claim 5, wherein, The controller is configured to output the image at a first brightness when the user input type is the remote control input type, and to display a scaled-down image of the image while outputting the image at a second brightness that is less than the first brightness when the user input type changes to the touch input type. In this method, both size and brightness are adjusted simultaneously only based on the detection of a change in input type.
8. The display device according to claim 1, wherein, The controller is configured to zoom out and display an image displayed in the entire area of the display when the user input type changes from the remote control input type to the touch input type, and to convert the coordinate system of the entire area to the coordinate system of the zoomed-out image based on the zoom-out ratio and the point receiving the touch input.
9. The display device according to claim 8, wherein, The controller is configured to further display a touch menu for setting whether to maintain touch mode.
10. The display device according to claim 9, wherein, The controller is configured to restore the scaled-down image to its original size when the touch mode is released via the touch menu.
11. The display device according to claim 1, further comprising: A wireless communication interface configured to receive an image signal corresponding to a source image being displayed on the mobile device. The controller is configured to display a first mirrored image on the display based on the image signal, and to display a second mirrored image scaled down from the first mirrored image when the user input type changes from the remote control input type to the touch input type, and to simultaneously scale down the first virtual keyboard to the second virtual keyboard while scaling down the first mirrored image to the second mirrored image.
12. The display device according to claim 11, wherein, The controller is configured to convert the UIBC coordinates corresponding to the points of touch input received on the second mirror image to match the scale of the mirror image, and send the converted UIBC coordinates to the mobile device.
13. The display device according to claim 1, further comprising: A shaft that is connected to the rear surface of the display and extends vertically; as well as A bracket base that is connected to the lower end of the shaft.
14. A method of operating a display, the method comprising the following steps: Display image; Receive user input; Obtain the type of user input received; as well as The display properties are changed based on the type of user input obtained. Wherein, the type of user input is either remote control input or touch input, and The method further includes the following steps: When the user input type is the remote control input type, a first virtual keyboard with a first size is displayed on the display. When the user input type changes from the remote control input type to the touch input type, a second virtual keyboard with a second size smaller than the first size is displayed on the screen. The step of displaying the second virtual keyboard includes: Selectively shrink only the virtual keyboard while maintaining the size of other display elements, and The second size for touch input operations is optimized based on the inference of user proximity derived from the detection of the touch input type.
Citation Information
Patent Citations
Information display device
CN101382868A
Touch displayer, touch display device and brightness adjusting method thereof
CN105677089A
Image display device and onboard navigation device
JP2004252820A