Display device

Abstract

The present disclosure provides a display device having a user input unit that receives touch input, a display unit that outputs a screen provided by an application, and a display unit that determines whether the application supports touch input, and if the application does not support touch input, determines whether a mouse input function is supported, and performs a function corresponding to the touch input based on whether the mouse input function is supported.

Description

Technical Field

[0001] The present disclosure relates to a method for controlling a display device using touch input.

Background Art

[0002] A display device is a device having functions of receiving, processing, and displaying video that can be viewed by a user. The display device receives, for example, a broadcast signal selected by the user from among broadcast signals transmitted from a broadcasting station, separates a video signal from the received signal, and displays the separated video signal on the display again.

[0003] On the other hand, various applications such as those on a smartphone are also driven on a display device such as a TV, and there is a need for a method for controlling not only channel change and volume adjustment but also the running applications.

[0004] In addition, due to the diversification of user input methods, user input using a remote control device and user input by user touch input are provided. As a result, when the display device receives a user touch input, the display device can control the display device in such a way that it grasps the intention of the user of the touch input and executes the function intended by the user.

[0005] On the other hand, in order for an operation by touch input to be executed, not only the display device but also the application must be able to receive a function corresponding to the touch input. Although the display device can receive the touch input, if it does not provide a function corresponding to the touch input depending on the type of the currently running application, a problem occurs in that the function corresponding to the user touch input is not executed.

Summary of the Invention

Problems to be Solved by the Invention

[0006] An object of the present disclosure is to provide a display device that, when an application provided on the display device does not support a touch input function, converts a user's touch input into a mouse input and executes a command corresponding to the user touch input.

[0007] An object of the present disclosure is to provide a display device that, when an application provided on the display device does not support a touch input function, converts a user's touch input into a direction key input and executes a command corresponding to the user touch input.

Means for Solving the Problems

[0008] A display device according to an embodiment of the present disclosure includes a user input unit that receives a touch input, a display unit that outputs a screen provided from an application, determines whether to support a touch input of the application, and when the application does not support a touch input, determines whether to support a mouse input function, and based on whether to support the mouse input function, can execute a function corresponding to the touch input.

[0009] Further, the screen includes at least one content, and when the application supports a mouse input function, the control unit can convert the touch input into a mouse input and execute a function corresponding to the mouse input.

[0010] Further, when the touch input is a touch at a specific position, the control unit can convert the touch input into a mouse click input at the specific position and execute the mouse click input at the specific position.

[0011] Further, when the touch input is a long press input on the content, the control unit can convert the touch input into a long click input on the content and output detailed information on the content corresponding to the long click input on the content.

[0012] Further, when the touch input is a drag in a specific direction by touching a specific position, the control unit can convert the touch input into a mouse drag input in the specific direction by clicking on the specific position, and output a screen in which the specific position has moved in the direction corresponding to the specific direction.

[0013] Further, when the touch input is a drag in a specific direction by touching a specific position, the control unit can convert the touch input into a mouse drag input in the specific direction by clicking on the specific position, and output a screen in which the specific position has moved in the direction corresponding to the specific direction.

[0014] Further, the control unit arranges and outputs a plurality of contents included in one category in a specific direction. When the touch input is a drag in the specific direction by touching any one of the plurality of contents, the control unit can convert the touch input into a mouse drag input in the specific direction by clicking on the touched content, and output a screen in which the plurality of contents have moved in the specific direction.

[0015] Also, when the touch input is a drag in a specific direction after a long press input, the control unit can convert the touch input into a mouse drag input in the specific direction by clicking on the current time point of the content being played, and output the content in which the time point has advanced only in the specific direction from the current time point by the mouse drag input.

[0016] Further, the control unit outputs a progress bar representing the progress of content playback via the display unit. When the touch input is a drag in a specific direction by touching a specific point, the control unit can convert the touch input into a mouse drag input in the specific direction by clicking on the progress bar, and output the content in which the time point has advanced only in the specific direction from the current time point. Further, the control unit can output a guide window for guiding the mouse input function corresponding to the touch input.

[0017] Further, the guide window can include at least one of a guide image for guiding the movement of the user's hand and a guide image for the screen movement direction corresponding to the "mouse input function corresponding to the user input".

[0018] Further, the screen includes at least one content, and when the application does not support the mouse input function, the control unit can convert the touch input into a direction key input and execute a function corresponding to the direction key input.

[0019] Also, when the touch input is a touch at a specific position, the control unit can convert the touch input into a selection input at the specific position and execute the selection input at the specific position.

[0020] Also, when the touch input is a drag in a specific direction by touching a specific position, the control unit can convert it into a direction key input in a first direction corresponding to the opposite direction of the specific direction, and output a screen in which the specific position has moved in the direction corresponding to the specific direction.

[0021] Further, the control unit arranges and outputs a plurality of contents included in one category in a specific direction. When the touch input is a drag in the specific direction by touching any one of the plurality of contents, the control unit selects the touched content, converts the touch input into a direction key input in a first direction corresponding to the opposite direction of the specific direction, and can output a screen in which the plurality of contents have moved in the specific direction.

[0022] Also, when the touch input is a drag in a specific direction after a long press input, the control unit can select the current time point of the content being played for the touch input, convert it into a direction key input in the specific direction, and output the content whose time point has advanced by only the direction key input in the specific direction from the current time point.

[0023] In addition, the control unit outputs a progress bar indicating the progress of content playback via the display unit. When the user input touches a specific point on the progress bar and is dragged in a specific direction, it is determined as a direction key input in the first direction corresponding to the specific direction, and content can be output in which the time point has advanced by only the direction key input from the specific time point of the content in the specific direction.

[0024] In addition, the control unit can output a guide window for guiding the direction key input function corresponding to the user input.

[0025] In addition, the guide window can include at least one of a guide image for guiding the movement of the user's hand and a guide image for the screen movement direction corresponding to the "direction key input function corresponding to the user input".

[0026] In addition, the screen further includes a scroll bar that can be scrolled. When the touch input touches a specific area of the scroll bar and is dragged in a specific direction, the control unit converts the touch input into a mouse drag input by clicking on the specific area of the scroll bar and outputs a screen scrolled in the specific direction.

[0027] In addition, when the touch input touches a specific area of the scroll bar and is dragged in a specific direction, the control unit selects the specific area of the scroll bar, converts the touch input into a direction key input in the specific direction, and outputs a screen scrolled in the specific direction.

Advantages of the Invention

[0028] According to the embodiments of the present disclosure, even when an application that does not support touch installed in the display device is executed on the display device that supports touch input, the display device can be controlled to execute an instruction corresponding to the user's touch input by converting it into a mouse input or a direction key input.

[0029] According to an embodiment of the present disclosure, a guide indicating that touch input is being executed can be provided, and a notification that touch input is possible can be provided even in an application that does not assist the user with touch.

Brief Description of the Drawings

[0030]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Embodiments for Carrying Out the Invention

[0031] Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings. The suffixes “module” and “unit” for the components used in the following description are given or mixed for the purpose of facilitating the preparation of the specification, and do not have meanings or roles that are mutually distinguishable by themselves.

[0032] FIG. 1 is a block diagram showing the configuration of a display device according to an embodiment of the present invention.

[0033] Referring to FIG. 1, the display device 100 may include a broadcast receiving unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, a wireless communication unit 173, an audio acquisition unit 175, a display unit 180, an audio output unit 185, and a power supply unit 190.

[0034] The broadcast receiving unit 130 may include a tuner 131, a demodulation unit 132, and a network interface unit 133.

[0035] The tuner 131 can select a specific broadcast channel in response to a channel selection command. The tuner 131 can receive a broadcast signal for the selected specific broadcast channel.

[0036] The demodulation unit 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0037] The network interface unit 133 can provide an interface for connecting the display device 100 to a wired / wireless network including the Internet. The network interface unit 133 can transmit and receive data to / from other users or other electronic devices via the connected network or another network linked to the connected network.

[0038] The network interface unit 133 can connect to a predetermined web page via the connected network or another network linked to the connected network. That is, it can connect to a predetermined web page via the network and transmit or receive data to / from the server.

[0039] And the network interface unit 133 can receive content or data provided by a content provider or a network operator. That is, the network interface unit 133 can receive content such as movies, advertisements, games, VOD, broadcast signals, etc. and related information provided from a content provider or a network provider via the network.

[0040] Also, the network interface unit 133 can receive firmware update information and update files provided by a network operator and can transmit data to the Internet or a content provider or a network operator.

[0041] The network interface unit 133 can select and receive a desired application from an application publicly open to the public via the network.

[0042] The external device interface unit 135 can receive an application or an application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

[0043] The external device interface unit 135 can provide a connection path between the display device 100 and an external device. The external device interface unit 135 can receive one or more of video and audio output from an external device connected to the display device 100 wirelessly or wiredly, and transmit them to the control unit 170. The external device interface unit 135 can include a plurality of external input terminals. The plurality of external input terminals can include RGB terminals, one or more HDMI (High Definition Multimedia Interface) terminals, and component terminals.

[0044] The video signal of the external device input via the external device interface unit 135 is output via the display unit 180. The audio signal of the external device input via the external device interface unit 135 is output via the audio output unit 185.

[0045] The external device connectable to the external device interface unit 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is merely an example.

[0046] Also, a part of the content data stored in the display device 100 can be transmitted to a selected user or a selected electronic device among other pre-registered users or other electronic devices of the display device 100.

[0047] The storage unit 140 can store programs for each signal processing and control in the control unit 170, and can store signal-processed video, audio, or data signals.

[0048] In addition, the storage unit 140 can also function for temporarily storing video, audio, or data signals input from the external device interface unit 135 or the network interface unit 133, and can also store information related to a predetermined image via the channel storage function.

[0049] The storage unit 140 can store an application or an application list input from the external device interface unit 135 or the network interface unit 133.

[0050] The display device 100 can reproduce content files (such as video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

[0051] The user input interface unit 150 can transmit a signal input by the user to the control unit 170 or transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device 200 according to various communication methods such as Bluetooth, WB (Ultra Wideband), ZigBee, RF (Radio Frequency) communication method, or infrared (IR) communication method, or process the control signal from the control unit 170 to be transmitted to the remote control device 200.

[0052] In addition, the user input interface unit 150 can transmit a control signal input from local keys (not shown) such as a power key, a channel key, a volume key, and set values to the control unit 170.

[0053] The video signal processed by the control unit 170 is input to the display unit 180 and is displayed as a video corresponding to the video signal. In addition, the video signal processed by the control unit 170 is input to an external output device via the external device interface unit 135.

[0054] The audio signal processed by the control unit 170 is output as audio by the audio output unit 185. Also, the audio signal processed by the control unit 170 is input to an external output device via the external device interface unit 135.

[0055] Also, the control unit 170 can control the overall operation within the display device 100.

[0056] Also, the control unit 170 can control the display device 100 according to a user command or an internal program input via the user input interface unit 150, and can connect to a network to download an application or a list of applications desired by the user into the display device 100.

[0057] The control unit 170 causes the display unit 180 or the audio output unit 185 to output the video or audio signal processed together with the channel information etc. selected by the user.

[0058] Also, the control unit 170 causes a video signal or an audio signal from an external device, such as a camera or a video camera, input via the external device interface unit 135 to be output via the display unit 180 or the audio output unit 185 in response to an external device video playback command received via the user input interface unit 150.

[0059] On the other hand, the control unit 170 can control the display unit 180 to display video. For example, it can control the broadcast video input via the tuner 131, the external input video input via the external device interface unit 135, the video input via the network interface unit, or the video stored in the storage unit 140 to be displayed on the display unit 180. In this case, the video displayed on the display unit 180 may be a still image or a moving image, and may be a 2D video or a 3D video.

[0060] In addition, the control unit 170 can control the content stored in the display device 100, the received broadcast content, or the external input content input from the outside to be played. The content can have various forms such as broadcast video, external input video, audio file, still video, connected web screen, and document file.

[0061] The wireless communication unit 173 can communicate with an external device via wired or wireless communication. The wireless communication unit 173 can perform short-range communication with the external device. For this purpose, the wireless communication unit 173 can support short-range communication by using at least one of Bluetooth (registered trademark), BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association: IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. In this way, the wireless communication unit 173 can support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the network where the display device 100 (or an external server) is located via a short-range wireless communication network. The short-range wireless communication network may be a WPAN (Wireless Personal Area Networks).

[0062] Here, the other display device 100 may be a wearable device (e.g., a smartwatch, smart glass, head mounted display (HMD)) or a mobile terminal such as a smartphone that can exchange data (or be interlocked) with the display device 100 according to the present invention. The wireless communication unit 173 can sense (or recognize) a wearable device capable of communication around the display device 100. Further, when the sensed wearable device is an authenticated device that communicates with the display device 100 according to the present invention, the control unit 170 can transmit at least a part of the data processed by the display device 100 to the wearable device via the wireless communication unit 173. Therefore, the user of the wearable device can use the data processed by the display device 100 via the wearable device.

[0063] The audio acquisition unit 175 can acquire audio. The audio acquisition unit 175 can include at least one microphone (not shown), and can acquire the audio around the display device 100 via the microphone (not shown).

[0064] The display unit 180 can convert the video signal, data signal, OSD signal processed by the control unit 170 or the video signal, data signal, etc. received by the external device interface unit 135 into R, G, B signals respectively to generate a drive signal.

[0065] On the other hand, the display device 100 illustrated in FIG. 1 is only one embodiment of the present invention, and some of the illustrated components can be integrated, added or omitted according to the specifications of the display device 100 actually implemented.

[0066] That is, two or more components may be integrated as one component as necessary, or one component may be subdivided into two or more components. Also, the functions performed by each block are for explaining the embodiments of the present invention, and the specific operations and devices thereof do not limit the scope of the rights of the present invention.

[0067] According to still another embodiment of the present invention, the display device 100, unlike that shown in FIG. 1, does not include a tuner 131 and a demodulation unit 132, and can also receive and reproduce video via a network interface unit 133 or an external device interface unit 135.

[0068] For example, the display device 100 may be separated and embodied as a video processing device such as a set-top box for receiving content by a broadcast signal or various network services, etc., and a content playback device for playing back the content input from the video processing device.

[0069] In this case, the operation method of the display device according to the embodiment of the present invention described below may be executed not only by the display device 100 as described with reference to FIG. 1, but also by any one of a separated video processing device such as a set-top box or a content playback device including a display unit 180 and an audio output unit 185.

[0070] The audio output unit 185 receives the signal processed by the control unit 170 for audio and outputs it as audio.

[0071] The power supply unit 190 supplies power to the entire display device 100. In particular, it can supply power to the control unit 170 that can be embodied in the form of a System On Chip (SOC), the display unit 180 for video display, the audio output unit 185 for audio output, etc.

[0072] Specifically, the power supply unit 190 can include a converter that converts an AC power supply into a DC power supply, and a DC / DC converter that converts the level of the DC power supply.

[0073] Next, with reference to FIGS. 2 to 3, a remote control device according to an embodiment of the present invention will be described.

[0074] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present invention, and FIG. 3 shows an actual configuration example of the remote control device according to an embodiment of the present invention.

[0075] First, referring to FIG. 2, the remote control device 200 can include a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, a control unit 280, and an audio acquisition unit 290. Referring to FIG. 2, the wireless communication unit 220 transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0076] The remote control device 200 can include an RF module 221 that can transmit and receive signals with the display device 100 according to the RF communication standard, and an IR module 223 that can transmit and receive signals with the display device 100 according to the IR communication standard. Further, the remote control device 200 can include a Bluetooth module 225 that can transmit and receive signals with the display device 100 according to the Bluetooth communication standard. Further, the remote control device 200 can include an NFC (Near Field Communication) module 227 that can transmit and receive signals with the display device 100 according to the NFC communication standard, and a WLAN (Wireless LAN) module 229 that can transmit and receive signals with the display device 100 according to the WLAN communication standard.

[0077] In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 via the wireless communication unit 220.

[0078] On the one hand, the remote control device 200 can receive the signal transmitted by the display device 100 via the RF module 221, and can transmit commands related to power on / off, channel change, volume change, etc. to the display device 100 via the IR module 223 as necessary.

[0079] The user input unit 230 may be composed of a keypad, buttons, a touch pad, a touch screen, or the like. The user can operate the user input unit 230 to input commands related to the display device 100 on the remote control device 200. When the user input unit 230 includes hard keys, the user can input commands related to the display device 100 on the remote control device 200 through the push operation of the hard keys. This will be described with reference to FIG. 3.

[0080] Referring to FIG. 3, the remote control device 200 can include a plurality of buttons. The plurality of buttons can include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume adjustment button 235, a voice recognition button 236, a channel change button 237, a confirmation button 238, and a return button 239.

[0081] The fingerprint recognition button 212 may be a button for recognizing the user's fingerprint. As an example, the fingerprint recognition button 212 can be pushed and can also receive the push operation and the fingerprint recognition operation. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a live broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume adjustment button 235 may be a button for adjusting the volume output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to the previous screen.

[0082] Redescribe FIG. 2. When the user input unit 230 includes a touch screen, the user can touch the soft keys on the touch screen to input commands related to the display device 100 with the remote control device 200. Also, the user input unit 230 can include various types of input means that can be operated by the user, such as scroll keys and jog keys, and this embodiment does not limit the scope of the rights of the present invention.

[0083] The sensor unit 240 can include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 can sense information related to the movement of the remote control device 200.

[0084] For example, the gyro sensor 241 can sense information regarding the operation of the remote control device 200 with reference to the x, y, and z axes, and the acceleration sensor 243 can sense information regarding the moving speed etc. of the remote control device 200. On the other hand, the remote control device 200 can further include a distance measurement sensor, and can sense the distance to the display unit 180 of the display device 100.

[0085] The output unit 250 can output a video or audio signal corresponding to the operation of the user input unit 230 or to the signal transmitted from the display device 100. Through the output unit 250, the user can recognize the presence or absence of the operation of the user input unit 230 or the presence or absence of the control of the display device 100.

[0086] For example, when the user input unit 230 is operated or a signal is transmitted and received with the display device 100 via the wireless communication unit 220, the output unit 250 can include an LED module 251 that lights up, a vibration module 253 that generates vibration, an acoustic output module 255 that outputs sound, or a display module 257 that outputs video.

[0087] Also, the power supply unit 260 supplies power to the remote control device 200, and when the remote control device 200 has not moved for a predetermined time, it can reduce power waste by interrupting the power supply. The power supply unit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

[0088] The storage unit 270 can store various types of programs, application data, etc. necessary for the control or operation of the remote control device 200. If the remote control device 200 wirelessly transmits and receives signals with the display device 100 via the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals via a predetermined frequency band.

[0089] The control unit 280 of the remote control device 200 can store in and refer to the storage unit 270 information regarding the frequency band etc. that enables wireless transmission and reception of signals with the display device 100 paired with the remote control device 200.

[0090] The control unit 280 controls various matters related to the control of the remote control device 200. The control unit 280 can transmit, via the wireless communication unit 220, a signal corresponding to a predetermined key operation of the user input unit 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 to the display device 100.

[0091] Also, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

[0092] The voice acquisition unit 290 can include at least one or more microphones 291, and can acquire voice via the microphones 291.

[0093] Next, FIG. 4 will be described. FIG. 4 shows an example of utilizing the remote control device according to an embodiment of the present invention. FIG. 4(a) exemplifies that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

[0094] The user can move the remote control device 200 up and down, left and right, or rotate it. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. Such a remote control device 200 can be named a spatial remote control because, as shown in the drawing, the pointer 205 moves and is displayed according to the movement in the 3D space.

[0095] FIG. 4(b) exemplifies that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left correspondingly.

[0096] Information regarding the movement of the remote control device 200 sensed via the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the pointer 205 from the information regarding the movement of the remote control device 200. The display device 100 can display the pointer 205 so as to correspond to the calculated coordinates.

[0097] FIG. 4(c) illustrates a case where the user moves the remote control device 200 away from the display unit 180 while a specific button in the remote control device 200 is pressed. As a result, the selection area in the display unit 180 corresponding to the pointer 205 is zoomed in and enlarged for display.

[0098] Conversely, when the user moves the remote control device 200 closer to the display unit 180, the selection area in the display unit 180 corresponding to the pointer 205 is zoomed out and reduced for display.

[0099] On the other hand, when the remote control device 200 moves away from the display unit 180, the selection area is zoomed out, and when the remote control device 200 moves closer to the display unit 180, the selection area is zoomed in.

[0100] Also, when a specific button in the remote control device 200 is pressed, the recognition of up, down, left, and right movements is excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, the up, down, left, and right movements are not recognized, and only the forward and backward movements can be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves in response to the up, down, left, and right movements of the remote control device 200. On the other hand, the movement speed and movement direction of the pointer 205 can correspond to the movement speed and movement direction of the remote control device 200.

[0101] On the one hand, the pointer in this specification means an object displayed on the display unit 180 corresponding to the operation of the remote control device 200. Therefore, objects of various shapes are possible in addition to the arrow shape illustrated in the drawing by the pointer 205. For example, concepts including a point, a cursor, a prompt, a thick frame line, etc. are included. And it is possible for the pointer 205 to be displayed corresponding to a point on either the horizontal axis or the vertical axis on the display unit 180, and it is also possible to be displayed corresponding to a plurality of points such as a line or a surface.

[0102] Hereinafter, the operation flowchart of the display device according to the embodiment of the present disclosure will be described.

[0103] First, the display device 100 according to the embodiment of the present disclosure can further include a user input unit 120.

[0104] The user input unit 120 can include mechanical input means (or mechanical keys, for example, buttons located on the front / back surface or side surface of the AI device 100, dome switches, jog wheels, jog switches, etc.) and touch input means.

[0105] As an example, the touch input means can consist of virtual keys, soft keys, or visual keys displayed on the touch screen by software processing, or can consist of touch keys arranged on a part other than the touch screen.

[0106] Alternatively, the display device 100 can also receive the user touch input received by the display unit corresponding to the touch input means of the user input unit 120.

[0107] That is, the user can provide a touch input to the user input unit 120 by touching the display unit of the display device 100, and the control unit can receive the touch input from the user via the user input unit 120.

[0108] FIG. 5 shows an operation flowchart of a display device according to an embodiment of the present disclosure.

[0109] Referring to FIG. 5, the display device 100 can execute an application (S510). Specifically, an application can provide at least one or more video contents, and the application may be stored in the storage unit 140 of the display device, or provided from a server or a set-top box connected to the display device.

[0110] For example, the application can include video and image contents, a web browser, a smart guide, external input contents connected separately by cable or wirelessly, and the like.

[0111] When the application is executed via the display unit, the control unit 170 of the display device 100 can output the screen provided by the application. The control unit 170 according to the embodiment of the present disclosure can determine whether the application supports touch input (S520).

[0112] First, an application can be classified into an application that provides a function of executing an instruction corresponding to the touch input when receiving the touch input, and an application that does not provide a function of executing an instruction corresponding to the touch input.

[0113] When a specific application is being executed in the OS currently operating on the display device, if a touch input is received on the screen output by the specific application, the control unit 170 according to an embodiment of the present disclosure can determine whether the running application supports the touch input and can determine whether the application provides a function of executing an instruction corresponding to the touch input.

[0114] Generally, since the OS installed in the display device 100 stores application information of the executed applications, the control unit 170 can determine whether the application provides a function of executing an instruction corresponding to the touch input by using the application information.

[0115] At this time, the application information can include various information necessary for application operation, such as application type, installation date, function, unique number, etc.

[0116] The control unit 170 according to an embodiment of the present disclosure can determine whether to assist the touch input by using the application information included in the application executed by the OS.

[0117] When the running application supports the touch input, the control unit 170 according to an embodiment of the present disclosure can receive the user's touch input via the input unit 120 and execute the function corresponding to the touch input (S531).

[0118] On the other hand, when the running application does not support the touch input (S520), the control unit 170 according to an embodiment of the present disclosure analyzes the user's touch input (S530) and can execute the function corresponding to the touch input based on whether the application supports the mouse input function (S540).

[0119] Specifically, when the application supports the mouse input function, the control unit can convert the touch input into a mouse input and execute the function corresponding to the mouse input (S552, S562).

[0120] Also, when the application does not support the mouse input function, the control unit can convert the touch input into a direction key input and execute the function corresponding to the direction key input (S551, S561).

[0121] Hereinafter, the types of user touch inputs according to the embodiments of the present disclosure will be described, and the corresponding screen movement and content playback will be described.

[0122] First, the control unit 170 according to the embodiments of the present disclosure can analyze a user's touch input (S530).

[0123] At this time, the user touch input analysis can mean analyzing the function corresponding to the user touch input input via the display unit 180 or the user touch input input via the input unit in the display device that provides the touch input.

[0124] The control unit 170 can analyze the user touch input and recognize various user touch inputs such as a specific position touch, a drag after a specific position touch, a long press at a specific position, a drag after a progress bar touch, and a drag after a scroll bar touch.

[0125] FIG. 6 is a drawing showing screen movement by a drag input after touch according to an embodiment of the present disclosure.

[0126] First, when an application is executed on the display device 100, the control unit 170 of the display device can output a screen provided by the application including at least one or more contents.

[0127] The user can input a touch input to the screen.

[0128] When the touch input of the user is a touch at a specific position on the screen, the control unit 170 according to an embodiment of the present disclosure can convert the touch input into a mouse click input at the specific position and execute the mouse click input at the specific position.

[0129] For example, when a user touch input is received for the first content 613 on the screen 610, the control unit 170 can convert the touch input into a click input for the first content 613, recognize it, and execute the first content 613. Also, the user can perform a drag input after touching a specific position for moving the screen.

[0130] When the touch input of the user is a touch at the specific position 611 and a drag in the specific direction 612, the control unit 170 according to an embodiment of the present disclosure can convert the touch input into a mouse click at the specific position 611 and a mouse drag input in the specific direction 612, and output a screen in which the specific position is moved in the direction corresponding to the specific direction 612.

[0131] For example, as shown in FIG. 6(a), when the touch input of the user is a touch at the specific position 611 and a drag in the specific direction 612, the control unit 170 can click the specific position 611 and convert it into a mouse drag input in the specific direction 612 for recognition.

[0132] Referring to FIG. 6(b), in response to the mouse input, the control unit can output a screen 630 in which the specific position 611 is moved in the direction corresponding to the specific direction 612.

[0133] Content 631 different from the first content 611 is output on the moved screen 630.

[0134] Describe the case where the application does not provide a mouse input function according to another embodiment of the present disclosure.

[0135] When the touch input of the user is a touch at a specific position, the control unit 170 according to an embodiment of the present disclosure can convert the touch input into a selection input at the specific position and execute the selection input at the specific position.

[0136] For example, when a user touch input is received for the first content 613 on the screen, the control unit 170 can convert the touch input into a selection input for the first content 613, recognize it, and execute the first content. In addition, the user can perform a drag input after touching a specific position for moving the screen.

[0137] When the touch input of the user is a touch at the specific position 611 and a drag in the specific direction 612, the control unit 170 according to an embodiment of the present disclosure can convert it into a direction key input in the first direction corresponding to the opposite direction of the specific direction 612, and output a screen in which the specific position 611 is moved in the direction corresponding to the specific direction 612.

[0138] For example, as shown in FIG. 6(a), when the touch input of the user is a touch at the specific position 611 and a drag in the specific direction 612, the control unit can select the specific position 611 and convert it into a direction key input in the first direction corresponding to the opposite direction of the specific direction 612 for recognition.

[0139] Referring to FIG. 6(b), in response to the direction key input in the first direction, the control unit 170 can output a screen 630 in which the specific position 611 is moved in the direction corresponding to the specific direction 612.

[0140] That is, according to the embodiment of the present disclosure, it can be seen that the screen movement and content execution output results corresponding to the user touch input are similar to those of the mouse input function and the direction key input function.

[0141] FIG. 7 is a drawing showing content movement by drag input after touch according to an embodiment of the present disclosure.

[0142] First, a case where the application supports the mouse input function will be described.

[0143] Referring to FIG. 7, when a plurality of contents are grouped by category, the user can input a drag touch input to convert the focused content to other content or view a plurality of content lists included in the category.

[0144] Specifically, the control unit 170 of the display device 100 can arrange and output a plurality of contents included in one category in a specific direction.

[0145] At this time, when the touch input of the user touches any one of the plurality of contents and is a drag in the specific direction, the control unit can click the content touched by the touch input and convert it into a mouse drag input in the specific direction.

[0146] The control unit 170 can output a screen in which the plurality of contents are moved in a specific direction via the display unit 180.

[0147] For example, on the screen 710 of FIG. 7(a), contents 713 and 714 grouped in similar categories are output.

[0148] The user can input a drag input in the specific direction 712 while touching the specific position 711 to view a plurality of content lists included in the category.

[0149] At this time, the specific position 711 may be any one (713) of the contents grouped in similar categories.

[0150] The control unit 170 according to an embodiment of the present disclosure can convert the touch input into a mouse drag input in a specific direction 712 while clicking on a specific position 711.

[0151] Thereafter, as shown in FIG. 7(b), the control unit 170 can output a screen 730 in which the plurality of contents 713, 714 are moved in the specific direction 712.

[0152] Hereinafter, a case where the application supports a direction key input function will be described.

[0153] According to another embodiment of the present disclosure, when the user touch input touches any one of the plurality of contents and is a drag in the specific direction, the control unit 170 selects the touched content for the touch input, converts it into a direction key input in a first direction corresponding to the direction opposite to the specific direction, and can output a screen in which the plurality of contents are moved in the specific direction.

[0154] Referring to FIG. 7(a) as described above, the user can input a drag input in a specific direction 712 while touching a specific position 711 to view a plurality of content lists included in the category.

[0155] The control unit 170 according to an embodiment of the present disclosure can convert the touch input into a direction key input in a first direction corresponding to the direction opposite to the specific direction 712 while selecting the specific position 711.

[0156] Thereafter, the control unit 170 can output a screen 730 in which the plurality of contents 713, 714 are moved in the specific direction 712.

[0157] FIG. 8 is a drawing showing a screen according to a long press input according to an embodiment of the present disclosure.

[0158] According to an embodiment of the present disclosure, when the user touch input is a drag in a specific direction after a long press input on specific content, the control unit 170 can output detailed information about the specific content on the screen.

[0159] Specifically, when the running application provides a mouse input function, the control unit 170 can convert the touch input into a long click input on the content, and output detailed information about the content corresponding to the long click input on the content.

[0160] At this time, the long click input can be meant as an input that maintains the mouse click state for a certain period of time or more.

[0161] Referring to FIGS. 8(a) and 8(b), when the control unit 170 receives a long press input 811 of the user on specific content 810, the control unit 170 can convert the long press input into a long click input on the content 810, and output a detailed information window 820 about the content.

[0162] At this time, when the content is a video, the detailed information window can include at least one of information such as a title, a playback time, a date, a trailer, a producer, playback, and a preview for the content.

[0163] FIG. 9 is a drawing showing a guide window for guiding screen movement according to an embodiment of the present disclosure.

[0164] Although it is an application that does not support touch input according to an embodiment of the present disclosure, an operation by touch input is executed. Therefore, the display device 100 can output a guide informing the user that the touch input is converted into a mouse input function or a direction key input function and executed.

[0165] Specifically, referring to FIGS. 9(a) and 9(b), when the user inputs a touch input at a specific position 911 with respect to the first content 910, the control unit 170 can output a guide window 920 for guiding the mouse input function corresponding to the touch input.

[0166] For example, in the case of an application that provides a mouse input function, the guide window can include at least one of a guide image 921 for guiding the movement of the user's hand, a cursor guide image 922 indicating that the mouse input function is being executed, and a guide image 923 indicating that the current touch input is being received.

[0167] Also, when the mouse input function corresponds to a mouse drag, it is also possible to output a guide image for the screen movement direction.

[0168] FIG. 10 is a drawing showing a guide window for guiding screen movement according to an embodiment of the present disclosure.

[0169] According to another embodiment of the present disclosure, in the case of an application that provides a direction key input function, the control unit 170 can output a guide window 1120 for guiding the direction key input function corresponding to the user input.

[0170] Specifically, when a drag input is received in a specific direction 1012 after the user touches a specific position 1011 with respect to the first content 1010, the control unit 170 can output the guide window 1020 for guiding the direction key input.

[0171] The guide window 1020 for guiding the direction key input can include at least one of a guide image 1021 for guiding the movement of the user's hand and a guide image 1022 for the screen movement direction corresponding to the "direction key input function corresponding to the user input".

[0172] In addition, when the control unit 170 moves the screen in a specific direction in response to a user's touch input, it is also possible to activate and represent the direction key in that direction.

[0173] FIG. 11 is a drawing showing screen movement during touch input according to an embodiment of the present disclosure.

[0174] On the other hand, on the screen provided by the application, a tool that makes it easy to move the screen, such as a scroll bar, may be provided. The operation of the control unit when the user inputs a touch input to the scroll bar to move the screen provided by the application will be described.

[0175] First, the case where the application provides a mouse input function will be described. When the touch input of the user during execution by the control unit 170 according to the embodiment of the present disclosure is an input that touches a specific area of the scroll bar and drags it in a specific direction, the touch input is converted into a mouse drag input in the specific direction by clicking on the specific area of the scroll bar, and a screen scrolled in the specific direction can be output.

[0176] For example, referring to FIG. 11, the screen can include a scroll bar 1110. When the touch input of the user is an input that touches a specific area 1111 of the scroll bar 1110 and drags it in a specific direction 1112, the control unit 170 can convert it into a mouse drag input in the specific direction 1112 while clicking on the specific area 1111 and output a screen scrolled in the specific direction 1112.

[0177] At this time, the degree of scrolling may be set to vary according to the drag intensity in the specific direction 1112 of the user.

[0178] Hereinafter, the case where the application provides a direction key input function will be described.

[0179] When the touch input of the user during execution touches a specific area of the scroll bar and drags in a specific direction, the control unit 170 according to another embodiment of the present disclosure can select the specific area of the scroll bar for the touch input, convert it into a direction key input in the specific direction, and output a screen scrolled in the specific direction.

[0180] For example, referring to FIG. 12, when the touch input of the user touches a specific area 1111 of the scroll bar 1110 and drags in a specific direction 1112, the control unit 170 can convert it into a direction key input in the specific direction 1112 while selecting the specific area 1111, and output a screen scrolled in the specific direction 1112.

[0181] Similarly, the degree of scrolling may be set to vary according to the dragging strength of the user in the specific direction 1112.

[0182] On the other hand, when the touch input touches a specific area of the scroll bar and the drag input is converted into a mouse input function or a direction key input function, the control unit 170 can output a guide window 1130 indicating that the screen is moving in a specific direction.

[0183] As described above, a guide image corresponding to the moving direction of the screen may be activated and displayed in the guide window 1130.

[0184] In FIGS. 12 to 14 below, when the content is being played, an embodiment of setting the playback time point according to the touch input of the user will be described.

[0185] FIG. 12 is a drawing showing the movement of the playback time point at the time of touch input according to an embodiment of the present disclosure.

[0186] Referring to FIG. 12, the control unit 170 can play the content included in the application. At this time, the content may be video or image data having a certain playback time.

[0187] The user can input various touch inputs for pausing, fast-forwarding, rewinding, and moving to a specific point during content playback.

[0188] When the touch input of the user is a drag in a specific direction after a long press input, the control unit 170 according to an embodiment of the present disclosure can click the current time point of the content being played for the touch input and convert it into a mouse drag input in the specific direction, and output the content in which the time point has advanced only by the mouse drag input in the specific direction from the current time point.

[0189] For example, referring to FIG. 12, content 1210 is being played on the display unit 180. When the user drags a specific position 1211 of the content in a specific direction 1212 (for example, the right direction) after a long press input, the control unit 170 can recognize by converting the touch input into a mouse drag input in the right direction while clicking the current time point of the content being played.

[0190] The control unit 170 can output the content 1220 in which the time point has advanced (1213) only by the mouse drag input in the right direction from the current time point.

[0191] On the other hand, as shown in FIG. 13, the control unit 170 can output a progress bar 1310 representing the progress of content playback via the display unit 180. Similar to the above, when the touch input of the user is a touch on a specific point 1311 and a drag in a specific direction 1312, the control unit 170 can click the progress bar 1310 at the current time point for the touch input and convert it into a mouse drag input in the specific direction to recognize.

[0192] In addition, the control unit 170 can output a progress bar 1313 in which the time point has advanced by the drag intensity in the specific direction from the current time point 1311, and output the content at the time point corresponding to the progress bar 1313.

[0193] Another embodiment of the present disclosure will be described in the case where an application provides a direction key input.

[0194] When the control unit 170 according to the embodiment of the present disclosure receives a drag in a specific direction after the touch input is a long press input, the control unit 170 can select the current time point of the content being played for the touch input and convert it into a direction key input in the specific direction. In addition, the control unit 170 can output the content whose time point has advanced only by the direction key input in the specific direction 1312 from the current time point.

[0195] In addition, the control unit 170 outputs a progress bar 1310 representing the progress of content playback via the display unit 180. When the user input touches a specific time point 1311 on the progress bar and drags in a specific direction 1312, it is determined as a direction key input in the first direction corresponding to the specific direction 1312, and the control unit 170 can output the content whose time point has advanced only by the direction key input in the specific direction from the specific time point of the content.

[0196] For example, when touching a specific time point 1311 on the progress bar and dragging to the right, as shown in FIG. 13, the control unit 170 can output the content 1320 whose time point has advanced only by the direction key input to the right from the specific time point 1311 of the content 1310 being played.

[0197] Hereinafter, a guide window for a mouse input function or a direction key input function will be described according to the movement of the playback time point.

[0198] Referring to FIG. 13, when the mouse input function is executed, the control unit 170 can output a guide window 1320 for guiding the user to move the playback time point via the display unit 180.

[0199] The guide window 1320 according to an embodiment of the present disclosure can include at least one of a hand movement guide image 1321, a cursor guide image 1322, and an image 1323 that guides that the time point is moving in a direction corresponding to a specific direction 1312 in accordance with a mouse input function.

[0200] When the user touches the current time point 1310 of the progress bar via the display unit 180 and drags it in a specific direction to the subsequent time point 1313, the control unit 170 can output an effect 1323 in which the hand movement guide image and the cursor guide image included in the guide window 1320 move.

[0201] The above embodiment can be similarly applied not only to a mouse input function but also to an application that provides a direction key input function.

[0202] FIG. 14 is a drawing showing movement of a reproduction time point at the time of touch input according to an embodiment of the present disclosure.

[0203] Referring to FIG. 14, when the direction key input function is executed, the control unit 170 can output a guide window 1420 for guiding the user to move the reproduction time point via the display unit 180.

[0204] The guide window 1420 according to an embodiment of the present disclosure can include a hand movement guide image 1421 and a direction key guide image 1422 in accordance with a direction key input function.

[0205] The control unit 170 not only when the user touches the current time point of the progress bar via the display unit 180 and drags it in a specific direction to a subsequent time point, but also when the user touches a specific area 1411 during content reproduction and drags it in a specific direction 1412, can output a guide image in which the direction key guide image included in the guide window 1420 is activated in a direction for adjusting the content reproduction time point.

[0206] The above description merely exemplarily explains the technical idea of the present invention. For those with ordinary knowledge in the technical field to which the present invention pertains, various modifications and variations are possible without departing from the essential characteristics of the present invention.

[0207] Therefore, the embodiments disclosed in the present invention are not for limiting the technical idea of the present invention, but for the purpose of explanation, and the scope of the technical idea of the present invention is not limited by such embodiments.

[0208] The protection scope of the present invention should be interpreted according to the appended claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of the present invention.

Claims

1. a user input portion for receiving touch input; A display unit for outputting a screen provided by an application; a control unit that determines whether the application supports the touch input, and if the application does not support the touch input, determines whether a mouse input function is supported, and executes a function corresponding to the touch input based on whether the mouse input function is supported; If the application supports a mouse input function, the controller converts the touch input into a mouse input and executes a function corresponding to the mouse input.

2. The display device of claim 1 , wherein the screen includes at least one content.

3. When the touch input is a touch at a specific position, the control unit converting the touch input into a mouse click input at the specific location; The display device according to claim 1 , wherein the mouse click input is executed at the specific position.

4. When the touch input is a long press input on the content, the control unit Converting the touch input into a long click input on the content; The display device according to claim 2 , further comprising: a display unit configured to output detailed information about the content in response to a long click input on the content.

5. When the touch input is touching a specific position and dragging in a specific direction, the controller converting the touch input into a mouse drag input by clicking the specific position in the specific direction; The display device according to claim 1 , wherein the display device outputs a screen in which the specific position is moved in a direction corresponding to the specific direction.

6. the control unit outputs a plurality of contents included in one category in a specific direction, and the touch input is touching one of the plurality of contents and dragging it in the specific direction, converting the touch input into a mouse drag input in the specific direction by clicking the touched content; The display device according to claim 1 , further comprising: a display unit configured to display a screen on which the plurality of contents are moved in the specific direction.

7. If the touch input is a long press followed by a drag in a specific direction, The control unit is The touch input is converted into a mouse drag input in the specific direction by clicking on a current point of the content being played; The display device according to claim 1 , wherein the display device outputs content whose time has progressed from the current time in a specific direction by an amount of mouse dragging input.

8. the control unit outputs a progress bar indicating a progress of content playback through a display unit, and when the touch input is touching a specific point and dragging in a specific direction, converting the touch input into a mouse drag input in the specific direction by clicking the progress bar; The display device according to claim 1 , wherein the display device outputs content whose time has progressed in a specific direction from the current time.

9. The display device of claim 1 , wherein the control unit outputs a guide window for guiding the mouse input function corresponding to the touch input.

10. The display device of claim 9 , wherein the guide window includes at least one of a guide image for guiding a user's hand movement and a guide image for a screen movement direction according to the "mouse input function corresponding to touch input."

11. A user input unit for receiving touch input; A display unit for outputting a screen provided by an application; a control unit that determines whether the application supports the touch input, and if the application does not support the touch input, determines whether a mouse input function is supported, and executes a function corresponding to the touch input based on whether the mouse input function is supported; The control unit converts the touch input into a directional key input and executes a function corresponding to the directional key input when the application does not support the mouse input function.

12. The display device of claim 11, wherein, when the touch input is a touch at a specific position, the controller converts the touch input into a selection input at the specific position and executes the selection input at the specific position.

13. When the touch input is touching a specific position and dragging in a specific direction, the controller A direction key input is switched to a first direction corresponding to a direction opposite to the specific direction; The display device according to claim 11 , wherein a screen is output in which the specific position is moved in a direction corresponding to the specific direction.

14. the control unit outputs a plurality of contents included in one category in a specific direction, and the touch input is touching one of the plurality of contents and dragging it in the specific direction, The touch input is converted into a direction key input of a first direction corresponding to a direction opposite to the specific direction by selecting the touched content; The display device of claim 11 , further comprising: a display unit configured to display a screen in which the plurality of contents are moved in the specific direction.

15. If the touch input is a long press input followed by a drag in a specific direction, the controller The touch input is converted into a direction key input in the specific direction to select a current point of the content being played; The display device according to claim 11, wherein the display device outputs content whose time has progressed from the current time by an amount corresponding to a directional key input in the specific direction.

16. 12. The display device of claim 11, wherein the control unit outputs a progress bar indicating a progress of playback of the content through the display unit, and when the user input is touching a specific point on the progress bar and dragging in a specific direction, determines that the input is a directional key input in a first direction corresponding to the specific direction, and outputs content whose time has progressed from the specific point in the content by the directional key input in the specific direction.

17. The display device of claim 11 , wherein the controller outputs a guide window for guiding a function corresponding to the directional key input corresponding to the touch input.

18. The display device of claim 17 , wherein the guide window includes at least one of a guide image for guiding a user's hand movement and a guide image for a screen movement direction according to the "function corresponding to the directional key input corresponding to the touch input."

19. The screen further includes a scroll bar for scrolling; When the touch input is an input of touching a specific area of ​​a scroll bar and dragging it in a specific direction, the control unit converting the touch input into a mouse drag input in the specific direction by clicking a specific area of ​​the scroll bar; The display device according to claim 1 , wherein the screen is scrolled in the specific direction.

20. The screen further includes a scroll bar for scrolling; When the touch input is an input of touching a specific area of ​​a scroll bar and dragging it in a specific direction, the control unit The touch input is converted into a direction key input in the specific direction by selecting a specific area of ​​the scroll bar; The display device of claim 11 , further comprising: a display unit configured to display a screen scrolled in the specific direction.

Images