Display apparatus and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes a camera, a display, a communication interface including a circuit, and a processor that controls the display to display a live image received through the camera and controls the communication interface to transmit the displayed live image to an external display device.

Description

Technology Field

[0001] The present invention relates to a display device and a control method thereof, and more specifically, to a display device that displays a touch trajectory and a control method thereof. Background Technology

[0002] Recently, driven by technological advancements in the field of display devices, various types of display devices are being developed and distributed. In particular, following the trend of e-learning that utilizes electronic devices in the education sector, electronic whiteboard devices that combine display devices with whiteboards are being widely used.

[0003] In the case of electronic whiteboards, there was a problem where a gap occurred between the time of writing (or touching) and the time when the trajectory corresponding to the writing is displayed on the screen. To minimize this problem, the display device uses various prediction algorithms to provide an effect where the trajectory is displayed on the screen at the same time as the user writes.

[0004] However, this prediction algorithm had a limitation in that it could only predict a trajectory similar to the actual touch input in a limited environment, for example, an environment that displays a straight touch trajectory.

[0005] In environments other than limited ones, there was a problem where the predicted trajectory actually hindered the user. Accordingly, there was an increased need for a method to minimize the problem of the aforementioned gap occurring by predicting the trajectory only when prediction is required and displaying the predicted trajectory. The problem to be solved

[0006] The present disclosure is in accordance with the aforementioned necessity, and the purpose of the present disclosure is to provide a display device and a control method thereof that determine whether prediction of a trajectory based on touch input is required and display a predicted trajectory according to the result of the determination. means of solving the problem

[0007] According to one embodiment for achieving the above-described purpose of the present disclosure, a display device comprises a display panel including a touch sensor and a processor that, when a touch input signal for a part of the display panel is received from the touch sensor, controls the display panel to display a touch trajectory corresponding to the touch input signal in the part of the display panel, and determines whether to display a subsequent trajectory of the displayed touch trajectory based on touch context information including speed information corresponding to the touch input signal.

[0008] Additionally, the processor can control the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory if the speed information is less than the first threshold speed, and to display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor if the speed information is greater than or equal to the first threshold speed.

[0009] Here, the processor predicts and displays a subsequent trajectory corresponding to a first area based on the displayed touch trajectory if the speed information is less than the first threshold speed and greater than or equal to the second threshold speed, and predicts and displays a subsequent trajectory corresponding to a second area based on the displayed touch trajectory if the speed information is less than the second threshold speed, and the size of the second area may be larger than the size of the first area.

[0010] In addition, the touch context information may further include at least one of the following: placement mode information of the display device, area information where the touch input is received, setting language information of the display device, or content type information corresponding to the touch input.

[0011] Here, the processor can predict and display the subsequent trajectory based on the displayed touch trajectory when the value obtained by applying different weights to each of the plurality of pieces of information included in the touch context information exceeds a threshold value.

[0012] Additionally, the arrangement mode information of the display device includes a horizontal mode or a vertical mode, and the processor can control the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory when the display device is in a vertical mode, and control the display panel to display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor when the display device is in a horizontal mode.

[0013] Additionally, the area information where the touch input is received includes an upper area or a lower area, and the processor can control the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory if the area where the touch input is received is a lower area, and control the display panel to display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor if the area where the touch input is received is an upper area.

[0014] Additionally, the content type information corresponding to the touch input includes a text type or an image type, and the processor can control the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory if the content corresponding to the touch input is an image type, and control the display panel to display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor if the content corresponding to the touch input is a text type.

[0015] Additionally, the processor can control the display panel to replace the displayed subsequent trajectory with the touch trajectory corresponding to the touch input signal received from the touch sensor and display it if, after the subsequent trajectory is displayed, the error between the touch trajectory and the subsequent trajectory exceeds a threshold range.

[0016] Additionally, the device further includes a memory in which usage history information related to touch input of the display panel is stored, and the processor can determine whether to display a subsequent trajectory of the displayed touch trajectory based on the usage history information.

[0017] According to one embodiment for achieving the above-described purpose of the present disclosure, a control method for a display device including a display panel equipped with a touch sensor comprises, when a touch input signal for a part of the display panel is received from the touch sensor, a step of displaying a touch trajectory corresponding to the touch input signal for the part of the display panel, and a step of determining whether to display a subsequent trajectory of the displayed touch trajectory based on touch context information including speed information corresponding to the touch input signal.

[0018] Here, if the speed information is less than a first threshold speed, the method may further include the step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory, and if the speed information is greater than or equal to the first threshold speed, the method may further include the step of displaying a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor.

[0019] Here, the step of predicting and displaying the subsequent trajectory includes, if the speed information is less than the first threshold speed and greater than or equal to the second threshold speed, the step of predicting and displaying a subsequent trajectory corresponding to the first area based on the displayed touch trajectory, and if the speed information is less than the second threshold speed, the step of predicting and displaying a subsequent trajectory corresponding to the second area based on the displayed touch trajectory, wherein the size of the second area may be larger than the size of the first area.

[0020] In addition, the touch context information may further include at least one of the following: placement mode information of the display device, area information where the touch input is received, setting language information of the display device, or content type information corresponding to the touch input.

[0021] Here, the method may further include the step of predicting and displaying a subsequent trajectory based on the displayed touch trajectory when the value obtained by applying different weights to each of the plurality of pieces of information included in the touch context information exceeds a threshold value.

[0022] Additionally, the arrangement mode information of the display device may include a horizontal mode or a vertical mode, and if the display device is in a vertical mode, it may further include the step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory, and if the display device is in a horizontal mode, it may further include the step of displaying a touch trajectory corresponding to the subsequent touch input signal received from the touch sensor.

[0023] Additionally, the area information where the touch input is received may include an upper area or a lower area, and if the area where the touch input is received is a lower area, the method may further include the step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory, and if the area where the touch input is received is an upper area, the method may further include the step of displaying a touch trajectory corresponding to the subsequent touch input signal received from the touch sensor.

[0024] Additionally, the content type information corresponding to the touch input may include a text type or an image type, and if the content corresponding to the touch input is an image type, the method may further include the step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory, and if the content corresponding to the touch input is a text type, the method may further include the step of displaying the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor.

[0025] Additionally, after the subsequent trajectory is displayed, if the error between the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor and the subsequent trajectory exceeds a threshold range, the method may further include the step of replacing the displayed subsequent trajectory with the touch trajectory corresponding to the touch input signal and displaying it.

[0026] Additionally, the display device may further include a step of including usage history information related to the touch input of the display panel and determining whether to display a subsequent trajectory of the displayed touch trajectory based on the usage history information. Effects of the invention

[0027] According to various embodiments of the present disclosure, a trajectory can be predicted and displayed only when a prediction of a trajectory based on touch input is required.

[0028] Since the predicted trajectory is identical to or similar within a threshold range to the touch trajectory based on the actual touch history, the reliability of the predicted trajectory can be improved and user convenience can be increased. Brief explanation of the drawing

[0029] FIG. 1 is a diagram for schematically illustrating a display device according to one embodiment of the present disclosure. FIG. 2 is a block diagram for explaining the configuration of a display device according to one embodiment of the present disclosure. FIG. 3 is a drawing for explaining a subsequent trajectory according to one embodiment of the present disclosure. FIGS. 4 and FIGS. 5 are drawings for illustrating a placement mode according to one embodiment of the present disclosure. FIGS. 6 and FIGS. 7 are drawings for explaining area information according to one embodiment of the present disclosure. FIGS. 8 and 9 are drawings for illustrating a setting language according to an embodiment of the present disclosure. FIGS. 10 and FIGS. 11 are drawings for explaining content types according to one embodiment of the present disclosure. FIG. 12 is a drawing for explaining a touch trajectory according to one embodiment of the present disclosure. FIG. 13 is a flowchart illustrating a control method for a display device according to one embodiment of the present disclosure. Specific details for implementing the invention

[0030] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0031] The terms used in the embodiments of this disclosure have been selected to be as widely used as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant explanatory section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0032] The embodiments of the present disclosure are subject to various modifications and may have various embodiments; therefore, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of specific embodiments, and it should be understood that it includes all modifications, equivalents, and substitutions that fall within the scope of the disclosed spirit and technology. In describing the embodiments, if it is determined that a detailed description of related prior art may obscure the essence, such detailed description is omitted.

[0033] Terms such as "first," "second," etc., may be used to describe various components, but components should not be limited by these terms. Terms are used solely for the purpose of distinguishing one component from another.

[0034] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0035] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0036] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0037] FIG. 1 is a diagram for schematically illustrating a display device according to one embodiment of the present disclosure.

[0038] A display device (100) according to one embodiment of the present disclosure can display various types of content. According to one embodiment, the display device (100) may be implemented as an electric whiteboard display, but is not limited thereto. For example, the display device (100) is not limited to and can be applied as any device equipped with a display function, such as a video wall, a large format display (LFD), a digital signage, a digital information display (DID), a projector display, etc. Additionally, the display device (100) may be implemented as various types of displays such as an LCD (liquid crystal display), an OLED (organic light-emitting diode), an LCoS (liquid crystal on silicon), a DLP (digital light processing), a QD (quantum dot) display panel, a QLED (quantum dot light-emitting diodes), a μLED (micro light-emitting diodes), a Mini LED, etc. Meanwhile, the display device (100) may be implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display in which a plurality of display modules are physically connected, etc.

[0039] For convenience of explanation, the following description assumes that the display device (100) is implemented as an electronic whiteboard. The display device (100) may be placed in a wall-mounted form or implemented in a stand form.

[0040] A display device (100) according to one embodiment of the present disclosure may provide a writing function. Here, the writing function may mean a function of drawing a line along a touched path based on a touch input signal when a touch input signal is received for the display device. Referring to FIG. 1, the display device (100) may receive a touch input signal based on a touch input using a pen (10) and display a touch trajectory corresponding to the touch input signal. Meanwhile, FIG. 1 is illustrated assuming a touch input using a pen (10) for convenience of explanation, but it is obvious that touch input can be performed through a user's hand, a display device (100) and various other objects that can touch the display device (100), rather than a pen (10).

[0041] Meanwhile, when the display device (100) displays a touch trajectory corresponding to a touch input signal, the time of touch input using the pen (10) and the time of display of the touch trajectory may not coincide.

[0042] For example, after the display device (100) receives a touch input signal, it may take a certain amount of time to display a touch trajectory corresponding to the touch input signal. Here, the certain amount of time may be referred to as latency, delay time, response speed, etc.

[0043] A display device (100) according to one embodiment displays a touch trajectory corresponding to a touch input signal and can predict a subsequent trajectory based on the touch input signal or the touch trajectory. Subsequently, the display device (100) can display the predicted subsequent trajectory. In this case, the display device (100) can provide the user with an effect such as that the touch trajectory corresponding to the subsequent touch input is displayed simultaneously with the subsequent touch input, that is, an effect such as that no delay occurs.

[0044] However, the display device (100) can provide the user with the effect of no delay time only when the touch trajectory corresponding to the subsequent touch input is identical to or similar within a threshold range to the predicted subsequent trajectory. As another example, if the difference between the touch trajectory corresponding to the subsequent touch input and the predicted subsequent trajectory exceeds a threshold range, the display device (100) may instead cause inconvenience to the user.

[0045] Accordingly, a display device (100) according to various embodiments of the present disclosure can predict a subsequent trajectory based on context information regarding a user's touch input and determine whether to display it. Various embodiments of touch context information will be described below.

[0046] FIG. 2 is a block diagram for explaining the configuration of a display device according to one embodiment of the present disclosure.

[0047] Referring to FIG. 2, a display device (100) according to one embodiment of the present disclosure includes a display panel (110) including a touch sensor (111) and a processor (120).

[0048] The display panel (110) displays a screen. In particular, if the display device (100) is implemented as an electronic whiteboard, the display panel (110) can display a screen for setting and executing functions of the electronic whiteboard. For example, the display panel (110) can display a screen including at least one of a desktop, an application icon, an application execution window, a toolbar menu, a settings menu, a drawing canvas, and a graphic object.

[0049] A touch sensor (111) according to one embodiment can detect a touch on a display panel (110). For example, the touch sensor (111) can detect a touch in which any object comes into contact with the display panel (110). The touch sensor (111) may detect touches from all objects that come into contact with the display panel (110), or it may detect touches from objects that have certain limited characteristics. The limitation on the objects that the touch sensor (111) can detect touches from varies depending on the method of detecting touches. For example, the method of the touch sensor (111) detecting touches may be implemented using an infrared method (Infrared Touch Screen) using an IR sensor, an ultrasonic method (Surface Acoustic Wave Touch Screen), a resistive method (Resistive Touch Screen) (or pressure-sensitive method), or a capacitive touch method (Capacitive Touch Screen).

[0050] A touch sensor (111) according to one embodiment can generate a touch input signal and transmit it to a processor (120) when a touch is detected on an area of ​​the display panel (110). Meanwhile, the method of detecting a touch is not limited to the example described above, and the touch sensor (111) can detect a touch in various ways. For example, the touch sensor (111) may be equipped with a camera, and it is obvious that it may detect a touch on an area of ​​the display panel (110) based on an image captured by the camera.

[0051] A processor (120) controls the overall operation of a display device (100). Here, the processor (120) may be composed of one or more processors. Specifically, the processor (120) may perform the operation of the display device (100) according to various embodiments of the present disclosure by executing at least one instruction stored in a memory (not shown).

[0052] According to one embodiment, the processor (120) may be implemented as a digital signal processor (DSP) that processes digital video signals, a microprocessor, a Graphics Processing Unit (GPU), an Artificial Intelligence (AI) processor, a Neural Processing Unit (NPU), or a Time Controller (TCON). However, it is not limited thereto, and may include or be defined by one or more of a central processing unit (CPU), a Micro Controller Unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a communication processor (CP), or an ARM processor. Additionally, the processor (120) may be implemented as a System on Chip (SoC) or Large Scale Integration (LSI) with a built-in processing algorithm, or may be implemented in the form of an Application Specific Integrated Circuit (ASIC) or Field Programmable Gate Array (FPGA).

[0053] In particular, a processor (120) according to one embodiment of the present disclosure can control the display panel (110) to display a touch trajectory corresponding to the touch input signal in a part of the display panel (110) when a touch input signal for a part of the display panel (110) is received from a touch sensor (111) as shown in FIG. 1.

[0054] A processor (120) according to one embodiment of the present disclosure may determine whether to display a subsequent trajectory of a displayed touch trajectory based on touch context information corresponding to a touch input signal.

[0055] A detailed explanation of this will be provided with reference to Fig. 3.

[0056] FIG. 3 is a drawing for explaining a subsequent trajectory according to one embodiment of the present disclosure.

[0057] Referring to FIG. 3, a processor (120) according to one embodiment of the present disclosure can control a display panel (110) to display a touch trajectory (1) corresponding to a touch input signal. Subsequently, the processor (120) can determine whether to display a subsequent trajectory (2) of the displayed touch trajectory (1) based on touch context information corresponding to the touch input signal.

[0058] For example, the processor (120) can predict a subsequent trajectory (2) based on a touch input signal or a touch trajectory (1) corresponding to the touch input signal. Additionally, the processor (120) can determine whether to display the predicted subsequent trajectory (2) based on touch context information corresponding to the touch input signal.

[0059] For example, the processor (120) can obtain a vector change amount of a touch trajectory (1) corresponding to a touch input signal and predict a subsequent trajectory (2) based on the vector change amount. For example, if the touch trajectory (1) corresponding to the touch input signal is a straight line trajectory, the processor (120) can predict a straight line subsequent trajectory (2) that continues in succession to the touch trajectory (1). For another example, if the touch trajectory (1) corresponding to the touch input signal is a circular trajectory, the processor (120) can predict a circular subsequent trajectory (2) that continues in succession to the touch trajectory (1).

[0060] Next, the processor (120) can determine whether to display a predicted subsequent trajectory (2) based on touch context information. Here, the touch context information may include speed information corresponding to a touch input signal. For example, the processor (120) can identify a touch input speed on the display panel (110) based on the touch context information. Next, if the input speed identified based on the speed information is less than a first threshold speed, the processor (120) can predict and display a subsequent trajectory (2) based on the touch trajectory (1).

[0061] As another example, if the input speed identified based on speed information is greater than or equal to the first threshold speed, the processor (120) may not predict a subsequent trajectory (2) based on the touch trajectory (1) or may not display the predicted subsequent trajectory (2). In this case, the processor (120) may control the display panel (110) to display a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor (111).

[0062] Here, the first threshold speed may be a speed corresponding to the computation time required for the processor (120) to predict the subsequent trajectory (2). For example, if the touch input speed is less than the first threshold speed, the processor (120) may perform a computation to predict the subsequent trajectory (2) based on the vector change amount of the touch trajectory (1), and then control the display panel (110) to display the predicted subsequent trajectory (2). As the display panel (110) displays the predicted subsequent trajectory (2), the display device (100) can provide the user with the effect of displaying the touch trajectory corresponding to the subsequent touch input simultaneously with the subsequent touch input using the pen (10) (or with a very small delay time).

[0063] Meanwhile, the example described above is merely one example, and it goes without saying that the reverse of the example described above is also possible. For example, depending on the settings of the manufacturer or user, the processor (120) may predict and display a subsequent trajectory if the speed information is greater than or equal to a first threshold speed, and may display a touch trajectory corresponding to a subsequent touch input signal rather than a subsequent trajectory if the speed information is less than or equal to a first threshold speed. As an example, if the touch input speed identified based on the speed information included in the touch context information is greater than or equal to a first threshold speed, the processor (120) may predict and display a subsequent trajectory (2) based on the touch trajectory (1). Additionally, if the touch input speed identified based on the speed information is less than a first threshold speed, the processor (120) may not predict a subsequent trajectory (2). That is, if the user performs a touch at a relatively fast speed, the processor (120) can predict and display a subsequent trajectory (2) to minimize the delay time between the touch point and the display point of the touch trajectory corresponding to the touch, thereby providing the user with the effect of the touch trajectory being displayed simultaneously with the touch. In this case, the first threshold speed may, of course, be arbitrarily set by the manufacturer or the user.

[0064] For convenience of explanation, the following description assumes a case where the processor (120), depending on the manufacturer or user settings, predicts and displays a subsequent trajectory (2) based on the touch trajectory (1) when the speed information is less than the first threshold speed.

[0065] A processor (120) according to one embodiment of the present disclosure can predict and display a subsequent trajectory (2) corresponding to a first area based on a displayed touch trajectory (1) if the speed information is less than a first threshold speed and greater than or equal to a second threshold speed.

[0066] As another example, if the speed information is less than a second threshold speed, the processor (120) can predict and display a subsequent trajectory (2) corresponding to a second area based on the displayed touch trajectory (1). Here, the size of the second area may be larger than the size of the first area. For example, the slower the touch input speed, the greater the amount of computation the processor (120) must perform to predict the subsequent trajectory (2). The processor (120) can predict a longer subsequent trajectory (2), that is, a subsequent trajectory (2) the size of the second area, as the touch input speed is slower.

[0067] For example, a case can be assumed where the first threshold speed is 35 mm / s and the second threshold speed is 25 mm / s. If the speed information is less than the first threshold speed and greater than or equal to the second threshold speed, the processor (120) can predict a subsequent trajectory (2) of 5 mm in length. Here, 5 mm may mean the size of the first area.

[0068] As another example, the processor (120) can predict a subsequent trajectory (2) of length 10 mm during the same computation time if the speed information is less than a second threshold speed. Here, 10 mm may mean the size of the second area. However, the specific number described above is merely an example, and the processor (120) can predict a subsequent trajectory (2) of relatively longer length during the same time as the speed information corresponding to the touch input is slower.

[0069] FIG. 3 is illustrated as if the processor (120) determines whether to display a subsequent trajectory (2) of a touch trajectory (1) based only on speed information of a touch input included in the touch context information for convenience of explanation, but this is merely an example and the processor (120) may determine whether to display a subsequent trajectory (2) based on various information related to the touch included in the touch context information.

[0070] Below, we will explain the various touch-related information included in the touch context information.

[0071] FIGS. 4 and FIGS. 5 are drawings for illustrating a placement mode according to one embodiment of the present disclosure.

[0072] A processor (120) according to one embodiment of the present disclosure may determine whether to display a subsequent trajectory (2) of a touch trajectory (1) based on placement mode information. Here, the placement mode information may include a horizontal mode or a vertical mode.

[0073] Referring to FIG. 4, a processor (120) according to one embodiment of the present disclosure can display a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor (111) based on placement mode information when the display device (100) is in a horizontal mode.

[0074] As another example, referring to FIG. 5, a processor (120) according to one embodiment of the present disclosure can control a display panel (110) to predict and display a subsequent trajectory (2) based on a displayed touch trajectory (1) when the display device (100) is in a vertical mode based on placement mode information.

[0075] FIGS. 4 and 5 are illustrated as if the display device (100) is in a vertical mode and the subsequent trajectory (2) is predicted and displayed when the display device (100) is in a vertical mode, assuming that the touch input speed is relatively slower when the display device (100) is in a vertical mode, but this is an example and is not limited thereto. Conversely, the processor (120) may display a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor (111) when the display device (100) is in a vertical mode, and predict and display a subsequent trajectory (2) based on the displayed touch trajectory (1) when the display device (100) is in a horizontal mode.

[0076] That is, the processor (120) may predict and display a subsequent trajectory (2) only when the display device (100) corresponds to either a vertical mode or a horizontal mode according to the settings of the manufacturer or user.

[0077] FIGS. 6 and FIGS. 7 are drawings for explaining area information according to one embodiment of the present disclosure.

[0078] A processor (120) according to one embodiment of the present disclosure can predict and determine whether to display a subsequent trajectory (2) of a touch trajectory (1) based on area information where a touch input is received. Here, the area information may include an upper area or a lower area.

[0079] Referring to FIG. 6, a processor (120) according to one embodiment of the present disclosure can display a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor (111) when the area where the touch input is received is an upper area.

[0080] As another example, referring to FIG. 7, a processor (120) according to one embodiment of the present disclosure can control a display panel (110) to predict and display a subsequent trajectory (2) based on a displayed touch trajectory (1) when the area where a touch input is received is a lower area.

[0081] Here, the upper region refers to the upper region of any dotted line crossing the central region of the display panel (110) shown in FIG. 6, and the lower region may refer to the lower region of the dotted line.

[0082] For example, if the area where the touch input is received is the lower area, the user inputting the touch may be relatively short or young, and such a user may have a relatively slow touch input speed. As another example, if the area where the touch input is received is the upper area, the user inputting the touch may be relatively tall or old, and such a user may have a relatively fast touch input speed. Based on these assumptions, FIGS. 6 and 7 are illustrated as predicting and displaying a subsequent trajectory (2) when a touch input is detected in the lower area of ​​the display panel (110), assuming that the touch input speed is relatively slower when the area where the touch input is received is the lower area than when the area where the touch input is received is the upper area, but this is merely an example and is not limited thereto.

[0083] Conversely, the processor (120) may predict and display a subsequent trajectory (2) when a touch input is detected in the upper area of ​​the display panel (110), and may display a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor (111) when a touch input is detected in the lower area.

[0084] That is, the processor (120) may predict and display a subsequent trajectory (2) only when the touch input is detected in the upper area or in the lower area, depending on the settings of the manufacturer or user.

[0085] FIGS. 8 and 9 are drawings for illustrating a setting language according to an embodiment of the present disclosure.

[0086] A processor (120) according to one embodiment of the present disclosure may predict and determine whether to display a subsequent trajectory (2) of a touch trajectory (1) based on a set language. Here, the set language may include at least one of a main language set by the user or a language identified by the processor (120) based on the touch trajectory (1).

[0087] Referring to FIG. 8, a processor (120) according to one embodiment of the present disclosure may identify 'English' as ​​a set language based on a touch trajectory (1). According to one embodiment, 'English' may be a language set to predict a subsequent trajectory (2). In this case, the processor (120) may control a display panel (110) to predict and display a subsequent trajectory (2) based on the displayed touch trajectory (1). Meanwhile, it goes without saying that the language set to predict the subsequent trajectory (2) may be added, deleted, or changed in various ways depending on the manufacturer's or user's settings. For example, if the touch trajectory (1) is identified as corresponding to a language that uses characters composed of straight lines or circles (e.g., English, Korean), the processor (120) may predict and display a subsequent trajectory (2) of the touch trajectory (1).

[0088] As another example, referring to FIG. 9, a processor (120) according to another embodiment of the present disclosure may identify 'Arabic' as a set language based on a touch trajectory (1). According to one embodiment, 'Arabic' may not correspond to a language set to predict a subsequent trajectory (2). In this case, the processor (120) may display a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor (111) rather than a subsequent trajectory (2). For example, 'Arabic' may correspond to a language that uses characters composed of curves rather than relatively straight lines or circles.

[0089] In this case, since there is a difference greater than a threshold range between the subsequent trajectory (2) and the touch input actually entered by the user, that is, the touch trajectory corresponding to the subsequent touch input signal, the processor (120) can display the touch trajectory corresponding to the subsequent touch actually entered by the user, rather than the predicted subsequent trajectory (2).

[0090] FIGS. 10 and FIGS. 11 are drawings for explaining content types according to one embodiment of the present disclosure.

[0091] A processor (120) according to one embodiment of the present disclosure can predict and determine whether to display a subsequent trajectory (2) of a touch trajectory (1) based on content type information corresponding to a touch input. Here, the content type information may include a text type or an image type.

[0092] Referring to FIG. 10, a processor (120) according to one embodiment of the present disclosure can control a display panel (110) to predict and display a subsequent trajectory (2) based on the displayed touch trajectory (1) if the touch trajectory (1) displayed according to a user's touch input is of an image type.

[0093] As another example, referring to FIG. 11, a processor (120) according to one embodiment of the present disclosure can display a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor (111), rather than a predicted subsequent trajectory (2), when the touch trajectory (1) is of text type.

[0094] Here, the processor (120) can analyze the displayed touch trajectory (1) to identify whether the content type is an image type or a text type, and can also identify whether the displayed touch trajectory (1) corresponds to an image type or a text type according to user settings.

[0095] FIGS. 10 and 11 are illustrated as if, for convenience of explanation, the touch input speed is relatively slower when a touch corresponding to an image type requiring delicate touch movements is input than when a touch corresponding to a text type is input, and the subsequent trajectory (2) is predicted and displayed when the content corresponding to the displayed touch trajectory (1) is of an image type, but this is an example and is not limited thereto. Conversely, the processor (120) may predict and display the subsequent trajectory (2) when the content corresponding to the touch input is of a text type, and may display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor (111) when the content corresponding to the touch input is of an image type.

[0096] That is, the processor (120) may predict and display a subsequent trajectory (2) only when the touch input corresponds to either an image type or a text type, depending on the settings of the manufacturer or user.

[0097] Meanwhile, the content type may be determined according to the mode of the display device (100) in addition to the text type or image type. For example, the display device (100) may include various modes such as a calligraphy mode, a brush mode, and a pencil mode. Subsequently, when a specific mode is selected as the mode of the display device (100), the processor (120) can predict and display a subsequent trajectory (2) when the content corresponding to the displayed touch trajectory (1) is of the image type, assuming that the touch input speed is relatively slower than other modes. For example, if the display device (100) is in calligraphy mode, the processor (120) can predict and display a subsequent trajectory (2) corresponding to the touch trajectory (1).

[0098] Meanwhile, FIGS. 3 to 11 are illustrated assuming, for convenience of explanation, that the touch context information includes at least one of speed information, placement mode information of the display device (100), area information where the touch input is received, setting language information of the display device (100), or content type information corresponding to the touch input. Additionally, although it is described that the processor (120) independently considers each of the plurality of pieces of information included in the touch context information to determine whether to display a subsequent trajectory (2), this is merely an example and is not limited thereto.

[0099] For example, the processor (120) can apply different weights to each of the multiple pieces of information included in the touch context information and, if the obtained value exceeds a threshold value, predict and display a subsequent trajectory (2).

[0100] For example, the processor (120) may acquire 1 if the speed information corresponding to the touch input signal is less than a first threshold speed, and acquire 0 if it is greater than or equal to the first threshold speed. Additionally, the processor (120) may acquire 1 if the display device is in vertical mode and acquire 0 if it is in horizontal mode based on the placement mode information. Additionally, the processor (120) may acquire 1 if the area where the touch input is received is a lower area and acquire 0 if it is an upper area based on the area information where the touch input is received. Additionally, the processor (120) may acquire 1 if the set language is a language set to predict the subsequent trajectory (2) based on the set language information, and acquire 0 if it does not correspond to this. Additionally, the processor (120) may acquire 1 if the content corresponding to the touch input is an image type and acquire 0 if it is a text type.

[0101] Next, the processor (120) sums the acquired values ​​and, if the sum is 3 or greater, predicts and displays a subsequent trajectory (2), and if the sum is less than 3, displays a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor (111). However, this is merely an example, and the touch context information may include various information in addition to the example described above.

[0102] For example, the memory may store usage history information related to the touch input of the display panel (110), and the processor (120) may determine whether to display a subsequent trajectory (2) of the displayed touch trajectory (1) based on the usage history information.

[0103] For example, usage history information may include user information, and user information may include information on average touch input speed per user (e.g., whiteboard speed, handwriting speed, etc.), set language information, handwriting information, physical information (e.g., age, height, etc.).

[0104] A processor (120) according to one embodiment of the present disclosure may acquire at least one of average touch input speed information, setting language information, handwriting information, or body information corresponding to a user currently using the display device (100) based on usage history information, and may determine whether to display a subsequent trajectory (2) based on the acquired information. For example, if the user's age exceeds a threshold value based on the body information corresponding to the user, the processor (120) may assume that the touch speed is relatively fast and may not predict a subsequent trajectory (2). As another example, if the user's height exceeds a threshold value based on the body information corresponding to the user, the processor (120) may assume that the area where the touch input is received is the upper area and may not predict a subsequent trajectory (2). However, it goes without saying that the reverse case is also possible depending on the manufacturer or user settings.

[0105] A processor (120) according to one embodiment of the present disclosure can predict and display a subsequent trajectory (2) when the value obtained by applying different weights to each of the plurality of pieces of information included in the touch context information based on the following mathematical formula 1 exceeds a threshold value.

[0106] [Mathematical Formula 1]

[0107] Y=W1*P1 + W2*P2 + W3*P3 + …

[0108] Here, P1 represents the average speed of the touch input, P2 represents the placement mode information of the display device, and P3 represents the area where the touch input is received, and W1, W2, and W3 each represent different weight values. Meanwhile, P2 and P3 may have a value of 0 or 1 as described above.

[0109] A processor (120) according to one embodiment can predict a subsequent trajectory (2) based on the touch trajectory (1) when the Y value exceeds a threshold value. However, as an example, the parameter included in Equation 1 may increase depending on the information included in the touch context information. For example, it may be determined whether to predict a subsequent trajectory (2) based on information about the area where the display device (100) is equipped. For example, when the illuminance value of the area where the display device (100) is equipped is detected through a sensor (not shown), the processor (120) can determine whether the illuminance value is greater than or equal to a threshold value. Subsequently, if the illuminance value is less than the threshold value, the processor (120) can predict and display a subsequent trajectory (2) of the touch trajectory (1) by assuming that the touch input speed will be relatively slow because the area where the display device (100) is equipped is somewhat dark. However, this is just one example, and as another example, depending on the manufacturer or user settings, the processor (120) may predict and display a subsequent trajectory (2) of the touch trajectory (1) if the illuminance value is greater than or equal to a threshold value.

[0110] FIG. 12 is a drawing for explaining a touch trajectory according to one embodiment of the present disclosure.

[0111] Referring to FIG. 12, a processor (120) according to one embodiment of the present disclosure can control a display panel (110) to replace the displayed subsequent trajectory (2) with the touch trajectory (3) corresponding to the touch input signal received from a touch sensor and display the subsequent trajectory (2) after the subsequent trajectory (2) is displayed, if the error between the subsequent trajectory (2) and the touch trajectory (3) corresponding to the touch input signal exceeds a threshold range.

[0112] For example, since the subsequent trajectory (2) is a predicted trajectory, it is possible to assume a case where the touch trajectory received according to the actual user touch input, that is, the touch trajectory (3) corresponding to the subsequent touch input signal, and the subsequent trajectory (2) are different. If the error between the touch trajectory (3) corresponding to the subsequent touch input signal and the subsequent trajectory (2) exceeds a threshold range, the processor (120) may remove the displayed subsequent trajectory (2) and display the touch trajectory (3) corresponding to the touch input signal.

[0113] FIG. 13 is a flowchart illustrating a control method for a display device according to one embodiment of the present disclosure.

[0114] A control method for a display device including a display panel equipped with a touch sensor according to one embodiment of the present disclosure first, when a touch input signal for one area of ​​the display panel is received from the touch sensor, a touch trajectory corresponding to the touch input signal for one area is displayed (S1310).

[0115] Next, it is determined whether to display a subsequent trajectory of the displayed touch trajectory based on touch context information including speed information corresponding to the touch input signal (S1320).

[0116] A control method according to one embodiment of the present disclosure further includes the step of predicting and displaying a subsequent trajectory based on a displayed touch trajectory when the speed information is less than a first threshold speed, and the step of displaying a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor when the speed information is greater than or equal to the first threshold speed.

[0117] Here, the step of predicting and displaying a subsequent trajectory includes, if the speed information is less than a first threshold speed and greater than or equal to a second threshold speed, the step of predicting and displaying a subsequent trajectory corresponding to a first area based on the displayed touch trajectory, and if the speed information is less than a second threshold speed, the step of predicting and displaying a subsequent trajectory corresponding to a second area based on the displayed touch trajectory, and the size of the second area may be larger than the size of the first area.

[0118] The touch context information according to one embodiment may further include at least one of the following: placement mode information of the display device, area information where the touch input is received, setting language information of the display device, or content type information corresponding to the touch input.

[0119] A control method according to one embodiment may further include the step of predicting and displaying a subsequent trajectory based on a displayed touch trajectory when a value obtained by applying different weights to each of a plurality of pieces of information included in the touch context information exceeds a threshold value.

[0120] Additionally, the arrangement mode information of the display device includes a horizontal mode or a vertical mode, and the control method according to one embodiment may further include the step of predicting and displaying a subsequent trajectory based on a displayed touch trajectory when the display device is in a vertical mode, and the step of displaying a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor when the display device is in a horizontal mode.

[0121] Area information where a touch input is received according to one embodiment includes an upper area or a lower area, and the control method may further include the step of predicting and displaying a subsequent trajectory based on a displayed touch trajectory if the area where the touch input is received is a lower area, and the step of displaying a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor if the area where the touch input is received is an upper area.

[0122] Content type information corresponding to a touch input according to one embodiment includes a text type or an image type, and the control method may further include the step of predicting and displaying a subsequent trajectory based on a displayed touch trajectory if the content corresponding to the touch input is an image type, and the step of displaying a touch trajectory corresponding to a subsequent touch input signal received from a touch sensor if the content corresponding to the touch input is a text type.

[0123] A control method according to one embodiment of the present disclosure may further include the step of replacing the displayed subsequent trajectory with the touch trajectory corresponding to the touch input signal when, after the subsequent trajectory is displayed, the error between the touch trajectory and the subsequent trajectory corresponding to the subsequent touch input signal received from the touch sensor exceeds a threshold range.

[0124] A display device according to one embodiment of the present disclosure includes usage history information related to a touch input of a display panel, and a control method may further include a step of determining whether to display a subsequent trajectory of a displayed touch trajectory based on the usage history information.

[0125] However, it is obvious that the various embodiments of the present disclosure can be applied not only to electronic devices but also to all types of electronic devices equipped with a display.

[0126] Meanwhile, the various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented as the processor itself. According to software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0127] Meanwhile, computer instructions for performing processing operations of an electronic device (100) according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations in the electronic device (100) according to various embodiments described above.

[0128] A non-transient computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, unlike media that store data for a short period of time such as registers, caches, and memory. Specific examples of non-transient computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0129] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure. Explanation of the symbols

[0130] 100: Display device 111: Touch sensor 110: Display panel 120: Processor

Claims

Claim 1 A display device comprising: a display panel including a touch sensor; and a processor that, when a touch input signal for a part of the display panel is received from the touch sensor, controls the display panel to display a touch trajectory corresponding to the touch input signal in the part of the display panel, and determines whether to display a subsequent trajectory of the displayed touch trajectory based on touch context information including speed information corresponding to the touch input signal; wherein, if the speed information is less than a first threshold speed, the processor predicts and displays the subsequent trajectory based on a change amount of the vector of the displayed touch trajectory, and if the speed information is greater than or equal to the first threshold speed, controls the display panel to display a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor. Claim 2 delete Claim 3 A display device according to claim 1, wherein the processor predicts and displays a subsequent trajectory corresponding to a first area based on the displayed touch trajectory when the speed information is less than the first threshold speed and greater than or equal to the second threshold speed, and predicts and displays a subsequent trajectory corresponding to a second area based on the displayed touch trajectory when the speed information is less than the second threshold speed, and the size of the second area is larger than the size of the first area. Claim 4 A display device according to claim 1, wherein the touch context information further comprises at least one of the following: placement mode information of the display device, area information where a touch input is received, setting language information of the display device, or content type information corresponding to the touch input. Claim 5 A display device according to claim 4, wherein the processor predicts and displays the subsequent trajectory based on the displayed touch trajectory when the value obtained by applying different weights to each of the plurality of pieces of information included in the touch context information exceeds a threshold value. Claim 6 In claim 4, the arrangement mode information of the display device includes a horizontal mode or a vertical mode, and the processor controls the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory when the display device is in a vertical mode, and controls the display panel to display a touch trajectory corresponding to the subsequent touch input signal received from the touch sensor when the display device is in a horizontal mode. Claim 7 A display device according to claim 4, wherein the area information where the touch input is received includes an upper area or a lower area, and the processor controls the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory if the area where the touch input is received is a lower area, and controls the display panel to display a touch trajectory corresponding to the subsequent touch input signal received from the touch sensor if the area where the touch input is received is an upper area. Claim 8 A display device according to claim 4, wherein the content type information corresponding to the touch input includes a text type or an image type, and the processor controls the display panel to predict and display the subsequent trajectory based on the displayed touch trajectory if the content corresponding to the touch input is an image type, and controls the display panel to display the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor if the content corresponding to the touch input is a text type. Claim 9 A display device according to claim 1, wherein the processor controls the display panel to replace the displayed subsequent trajectory with the touch trajectory corresponding to the touch input signal received from the touch sensor and display the subsequent trajectory if, after the subsequent trajectory is displayed, the error between the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor and the subsequent trajectory exceeds a threshold range. Claim 10 A display device according to claim 1, further comprising a memory in which usage history information related to a touch input of the display panel is stored, wherein the processor determines whether to display a subsequent trajectory of the displayed touch trajectory based on the usage history information. Claim 11 A control method for a display device including a display panel equipped with a touch sensor, comprising: a step of displaying a touch trajectory corresponding to the touch input signal for a one area of ​​the display panel when a touch input signal for a one area is received from the touch sensor; and a step of determining whether to display a subsequent trajectory of the displayed touch trajectory based on touch context information including speed information corresponding to the touch input signal; wherein the control method further comprises: a step of predicting and displaying the subsequent trajectory based on a change amount of the vector of the displayed trajectory when the speed information is less than a first threshold speed; and a step of displaying a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor when the speed information is greater than or equal to the first threshold speed. Claim 12 delete Claim 13 In claim 11, the step of predicting and displaying the subsequent trajectory comprises: a step of predicting and displaying a subsequent trajectory corresponding to a first area based on the displayed touch trajectory if the speed information is less than the first threshold speed and greater than or equal to the second threshold speed; and a step of predicting and displaying a subsequent trajectory corresponding to a second area based on the displayed touch trajectory if the speed information is less than the second threshold speed; wherein the size of the second area is larger than the size of the first area. Claim 14 A control method according to claim 11, wherein the touch context information further comprises at least one of the following: placement mode information of the display device, area information where touch input is received, setting language information of the display device, or content type information corresponding to the touch input. Claim 15 A control method according to claim 14, further comprising the step of predicting and displaying a subsequent trajectory based on the displayed touch trajectory when a value obtained by applying different weights to each of the plurality of pieces of information included in the touch context information exceeds a threshold value. Claim 16 A control method according to claim 14, wherein the arrangement mode information of the display device includes a horizontal mode or a vertical mode, and if the display device is in a vertical mode, a step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory; and if the display device is in a horizontal mode, a step of displaying a touch trajectory corresponding to a subsequent touch input signal received from the touch sensor. Claim 17 A control method according to claim 14, wherein the area information where the touch input is received includes an upper area or a lower area, and if the area where the touch input is received is a lower area, a step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory; and if the area where the touch input is received is an upper area, a step of displaying a touch trajectory corresponding to the subsequent touch input signal received from the touch sensor. Claim 18 A control method according to claim 14, wherein the content type information corresponding to the touch input includes a text type or an image type, and if the content corresponding to the touch input is an image type, a step of predicting and displaying the subsequent trajectory based on the displayed touch trajectory; and if the content corresponding to the touch input is a text type, a step of displaying the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor. Claim 19 A control method according to claim 11, further comprising the step of, if, after the subsequent trajectory is displayed, the error between the touch trajectory corresponding to the subsequent touch input signal received from the touch sensor and the subsequent trajectory exceeds a threshold range, replacing the displayed subsequent trajectory with the touch trajectory corresponding to the touch input signal and displaying it. Claim 20 A control method according to claim 11, wherein the display device includes usage history information related to a touch input of the display panel, and further includes the step of determining whether to display a subsequent trajectory of the displayed touch trajectory based on the usage history information.

Images