Display device, touch point positioning method and apparatus

Abstract

Embodiments of the present application provide a display device, a touch point positioning method and apparatus. The display device comprises a display and a processor; the display is provided with a touch detection device; the touch detection device is configured to detect N touch regions of a target touch point in N scanning directions, N being an integer greater than 1; the processor is configured to: intersect an i th touch region with a first polygon to obtain a second polygon, the first polygon being determined based on an (i-1) th touch region, i being an integer less than or equal to N and greater than 0; convert the second polygon into a third polygon according to vertices of the second polygon, the vertices of the third polygon being a subset of the vertices of the second polygon; and determine coordinates of the target touch point according to the third polygon. The computational complexity is reduced, the positioning speed of the touch point is improved, the response speed of the touch operation is improved, and the experience of the touch operation is improved.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and more specifically, to display devices, touch point positioning methods, and apparatus. Background Technology

[0002] Currently, smart terminals enable human-computer interaction through touch operations on an interactive interface displayed on a screen. In responding to touch operations, the screen needs to pinpoint the location of the touch point.

[0003] In existing technologies, displays can detect multiple touch areas through multiple scans, and then accurately locate the touch point by intersecting these multiple touch areas. However, when users perform rapid touch operations, the touch point location speed affects the terminal's response speed, resulting in missed touches or disconnections, thus degrading the touch operation experience. Summary of the Invention

[0004] This application provides a display device, a touch point positioning method, and an apparatus to reduce computational complexity, improve the positioning speed of touch points, and thereby improve the response speed of the terminal to touch operations.

[0005] In a first aspect, a display device is provided, comprising: a display and a processor; the display is equipped with a touch detection device; the touch detection device is used to detect N touch regions of a target touch point in N scanning directions, where N is an integer greater than 1; the processor is configured to: intersect the i-th touch region with a first polygon to obtain a second polygon, the first polygon being determined based on the (i-1)-th touch region, where i is an integer less than or equal to N and greater than 0; convert the second polygon into a third polygon based on the vertices of the second polygon, the vertices of the third polygon being a subset of the vertices of the second polygon; and determine the coordinates of the target touch point based on the third polygon.

[0006] Secondly, a touch point localization method is provided, comprising: detecting N touch regions of a target touch point in N scanning directions, where N is an integer greater than 1; intersecting the i-th touch region with a first polygon to obtain a second polygon, wherein the first polygon is determined based on the (i-1)-th touch region, where i is an integer less than or equal to N and greater than 0; converting the second polygon into a third polygon based on the vertices of the second polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon; and determining the coordinates of the target touch point based on the third polygon.

[0007] Thirdly, a touch point positioning device is provided, comprising: a detection unit for detecting N touch regions of a target touch point in N scanning directions, where N is an integer greater than 1; a processing unit for intersecting the i-th touch region with a first polygon to obtain a second polygon, wherein the first polygon is determined based on the (i-1)-th touch region, where i is an integer less than or equal to N and greater than 0; the processing unit is further configured to convert the second polygon into a third polygon based on the vertices of the second polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon; and the processing unit is further configured to determine the coordinates of the target touch point based on the third polygon.

[0008] Fourthly, a computer-readable storage medium is provided for storing a computer program that causes a computer to perform the methods described in the second aspect.

[0009] Fifthly, a computer program product is provided, including computer program instructions that cause a computer to perform the method as described in the second aspect.

[0010] In this embodiment, the processor transforms the second polygon obtained by the intersection of the i-th touch area and the first polygon into a third polygon with fewer vertices to simplify the second polygon. Then, the coordinates of the target touch point are determined based on the third polygon, which reduces computational complexity, improves the positioning speed of the touch point, and thus improves the response speed of touch operation and enhances the touch operation experience. Attached Figure Description

[0011] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to an embodiment.

[0012] Figure 2 The diagram illustrates a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.

[0013] Figure 3 This is a schematic diagram of the structure of a touch detection device provided in an embodiment of this application;

[0014] Figure 4 A flowchart illustrating a touch point positioning method 300 provided in an embodiment of this application;

[0015] Figures 5a to 5d A schematic diagram of the scanning direction provided for an embodiment of this application;

[0016] Figure 6 A schematic diagram of a touch area provided in an embodiment of this application;

[0017] Figures 7a to 7c A schematic diagram illustrating the intersection of touch areas provided in an embodiment of this application;

[0018] Figure 8 A schematic diagram of a reverse scan provided for this application;

[0019] Figure 9a and Figure 9b A schematic diagram illustrating a method for selecting vertices of intersecting touch areas provided in an embodiment of this application;

[0020] Figure 10 A flowchart illustrating a touch point positioning method 400 provided in an embodiment of this application;

[0021] Figure 11 This is a schematic block diagram of a touch point positioning device provided in an embodiment of this application. Detailed Implementation

[0022] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0023] Based on the exemplary embodiments described in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the appended claims. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete implementation on its own.

[0024] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0025] In this application, the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings are used to distinguish similar or related objects or entities and do not necessarily imply a specific order or sequence, unless otherwise indicated. It should be understood that such terms can be used interchangeably where appropriate, for example, in situations where implementation is possible in a sequence other than those given in the embodiments illustrated or described in this application.

[0026] Furthermore, the terms “including” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0027] As used in this application, the term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0028] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0029] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via other wired means. Users can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. For example, users can input corresponding control commands through volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input buttons, menu buttons, power on / off buttons, etc., to achieve the function of controlling the display device 200.

[0030] In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200. This application can be configured to provide the user with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

[0031] In some embodiments, the mobile terminal 300 can install software applications with the display device 200 to establish a connection and communication via a network communication protocol, achieving one-to-one control operations and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, synchronizing a remote control keyboard to the mobile terminal 300. By controlling the user interface on the mobile terminal 300, the display device 200 can be controlled. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 for synchronized display.

[0032] like Figure 1The diagram also shows that display device 200 communicates with server 400 via various communication methods. Display device 200 can communicate via local area network (LAN), wireless local area network (WLAN), and other networks. Server 400 can provide display device 200 with various content and interactive features. For example, display device 200 can interact by sending and receiving information, as well as through electronic program guides (EPGs), receiving software updates, or accessing remotely stored digital media libraries. Server 400 can be a cluster or multiple clusters, and may include one or more types of servers. Other network services such as video-on-demand and advertising services are provided through server 400.

[0033] Display device 200 can be an LCD monitor, OLED monitor, or projection display device. The specific type, size, and resolution of the display device are not limited. Those skilled in the art will understand that display device 200 can be modified in terms of performance and configuration as needed.

[0034] In addition to providing broadcast television reception functions, the display device 200 can also be equipped with intelligent network television functions that provide computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0035] Figure 2 The diagram illustrates a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.

[0036] In some embodiments, the display device 200 includes at least one of the following: a controller 250, a tuner / demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

[0037] In some embodiments, the display 275 is a component for receiving image signals output from a first processor and for displaying video content and images as well as a menu control interface.

[0038] In some embodiments, the display 275 includes a display component for displaying an image and a driving component for driving the image display.

[0039] In some embodiments, the displayed video content may originate from broadcast television content, or from various broadcast signals received via wired or wireless communication protocols. Alternatively, it may display various image content received from a network server via network communication protocols.

[0040] In some embodiments, the display 275 is used to present a user-controlled UI interface generated in the display device 200 and used to control the display device 200.

[0041] In some embodiments, depending on the type of display 275, a driving component for driving the display may also be included.

[0042] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.

[0043] In some embodiments, the communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver.

[0044] In some embodiments, the display device 200 may establish a communication with an external control device 100 or a content providing device via a communicator 220 to send and receive control signals and data signals.

[0045] In some embodiments, the user interface 265 can be used to receive infrared control signals from the control device 100 (e.g., an infrared remote controller).

[0046] In some embodiments, the detector 230 is used by the display device 200 to collect signals from the external environment or to interact with the outside world.

[0047] In some embodiments, the detector 230 includes a light receiver and a sensor for collecting ambient light intensity, which can adaptively display parameter changes by collecting ambient light.

[0048] In some embodiments, the detector 230 may also include an image acquisition device, such as a camera or webcam, which can be used to acquire external environmental scenes and to acquire user attributes or user interaction gestures. It can adaptively change display parameters and recognize user gestures to achieve the function of interaction with the user.

[0049] In some embodiments, the detector 230 may also include a temperature sensor, such as by sensing ambient temperature.

[0050] In some embodiments, the display device 200 may adaptively adjust the color temperature of the displayed image. For example, in a high-temperature environment, the display device 200 may adjust the color temperature of the displayed image to be cooler, or in a low-temperature environment, the display device 200 may adjust the color temperature of the displayed image to be warmer.

[0051] In some embodiments, the detector 230 may also be a sound acquisition device, such as a microphone, for receiving the user's voice. For example, it may include voice signals containing control commands from the user to the display device 200, or it may collect ambient sounds to identify the type of environmental scene, enabling the display device 200 to adaptively adapt to ambient noise.

[0052] In some embodiments, such as Figure 2 As shown, the input / output interface 255 is configured to enable data transmission between the controller 250 and other external devices or other controllers 250. This includes receiving video and audio signal data, or command and instruction data, from external devices.

[0053] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as an HDMI interface, an analog or high-definition component input interface, a composite video input interface, a USB input interface, and an RGB port. Alternatively, multiple interfaces may be combined to form a composite input / output interface.

[0054] In some embodiments, such as Figure 2 As shown, the tuner / demodulator 210 is configured to receive broadcast television signals via wired or wireless means, and to perform modulation and demodulation processes such as amplification, mixing, and resonance, to demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the frequency of the television channel selected by the user, as well as EPG data signals.

[0055] In some embodiments, the frequency point demodulated by the tuner 210 is controlled by the controller 250, which can issue control signals according to user selection to make the modem respond to the television signal frequency selected by the user and modulate the television signal carried at that frequency.

[0056] In some embodiments, broadcast television signals can be categorized according to different broadcasting standards, such as terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or internet broadcast signals. Alternatively, they can be categorized according to different modulation types, such as digital modulation signals or analog modulation signals. Or, they can be categorized according to different signal types, such as digital signals or analog signals.

[0057] In some embodiments, the controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the modulated and demodulated television audio and video signal from the received broadcast television signal to the main device, and the main device receives the audio and video signal through the first input / output interface.

[0058] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 275, the controller 250 can perform operations related to the object selected by the user command.

[0059] In some embodiments, the object can be any of the optional objects, such as a hyperlink or an icon. Operations related to the selected object include, for example, displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon. User commands for selecting UI objects can be input via various input devices connected to the display device 200 (e.g., mouse, keyboard, touchpad, etc.) or voice commands corresponding to spoken commands by the user.

[0060] like Figure 2 As shown, the controller 250 includes at least one of the following: Random Access Memory 251 (RAM), Read-Only Memory 252 (ROM), Video Processor 270, Audio Processor 280, Other Processors 253 (e.g., Graphics Processing Unit (GPU), Central Processing Unit (CPU) 254), Communication Interface, and Communication Bus 256. The Communication Bus connects the various components.

[0061] In some embodiments, RAM 251 is used to store temporary data of the operating system or other running programs.

[0062] In some embodiments, ROM 252 is used to store various system startup instructions.

[0063] In some embodiments, ROM 252 is used to store a basic input / output system, referred to as the Basic Input / Output System (BIOS). It is used to perform power-on self-tests, initialize various functional modules within the system, install drivers for the system's basic inputs / outputs, and boot the operating system.

[0064] In some embodiments, upon receiving a power-on signal, the display device 200 starts up, the CPU executes the system startup instructions in ROM 252, and copies temporary data of the operating system stored in memory to RAM 251 to facilitate the startup or operation of the operating system. After the operating system has started up, the CPU copies temporary data of various applications from memory to RAM 251 to facilitate the startup or operation of various applications.

[0065] In some embodiments, the CPU processor 254 is configured to execute operating system and application instructions stored in memory, and to execute various applications, data, and content based on various interactive instructions received from external input, so as to ultimately display and play various audio and video content.

[0066] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in a pre-power-on mode, and / or to display a screen in normal mode. The one or more sub-processors are used for one operation in a standby mode or other state.

[0067] In some embodiments, the graphics processor 253 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes a calculation unit that performs calculations based on various user input interaction commands and displays various objects according to display attributes. It also includes a renderer that renders the various objects obtained from the calculation unit, and the rendered objects are used to display on a monitor.

[0068] In some embodiments, the video processor 270 is configured to receive external video signals and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, so as to obtain a signal that can be directly displayed or played on the display device 200.

[0069] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.

[0070] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if the input is MPEG-2, the demultiplexing module will demultiplex it into video signals and audio signals.

[0071] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0072] Image compositing modules, such as image synthesizers, are used to overlay and blend GUI signals generated by a graphics generator based on user input or its own data with scaled video images to generate displayable image signals.

[0073] The frame rate conversion module is used to convert the frame rate of the input video, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate. The usual format is achieved by frame interpolation.

[0074] The display formatting module is used to convert the received frame rate video output signal and change the signal to conform to the display format, such as outputting RGB data signals.

[0075] In some embodiments, the graphics processor 253 can be integrated with the video processor or configured separately. When integrated, it can perform the processing of graphics signals output to the display. When configured separately, they can perform different functions, such as a GPU+FRC (Frame Rate Conversion) architecture.

[0076] In some embodiments, the audio processor 280 is configured to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signals, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

[0077] In some embodiments, the video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

[0078] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or integrated into one or more chips together with the controller.

[0079] In some embodiments, the audio output receives sound signals output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and external audio output terminals of the generating device of an external device, such as an external audio interface or headphone interface, in addition to the speaker carried by the display device 200 itself. It may also include a short-range communication module in the communication interface, such as a Bluetooth module for Bluetooth speaker sound output.

[0080] The power supply 290, under the control of the controller 250, provides power to the display device 200 from an external power source. The power supply 290 may include a built-in power circuit installed inside the display device 200, or it may be an external power source installed in the display device 200, providing an external power interface within the display device 200.

[0081] User interface 265 is used to receive user input signals and then send the received user input signals to controller 250. The user input signals can be remote control signals received via an infrared receiver, or various user control signals received via a network communication module.

[0082] In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300, and the user input interface responds to the user's input through the controller 250.

[0083] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0084] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user. It converts information between its internal form and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0085] The memory 260 includes various software modules for driving the display device 200. For example, the various software modules stored in the first memory include at least one of the following: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0086] The basic module is a low-level software module used for signal communication between various hardware components in the display device 200 and for sending processing and control signals to higher-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage the data.

[0087] For example, the speech recognition module includes a speech parsing module and a speech command database module. The display control module controls the monitor to display image content and can be used to play multimedia images and UI information. The communication module is used for control and data communication with external devices. The browser module is used to perform data communication with browser servers. The service module provides various services and applications. Meanwhile, the memory 260 also stores received external data and user data, images of various items in the user interface, and visual effects of the focused object.

[0088] The execution subject of this application embodiment may be the above-described Figure 1 The display device 200 in the middle.

[0089] Currently, smart terminals enable human-computer interaction through touch operations on an interactive interface displayed on a screen. During the response to touch operations, the screen needs to locate the touch point. In existing technologies, the screen scans multiple times to detect multiple touch areas, and then intersects these areas to accurately locate the touch point. However, when users perform rapid touch operations, the speed of touch point location affects the terminal's response time, resulting in missed touches or disconnections, thus degrading the touch operation experience.

[0090] To address the aforementioned technical problems, this application provides a touch point positioning scheme that simplifies the polygon formed by the intersection of touch areas before intersecting it with the next detected touch area. This reduces computational complexity, improves the positioning speed of touch points, and thus enhances the terminal's response speed to touch operations, thereby improving the touch operation experience.

[0091] It should be noted that the smart terminal and terminal in this application can be smart TVs, computers, tablets, smart wearable devices, mobile phones, etc. Of course, the smart terminal and terminal can also be the aforementioned display devices, such as... Figure 1 and Figure 2 The display device 200 in the middle.

[0092] The methods provided in the embodiments of this application will now be described in conjunction with the accompanying drawings.

[0093] As previously mentioned, display devices (such as...) Figure 1 or Figure 2 The display device 200 includes a display and a processor. In this embodiment, the display is equipped with a touch detection device for detecting the touch area of ​​a touch point.

[0094] For example, the touch detection device includes a light-emitting component and a light-receiving component, which are respectively deployed on opposite sides of the display. For example Figure 3 As shown, a first light-emitting component is deployed on the upper side of the display, a first light-receiving component is deployed on the lower side of the display, a second light-emitting component is deployed on the left side of the display, and a second light-receiving component is deployed on the right side of the display. Optionally, Figure 3 The first and second light-emitting components can be components of a light-emitting component, or they can be independent light-emitting components. Figure 3 The first and second light-receiving components can be components of the light-receiving components, or they can be independent light-receiving components. This application does not limit this.

[0095] Optionally, the light-emitting component may consist of multiple emitting lamps, such as infrared emitting lamps.

[0096] Optionally, the light receiving component may consist of multiple receivers, such as infrared light receivers.

[0097] Figure 4 This is a flowchart illustrating a touch point positioning method 300 provided in an embodiment of this application. Figure 4 As shown, the method specifically includes some or all of the following steps:

[0098] S310, detect N touch areas of the target touch point in N scanning directions respectively, where N is an integer greater than 0;

[0099] S320, intersect the i-th touch area with the first polygon to obtain the second polygon, where the first polygon is determined based on the (i-1)-th touch area, and i is an integer less than or equal to N and greater than 0;

[0100] S330, Based on the vertices of the second polygon, the second polygon is transformed into a third polygon, the vertices of the third polygon being a subset of the vertices of the second polygon;

[0101] S340, Determine the coordinates of the target touch point based on the third polygon.

[0102] In the above S310, the N scanning directions can be, for example, the light emission directions of the light-emitting components of the touch detector. The light emission directions of each scanning direction are different. In other words, the parallel light beams emitted by the light-emitting components at the same angle form a scanning direction.

[0103] Combination Figures 5a to 5d As shown, the first light-emitting component emits light perpendicular to the first receiving component towards the first receiving component (see...). Figure 5a ), and emits light at an angle toward the first receiving component (see Figure 5b The second light-emitting component emits a line perpendicular to the second receiving component towards the second receiving component (see...). Figure 5c ), and emits light at an angle toward the second receiving component (see Figure 5d It should be understood that light emitted from the light-emitting component at an angle to the receiving component forms a scanning direction, that is... Figures 5a to 5d In the process, the emitted light rays at two angles from the first light-emitting component form two scanning directions, and the emitted light rays at two angles from the second light-emitting component also form two scanning directions. These N scanning directions are... Figures 5a to 5d It includes four scanning directions. Of course, the above four scanning directions are just an example. In actual application scenarios, there may be more or fewer scanning directions. For example, the first light-emitting component can form four scanning directions, the second light-emitting component can form one scanning direction, and so on.

[0104] The target touch point can be the location touched by the user on the human-computer interaction interface of the display. This application does not limit the number of target touch points. For example, when the user performs a single-finger operation, one target touch point is formed on the human-computer interaction interface; when the user performs a multi-finger operation, multiple target touch points are formed simultaneously on the human-computer interaction interface.

[0105] In S310 described above, the touch detection device can detect a touch area in each scanning direction. For example, in Figure 6 In the scanning direction shown, the target touch point blocks several consecutive light rays in the parallel light path. These consecutively blocked light rays form a touch area in the scanning direction, with the light rays on both sides of the blocked light rays serving as the boundary of the touch area.

[0106] In the above S320, the i-th touch area is one of N touch areas. For the i-th touch area, the processor can intersect it with a first polygon to obtain a second polygon. The first polygon can be determined based on the (i-1)-th touch area; for example, the first polygon can be obtained by intersecting the (i-1)-th touch area with a first polygon determined based on the (i-2)-th touch area. Combined with... Figure 7a As shown, assuming the first touch area and the second touch area intersect to form polygon A, see [reference]. Figure 7b The processor can intersect the third touch area with the first polygon A to obtain polygon B. Furthermore, Figure 7c In the process, the processor can intersect the fourth touch area with polygon B to obtain polygon C.

[0107] See Figure 8If the first light-emitting component can form 60 scanning directions by emitting light in different directions, and the second light-emitting component can form 60 scanning directions by emitting light in different directions, then the intersecting polygons can have a maximum of 240 sides, and the computational load of their intersection operation is huge.

[0108] In order to reduce computational complexity and improve the positioning speed of touch points, in the above-described S330, the second polygon is converted into a third polygon, reducing the number of vertices of the second polygon, thereby reducing the computational complexity when the second polygon intersects with the (i+1)th touch area detected in the (i+1)th scanning direction.

[0109] For example, the processor can use the second polygon as the third polygon when the number of vertices of the second polygon is less than a preset value, that is, without reducing the number of vertices of the second polygon. Correspondingly, the processor can filter the vertices of the second polygon to obtain the third polygon when the number of vertices of the second polygon is greater than or equal to the preset value.

[0110] For example, suppose the default value is 6. Figure 7a If polygon A has 4 vertices, then no vertex filtering is required before polygon A intersects with the 3rd touch area; Figure 7b Polygon B in the image has 6 vertices, and no vertex filtering is required before it intersects with the 4th touch area; while Figure 7c If polygon C has 7 vertices, then the vertices need to be filtered before it intersects with the 5th touch area.

[0111] Generally, the default value is an integer greater than or equal to 3.

[0112] In some embodiments, the processor can filter the vertices of the third polygon from the vertices of the second polygon at preset intervals. For example, the processor can delete a vertex every other vertex, or delete a vertex every two vertices.

[0113] In other embodiments, the processor determines the degree of drastic change in position between adjacent vertices, and if the degree of drastic change is less than a threshold, one of the adjacent vertices is selected as a vertex of the third polygon. For example, Figure 9a In the middle, one of the adjacent vertices a and b (e.g., vertex b) whose position change is less than a certain threshold is deleted, resulting in... Figure 9b The polygon in the middle (i.e., the third polygon).

[0114] Optionally, after filtering the vertices of the second polygon in the above two ways, if the number of vertices is still greater than or equal to the preset value, the processor can filter the vertices again based on the same or different filtering methods until the number of vertices of the third polygon is less than the preset value.

[0115] In this embodiment of the application, if i equals N, the coordinates of the third polygon can directly determine the coordinates of the target touch point. If i does not equal N, the third polygon can be intersected with the (i+1)th touch area until the Nth touch area is intersected, and then the coordinates of the target touch point can be obtained.

[0116] For example, the processor can use the third polygon as the first polygon and execute the processes S320 to S340 described above. That is, the processor intersects the (i+1)th touch area with the third polygon to obtain the second polygon corresponding to the (i+1)th touch area, and converts the second polygon into the third polygon corresponding to the (i+1)th touch area based on the vertices of the second polygon. Then, the third polygon is used as the first polygon corresponding to the (i+2)th touch area, and so on, until the Nth touch area intersects with its corresponding first polygon to obtain the coordinates of the target touch point.

[0117] Understandably, a processor completes one scan cycle by intersecting N touch areas. For example, the processor can generate the coordinates of the target touch point for each scan cycle to obtain the trajectory of the user's touch operation.

[0118] In this embodiment, the processor transforms the second polygon obtained by the intersection of the i-th touch area and the first polygon into a third polygon with fewer vertices to simplify the second polygon. Then, based on the third polygon, the coordinates of the target touch point are determined, which reduces the computational complexity, improves the positioning speed of the touch point, and thus improves the response speed of the touch operation and enhances the touch operation experience.

[0119] Based on any of the above embodiments, combined with Figure 10 As shown, this embodiment may also include some or all of the following steps:

[0120] S410, initialize at least one of the following: number of scanning directions, scanning angle, and preset value;

[0121] S420 performs a scan cycle of detection via a touch detection device;

[0122] S430 extracts N touch areas in N scanning directions through the processor;

[0123] S440, intersect the i-th touch area with the first polygon to obtain the second polygon;

[0124] S450, determine the touch control mode based on the rate of change of the position of the target touch point relative to the first touch point, the position of which is obtained by detection in the previous scan cycle;

[0125] When the touch operation mode is fast-moving touch, the second polygon is converted into a third polygon based on the vertices of the second polygon. For example, when the touch operation mode is fast-moving touch, S460 and S470 are executed, and when the touch operation mode is not fast-moving touch, S480 is executed.

[0126] S460, Determine whether the number of vertices of the second polygon is greater than or equal to a preset value;

[0127] If the number of vertices of the second polygon is greater than or equal to the preset value, then execute S470; if the number of vertices of the second polygon is less than the preset value, then execute S480.

[0128] S470, Filter the vertices of the second polygon to obtain the third polygon;

[0129] S480, the second polygon is used as the third polygon, that is, the vertices of the second polygon are not filtered, in other words, the vertices of the second polygon and the third polygon are the same.

[0130] S490, determine whether all N touch areas have intersected;

[0131] If all N touch areas have intersected, then execute S500; otherwise, execute S440 as described above.

[0132] S500, based on the obtained touch operation trajectory, performs at least one of the following on the target touch point: ghost point removal, trajectory tracking, and smoothing.

[0133] S510, generate the coordinates of the target touch point and output the coordinates of the target touch point;

[0134] If the touch operation has ended, return to step S420 above and continue execution; otherwise, end the process.

[0135] S420 to S440 and S460 to S480 have been described in the previous embodiments and will not be repeated here.

[0136] Regarding the S450 mentioned above, it should be noted that during slow writing by the user, the touch response speed requirement of the display device is not high, but the accuracy requirement for touch position recognition is high. In this case, the processor can obtain the accurate target touch point position by intersecting N touch areas sequentially. However, during fast writing or drawing, i.e., fast touch movement, the touch response speed requirement of the display device is high, and the accuracy requirement for touch position recognition is low. In this case, the processor needs to simplify the polygon obtained by each touch area after it intersects with the previous polygon, so as to reduce the computational complexity when the polygon intersects with the next touch area and improve the touch response speed.

[0137] Figure 11 This is a schematic block diagram of a touch point positioning device provided in an embodiment of this application. Figure 11 As shown, the device 600 includes:

[0138] The detection unit 610 is used to detect N touch areas of the target touch point in N scanning directions, where N is an integer greater than 1;

[0139] The processing unit 620 is used to intersect the i-th touch area with the first polygon to obtain the second polygon, wherein the first polygon is determined based on the (i-1)-th touch area, and i is an integer less than or equal to N and greater than 0.

[0140] The processing unit 620 is further configured to convert the second polygon into a third polygon based on the vertices of the second polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon;

[0141] The processing unit 620 is also used to determine the coordinates of the target touch point based on the third polygon.

[0142] In some embodiments, the processing unit 620 is specifically used to: when the number of vertices of the second polygon is greater than or equal to a preset value, filter the vertices of the second polygon to obtain the third polygon.

[0143] In some embodiments, the processing unit 620 is specifically configured to: filter out the vertices of the third polygon from the vertices of the second polygon at a preset interval; or, determine the degree of positional change between adjacent vertices, and when the degree of positional change between adjacent vertices is less than a degree threshold, use one of the adjacent vertices as the vertex of the third polygon.

[0144] In some embodiments, the processing unit 620 is specifically used to: use the third polygon as the first polygon, intersect it with the (i+1)th touch area to obtain the second polygon, and repeat this process until the Nth touch area is intersected to obtain the coordinates of the target touch point.

[0145] In some embodiments, the processing unit 620 is specifically configured to: when the number of vertices of the second polygon is less than the preset value, use the second polygon as the third polygon.

[0146] In some embodiments, the processing unit 620 is further configured to: determine a touch control mode based on the rate of change of the position of the target touch point relative to the first touch point, wherein the position of the first touch point is detected in the previous scan cycle; and when the touch control mode is a fast-moving touch, convert the second polygon into the third polygon based on the vertices of the second polygon.

[0147] The touch point positioning device provided in the above embodiments can execute the technical solutions of the above method embodiments, and its implementation principle and technical effect are similar, so they will not be described again here.

[0148] This application also provides a computer-readable storage medium, which may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. Specifically, the computer-readable storage medium stores program instructions, which are used in the methods described in the above embodiments.

[0149] This application also provides a program product including executable instructions stored in a readable storage medium. At least one processor of an electronic device can read the executable instructions from the readable storage medium, and the at least one processor executes the executable instructions to cause the electronic device to perform the methods provided in the various embodiments described above.

[0150] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0151] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: Displays and processors; The display is equipped with a touch detection device; The touch detection device is used to detect N touch areas of the target touch point in N scanning directions, where N is an integer greater than 1; The processor is configured to: The second polygon is obtained by intersecting the i-th touch area with the first polygon. The first polygon is determined based on the (i-1)-th touch area, where i is an integer less than or equal to N and greater than 0. Based on the vertices of the second polygon, the second polygon is transformed into a third polygon to simplify the second polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon; The third polygon is used as the first polygon, and its intersection with the (i+1)th touch area is used to obtain the second polygon. This process is repeated until the Nth touch area is intersected to obtain the coordinates of the target touch point.

2. The device according to claim 1, characterized in that, The processor is configured to: When the number of vertices of the second polygon is greater than or equal to a preset value, the vertices of the second polygon are filtered to obtain the third polygon.

3. The device according to claim 1 or 2, characterized in that, The processor is configured to: The vertices of the third polygon are obtained by filtering from the vertices of the second polygon at preset intervals; or, Determine the degree of drastic change in position between adjacent vertices. If the degree of drastic change in position between adjacent vertices is less than a threshold, one of the adjacent vertices is selected as a vertex of the third polygon.

4. The device according to claim 1, characterized in that, The processor is configured to: When the number of vertices of the second polygon is less than a preset value, the second polygon is used as the third polygon.

5. The device according to claim 1 or 2, characterized in that, The touch detection device includes a light-emitting component and a light-receiving component, which are respectively deployed on opposite sides of the display. The light-receiving component receives the light emitted by the light-emitting component in the N scanning directions to detect the touch area of ​​the target touch point on the display.

6. The device according to claim 1 or 2, characterized in that, The processor is deployed as follows: The touch control mode is determined based on the rate of change of the position of the target touch point relative to the first touch point, wherein the position of the first touch point is obtained from the previous scan cycle. When the touch control mode is fast-moving touch, the second polygon is converted into the third polygon based on the vertices of the second polygon.

7. A touch point positioning method, characterized in that, include: N touch regions of the target touch point are detected in N scanning directions, where N is an integer greater than 1; The second polygon is obtained by intersecting the i-th touch area with the first polygon. The first polygon is determined based on the (i-1)-th touch area, where i is an integer less than or equal to N and greater than 0. Based on the vertices of the second polygon, the second polygon is transformed into a third polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon; The third polygon is used as the first polygon, and its intersection with the (i+1)th touch area is used to obtain the second polygon. This process is repeated until the Nth touch area is intersected to obtain the coordinates of the target touch point.

8. The method according to claim 7, characterized in that, The step of converting the second polygon into a third polygon based on its vertices includes: When the number of vertices of the second polygon is greater than or equal to a preset value, the vertices of the second polygon are filtered to obtain the third polygon.

9. A touch point positioning device, characterized in that, include: The detection unit is used to detect N touch areas of the target touch point in N scanning directions, where N is an integer greater than 1; The processing unit is used to intersect the i-th touch area with the first polygon to obtain the second polygon, wherein the first polygon is determined based on the (i-1)-th touch area, and i is an integer less than or equal to N and greater than 0. The processing unit is further configured to convert the second polygon into a third polygon based on the vertices of the second polygon, wherein the vertices of the third polygon are a subset of the vertices of the second polygon; The processing unit is further configured to determine the coordinates of the target touch point based on the third polygon; The processing unit is specifically used to take the third polygon as the first polygon, intersect it with the (i+1)th touch area to obtain the second polygon, and repeat this process until it intersects with the Nth touch area to obtain the coordinates of the target touch point.

Images