Touch area determination method and apparatus, touch method and apparatus, display device, and medium

Abstract

Disclosed in embodiments of the present application are a touch area determination method and apparatus, a touch method and apparatus, a display device, and a medium. A laser radar is configured on a display device for touch detection, a scanning plane of the laser radar is greater than a display plane of the display device, and scanning of an area outside the display plane can be realized. On the basis of a detection range of the laser radar that is not limited by the display plane, when a function of expanding a touch area is enabled, a second touch area is additionally determined in the area outside the display plane. By means of a first touch area and the second touch area, a touch operation detected in an area corresponding to the display plane and a touch operation detected in the area outside the display plane are respectively processed. In this way, interaction operations in a non-picture display area that break through the limitation of picture display content are realized, and these interaction operations can meet various control requirements in a multi-person communication scenario.

Description

Touch area determination method, touch method, device, display device and medium Technical Field

[0001] The embodiments of the present application relate to the field of interactive technology, and in particular to a touch area determination method, a touch method, an apparatus, a display device, and a medium. Background Art

[0002] With the continuous development and popularization of information technology, various types of terminal devices continue to emerge, and the communication methods between terminal devices are also becoming increasingly diverse. The rich and diverse communication methods and terminal devices provide strong technical support for various types of communication between people. For example, in electronic conference rooms built based on information technology, various peripheral devices such as microphones, speakers, and screen transmitters are configured around the display device. During multi-person communication activities carried out in electronic conference rooms, peripheral devices are connected to the display device and cooperate with the display device to realize the collection, transmission, and presentation of information during the multi-person communication process. In multi-person communication carried out with the display device as the hardware center display, human-computer interaction on the display device is usually achieved through touch operation.

[0003] When the inventor used existing display devices for human-computer interaction during multi-person communication, he found that the touch operation interface usually overlaps with the screen display interface, and the specific interaction object is usually the screen display content. The basis of this interaction design makes the interactive operation strictly restricted by the screen display content, and the control of the display device cannot meet the rich and diverse control needs in multi-person communication scenarios.

[0004] Summary of the Invention

[0005] The present invention provides a touch area determination method, a touch method, an apparatus, a display device, and a medium to solve the technical problem that existing interactive operations are strictly limited by the displayed content of the screen and the control of the display device cannot meet the rich and diverse control requirements in multi-person communication scenarios.

[0006] In a first aspect, embodiments of the present application provide a touch area determination method for a display device, wherein the display device is configured with at least one laser radar, the laser radar being configured to scan a display surface of the display device and a peripheral area of ​​the display device. The touch area determination method includes:

[0007] Obtaining occlusion position information of a positioning reference point on the display surface; wherein the occlusion position information is acquired by a laser radar performing a laser scan on the display surface of the display device, and the positioning reference point is a point on the display surface used to determine the specific position information of the display surface in the scanning surface of the laser radar;

[0008] Determining a first touch area corresponding to the display surface in a scanning surface of the laser radar according to the occlusion position information of the positioning reference point;

[0009] When the function for extending the touch area in the display device is enabled, obtaining target position information; the target position information is used to expand the area on the display surface;

[0010] A second touch area is determined in the peripheral area of ​​the display device based on the first touch area and the target position information. The second touch area is the area in the scanning surface of the laser radar used for extended touch. Both the first touch area and the second touch area are used for touch interaction.

[0011] As mentioned above, when the display device is configured with a laser radar for touch detection, the scanning surface of the laser radar is larger than the display surface of the display device, and can scan the area outside the display surface. On the basis of the detection range of the laser radar not constrained by the display surface, when the function of extending the touch area is enabled, a second touch area is additionally confirmed in the area outside the display surface. Through the first touch area and the second touch area, the touch operations detected in the corresponding area of ​​the display surface and the touch operations detected in the area outside the display surface are processed separately, thereby realizing interactive operations in the non-screen display area that break through the limitations of the screen display content. These interactive operations can meet the rich and diverse control needs in multi-person communication scenarios.

[0012] The process of obtaining the occlusion position information of the positioning reference point on the display surface includes:

[0013] displaying a reference point touch guide for guiding touching of a positioning reference point in the display surface, the reference point touch guide including a touching sequence for the positioning reference point;

[0014] When the reference point touch guidance is displayed, the occlusion position information obtained from the lidar is associated with the positioning reference points in the touch order to obtain the occlusion position information of the positioning reference points.

[0015] As described above, when the function of extending the touch area is enabled, the user is guided to operate on the display surface by touching the reference point, and the occlusion position information of the positioning reference point is confirmed according to the occlusion position information obtained during the guidance process, so as to confirm the first touch area and the second touch area. The display device and the lidar can be flexibly installed according to the application scenario of the display device, and the position of the display surface and the position for extended touch can be quickly confirmed after installation.

[0016] The method of determining the first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point includes:

[0017] Determine the conversion relationship between the laser radar coordinate system and the display surface coordinate system based on the occlusion position information of the positioning reference point;

[0018] Determine the target position of each vertex of the display surface in the laser radar coordinate system according to the conversion relationship;

[0019] The first touch area corresponding to the display surface in the scanning surface of the laser radar is determined according to the target position of each vertex.

[0020] As described above, while confirming the first touch area based on the occlusion position information of the reference point, the conversion relationship between the coordinate system of the laser radar and the coordinate system of the display surface is confirmed. In the subsequent interaction state, the corresponding processing can be directly performed according to the conversion relationship, thereby improving the interaction efficiency and interaction accuracy.

[0021] Obtaining target location information includes:

[0022] Obtaining preset position parameters for area expansion on the display surface as target position information;

[0023] or,

[0024] Collect and display the spatial location information of the device in the actual usage scenario;

[0025] Generate target position information based on the spatial position information.

[0026] As described above, the target location information can be obtained in various ways, thereby adapting to the user's interaction needs or usage scenarios and obtaining appropriate target location information.

[0027] The step of obtaining preset position parameters for area expansion of the display surface as target position information includes:

[0028] Reading position parameters for area expansion of the display surface from a preset parameter configuration file as target position information;

[0029] or,

[0030] Displaying an adjustment interface for configuring parameters of the extended touch area;

[0031] In response to the target parameter value of the parameter received in the adjustment interface, position parameters for area expansion of the display surface are obtained as target position information.

[0032] As described above, the user's extended touch needs are met in a variety of ways through preset position parameters suitable for use or position parameters input by the user.

[0033] Generating target location information according to spatial location information includes:

[0034] Confirm the spatial distance information of the display device from the upper, lower, left, and right obstructions in the actual usage scenario based on the spatial position information;

[0035] The target position information is generated by combining the size of the display surface of the display device and the spatial distance information.

[0036] As described above, by confirming the target position information based on the installation status of the display device in the actual scene, it is possible to ensure that the generated second touch area can be realized in the actual scene, and to ensure that the extended touch is completed normally.

[0037] The method of determining the second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0038] Determining an expansion direction and an expansion distance for area expansion on the display surface according to the target position information;

[0039] Starting from the side of the first touch area corresponding to the extension direction, the touch area is translated along the extension direction for an extension distance, and the extended touch area covered by the translation is used as the second touch area.

[0040] As described above, by moving the side of the first touch area outward by a certain distance to achieve expansion, the second touch area can be quickly confirmed.

[0041] The method of determining the second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0042] Determining an expansion direction and an expansion area for area expansion on the display surface according to the target position information;

[0043] The first touch area is extended along the extension direction and according to the extension area to obtain an extended touch area in the peripheral area of ​​the display device in the scanning surface of the laser radar as the second touch area.

[0044] As described above, by extending a region of a specified area on one side of the first touch region to achieve expansion, a second touch region with a shape that adapts to various scene states can be obtained.

[0045] In a second aspect, embodiments of the present application further provide a touch control method, applied to a display device, wherein an interactive area of ​​the display device includes a first touch control area and a second touch control area determined by any one of the touch control area determination methods of the first aspect; the touch control method includes:

[0046] In the interactive state, when the occlusion position information corresponding to the first touch area is received, the touch position information is generated point-to-point according to the occlusion position information;

[0047] In the interactive state, when the occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information.

[0048] As described above, based on the detection range of the laser radar that is not constrained by the display surface, the touch operations detected in the corresponding area of ​​the display surface and the touch operations detected in the area outside the display surface are processed separately, thereby achieving interactive operations in the non-screen display area that break through the limitations of the screen display content. These interactive operations can meet the rich and diverse control needs in multi-person communication scenarios.

[0049] Wherein, in the interactive state, when the occlusion position information corresponding to the second touch area is received, generating a touch system event according to the occlusion position information includes:

[0050] In the interactive state, when the occlusion position information corresponding to the second touch area is received, multiple occlusion position information with the same coordinate component having the same change trend and the change amount within a preset range are confirmed as a touch system event, and the type of the touch system event is confirmed based on the change trend.

[0051] As described above, based on the constraints on the changing rules during the movement process, erroneous operations can be effectively identified, and the response accuracy of interactive operations in the extended touch area can be improved.

[0052] In a third aspect, embodiments of the present application further provide a touch area determination device, which is used for a display device, wherein the display device is configured with at least one laser radar, and the laser radar is used to scan a display surface of the display device and a peripheral area of ​​the display device. The touch area determination device includes:

[0053] An occlusion position information acquisition module is used to obtain occlusion position information of a positioning reference point on the display surface; wherein the occlusion position information is acquired by laser scanning the display surface of the display device by a laser radar, and the positioning reference point is a point on the display surface used to determine the specific position information of the display surface in the scanning surface of the laser radar;

[0054] A first area confirmation module is used to determine a first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point;

[0055] A target position information acquisition module is used to acquire target position information when the function for extending the touch area in the display device is enabled; the target position information is used to expand the area of ​​the display surface;

[0056] The second area confirmation module is used to determine the second touch area in the peripheral area of ​​the display device based on the first touch area and target position information. The second touch area is the area in the scanning surface of the laser radar used for extended touch; the first touch area and the second touch area are both used for touch interaction.

[0057] In a fourth aspect, embodiments of the present application provide a touch device, applied to a display device, wherein an interactive area of ​​the display device includes a first touch area and a second touch area determined by any one of the touch area determination methods of the first aspect; the touch device includes:

[0058] A first touch area interaction processing module is configured to generate touch position information point-by-point based on the occlusion position information when receiving occlusion position information corresponding to the first touch area in an interactive state;

[0059] The second touch area interaction processing module is configured to generate a touch system event according to the occlusion position information when receiving occlusion position information corresponding to the second touch area in the interaction state.

[0060] Wherein, in the interactive state, when the occlusion position information corresponding to the second touch area is received, generating a touch system event according to the occlusion position information includes:

[0061] In the interactive state, when the occlusion position information corresponding to the second touch area is received, multiple occlusion position information with the same coordinate component having the same change trend and the change amount within a preset range are confirmed as a touch system event, and the type of the touch system event is confirmed based on the change trend.

[0062] In a fifth aspect, an embodiment of the present application further provides a display device, including:

[0063] LiDAR;

[0064] one or more processors;

[0065] a memory for storing one or more computer programs;

[0066] When one or more computer programs are executed by one or more processors, the display device implements any method of the first aspect.

[0067] In a sixth aspect, an embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the methods of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] FIG1 is a flow chart of a touch-expanded interaction method provided in an embodiment of the present application.

[0069] FIG. 2 is a front view schematic diagram of a display device in the related art.

[0070] FIG3 is a schematic diagram showing the relationship between touch and display of a display device in the related art.

[0071] FIG4 is a schematic diagram showing the principle of detecting occlusion position information by a laser radar in an embodiment of the present application.

[0072] FIG5 is a schematic diagram of an exemplary state of a touch positioning reference point in an embodiment of the present application.

[0073] FIG6 is a schematic diagram showing the distribution of an exemplary first touch area and a second touch area in an embodiment of the present application.

[0074] FIG. 7 is a schematic structural diagram of a touch area determination device provided in an embodiment of the present application.

[0075] FIG8 is a schematic structural diagram of a touch device provided in an embodiment of the present application.

[0076] FIG9 is a schematic structural diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0077] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended to explain the present invention, not to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.

[0078] It should be noted that due to space limitations, this application specification does not enumerate all optional implementation methods. After reading this application specification, those skilled in the art should be able to understand that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0079] The following describes in detail the embodiments of the present invention.

[0080] The existing display device 10 is an integrated device for controlling the content displayed on the display screen and realizing human-computer interaction operations, which integrates one or more functions such as a projector, an electronic whiteboard, a screen, an audio system, a television, and a video conferencing terminal.

[0081] Typically, the display device is installed with at least one operating system, including but not limited to Android, Linux, Windows, and Huawei's Hongmeng system, which is used to control and coordinate the display device and peripheral devices so that the various independent hardware in the display device can work together as a stable whole. The display device includes at least one display screen, which can be an LED display screen, an LCD display screen, or an OLED display screen. That is, the display device includes LED display devices, LCD display devices, OLED display devices, etc., which can all be used to implement this solution. For example, the display device is equipped with a display screen with touch function, that is, a touch-sensitive display screen.

[0082] Common touch modules include resistive touch modules, capacitive touch modules, infrared touch modules, electromagnetic touch modules, etc. These touch modules have clear touch detection boundaries determined by hardware. The touch detection boundaries usually overlap with the boundaries of the screen display. Based on this boundary relationship, as shown in Figure 3, the width and height of the touch detection area 102 and the screen display area 101 are equal and overlap, thereby realizing touch operations within the visual area based on the screen display, presenting an interactive experience of what you see is the operation object.

[0083] Display devices with touch detection areas that are equal in width and height to the display area, typically only operate within the current application window. When system-level operations are required, the user must exit the current application window or invoke a new trigger control window for system-level functions before performing the desired operation. These operations are strictly limited by the displayed content, and quick control of the display device cannot meet the diverse control needs of multi-person communication scenarios.

[0084] In response to the above technical problems, an embodiment of the present application proposes to configure a laser radar on the display device for touch detection. The scanning surface of the laser radar is larger than the display surface of the display device, and can scan the area outside the display surface. On the basis of the detection range of the laser radar not constrained by the display surface, when the function of expanding the touch area is enabled, a second touch area is additionally confirmed in the area outside the display surface. Through the first touch area and the second touch area, the touch operations detected in the corresponding area of ​​the display surface and the touch operations detected in the area outside the display surface are processed separately, thereby realizing interactive operations in the non-screen display area that break through the limitations of the screen display content. These interactive operations can meet the rich and diverse control needs in multi-person communication scenarios.

[0085] FIG1 is a flow chart of a touch-expanded interaction method provided in an embodiment of the present application, which is exemplarily applied to a display device 10 as shown in FIG4 . The display device 10 includes a laser radar 20, the scanning surface of which covers the display surface of the display device 10. During operation, the laser radar 20 is driven by a motor to continuously rotate the laser transceiver (including a transmitter and a receiver) (the maximum rotation angle can reach 360°, that is, it always rotates clockwise or counterclockwise, or rotates alternately clockwise and counterclockwise within a certain angle range). The transmitter continuously emits laser light during rotation. When the laser light hits an obstacle around it, it is reflected and detected by the receiver. The laser radar 20 can determine the position of the obstacle relative to the laser radar 20 based on the transmitter's emission time, emission angle, and receiver's reception time. The transmitter rotates around the rotation axis and emits laser light perpendicular to the rotation axis. The laser light emitted around the rotation axis can confirm a plane, which is the scanning surface in the embodiment of the present application. In the actual installation environment of the display device 10 and the laser radar 20, there will inevitably be static obstacles that block the propagation of the laser and cause it to reflect. The actual scanning surface that can be detected is a limited planar area. The display surface in the embodiments of the present application refers to the planar area of ​​the display screen of the display device when displaying an image. For a display device, the display surface remains unchanged.

[0086] When installing the display device 10 and the laser radar 20, the relative installation positions of the two can be directly installed according to the design at the time of production, or the laser radar 20 can be flexibly installed near the display device 10 according to the on-site environment. During installation, the display device 10 can be installed by a floor stand or fixed on the wall, and the display surface is parallel to the vertical direction after installation. The installation of the laser radar 20 is determined by the installation position of the display device 10. It is necessary to ensure that the scanning surface and the display surface are as parallel as possible and the distance between the two is as close as possible. The scanning surface should be located on the outside of the display surface (the side where the main body of the display device 10 is located is the inside) to facilitate user operation, and the scanning surface of the laser radar 20 covers the display surface of the display device 10, wherein the scanning surface covering the display surface specifically means that when the two are parallel, the projection of the display surface on the scanning surface is completely within the scanning surface. The display device 10 and the laser radar 20 installed based on this relationship between the display surface and the scanning surface can ensure that the corresponding position information of objects close to the display surface and nearby objects is accurately detected, and can avoid false detection when the distance between the object and the display surface is large.

[0087] Regardless of whether the display device 10 and the laser radar 20 are directly installed according to the combined design at the time of production, or are flexibly installed separately according to the on-site environment, the laser radar 20 needs to be connected to the display device 10 through a data link, specifically a processor connected to the display device 10. The data link can be a wireless communication link such as Bluetooth, or it can be a wired communication link established based on a USB wired connection through the USB-HID (Universal Serial Bus-Human Interface Device) protocol. The USB wired connection can be plug-and-play after installation.

[0088] Figure 4 shows an exemplary schematic diagram of the installation position relationship between the display device 10 and the laser radar 20. The laser radar 20 is installed directly above the display device 10. The dashed circle in Figure 4 represents the scanning plane centered on the laser radar 20 transmitter. The display device 10 is entirely located within the scanning plane, ensuring that the scanning plane covers the display surface. In specific implementations, the laser radar 20 can be placed in other locations on the display device 10, depending on the size of the installation environment, the layout of other electronic equipment, etc., to ensure that the laser transceiver can detect touch objects approaching or contacting the display surface.

[0089] The touch expansion interaction method in the embodiment of the present application can be regarded as a composite implementation of the touch area determination method and the touch method, that is, in the embodiment of the touch expansion interaction method, the detection capability based on the laser radar is described in detail. When the touch needs to be expanded, the first touch area and the second touch area are confirmed with reference to the display surface of the display device, and then different touch responses are performed according to the occlusion position information detected in the first touch area and the second touch area.

[0090] As shown in FIG1 , the touch extension interaction method includes but is not limited to steps S110 to S160:

[0091] Step S110: Obtain the occlusion position information of the positioning reference point in the display surface; wherein, the occlusion position information is obtained by laser scanning the display surface of the display device by the laser radar, and the positioning reference point is a point in the display surface used to determine the specific position information of the display surface in the scanning surface of the laser radar.

[0092] When the display device in the embodiment of the present application is powered on, the laser radar starts to operate. During the operation of the laser radar, the transmitter rotates continuously around the rotation axis. Different types of laser radars have their own fixed rotation cycles. The laser is emitted from the end of the transmitter away from the rotation axis. The scanning period of the laser emitted by the transmitter is different from the rotation period. Specifically, the scanning period of the transmitter is smaller than the rotation period. For example, one rotation period can correspond to multiple scanning periods, that is, the transmitter can emit multiple lasers during one rotation period. If a certain laser is blocked, the emitted laser is reflected back by the obstruction and received. Based on the propagation speed of the laser and the time difference between emission and reception, the distance of the obstruction relative to the laser radar can be obtained. The angle at which the laser radar emits the laser beam can be used to obtain the azimuth of the obstruction relative to the laser radar, and accordingly, the obstruction position information of the obstruction with reference to the position of the laser radar can be obtained. The display device can process all the obstruction position information.

[0093] The data directly collected by the laser radar 20 is angle and distance information, which is equivalent to constructing a polar coordinate system with the position of the rotation axis as the pole, referring to the detection principle of emitting in all directions with the laser radar transmitter as the center in the scanning surface. For example, the polar coordinate system in Figure 4 has the horizontal right as the polar axis. In the scanning state shown in Figure 4, in a certain scanning cycle, the distance d between the pole and A and the smaller angle α between the line connecting the pole and A and the polar axis are collected because of the obstacle at A. In the rectangular plane coordinate system with the pole as the origin (the rectangular plane coordinate system corresponding to the reference display surface in the horizontal and vertical axis directions), the horizontal coordinate x and vertical coordinate y of the obstacle at A can be calculated based on the distance d and the angle α, and the horizontal coordinate x and vertical coordinate y are used as the occlusion position information for describing the position of the obstacle. The specific calculation formulas for the horizontal coordinate x and the vertical coordinate y are as follows: x = d*cosα y = d*sinα

[0094] In one embodiment, because the display device 10 and the laser radar 20 are installed on-site, and the laser radar 20 collects occlusion position information by optical scanning, the initial information used to confirm the occlusion position information is position information with reference to the laser radar 20, and in the display device 10, the display surface has another coordinate system for confirming the position information of the display pixels on the display surface. After the display device 10 and the laser radar 20 are installed on-site, calibration is usually required to configure the conversion relationship between the coordinate system of the display surface in the display device 10 and the coordinate system of the laser radar 20, so that the coordinates carried in the detected occlusion position information can be determined to correspond to the coordinates of the same position in the coordinate system of the display surface in the display device 10, so that the occlusion position information can be subsequently detected. In the embodiment of the present application, the state in which the conversion relationship between the coordinate system of the display surface and the coordinate system of the laser radar 20 is configured is defined as the first configuration state, which corresponds to the various detailed operations required to implement the configuration. The first configuration state includes displaying a reference point touch guide for guiding the touch of the positioning reference point in the display surface, and the reference point touch guide includes the touch order of the positioning reference point; when the reference point touch guide is displayed, the occlusion position information obtained from the laser radar is associated with the positioning reference point according to the touch order to obtain the occlusion position information of the positioning reference point and other specific processing details. The first configuration state can be entered when the display device 10 and the laser radar 20 are installed for initial configuration, or it can be entered after a period of use because the position of the display device 10 or the laser radar 20 changes, or the user finds that the touch position does not match the response result and needs to perform configuration correction. The specific entry method can be through a dedicated system setting portal, voice command, key command, gesture command, etc.

[0095] For the display surface presented as a rectangle in the display device 10, considering that the display device 10 is usually arranged with the long side parallel to the ground and the short side perpendicular to the ground, the coordinate system used to characterize any display position in the display surface usually takes the intersection of a long side direction and a short side direction as the origin, and this set of long side directions and short side directions are the horizontal axis and vertical axis respectively. In order to facilitate the subsequent conversion of the coordinates in the display surface and the coordinates carried in the occlusion position information detected by the laser radar 20, when the laser radar 20 is installed, the polar axis of the laser radar 20 can be parallel to the long side direction or the short side direction of the display device 10.

[0096] When the display device 10 is arranged with its long sides parallel to the ground and its short sides perpendicular to the ground, to calibrate the corresponding position of the display surface in the coordinate system of the laser radar 20, that is, to determine the area of ​​the first touch area in the coordinate system of the laser radar 20, at least two positioning reference points are required. These two positioning reference points are two vertices located on the same diagonal of the display surface (i.e., the positioning reference points include at least two vertices on one diagonal of the display surface). In the arrangement described above, the positioning reference points can also be other combinations, such as the midpoints of the four sides of the rectangular display surface as positioning reference points, or any non-vertex point on the four sides of the rectangular display surface as positioning reference points. For the coordinates detected corresponding to the positioning reference points on the two horizontal sides, the horizontal coordinates are taken as the horizontal coordinates of the upper and lower sides of the rectangular display surface; for the coordinates detected corresponding to the positioning reference points on the two sides perpendicular to the ground, the vertical coordinates are taken as the vertical coordinates of the left and right sides of the rectangular display surface. Based on the horizontal coordinates of the upper and lower sides and the vertical coordinates of the left and right sides, the area of ​​the first touch area can be determined. The coordinates detected corresponding to the positioning reference point mentioned above are the coordinates detected by the laser radar 20 and included in the touch point location information when the user performs a single touch according to the reference point touch guidance. In other words, the positioning reference point is the point on the display surface used to determine the specific position information of the display surface on the scanning surface.

[0097] It should be understood that in the first configuration state, the received occlusion position information needs to be accurately matched to the positioning reference point. Therefore, a clear touch order should be indicated in the reference point touch guide. The user touches the positioning reference in sequence according to the touch order. Each touch generates an occlusion position information. The display device associates the received occlusion position information with the positioning reference point in the touch order. For example, there are 4 positioning reference points. When the reference point touch guide is displayed, each positioning reference point displays a circular logo. The circular logo displays 4 numbers 1-4, representing the touch order, and instructions for touching in order are displayed. The user touches in order according to the instructions. The display device will obtain four occlusion position information and associate them with the positioning reference points in the order of 1-4 in the acquisition order, thus completing the acquisition of the occlusion position information of the positioning reference point.

[0098] Step S120: Determine a first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point.

[0099] After obtaining the occlusion position information of the positioning reference point, the conversion relationship between the laser radar coordinate system and the display surface coordinate system is determined based on the occlusion position information of the positioning reference point; the target position of each vertex of the display surface in the laser radar coordinate system is determined based on the conversion relationship; and the first touch area corresponding to the display surface in the laser radar scanning surface is determined based on the target position of each vertex. For example, the coordinate system (pixel coordinates) of the display surface has the upper left corner as the origin (0,0), the vertex coordinates of the upper right corner are (1600,0), and the vertex coordinates of the lower right corner are (1600,1200), and these three points are all positioning reference points; in the first configuration state, the occlusion position information detected corresponding to the above positioning reference points are (-45,-33), (-5,-33), and (-5,-63), respectively. Based on the geometric angle relationship of the rectangle, the coordinates of the fourth vertex of the first touch area can be confirmed to be (-45,-63). Then it can be confirmed that in the coordinate system of the laser radar, the area with (-45, -33), (-5, -33), (-5, -63) and (-45, 63) as vertices is the first touch area. The coordinate conversion of the overlapping areas in the two coordinate systems can be implemented using the relevant conventional processing method. For example, in the subsequent interactive state, the occlusion position information with coordinates of (-25, -48) is detected. According to the conversion relationship, it can be confirmed that the coordinates of the touch target corresponding to the display surface are (800, 600), which will not be explained in detail here. The embodiment of the present application realizes the corresponding conversion between the two coordinate systems as the basis for subsequent interaction.

[0100] If the display device 10 and the laser radar 20 are not installed in accordance with the aforementioned requirements of having the long side parallel to the ground and the short side perpendicular to the ground, the position information of at least three positioning reference points (which can be any three vertices of the rectangular display surface) is required to complete the process of determining the area range of the first touch area. Of course, in a specific implementation, the positioning reference points can also be other combinations, as long as these positioning reference points can uniquely identify a rectangle. For example, for any two points on each side of the rectangular display surface, the corresponding edge point can be determined based on the order in which the reference points are touched. For two points on the same edge, the line on which this edge lies can be determined. For two points on each edge, a total of four lines can be determined. The enclosed area enclosed by the four lines is the area range of the first touch area. Once the first touch area has been determined, that is, the area range of the display surface in the laser radar 20 coordinate system has been determined, the process of converting the occlusion position information in the first touch area into coordinates on the display surface can refer to the solution of the related art of using the laser radar 20 as a touch detection module to implement touch interactive control.

[0101] The display device 10 itself cannot independently complete the indication and detection of the positioning reference point, and needs to guide the user to operate the display device 10. The specific operation content is the reference point touch guidance. The reference point touch guidance can guide the user to use a touch object to touch the positioning reference point. For example, as shown in Figure 5, the user is guided to use a writing pen 30 (or a finger, etc.) to touch the upper left, upper right, lower left and lower right vertices of the display surface in turn, and the corresponding four occlusion position information is obtained, which is the position of the four vertices of the rectangular display surface. The positions of these four vertices can represent the area range of the first touch area corresponding to the display surface. After the configuration is completed, the occlusion position information detected by the laser radar 20 can be compared with the coordinates of the four vertices to confirm whether it is in the first touch area. The specific comparison process with the four vertices can refer to the specific example description below.

[0102] Step S130: When the function for expanding the touch area in the display device is enabled, target position information is obtained; the target position information is used to expand the area on the display surface.

[0103] The display device in the embodiment of the present application can be used based solely on the first touch area and in accordance with existing touch design. When using the display device 10, the user is typically located near the display device 10. In addition to maintaining the direct operation of the display surface as in the related art, a function for extending the touch area can also be configured. When this function is enabled, target position information can be obtained. This target position information is used to identify a fixed area outside the display surface that does not intersect with the display surface. Based on the layout relationship between the display surface and the scanning surface described above, the laser radar can detect the corresponding occlusion position information when an object appears in this fixed area.

[0104] In the embodiment of the present application, the detection range of the laser radar 20 is not restricted by the display surface, and can be expanded outward based on the display surface. The basis for the area expansion of the display surface is the target position information, and the target position information is used to describe the direction of the touch area expansion, the scale of the expansion, etc. For example, a conference room is relatively small, and with other electronic devices, the area near the display device 10 is no longer expanded in all directions. At this time, the area can be expanded only in one or two appropriate directions, and the direction of the area expansion may be one or more. In general, the expansion direction may include at least one of the left side, right side and bottom side of the display surface. Since the upper side of the display surface is usually not suitable for user operation, it is possible to consider not expanding the area on the upper side. Of course, expanding the area on the upper side does not deviate from the design concept of this solution.

[0105] The specific timing for enabling this function can be automatic activation upon installation of the laser radar on the display device, for example, enabling this function by default to directly obtain target location information, i.e., the area expansion is performed after the display device and laser radar are installed until the function is disabled; it can also be selectively enabled by the user upon installation of the laser radar on the display device, for example, prompting the user whether to enable this function before or after the first configuration state; or it can be actively enabled by the user at any time during the use of the display device. The activation method can be, for example, through a dedicated system settings portal, voice commands, key commands, gesture commands, etc., which are not specifically limited here.

[0106] The method for obtaining the target position information may be to obtain the preset position parameters for area expansion of the display surface as the target position information, that is, the target position information is directly read (from a preset storage space) or received (by the user operating the display device or inputting through another electronic device); or to collect the spatial position information of the display device in the actual usage scenario; generate the target position information based on the spatial position information, that is, the target position information is confirmed based on the installation status in the actual usage scenario or the installation environment of the display device.

[0107] In a more specific implementation, preset position parameters for expanding the display area are obtained as target position information. For example, the target position parameters for expanding the display area can be read from a preset parameter configuration file; alternatively, an adjustment interface for configuring parameters for expanding the touch area can be first displayed; after confirming the first touch area, user operation on the adjustment interface can be received, and the target parameter values ​​of the parameters received in the adjustment interface can be responded to accordingly to obtain the target position parameters for expanding the display area as the target position information. By using preset suitable position parameters or user-entered position parameters, the user's extended touch needs can be met in a variety of ways.

[0108] In another more specific implementation, target position information is generated based on spatial position information, including: confirming the spatial distance information of the display device from the upper, lower, left and right obstructions in the actual use scenario based on the spatial position information; generating target position information in combination with the size of the display surface of the display device and the spatial distance information. The laser radar used in conjunction with the display device can accurately detect the installation environment of the display device. For example, when the left or right side of the display device is installed close to a wall, that is, there is no space for user operation on the left or right side, then only the other side can be determined as the expansion direction. For another example, when peripheral devices such as cameras and / or speakers are installed close to the top of one side of the display device, it can be determined that this side of the display device is partially expanded. Confirming the target position information by the installation status of the display device in the actual scenario can ensure that the generated second touch area can be realized in the actual scenario, and ensure that the extended touch is completed normally.

[0109] Step S140: Determine a second touch area in the peripheral area of ​​the display device based on the first touch area and the target position information. The second touch area is an area in the scanning surface of the laser radar used for extended touch. Both the first touch area and the second touch area are used for touch interaction.

[0110] According to the target position information, the area is expanded in the peripheral area of ​​the display device, and the area for extended touch can be obtained accordingly, which is the second touch area. According to the number of expansion directions, the second touch area can be one or more. Each second touch area can be a rectangle, and the area position corresponding to each second touch area can be represented by four vertices with reference to the first touch area, or it can be represented by a vertex coordinate + width and height. For example, a rectangular second touch area is represented as (x, y, w, h), where in this representation method, x and y come from the coordinates (x, y) of the upper left corner vertex of the second touch area, w comes from the width value of the second touch area, and h comes from the height value of the second touch area. Of course, the first touch area can also be represented by a vertex coordinate + width and height. The embodiment of the present application does not specifically limit the representation method of the area position of the first touch area and any second touch area.

[0111] The area sizes of the second touch areas in different directions can be the same or different. For example, the left and right sides can be the same, that is, the area sizes of the second touch areas on the left and right sides are the same; or the left, right, and bottom sides can be different, that is, the area sizes of the second touch areas on the left, right, and bottom sides are different. In the schematic distribution diagram of the first touch area and the second touch area 11 shown in Figure 6, the three second touch areas 11 are exemplarily distributed on the left, right, and bottom sides of the first touch area, corresponding to the second touch area on the left, right, and bottom sides, respectively. The area sizes of the second touch areas on the left and right sides are the same.

[0112] When performing area expansion, the second touch area is determined in different ways depending on the target location information. In one optional implementation, the expansion direction and distance of the area expansion on the display surface are determined based on the target location information; starting from the side edge of the first touch area corresponding to the expansion direction, the area is translated along the expansion direction by the expansion distance, and the expanded touch area covered by the translation is used as the second touch area. For example, as shown in Figure 6, it can be considered that starting from multiple side edges of the first touch area, after a certain distance is translated along the expansion direction, the expanded touch area covered by the translation process is used as the second touch area.

[0113] In another optional implementation, the expansion direction and area for the display surface are determined based on the target location information. The first touch area is extended along the expansion direction and by the expansion area to obtain an expanded touch area within the peripheral area of ​​the display device within the laser radar scanning surface as the second touch area. For example, Figure 6 can be considered as starting from multiple sides of the first touch area and extending along the expansion direction by a certain area. The area corresponding to the extended area is the second touch area.

[0114] It should be understood that the "expansion" described in the specific area expansion process is only used to illustrate the relative positional relationship between the second touch area and the first touch area, and does not necessarily mean that the display device will control the movement of a certain graphic element during specific processing. The specific parameters confirmed in the target position information can be directly converted with the position of the first touch area as a reference. For example, the vertex coordinates of the first touch area shown in Figure 6 are (xa, ya), (xb, yb), (xc, yc), and (xd, yd) clockwise from the top left vertex. The expansion direction is rightward and the expansion distance is xe. Then the vertex coordinates of the corresponding second touch area are (xb, yb), (xb+xe, yb), (xc+xe, yc), and (xc, yc) clockwise from the top left vertex.

[0115] Step S150: In the interactive state, when the occlusion position information corresponding to the first touch area is received, touch position information is generated point-to-point according to the occlusion position information.

[0116] Step S150: In the interactive state, when occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information.

[0117] After completing the configuration of the first touch area and the second touch area, the display device can be used normally. The normal state of the display device is defined as the interactive state. In the interactive state, the laser radar 20 can detect all obstacles within the laser propagation range and collect the corresponding occlusion position information. During the processing of the occlusion position information, only the occlusion position information of the first and second areas can be subsequently processed. The occlusion position information of other areas does not need to be processed or responded to by the display device and is directly discarded. At the user's actual action level, each touch operation may be caused by a touch object making physical contact with the display device (such as contact between a writing pen and the display device), or occurring at a location outside the display device (such as passing through the air around a display device placed on a stand, or passing through an adjacent wall of a display device mounted on a wall). These touch operation states may correspond to relatively fixed touch points that can be viewed as points, or touch trajectories formed by the movement of touch points. For touch points or touch trajectories that appear in these touch operation states, at the specific data processing level, the lidar will detect and obtain one or more occlusion position information. Whether the coordinates carried by each occlusion position information are within the first touch area or a second touch area can be determined by reference to the judgment logic in the relevant technology, such as comparing the magnitude relationship between the two coordinate components of the coordinates carried by the occlusion position information and the coordinate components of the four vertices of the first touch area (or second touch area). If the first touch area (or second touch area) is represented by a vertex coordinate and width and height, the relationship between the coordinate components of the coordinates carried by the occlusion position information and the sum of the corresponding vertex coordinate components and the width (or height) can also be compared to confirm. A touch system event refers to a touch operation event used to trigger a function at the display device system level. For example, when it is confirmed that the swipe is to the left based on the occlusion position information, the touch system event corresponds to a left swipe event. Different systems may have different response logic for the left swipe event, and each system can respond according to its own response logic.

[0118] In the interactive state, upon confirming receipt of occlusion position information corresponding to a second touch area, multiple pieces of occlusion position information with the same coordinate component showing the same change trend and the amount of change in the same coordinate component within a preset range are identified as a touch system event, and the type of the touch system event is determined based on the change trend. The types of touch system events include one or more of an up swipe event, a down swipe event, a left swipe event, a right swipe event, and a long press event.

[0119] The above confirmation process of the touch system event can be illustrated based on specific coordinates. Assume that the recorded touch coordinates are (x1, y1), (x2, y2), (x3, y3) ... (x i ,y i )…(x n ,y n ), set a threshold D.

[0120] If the recorded touch coordinates all meet the following conditions, it means that the touch is sliding up and down, and the sliding process is continuous, and the change in the vertical coordinate components of two adjacent touch coordinates is within the threshold (i.e., the preset range). |y2-y1|<D |y3-y2|<D |y4-y3|<D ... |y n -y n-1 |<D

[0121] If y i -y i-1 >0, it is a decline, if y i -y i-1 If <0, it is an upward slide, that is, the change trend is the same.

[0122] Similarly, if the recorded touch coordinates all meet the following conditions, it means it is a left or right slide. |x2-x1|<D |x3-x2|<D |x4-x3|<D ... |x n -x n-1 |<D

[0123] If x i -x i-1 >0, it is a right slide, if x i -x i-1 <0, it is a left swipe.

[0124] After parsing the user gesture, the corresponding event can be sent to the system, such as: an upward swipe gesture corresponds to an upward swipe action, a downward swipe gesture corresponds to a downward swipe action, a left swipe gesture corresponds to a return action (equivalent to the Back key event), and a right swipe gesture corresponds to a return to the home page (equivalent to the Home key event).

[0125] If the width of the display is W, the height is H, and the displacement of each movement is d, the event details can be sent when sending a touch system event. For example, the upward sliding action sent to the system can be implemented like this:

[0126] Send touch UP event, coordinates are (W / 2, H / 2)

[0127] Send touch UP event, coordinates are (W / 2, H / 2-d)

[0128] Send touch UP event, coordinates are (W / 2, H / 2-d*2)

[0129] Send touch UP event, coordinates are (W / 2, H / 2-d*3)

[0130] …

[0131] Send a touch UP event.

[0132] The swipe down action sent to the system can be implemented like this:

[0133] Send a touch DOWN event with coordinates (W / 2, H / 2)

[0134] Send a touch DOWN event with coordinates (W / 2, H / 2+d)

[0135] Send a touch DOWN event with coordinates (W / 2, H / 2+d*2)

[0136] Send a touch DOWN event with coordinates (W / 2, H / 2+d*3)

[0137] …

[0138] Send a touch DOWN event.

[0139] Of course, when sending touch system events, you can also send the final confirmed event type. For example, only touch UP and touch DOWN events are sent, and the intermediate detail events are only used to confirm the final touch system event type. For other types of touch system events, refer to the event confirmation method in the interactive field for confirmation.

[0140] While confirming the first touch area and the second touch area in the configuration state, the conversion relationship between the laser radar coordinate system and the display surface coordinate system has been established; when the occlusion position information corresponding to the first touch area is received, each occlusion position information is converted according to the conversion relationship to generate the corresponding touch position information. This processing method converts the occlusion position information detected in the laser radar coordinate system into the touch position information in the display surface coordinate system (i.e., the image coordinate system). When the two coordinate systems are parallel, the occlusion position information can obtain the corresponding touch position information through the translation change of the two coordinate components and the conversion of the unit length. On the basis of confirming the conversion relationship between the laser radar coordinate system and the display surface coordinate system in the configuration state, in the interactive state, the corresponding processing can be performed according to the conversion relationship, thereby improving the interaction efficiency and interaction accuracy.

[0141] The occlusion position information for different location areas can be processed according to the interaction logic required by the display device. For example, touch position information can be processed according to the interaction logic described in the relevant technology to generate writing handwriting, trigger page turning, etc. For touch system events, the display content on the display surface is changed according to the response logic, such as returning to the desktop or returning to the previous page. The specific definition of the corresponding system functions is not the focus of the description of the embodiments of this application and will not be explained in detail.

[0142] An embodiment of the present application provides a touch area determination method, which is used for a display device, wherein the display device is configured with at least one laser radar, and the laser radar is used to scan the display surface of the display device and the peripheral area of ​​the display device; the touch area determination method includes but is not limited to steps S210 to S240:

[0143] Step S210: Obtain the occlusion position information of the positioning reference point in the display surface; wherein, the occlusion position information is obtained by laser scanning the display surface of the display device by the laser radar, and the positioning reference point is a point in the display surface used to determine the specific position information of the display surface in the scanning surface of the laser radar.

[0144] Step S220: Determine a first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point.

[0145] Step S230: When the function for expanding the touch area in the display device is enabled, target position information is obtained; the target position information is used to expand the area on the display surface.

[0146] Step S240: Determine a second touch area in the peripheral area of ​​the display device based on the first touch area and the target position information. The second touch area is an area in the scanning surface of the laser radar used for extended touch. Both the first touch area and the second touch area are used for touch interaction.

[0147] Based on the above embodiment, obtaining the occlusion position information of the positioning reference point on the display surface includes:

[0148] displaying a reference point touch guide for guiding touching of a positioning reference point in the display surface, the reference point touch guide including a touching sequence for the positioning reference point;

[0149] When the reference point touch guidance is displayed, the occlusion position information obtained from the lidar is associated with the positioning reference points in the touch order to obtain the occlusion position information of the positioning reference points.

[0150] On the basis of the above embodiment, determining the first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point includes:

[0151] Determine the conversion relationship between the laser radar coordinate system and the display surface coordinate system based on the occlusion position information of the positioning reference point;

[0152] Determine the target position of each vertex of the display surface in the laser radar coordinate system according to the conversion relationship;

[0153] The first touch area corresponding to the display surface in the scanning surface of the laser radar is determined according to the target position of each vertex.

[0154] Based on the above embodiment, obtaining target location information includes:

[0155] Obtaining preset position parameters for area expansion on the display surface as target position information;

[0156] or,

[0157] Collect and display the spatial location information of the device in the actual usage scenario;

[0158] Generate target position information based on the spatial position information.

[0159] Based on the above embodiment, obtaining preset position parameters for area expansion of the display surface as target position information includes:

[0160] Reading position parameters for area expansion of the display surface from a preset parameter configuration file as target position information;

[0161] or,

[0162] Displaying an adjustment interface for configuring parameters of the extended touch area;

[0163] In response to the target parameter value of the parameter received in the adjustment interface, position parameters for area expansion of the display surface are obtained as target position information.

[0164] On the basis of the above embodiment, generating target position information according to spatial position information includes:

[0165] Confirm the spatial distance information of the display device from the upper, lower, left, and right obstructions in the actual usage scenario based on the spatial position information;

[0166] The target position information is generated by combining the size of the display surface of the display device and the spatial distance information.

[0167] On the basis of the above embodiment, determining a second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0168] Determining an expansion direction and an expansion distance for area expansion on the display surface according to the target position information;

[0169] Starting from the side of the first touch area corresponding to the extension direction, the touch area is translated along the extension direction for an extension distance, and the extended touch area covered by the translation is used as the second touch area.

[0170] On the basis of the above embodiment, determining a second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0171] Determining an expansion direction and an expansion area for area expansion on the display surface according to the target position information;

[0172] The first touch area is extended along the extension direction and according to the extension area to obtain an extended touch area in the peripheral area of ​​the display device in the scanning surface of the laser radar as the second touch area.

[0173] Based on the above embodiment, the positioning reference points include at least two vertices on a diagonal line of the display surface.

[0174] Based on the above embodiment, the expansion direction includes at least one of the left side, the right side and the bottom side.

[0175] The specific implementation process of the above touch area determination method can refer to the corresponding description of the touch expansion interaction method in the previous embodiment, and will not be repeated here.

[0176] An embodiment of the present application provides a touch control method, which is applied to a display device, wherein an interactive area of ​​the display device includes a first touch control area and a second touch control area determined by any one of the touch control area determination methods of the first aspect; the touch control method includes but is not limited to steps S310 and S320:

[0177] Step S310: In the interactive state, when occlusion position information corresponding to the first touch area is received, touch position information is generated point-to-point according to the occlusion position information.

[0178] Step S320: In the interactive state, when the occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information.

[0179] Based on the above embodiment, the type of touch system event includes one or more of an upward swipe event, a downward swipe event, a left swipe event, a right swipe event, and a long press event.

[0180] Based on the above embodiment, in the interactive state, when the occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information, including:

[0181] In the interactive state, when the occlusion position information corresponding to the second touch area is received, multiple occlusion position information with the same coordinate component having the same change trend and the change amount within a preset range are confirmed as a touch system event, and the type of the touch system event is confirmed based on the change trend.

[0182] For the specific implementation process of the above touch method, reference may be made to the corresponding description in the embodiment of the touch expansion interaction method mentioned above, which will not be elaborated here.

[0183] Figure 7 is a schematic diagram of the structure of a touch area determination device provided in an embodiment of the present application. This touch area determination device is used in a display device equipped with at least one laser radar (LIDA) for scanning the display surface and surrounding areas of the display device. As shown in Figure 7, the touch area determination device includes an occlusion position information acquisition module 310, a first area confirmation module 320, a target position information acquisition module 330, and a second area confirmation module 340.

[0184] Among them, the occlusion position information acquisition module 310 is used to obtain the occlusion position information of the positioning reference point in the display surface; wherein, the occlusion position information is obtained by the laser radar performing laser scanning on the display surface of the display device, and the positioning reference point is a point in the display surface used to determine the specific position information of the display surface in the scanning surface of the laser radar; the first area confirmation module 320 is used to determine the first touch area corresponding to the display surface in the scanning surface of the laser radar based on the occlusion position information of the positioning reference point; the target position information acquisition module 330 is used to obtain the target position information when the function for extending the touch area in the display device is enabled; the target position information is used to expand the area of ​​the display surface; the second area confirmation module 340 is used to determine the second touch area in the peripheral area of ​​the display device based on the first touch area and the target position information, and the second touch area is the area in the scanning surface of the laser radar used for extending the touch; the first touch area and the second touch area are both used for touch interaction.

[0185] Based on the above embodiment, obtaining the occlusion position information of the positioning reference point on the display surface includes:

[0186] displaying a reference point touch guide for guiding touching of a positioning reference point in the display surface, the reference point touch guide including a touching sequence for the positioning reference point;

[0187] When the reference point touch guidance is displayed, the occlusion position information obtained from the lidar is associated with the positioning reference points in the touch order to obtain the occlusion position information of the positioning reference points.

[0188] On the basis of the above embodiment, determining the first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point includes:

[0189] Determine the conversion relationship between the laser radar coordinate system and the display surface coordinate system based on the occlusion position information of the positioning reference point;

[0190] Determine the target position of each vertex of the display surface in the laser radar coordinate system according to the conversion relationship;

[0191] The first touch area corresponding to the display surface in the scanning surface of the laser radar is determined according to the target position of each vertex.

[0192] Based on the above embodiment, obtaining target location information includes:

[0193] Obtaining preset position parameters for area expansion on the display surface as target position information;

[0194] or,

[0195] Collect and display the spatial location information of the device in the actual usage scenario;

[0196] Generate target position information based on the spatial position information.

[0197] Based on the above embodiment, obtaining preset position parameters for area expansion of the display surface as target position information includes:

[0198] Reading position parameters for area expansion of the display surface from a preset parameter configuration file as target position information;

[0199] or,

[0200] Displaying an adjustment interface for configuring parameters of the extended touch area;

[0201] In response to the target parameter value of the parameter received in the adjustment interface, position parameters for area expansion of the display surface are obtained as target position information.

[0202] On the basis of the above embodiment, generating target position information according to spatial position information includes:

[0203] Confirm the spatial distance information of the display device from the upper, lower, left, and right obstructions in the actual usage scenario based on the spatial position information;

[0204] The target position information is generated by combining the size of the display surface of the display device and the spatial distance information.

[0205] On the basis of the above embodiment, determining a second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0206] Determining an expansion direction and an expansion distance for area expansion on the display surface according to the target position information;

[0207] Starting from the side of the first touch area corresponding to the extension direction, the touch area is translated along the extension direction for an extension distance, and the extended touch area covered by the translation is used as the second touch area.

[0208] On the basis of the above embodiment, determining a second touch area in the peripheral area of ​​the display device according to the first touch area and the target position information includes:

[0209] Determining an expansion direction and an expansion area for area expansion on the display surface according to the target position information;

[0210] The first touch area is extended along the extension direction and according to the extension area to obtain an extended touch area in the peripheral area of ​​the display device in the scanning surface of the laser radar as the second touch area.

[0211] Based on the above embodiment, the positioning reference points include at least two vertices on a diagonal line of the display surface.

[0212] Based on the above embodiment, the expansion direction includes at least one of the left side, the right side and the bottom side.

[0213] The touch area determination device provided in the embodiment of the present application is included in a display device and can be used to execute the corresponding touch area determination method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0214] FIG8 is a schematic diagram of the structure of a touch control device provided in an embodiment of the present application. The touch control device provided in an embodiment of the present application is applied to a display device, wherein the interactive area of ​​the display device includes a first touch control area and a second touch control area determined by the touch control area determination method in any of the above embodiments; as shown in FIG8 , the touch control device includes:

[0215] The first touch area interaction processing module 410 is configured to generate touch position information point-by-point based on the occlusion position information when receiving occlusion position information corresponding to the first touch area in the interactive state;

[0216] The second touch area interaction processing module 420 is configured to generate a touch system event according to the occlusion position information when receiving occlusion position information corresponding to the second touch area in the interaction state.

[0217] Based on the above embodiment, the type of touch system event includes one or more of an upward swipe event, a downward swipe event, a left swipe event, a right swipe event, and a long press event.

[0218] Based on the above embodiment, in the interactive state, when the occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information, including:

[0219] In the interactive state, when the occlusion position information corresponding to the second touch area is received, multiple occlusion position information with the same coordinate component having the same change trend and the change amount within a preset range are confirmed as a touch system event, and the type of the touch system event is confirmed based on the change trend.

[0220] It is worth noting that in the embodiments of the above-mentioned touch area determination device and touch device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0221] FIG9 is a schematic diagram of the structure of a display device provided in an embodiment of the present application. As shown in FIG9 , the display device includes a laser radar, a processor 510, and a memory 520, and may also include an input device 530, an output device 540, and a communication device 550. The display device may include one or more processors 510, with FIG9 showing a single processor 510 as an example. The processor 510, memory 520, input device 530, output device 540, and communication device 550 in the display device may be connected via a bus or other means, with FIG9 showing a bus connection as an example.

[0222] Memory 520, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the touch area determination method in the embodiments of the present application. Processor 510 executes the software programs, instructions, and modules stored in memory 520 to execute various functional applications and data processing of the display device, thereby implementing the aforementioned method.

[0223] The memory 520 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store data created based on the use of the display device, etc. In addition, the memory 520 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 520 may further include a memory remotely located relative to the processor 510, and these remote memories may be connected to the display device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0224] The input device 530 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the display device. The output device 540 may include a display device such as a display screen.

[0225] The above-mentioned display device includes a touch area determination device and a touch method, which can be used to execute any touch area determination method and touch method, and has corresponding functions and beneficial effects.

[0226] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it is used to perform the relevant operations in the method provided in any embodiment of the present application and has corresponding functions and beneficial effects.

[0227] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0228] Therefore, the application can adopt the form of complete hardware embodiment, complete software embodiment, or the embodiment in combination with software and hardware. Moreover, the application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The application is described with reference to the flow chart and / or block diagram of the method, equipment (system) and computer program product according to the embodiment of the application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instruction executed by the processor of the computer or other programmable data processing device produces a device for realizing the function specified in one flow chart flow chart or multiple flow processes and / or one block or multiple blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device that implements the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram. These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram.

[0229] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-permanent storage in a computer-readable medium, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0230] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0231] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0232] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments, and substitutions are possible for those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for determining a touch area, for use in a display device, wherein: The display device is configured with at least one laser radar, and the laser radar is used to scan the display surface of the display device and the peripheral area of ​​the display device. The touch area determination method includes: Obtaining occlusion position information of a positioning reference point in the display surface; wherein the occlusion position information is acquired by the laser radar performing laser scanning on the display surface of the display device, and the positioning reference point is a point in the display surface used to determine specific position information of the display surface in the scanning surface of the laser radar; Determining a first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point; When a function for expanding a touch area in the display device is enabled, acquiring target position information; the target position information is used to expand the area of ​​the display surface; A second touch area is determined in the peripheral area of ​​the display device based on the first touch area and the target position information. The second touch area is an area in the scanning surface of the laser radar used for extended touch. Both the first touch area and the second touch area are used for touch interaction.

2. The touch area determination method according to claim 1, wherein: The obtaining of the occlusion position information of the positioning reference point in the display surface includes: displaying a reference point touch guide for guiding a user to touch a positioning reference point on the display surface, wherein the reference point touch guide includes a touch order for the positioning reference point; When the reference point touch guide is displayed, the occlusion position information obtained from the laser radar is associated with the positioning reference point according to the touch order to obtain the occlusion position information of the positioning reference point.

3. The touch area determination method according to claim 1, wherein: The determining, based on the occlusion position information of the positioning reference point, a first touch area corresponding to the display surface in the scanning surface of the laser radar includes: Determining a conversion relationship between a coordinate system of the laser radar and a coordinate system of the display surface according to the occlusion position information of the positioning reference point; Determining the target position of each vertex of the display surface in the coordinate system of the laser radar according to the conversion relationship; A first touch area corresponding to the display surface in the scanning surface of the laser radar is determined according to the target position of each of the vertices.

4. The touch area determination method according to any one of claims 1 to 3, wherein: The obtaining of target location information includes: Acquiring preset position parameters for area expansion of the display surface as target position information; or, Collecting spatial position information of the display device in an actual usage scenario; Target position information is generated according to the spatial position information.

5. The touch area determination method according to claim 4, wherein: The acquiring of preset position parameters for area expansion of the display surface as target position information includes: Reading position parameters for area expansion of the display surface from a preset parameter configuration file as target position information; or, Displaying an adjustment interface for configuring parameters of the extended touch area; In response to the target parameter value of the parameter received in the adjustment interface, position parameters for area expansion of the display surface are obtained as target position information.

6. The touch area determination method according to claim 4, wherein: Generating target position information according to the spatial position information includes: Determining, based on the spatial position information, spatial distance information of the display device from obstructions on the upper, lower, left, and right sides in an actual usage scenario; The target position information is generated by combining the size of the display surface of the display device and the spatial distance information.

7. The touch area determination method according to claim 1, 2, 3, 5 or 6, wherein: The determining of a second touch area in a peripheral area of ​​the display device according to the first touch area and the target position information includes: determining an expansion direction and an expansion distance for performing area expansion on the display surface according to the target position information; Taking the side of the first touch area corresponding to the extension direction as a starting point, the touch area is translated along the extension direction by the extension distance, and the extended touch area covered by the translation is used as the second touch area.

8. The touch area determination method according to claim 1, 2, 3, 5 or 6, wherein: The determining of a second touch area in a peripheral area of ​​the display device according to the first touch area and the target position information includes: determining an expansion direction and an expansion area for performing area expansion on the display surface according to the target position information; The first touch area is extended along the extension direction and according to the extension area to obtain an extended touch area in the peripheral area of ​​the display device in the scanning surface of the laser radar as the second touch area.

9. The touch area determination method according to claim 1, 2, 3, 5 or 6, wherein: The positioning reference points include at least two vertices on a diagonal line of the display surface.

10. The touch area determination method according to claim 7, wherein: The expansion direction includes at least one of a left side, a right side, and a lower side.

11. Touch method, wherein Applied to a display device, the interactive area of ​​the display device includes a first touch area and a second touch area determined by the touch area determination method according to any one of claims 1 to 10; The touch control method includes: In the interactive state, upon receiving the occlusion position information corresponding to the first touch area, generating touch position information point-by-point according to the occlusion position information; In the interactive state, when the occlusion position information corresponding to the second touch area is received, a touch system event is generated according to the occlusion position information.

12. The touch control method according to claim 11, wherein: The type of the touch system event includes one or more of an upward swipe event, a downward swipe event, a left swipe event, a right swipe event, and a long press event.

13. The touch control method according to claim 11 or 12, wherein: In the interactive state, when the occlusion position information corresponding to the second touch area is received, generating a touch system event according to the occlusion position information includes: In the interactive state, when the occlusion position information corresponding to the second touch area is received, multiple occlusion position information with the same coordinate component having the same change trend and the change amount within a preset range are confirmed as a touch system event, and the type of the touch system event is confirmed based on the change trend.

14. A touch area determination device, used in a display device, wherein: The display device is configured with at least one laser radar, and the laser radar is used to scan the display surface of the display device and the peripheral area of ​​the display device. The touch area determination method includes: an occlusion position information acquisition module, configured to acquire occlusion position information of a positioning reference point on the display surface; wherein the occlusion position information is acquired by the laser radar through laser scanning of the display surface of the display device, and the positioning reference point is a point on the display surface used to determine the specific position information of the display surface on the scanning surface of the laser radar; A first area confirmation module is used to determine a first touch area corresponding to the display surface in the scanning surface of the laser radar according to the occlusion position information of the positioning reference point; a target position information acquisition module, configured to acquire target position information when a function for generating an extended touch area in the display device is enabled; the target position information is used to perform area expansion on the display surface; A second area confirmation module is used to determine a second touch area in the peripheral area of ​​the display device based on the first touch area and the target position information, where the second touch area is an area in the scanning surface of the laser radar used for extended touch; both the first touch area and the second touch area are used for touch interaction.

15. A touch device, wherein Applied to a display device, the interactive area of ​​the display device includes a first touch area and a second touch area determined by the touch area determination method according to any one of claims 1 to 10; The touch control device comprises: A first touch area interaction processing module is configured to generate touch position information point-by-point based on the occlusion position information when receiving occlusion position information corresponding to the first touch area in an interactive state; The second touch area interaction processing module is configured to generate a touch system event according to the occlusion position information when receiving occlusion position information corresponding to the second touch area in an interactive state.

16. A display device, wherein include: LiDAR; one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the display device implements the method according to any one of claims 1 to 13.

17. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.

Images