An interactive method, an interactive device, an electronic device and a readable storage medium

Abstract

The present application discloses an interaction method, an interaction device, an electronic device and a readable storage medium, which belongs to the technical field of electronic devices. The interaction method comprises: obtaining motion information of a target object when it is above a screen of an electronic device and not in contact with the screen; determining a target control from a plurality of controls displayed on the screen according to the motion information; and executing a target function corresponding to the target control if the motion information satisfies a preset condition before the target object touches the screen.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic devices, and specifically relates to an interaction method, an interaction device, an electronic device and a readable storage medium. Background Art

[0002] With the rapid development of mobile terminal software and hardware technology, the control function has transitioned from the original physical keyboard operation to touch operation, and the controllability has become more and more abundant. However, the realization of the touch function is premised on the corresponding virtual key being touched, that is, the electronic device will detect it only after the corresponding virtual key is touched, and then execute the corresponding function according to the touch operation. In some scenarios that require fast and frequent touch operations and require a quick response to touch operations (such as real-time game scenarios, etc.), due to the mutual constraints of power consumption and touch detection frequency, the mobile terminal cannot recognize the user's touch input in time, and the corresponding touch function has a certain delay, resulting in a reduced user experience. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide an interaction method, an interaction device, an electronic device and a readable storage medium, which can solve the problem that the realization of the touch function in the related art is based on the premise that the corresponding virtual key is touched. In scenarios where fast and frequent touch operations and quick responses to touch operations are required (such as real-time game scenarios, etc.), due to factors such as power consumption and the mutual constraints of touch detection frequency, the mobile terminal cannot promptly recognize the user's touch input, and the corresponding touch function has a certain delay, resulting in a reduced user experience.

[0004] In a first aspect, an embodiment of the present application provides an interaction method, the method comprising:

[0005] Acquiring motion information of a target object when the target object is above a screen of an electronic device and is not in contact with the screen;

[0006] Determining a target control from a plurality of controls displayed on the screen according to the motion information;

[0007] Before the target object touches the screen, if the motion information meets a preset condition, a target function corresponding to the target control is executed.

[0008] In a second aspect, an embodiment of the present application provides an interactive device, the device comprising:

[0009] An acquisition module, used to acquire motion information of a target object when the target object is above a screen of an electronic device and is not in contact with the screen;

[0010] A determination module, configured to determine a target control from a plurality of controls displayed on the screen according to the motion information;

[0011] An execution module is used to execute a target function corresponding to the target control if the motion information meets a preset condition before the target object touches the screen.

[0012] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0013] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0014] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0015] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0016] In an embodiment of the present application, a radar module is set in an electronic device, and the radar module is used to obtain the motion information of the target object on the screen of the electronic device, and then the target control that the user wants to click is determined based on the motion information. When the motion information meets the preset conditions, the target function corresponding to the target control is executed before the target object touches the screen, thereby speeding up the response speed, reducing the delay, and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic diagram of a touch function implementation process in the related art;

[0018] Figure 2 A flowchart of an interactive method provided in an embodiment of the present application;

[0019] Figure 3 It is a schematic diagram of the structure of a millimeter wave radar in the related art;

[0020] Figure 4 It is a schematic diagram of the transmission signal and the echo signal when the target object is stationary;

[0021] Figure 5 It is a schematic diagram of the transmission signal and the echo signal when the target object moves;

[0022] Figure 6A schematic diagram of the millimeter wave radar measuring angle;

[0023] Figure 7 A schematic diagram of the position relationship between the target object and the target control provided in the embodiment of the present application;

[0024] Figure 8 A schematic diagram of a mobile target control provided in an embodiment of the present application;

[0025] Fig. 9 A schematic diagram of an interactive device provided in an embodiment of the present application;

[0026] Fig.10 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0027] Fig.11 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0030] In conjunction with the accompanying drawings, an interaction method, an interaction device, an electronic device and a readable storage medium provided in an embodiment of the present application are described in detail below through specific embodiments and their application scenarios.

[0031] In the related art, the realization of the touch function is premised on the corresponding virtual key being touched, that is, it will be detected by the electronic device only after the corresponding virtual key is touched, and then the corresponding function will be executed according to the touch operation. In some scenarios that require fast and frequent touch operations and require a quick response to touch operations (such as real-time game scenarios, etc.), the speed of user touch input is limited, and the corresponding touch function has a certain delay, resulting in a reduced user experience.

[0032] The following is further explained using a real-time online game scenario.

[0033] Please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the touch function implementation process in the related art. Figure 1 As shown, the touch function implementation process includes the following steps:

[0034] When the brain decides to perform a touch operation, it sends instructions for the finger to perform the corresponding operation;

[0035] The finger moves from the top of the screen to the top of the screen until it clicks the corresponding virtual button on the screen. According to the CPS hand speed test statistics, the average CPS value of ordinary people is 6.2, that is, they can click the screen 6.2 times per second. Here, based on a hand speed of 10 CPS, the average time for one click is 100ms. One click process includes two steps: the finger points to the screen and leaves the screen. Therefore, the time from the finger moving to the screen to touching the screen is about 50ms;

[0036] When the screen detects that the area corresponding to the virtual button is clicked, it transmits the corresponding operation instruction to the application processor, and then the application processor packages the game instruction corresponding to the clicked virtual button and the current game screen and uploads them to the game server via the network;

[0037] The game server parses the data packets uploaded by the application processor, modifies the game world model in its memory according to the user's operation area, calculates the game world's response to this operation, and then packages these responses and passes them to the application processor;

[0038] The application processor parses the data packets sent by the game server and displays them on the screen.

[0039] In the above process, the delay caused by the intermediate data packaging and parsing time, screen refresh time and network delay is about 40ms to 60ms.

[0040] Currently, most of the optimization processes for game delay are focused on reducing network delay and improving screen detection speed. For example, optimizing antenna layout to ensure that the antenna of the gaming phone is not blocked when running the game, that is, optimizing from the aspect of network delay; or increasing the screen refresh rate, that is, optimizing the delay caused by the screen, etc. These optimization processes can only bring limited delay reduction effects.

[0041] Therefore, please refer to Figure 2 , Figure 2 The following is a flow chart of an interactive method provided in an embodiment of the present application. Figure 2As shown, an embodiment of the present application provides an interaction method, which includes the following steps:

[0042] Step 201: Acquire motion information of a target object when it is above a screen of an electronic device and not in contact with the screen;

[0043] Exemplarily, the motion information of the target object when it is above the screen of the electronic device and not in contact with the screen can be obtained through a radar module of the electronic device, or through ultra-wideband technology (Ultra Wide Band, UWB) and other technologies.

[0044] Among them, when using the radar module to obtain, the radar module can be set close to the screen of the electronic device. The radar module may include a millimeter wave radar that can detect information such as the distance, direction, and speed of an object. Optionally, the number of radar modules can be one, or two or more. It can be understood that the more radar modules there are, the more accurate the motion information of the target object obtained. When the number of radar modules is one, the radar module can be set near the midpoint of any long side of the electronic device. When the number of radar modules is two, the two radar modules can be respectively set on both sides of the two short sides of the electronic device.

[0045] In some embodiments of the present application, the radar module includes a transmitting antenna, at least two receiving antennas and a millimeter wave processing unit, wherein the transmitting antenna is used to transmit millimeter waves, the receiving antenna is used to receive reflected millimeter waves, and the millimeter wave processing unit can process the received millimeter waves.

[0046] In some embodiments of the present application, the target object being above the screen of the electronic device means that the target object is located directly above the screen of the electronic device, that is, the orthographic projection of the target object on the plane where the screen is located overlaps with the screen, and the target object has not yet touched the screen.

[0047] Optionally, the target object may be a user's finger, a stylus, a touch glove, etc.

[0048] Step 202: determining a target control from a plurality of controls displayed on the screen according to the motion information;

[0049] Based on the detected motion information of the target object, the position of the target object relative to the screen can be determined, and then the position on the screen that the target object wants to click can be determined. From this, the target control displayed at the screen position that the target object wants to click can be determined, that is, the touch object when the target object performs this touch operation.

[0050] In some embodiments of the present application, optionally, the target control may be a virtual button or other triggerable interface control.

[0051] Step 203: before the target object touches the screen, if the motion information satisfies a preset condition, executing a target function corresponding to the target control.

[0052] After the target control is determined, if the motion information of the target object moving toward the target control meets the preset conditions, it is determined that the target object does want to click the target control, and the target function corresponding to the target control is executed before the target object touches the target control on the screen. In other words, by analyzing the motion information of the target object to predict the gesture, when the preset conditions are met, the corresponding target function can be executed without waiting until the target object actually touches the screen, so that the electronic device responds to the touch operation in advance, thereby reducing the delay.

[0053] Therefore, in an embodiment of the present application, a radar module is set in an electronic device, and the radar module is used to obtain the motion information of the target object on the screen of the electronic device, and then the target control that the user wants to click is determined based on the motion information, and when the motion information meets the preset conditions, the target function corresponding to the target control is executed before the target object touches the screen, thereby speeding up the response speed, reducing the delay, and improving the user experience.

[0054] The working principle of the radar module is introduced below.

[0055] Please refer to Figures 3 to 5 , Figure 3 is a schematic diagram of the structure of a millimeter wave radar in the related art, Figure 4 It is a schematic diagram of the transmission signal and the echo signal when the target object is stationary. Figure 5 The figure is a schematic diagram of the transmitted signal and the echo signal when the target object is moving. Figures 3 to 5 As shown, the millimeter wave radar includes a transmitting antenna, a receiving antenna, a mixer and a synthesizer. When the target object is stationary relative to the millimeter wave radar, the transmitting signal of the transmitting antenna hits the target object and is reflected back to generate an echo signal. The echo signal has the same shape as the transmitting signal, but is delayed in time by τ, τ = 2D / c, where D is the distance between the target object and the millimeter wave radar, and c is the speed of light; the frequency difference between the transmitting signal and the echo signal is the frequency f of the intermediate frequency signal output by the mixer. 0 , according to the relationship between similar triangles, we have:

[0056]

[0057] From τ=2D / c, we can get:

[0058]

[0059] The frequencies of the intermediate frequency signals at the rising and falling edges of the triangular wave can be expressed as follows: The frequency of the intermediate frequency signal at the rising edge fb+=f 0 –f d ; fb-=f 0 +f d , where f 0 is the frequency of the intermediate frequency signal when the target object is relatively stationary, f d is the Doppler shift.

[0060] Then, from the distance formula D and the Doppler frequency shift formula, we can get:

[0061]

[0062] Then the distance D of the target object when it moves can be equivalent to:

[0063]

[0064] The speed V of the target object when it moves is:

[0065]

[0066] Please refer to Figure 6 , Figure 6 This is a schematic diagram of the millimeter wave radar measuring angle. Figure 6 As shown in the figure, if the millimeter wave radar uses two or more receiving antennas, the AOA arrival angle measurement can be completed. In other words, the distance difference between the target object and the two receiving antennas will cause the phase change of the FFT peak, and the angle information of the object can be estimated based on the phase change.

[0067] The phase change of the FFT peak can be expressed as:

[0068]

[0069] Assuming that the millimeter wave is a plane wave, then:

[0070] Δd=l*sin(θ),

[0071] Among them, l is the distance between the two receiving antennas, △d is the difference in the distance from the target object to the two receiving antennas, so:

[0072]

[0073] Based on the above analysis, it can be seen that the radar module in the embodiment of the present application can measure the distance information, azimuth information, and movement speed information of the target object.

[0074] In some embodiments of the present application, determining the target control from the plurality of controls displayed on the screen according to the motion information includes:

[0075] Determining, according to the position of the target object, an orthographic projection of the target object on the screen;

[0076] A control whose display area or movement range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen is determined as a target control, wherein the movement range area is a movable range of the control.

[0077] Specifically, since the radar module can measure the position of the target object (that is, it can be determined by the distance and azimuth), the orthographic projection of the target object on the screen of the electronic device can be determined according to the position of the target object, thereby determining the control whose display area or moving range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen as the target control. In other words, if there are multiple controls displayed on the screen of the electronic device, if the display area or moving range area of ​​a control at least partially overlaps with the orthographic projection of the target object on the screen, the control is determined as the target control.

[0078] Among them, the display area of ​​the control can be the area enclosed by the outline of the control, and the moving range area of ​​the control is the area constituted by the range in which the control can be moved. The control can only move within the moving range area. For example, the moving range area can be a circular area, an elliptical area, a fan-shaped area, etc.

[0079] In some embodiments of the present application, if the orthographic projection of the target object on the screen overlaps with at least two controls on the screen, the target control can be determined according to the size of the overlapping area. For example, the control with the largest overlapping area with the orthographic projection of the target object on the screen can be determined as the target control.

[0080] Please refer to Figure 7 , Figure 7 The following is a schematic diagram of the position relationship between the target object and the target control provided in the embodiment of the present application. Figure 7As shown, a plurality of controls are displayed on the screen 71 of the electronic device, including a first control 711, a second control 712 and a third control 713. A radar module 72 is arranged in the middle of the long side of the screen 71 of the electronic device. The radar module 72 includes a transmitting antenna 721 and two receiving antennas 722. The target object 73 moves directly above the screen 71. The electronic device can establish a rectangular coordinate system (x, y, z) with the radar module 72 as the center, and automatically match the coordinates of the center points of the controls on the screen, and determine the coordinates of the display area or the coordinates of the moving range area of ​​the control according to relevant settings. For example, the center point of the second control 712 is B, and its coordinates can be expressed as B (x1, y1, z1), and its display area is a circle centered on point B. If the orthographic projection of the target object 73 on the screen 71 at least partially overlaps with the display area or the moving range area of ​​the second control 712 on the screen, the second control 712 is the target control.

[0081] In some embodiments of the present application, the motion information satisfies a preset condition including:

[0082] The speed at which the target object moves from the first position point to the second position point is greater than a preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than a preset angle threshold;

[0083] Among them, the orthographic projection of the target object on the screen at the first position point and the second position point at least partially overlaps with the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen.

[0084] Exemplarily, when it is detected that the target object is located in the area directly above the target control (that is, when the display area or the moving range area of ​​the target control at least partially overlaps with the orthographic projection of the target object on the screen), it is possible to continue to determine whether the motion information of the target object meets the preset conditions. Specifically, if the speed at which the target object moves from the first position point to the second position point (here, the average speed) is greater than the preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than the preset angle threshold, it indicates that the target object is moving in the direction of the target control, and the movement speed is greater than the preset speed threshold, that is, the target object's operation intention is to touch the target control, then at this time, the target function corresponding to the target control can be executed before the target object touches the screen.

[0085] Among them, the orthographic projection of the target object on the screen at the first position point and the second position point overlaps with the target control at least partially, that is, the target object is always located in the area directly above the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen, that is, the moving direction of the target object is toward the screen, more specifically, toward the target control. In this process, the radar module can be used to obtain motion information and determine whether the preset conditions are met. The preset conditions are equivalent to the prerequisite that the target object touches the target control required for the target function of the original target control to be triggered. This can achieve the execution of the target function corresponding to the target control before the target object touches the screen, thereby speeding up the response speed, reducing latency, and improving the user experience.

[0086] It can be understood that the target object being located at the first position point may mean that the geometric center point of the target object is located at the first position point. Of course, a certain deviation may be appropriately generated. For example, the target object being located at the first position point may mean that the distance between the geometric center point of the target object and the first position point is less than a certain value.

[0087] like Figure 7 As shown, when it is detected that the target object 73 is located in the area directly above the second control 712 (i.e., the target control) (i.e., the display area or the moving range area of ​​the second control 712 at least partially overlaps with the positive projection of the target object 73 on the screen 71), the movement behavior of the target object 73 is judged, that is, the movement information is analyzed to see whether it meets the preset conditions. When the target object 73 is about to touch the second control 712, its movement trajectory is E→D→B, then the radar module 72 can obtain the speed and displacement vector ED of the target object 73 moving from the first position point E to the second position point D. If the speed of the target object 73 moving from the first position point E to the second position point D is greater than the preset speed threshold, and the angle between the displacement vector ED and the vector EB is less than the preset angle threshold, it is determined that the target object 73 is touching the second control 712, then the target function corresponding to the target control can be executed before the target object touches the screen.

[0088] In the embodiment of the present application, before the target object touches the screen, if the motion information satisfies the preset conditions, the target function corresponding to the target control is started to be executed, and the target function is the function that the electronic device responds to when the target control is touched. For example, if the target control is an icon of a target application, the target function corresponding to the target control is started to be executed, that is, the target application is started, so that the target application is quickly opened.

[0089] In some embodiments of the present application, executing the target function corresponding to the target control includes:

[0090] The operation data corresponding to when the target control is triggered is uploaded to the target server.

[0091] Exemplarily, the target control is a control in the game interface, then executing the target function corresponding to the target control is to upload the operation data generated when the original target control is touched to the target server (i.e., the game server) in advance, so that the target server can perform game calculations and processing in advance. When the target object touches the target control, the target server has completed or partially completed the intermediate data packaging, transmission, game calculation and other processes, thereby reducing the delay during the game and improving the user experience.

[0092] In some other embodiments of the present application, the executing the target function corresponding to the target control includes:

[0093] When the center point of the orthographic projection is located within the moving range of the target control and does not coincide with the center point of the target control, updating the display position of the target control;

[0094] The center point of the target control after the update is coincident with the center point of the orthographic projection.

[0095] Specifically, the target control can only be moved within the moving range area, and the moving range area of ​​the target control should be larger than the display area of ​​the target control. For example, the target control is the space for controlling the movement of the game character in the game interface, and the target control can be moved within a circular moving range area. In the conventional touch process, the target object needs to touch the target control first, and then drag the target control to move in a certain direction, that is, the operation corresponding to the target control is divided into two sub-operations, and the fixed order of the two sub-operations will cause a certain delay.

[0096] After determining the target control from multiple controls displayed on the screen according to the motion information, if the motion information meets the preset conditions, then when it is detected that the target object is located in the area directly above the target control (that is, the display area or the moving range area of ​​the target control at least partially overlaps with the orthographic projection of the target object on the screen), if the center point of the orthographic projection of the target object is located in the moving range area of ​​the target control and does not overlap with the center point of the target control, it is determined that the target object wants to touch the target control and move the target control in the direction of the center point of the orthographic projection of the target object. At this time, the electronic device can respond in advance and update the display position of the target control, that is, move the center point of the target control to overlap with the center point of the orthographic projection of the target object. As a result, the gesture intention of the target object can be predicted in advance, thereby updating the moving direction of the game character in advance, thereby reducing the corresponding delay and improving the user experience.

[0097] In some embodiments of the present application, after executing the target function corresponding to the target control, the method further includes:

[0098] When the target object touches the target control on the screen, a touch response function corresponding to the target control is executed.

[0099] Exemplarily, before the target object touches the screen, if the motion information satisfies a preset condition, the target function corresponding to the target control is executed as follows: before the target object touches the screen, the display position of the target control is updated in advance according to the motion information (i.e., the target control is moved to the corresponding position in advance), then thereafter, if the target object touches the target control on the screen, the electronic device will respond to the touch operation and execute the corresponding touch response function. For example, if the target control is a control in a game application for controlling the movement of a game character, executing the corresponding touch response function is equivalent to controlling the game character to move in a predicted direction, and the predicted direction is also the orientation of the display position of the updated target control relative to the initial display position of the target control.

[0100] Please refer to Figure 8 , Figure 8 Schematic diagram of a mobile target control provided in an embodiment of the present application. Figure 8 As shown, if the orthographic projection of the target object 73 on the screen 71 at least partially overlaps with the moving range area of ​​the second control 712 on the screen, the second control 712 is the target control. At this time, the center point A of the orthographic projection of the target object 73 is located in the moving range area of ​​the second control 712 and does not overlap with the center point B of the second control 712, then it is determined that the target object 73 wants to touch the second control 712 and move the second control 712 in the direction of the center point A of the orthographic projection of the target object 73, then the second control 712 is moved in the direction of the center point A of the orthographic projection of the target object 73, so that the center point of the second control 712 overlaps with the center point A of the orthographic projection of the target object 73.

[0101] In some embodiments of the present application, the preset speed threshold and / or the preset angle threshold are determined according to the user's operating habits. That is, in order to better perceive the movement trend of the target object and make the setting of the preset conditions more reasonable, the user's operating habits can be obtained, and the preset conditions can be set based on the user's operating habits. Exemplarily, a special behavior pattern can be established for training, or reasonable preset conditions can be obtained through machine learning, or by establishing a neural network model, etc.

[0102] For example, establish a user's gaming behavior pattern, and through operations similar to continuously clicking the screen in the game, predict the frequency of tapping the corresponding control, the distance of the target object from the screen during tapping the corresponding control, and the target object model, etc. Through the key frequency and the distance of the target object from the screen, the speed at which the user clicks the corresponding control can be obtained in advance as the preset speed threshold. The target object model mainly perceives the user's operating habits, so that the area of ​​the screen corresponding to the target object can be quickly obtained. Establishing a user's gaming behavior pattern can also be accomplished through machine learning or special behavior pattern training during the user's gaming operation.

[0103] In summary, in an embodiment of the present application, a radar module is set in an electronic device, and the radar module is used to obtain the motion information of the target object on the screen of the electronic device, and then the target control that the user wants to click is determined based on the motion information, and when the motion information meets the preset conditions, the target function corresponding to the target control is executed before the target object touches the screen, thereby speeding up the response speed, reducing the delay, and improving the user experience.

[0104] The interactive method provided in the embodiment of the present application can be executed by an interactive device. In the embodiment of the present application, the interactive device provided in the embodiment of the present application is described by taking the interactive method executed by the interactive device as an example.

[0105] Please refer to Fig. 9 , Fig. 9 Schematic diagram of an interactive device provided in an embodiment of the present application. Fig. 9 As shown, another aspect of the present application further provides an interactive device, the interactive device 900 comprising:

[0106] An acquisition module 901 is used to acquire motion information of a target object when the target object is above the screen of the electronic device and is not in contact with the screen;

[0107] A determination module 902, configured to determine a target control from a plurality of controls displayed on the screen according to the motion information;

[0108] The execution module 903 is used to execute the target function corresponding to the target control if the motion information meets a preset condition before the target object touches the screen.

[0109] Optionally, the determining module includes:

[0110] A first determining unit, configured to determine an orthographic projection of the target object on the screen according to a position of the target object;

[0111] The second determination unit is used to determine a control whose display area or movement range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen as a target control, wherein the movement range area is a movable range of the control.

[0112] Optionally, the motion information satisfies a preset condition including:

[0113] The speed at which the target object moves from the first position point to the second position point is greater than a preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than a preset angle threshold;

[0114] Among them, the orthographic projection of the target object on the screen at the first position point and the second position point at least partially overlaps with the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen.

[0115] Optionally, the execution module includes:

[0116] The uploading unit is used to upload the corresponding operation data when the target control is triggered to the target server.

[0117] Optionally, the execution module includes:

[0118] An updating unit, configured to update a display position of the target control when the center point of the orthographic projection is within a moving range of the target control and does not coincide with the center point of the target control;

[0119] The center point of the target control after the update is coincident with the center point of the orthographic projection.

[0120] Optionally, the preset speed threshold and / or the preset angle threshold are determined according to user operating habits.

[0121] In an embodiment of the present application, a radar module is set in an electronic device, and the radar module is used to obtain the motion information of the target object on the screen of the electronic device, and then the target control that the user wants to click is determined based on the motion information. When the motion information meets the preset conditions, the target function corresponding to the target control is executed before the target object touches the screen, thereby speeding up the response speed, reducing the delay, and improving the user experience.

[0122] The interactive device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtualreality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0123] The interactive device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0124] The interactive device provided in the embodiment of the present application can achieve Figures 2 to 8 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0125] Alternatively, if Fig.10 As shown, an embodiment of the present application also provides an electronic device 1000, including a processor 1001 and a memory 1002, wherein the memory 1002 stores programs or instructions that can be executed on the processor 1001, and when the program or instructions are executed by the processor 1001, the various steps of the above-mentioned interaction method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0126] Fig.11 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0127] The electronic device 1100 includes but is not limited to: a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109, and a processor 1110 and other components.

[0128] Those skilled in the art will appreciate that the electronic device 1100 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0129] Wherein, the sensor 1105 is used to obtain the motion information of the target object when it is above the screen of the electronic device and not in contact with the screen;

[0130] The processor 1110 is configured to determine a target control from a plurality of controls displayed on the screen according to the motion information;

[0131] The processor 1110 is further configured to execute a target function corresponding to the target control if the motion information satisfies a preset condition before the target object touches the screen.

[0132] In an embodiment of the present application, a radar module is set in an electronic device, and the radar module is used to obtain the motion information of the target object on the screen of the electronic device, and then the target control that the user wants to click is determined based on the motion information. When the motion information meets the preset conditions, the target function corresponding to the target control is executed before the target object touches the screen, thereby speeding up the response speed, reducing the delay, and improving the user experience.

[0133] Optionally, the processor 1110 is further configured to determine an orthographic projection of the target object on the screen according to the position of the target object;

[0134] A control whose display area or movement range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen is determined as a target control, wherein the movement range area is a movable range of the control.

[0135] Optionally, the motion information satisfies a preset condition including:

[0136] The speed at which the target object moves from the first position point to the second position point is greater than a preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than a preset angle threshold;

[0137] Among them, the orthographic projection of the target object on the screen at the first position point and the second position point at least partially overlaps with the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen.

[0138] Optionally, the network module 1102 is used to upload the corresponding operation data when the target control is triggered to the target server.

[0139] Optionally, the display unit 1106 is used to update the display position of the target control when the center point of the orthographic projection is located in the moving range of the target control and does not coincide with the center point of the target control;

[0140] The center point of the target control after the update is coincident with the center point of the orthographic projection.

[0141] Optionally, the preset speed threshold and / or the preset angle threshold are determined according to user operating habits.

[0142] In this embodiment, the target object may be a finger of the user, or an object such as a touch pen, a touch glove, etc. that can trigger a touch screen operation.

[0143] It should be understood that in the embodiment of the present application, the input unit 1104 may include a graphics processor (Graphics Processing Unit, GPU) 11041 and a microphone 11042, and the graphics processor 11041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1107 includes a touch panel 11071 and at least one of other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts: a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0144] The memory 1109 can be used to store software programs and various data. The memory 1109 can mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area can store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1109 can include a volatile memory or a non-volatile memory, or the memory 1109 can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0145] The processor 1110 may include one or more processing units; optionally, the processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1110.

[0146] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned interaction method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0147] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory, a random access memory, a magnetic disk or an optical disk.

[0148] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned interaction method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0149] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0150] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned interaction method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0151] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0152] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0153] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An interactive method, characterized in that: include: Acquiring motion information of a target object when the target object is above a screen of an electronic device and is not in contact with the screen; Determining a target control from a plurality of controls displayed on the screen according to the motion information; Before the target object touches the screen, if the motion information meets a preset condition, executing a target function corresponding to the target control; The motion information meeting the preset condition includes: The speed at which the target object moves from the first position point to the second position point is greater than a preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than a preset angle threshold; Among them, the orthographic projection of the target object on the screen at the first position point and the second position point at least partially overlaps with the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen.

2. The interactive method according to claim 1, characterized in that: Determining the target control from the plurality of controls displayed on the screen according to the motion information includes: Determining, according to the position of the target object, an orthographic projection of the target object on the screen; A control whose display area or movement range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen is determined as a target control, wherein the movement range area is a movable range of the control.

3. The interactive method according to claim 2, characterized in that: The executing of the target function corresponding to the target control comprises: When the center point of the orthographic projection is located within the moving range of the target control and does not coincide with the center point of the target control, updating the display position of the target control; The center point of the target control after the update is coincident with the center point of the orthographic projection.

4. An interactive device, characterized in that: include: An acquisition module, used to acquire motion information of a target object when the target object is above a screen of an electronic device and is not in contact with the screen; A determination module, configured to determine a target control from a plurality of controls displayed on the screen according to the motion information; An execution module, configured to execute a target function corresponding to the target control if the motion information satisfies a preset condition before the target object touches the screen; The motion information meeting the preset condition includes: The speed at which the target object moves from the first position point to the second position point is greater than a preset speed threshold, and the angle formed by the vector from the first position point to the second position point and the vector from the first position point to the center point of the target control is less than a preset angle threshold; Among them, the orthographic projection of the target object on the screen at the first position point and the second position point at least partially overlaps with the target control, and the distance between the first position point and the screen is greater than the distance between the second position point and the screen.

5. The interactive device according to claim 4, characterized in that: The determination module comprises: A first determining unit, configured to determine an orthographic projection of the target object on the screen according to a position of the target object; The second determination unit is used to determine a control whose display area or movement range area at least partially overlaps with the orthographic projection among the multiple controls displayed on the screen as a target control, wherein the movement range area is a movable range of the control.

6. The interactive device according to claim 5, characterized in that: The execution module includes: An updating unit, configured to update a display position of the target control when the center point of the orthographic projection is within a moving range of the target control and does not coincide with the center point of the target control; The center point of the target control after the update is coincident with the center point of the orthographic projection.

7. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the interaction method according to any one of claims 1 to 3 are implemented.

8. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the interactive method according to any one of claims 1 to 3 are implemented.

Images