Display methods, devices and electronic equipment

By using a hovering sensor to enhance the acquisition of three-dimensional spatial coordinates and display the markers, the problem of finger placement deviation during screen projection is solved. This improves operational efficiency and accuracy without looking at the display screen of the primary electronic device, thus enhancing the user experience.

CN123114267APending Publication Date: 2026-11-17VIVO MOBILE COMM CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611505277.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-09-24
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

During screen mirroring, when the user's gaze is focused on the large screen, the point where their finger lands on the touch screen of the electronic device is prone to deviating from the target, resulting in low operating efficiency and accuracy.

Method used

By acquiring three-dimensional spatial coordinates through the hover sensing enhancement finger sleeve, determining the identification display area on the display screen, and displaying an indicator in that area to indicate the hover sensing enhancement finger sleeve's hovering area or control, the user can operate the first electronic device through the display screen of the second electronic device without looking at the first electronic device's display screen.

Benefits of technology

It improves the efficiency and accuracy of users operating the primary electronic device during screen mirroring, reduces visual lag, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123114267A_ABST
    Figure CN123114267A_ABST
Patent Text Reader

Abstract

This application discloses a display method, apparatus, and electronic device, belonging to the field of electronic device technology. The display method executed by the first electronic device includes: in a state where the first interface of the first electronic device is projected onto the second electronic device, determining an identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve; displaying a first identification in the identification display area; wherein the first identification is used to indicate the hovering area of ​​the levitation sensing enhanced finger sleeve on the display screen or a first control on the first interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, and specifically relates to a display method, device and electronic equipment. Background Technology

[0002] Screen mirroring is a technology that transmits content from electronic devices such as mobile phones and tablets to large screens such as TVs and projectors in real time.

[0003] When projecting, the user's gaze is focused on the large screen. When operating an electronic device while focused on the large screen, the finger's placement on the touchscreen is prone to deviating from the target. To prevent this, the user needs to frequently switch their gaze between the large screen and the electronic device's touchscreen, resulting in low user efficiency and accuracy. Summary of the Invention

[0004] The purpose of this application is to provide a display method, apparatus, and electronic device that can improve the efficiency and accuracy of a user operating a first electronic device while the user is looking at the display screen of a second electronic device, without looking at the display screen of a first electronic device.

[0005] In a first aspect, embodiments of this application provide a display method, executed by a first electronic device, the method comprising: When the first interface of the first electronic device is projected onto the second electronic device, the identification display area on the display screen of the first electronic device is determined based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve. In the identification display area, a first identifier is displayed; wherein the first identifier is used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen or the first control on the first interface.

[0006] In this embodiment, the user does not need to look at the display screen of the first electronic device. By looking at the identifier projected onto the second electronic device to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or the first control on the first interface, the user can know the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or the control locked by the system. Thus, the user can operate the first electronic device without looking at the display screen of the first electronic device, but by looking at the display screen of the second electronic device. This improves the efficiency and accuracy of the user's operation of the first electronic device.

[0007] In some embodiments of this application, before determining the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve, the display method provided in the embodiments of this application further includes: in a first mode, acquiring the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve according to a first time interval; In the first mode, the first identifier moves with the hover-sensing enhanced finger sleeve.

[0008] In this embodiment of the application, by marking the movement of the hover sensing enhancement finger sleeve, the user can promptly know the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the first electronic device.

[0009] In some embodiments of this application, determining the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve includes: Based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration, determine the identification display area on the screen of the first electronic device; Among them, the screen projection link delay is the delay of the link connecting the first electronic device and the second electronic device; the first speed is the moving speed of the hover sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hover sensing enhanced finger sleeve.

[0010] In some embodiments of this application, determining the identification display area on the display screen of the first electronic device based on three-dimensional spatial coordinates, projection link delay duration, a first velocity, and a first acceleration includes: Based on three-dimensional spatial coordinates, determine the projection area of ​​the levitation sensing enhancement finger sleeve on the display screen; The first displacement of the levitation sensing enhanced finger sleeve is determined based on the projection link delay, the first velocity, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhanced finger sleeve on the display screen. Based on the projection area and the first displacement, the identification display area on the display screen of the first electronic device is determined.

[0011] In this embodiment, the position of the floating sensor-enhanced finger sleeve when the first identifier arrives at the second electronic device is predicted based on the screen projection link delay time. This allows the first identifier to be displayed in advance, and the first identifier and finger movement are visually approximately synchronized, which can reduce the visual lag caused by screen projection.

[0012] In some embodiments of this application, the display screen includes N controls; N is an integer greater than 1; the display method provided in the embodiments of this application further includes: Obtain the distance between each of the N controls and the label display area, resulting in N distance values; If the minimum distance value among N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold, a first identifier is displayed in the control display area of ​​the first control; wherein, the first radius is the radius of the first control corresponding to the minimum distance value.

[0013] In this embodiment, the first identifier can be snapped to the display area of ​​the control corresponding to the minimum distance value for display, so as to guide the user to touch the control.

[0014] In some embodiments of this application, a first identifier is displayed in the control display area of ​​the first control, including: The first identifier is moved to the center of the control display area of ​​the first control and displayed in a first display mode.

[0015] In this embodiment, the first identifier can be snapped to the center of the display area of ​​the control corresponding to the minimum distance value and displayed in a first display mode to guide the user to touch the control.

[0016] In some embodiments of this application, the display method provided in this application further includes: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, the second display mode of the first identifier is determined based on the height component. In the signage display area, the first signage is displayed, including: In the signage display area, the first signage is displayed in the second display mode; In the second display mode, the transparency of the first icon decreases as the height component increases and increases as the height component decreases; the size of the first icon increases as the height component increases and decreases as the height component decreases; when the size of the first icon decreases to a second threshold, it no longer decreases as the height component decreases.

[0017] In this embodiment of the application, by displaying the first logo in a second display mode, the user can perceive the distance between the levitation sensing enhancement fingertip and the display screen of the first electronic device.

[0018] In some embodiments of this application, after displaying the first identifier in the control display area of ​​the first control, the display method provided in the embodiments of this application further includes: Receives touch input from the first control via a hover-sensing enhanced finger sleeve; In response to touch input, perform the first processing corresponding to the first control.

[0019] In this embodiment of the application, when a user touches the first control through the hover sensing enhancement fingertip, the user can perform the processing corresponding to the first control and complete an interaction between the user and the electronic device.

[0020] In some embodiments of this application, the display method provided in this application further includes: If no three-dimensional spatial coordinates are obtained or the height component of the three-dimensional spatial coordinates is greater than the third threshold, a prompt message will be displayed; The prompt message is used to remind the user to move the hover sensing enhancement finger sleeve into the hover sensing range of the display screen.

[0021] In this embodiment of the application, the user can be guided to move the hover sensing enhancement finger sleeve to the hover sensing range of the display screen of the electronic device, so as to display an indicator on the display screen of the electronic device indicating the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the electronic device, so that the user can know the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the electronic device through the indicator.

[0022] Secondly, embodiments of this application provide a display device, including: The determination module is used to determine the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve when the first interface of the first electronic device is projected onto the second electronic device. The display module is used to display a first identifier in the identifier display area; wherein the first identifier is used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen or a first control on the first interface.

[0023] In some embodiments of this application, the display device provided in the embodiments of this application further includes: The first acquisition module is used to acquire the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve according to a first time interval in the first mode; In the first mode, the first identifier moves with the hover-sensing enhanced finger sleeve.

[0024] In some embodiments of this application, the determining module is specifically used for: Based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration, determine the identification display area on the screen of the first electronic device; Among them, the screen projection link delay is the delay of the link connecting the first electronic device and the second electronic device; the first speed is the moving speed of the hover sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hover sensing enhanced finger sleeve.

[0025] In some embodiments of this application, the determining module is specifically used for: Determine the projection position of the levitation sensing enhancement finger sleeve on the display screen based on the three-dimensional spatial coordinates; The first displacement of the levitation sensing enhanced finger sleeve is determined based on the projection link delay, the first velocity, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhanced finger sleeve on the display screen. Based on the projection position and the first displacement, the identification display area on the display screen of the first electronic device is determined.

[0026] In some embodiments of this application, the display screen includes N controls; N is an integer greater than 1; the display device provided in the embodiments of this application further includes: The second acquisition module is used to obtain the distance between the center of each of the N controls and the center of the identifier display area, and obtain N distance values; The display module is also used for: If the minimum distance value among N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold, the first identifier is displayed in the control display area of ​​the first control. Wherein, the first radius is the radius of the first control corresponding to the minimum distance value.

[0027] In some embodiments of this application, the display module is specifically used for: The first identifier is moved to the center of the control display area of ​​the first control and displayed in a first display mode.

[0028] In some embodiments of this application, the determining module is further configured to: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, the second display mode of the first identifier is determined based on the height component. The display module is specifically used for: In the signage display area, the first signage is displayed in the second display mode; In the second display mode, the transparency of the first icon decreases as the height component increases and increases as the height component decreases; the size of the first icon increases as the height component increases and decreases as the height component decreases; when the size of the first icon decreases to a second threshold, it no longer decreases as the height component decreases.

[0029] In some embodiments of this application, the display device provided in the embodiments of this application further includes: The receiving module is used to receive touch input from the hover-sensing enhanced finger sleeve to the first control; The execution module is used to respond to touch input and perform the first processing corresponding to the first control.

[0030] In some embodiments of this application, the display module is further configured to: If no three-dimensional spatial coordinates are obtained or the height component of the three-dimensional spatial coordinates is greater than the second threshold, a prompt message will be displayed. The prompt message is used to remind the user to move the hover sensing enhancement finger sleeve into the hover sensing range of the display screen.

[0031] Thirdly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory stores programs or instructions that can run on the processor, and when the programs or instructions are executed by the processor, they implement the steps of the display method provided in embodiments of this application.

[0032] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, and when the program or instructions are executed by a processor, the steps of the display method provided in embodiments of this application are implemented.

[0033] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the steps of the display method provided in embodiments of this application.

[0034] Sixthly, embodiments of this application provide a computer program product, which is stored in a storage medium and executed by at least one processor to implement the steps of the display method provided in embodiments of this application.

[0035] In this embodiment, the user does not need to look at the display screen of the first electronic device. By looking at the identifier projected onto the second electronic device to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or the first control on the first interface, the user can know the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or the control locked by the system. Thus, the user can operate the first electronic device without looking at the display screen of the first electronic device, but by looking at the display screen of the second electronic device. This improves the efficiency and accuracy of the user's operation of the first electronic device. Attached Figure Description

[0036] Figure 1 This is a flowchart illustrating a display method performed by a first electronic device according to some embodiments of this application; Figure 2 This is a schematic diagram of the structure of the levitation sensing enhanced finger sleeve provided in some embodiments of this application; Figure 3 This is a schematic diagram of the three-dimensional spatial coordinates of a levitation sensing enhanced finger sleeve provided in some embodiments of this application; Figure 4These are schematic diagrams showing the first identifier provided in some embodiments of this application; Figure 5A This is a schematic diagram showing the position of the identification display area and various controls provided in some embodiments of this application; Figure 5B This is a schematic diagram illustrating the display of a first identifier at the center of the control display area of ​​a jump control, provided by some embodiments of this application; Figure 6 These are schematic diagrams illustrating the display of prompt information provided in some embodiments of this application; Figure 7A This is a schematic diagram illustrating another position of the identifier display area and various controls provided in some embodiments of this application; Figure 7B This is a schematic diagram illustrating the display of a first identifier at the center of the control display area of ​​a brightness control, provided by some embodiments of this application; Figure 8 These are schematic diagrams of the structure of a display device provided in some embodiments of this application; Figure 9 These are schematic diagrams of the structure of electronic devices provided in some embodiments of this application; Figure 10 These are schematic diagrams of the hardware structure of electronic devices provided in some embodiments of this application. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0038] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0039] The terminology used in the implementation section of this application is only for explaining specific embodiments of this application and is not intended to limit this application. The terminology involved in the embodiments of this application is explained below.

[0040] The levitation sensing enhancement finger sleeve is an enhanced wearable component made of a composite dielectric layer with a high conductivity layer and a high dielectric constant layer. It is worn on the fingertip to enhance the spatial sensing capability of mobile touch.

[0041] An identifier is a mark used for identification. Its core function is to mark things through visual symbols, such as text, graphics, and colors, to achieve identification, differentiation, and guidance. The first identifier in this application is text, symbols, images, etc., used to indicate information, and can use controls or other containers as the carrier for displaying information, including but not limited to text identifiers, symbol identifiers, and image identifiers.

[0042] A control (also called a part, component, widget, or control) is a graphical user interface element and a basic building block of the user interface. It is a window or text box that is displayed in the program interface of any application. Controls can be buttons, text boxes, labels, etc., and are used to control all the data processed by each application and the interactive operations on that data.

[0043] The display method, apparatus, and electronic device provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0044] It should be noted that the display method provided in this application can be executed by a first electronic device, which can be a mobile phone, tablet computer, laptop computer, or other electronic device. Some embodiments of this application use the first electronic device as the execution subject to illustrate the display method provided in this application.

[0045] The display method provided in this application can be applied to scenarios where a user operates a first electronic device while viewing the content displayed on the screen of a second electronic device. One specific application scenario is where the first electronic device is a mobile phone and the second electronic device is a television, and the game interface of the mobile phone is projected onto the television, allowing the user to play the game by viewing the game interface displayed on the television. Another specific application scenario is where the first electronic device is a mobile phone and the second electronic device is a television, and the image editing interface of the mobile phone is projected onto the television, allowing the user to edit images by viewing the image editing interface displayed on the television.

[0046] It should be noted that the above application scenario is only one example. In actual applications, other application scenarios may also be included. For example, the first electronic device is a mobile phone and the second electronic device is a television. The web page interface of the mobile phone is projected onto the television, and the user operates the web page by watching the web page interface displayed on the television.

[0047] Figure 1This is a flowchart illustrating a display method performed by a first electronic device according to some embodiments of this application. The display method performed by the first electronic device may include: Step 101: When the first interface of the first electronic device is projected onto the second electronic device, the identification display area on the display screen of the first electronic device is determined based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve. In some embodiments of this application, the first interface in these embodiments is the interface displayed on the screen of a first electronic device.

[0048] In some embodiments of this application, the second electronic device may be an electronic device such as a television or a projector.

[0049] In some embodiments of this application, in step 101, the identification display area on the display screen of the first electronic device can be determined in real time based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve. Alternatively, the identification display area on the display screen of the first electronic device can be determined according to a preset time interval based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve. The preset time interval can be set according to actual needs, for example, the preset time interval is 10 milliseconds (ms), or the preset time interval is the duration of the touch sampling period of the first electronic device.

[0050] In some embodiments of this application, the identification display area is an area on the display screen of the first electronic device used to display a first identification, which is an identification used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or a first control on the first interface.

[0051] In some embodiments of this application, the levitation sensing enhanced finger sleeve may include a composite dielectric layer of a highly conductive layer and a high dielectric constant. For example... Figure 2 As shown, Figure 2 This is a schematic diagram of the structure of the levitation sensing enhanced finger sleeve provided in some embodiments of this application. Figure 2 In the process, the levitation sensing enhancement finger sleeve includes a highly conductive layer 201 and a high dielectric constant composite dielectric layer 202.

[0052] In some embodiments of this application, the highly conductive layer 201 contains free charges and is conductive, and its ground coupling with the human body through the skin is equivalent to a "virtual electrode attached to the fingertip"; while the high dielectric constant composite dielectric layer 202 is non-conductive and relies on polarization to converge or confine the electric field, actively capturing and binding divergent edge electric field lines in space, forcibly converging the surrounding sparse electric field towards the fingertip coupling region. The combination of the highly conductive layer 201 and the high dielectric constant composite dielectric layer 202 enables the signal-to-noise ratio (SNR) obtained by the sensor in the display of the first electronic device at a height of 20 mm to 30 mm to be equivalent to the signal strength of a bare finger at 10 mm.

[0053] In some embodiments of this application, the conductivity of the levitation sensing enhancement finger sleeve material gradually decreases from the fingertip to the base of the finger. The sensing effect is mainly concentrated in the small area at the fingertip where the conductivity is best, while the influence of larger areas such as the palm and back of the hand on the sensing is correspondingly weakened, making the useful signal more concentrated and cleaner, which helps to further improve the sensing signal-to-noise ratio.

[0054] In some embodiments of this application, the levitation sensing enhancement finger sleeve, by employing a high dielectric constant composite dielectric layer, can effectively compensate for signal attenuation caused by increased height and distance, and can provide high-intensity capacitance change feedback.

[0055] In the embodiments of this application, by using a composite dielectric layer of highly conductive and high dielectric constant for the levitation sensing enhancement finger sleeve, the sensing distance of levitation touch can be increased from 10mm to 20-30mm, or even 50mm. This provides the stable sensing space required for users to operate the first electronic device by viewing the display screen of a second electronic device, without having to view the display screen of the first electronic device. As an external wearable device, the levitation sensing enhancement finger sleeve requires minimal modification to the touch chip of the first electronic device, exhibiting good compatibility and mass production feasibility.

[0056] In some embodiments of this application, a three-dimensional Cartesian coordinate system can be established with the upper left corner of the display screen of the first electronic device as the origin, the two adjacent sides of the upper left corner of the display screen of the first electronic device as the X-axis and Y-axis respectively, and the orientation direction of the display screen of the first electronic device as the Z-axis. Then, the first electronic device identifies the specific impedance characteristics of the levitation sensing enhancement finger sleeve through self-capacitance scanning, automatically activates the high-precision levitation sensing mode, and begins to collect the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve. The three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve are represented as P(x, y, z), where x and y are the two-dimensional projection coordinates of the levitation sensing enhancement finger sleeve in the display screen of the first electronic device, and z is the height of the fingertip of the levitation sensing enhancement finger sleeve perpendicular to the display screen plane of the first electronic device, that is, the height component of the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve.

[0057] In some embodiments of this application, the sensing electrode array (such as ITO row / column electrodes) of the display screen of the first electronic device is driven by a capacitive touch controller IC built into the first electronic device. The touch controller IC periodically applies excitation to each sensing electrode and measures its self-capacitance to ground. When a finger wearing a hovering sensing enhancement finger sleeve approaches the display screen of the first electronic device, the highly conductive layer of the fingertip is grounded through the skin to the human body, forming an additional capacitance between it and the sensing electrode, causing a change in the total capacitance of the electrode to ground. The touch controller IC obtains the capacitance change distribution by detecting the minute changes in the charging and discharging time / charge of each electrode, and then matches it with the unique impedance / capacitance characteristics of the hovering sensing enhancement finger sleeve to determine the projection position (x, y) of the hovering sensing enhancement finger sleeve on the display screen plane and its suspension height z, thus obtaining the three-dimensional spatial coordinates of the hovering sensing enhancement finger sleeve. The highly conductive layer and the high dielectric constant composite dielectric layer of the hovering sensing enhancement finger sleeve significantly enhance this capacitance change, enabling it to be stably detected even at higher suspension distances. The maximum suspension distance can reach 50 mm.

[0058] For example, such as Figure 3 As shown, Figure 3 This is a schematic diagram of the three-dimensional spatial coordinates of a levitation sensing enhanced finger sleeve provided in some embodiments of this application.

[0059] For example, the first electronic device is a mobile phone, and the second electronic device is a television. When a user wears a hovering sensor enhanced finger sleeve to play games, and the game interface of the mobile phone is projected onto the television, the three-dimensional spatial coordinates of the hovering sensor enhanced finger sleeve in a three-dimensional rectangular coordinate system established by the mobile phone are obtained. Based on the three-dimensional spatial coordinates, the identification display area on the mobile phone screen is determined.

[0060] For example, the first electronic device is a mobile phone, and the second electronic device is a television. The user wears a hovering sensor enhanced finger sleeve to edit images. When the image editing interface of the mobile phone is projected onto the television, the three-dimensional spatial coordinates of the hovering sensor enhanced finger sleeve in a three-dimensional rectangular coordinate system established by the mobile phone are obtained. Based on the three-dimensional spatial coordinates, the identification display area on the mobile phone screen is determined.

[0061] In some embodiments of this application, step 101 may include: determining the identification display area on the display screen of the first electronic device based on three-dimensional spatial coordinates, screen projection link delay duration, a first speed, and a first acceleration; wherein, the screen projection link delay duration is the delay duration of the screen projection connection between the first electronic device and the second electronic device; the first speed is the moving speed of the levitation sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the levitation sensing enhanced finger sleeve.

[0062] In some embodiments of this application, determining the identification display area on the display screen of the first electronic device based on three-dimensional spatial coordinates, projection link delay duration, a first velocity, and a first acceleration includes: determining the projection position of the levitation sensing enhancement fingertip on the display screen of the first electronic device based on three-dimensional spatial coordinates; determining the first displacement of the levitation sensing enhancement fingertip based on the projection link delay duration, the first velocity, and the first acceleration; wherein the first displacement is the displacement of the projection of the levitation sensing enhancement fingertip on the display screen of the first electronic device; and determining the identification display area on the display screen of the first electronic device based on the projection position and the first displacement.

[0063] In some embodiments of this application, the displacement of the projection of the levitation sensing enhancement fingertip on the display screen of the first electronic device is the displacement of the projection of the levitation sensing enhancement fingertip on the plane where the display screen of the first electronic device is located.

[0064] In some embodiments of this application, when determining the projection position of the levitation sensing enhancement fingertip on the display screen based on three-dimensional spatial coordinates, the three-dimensional spatial coordinates can be determined as the two-dimensional projection coordinates within the display screen of the first electronic device as the projection position of the levitation sensing enhancement fingertip on the display screen of the first electronic device.

[0065] In some embodiments of this application, when determining the first displacement of the levitation sensing enhancement finger sleeve based on the projection link delay duration, the first velocity, and the first acceleration, the first displacement can be determined by the following formula (1): (1) In formula (1), and These are the components of the first displacement along the X and Y axes, respectively. and These represent the X-axis and Y-axis components of the velocity of the hovering sensor-enhanced finger sleeve, respectively. and These represent the X-axis and Y-axis components of the acceleration of the levitation-sensing enhanced finger sleeve, respectively. This refers to the latency of the screen mirroring link.

[0066] In some embodiments of this application, when determining the identification display area on the display screen of the first electronic device based on the projection position and the first displacement, the component of the projection position on the X-axis and the component of the first displacement on the X-axis can be summed to obtain the component of the center of the identification display area on the X-axis; the component of the projection position on the Y-axis and the component of the first displacement on the Y-axis can be summed to obtain the component of the center of the identification display area on the Y-axis, thereby obtaining the coordinates of the center of the identification display area on the display screen of the first electronic device.

[0067] For example, with P future ( , The coordinates (P) represent the center of the identification display area on the screen of the first electronic device. The three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve are P. now ( , , Then, the projection position of the levitation sensing enhancement fingertip on the display screen of the first electronic device is ( , Then, the coordinates P of the center of the display area on the screen of the first electronic device are... future ( , )for( + , + ).

[0068] For example, the projection link latency is 60 milliseconds (ms), the three-dimensional spatial coordinates of the hover sensing enhanced finger sleeve are (50mm, 50mm, 25mm), the velocity component of the hover sensing enhanced finger sleeve in the X-axis direction is 100mm / s, the velocity component in the Y-axis direction is 50mm / s, and the acceleration component of the hover sensing enhanced finger sleeve in the X-axis direction is 200mm / s. 2 The acceleration component in the Y-axis direction is 100 mm / s². 2 Based on the above, the coordinates of the center of the marking display area on the display screen of the first electronic device are (56.36mm, 53.18mm).

[0069] In this embodiment, the position of the floating sensor-enhanced finger sleeve when the first identifier arrives at the second electronic device is predicted based on the screen projection link delay time. This allows the first identifier to be displayed in advance, and the first identifier and finger movement are visually approximately synchronized, which can reduce the visual lag caused by screen projection.

[0070] In this embodiment, a time-delay prediction model is adopted. The motion speed and acceleration of the finger sleeve are enhanced by the levitation sensor, and the predicted coordinates are calculated and displayed. The position and falling distance of the mark are displayed in real time by the second electronic device. This can offset the physical projection delay, improve the smoothness of operation, solve the "blind operation pain point" of finger landing point when projecting, improve the accuracy of finger landing point, solve the anxiety of hand-eye separation, and improve the user experience.

[0071] Step 102: Display a first identifier in the identifier display area; wherein the first identifier is used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen of the first electronic device or the first control on the first interface.

[0072] For example, such as Figure 4 As shown, Figure 4This is a schematic diagram showing a first identifier provided in some embodiments of this application. Figure 4 In the first electronic device, a first identifier 401 is displayed in the identifier display area 400. The first identifier 401 indicates the hovering area of ​​the hover sensing enhancement fingertip on the display screen of the first electronic device. The second electronic device synchronously displays the first identifier 401 through screen projection from the first electronic device.

[0073] In some embodiments of this application, the display screen of the first electronic device can display two layers of content, and the user sees a combined effect of the two layers of content on both the first and second electronic devices. The bottom layer is the first interface, and the floating layer is a first identifier superimposed on top of the first interface.

[0074] In some embodiments of this application, the display screen includes N controls, where N is a positive integer greater than 1; the display method performed by the first electronic device provided in the embodiments of this application may further include: obtaining the distance between the center of each of the N controls and the center of the identification display area to obtain N distance values; when the minimum distance value among the N distance values ​​is less than or equal to a first radius and the height component of the three-dimensional spatial coordinates is less than or equal to a first threshold, displaying a first identifier in the control display area of ​​the first control; wherein the first radius is the radius of the first control corresponding to the minimum distance value.

[0075] In some embodiments of this application, the first electronic device can obtain the center point coordinates and radius of each of the N controls on the first interface.

[0076] In some embodiments of this application, the distance from the center of the identifier display area to the center point coordinates of each of the N controls can be calculated by the distance between two points, resulting in N distance values. After obtaining the N distance values, the minimum distance value among the N distance values ​​can be determined, thereby identifying the control corresponding to the minimum distance value and obtaining the radius of the control corresponding to the minimum distance value. When the minimum distance value is less than or equal to the radius of the control corresponding to the minimum distance value and the height component of the three-dimensional spatial coordinates is less than or equal to a first threshold, the first identifier is displayed in the control display area of ​​the control corresponding to the minimum distance value.

[0077] In some embodiments of this application, the first threshold can be set according to actual needs. The value range of the first threshold can be 20 to 30 mm.

[0078] For example, such as Figure 5A As shown, Figure 5A This is a schematic diagram illustrating the position of the identifier display area and various controls provided in some embodiments of this application. Figure 5AIn the game interface 500, there are jump controls 501, crouch controls 502, and prone controls 503. The distance between the center of the indicator display area 400 and the center of the jump control 501 is 9.4mm, the distance between the center of the indicator display area 400 and the center of the crouch control 502 is 20mm, and the distance between the center of the indicator display area 400 and the center of the prone control 503 is 20mm. The distance between the center of the indicator display area 400 and the center of the jump control 501 is the smallest. The radius of the jump control 501 is 15mm, the height component of the three-dimensional spatial coordinates of the hover sensing enhanced finger sleeve is 18mm, and the first threshold is 20mm. Therefore, the first indicator 401 is displayed in the control display area of ​​the jump control 501.

[0079] In this embodiment, the first identifier can be snapped to the display area of ​​the control corresponding to the minimum distance value for display, so as to guide the user to touch the control.

[0080] In some embodiments of this application, displaying a first identifier in the control display area of ​​a first control may include: controlling the first identifier to move to the center position of the control display area of ​​the first control, and displaying the first identifier in a first display mode.

[0081] In some embodiments of this application, the first display mode in the embodiments of this application includes, but is not limited to, 100% transparency, a bright solid line crosshair, a specific color, etc.

[0082] In some embodiments of this application, when displaying the first identifier in the first display mode, the transparency of the first identifier can be adjusted to 100%, that is, completely opaque. The shape of the first identifier can be switched from a circle to a bright solid line crosshair, such as a crosshair or a circular crosshair. The color of the first identifier can also be adjusted to a preset specific color, such as red. The size of the first identifier can also be adjusted to a preset size, no longer changing with the height component of the three-dimensional spatial coordinates, so as to highlight the sense of precise locking.

[0083] For example, such as Figure 5B As shown, Figure 5B This is a schematic diagram illustrating the display of a first identifier at the center of the control display area of ​​a jump control, provided by some embodiments of this application. Figure 5BIn the game interface 500, there are jump controls 501, crouch controls 502, and prone controls 503. The distance between the center of the indicator display area 400 and the center of the jump control 501 is 9.4mm, the distance between the center of the indicator display area 400 and the center of the crouch control 502 is 20mm, and the distance between the center of the indicator display area 400 and the center of the prone control 503 is 20mm. The distance between the center of the indicator display area 400 and the center of the jump control 501 is the smallest. The radius of the jump control 501 is 15mm, the height component of the three-dimensional spatial coordinates of the hover sensing enhanced finger sleeve is 18mm, and the first threshold is 20mm. The first indicator 401 is then moved to the center position of the control display area of ​​the jump control 501 and displayed as a black circle.

[0084] In this embodiment, the first identifier can be snapped to the center of the display area of ​​the control corresponding to the minimum distance value and displayed in a first display mode to guide the user to touch the control.

[0085] In some embodiments of this application, after displaying the first identifier in the control display area of ​​the first control, the display method provided in the embodiments of this application may further include: receiving touch input from the hover sensing enhanced finger sleeve to the first control; and in response to the touch input, performing a first process corresponding to the first control.

[0086] For example, when the first control is a control for controlling a character in the game to jump, the user controls the character in the game to jump after touching the control with a hover-sensing enhanced fingertip; when the first control is a control for controlling a character in the game to crouch, the user controls the character in the game to crouch after touching the control with a hover-sensing enhanced fingertip.

[0087] In some embodiments of this application, when the first identifier moves to the center of the control display area of ​​the first control, the first identifier can be in a locked state. Specifically, the locked state is a pre-judgment state where, when the first identifier enters the control display area and the height of the floating sensor enhancement finger sleeve decreases below a first threshold, the first identifier automatically moves to the center of the control display area and changes its shape to guide the user to decisively place their finger for touch. Under the visual guidance of the locked state, the user confirms the finger's landing point and presses their finger down to contact the display screen of the first electronic device. The first electronic device recognizes the touch event and maps it to the corresponding control, realizing a complete interactive operation. Since the locked state has pre-moved the first identifier to the center of the control display area of ​​the first control, the deviation between the physical coordinates of the user's finger and the center of the control display area of ​​the first control is usually within ±5mm. The first electronic device determines this as a hit on the first control and triggers the corresponding operation. After an interaction is completed, the floating first identifier of the first electronic device disappears, the second electronic device mirrors and synchronizes, and then the first identifier returns to its following state, waiting for the user's next touch. When the user lifts their finger, the first electronic device automatically continues to acquire the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve for the next interaction, without any reset operation.

[0088] In this embodiment of the application, when a user touches the first control through the hover sensing enhancement fingertip, the user can perform the processing corresponding to the first control and complete an interaction between the user and the electronic device.

[0089] In some embodiments of this application, the display method applied to a first electronic device provided in this application may further include: determining a second display mode for a first identifier based on the height component when the minimum distance value is greater than a first radius or the height component is greater than a first threshold; correspondingly, step 102 may include: displaying the first identifier in the identifier display area in the second display mode; wherein, in the second display mode, the transparency of the first identifier decreases as the height component increases and increases as the height component decreases; the size of the first identifier increases as the height component increases and decreases as the height component decreases; when the size of the first identifier decreases to the second threshold, it no longer decreases as the height component decreases.

[0090] In some embodiments of this application, when the minimum distance value is greater than the radius of the first control corresponding to the minimum distance value, it indicates that the user's finger is in the movement and positioning stage, and the first identifier is not moved to the center position of the control display area of ​​any control. The first identifier follows the movement of the floating sensing enhancement finger sleeve in real time.

[0091] In some embodiments of this application, when the user's finger is in the movement and positioning stage, the first identifier can be in a following state. In this following state, the first identifier moves in real time on the display screen of the first electronic device, following the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve, and is simultaneously displayed on the visual guidance state of the second electronic device via screen projection.

[0092] In some embodiments of this application, the first identifier can be circular, with its diameter automatically changing according to the height of the levitation sensing enhancement finger sleeve. The second threshold can be set according to actual needs. The value range of the second threshold can be 5 to 15 pixels.

[0093] In some embodiments of this application, the diameter of the first identifier is max(10, The unit is pixels, where Z is the height component of the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve, in mm. When the height component of the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve is 50mm, the diameter of the first logo reaches its maximum value of 40px, and the minimum diameter of the first logo is 10px, ensuring that it is not too small to be invisible when the finger is close to the display screen. The intuitive effect is: the farther the finger is from the display screen, that is, the larger the height component of the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve, the larger and more transparent the first logo is; the closer the finger is to the display screen, that is, the smaller the height component of the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve, the smaller and clearer the first logo is, until it shrinks to a circle with a diameter of 10px, like a scope gradually narrowing.

[0094] For example, the center coordinates of the identification display area are (840mm, 160mm), the center coordinates of the control closest to the identification display area are (850mm, 150mm), the radius of the control is 15mm, the height component of the three-dimensional spatial coordinates of the hover sensing enhancement finger sleeve is 30mm, and the first threshold is 20mm.

[0095] Although the distance from the display area to the center point of the control is 14.1mm, which is less than 15mm, the height component of the three-dimensional spatial coordinates of the floating sensing enhanced finger sleeve is greater than the first threshold, indicating that the user's finger is still in the moving positioning stage. Therefore, a semi-transparent, circular first logo with a diameter of 24px is displayed at the position of (840mm, 160mm).

[0096] In this embodiment of the application, by displaying the first logo in a second display mode, the user can perceive the distance between the levitation sensing enhancement fingertip and the display screen of the first electronic device.

[0097] In some embodiments of this application, the display method performed by the first electronic device provided in the embodiments of this application may further include: displaying a prompt message when the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve are not obtained or the height component of the three-dimensional spatial coordinates is greater than a third threshold; wherein the prompt message is used to prompt the user to move the levitation sensing enhancement finger sleeve into the levitation sensing range of the display screen.

[0098] In some embodiments of this application, the third threshold can be set according to actual needs. The value range of the second threshold can be 30 to 50 mm.

[0099] In some embodiments of this application, when the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve are not obtained, a prompt message can be displayed to prompt the user to move the levitation sensing enhancement finger sleeve into the levitation sensing range of the display screen.

[0100] In some embodiments of this application, when the height component of the three-dimensional spatial coordinates of the obtained levitation sensing enhanced finger sleeve is greater than a second threshold, a prompt message can be displayed to prompt the user to move the levitation sensing enhanced finger sleeve into the levitation sensing range of the display screen.

[0101] In some embodiments of this application, the prompt information in these embodiments can be set according to actual needs.

[0102] For example, such as Figure 6 As shown, Figure 6 These are schematic diagrams illustrating the display of prompt information provided in some embodiments of this application. Figure 6 In the middle, the prompt message 601 is "Please bring your finger close to the phone screen".

[0103] In this embodiment of the application, the prompt information can guide the user to naturally lower their finger into the hover sensing range of the display screen without having to specifically control the distance between the hover sensing enhancement finger sleeve and the display screen. In this way, an indicator is displayed on the display screen of the electronic device to indicate the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the electronic device, so that the user can know the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the electronic device through the indicator.

[0104] In some embodiments of this application, before step 101, the display method performed by the first electronic device provided in the embodiments of this application may further include: in a first mode, acquiring the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve according to a first time interval; wherein, in the first mode, the first identifier moves with the levitation sensing enhancement finger sleeve.

[0105] In some embodiments of this application, the first mode in this application embodiment is a mode in which the first identifier follows the movement of the hover sensing enhanced finger sleeve; the first time interval can be set according to actual needs, for example, the first time interval is the duration of the touch sampling cycle of the first electronic device.

[0106] In this embodiment of the application, by marking the movement of the hover sensing enhancement finger sleeve, the user can promptly know the hovering area of ​​the hover sensing enhancement finger sleeve on the display screen of the first electronic device.

[0107] The display method provided in the embodiments of this application will be described below with reference to specific examples.

[0108] For example, when a user is playing a game on their phone while wearing a hover-sensing enhanced finger sleeve, the game interface can be projected onto a TV screen, allowing them to play the game by viewing the projected interface displayed on the TV. During gameplay, the user moves their finger in the space above the phone screen.

[0109] The mobile phone collects the 3D spatial coordinates of the hover-sensing enhanced finger sleeve in real time. When the 3D spatial coordinates of the hover-sensing enhanced finger sleeve are not collected, or when the height component of the collected 3D spatial coordinates of the hover-sensing enhanced finger sleeve is greater than 50mm, the following will be displayed: Figure 6 The displayed prompt message guides the user to move the hover-sensing enhanced finger sleeve within the hover-sensing range of the phone screen. This prompt message is then projected onto a TV. After viewing the prompt message on the TV, the user moves the hover-sensing enhanced finger sleeve into the hover-sensing range of the phone screen. When the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve are acquired, the projection position of the hover-sensing enhanced finger sleeve on the phone screen is determined based on these coordinates. The displacement of the hover-sensing enhanced finger sleeve within the delay time is determined based on the latency of the projection link between the phone and the TV, the speed and acceleration of the hover-sensing enhanced finger sleeve. Based on the projection position and displacement, the first identifier 401 is determined to be in the identifier display area 400 on the phone screen, and the first identifier 401 is displayed in this area. At this time, the first identifier 401 is displayed on the TV via projection. After viewing the first identifier 401 on the TV, the user can determine the hovering area of ​​the hover-sensing enhanced finger sleeve on the phone screen.

[0110] like Figure 5A and in Figure 5B As shown, in Figure 5A and in Figure 5BIn the game interface 500, there are jump controls 501, crouch controls 502, and prone controls 503. Based on the above determination, the distance from the center of the jump control 501 to the center of the indicator display area 400 is minimized, and this distance is less than the radius of the jump control 501. Furthermore, the height component of the three-dimensional spatial coordinates of the hover-sensing enhanced fingertip is also less than 50mm. The first indicator 401 is moved to the center of the control display area of ​​the jump control 501 and displayed as a black dot. The black dot-shaped first indicator 401 is displayed on a television screen via projection. Once the user sees the black dot on the television, they know that the system has locked the jump control 501. At this point, the user can touch the jump control 501 with their finger to control the character in the game to jump, completing one interaction.

[0111] Assuming the distance from the center of the jump control 501 to the center of the logo display area 400 is the smallest, but the distance from the center of the jump control 501 to the center of the logo display area 400 is greater than the radius of the jump control 501, the transparency and area of ​​the first logo are determined based on the height component of the three-dimensional spatial coordinates of the hover sensing enhancement finger sleeve, and the first logo is displayed with the determined transparency and area.

[0112] For example, when a user is editing an image on their phone while wearing a hover-sensing enhanced finger sleeve, the edited image is projected onto a TV screen, and the user edits the image by viewing the projected interface displayed on the TV. During the image editing process, the user moves their finger in the space above the phone screen.

[0113] The mobile phone collects the 3D spatial coordinates of the hover-sensing enhanced finger sleeve in real time. When the 3D spatial coordinates of the hover-sensing enhanced finger sleeve are not collected, or when the height component of the collected 3D spatial coordinates of the hover-sensing enhanced finger sleeve is greater than 50mm, the following will be displayed: Figure 6 The system displays a prompt message to guide the user to move the hover-sensing enhanced finger sleeve within the hover-sensing range of the phone screen. This prompt message is then projected onto a TV screen. After viewing the prompt message on the TV, the user moves the hover-sensing enhanced finger sleeve into the hover-sensing range of the phone screen. When the three-dimensional spatial coordinates of the hover-sensing enhanced finger sleeve are acquired, the projection position of the finger sleeve on the phone screen is determined based on these coordinates. The displacement of the finger sleeve within the delay time is determined based on the latency of the projection link between the phone and the TV, the speed and acceleration of the finger sleeve's movement. Based on the projection position and displacement, the first identifier 401 is determined to be located in the identifier display area 400 on the phone screen, and is displayed in this area. At this time, the first identifier 401 is displayed on the TV screen via projection. After viewing the first identifier 401 on the TV, the user can determine the hovering area of ​​the hover-sensing enhanced finger sleeve on the phone screen.

[0114] like Figure 7A and in Figure 7B As shown, in Figure 7A and in Figure 7B In the image editing interface 700, there are exposure controls 701, brightness controls 702, contrast controls 703, and saturation controls 704. Based on the above determination, the distance from the center of the brightness control 702 to the center of the indicator display area 400 is minimized, and the distance from the center of the brightness control 702 to the center of the indicator display area 400 is less than the radius of the brightness control 702. The height component of the three-dimensional spatial coordinates of the hover sensing enhanced finger sleeve is also less than 50mm. The first indicator 401 is moved to the center of the control display area of ​​the brightness control 702 and displayed as a black dot. The black dot first indicator 401 is displayed on the television via screen projection. After the user sees the black dot on the television, they know that the system has locked the brightness control 702. At this time, the user can touch the brightness control 702 with their finger to display the brightness adjustment interface, completing an interaction.

[0115] Assuming the distance from the center of the brightness control 702 to the center of the logo display area 400 is the smallest, but the distance from the center of the brightness control 702 to the center of the logo display area 400 is greater than the radius of the brightness control 702, the transparency and area of ​​the first logo are determined based on the height component of the three-dimensional spatial coordinates of the floating sensing enhancement finger sleeve, and the first logo is displayed with the determined transparency and area.

[0116] The display method provided in this application can be executed by a display device. This application uses a display device executing the display method as an example to illustrate the display device provided in this application.

[0117] Figure 8 This is a schematic diagram of the structure of a display device provided in some embodiments of this application. The display device 800 includes: The determination module 801 is used to determine the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the floating sensing enhanced finger sleeve when the first interface of the first electronic device is projected onto the second electronic device. Display module 802 is used to display a first identifier in the identifier display area; wherein the first identifier is used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen or a first control on the first interface.

[0118] In some embodiments of this application, the display device provided in the embodiments of this application further includes: The first acquisition module is used to acquire the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve according to a first time interval in a first mode; wherein, in the first mode, the first identifier moves with the levitation sensing enhanced finger sleeve.

[0119] In some embodiments of this application, the determining module 801 is specifically used for: Based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration, determine the identification display area on the screen of the first electronic device; Among them, the screen projection link delay is the delay of the link connecting the first electronic device and the second electronic device; the first speed is the moving speed of the hover sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hover sensing enhanced finger sleeve.

[0120] In some embodiments of this application, the determining module 801 is specifically used for: Determine the projection position of the levitation sensing enhancement finger sleeve on the display screen based on the three-dimensional spatial coordinates; The first displacement of the levitation sensing enhanced finger sleeve is determined based on the projection link delay, the first velocity, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhanced finger sleeve on the display screen. Based on the projection position and the first displacement, the identification display area on the display screen of the first electronic device is determined.

[0121] In some embodiments of this application, the display screen includes N controls; N is an integer greater than 1; the display device provided in the embodiments of this application further includes: The second acquisition module is used to obtain the distance between the center of each of the N controls and the center of the identifier display area, and obtain N distance values; Accordingly, the display module 802 is also used for: If the minimum distance value among N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold, a first identifier is displayed in the control display area of ​​the first control; wherein, the first radius is the radius of the first control corresponding to the minimum distance value.

[0122] In some embodiments of this application, the display module 802 is specifically used for: The first identifier is moved to the center of the control display area of ​​the first control and displayed in a first display mode.

[0123] In some embodiments of this application, the determining module 801 is further configured to: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, the second display mode of the first identifier is determined based on the height component. Accordingly, the display module 802 is specifically used for: In the signage display area, the first signage is displayed in the second display mode; In the second display mode, the transparency of the first icon decreases as the height component increases and increases as the height component decreases; the size of the first icon increases as the height component increases and decreases as the height component decreases; when the size of the first icon decreases to a second threshold, it no longer decreases as the height component decreases.

[0124] In some embodiments of this application, the display device provided in the embodiments of this application further includes: The receiving module is used to receive touch input from the hover-sensing enhanced finger sleeve to the first control; The execution module is used to respond to touch input and perform the first processing corresponding to the first control.

[0125] In some embodiments of this application, the display module 802 is further configured to: If no three-dimensional spatial coordinates are obtained or the height component of the three-dimensional spatial coordinates is greater than the third threshold, a prompt message will be displayed; the prompt message is used to prompt the user to move the hover sensing enhancement finger sleeve into the hover sensing range of the display screen.

[0126] The display device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0127] The display device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0128] The display device provided in this application embodiment can achieve... Figures 1 to 7BThe various processes implemented in the display method embodiment will not be described again here to avoid repetition.

[0129] Optionally, such as Figure 9 As shown, this application embodiment also provides an electronic device 900, including a processor 901 and a memory 902. The memory 902 stores a program or instructions that can run on the processor 901. When the program or instructions are executed by the processor 901, they implement the various steps of the display method embodiment provided in this application embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0130] Figure 10 These are schematic diagrams of the hardware structure of electronic devices according to some embodiments of this application.

[0131] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

[0132] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0133] The processor 1010 is used to: determine the identification display area on the display screen of the electronic device 1000 based on the three-dimensional spatial coordinates of the floating sensing enhanced finger sleeve when the first interface of the electronic device 1000 is projected onto the second electronic device. The display unit 1006 is used to display a first identifier in the identifier display area; wherein the first identifier is used to indicate the hovering area of ​​the hover sensing enhancement finger on the display screen or a first control on the first interface.

[0134] In some embodiments of this application, the processor 1010 is further configured to: in a first mode, acquire the three-dimensional spatial coordinates of the levitation sensing enhancement finger sleeve according to a first time interval; wherein, in the first mode, the first identifier moves with the levitation sensing enhancement finger sleeve.

[0135] In some embodiments of this application, the processor 1010 is specifically used for: Based on the three-dimensional spatial coordinates, the projection link delay duration, the first velocity, and the first acceleration, the identification display area on the display screen of the electronic device 1000 is determined; wherein, the projection link delay duration is the delay duration of the projection connection link between the electronic device 1000 and the second electronic device; the first velocity is the moving speed of the hovering sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hovering sensing enhanced finger sleeve.

[0136] In some embodiments of this application, the processor 1010 is specifically used for: Determine the projection position of the levitation sensing enhancement finger sleeve on the display screen based on the three-dimensional spatial coordinates; The first displacement of the levitation sensing enhanced finger sleeve is determined based on the projection link delay, the first velocity, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhanced finger sleeve on the display screen. Based on the projection position and the first displacement, the marking display area on the display screen of the electronic device 1000 is determined.

[0137] In some embodiments of this application, the display screen includes N controls; N is an integer greater than 1; the processor 1010 is further configured to: obtain the distance between the center of each of the N controls and the center of the identification display area, and obtain N distance values; Accordingly, the display unit 1006 is further configured to: display a first identifier in the control display area of ​​the first control when the minimum distance value among the N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold; wherein the first radius is the radius of the first control corresponding to the minimum distance value.

[0138] In some embodiments of this application, the processor 1010 is further configured to: control the first identifier to move to the center position of the control display area of ​​the first control; Accordingly, the display unit 1006 is specifically used to: display the first identifier in a first display mode.

[0139] In some embodiments of this application, the processor 1010 is also used for: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, the second display mode of the first identifier is determined based on the height component. Accordingly, the display unit 1006 is specifically used for: In the signage display area, the first signage is displayed in the second display mode; In the second display mode, the transparency of the first icon decreases as the height component increases and increases as the height component decreases; the size of the first icon increases as the height component increases and decreases as the height component decreases; when the size of the first icon decreases to a second threshold, it no longer decreases as the height component decreases.

[0140] In some embodiments of this application, the processor 1010 is further configured to: receive touch input from the hover-sensing enhanced finger sleeve to the first control; and, in response to the touch input, perform a first process corresponding to the first control.

[0141] In some embodiments of this application, the display unit 1006 is further configured to: If no three-dimensional spatial coordinates are obtained or the height component of the three-dimensional spatial coordinates is greater than the third threshold, a prompt message will be displayed; the prompt message is used to prompt the user to move the hover sensing enhancement finger sleeve into the hover sensing range of the display screen.

[0142] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here.

[0143] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0144] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0145] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the display method embodiment provided in this application and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0146] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0147] This application also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the display method embodiments provided in this application, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0148] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0149] This application also provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the display method embodiment provided in this application, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0150] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0151] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the display methods provided in the various embodiments of this application.

[0152] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A display method, performed by a first electronic device, characterized in that, The method includes: When the first interface of the first electronic device is projected onto the second electronic device, the identification display area on the display screen of the first electronic device is determined based on the three-dimensional spatial coordinates of the floating sensing enhanced finger sleeve. In the identification display area, a first identification is displayed; wherein the first identification is used to indicate the hovering area of ​​the hovering sensor enhancement finger on the display screen or the first control on the first interface.

2. The method according to claim 1, characterized in that, Before determining the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve, the method further includes: In the first mode, the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve are acquired according to a first time interval; In the first mode, the first identifier moves along with the levitation sensing enhanced finger sleeve.

3. The method according to claim 1, characterized in that, The determination of the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve includes: Based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration, the identification display area on the display screen of the first electronic device is determined; Wherein, the screen projection link delay duration is the delay duration of the screen projection connection link between the first electronic device and the second electronic device; the first speed is the moving speed of the hovering sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hovering sensing enhanced finger sleeve.

4. The method according to claim 1, characterized in that, The step of determining the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration includes: Based on the three-dimensional spatial coordinates, determine the projection position of the levitation sensing enhancement fingertip on the display screen; The first displacement of the levitation sensing enhancement finger sleeve is determined based on the projection link delay, the first speed, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhancement finger sleeve onto the display screen; Based on the projection position and the first displacement, the identification display area on the display screen of the first electronic device is determined.

5. The method according to claim 1, characterized in that, The display screen includes N controls; N is an integer greater than 1; the method further includes: Obtain the distance between the center of each of the N controls and the center of the identifier display area to obtain N distance values; If the minimum distance value among the N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold, the first identifier is displayed in the control display area of ​​the first control. Wherein, the first radius is the radius of the first control corresponding to the minimum distance value.

6. The method according to claim 5, characterized in that, The first identifier is displayed in the control display area of ​​the first control, including: The first identifier is moved to the center of the control display area of ​​the first control and displayed in a first display mode.

7. The method according to claim 5, characterized in that, The method further includes: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, a second display mode for the first identifier is determined based on the height component. Displaying the first identifier in the identifier display area includes: In the identification display area, the first identification is displayed in the second display mode; In the second display mode, the transparency of the first identifier decreases as the height component increases and increases as the height component decreases; the size of the first identifier increases as the height component increases and decreases as the height component decreases; when the size of the first identifier decreases to a second threshold, it no longer decreases as the height component decreases.

8. The method according to claim 5, characterized in that, After displaying the first identifier in the control display area of ​​the first control, the method further includes: Receive touch input from the floating sensing enhanced finger sleeve to the first control; In response to the touch input, a first process corresponding to the first control is executed.

9. The method according to claim 1, characterized in that, The method further includes: If the three-dimensional spatial coordinates are not obtained or the height component of the three-dimensional spatial coordinates is greater than the third threshold, a prompt message will be displayed. The prompt message is used to prompt the user to move the levitation sensing enhancement finger sleeve into the levitation sensing range of the display screen.

10. A display device, characterized in that, The device includes: The determination module is used to determine the identification display area on the display screen of the first electronic device based on the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve when the first interface of the first electronic device is projected onto the second electronic device. The display module is used to display a first identifier in the identifier display area; wherein the first identifier is used to indicate the hovering area of ​​the hovering sensor enhancement finger on the display screen or a first control on the first interface.

11. The apparatus according to claim 10, characterized in that, The device further includes: The first acquisition module is used to acquire the three-dimensional spatial coordinates of the levitation sensing enhanced finger sleeve according to a first time interval in a first mode; In the first mode, the first identifier moves along with the levitation sensing enhanced finger sleeve.

12. The apparatus according to claim 10, characterized in that, The determining module is specifically used for: Based on the three-dimensional spatial coordinates, the projection link delay, the first velocity, and the first acceleration, the identification display area on the display screen of the first electronic device is determined; Wherein, the screen projection link delay duration is the delay duration of the screen projection connection link between the first electronic device and the second electronic device; the first speed is the moving speed of the hovering sensing enhanced finger sleeve; and the first acceleration is the moving acceleration of the hovering sensing enhanced finger sleeve.

13. The apparatus according to claim 12, characterized in that, The determining module is specifically used for: Based on the three-dimensional spatial coordinates, determine the projection position of the levitation sensing enhancement fingertip on the display screen; The first displacement of the levitation sensing enhancement finger sleeve is determined based on the projection link delay, the first speed, and the first acceleration; wherein, the first displacement is the displacement of the projection of the levitation sensing enhancement finger sleeve onto the display screen; Based on the projection position and the first displacement, the identification display area on the display screen of the first electronic device is determined.

14. The apparatus according to claim 10, characterized in that, The display screen includes N controls; N is an integer greater than 1; the device also includes: The second acquisition module is used to acquire the distance between the center of each of the N controls and the center of the identifier display area, and obtain N distance values; The display module is also used for: If the minimum distance value among the N distance values ​​is less than or equal to the first radius and the height component of the three-dimensional spatial coordinates is less than or equal to the first threshold, the first identifier is displayed in the control display area of ​​the first control. Wherein, the first radius is the radius of the first control corresponding to the minimum distance value.

15. The apparatus according to claim 14, characterized in that, The display module is specifically used for: The first identifier is moved to the center of the control display area of ​​the first control and displayed in a first display mode.

16. The apparatus according to claim 14, characterized in that, The determining module is also used for: If the minimum distance value is greater than the first radius or the height component is greater than the first threshold, a second display mode for the first identifier is determined based on the height component. The display module is specifically used for: In the identification display area, the first identification is displayed in the second display mode; In the second display mode, the transparency of the first identifier decreases as the height component increases and increases as the height component decreases; the size of the first identifier increases as the height component increases and decreases as the height component decreases; when the size of the first identifier decreases to a second threshold, it no longer decreases as the height component decreases.

17. The apparatus according to claim 14, characterized in that, The device further includes: A receiving module is used to receive touch input from the levitation sensing enhanced finger sleeve to the first control; An execution module is used to respond to the touch input and perform a first process corresponding to the first control.

18. The apparatus according to claim 10, characterized in that, The display module is also used for: If the three-dimensional spatial coordinates are not obtained or the height component of the three-dimensional spatial coordinates is greater than the third threshold, a prompt message will be displayed. The prompt message is used to prompt the user to move the levitation sensing enhancement finger sleeve into the levitation sensing range of the display screen.

19. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing programs or instructions that can run on the processor, the programs or instructions being executed by the processor to implement the steps of the display method as described in any one of claims 1-9.