Interface display method and electronic device

Abstract

The present application provides an interface display method and electronic device. In this method, when the electronic device receives a first operation, it activates a one-handed operation mode in response to the first operation. In the one-handed operation mode, the electronic device can obtain first viewpoint coordinates and finger coordinates, as well as first display content within a first display area corresponding to the first viewpoint coordinates, and display the first display content within a second display area corresponding to the finger coordinates. In this way, a user can operate any content in the operation interface with one hand, effectively improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an interface display method and electronic equipment. Background Art

[0002] With the advancement of terminal technology, the functions of electronic devices are gradually improved. To meet people's visual experience, electronic devices are usually equipped with larger screens. However, when users operate large-screen electronic devices with one hand, the user experience is poor due to the limitation of the user's finger length.

[0003] Some electronic devices provide a one-handed operation mode, but due to the limitations of the screen width of the electronic device and the length of the user's fingers, the user still needs to use multiple fingers together (for example, if the user wants to click the application icon on the far right of the phone screen with his left hand, he needs to span the entire width of the screen), and the user experience is still poor.

[0004] Therefore, how to provide a convenient one-handed operation mode is an urgent problem to be solved. Summary of the Invention

[0005] The present application provides an interface display method and an electronic device to solve the problem of user operation inconvenience in the existing one-handed operation mode.

[0006] In a first aspect, an interface display method is provided, which can be executed by an electronic device, and the method includes: receiving a first operation; starting a one-handed operation mode in response to the first operation; in the one-handed operation mode, obtaining first viewpoint coordinates and finger coordinates; obtaining first display content in a first display area corresponding to the first viewpoint coordinates, and displaying the first display content in a second display area corresponding to the finger coordinates.

[0007] In the above technical solution, when the electronic device receives the first operation, it activates the one-handed operation mode in response to the first operation. In the one-handed operation mode, the electronic device can obtain the first viewpoint coordinates and the finger coordinates, as well as the first display content in the first display area corresponding to the first viewpoint coordinates, and display the first display content in the second display area corresponding to the finger coordinates. In this way, the user can effectively operate any content in the display interface with one hand, thereby effectively improving the user experience.

[0008] In order to improve the flexibility of the solution, in an embodiment of the present application, the first operation may be that the electronic device is lifted or shaken; or, a click operation or a sliding operation on the display screen of the electronic device; or, a voice command; or, an operation on a hardware button of the electronic device.

[0009] It should be noted that, in the embodiments of the present application, the above-mentioned embodiments are only several specific implementation methods of the first operation. In addition, in the embodiments of the present application, the first operation can also be implemented in other ways, and the embodiments of the present application do not limit this.

[0010] In one possible design, after the electronic device displays the first display content in the second display area corresponding to the finger coordinates, the electronic device can also receive a first sliding operation in the second display area, and determine the second display content based on the first sliding operation, and switch the display content in the second display area from the first display content to the second display content.

[0011] In the above technical solution, after the electronic device displays the first display content in the second display area corresponding to the finger coordinates, if the electronic device detects a sliding operation on the second display area, it can update the display content of the second display area, effectively meeting the user's operation needs, and thereby making the display of the user interface more intelligent.

[0012] In one possible design, after the electronic device displays the first display content in the second display area corresponding to the finger coordinates, it can also obtain the second viewpoint coordinates and the third display content in the third display area corresponding to the second viewpoint coordinates, and switch the display content in the second display area from the first display content to the third display content.

[0013] In the above technical solution, after the electronic device displays the first display content in the second display area corresponding to the finger coordinates, if the electronic device can also monitor the changes in the viewpoint coordinates in real time, for example, when the electronic device detects that the first viewpoint coordinates change to the second viewpoint coordinates, the electronic device can obtain the third display content in the third display area corresponding to the second viewpoint coordinates and switch the display content in the second display area from the first display content to the third display content. In this way, the user's operation needs are effectively met, thereby effectively improving the intelligence of the user operation interface.

[0014] In one possible design, before the electronic device displays the first display content in the second display area corresponding to the finger coordinates, it also needs to determine whether there is an application icon or control icon at the first position corresponding to the finger coordinates in the second display area; if so, the first display content is displayed at the second position in the second display area; the second position is a first preset value away from the first position; if not, the first display content is displayed at the first position.

[0015] In the above technical solution, before displaying the first display content in the second display area corresponding to the finger coordinates, the electronic device determines whether there is an application icon or a control icon in the first position corresponding to the finger coordinates. If there is an application icon or a control icon in the first position, the first display content is displayed in the second display area at a second position that is a first preset distance away from the first position; if not, the first display content is displayed at the first position. This effectively prevents the first display content from overlapping other control icons in the second display area, causing inconvenience to the user, thereby effectively improving the user experience.

[0016] In one possible design, before the electronic device displays the first display content in the second display area corresponding to the finger, the electronic device may also determine that the time the user's line of sight stays at the first viewpoint coordinate exceeds a second preset threshold.

[0017] In the above technical solution, the electronic device displays the first display content in the second display area corresponding to the finger only after determining that the user's gaze remains on the first viewpoint coordinate for a period exceeding a second preset threshold. This effectively avoids misoperation, thereby effectively improving the accuracy of the user interface display and effectively enhancing the user experience.

[0018] In a possible design, the electronic device may also receive a click operation on at least one target icon in the first display content, determine the first target icon, and execute an application process corresponding to the first target icon.

[0019] In the above technical solution, if the electronic device detects a click operation on at least one target icon in the first display content, it can determine the first target icon that the user wants to operate, and then start the application process corresponding to the first target icon, effectively improving the interaction efficiency between the electronic device and the user, and thus effectively improving the user experience.

[0020] In one possible design, the electronic device obtains the first viewpoint coordinates in response to the first operation by: determining the first distance between the user's eyes and the infrared camera, as well as the corneal reflection spot coordinates and the pupil center coordinates; and determining the first viewpoint coordinates based on the first distance, the corneal reflection spot coordinates and the pupil center coordinates.

[0021] In the above technical solution, the electronic device determines the first viewpoint coordinates based on the first distance between the user's eye and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center. This effectively improves the interaction efficiency between the electronic device and the user, thereby effectively improving the user experience.

[0022] In one possible design, the electronic device obtains the coordinates of the finger in response to the first operation. The specific method may be: determining a second distance between the finger and an infrared light sensor in the electronic device, a third distance between the finger and a display screen of the electronic device, and the orientation of the finger relative to the infrared light sensor; based on the second distance and the third distance, determining a fourth distance between the projection point of the finger on the display screen and the infrared light sensor; and determining the finger coordinates based on the fourth distance and the orientation.

[0023] In the above technical solution, the electronic device determines the finger coordinates based on the fourth distance between the finger's projection on the display screen and the infrared light sensor, and the finger's orientation relative to the infrared light sensor. This effectively improves the interaction efficiency between the electronic device and the user, thereby effectively enhancing the user experience.

[0024] According to a second aspect, an electronic device is provided, comprising a module for executing the method according to the first aspect.

[0025] As an example, the electronic device may include: a processor and a memory; wherein the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are executed by the processor, the electronic device performs the following steps:

[0026] Receive a first operation; in response to the first operation, start a one-handed operation mode; in the one-handed operation mode, obtain first viewpoint coordinates and finger coordinates; obtain first display content in a first display area corresponding to the first viewpoint coordinates, and display the first display content in a second display area corresponding to the finger coordinates.

[0027] Optionally, the memory is located outside the electronic device.

[0028] Optionally, the electronic device includes a memory connected to at least one processor, and the memory stores instructions that can be executed by the at least one processor.

[0029] In one possible design, the electronic device also includes a display screen, and the first operation is: the electronic device is lifted or shaken; or, a click operation or a sliding operation on the display screen; or, a voice command; or, an operation on a hardware button of the electronic device.

[0030] In one possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device also performs the following steps: receiving a first sliding operation in the second display area; determining the second display content based on the first sliding operation, and switching the display content in the second display area from the first display content to the second display content.

[0031] In one possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device also performs the following steps: obtaining the second viewpoint coordinates and the third display content in the third display area corresponding to the second viewpoint coordinates, and switching the display content in the second display area from the first display content to the third display content.

[0032] In one possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device also performs the following steps: determining whether there is an application icon or control icon at the first position corresponding to the finger coordinates in the second display area; if so, displaying the first display content at the second position in the second display area; the second position is a first preset value away from the first position; if not, displaying the first display content at the first position.

[0033] In one possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device is also caused to perform the following steps: determining whether the time duration that the user's line of sight stays at the first viewpoint coordinate exceeds a second time threshold.

[0034] In one possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device also performs the following steps: receiving a click operation on at least one target icon in the first display content, determining the first target icon, and executing the application process corresponding to the first target icon.

[0035] In one possible design, the electronic device also includes an infrared camera. When one or more computer programs stored in the memory are executed by the processor, the electronic device also performs the following steps: determining a first distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center; and determining the first viewpoint coordinates based on the first distance, the coordinates of the corneal reflection spot, and the coordinates of the pupil center.

[0036] In one possible design, the electronic device also includes an infrared light sensor. When one or more computer programs stored in the memory are executed by the processor, the electronic device is also caused to perform the following steps: determining a second distance between the finger and the infrared light sensor in the electronic device, a third distance between the finger and the display screen of the electronic device, and the orientation of the finger relative to the infrared light sensor; determining a fourth distance between the projection point of the finger on the display screen and the infrared light sensor based on the second distance and the third distance; and determining the coordinates of the finger based on the fourth distance and the orientation.

[0037] These electronic devices can perform the corresponding functions in the method examples in the above-mentioned first aspect or any possible design of the first aspect. Please refer to the detailed description in the method examples for details, which will not be repeated here.

[0038] In a third aspect, a computer-readable medium is provided, which stores a program code for execution by a device. When the program code is executed by the device, the method in the above-mentioned first aspect or any possible design of the first aspect will be executed.

[0039] In a fourth aspect, a computer program comprising instructions is provided, which, when executed on a computer, enables the method in the first aspect or any possible design of the first aspect to be executed.

[0040] In a fifth aspect, a chip is provided, comprising a processor and a data interface, wherein the processor is used to read and execute instructions stored in a memory through the data interface, so that the method in the first aspect or any possible design of the first aspect is executed.

[0041] In one possible design, the chip may further include the memory, in which the instructions are stored.

[0042] The technical effects that can be achieved by the various design schemes in any of the third to fifth aspects mentioned above can be referred to the technical effects that can be achieved by the methods in the first aspect mentioned above or any possible design of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1A A scene diagram for a user to operate an electronic device with one hand;

[0044] Figure 1B A schematic diagram of a mobile phone user graphical interface provided in this application;

[0045] Figure 1C A schematic diagram of a mobile phone user graphical interface provided in this application;

[0046] Figure 2A A schematic diagram of the hardware structure of a mobile phone 100 provided in one embodiment of the present application;

[0047] Figure 2B A schematic diagram of the software structure of the mobile phone 100 provided in one embodiment of the present application;

[0048] Figure 3 A flowchart of an interface display method provided in one embodiment of the present application;

[0049] Figure 4A This is one of the operation diagrams of the mobile phone 100 entering the one-handed operation mode provided by an embodiment of the present application;

[0050] Figure 4B This is a second operational diagram of the mobile phone 100 entering the one-handed operation mode according to an embodiment of the present application;

[0051] Figure 4C This is a third operational diagram of the mobile phone 100 entering the one-handed operation mode according to an embodiment of the present application;

[0052] Figure 4D This is a third operational diagram of the mobile phone 100 entering the one-handed operation mode according to an embodiment of the present application;

[0053] Figure 5 A schematic diagram of a possible process for determining the coordinates of a user's viewpoint provided in an embodiment of the present application;

[0054] Figure 6A This is one of the schematic diagrams of obtaining viewpoint coordinates of the mobile phone 100 provided in one embodiment of the present application;

[0055] Figure 6B This is a second schematic diagram of obtaining viewpoint coordinates of the mobile phone 100 provided in an embodiment of the present application;

[0056] Figure 6C A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0057] Figure 7 A schematic diagram of a possible process for determining the coordinates of a user's finger provided in an embodiment of the present application;

[0058] Figure 8A A schematic diagram of obtaining finger coordinates of a mobile phone 100 provided in one embodiment of the present application;

[0059] Figure 8B A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0060] Figure 9A A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0061] Figure 9B A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0062] Figure 10 A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0063] Figure 11 A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0064] Figure 12A A schematic diagram of a possible game interface provided in one embodiment of the present application;

[0065] Figure 12BA schematic diagram of another possible game interface provided in an embodiment of the present application;

[0066] Figure 13 A schematic diagram of a user graphical interface of a mobile phone 100 provided in one embodiment of the present application;

[0067] Figure 14 A schematic diagram of a user graphical interface for implementing one-handed operation on multiple devices provided by an embodiment of the present application;

[0068] Figure 15 A schematic structural diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0069] Figure 1A , which shows a scene diagram of a user operating an electronic device with one hand, wherein the electronic device is a mobile phone as an example. Figure 1A The electronic device 101 displays multiple application (APP) icons on the graphical user interface (GUI) of the electronic device. When the user holds the electronic device with one hand, if the user needs to control an area far from the finger currently used for operation (for example, Figure 1A As shown in the figure, the APP1 icon above the operation interface 101 is not able to be operated due to the limitation of the length of the user's fingers, resulting in a poor user experience.

[0070] In order to enable users to operate electronic devices more conveniently with one hand, some electronic devices may provide a one-handed operation mode.

[0071] For a specific example, see Figure 1B ,exist Figure 1B In the embodiment, after the electronic device detects the sliding operation from top to bottom on the screen, it determines to start the one-hand mode in response to the operation, shrinks the operation interface 101 as a whole, and displays it in the display area close to the operation position (i.e., the user's finger), and obtains Figure 1B The operation interface 102 shown. In this display mode, the reduction ratio of the operation interface 102 set by the electronic device relative to the operation interface 101 is fixed. If the electronic device screen is large or the user's fingers are short, the user still has the problem of inconvenience in single-handed operation.

[0072] For another specific example, see Figure 1CWhen the electronic device detects two consecutive click operations on the start key of the electronic device within a preset time, the electronic device's operation interface 101 is moved down to the bottom of the electronic device's display screen to display the operation interface 103. However, this method only shrinks the operation interface 101 vertically, and does not shrink the operation interface 101 horizontally. It is still difficult for the user to operate the area that is far away from the user's finger horizontally. For example, Figure 1C In the example, the user holds the electronic device in his right hand, and the thumb of his right hand cannot touch the area where the APP1 icon is located, so the user experience is still poor.

[0073] In view of this, an embodiment of the present application provides an interface display method. After the electronic device detects a first operation, it enters a one-handed operation mode. In the one-handed operation mode, the electronic device obtains the finger coordinates and the first viewpoint coordinates, and displays the first display content in the first display area corresponding to the first viewpoint coordinates in the second display area corresponding to the finger coordinates (i.e., the operable range of the finger). In this way, the user only needs to control the viewpoint position to operate the application icon or control icon located at any position in the operation interface in the same area with one hand, thereby improving the user experience. The specific implementation method of this technical solution will be described in detail later.

[0074] First, some of the terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0075] The application (app) involved in the embodiments of the present application is a software program that can realize one or more specific functions. Generally, multiple applications can be installed in an electronic device. For example, a camera application, a gallery application, a text messaging application, a multimedia messaging application, various mailbox applications, WeChat, Tencent chat software (QQ), WhatsApp Messenger, Line, photo sharing (Instagram), Kakao Talk, DingTalk, etc. The application mentioned below can be an application installed when the terminal leaves the factory, or it can be an application downloaded by the user from the Internet or obtained from other terminals during the use of the electronic device.

[0076] The operation interface involved in the embodiments of the present application may also be called a user interface (UI) or a graphical interface, or other names. The operation interface is an interface for human-computer interaction between an electronic device and a user. The electronic device can output information to the user through the operation interface, such as displaying images or text, and can also receive user operations through the operation interface, such as receiving user touch operations. For example, Figure 1A Operation interface 101 in, or Figure 1B The operation interface 102 in the Figure 1C The operation interface 103 in the Figure 9Aor Figure 9B Operation interface 901 in, or Figure 10 Operation interface 1001 in, or Figure 11 The operation interface 1101 and the like are all operation interfaces.

[0077] The application icons involved in the embodiments of the present application are graphics with clear reference meanings, which clearly refer to an application. The application icons can be displayed on the desktop (or home screen interface) of the electronic device. When the electronic device detects a click operation on these application icons, it can run the corresponding application and start the corresponding application process. For example, if Figure 1A The APP1 icon in the image is the application icon of WeChat. When the mobile phone detects a click operation on the APP1 icon, it runs WeChat and starts WeChat.

[0078] The control icon (hereinafter referred to as control) involved in the embodiment of the present application can be an icon in the interface of an application for realizing a specific function of the application. When the electronic device detects a click operation on the control icon, it can start the corresponding sub-process of the application. For example, Figure 12A When the game application is started, the mobile phone detects a click or long press operation on the control ① in the game application operation interface, which can start the process of controlling the forward direction of the game character in the game application.

[0079] The one-handed operation mode involved in the embodiment of the present application is an interface display mode set to facilitate the user to operate any icon in the display interface with one hand. In this interface display mode, the electronic device can display the display content in the display area corresponding to the user's viewpoint coordinates in the display area corresponding to the user's finger coordinates. For example, Figure 9A The APP8 icon corresponding to the viewpoint coordinates is displayed in the display area corresponding to the finger coordinates, that is, Figure 9A The operation interface 901 is shown in (b).

[0080] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0081] The multiple involved in the embodiments of the present application refers to greater than or equal to two. It should be noted that the term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally indicates that the previous and next associated objects are in an "or" relationship. And in the description of the embodiments of the present application, words such as "first" and "second" are only used to distinguish the purpose of description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.

[0082] The following describes an electronic device for executing the interface display method provided in an embodiment of the present application, a graphical user interface (GUI) for such an electronic device, and an embodiment for using such an electronic device. In some embodiments of the present application, the electronic device may be a portable terminal including a display screen, such as a mobile phone, a tablet computer, etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a digital camera. It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable electronic device, but a desktop computer with a display screen.

[0083] Typically, electronic devices can support multiple applications. For example, one or more of the following applications: communication applications, instant messaging applications, game applications, etc. Among them, there can be multiple instant messaging applications. For example, WeChat (Wechat), Weibo, Tencent Chat Software (QQ), WhatsApp Messenger, Line, photo sharing (Instagram), Kakao Talk, DingTalk, etc. Users can use instant messaging applications to send information such as text, voice, pictures, video files, and various other files to other contacts (or other contacts); or users can use instant messaging applications to make video or audio calls with other contacts.

[0084] The following takes the mobile phone as an example. Figure 2A FIG. 1 shows a schematic structural diagram of the mobile phone 100 .

[0085] The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an orientation sensor 180C, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a touch sensor 180K, a bone conduction sensor 180M, and the like.

[0086] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0087] The controller may be the nerve center and command center of the mobile phone 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0088] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0089] The processor 110 can run the software code of the interface display method provided in the embodiment of the present application to realize the one-handed operation mode of the mobile phone 100.

[0090] The USB interface 130 is an interface that complies with USB standards, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the mobile phone 100, and may also be used to transmit data between the mobile phone 100 and peripheral devices.

[0091] The charging management module 140 is configured to receive charging input from a charger. The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.

[0092] The wireless communication function of the mobile phone 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0093] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the mobile phone 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0095] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0096] In some embodiments, the antenna 1 of the mobile phone 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile phone 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0097] Mobile phone 100 implements display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0098] The display screen 194 is used to display images, videos, application icons, control icons, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the mobile phone 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. Exemplarily, the display screen 194 can be used to display the operation interface provided in the embodiment of the present application (for example Figure 9A The operation interface 901 shown in FIG. 9A , and the application icons or control icons in the operation interface.

[0099] Camera 193 is used to capture still images or videos. Camera 193 may include a front-facing camera and a rear-facing camera. For example, camera 193 may be used to capture an image of a user's face. Alternatively, the front-facing camera may be an infrared camera that can capture infrared light reflected from the user's eyes and generate a depth image of the eyes.

[0100] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application (such as a game application, WeChat application, etc.). The data storage area can store data (such as images, videos, etc.) generated during the use of the mobile phone 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0101] The internal memory 121 can also store the software code of the interface display method provided in the embodiment of the present application. When the processor 110 runs the software code, the process steps of the interface display method are executed to realize the one-handed operation mode.

[0102] The internal memory 121 can also store information generated or received by the electronic device during operation, such as user-defined shortcut gesture information for entering one-handed operation mode, face images, viewpoint coordinates, finger coordinates, fingerprint information, etc.

[0103] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0104] Of course, the software code of the interface display method provided in the embodiment of the present application can also be stored in an external memory, and the processor 110 can run the software code through the external memory interface 120 to execute the process steps of the interface display method to achieve a one-handed operation mode. The user's facial information, viewpoint coordinates, finger coordinates, etc. collected by the mobile phone 100 can also be stored in an external memory.

[0105] The mobile phone 100 can implement audio functions such as answering calls and recording audio through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0106] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. In some embodiments, the mobile phone 100 can detect click operations on the display screen 194 or on application icons in the operation interface displayed on the display screen 194 through the pressure sensor 180A. In other embodiments, the pressure sensor 180A can be used to detect shortcut gestures determined by sliding operations on the display screen 194, for example, Figure 4B The shortcut gesture letters "Z" and "C" in the .

[0107] The gyroscope sensor 180B can be used to determine the motion posture of the mobile phone 100. In some embodiments, the gyroscope sensor 180B can be used to determine the angular velocity of the mobile phone 100 around three axes (ie, x, y, and z axes) to determine whether the mobile phone 100 is lifted.

[0108] The direction sensor 180C can detect the absolute posture value of the mobile phone 100 and further determine the angle change of the mobile phone 100.

[0109] Accelerometer 180E can detect the magnitude of the phone 100's acceleration in all directions (generally three axes). When the phone 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers. In some possible embodiments, it can also be used in conjunction with orientation sensor 180C to detect whether the phone 100 is lifted.

[0110] Distance sensor 180F is used to measure distance. Mobile phone 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, mobile phone 100 can use distance sensor 180F to measure distance to achieve fast focus.

[0111] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The mobile phone 100 emits infrared light outward through the light emitting diode. The mobile phone 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone 100. When insufficient reflected light is detected, the mobile phone 100 can determine that there is no object near the mobile phone 100. The mobile phone 100 can use the proximity light sensor 180G to detect when the user holds the mobile phone 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0112] Optionally, when the proximity light sensor 180G is an infrared light sensor, the distance between the user's eyes and the screen 194 and the coordinates of the user's finger relative to the display screen 194 can also be obtained through an infrared light emitting diode.

[0113] The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc. In one possible embodiment, the size of the fingerprint sensor 180H can be the same as the display screen 194. After the mobile phone 100 obtains the coordinates of the user's finger, the display screen 194 displays the fingerprint unlocking pattern in the display area corresponding to the finger coordinates. The mobile phone 100 detects a click operation on the fingerprint unlocking pattern and activates the fingerprint sensor 180H. The fingerprint sensor 180H begins to collect the user's fingerprint information. The fingerprint sensor 180H sends the collected fingerprint information to the processor 100. The processor 100 matches the fingerprint information with the user's fingerprint information stored in the internal memory 121. If the match is successful, the unlocked application process is started. If the match is unsuccessful, the lock screen mode is maintained.

[0114] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the mobile phone 100, at a different position from the display screen 194. For example, the touch sensor 180K detects a touch action on the display screen 194 and can determine the coordinates of the user's finger.

[0115] Bone conduction sensor 180M can acquire vibration signals. In some embodiments, bone conduction sensor 180M can acquire vibration signals from vibrating bones in the human body. Bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.

[0116] Keys 190 include a power button, a volume button, and the like. Keys 190 may be mechanical keys or touch-sensitive keys. Mobile phone 100 may receive key inputs and generate key signal inputs related to user settings and function control of mobile phone 100. In one possible embodiment, if mobile phone 100 detects multiple clicks on keys 190 within a preset time period, it activates one-handed operation mode for mobile phone 100.

[0117] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or touch vibration feedback. For example, touch operations on different applications (such as answering a call, playing audio, etc.) can correspond to different vibration feedback effects.

[0118] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0119] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the mobile phone 100 by inserting or removing the SIM card into or from the SIM card interface 195.

[0120] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0121] The above introduces the hardware structure of the mobile phone 100. The following introduces the software architecture of the mobile phone 100.

[0122] Specifically, the software system of the mobile phone 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The present application embodiment uses the layered Android system as an example to illustrate the software structure of the mobile phone 100. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.

[0123] See Figure 2B In some possible embodiments, the Android system is divided into four layers, namely, from top to bottom, the application layer (hereinafter referred to as the "application layer"), the application framework layer (hereinafter referred to as the "framework layer"), the Android runtime and system library layer (hereinafter referred to as the "system runtime library layer"), and the kernel layer.

[0124] The application layer runs at least one application, which may be a window program, a system settings program, a contact program, a text messaging program, a clock program, a camera application, etc. provided by the operating system; or an application developed by a third-party developer, such as an instant messaging program, a photo beautification program, a game program, etc. Of course, in a specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which is not limited in the present embodiment.

[0125] The framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes predefined functions and acts as a processing center, determining the actions taken by applications in the application layer.

[0126] like Figure 2B As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0127] The window manager is used to manage window programs. The window manager can obtain the display screen size and control the display window changes. For example, Figure 9A 、 Figure 9B Select part of the display content to display in a separate display window (such as the operation interface 901), and for example, Figure 11Mobile phone 100 detects a sliding operation on operating interface 1101 (i.e., display window) and reduces or enlarges the icons in operating interface 1101. The window manager can also determine whether a status bar is present, lock the screen, capture a screenshot, etc. The content provider is used to store and retrieve data and make it accessible to applications. This data may include video, images, audio, dialed and received calls, browsing history and bookmarks, and phone books.

[0128] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. Display interfaces (such as Figure 1B The operation interface 101 shown, or Figure 9A The operation interface 901 shown may be composed of one or more views.

[0129] The phone manager is used to provide communication functions of the mobile phone 100. For example, the management of call status (including answering, hanging up, etc.) The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0130] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0131] For example, Figure 4D As shown, when the mobile phone 100 detects multiple click operations on the operation interface 301 displayed on the display screen 194 but does not trigger any application process, the notification manager controls the display 194 to display a dialog box 302.

[0132] The system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0133] The kernel layer is the layer between hardware and software. Figure 2B As shown, the kernel layer includes at least display driver and sensor driver (such as infrared light sensor, touch sensor, pressure sensor, etc.), camera driver, audio driver, etc.

[0134] For ease of understanding, the following examples of this application will be described with Figure 2A and Figure 2BTaking the mobile phone 100 of the structure shown as an example, the interface display method provided in the embodiment of the present application is specifically described in conjunction with the accompanying drawings.

[0135] See Figure 3 As shown, Figure 3 This is a flow chart of the interface display method provided in the embodiment of the present application. Figure 3 As shown, the method may include the following steps:

[0136] S301: The mobile phone 100 receives a first operation, and enters a one-handed operation mode in response to the first operation.

[0137] The first operation is an operation for triggering the mobile phone 100 to enter the one-handed operation mode.

[0138] After receiving the first operation, the processor 110 in the mobile phone 100 can control the display screen 194 to display an operation interface that can be operated by the user with one hand in the one-handed operation mode. The user can realize one-handed operation of any icon in the operation interface (for example, an application icon, a parameter control icon within an application, a function control icon, etc.). The specific scheme is described below.

[0139] There are many specific implementations of the first operation, including but not limited to the following:

[0140] Method 1: lift up the mobile phone 100.

[0141] In the method 1, the first operation is an operation of lifting the mobile phone 100 .

[0142] For example, the mobile phone 100 may detect whether the mobile phone 100 is lifted up through the acceleration sensor 180E and the direction sensor 180C.

[0143] Specifically, when the mobile phone 100 is lifted up, the acceleration sensor 180E converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110. The kernel layer running in the processor 110 generates corresponding acceleration data based on the information; the direction sensor 180C converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110. The kernel layer running in the processor 110 generates angle change data of the mobile phone 100 relative to its own horizontal axis based on the information; the kernel layer determines that the difference between the acceleration data and the preset acceleration data exceeds the preset threshold, and determines that the angle change data meets the preset conditions (for example, the angle value will change from 0 to 180), then it is determined that the mobile phone 100 is lifted up, and the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0144] Optionally, after the mobile phone 100 detects that the mobile phone 100 is lifted, it can continue to detect whether there is a click operation or a shake operation on the display screen 194 of the mobile phone 100. If so, it enters the one-handed operation mode. This can effectively prevent user misoperation and thus improve user experience.

[0145] For example, see Figure 4A As shown, the mobile phone 100 detects through the acceleration sensor 180E that the mobile phone 100 is lifted up, and detects a double-click action or a shaking action on the display screen 194, and the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0146] Method 2: Quick gesture.

[0147] In mode 2, the first operation is a user-defined shortcut gesture.

[0148] For example, the mobile phone 100 may detect the shortcut gesture via the pressure sensor 180A.

[0149] Specifically, the pressure sensor 180A converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110. The kernel layer running in the processor 110 generates position data corresponding to the operation based on the information (specifically, it may include touch coordinates, timestamps corresponding to touch coordinates, etc.); the kernel layer draws the data of the shortcut gesture based on the finger position data collected within the first preset time period, and determines whether the data of the shortcut gesture matches the data of the preset shortcut gesture stored in the internal memory 121. If they match, the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0150] For example, see Figure 4B , assuming that the internal memory 121 of the mobile phone 100 stores shortcut gestures (letters Z and C) customized by the user according to his or her own preferences. Figure 4B As shown in (a) of FIG. 1 , when the processor 110 in the mobile phone 100 detects the letter Z through the pressure sensor 180A, the processor 110 controls the display screen 194 to enter the one-hand operation mode. Figure 4B As shown in (b) in FIG. 1 , when the processor 110 in the mobile phone 100 detects the letter Z through the pressure sensor 180A, the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0151] Method 3: Voice command.

[0152] In mode 3, the first operation may be sound information.

[0153] Specifically, audio module 170 converts the detected sound signal into information that processor 110 can process and transmits it to processor 110. The kernel layer running in processor 110 generates sound command data corresponding to the operation based on this information. The kernel layer matches the sound command data collected within a preset time period with the preset sound command data. If the match is successful, processor 110 controls display screen 194 to enter one-handed operation mode; if the match is unsuccessful, the original display mode is maintained.

[0154] For example, see Figure 4C , assuming that the internal memory 121 of the mobile phone 100 stores a preset voice command "turn on one-handed mode", when the processor 110 in the mobile phone 100 detects the voice command "turn on one-handed mode" through the audio module 170, the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0155] Method 4: key operation.

[0156] In mode 4, the first operation may be an operation on a hardware control (eg, button 190 ) of the mobile phone 100 .

[0157] The button 190 may be a power button or a volume button, which is not limited in the present embodiment. Specifically, the first operation may be a double click operation, a triple click operation, or a touch operation detected by the mobile phone 100 within a preset time period on the button 190, which is not specifically limited in the present embodiment.

[0158] Exemplarily, when the mobile phone 100 detects two click operations on the power button within a preset time period, the processor 110 controls the display screen 194 to enter the one-handed operation mode.

[0159] Method 5: click operation or touch operation.

[0160] In mode 5, the first operation may be multiple click operations or touch operations on the display screen 194 within a preset time period. Specifically, the touch sensor 180K in the display screen 194 detects the multiple click operations and touch operations, and the touch sensor 180K converts the detected signals into information that can be processed by the processor 110 and transmits the information to the processor 110. The processor 110 determines that the multiple click operations or touch operations do not trigger any application process, and the processor 110 controls the window manager to output a dialog box for asking the user whether to enter the one-handed operation mode (see Figure 4D If the processor 110 detects a confirmation instruction, the display screen 194 is controlled to enter the one-handed operation mode. If the processor 110 detects a negative instruction, the display screen 194 is controlled to maintain the original display mode.

[0161] The user can set the five methods provided above according to his or her needs in the auxiliary function of the setting application of the mobile phone 100.

[0162] It should be understood that the above five methods are only examples and not limitations, and there may be other specific implementation methods in actual applications.

[0163] S302: The mobile phone 100 obtains the viewpoint coordinates and the finger coordinates.

[0164] It should be understood that the viewpoint coordinates in the embodiment of the present application are used to represent the specific position where the user's line of sight falls on the display screen 194 of the mobile phone 100.

[0165] The viewpoint coordinate system can be a two-dimensional coordinate system, and the two-dimensional plane corresponding to the two-dimensional coordinate system can be the plane where the display screen 194 of the mobile phone 100 is located. There are many specific implementation methods for the mobile phone 100 to obtain the user's viewpoint coordinates, for example, based on pupil cornea vector reflection technology, visual tracking technology based on 3D eyeball model, etc.

[0166] Optionally, after the mobile phone 100 determines the viewpoint coordinates, it can also determine whether the time the user's gaze remains at the location of the viewpoint coordinates exceeds a first time threshold. If so, the mobile phone 100 obtains the coordinates of the user's finger. If not, the mobile phone 100 continues to detect new viewpoint coordinates until a viewpoint coordinate at which the user's gaze remains exceeds the first time threshold appears, at which point the user's finger coordinates are obtained. In this way, the obtained viewpoint coordinates are more accurate and closer to the viewpoint coordinates of the target the user actually wants to operate.

[0167] It should be understood that the finger coordinates in the embodiment of the present application are used to represent the position information of the projection of the user's finger falling on the display screen 194 of the mobile phone 100 or the position information of the contact point between the user's finger and the display screen 194 on the display screen 194.

[0168] It is understandable that the user's finger coordinates can be three-dimensional coordinates or two-dimensional coordinates, and the embodiments of this application do not specifically limit this. When the finger coordinates are two-dimensional coordinates, the finger coordinate system and the viewpoint coordinate system can be the same coordinate system.

[0169] There are many specific implementations for the mobile phone 100 to obtain finger coordinates, and this application does not limit them.

[0170] Example 1: The mobile phone 100 detects the position data corresponding to the touch operation through the touch sensor 180K (specifically, it may include the touch point coordinates, the timestamp corresponding to the touch point coordinates, etc.), and then determines the coordinates of the user's finger.

[0171] Example 2: The mobile phone 100 emits infrared light through an infrared optical sensor, detects the infrared light reflected back from the finger, and determines the coordinates of the user's finger.

[0172] S303: The mobile phone 100 obtains the first display content of the first display area corresponding to the viewpoint coordinates, and displays it in the second display area corresponding to the finger coordinates.

[0173] Specifically, after the mobile phone 100 obtains the user's viewpoint coordinates and finger coordinates, it converts them into information that can be processed by the processor 110. The processor 110 controls the window manager in the application framework layer running by the processor 110 to obtain the first display content of the first display area corresponding to the viewpoint coordinates, and generates a new display window based on the first display content; the processor 110 controls the display screen 194 to display the new display window in the second display area corresponding to the finger coordinates.

[0174] In one possible implementation, the first display area may be a circular display area centered on the viewpoint coordinates and having a radius equal to a first preset value. In another possible implementation, the first display area may be a square display area centered on the viewpoint coordinates and having a side length equal to a second preset value. Of course, the above two examples are merely examples and are not intended to be limiting.

[0175] Optionally, the first display content may include at least one application icon or a control icon. The specific content may be determined based on the display content of the first display area where the viewpoint coordinates are located.

[0176] Optionally, when the mobile phone 100 detects a click operation on any application icon or control icon in the first display content, the mobile phone 100 determines the icon as a target icon and starts a process corresponding to the target icon.

[0177] Optionally, after the mobile phone 100 determines the viewpoint coordinates and finger coordinates, it can also determine whether the time the user's gaze remains at the location of the viewpoint coordinates exceeds a second time threshold. If so, the mobile phone 100 displays the first display content in the second display area. If not, the mobile phone 100 continues to detect new viewpoint coordinates until a viewpoint coordinate at which the user's gaze remains exceeds the second time threshold appears, at which point the mobile phone 100 displays the first display content in the second display area. In this way, the first display content obtained is more accurate and closer to the display content the user actually wants to operate.

[0178] As can be seen from the above, in the embodiment of the present application, after the mobile phone 100 detects the first operation, it enters the one-handed operation mode. In the one-handed operation mode, the mobile phone 100 can obtain the user's viewpoint coordinates and finger coordinates, and display the first display content in the first display area corresponding to the viewpoint coordinates in the second display area corresponding to the finger coordinates. This effectively solves the technical problem of users having difficulty using the phone with one hand, and effectively improves the user experience.

[0179] The following describes a method for determining viewpoint coordinates provided by an embodiment of the present application. Figure 5 , the method comprising:

[0180] S501: The mobile phone 100 detects a user's facial image.

[0181] Specifically, the processor 110 in the mobile phone 100 starts the camera 193, the camera 193 captures the environmental image data around the mobile phone 100, and converts the environmental image data into information that the processor 110 can process and transmits it to the processor 110; the processor 110 determines whether there is facial data in the environmental image data. If there is facial data, the processor 110 continues to execute S502; if there is no facial data, the processor 110 controls the display screen 194 to exit the one-handed operation mode.

[0182] Optionally, before the mobile phone 100 executes step S502, the legitimacy of the user identity may be further verified. Specific implementation methods for verifying the legitimacy of the user identity include but are not limited to the following three methods:

[0183] Method 1: The processor 110 in the mobile phone 100 determines whether the facial image in the environmental image data matches the stored facial image. If so, S402 is executed; if not, the display screen 194 is controlled to exit the one-handed operation mode.

[0184] Method 2: The processor 110 in the mobile phone 100 detects the user's voiceprint information and determines whether the current user's voiceprint information matches the stored voiceprint information. If so, S402 is executed; if not, the display screen 194 is controlled to exit the one-handed operation mode.

[0185] Method 3: The processor 110 in the mobile phone 100 detects the user's iris information and determines whether the current user's iris information matches the stored iris information. If so, S402 is executed; if not, the display screen 194 is controlled to exit the one-handed operation mode.

[0186] S502: The mobile phone 100 determines the distance between the user's eyes and the infrared camera, as well as the coordinates of the corneal reflection spot and the pupil center.

[0187] For details, see Figure 6A, the processor 110 in the mobile phone 100 starts the infrared light sensor of the kernel layer and the infrared camera set at the center of the upper edge of the display screen 194; the infrared light sensor 180G controls the infrared light emitting diode inside it to emit infrared rays to the user's face; the infrared camera captures the light returned by the user's eyes, and converts the light data into information that can be processed by the processor 110 and transmits it to the processor 110; based on the information, the processor 110 controls the image processing library in the system library run by the processor 110 to generate a depth image of the user's eyes; the processor 110 processes the depth image according to the algorithm stored in the internal memory 121 (for example, a coordinate transformation algorithm), and then determines the distance between the user's eyes and the infrared camera; when the user's eyes move relative to the infrared camera, the processor 110 can also determine the coordinates of the corneal reflection spot and the coordinates of the pupil center according to algorithms such as pupil segmentation, pupil coarse positioning, edge extraction, and edge fitting.

[0188] S503: The mobile phone 100 determines the viewpoint coordinates of the user according to the distance, the corneal reflection spot coordinates, and the pupil center coordinates.

[0189] In one possible implementation, see Figure 6A The mobile phone 100 uses the center point of the upper edge of the display screen 194 as the origin, the upper edge of the display screen 194 as the Y-axis, and a line passing through the center point of the upper edge of the display screen 194 and perpendicular to the upper edge of the display screen 194 as the X-axis. Based on the distance between the user's eye and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center, the mobile phone 100 can determine the position of the user's line of sight relative to the display screen 194 (i.e., the viewpoint coordinates). Specifically, the processor 110 can obtain the offset of the corneal reflection spot relative to the pupil center in the depth image of the eye and determine the first coordinate of the user's line of sight in the world coordinate system based on a preset mapping relationship between the offset and the viewpoint coordinates. The processor 110 then performs a matrix transformation on the first coordinate based on the distance between the user's eye and the infrared camera to obtain the viewpoint coordinates (Ex, Ey) of the user's line of sight relative to the display screen 194. The processor 110 determines the position information corresponding to the viewpoint coordinates and controls the display screen 194 to display prompt information (e.g., a cursor) at the position corresponding to the viewpoint coordinates.

[0190] In another possible implementation, see Figure 6B The processor 110 of the mobile phone 100 starts the human eye viewpoint tracking sensor, and the human eye viewpoint tracking sensor obtains the viewpoint coordinates (Ex, Ey) and converts them into information that the processor 110 can process and transmits them to the processor 110; the processor 110 determines the position information corresponding to the viewpoint coordinates, and controls the display screen 194 to display prompt information (for example, a floating icon) at the position corresponding to the viewpoint data.

[0191] Optionally, the viewpoint coordinates obtained by the human eye viewpoint tracking sensor are converted into information that can be processed by the processor 110 and transmitted to the processor 110; the processor 110 controls the window manager in the application framework layer running on the processor 110 to obtain the display content within the preset range corresponding to the viewpoint coordinates. For example, see Figure 6C , the processor 110 determines that the viewpoint coordinates fall on the APP8 icon, and the mobile phone 100 obtains the display information corresponding to the icon APP8 (ie, the content of the dotted box).

[0192] The following describes a method for determining finger coordinates provided by an embodiment of the present application. Figure 7 , the method comprising:

[0193] S701: The mobile phone 100 transmits infrared rays toward the user's finger.

[0194] Optionally, before the mobile phone 100 executes S701 to S702, the processor 110 in the mobile phone 100 can control the front camera of the mobile phone 100 to start, and the front camera starts to collect the surrounding environmental image data, and converts the environmental image data into information that can be processed by the processor 110 and transmits it to the processor 110; the processor 110 executes the finger recognition program stored in the internal memory 121. If it is determined that there are multiple fingers in the environmental image data, and the multiple fingers include the user's thumb, the processor 110 executes S701 to S702 to obtain the coordinates of the thumb; if it is determined that there is only one finger in the environmental image data, the processor 110 executes S701 to S702 to obtain the coordinates of the finger.

[0195] Optionally, the user's finger may be the finger closest to the display screen 194 .

[0196] Specifically, before emitting infrared rays to the user's finger, the mobile phone 100 determines whether the distance between the finger and the screen 194 is less than a preset value through the built-in gesture tracking sensor of the mobile phone 100. If it is less than the preset value, the mobile phone 100 executes step S701. If it is not less than the preset value, the processor in the mobile phone 100 controls the display screen 194 to exit the one-handed operation mode.

[0197] S702: The mobile phone 100 receives the infrared light reflected by the finger.

[0198] Specifically, the processor 110 in the mobile phone 100 starts the infrared optical sensor in the kernel layer of the processor 110, and the infrared optical sensor controls the infrared light emitting diode inside it to emit infrared light to the user's finger and receive the infrared light returned by the finger.

[0199] S703: The mobile phone 100 determines the coordinates of the finger based on the infrared light reflected by the finger.

[0200] For details, see Figure 8A The infrared light sensor is disposed at the center point of the upper edge of the display screen 194, and the two infrared light emitting diodes in the infrared light sensor are disposed on either side of the center point of the upper edge of the display screen 194. After the infrared sensor receives the infrared light information reflected by the finger, the processor 110 in the mobile phone 100 can determine the first distance between the finger and the infrared light sensor according to the formula S = ((t2-t1)c) / 2, where t1 is the time when the infrared sensor transmits infrared light to the finger, t2 is the time when the infrared sensor receives the infrared light reflected by the finger, c is the speed of light, and S is the first distance between the finger and the infrared light sensor.

[0201] Furthermore, the processor 110 obtains a second distance between the finger and the display screen 194 based on the built-in gesture tracking sensor, and performs geometric operations on the first distance and the second distance to obtain a third distance between the projection point of the finger on the display screen 194 and the center point of the upper edge of the display screen 194; the processor 110 controls the infrared camera to capture an image of the finger, and determines the position of the finger relative to the infrared light sensor based on the image; and then the processor 110 can determine the coordinates of the finger relative to the center point of the display screen 194 (i.e., the infrared light sensor) and the position of the finger relative to the infrared light sensor, and determine the coordinates of the finger. For example, Figure 8A As shown, the second distance is Ez, the third distance is Ex, and the user's finger is located in the north direction of the infrared light sensor, then the finger coordinates are (Ex, 0, Ez). The finger coordinates here are three-dimensional coordinates. Figure 8B After determining the coordinates of the user's finger, a corresponding icon can be displayed on the display screen 194 of the mobile phone 100.

[0202] Optionally, when the mobile phone 100 is not unlocked, the mobile phone 100 can also use the infrared light sensor to obtain the coordinates of the user's finger and control the display screen 194 to display the fingerprint unlocking icon on the operational interface corresponding to the finger coordinates. The touch sensor 180K of the mobile phone 100 detects the touch operation on the unlocking icon, converts the touch operation into an electrical signal, and the fingerprint sensor 180H is driven by the kernel layer. The fingerprint sensor 180H collects the user's fingerprint, matches the fingerprint with the stored fingerprint, and enters the unlocking mode after the match is successful. Through this embodiment, the fingerprint unlocking position does not need to be fixed at a fixed position, which effectively improves the user experience.

[0203] The following is an example of the software and hardware workflow of an electronic device, using the interface display method provided in the embodiment of the present application.

[0204] The touch sensor 180K detects a sliding touch operation on the display screen 194, converts the detected signal into information that can be processed by the processor 110, and transmits it to the processor 110. The kernel layer running in the processor 110 generates position data corresponding to the operation based on the information (specifically, it may include touch point coordinates, timestamps corresponding to the touch coordinates, etc.); the processor 110 determines that the multiple click operations or touch operations do not trigger any application process, and the processor 110 controls the window manager to output a dialog box for asking the user whether to enter the one-handed operation mode (see Figure 4D If the processor 110 detects a confirmation instruction, the display screen 194 is controlled to enter the one-handed operation mode, the mobile phone 100 starts the infrared camera, obtains an infrared image, and transmits the infrared image to the processor 110. The processor 110 determines the viewpoint coordinates and finger coordinates of the user according to the infrared image, and transmits the viewpoint coordinates and finger coordinates to the application framework layer. The view system in the framework layer obtains the first display content in the first display area corresponding to the viewpoint coordinates and the second display area corresponding to the finger coordinates, and displays the first display content in the second display area.

[0205] Of course, the above is only an example of the first operation being a sliding touch operation detected by the touch sensor 180K to illustrate the interface display method provided in the embodiment of the present application. There may be other implementation methods in specific implementation, and the embodiment of the present application does not limit this.

[0206] To better understand the technical solutions provided by the embodiments of the present application, the interface display method in the one-handed operation mode in the embodiments of the present application is introduced below in combination with several specific application scenarios.

[0207] Scenario 1 - Launch the application.

[0208] In scenario 1, there are many specific implementations for the mobile phone 100 to display the first display content in the first display area corresponding to the viewpoint coordinates to the second display area corresponding to the finger coordinates, including but not limited to the following:

[0209] Method 1: When the processor 110 in the mobile phone 100 determines that the position corresponding to the viewpoint coordinates overlaps with the position of a certain APP icon, it determines the certain APP icon as the first display content and displays the first display content in the second display area corresponding to the finger coordinates.

[0210] For example, see Figure 9A ,exist Figure 9A In (a), the processor 110 in the mobile phone 100 determines that the position corresponding to the viewpoint coordinates overlaps with the position of the APP8 icon, and the mobile phone 100 uses the APP8 icon as the first display content and controls the display screen 194 to display it in the second display area corresponding to the finger coordinates, that is, Figure 9A The operation interface 901 in (b).

[0211] Optionally, the mobile phone 100 can monitor the changes in the viewpoint coordinates in real time, that is, obtain the third display content in the first display area corresponding to the new viewpoint coordinates in real time, and switch the display content in the second display area corresponding to the finger coordinates from the first display content to the third display content.

[0212] For example, see Figure 9B , assuming that the mobile phone 100 detects at the first moment that the position of the viewpoint coordinates corresponds to the APP8 icon, and detects at the second moment that the position of the viewpoint coordinates corresponds to the APP9 icon, then at the first moment the operation interface 901 corresponding to the finger coordinates will display the APP8 icon, and at the second moment the operation interface 901 corresponding to the finger coordinates will display the APP9 icon.

[0213] In the embodiment of the present application, the display content in the second display area (eg, the operation interface 901 ) corresponding to the finger coordinates can change in real time as the viewpoint coordinates change.

[0214] Method 2: When the processor 110 in the mobile phone 100 determines that the viewpoint coordinate position does not overlap with the position of any APP icon, the APP icon whose distance from the viewpoint coordinate position is a preset value is determined as the first display content, and the first display content is displayed in the second display area corresponding to the finger coordinates.

[0215] For example, see Figure 10 ,exist Figure 10 In (a), after the mobile phone 100 obtains the viewpoint coordinates and the finger coordinates, the processor 110 determines that the viewpoint coordinates are between the APP8 icon and the APP13 icon, then the processor 110 determines the APP8 icon and the APP13 icon as the first display content, and displays the APP8 icon and the APP13 icon in the second display area corresponding to the finger coordinates, that is, Figure 10 (b) shows the operation interface 1001.

[0216] Optionally, after the mobile phone 100 displays the first display content in the second display area, if a sliding operation on the second display area is detected, the processor 110 in the mobile phone 100 can control the display screen 194 to display new display content in the second display area.

[0217] For example, in Figure 10 In (c), the mobile phone 100 detects a sliding operation (left and right sliding, up and down sliding, etc.) on the operation interface 1001, and displays the APP8 icon, APP9 icon, APP13 icon, and APP14 icon on the operation interface 1001.

[0218] Optionally, after the mobile phone 100 displays the first display content in the second display area, if a sliding operation or a touch operation on the second display area is detected, the processor 110 in the mobile phone 100 can control the display screen 194 to display the first display content scaled to a preset scaling ratio in the second display area. The scaling ratio can also be set by the user through voice commands when using the mobile phone 100.

[0219] For example, see Figure 11 ,exist Figure 11 In (a), after the mobile phone 100 obtains the viewpoint coordinates and the finger coordinates, the processor 110 in the mobile phone 100 determines that the viewpoint coordinates are between the APP8 icon and the APP13 icon. The processor 110 uses the APP8 icon and the APP13 icon as the first display content and displays the APP8 icon and the APP13 icon on the operation interface 1101 corresponding to the finger coordinates. Figure 11 In (b), the mobile phone 100 detects a touch operation on the operation interface 1101 and displays the APP8 icon and the APP13 icon on the operation interface 1101 at a preset magnification ratio; Figure 11 In (c), the mobile phone 100 detects two touch operations on the operation interface 1101 within a preset time period, and displays the APP8 icon and the APP13 icon on the operation interface 1101 at a preset reduced scale.

[0220] Scene 2 - Game interface controls.

[0221] In scenario 2, further using mobile phone 100 as an example, the process of mobile phone 100 displaying the display content corresponding to the viewpoint coordinates in the display area corresponding to the finger coordinates is described. Specifically, before displaying the display content corresponding to the viewpoint coordinates in the second display area corresponding to the finger coordinates, mobile phone 100 further includes: determining whether there is an application icon or control icon at a first position corresponding to the second display area corresponding to the finger coordinates; if so, displaying the display content at a second position in the second display area; if not, displaying the display content at the first position, wherein the second position is a first preset value away from the first position.

[0222] See Figure 12A As shown in (a), Figure 12A(a) in the figure gives a possible game interface schematic diagram, in which controls ①, ②, ③, ④, ⑤, ⑥, and ⑦ are set; wherein, when the mobile phone 100 detects a click operation or a touch operation on controls ①, ②, and ③, the processor 110 in the mobile phone 100 can control the walking speed of the character in the game interface; when the mobile phone 100 detects a click operation or a touch operation on controls ④, ⑤, and ⑥, the processor 110 in the mobile phone 100 can control the character in the game interface to make an attack action; when the mobile phone 100 detects a click operation or a touch operation on control ⑦, the processor 110 in the mobile phone 100 can control the character in the game interface to change game equipment.

[0223] Example 1, in Figure 12A In (a), the mobile phone 100 has turned on the one-handed operation mode, and the mobile phone 100 starts to obtain the user's viewpoint coordinates and finger coordinates, and detects that the display area corresponding to the user's viewpoint coordinates includes the control ⑦. Figure 12A In (b), the mobile phone 100 determines the display area corresponding to the user's thumb, namely the operation interface 1201. The mobile phone 100 further determines that there is a control ⑥ in the position corresponding to the thumb coordinates. The mobile phone 100 determines another position in the operation interface 1201 that is a preset distance away from the thumb coordinates, and then the mobile phone 100 displays the control ⑦ at this position, realizing the user's one-handed operation.

[0224] Example 2, in Figure 12B In (a), the mobile phone 100 has turned on the one-handed operation mode, and the mobile phone 100 starts to obtain the user's viewpoint coordinates and finger coordinates, and detects that the display area corresponding to the user's viewpoint coordinates includes the control ⑦. Figure 12B In (b), the mobile phone 100 determines the display area corresponding to the user's thumb, namely the operation interface 1001. The mobile phone 100 further determines that there is no control ⑥ in the position corresponding to the thumb coordinates, and then the mobile phone 100 displays the control ⑦ at this position, realizing the user's one-handed operation.

[0225] Scenario 3 - User answers the phone with one hand.

[0226] See Figure 13 (a) In Figure 13 In (a), the operation interface of the mobile phone 100 includes an answer control 1301 for indicating rejection of a call and an answer control 1302 for indicating answering a call.

[0227] When the user holds the phone in his right hand, there is an incoming call reminder. The finger of the user's right hand can only reach the answer control 1301. The mobile phone 100 detects the voice command for turning on the one-handed mode, enters the one-handed operation mode, and obtains the user's finger coordinates and viewpoint coordinates; if the mobile phone 100 detects that the display area corresponding to the viewpoint coordinates contains the reject control 1301, the reject control 1301 icon is displayed within the operable range of the user's finger (for example, Figure 13 (b)); If the display area corresponding to the viewpoint coordinates includes the answer control 1302, the original display mode is maintained (for example Figure 13 (as shown in (a)).

[0228] It should be understood that the above embodiments are all described by taking a single device to implement a one-handed operation mode as an example. The one-handed operation method provided in the embodiments of the present application can also be applied to multiple electronic devices or a system composed of multiple electronic devices. The following example is applied to two electronic devices.

[0229] For example, see Figure 14 Taking the computer 1401 and the mobile phone 100 as an example, the computer 1401 and the mobile phone 100 are in communication connection (wired connection, Bluetooth connection, wifi connection, etc., without limitation). The computer 1401 obtains the viewpoint coordinates of the user on the computer 1401, and the mobile phone 100 obtains the coordinates of the user's finger on the mobile phone 100. The computer 1401 displays the display content in the display area corresponding to the viewpoint coordinates on the operation interface 1402 on the mobile phone 100 (i.e., the operable range of the user's finger). The process of obtaining the viewpoint coordinates, finger coordinates, and controlling the display can be referred to above and will not be repeated here.

[0230] In the embodiments provided in the present application above, the methods provided in the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the various functions in the methods provided in the embodiments of the present application above, the electronic device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0231] Based on the same technical concept, the present application also provides an electronic device 1500 for implementing Figure 3 、 Figure 5 、 Figure 7 The method in the embodiment shown. Figure 15 As shown, the electronic device 1500 may include a processor 1501 for executing a program or instruction stored in a memory 1502. When the program or instruction stored in the memory 1502 is executed, the processor is used to Figure 3The interface display method shown.

[0232] Optionally, the electronic device 1500 may further include a communication interface 1503. Figure 15 The dashed lines indicate that the communication interface 1503 is optional for the electronic device 1500 .

[0233] The number of processors 1501, memories 1502, and communication interfaces 1503 does not constitute a limitation on the embodiments of the present application, and can be arbitrarily configured according to business requirements during specific implementation.

[0234] Optionally, the memory 1502 is located outside the electronic device 1500 .

[0235] Optionally, the electronic device 1500 includes the memory 1502, the memory 1502 is connected to the at least one processor 1501, and the memory 1502 stores instructions that can be executed by the at least one processor 1501. Figure 15 The dashed lines indicate that the memory 1502 is optional for the electronic device 1500 .

[0236] The processor 1501 and the memory 1502 may be coupled via an interface circuit or may be integrated together, which is not limited here.

[0237] The specific connection medium between the processor 1501, the memory 1502 and the communication interface 1503 is not limited in the embodiment of the present application. Figure 15 The processor 1501, the memory 1502 and the communication interface 1503 are connected via a bus 1504. Figure 15 The connections between the other components are shown in bold lines, which are only for illustration and are not intended to be limiting. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, Figure 15 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0238] It should be understood that the processors mentioned in the embodiments of the present application can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented by software, the processor can be a general-purpose processor that is implemented by reading software code stored in a memory.

[0239] Exemplarily, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0240] It should be understood that the memory mentioned in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0241] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) can be integrated into the processor.

[0242] It should be noted that the memory described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0243] Based on the same technical concept, an embodiment of the present application further provides a computer-readable medium, which stores program code for execution by a device, and the program code includes a method for executing the interface display method in the aforementioned embodiment.

[0244] Based on the same technical concept, an embodiment of the present application also provides a computer program product containing instructions. When the computer program product is run on a computer, it enables the computer to execute the interface display method in the aforementioned embodiment.

[0245] Based on the same technical concept, an embodiment of the present application also provides a chip, which includes a processor and a data interface. The processor reads instructions stored in the memory through the data interface to execute the interface display method in the aforementioned embodiment.

[0246] In one possible design, the chip may further include a memory storing instructions, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to execute the interface display method in the aforementioned embodiment.

[0247] It should be noted that the division of modules in the embodiments of the present application is illustrative and is merely a logical functional division. In actual implementation, other division methods may be used. The functional modules in the embodiments of the present application may be integrated into a single processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The integrated modules may be implemented in either hardware or software functional modules.

[0248] The various embodiments of the present application can be used alone or in combination with each other to achieve different technical effects.

[0249] The above embodiments are merely used to provide a detailed introduction to the technical solutions of the present application. However, the descriptions of the above embodiments are only intended to help understand the methods of the embodiments of the present application and should not be construed as limiting the embodiments of the present application. Any changes or substitutions that can be easily conceived by those skilled in the art should be included within the scope of protection of the embodiments of the present application.

[0250] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).

[0251] For the purpose of explanation, the foregoing description is described with reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive, nor is it intended to limit the present application to the precise forms disclosed. In light of the above teachings, many modifications and variations are possible. The embodiments are selected and described in order to fully illustrate the principles of the present application and its practical application, so that others skilled in the art can take full advantage of the present application and various embodiments with various modifications suitable for the specific purposes contemplated.

Claims

1. An interface display method, characterized in that: Applied to an electronic device, the display interface of the electronic device includes a first display area and a second display area, the first display area displays first display content, second display content, third display content, and fourth display content, the first display content and the second display content are adjacent, the third display content is adjacent to the first display content, and the fourth display content is adjacent to the second display content, the method comprising: In response to the first viewpoint coordinates being located between the first display content and the second display content and the finger coordinates being located within the second display area, displaying the first display content and the second display content within the second display area; receiving a first sliding operation within the second display area; In response to the first sliding operation, the first display content, the second display content, the third display content, and the fourth display content are displayed in the second display area.

2. The method according to claim 1, wherein After displaying the first display content and the second display content in the second display area, the method further includes: receiving a first touch operation within the second display area; In response to the first touch operation, the first display content and the second display content displayed in the second display area are displayed at a preset magnification ratio.

3. The method according to claim 1 or 2, wherein: After displaying the first display content and the second display content in the second display area, the method further includes: receiving a second touch operation within the second display area; In response to the second touch operation, the first display content and the second display content displayed in the second display area are displayed at a preset reduced scale.

4. The method according to claim 3, wherein The method further comprises: In response to the second touch operation, the first display content and the second display content displayed in the second display area are displayed at a preset reduced scale. The third display content and the fourth display content reduced in size at the preset reduction ratio are displayed in the second display area.

5. The method according to claim 1 or 2, wherein: Before displaying the first display content and the second display content in the second display area, the method further includes: receiving a first operation; In response to the first operation, starting a one-handed operation mode; In the one-hand operation mode, the first viewpoint coordinates and the finger coordinates are acquired.

6. The method according to claim 5, wherein The first operation is: The electronic device is lifted or shaken; or, a click operation or a slide operation on the display screen of the electronic device; or Voice commands; or, Operations on hardware buttons of the electronic device.

7. The method according to claim 1 or 2, wherein: After displaying the first display content and the second display content in the second display area, the method further includes: Acquire the second viewpoint coordinates and the fifth display content in the third display area corresponding to the second viewpoint coordinates, and switch the display content in the second display area to the fifth display content.

8. The method according to claim 1 or 2, wherein: Before displaying the first display content and the second display content in the second display area, the method further includes: Determine whether there is an application icon or a control icon at a first position corresponding to the finger coordinates in the second display area; If so, displaying the first display content and the second display content at a second position in the second display area; the second position is at a first preset distance from the first position; If not, the first display content and the second display content are displayed at the first position.

9. The method according to claim 1 or 2, wherein: Before displaying the first display content and the second display content in the second display area, the method further includes: determining that a time duration during which the user's sight stays at the first viewpoint coordinate exceeds a second preset value.

10. The method according to claim 1 or 2, wherein: The method further comprises: A click operation on at least one target icon in the first display content and the second display content is received, a first target icon is determined, and an application process corresponding to the first target icon is executed.

11. The method according to claim 5, wherein The acquiring of first viewpoint coordinates in response to the first operation includes: Determine a first distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center; The first viewpoint coordinates are determined according to the first distance, the cornea reflection spot coordinates, and the pupil center coordinates.

12. The method according to claim 5, wherein The acquiring the finger coordinates in response to the first operation includes: Determining a second distance between the finger and an infrared light sensor in the electronic device, a third distance between the finger and a display screen, and an orientation of the finger relative to the infrared light sensor; determining a fourth distance between a projection point of the finger on the display screen and the infrared light sensor based on the second distance and the third distance; The finger coordinates are determined according to the fourth distance and the orientation.

13. An electronic device, characterized in that: The electronic device includes: a processor and a memory; wherein the memory is used to store one or more computer programs, and when the one or more computer programs stored in the memory are executed by the processor, the electronic device executes the method according to any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium includes a computer program, and when the computer program is run on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 12.

15. A chip, characterized in that: The chip includes a processor and a data interface, and the processor is used to read and execute instructions stored in a memory through the data interface, so that the computer executes the method according to any one of claims 1 to 12.

Images