A touch control method for a device with a folding screen and a folding screen device

Abstract

The embodiments of the present application provide a touch control method for a device with a folding screen and a folding screen device. The embodiments of the present application relate to the fields of folding screen devices, human-computer interaction, etc. Among them, the folding screen includes a first display area, a second display area and a third display area. When the electronic device is in a folded form, the angle between the first display area and the second display area is less than or equal to a first preset angle, and the third display area is arranged between the first display area and the second display area. The method includes: detecting a first operation in the third display area; controlling the first display area and / or the second display area. In the solution provided in the embodiments of the present application, when the electronic device is in a folded form, the main screen and / or the sub-screen can be controlled by the operation detected on the side screen.

Description

[0001] This application is a divisional application. The application number of the original application is 201910817743.0, and the original application date is August 30, 2019. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The embodiments of the present application relate to the field of electronic technology, and in particular, to a touch control method for a device with a folding screen and a folding screen device. Background Art

[0003] With the popularization of mobile devices such as mobile phones, people have a growing demand for large-screen mobile phones. However, the use of large-screen mobile phones also brings about the problem of portability. In order to improve portability, foldable screen mobile phones with stretchable and deformable screens have become a development trend of mobile phones.

[0004] For foldable screen mobile phones, the screen is a large screen when it is in the unfolded state, and can include a main screen, a secondary screen and a side screen when it is in the folded state, wherein the side screen is the area where the folding occurs on the screen.

[0005] When a foldable screen phone is in folded form, how to reasonably utilize the side screen is a question that needs to be considered. Summary of the invention

[0006] The purpose of the embodiments of the present application is to provide a touch method for a device with a folding screen and a folding screen device, which can reasonably utilize the side screen of a folding mobile phone to improve the user experience.

[0007] The above-mentioned and other objects are achieved by the features of the independent claims. Further implementations are reflected in the dependent claims, the description and the drawings.

[0008] In a first aspect, an embodiment of the present application provides a touch method, which is applied to an electronic device equipped with a foldable display, characterized in that the foldable display includes a first display area, a second display area and a third display area. When the electronic device is in a folded form, the angle between the first display area and the second display area is less than or equal to a first preset angle, and the third display area is arranged between the first display area and the second display area. The method includes: detecting a first operation in the third display area; and controlling the first display area and / or the second display area.

[0009] It should be noted that in the embodiment of the present application, when the electronic device is in a folded form, the user can control the main screen and / or the sub-screen through the side screen. On the one hand, the utilization rate of the side screen is improved. On the other hand, the touch operations on the main screen and / or the sub-screen can be transferred to the side screen, which can avoid the touch operations from blocking the main screen and / or the sub-screen, giving the user a better experience.

[0010] In one possible design, the control of the first display area and / or the second display area includes: updating the display interface in the first display area and / or the second display area; or controlling functions on the first display area and the second display area.

[0011] It should be noted that in the embodiment of the present application, when the electronic device is in a folded form, the user can control the main screen and / or the secondary screen through the side screen, for example, update the display interface of the main screen and / or the secondary screen, or control the functions on the main screen and / or the secondary screen. On the one hand, the utilization rate of the side screen is improved, and on the other hand, the touch operation on the main screen and / or the secondary screen can be transferred to the side screen, which can avoid the cover of the main screen and / or the secondary screen by the touch operation, giving the user a better experience.

[0012] In one possible design, a first interface is displayed on the first display area, and the first interface includes at least one control or controls; a first control in the first interface is mapped to the third display area, wherein the first control is retained or deleted in the first interface; a user operation on the first control is received; and a function corresponding to the first control on the first interface is executed.

[0013] It should be noted that in the embodiment of the present application, when the electronic device is in a folded form, the electronic device can map the controls and / or controls on the main screen and / or the secondary screen to the side screen, that is, the main screen and / or the secondary screen can be controlled through the side screen. On the one hand, the utilization rate of the side screen is improved, and on the other hand, the touch operation on the main screen and / or the secondary screen can be transferred to the side screen, which can avoid the cover of the main screen and / or the secondary screen by the touch operation, giving the user a better experience.

[0014] In one possible design, mapping the first control in the first interface to the third display area includes: mapping a preset control in the first interface as the first control to the third display area; or, mapping a control specified by a user in the first interface as the first control to the third display area; or, detecting the control that is used most or least in the first interface and mapping it as the first control to the third display area.

[0015] It should be noted that in the embodiment of the present application, when the electronic device is in a folded form, the electronic device can map the controls and / or controls on the main screen and / or the secondary screen to the side screen, that is, control of the main screen and / or the secondary screen is achieved through the side screen. Among them, which controls / controls are mapped to the side screen can be selected by the user, which helps to improve the user experience. In addition, on the one hand, the embodiment of the present application can improve the utilization rate of the side screen. On the other hand, the embodiment of the present application can also transfer the touch operation on the main screen and / or the secondary screen to the side screen, which can avoid the cover of the main screen and / or the secondary screen by the touch operation, giving the user a better experience.

[0016] In one possible design, a movie playback interface is displayed in the first display area and / or the second display area; a first operation on the third display area is detected; and the first display area and / or the second display area are controlled, including: detecting the first operation on the third display area; fast forwarding or rewinding the movie playback interface.

[0017] For example, if a movie playback interface is displayed on the main screen and / or the sub-screen, the user can fast forward or rewind the movie through the side screen. In traditional technology, the fast forward or rewind operation on the main screen / sub-screen will block the movie screen, resulting in a poor user experience. In an embodiment of the present application, the fast forward or rewind operation is transferred to the side screen to avoid blocking the movie screen and provide users with a better experience.

[0018] In one possible design, an image preview interface is displayed in the first display area and / or the second display area, the image preview interface including a first image; a first operation on the third display area is detected; and the first display area and / or the second display area are controlled, including: detecting the first operation on the third display area; and enlarging or reducing the first image.

[0019] For example, if an image is displayed on the main screen and / or the sub-screen, the user can use the side screen to zoom in or out on the image. In traditional technology, the zoom-in or zoom-out operation on the main screen / sub-screen will block the image content, resulting in a poor user experience. In an embodiment of the present application, the zoom-in or zoom-out operation is transferred to the side screen, which can avoid blocking the image content and provide the user with a better experience.

[0020] In one possible design, the controlling of the first display area and / or the second display area includes: determining that a first touch area of ​​the first display area is smaller than a second touch area of ​​the second display area, and controlling the first display area; or; determining that a first touch area of ​​the first display area is larger than a second touch area of ​​the second display area, and controlling the second display area.

[0021] Exemplarily, in an embodiment of the present application, the electronic device can determine whether the main screen is facing the user or the secondary screen is facing the user. If the main screen is facing the user, the main screen is controlled by operations on the side screen. If the secondary screen operates the user, the secondary screen is controlled by operations on the side screen. Among them, the electronic device can determine whether the main screen or the secondary screen is facing the user in a variety of ways. For example, when the first contact area on the main screen is greater than the second contact area on the secondary screen, it means that the main screen is facing away from the user and the secondary screen is facing the user. For another example, when the second contact area on the secondary screen is greater than the first contact area on the main screen, it means that the secondary screen is facing away from the user and the main screen is facing the user.

[0022] In one possible design, the controlling of the first display area and / or the second display area includes: determining that a first distance between the second display area and the user is greater than a second distance between the first display area and the user, and controlling the first display area; or determining that a second distance between the second display area and the user is less than a second distance between the first display area and the user, and controlling the second display area.

[0023] For another example, the electronic device may also determine whether the main screen is facing the user or the secondary screen is facing the user by the distance between the main screen, the secondary screen and the user respectively.

[0024] In one possible design, the controlling of the first display area and / or the second display area includes: controlling the first display area when it is determined that an image captured by a first camera on a first surface where the first display area is located includes user-specific features; or controlling the second display area when it is determined that an image captured by a second camera on a second surface where the second display area is located includes user-specific features.

[0025] For another example, the electronic device may also determine whether the main screen or the secondary screen is facing the user by capturing images through cameras respectively arranged on the first surface where the main screen is located and the second surface where the secondary screen is located.

[0026] In one possible design, the controlling of the first display area and / or the second display area includes: controlling the first display area when it is determined that the first display area is on and the second display area is off, or controlling the second display area when it is determined that the first display area is off and the second display area is on.

[0027] For another example, if the main screen is off and the sub-screen is on, the sub-screen is controlled by the operation on the side screen; if the sub-screen is off and the main screen is on, the main screen is controlled by the operation on the side screen.

[0028] In a possible design, the electronic device may also adjust the display brightness of the first display area and / or the second display area, or adjust the volume of the electronic device.

[0029] It should be noted that the electronic device can also implement display brightness conditions or volume conditions through operations on the side screen.

[0030] In a possible design, the first operation includes: any one of single-click, double-click, long press, sliding, and long press followed by continuous sliding.

[0031] It should be understood that the several first operations listed above are only examples and not limitations.

[0032] In a second aspect, an embodiment of the present application further provides an electronic device, comprising: a foldable display; one or more processors; one or more memories; wherein the one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to execute the above-mentioned first aspect and any possible design of the technical solution of the first aspect.

[0033] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a module / unit for executing the first aspect or any possible design method of the first aspect; these modules / units can be implemented by hardware, or corresponding software can be implemented by hardware.

[0034] In a fourth aspect, an embodiment of the present application further provides a chip, which is coupled to a memory in an electronic device to execute the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect thereof; in an embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.

[0035] In the fifth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect.

[0036] In a sixth aspect, an embodiment of the present application further provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the technical solution of the first aspect of the embodiment of the present application and any possible design of the first aspect thereof.

[0037] In the seventh aspect, an embodiment of the present application also provides a graphical user interface on an electronic device, which electronic device has a foldable display, one or more memories, and one or more processors, wherein the one or more processors are used to execute one or more computer programs stored in the one or more memories, and the graphical user interface includes a graphical user interface displayed when the electronic device executes the first aspect of the embodiment of the present application and any possible design of the first aspect thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application;

[0039] Figure 2 A schematic diagram of the software structure of an electronic device provided in one embodiment of the present application;

[0040] Figure 3 A schematic diagram of the physical form of a left-right foldable electronic device provided by an embodiment of the present application;

[0041] Figure 4 A schematic diagram of unfolding angles of different physical forms of a foldable electronic device provided in one embodiment of the present application;

[0042] Figure 5 A schematic diagram of the physical form of a foldable electronic device that can be folded up and down provided by an embodiment of the present application;

[0043] Figure 6 A schematic diagram of a holding state of a foldable electronic device provided in an embodiment of the present application;

[0044] Figure 7 A schematic diagram of a graphical user interface of a foldable electronic device provided in one embodiment of the present application;

[0045] Figure 8 A schematic diagram of a graphical user interface of a foldable electronic device provided in one embodiment of the present application;

[0046] Fig. 9 A schematic diagram of a graphical user interface of a foldable electronic device provided in one embodiment of the present application;

[0047] Fig.10 A schematic diagram of a graphical user interface of a foldable electronic device provided in one embodiment of the present application;

[0048] Fig.11 A schematic diagram of mapping an area on a main screen and an area on a side screen of a foldable electronic device provided in an embodiment of the present application;

[0049] Fig.12A schematic diagram of mapping a touch area on a side screen of a foldable electronic device to a touch area on a main screen provided by an embodiment of the present application;

[0050] Fig.13A A schematic diagram of mapping a sliding operation on a side screen of a foldable electronic device to a sliding operation on a main screen provided by an embodiment of the present application;

[0051] Fig. 13B A schematic diagram of mapping a sliding operation on a side screen of a foldable electronic device to a sliding operation on a main screen provided by an embodiment of the present application;

[0052] Fig.14 A schematic diagram of mapping controls on a main screen of a foldable electronic device to a side screen provided by an embodiment of the present application;

[0053] Fig.15 A schematic diagram of mapping controls on a main screen of a foldable electronic device to a side screen provided by an embodiment of the present application;

[0054] Fig.16 A schematic diagram of fingerprint detection on the main screen and the secondary screen of a foldable electronic device provided in an embodiment of the present application;

[0055] Fig.17 A schematic diagram of a flow chart of a touch control method for a foldable electronic device provided in one embodiment of the present application;

[0056] Fig.18 A schematic diagram of a flow chart of a touch control method for a foldable electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0057] The technical solutions in the embodiments of the present application will be described in detail below in conjunction with the drawings in the following embodiments of the present application.

[0058] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be used as limitations on the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0059] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0060] Below, some of the terms involved in the embodiments of the present application are explained to facilitate easy understanding by those skilled in the art.

[0061] The at least one involved in the embodiments of the present application includes one or more; wherein, more means greater than or equal to two. In addition, it should be understood that in the description of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0062] The application (application, app) involved in the embodiments of the present application can be referred to as application, which is a software program that can realize one or more specific functions. Usually, multiple applications can be installed in an electronic device, for example, instant messaging applications, video applications, audio applications, image shooting applications, etc. Among them, instant messaging applications, for example, may include text messaging applications, WeChat, WhatsApp Messenger, Line, photo sharing (instagram), Kakao Talk, DingTalk, etc. Image shooting applications, for example, may include camera applications (system camera or third-party camera applications). Video applications, for example, may include Youtube, Twitter, Douyin, iQiyi, Tencent Video, etc. Audio applications, for example, may include Kugou Music, Xiami, QQ Music, etc. The applications mentioned in the following embodiments may be applications that are installed on the electronic device when it leaves the factory, or they may be applications that the user downloads from the Internet or obtains from other electronic devices during the use of the electronic device.

[0063] The embodiment of the present application provides a touch control method, which can be applied to any electronic device with a side screen, such as a mobile phone, a tablet computer, a wearable device (for example, a watch, a bracelet, a smart helmet, etc.), a vehicle-mounted device, a smart home, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. In the touch control method provided in the embodiment of the present application, the side screen of the electronic device can be used as a touch control area, that is, the user can perform touch operations through the side screen to control the electronic device. In some embodiments, the electronic device with a side screen can be an electronic device with a curved screen. For example, the curved screen is set on the front and side of the electronic device, and the display area corresponding to the front of the electronic device can be used as the main screen, and the display area corresponding to the side of the electronic device can be used as the side screen. For another example, the electronic device with a side screen can also be an electronic device equipped with a folding screen, such as a folding screen mobile phone. Taking a folding screen mobile phone as an example, when the folding screen mobile phone is in a folded state, the display area bent on the folding screen can be used as a side screen. It should be noted that the touch control method provided in the embodiments of the present application can be applied to any electronic device with a side screen, and the embodiments of the present application will not be listed one by one. The following embodiments are mainly described by taking an electronic device with a folding screen as an example.

[0064] For example, Figure 1 A schematic structural diagram of an electronic device with a foldable screen is shown.

[0065] like Figure 1 As shown, the foldable electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0066] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the foldable electronic device. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0067] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the foldable electronic device, and can also be used to transmit data between the foldable electronic device and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0068] The wireless communication function of the foldable electronic device can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the foldable electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0069] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to foldable electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0070] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to foldable electronic devices. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0071] In some embodiments, the antenna 1 of the foldable electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the foldable electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0072] The display screen 194 is used to display the display interface of the application, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the foldable electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0073] The camera 193 is used to capture static images or videos. In some embodiments, the camera 193 may include at least one camera, such as a front camera and a rear camera.

[0074] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the foldable electronic device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and software code of at least one application (such as iQiyi application, WeChat application, etc.). The data storage area can store data (such as images, videos, etc.) generated during the use of the foldable electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0075] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the foldable electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures and videos are saved in the external memory card.

[0076] The foldable electronic device can realize audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0077] Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0078] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The gyroscope sensor 180B can be used to determine the motion posture of the foldable electronic device. In some embodiments, the angular velocity of the foldable electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B.

[0079] The gyroscope sensor 180B can be used for anti-shake shooting. The air pressure sensor 180C is used to measure air pressure. In some embodiments, the foldable electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation. The magnetic sensor 180D includes a Hall sensor. The foldable electronic device can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the foldable electronic device is a flip machine, the foldable electronic device can detect the opening and closing of the flip according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, the characteristics such as automatic unlocking of the flip are set. The acceleration sensor 180E can detect the magnitude of the acceleration of the foldable electronic device in all directions (generally three axes). When the foldable electronic device is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.

[0080] Distance sensor 180F, used to measure distance. Foldable electronic devices can measure distance by infrared or laser. In some embodiments, when shooting a scene, the foldable electronic device can use the distance sensor 180F to measure the distance to achieve fast focus. The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The foldable electronic device emits infrared light outward through the light emitting diode. The foldable electronic device uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the foldable electronic device. When insufficient reflected light is detected, the foldable electronic device can determine that there is no object near the foldable electronic device. The foldable electronic device can use the proximity light sensor 180G to detect that the user holds the foldable electronic device close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in the leather case mode, and the pocket mode automatically unlocks and locks the screen.

[0081] The ambient light sensor 180L is used to sense the ambient light brightness. The foldable electronic device can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the foldable electronic device is in the pocket to prevent accidental touch. The fingerprint sensor 180H is used to collect fingerprints. The foldable electronic device can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.

[0082] The temperature sensor 180J is used to detect temperature. In some embodiments, the foldable electronic device uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the foldable electronic device reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the foldable electronic device heats the battery 142 to avoid abnormal shutdown of the foldable electronic device due to low temperature. In other embodiments, when the temperature is lower than another threshold, the foldable electronic device performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0083] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the foldable electronic device, which is different from the position of the display screen 194.

[0084] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of vibrating bones of the human body. The bone conduction sensor 180M can also contact the human body's pulse to receive blood pressure beating signals.

[0085] The button 190 includes a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The foldable electronic device can receive button input and generate key signal input related to the user settings and function control of the foldable electronic device. Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195, or pulled out from the SIM card interface 195 to achieve contact and separation with the foldable electronic device.

[0086] Understandably, Figure 1 The components shown do not constitute a specific limitation on the mobile phone. The mobile phone may also include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. Figure 1 The foldable electronic device shown is used as an example for introduction.

[0087] Figure 2 FIG. 1 shows a software structure block diagram of an electronic device provided by an embodiment of the present application. Figure 2As shown, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the Android runtime (Android runtime) and the system library, and the kernel layer.

[0088] The application layer can include a series of application packages. Figure 2 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include WeChat, QQ, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0089] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions. Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0090] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0091] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0092] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0093] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0094] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages. It can stay for a short time and then disappear automatically without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0095] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0096] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0097] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0098] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0099] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0100] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0101] A 2D graphics engine is a drawing engine for 2D drawings.

[0102] In addition, the system library may also include a form detection module for identifying the physical form of the electronic device. For example, the form detection module can be used to determine the physical form of the electronic device based on the sensor data uploaded by various sensors in the hardware layer. The physical form may include a folded form, an unfolded form, a semi-folded form unfolded at a certain angle, and the like. The system library may also include a coordinate mapping module for recording the first position coordinates of the first display area / control on the side screen, and the second position coordinates of the second display area / control on the main screen / sub-screen, and constructing a mapping relationship between the first position coordinates and the second position coordinates.

[0103] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0104] The hardware layer may include various types of sensors, such as the acceleration sensor, gyroscope sensor, touch sensor, etc. involved in the embodiments of the present application.

[0105] The following is an illustrative description of the software and hardware workflow of the electronic device in conjunction with the touch method in the embodiment of the present application.

[0106] As an example, the sensor in the hardware layer can collect sensor data. For example. The touch sensor in the hardware layer detects the first operation of the user selecting the first display area / control on the side screen. The hardware layer can send the sensor data to the system library through the kernel layer. Since the coordinate mapping module in the system library can store the mapping relationship between the first coordinate of the first display area / control of the side screen and the second coordinate of the second display area / control on the main screen. Therefore, the coordinate mapping module can determine the second coordinate corresponding to the first coordinate, which is the coordinate on the main screen. The system library controls the hardware layer to respond to the operation of the second coordinate on the main screen through the kernel layer.

[0107] Figure 3 A schematic diagram showing various physical forms of an electronic device with a foldable screen provided in one embodiment of the present application. Figure 4 A schematic diagram showing the unfolding angles of an electronic device with a foldable screen in different physical forms provided by an embodiment of the present application is shown. Figure 3 and Figure 4 Introduction to electronic devices.

[0108] like Figure 3 As shown in (a), the display area on the folding screen of the electronic device may include three areas, namely, a first display area 301, a second display area 302 and a third display area 303, wherein the third display area 303 may be a foldable area. When the third display area 303 is bent or deformed, the third display area 303 may form a side screen, such as Figure 3 (b) Figure 3 (c) and Figure 3 (d) as shown.

[0109] In some embodiments, the foldable screen of the electronic device may be a whole screen, and the first display area, the second display area, and the third display area may be different areas on the whole screen. In other embodiments, the foldable screen of the electronic device may also be composed of multiple screens spliced ​​together, for example, three screens spliced ​​together, wherein the first display area is the display area on the first screen, the second display area is the display area on the second screen, the third display area is the display area on the third screen, and so on, which are not limited in the embodiments of the present application. It should be understood that the first display area on the foldable screen can be used as the main screen and the second display area can be used as the secondary screen; or, the first display area can be used as the secondary screen and the second display area as the main screen. The functions of the main screen and the secondary screen may be the same or different. Which area is the main screen and which area is the secondary screen may be specified by the user or may be the factory default setting of the foldable electronic device, which is not limited in the embodiments of the present application.

[0110] In some embodiments, when the angles between the first display area 301 and the second display area 302 on the folding screen are different, the electronic device can form different physical forms, such as a folded form, a semi-folded form opened at a certain angle, an unfolded form, etc. It should be understood that the division of the physical forms of the display screen of the foldable electronic device and the definition of each physical form are not limited in the embodiments of the present application.

[0111] For example, when the electronic device is in the unfolded state, Figure 3 (a) or Figure 3 Specifically, when the electronic device is in the unfolded state, the angle between the first display area 301 and the second display area 302 is a first angle ε; Figure 4 As shown, a2≤ε≤180 degrees, wherein a2 is greater than 90 degrees and less than or equal to 180 degrees. For example, a2 may be 150 degrees, 180 degrees, and so on.

[0112] For example, when the electronic device is in a semi-folded state, Figure 3 Specifically, when the electronic device is in a half-folded state, the angle between the first display area 301 and the second display area 302 is a second angle α; Figure 4 As shown, a1≤α≤a2; wherein a1 is greater than 0 degrees and less than or equal to 90 degrees, and a2 is greater than or equal to 90 degrees and less than 180 degrees. For example, a1 may be 90 degrees, and a2 may be 150 degrees.

[0113] For example, when the electronic device is in a folded form, Figure 3 Specifically, when the electronic device is in a folded state, the angle between the first display area 301 and the second display area 302 is a third angle β; Figure 4 As shown, 0≤β≤a1; wherein a1 is greater than or equal to 0 degrees and less than or equal to 90 degrees. For example, a1 can be 0 degrees, 5 degrees, etc. It should be noted that the specific value range involved in the embodiments of the present application is only an example and not a limitation.

[0114] In the above embodiments, the electronic device is folded left and right. In other embodiments, the electronic device can also be folded up and down. Figure 3 (a) as an example, the bending part can also be Figure 3 (a) is distributed horizontally, so that the electronic device can be folded up and down. For example, see Figure 5 As shown in (a), the folding screen of the electronic device may include a first display area 501, a second display area 502 and a third display area 503. The third display area 503 may be a foldable area. When the third display area 503 is bent or deformed, the angle between the first display area 501 and the second display area 502 changes. Therefore, the electronic device that folds up and down may also include three physical forms, for example, a folded form, a half-folded form, and an unfolded form. The folded form may be as follows: Figure 5 (d) The semi-folded form can be as follows Figure 5 (c) shown in the form, the expanded form can be as follows Figure 5 (a) and Figure 5 (b) The morphology shown.

[0115] In some embodiments, the electronic device can be folded left and right or up and down; or, the electronic device can be folded up and down or left and right. The touch control method provided in the embodiments of the present application can be applied to electronic devices that are folded in various directions. The following embodiments are foldable electronic devices that are folded up and down, for example Figure 5 The electronic device shown in FIG. 1 is taken as an example to introduce Figure 5 The first display area 501 on the foldable electronic device is shown as a main screen, and the second display area 502 is used as a sub-screen for introduction.

[0116] In an embodiment of the present application, when an electronic device equipped with a folding screen is in a folded form, the side screen can be used as a user's touch operation area, that is, the user can perform touch operations on the side screen to control the display content on the main screen and / or sub-screen of the electronic device. One possible scenario is that when the electronic device is in a folded form, the main screen displays the first interface of the first application, and the sub-screen and the side screen are off. After the electronic device detects the user's first touch operation on the side screen, it can map the first touch operation to the second touch operation of the first interface on the main screen to control the first interface on the main screen. Another possible scenario is that when the electronic device is in a folded form, if the electronic device detects the user's first touch operation on the side screen, it can adjust the display brightness, speaker volume, etc. in response to the first touch operation. The following embodiments will provide a detailed introduction to the above possible application scenarios.

[0117] In some embodiments, the electronic device that is folded up and down may be held in a variety of states, such as Figure 6 (a)- Figure 6 (b) Two holding states. Figure 6 (b) is used as an example to describe the holding state. Figure 6 In the holding state shown in (b), the user can control the display content on the main screen by performing touch operations on the side screen with the index finger of the left hand and / or right hand.

[0118] Scenario 1:

[0119] When the electronic device is in the folded state, the main screen displays the first interface of the first application, the secondary screen and the secondary screen are off, and the touch function of the side screen is turned on. After the electronic device detects the user's first touch operation on the side screen, the first touch operation can be mapped to the second touch operation on the main screen for the first interface, thereby realizing the control of the first interface on the main screen.

[0120] Example 1:

[0121] like Figure 7 As shown in (a), the main screen of the electronic device displays a main interface 701, and the secondary screen and the side screen are off. The touch function of the side screen is turned on. The main interface 701 includes one or more application icons. Figure 7 As shown in (a), when the electronic device detects a right swipe operation of the user on the side screen, the electronic device maps the right swipe operation to a right swipe operation in the main interface 701. In response to the right swipe operation, the electronic device displays another main interface 702, wherein the other main interface 702 includes one or more application icons, such as Figure 7In this example, when the electronic device includes multiple main interfaces, the user can browse different main interfaces by sliding the side screen, so that the user can select corresponding applications in different main interfaces.

[0122] Example 2:

[0123] like Figure 8 As shown in (a), the main screen of the electronic device displays an image 801 in the gallery application, and the secondary screen and the side screen are off. When the electronic device detects that the user slides right on the side screen, it displays another image 802. Figure 8 As shown in (b), image 802 is another image in the gallery application other than image 801. For example, when the gallery application includes multiple albums, image 802 and image 801 are images in the same album, for example, image 802 may be the next image of image 801, that is, the image stored immediately after image 801. If the electronic device detects that the user swipes left on the side screen, the previous image of image 801, that is, the image stored immediately before image 801, is displayed.

[0124] Example 3:

[0125] like Fig. 9 As shown in (a), the main screen of the electronic device displays an image 901 of the gallery application, and the secondary screen and the side screen are off. The electronic device detects a first left swipe operation of a user's finger on the side screen, and at the same time detects a first right swipe operation of another finger on the side screen, and the first left swipe operation and the first right swipe operation are operations from the center area of ​​the side screen to the edge, and the electronic device can enlarge the image 901, as shown in FIG. Fig. 9 When the electronic device detects a second left swipe operation of a finger of the user on the side screen, and simultaneously detects a second right swipe operation of another finger on the side screen, and the second left swipe operation and the second right swipe operation are swiping operations from the edge of the side screen to the center area of ​​the side screen, the electronic device can reduce the image 901, as shown in FIG. Fig. 9 (c) as shown.

[0126] Example 4:

[0127] like Fig.10 As shown in (a), the main screen of the electronic device displays a video playback application, such as the playback interface 1001 of the iQiyi application, and the playback interface includes the movie screen currently being played. The secondary screen and the side screen of the electronic device are turned off. When the electronic device detects that the user swipes right on the side screen, the right swipe operation can be mapped to the movie playback interface to fast forward the movie, such as Fig.10 When the electronic device detects a left swipe operation by the user on the side screen, the left swipe operation can be mapped to the movie playback interface to achieve fast rewind of the movie, such as Fig.10 (c) as shown.

[0128] In other examples, the user can also control the movie playback interface through other touch operations on the side screen. For example, when the electronic device detects a single click / double click operation on the side screen, the movie playback can be paused; when the electronic device detects a single click / double click operation again, the movie playback can continue.

[0129] In some embodiments, in order to facilitate users to understand the touch function of the side screen, the electronic device can display a prompt message when the movie starts playing, and the prompt message is used to prompt the user to fast forward / rewind / pause through the side screen. Among them, the prompt information can be an image, text, animated image, short video, etc., which is not limited in the embodiments of the present application. In other embodiments, the electronic device can output a prompt message after detecting that the user triggers the fast forward / rewind operation multiple times, and the prompt message is used to prompt the user to fast forward / rewind / pause through the side screen.

[0130] In other embodiments, the user can also use touch operations on the side screen to turn pages on the main screen of the electronic device (for example, turning pages of e-books), refresh pages (for example, browsing an address book), etc., which are not listed here one by one.

[0131] Scenario 2:

[0132] For example, the electronic device is in a folded state, and the main screen displays the first interface of the first application, or the main interface. If the electronic device detects a first touch operation of the user on the side screen, the display brightness, the volume of the speaker, etc. can be adjusted in response to the first touch operation. For example, the electronic device detects an upward swipe operation / right swipe operation of the user on the side screen, and increases the display brightness or volume of the main screen; the electronic device detects a downward swipe operation / left swipe operation of the user on the side screen, and reduces the display brightness or volume of the main screen and / or the secondary screen.

[0133] In an embodiment of the present application, the electronic device is in a folded form, the main screen displays the first interface, the secondary screen and the side screen can be turned off, and the touch function of the side screen can be turned on. The electronic device can map the first touch operation of the side screen to the second touch operation on the main screen. One possible implementation is that the electronic device can store in advance the mapping relationship between the first display area on the side screen and the second display area on the main screen (for example, the first display area and the second display area can be user-defined areas). When the electronic device detects the first touch operation in the first display area on the side screen, it maps to the second touch operation in the second display area on the main screen according to the mapping relationship. In this embodiment, the first display area on the side screen and the second display area on the main screen can be user-defined or system-default settings, which are not limited in the embodiment of the present application. Another possible implementation is that after the electronic device detects the first touch operation in the first display area on the side screen, it can determine the second display area on the main screen according to the coordinate conversion relationship, and then map the first touch operation to the second touch operation for the second display area on the main screen. In this embodiment, the electronic device does not need to store the mapping relationship between the first display area on the side screen and the second display area on the main screen in advance. No matter which area on the side screen the electronic device detects a touch operation, it can be mapped to the touch operation on the corresponding area on the main screen according to the coordinate conversion relationship. The following embodiments will be described in detail.

[0134] In a first possible implementation manner, the electronic device stores in advance a mapping relationship between a first display area on the side screen and a second display area on the main screen.

[0135] Example 1:

[0136] For example, see Fig.11As shown, the main screen of the electronic device displays the first interface 1101. The electronic device can map the touch function of the A area on the first interface 1101 to the A1 area of ​​the side screen, and map the touch function of the B area in the first interface 1101 to the B1 area of ​​the side screen. Among them, the A area and the B area of ​​the first interface 1101 can be user-defined, and the A1 area and the B1 area of ​​the side screen can also be user-defined. In this way, the user can touch the A area on the main screen through the touch operation of the A1 area on the side screen, and touch the B area on the main screen through the touch operation of the B1 area on the side screen. In some embodiments, the electronic device can provide a selection of the mapping area of ​​the side screen and the main screen through the setting application, that is, the user can select the A1 area and the B1 area on the main screen, and the A area and the B area on the side screen through the setting application, and the electronic device establishes a mapping relationship between the A1 area and the A area according to the user's selection, and establishes a mapping relationship between the B area and the B1 area.

[0137] For example, see Fig.12 As shown, the user selects area 2 on the main screen, and the electronic device can store the coordinates of area 2, for example, the coordinates of point B, the center point of area 2 (x1+x2+x5, y2). The user selects area 1 on the side screen, and the electronic device can store the coordinates of area 1, for example, the coordinates of point A, the center point of area 1 (x1+x4, y3). The electronic device can establish a mapping relationship between point A and point B, or the electronic device can also record the area of ​​area 1 and the area of ​​area 2, and then establish a mapping relationship between area 1 and area 2.

[0138] In some embodiments, after the electronic device has established a mapping relationship between the A1 area and the A area, when the electronic device detects an operation to establish a mapping between the C1 area on the side screen and the C area on the main screen, if there is an overlap between the C1 area and the A1 area, one possible implementation method is that the electronic device can output a prompt message, and the prompt message is used to prompt that the C1 area overlaps with the A1 area, please reselect the C1 area. In this way, it can be avoided that the two overlapping areas on the side screen correspond to different areas on the main screen. Another possible way is that if there is an overlap between the C1 area and the A1 area, the electronic device can determine whether the area of ​​the overlapping area between the C1 area and the A1 area is greater than the preset area. If so, a prompt message is output to prompt the user to reselect the C1 area; if not, a mapping relationship between the C1 area and the C area on the main screen is established.

[0139] In other embodiments, the electronic device detects a user's touch operation on the D1 area on the side screen, and the electronic device determines that the D1 area overlaps the A1 area. Then, the electronic device can determine whether the area of ​​the overlapping area accounts for a larger proportion of the area of ​​the D1 area or the area of ​​the A1 area. If the overlapping area accounts for a larger proportion of the area of ​​the A1 area, it is determined that the corresponding area on the main screen is area A. If the overlapping area accounts for a larger proportion of the area of ​​the DA area, it is determined that the D area on the main screen corresponds to the D1 area (not shown in the figure).

[0140] A second possible implementation method is that after the electronic device detects a first touch operation on the first display area on the side screen, it can determine the second display area on the main screen based on a coordinate conversion relationship, and then map the first touch operation to the second touch operation on the second display area on the main screen.

[0141] Example 1:

[0142] See also Fig.13A As shown, the electronic device constructs a coordinate system, for example, with the short side of the electronic device as the y-axis and the long axis as the x-axis. The electronic device detects a first touch operation on the side screen and determines the position coordinates of the touch area targeted by the first touch operation. Assume that the electronic device determines that the touch area of ​​the first touch operation is Fig.13A The electronic device may determine a point in area 1, such as center point A, and then determine point B on the main screen corresponding to point A according to a preset calculation relationship, and then determine area 2 according to point B, thereby achieving mapping between area 1 on the side screen and area 2 on the main screen. For example, Fig.13A As shown, the coordinates of point A on the side screen are (x1+x4,y3), and the coordinates of point B can be obtained according to the following calculation relationship, where the calculation relationship is as follows:

[0143] The horizontal coordinate of point B is: x1+x2+x4*x3 / x2; x4 is certain;

[0144] The ordinate of point B is: y2=y3*K; wherein K is a proportional value, which may be a preset value; for example, K=1;

[0145] Among them, x1 is the width of the secondary screen, x2 is the width of the side screen, and x3 is the width of the main screen; so x1, x2 and x3 are known, x4, y3 are the area 1 corresponding to the first touch operation determined by the electronic device after detecting the first touch operation on the side screen, and the center point of the area 1 (or any other point). Therefore, the coordinates of point B on the main screen can be obtained by the above formula. Exemplarily, the electronic device can determine a circular area with point B as the center and a radius as a first preset value, and the circular area is area 2, wherein the radius can be 3 cm, 5 cm, etc. It should be noted that the specific value of the radius is not limited in the embodiment of the present application. In addition, the electronic device can also determine areas of other shapes based on point B, which are not circular areas, such as rectangular areas, square areas, etc., and the embodiment of the present application is not limited to this. Therefore, when the electronic device detects a first touch operation in area 1 on the side screen, the first touch operation can be mapped to a second touch operation for area 2 on the main screen.

[0146] Continue to see Fig.13A As shown, when the electronic device maps area 1 on the side screen to area 3 on the secondary screen, it can be calculated by the following formula:

[0147] The horizontal coordinate of point C is: x6=x4*x1 / x2; where x4 is fixed;

[0148] The coordinate system of point C is: y4=K1*y3; K1 is a proportional value, which may be a preset value; for example, K1=1; K1 may be equal to or not equal to K.

[0149] Therefore, the electronic device obtains the horizontal and vertical coordinates of point C, and can then determine the position of area 3. Exemplarily, the electronic device can determine a circular area with point C as the center and a radius as a second preset value, the circular area being area 3, and the second preset value can be the same as or different from the first preset value.

[0150] In some embodiments, Fig.13AAs shown, when the electronic device detects the first touch operation on area 4 on the side screen, if area 4 overlaps with area 1, the area sizes of area 4 and area 1 can be compared. If the area of ​​area 4 is larger, area 5 (not shown in the figure) corresponding to area 4 on the main screen is determined, and then the first touch operation is mapped to area 5 on the main screen; if the area of ​​area 1 is larger, area 2 on the main screen corresponding to area 1 is determined, and then the first touch operation is mapped to area 2 on the main screen. In other embodiments, when the electronic device detects the first touch operation on area 4 on the side screen, if it is determined that there is an overlapping area between area 1 and area 4, the electronic device can determine whether the overlapping area occupies a larger area of ​​area 1 or a larger area of ​​area 4. If it is determined that the overlapping area occupies a larger area of ​​area 1, the first touch operation is mapped to area 2 on the main screen according to the mapping relationship between area 1 and area 2 on the main screen; if it is determined that the overlapping area occupies a larger area of ​​area 4, area 5 (not shown in the figure) corresponding to area 4 on the main screen is determined according to area 4, and then the first touch operation is mapped to area 5 on the main screen.

[0151] Example 2:

[0152] See also Fig. 13B As shown, the electronic device can construct a coordinate system, for example, with the short side of the electronic device as the y-axis and the long axis as the x-axis. After the electronic device detects the first sliding operation on the side screen, it can determine the first touch area corresponding to the first sliding operation. Assuming that the first touch area is Fig. 13B In area 1 shown, the electronic device determines the coordinates of point A and point B in area 1. For example, point A is the starting point of the first sliding operation, and point B is the end point of the first sliding operation, that is, sliding from point A to point B. The electronic device determines that the horizontal coordinates of points A and B are offset (different horizontal coordinates), and the horizontal coordinate of point B can be corrected to point C. For example, the electronic device can perform a correction in the vertical direction based on the coordinates of the starting point A, and obtain the coordinates of the correction point, i.e., point C, as (x1+x5, y4). Therefore, the electronic device can determine the distance in the vertical direction of the first sliding operation on the side screen as the vertical trajectory L2 (such as the dotted line from point A to point C in the figure).

[0153] The electronic device can map point A to point A1; the horizontal coordinate of point A1 is x1+x2+x5*x3 / x2; where x5 is determined; the vertical coordinate of point A1 is y1=y3*k, where k is the scaling ratio, for example, k=1. The electronic device can also determine the distance 1 between A and C, i.e., y3-y4; and then calculate the distance 2 between A1 and C1 as: (y3-y4)k1; k1 is the scaling ratio, for example, k1 is equal to 1, and k1 and k can be the same or different, which is not limited in the embodiments of the present application.

[0154] Therefore, the electronic device obtains the coordinates of point A1 on the main screen and the distance 2 between A1 and C1. Therefore, the electronic device can determine the sliding track L1 between A1 and C1 (eg Fig. 13B The first sliding track from A to B on the side screen is mapped to the second sliding track from A1 to C1 on the main screen. Alternatively, the electronic device can determine the rectangle based on A1 and C1, such as Fig. 13B In area 2 of the side screen, the electronic device can establish a mapping relationship between area 1 on the side screen and area 2 on the main screen.

[0155] In the above embodiment, the actual operation of the user on the side screen is an operation from point A to point B, and the electronic device maps the first sliding track (tilted track) from A to B to the vertical track on the main screen, that is, the second sliding track from A1 to C1. In other embodiments, such as when the width of the side screen is large, the electronic device can also map the user's track from point A to point B on the side screen to the track from A1 to B1 on the main screen, which is not limited in the embodiments of the present application. For example, after the electronic device determines the coordinates of point A on the side screen, it can also determine the angle between AB and AC, and the distance 1 between A and B. The electronic device can map point A to point A1, and then calculate distance 2 (i.e., the distance between A1 and B1) based on the scaling ratio and the distance 1, and then determine the track from A1 to B1 based on the angle, so as to map the first sliding track from A to B on the side screen to the second sliding track from A1 to B1 on the main screen.

[0156] In the above embodiment, the electronic device establishes a mapping relationship between the first display area on the side screen and the second display area on the main screen. In other embodiments, the electronic device may also map the first control on the main screen / secondary screen to the first display area on the side screen, that is, the electronic device establishes a mapping relationship between the first control on the main screen / secondary screen and the first display area on the side screen.

[0157] In some embodiments, the electronic device may map the touch function of the first control on the main screen and / or the secondary screen to the first display area on the side screen. Among them, the first control on the main screen and / or the secondary screen may be selected by the user or set by the system by default, which is not limited in the embodiments of the present application. The first display area on the side screen may also be user-defined or set by the system by default. For example, the electronic device is in a folded form, the main screen displays the first interface of the first application, and the side screen and the secondary screen are off. The electronic device may map the touch function of a control in the first interface to the first display area on the side screen. As an example, when multiple controls on the main screen or the secondary screen need to be mapped to the side screen, each control on the main screen may correspond to an area on the side screen. As other examples, when a control on the main screen or the secondary screen needs to be mapped to the first display area of ​​the side screen, the first display area may be all or part of the area of ​​the side screen. Of course, after the electronic device maps the touch function of the first control on the main screen to the side screen, the touch function of the first control on the main screen may be turned off.

[0158] For example, when one or more control icons are displayed on the main screen, the electronic device may only map the touch function of the first control on the main screen to the first display area on the side screen (the first display area may be user-defined), that is, the side screen does not display the icon of the first control, but the first display area of ​​the side screen has a touch function. After the electronic device detects the touch operation on the first display area on the side screen, it maps the touch operation to the operation on the first control / control icon on the main screen and / or the sub-screen.

[0159] In some embodiments, each of the one or more controls on the main screen may correspond to an area on the side screen. For example, different areas on the side screen may display different color information. For example, area 1 on the side screen displays gray, and area 1 corresponds to control 1 on the main screen. Area 2 on the side screen displays black, and area 2 corresponds to control 2 on the main screen, so as to facilitate users to distinguish the mapping relationship between each area on the side screen and the controls on the main screen and / or the secondary screen. Exemplarily, after the electronic device maps the touch function of the first control on the main screen and / or the secondary screen to the first display area on the side screen, the first display area on the side screen may be lit up. For example, only the first display area on the side screen may be lit up, and other areas on the side screen except the first display area may not be lit up.

[0160] In other embodiments, the electronic device may map the icon of the first control / control (one or more controls / controls) on the main screen and / or the secondary screen to the first display area on the side screen. The first control on the main screen may be selected by the user, and the first display area on the side screen may also be selected by the user.

[0161] As an example, when one or more icons of controls are displayed on the main screen of the electronic device, the electronic device can map the first icon of the first control on the main screen to the side screen, that is, the side screen displays the first icon. After the electronic device detects a first operation of the user on the side screen for the first icon, the first operation can be mapped to the icon for the first control on the main screen and / or the secondary screen.

[0162] Example 1:

[0163] like Fig.14 As shown in (a), the main screen of the electronic device displays a game interface 1101 of a game application such as King of Glory. The game interface 1101 includes a touch area 1102 (for example, a game controller touch area) and multiple controls, such as control 1103, control 1104 and control 1105, each of which implements a different game function. One possible implementation is that the electronic device detects an operation for setting a control 1106 in the game interface 1101 and displays multiple options, such as a "sound effect setting" option and a "side screen mapping" option, such as Fig.14 (b) When the electronic device detects an operation on the "side screen option", a prompt box is displayed, such as Fig.14 As shown in (c), the prompt box includes a prompt message "Please select the area / position to be mapped in the game interface". When the electronic device detects the "I know" control, the prompt box is hidden, such as Fig.14 (d) is shown. The electronic device detects the operation of the user selecting a control in the game interface, and in response to the operation, can determine the control to be mapped. The operation of selecting a control in the game interface can be an operation of clicking the area where the control is located, or a circle selection operation, etc. For example, Fig.14 As shown in (d), the electronic device detects the user's circle selection operation on the game interface, determines that the control within the area enclosed by the circle selection operation is the control 1103, and determines that the control 1103 is the control to be projected to the side screen.

[0164] After the electronic device detects the user's operation of selecting a control in the game interface, a pop-up message may be displayed. Fig.14 (e) shows a prompt box, which includes the prompt information "Reselect or continue setting", and two controls "Reselect" and "Continue setting". When the electronic device detects an operation for the "Reselect" control, the electronic device can re-determine the control to be mapped to the side screen according to the user's selection operation in the game interface. That is, if the user clicks the "Reselect" control, the control to be mapped to the side screen can be re-selected in the game interface. When the electronic device detects a control for the "Continue setting", it can display Fig.14 (f) shows the prompt box. Fig.14 As shown in (f), the prompt box includes a prompt message "Please select the projection area on the side screen". When the electronic device detects the operation of the "I know" control, the prompt box can be hidden, such as Fig.14 When the electronic device detects a user's touch operation on the side screen, it determines that the area where the touch operation is located is the target area where the control is to be projected. Fig.14 As shown in (g), after the electronic device detects that the user operates in the white area 1108 of the side screen, the output is as follows: Fig.14 (h) shows a prompt box, which includes the information of "Reselect or Complete Settings" and two controls of "Reselect" or "Complete Settings". When the electronic device detects an operation on the "Reselect" control, the projection target area can be re-determined according to the user's touch operation on the side screen. When the electronic device detects an operation on the "Complete Settings" control, a mapping relationship between the target area 1108 of the side screen and the control 1103 in the game interface can be established. In this way, the electronic device detects that the user's operation on the target area 1108 of the side screen can be mapped to the operation on the control 1103 in the game interface. For example, single-click / double-click / long press operations.

[0165] In some embodiments, after the electronic device establishes a mapping relationship between the control 1103 in the game interface and the target area 1108 of the side screen, the display of the control 1103 in the game interface can be canceled, or the touch function of the control 1103 in the game interface can be turned off. In other embodiments, after the electronic device establishes a mapping relationship between the control 1103 in the game interface and the target area 1108 of the side screen, the icon of the control 1103 can be displayed in the target area 1108 of the side screen.

[0166] Example 2:

[0167] like Fig.15 As shown in (a), the main screen of the electronic device displays a game interface 1101, which includes a touch area 1102 and multiple controls, such as control 1103, control 1104 and control 1105, each of which implements a different function. A possible implementation is that the electronic device detects an operation for setting a control 1106 in the game interface 1101 and displays multiple options, such as a "sound effect setting" option and a "side screen mapping" option, such as Fig.15 (b) When the electronic device detects an operation on the "side screen option", a prompt box is displayed, such as Fig.15 As shown in (c), the prompt box includes a prompt message "Please select the icon of the control to be mapped in the game interface and drag it to the side screen."

[0168] One possible implementation is, Fig.15 As shown in (d), when the electronic device detects that the icon of control 1103 is dragged to the side screen, the icon of control 1103 in the game interface can be hidden, and the icon of control 1103 can be displayed on the side screen. The icon of control 1103 displayed on the side screen can be the same as or different from the icon of control 1103 in the game interface; or, the electronic device can only light up the area where control 1103 is located on the side screen, that is, the area where the icon of control 1103 is dragged to the side screen. Another possible situation is that when the electronic device detects that the icon of control 1103 is dragged to the side screen, the icon of control 1103 is still displayed in the game interface, but the touch function of control 1103 is turned off.

[0169] The above examples 1 and 2 list that the electronic device maps the user-selected controls on the main screen to the side screen according to the user's selection. In other embodiments, the electronic device can also choose which controls on the main screen to map to the side screen by itself, without user selection. As an example, the main screen of the electronic device displays the first interface, and the electronic device can determine the control with the most or least clicks in the first interface, or the number of clicks is greater than or equal to the first preset number of times, or the number of clicks is less than or equal to the second preset number of times, and map the control to the side screen; or, the electronic device can determine the control that occupies the largest area in the first interface of the main screen, and map the control to the side screen without blocking the first interface. In some embodiments, after the electronic device automatically maps the controls in the first interface to the side screen, it can output a prompt message, which is used to prompt the user which controls in the first interface are mapped to the side screen.

[0170] In the above embodiment, the electronic device may associate and map an area on the side screen with an area / control on the main screen. That is, multiple areas on the side screen are associated and mapped one by one with multiple areas / controls on the main screen. In other embodiments, the electronic device may associate and map an area on the side screen with multiple areas / controls on the main screen. In this way, when the electronic device detects the user's operation on the area on the side screen, the operation may be mapped to multiple areas / controls on the main screen, thereby realizing simultaneous operation on multiple areas / controls on the main screen. Therefore, the user operates on multiple areas / controls on the main screen at the same time by operating on an area on the side screen. In other embodiments, the electronic device may associate and map multiple areas on the side screen with an area / control on the main screen. In this way, when the electronic device detects the user's operation on any of the multiple areas on the side screen, the operation may be mapped to the same area / control on the main screen, thereby realizing operation on the area / control on the main screen.

[0171] It should be noted that in the above embodiment, the mapping between the main screen and the side screen is taken as an example. In actual applications, the mapping between the secondary screen and the side screen can also be carried out in the same way, which will not be repeated here.

[0172] In some embodiments, the electronic device can turn on or off the touch mapping function of the side screen. When the electronic device turns on the touch mapping function of the side screen, the user can perform touch operations on the side screen to control the display content of the main screen / secondary screen of the electronic device. When the electronic device turns off the touch mapping function of the side screen, when the user performs a touch operation on the side screen, the main screen / secondary screen of the electronic device will be unresponsive. Exemplarily, the electronic device can start the touch mapping function of the side screen when it detects that it meets certain conditions. The following embodiments introduce several examples.

[0173] Example 1: When the electronic device detects that the device switches from an unfolded state to a folded state, the touch mapping function of the side screen is automatically activated.

[0174] For example, when the unfolding angle of the electronic device changes from 180 degrees to 0 degrees, or the physical form of the electronic device changes from Figure 5 The semi-folded shape shown in (c) changes to Figure 5 When the folded form is shown in (d), the touch mapping function of the side screen is automatically activated.

[0175] Example 2: When the electronic device detects that the first interface of the first application is displayed in full screen on the main screen or the secondary screen, the touch mapping function of the side screen can be automatically started. For example, when the electronic device is in a semi-folded form or an unfolded form, the first interface of the first application is displayed in full screen on the main screen, and the secondary screen and the side screen are off, the electronic device can automatically start the touch mapping function of the side screen. For another example, when the electronic device is in an unfolded form and the first interface of the first application is displayed in full screen on the main screen, the electronic device can automatically start the touch mapping function of the secondary screen, that is, map the touch operation on the secondary screen to the main screen, that is, in the unfolded form, the user can operate the main screen by operating the secondary screen.

[0176] In some embodiments, the first application may be a preset application, or any one or more applications among all the applications in the electronic device. Among them, the preset application may be one or more applications specified by the user; it may also be one or more applications set by default after the electronic device leaves the factory; it may also be one or more applications determined by the electronic device based on the user's usage habits, for example, it may be one or more applications determined by the electronic device that the user frequently uses; it may also be one or more applications belonging to a certain specific application type, for example, game applications, video applications, or audio applications, etc., which are not limited in the embodiments of the present application. In other embodiments, the first interface of the first application may also be the main interface (or desktop), negative one screen, etc. of the foldable electronic device.

[0177] It should be noted that in the embodiment of the present application, the side screen mapping functions of different applications may be different. Because the controls, touch areas, etc. included in the display interface of each application are different. For example, the display interfaces of some applications mostly display controls, such as WeChat; the display interfaces of some applications are mostly touch areas, such as iQiyi. Therefore, for different applications, the mapping relationship between the touch area on the side screen and the touch area on the main screen may be different. In other embodiments, the side screen mapping functions of different interfaces of the same application may also be different. Because the controls and touch areas included in different interfaces of the same application are different, for example, the controls and touch areas included in the WeChat Moments and WeChat chat interfaces are different. Therefore, for different interfaces of the same application, the mapping relationship between the touch area of ​​the side screen and the touch area on the main screen may also be different. Therefore, when the electronic device detects that the first interface of the first application is displayed in full screen on the main screen or the secondary screen, the touch mapping function of the side screen corresponding to the first application can be automatically started; or the side screen touch mapping function corresponding to the first interface of the first application is started.

[0178] In some embodiments, the first interface of the first application displayed in full screen on the main screen may be the first interface of the first application displayed in full screen in an area on the main screen that can be used to display the application interface. For example, the main screen has a status bar and a navigation bar. When the status bar on the main screen cannot be hidden, but the navigation bar can be hidden, the first interface of the first application is displayed in full screen on the main screen, that is, the first interface of the first application is displayed in full screen in all display areas on the main screen except the status bar. For another example, when the status bar and the navigation bar on the main screen cannot be hidden, the first interface of the first application is displayed in full screen on the main screen, that is, the first interface of the first application is displayed in full screen in all display areas on the main screen except the status bar and the navigation bar. For another example, when both the status bar and the navigation bar on the main screen can be hidden, the first interface of the first application is displayed in full screen on the main screen, that is, the first interface of the first application is displayed in full screen in all display areas on the main screen (including the area where the status bar and the navigation bar are located).

[0179] Example 3: When the electronic device detects that it is in the first holding state, the touch mapping function of the side screen is activated; or, after the electronic device detects that it is in the first holding state and maintains it for a preset time, the touch mapping function of the side screen is activated.

[0180] Exemplarily, the first holding state may be as follows: Figure 6 (a) or Figure 6 (b) The holding state shown. In some embodiments, the electronic device can determine the holding state based on the fingerprints detected on the main screen and the secondary screen. For example, see Fig.16 As shown, the foldable electronic device detects two fingerprints on the main screen and detects 8 fingerprints on the secondary screen, then it is determined that the foldable electronic device is in the first holding state.

[0181] Example 4: When the electronic device does not start the touch mapping function of the side screen, if the electronic device receives multiple touch operations of the user on the main screen / secondary screen, it can output prompt information to prompt the user to start the touch mapping function of the side screen. For example, when the interface of a game application is displayed in full screen on the main screen of the electronic device, the electronic device detects that the number of touch operations of the user in the interface is greater than a preset number, and can output prompt information, which is used to prompt the user to set the touch mapping function of the side screen.

[0182] Example 5: The touch mapping function of the side screen may be provided and activated before the electronic device leaves the factory, or may be activated through user settings. For example, the user may activate the touch mapping function of the side screen through a settings application in the electronic device.

[0183] It should be noted that the above embodiments are only examples of triggering conditions for several electronic devices to activate the touch mapping function of the side screen. In practical applications, the above different examples can be used in combination, and the embodiments of this application are not limited. After the electronic device activates the touch mapping function of the side screen, the main screen / secondary screen can be touched through the side screen.

[0184] See also Fig.17 As shown, it is a flow chart of the touch control method provided in the embodiment of the present application, such as Fig.17 As shown, the method includes:

[0185] 1701. Detect a first operation, start a first application, and display a first interface of the first application.

[0186] It should be understood that the first application can be any application in the electronic device, such as WeChat, Weibo, iQiyi, etc., and the embodiments of the present application are not limited thereto.

[0187] 1702. A second operation is detected, where the second operation is used to start a side screen touch mapping function.

[0188] 1703, determine whether to enter the fingerprint, if yes, execute 1604, if not, prompt to enter the fingerprint.

[0189] In some embodiments, in order to improve device security, the electronic device can enter a user fingerprint before starting the side screen touch mapping function. If the user fingerprint is consistent with a pre-stored fingerprint (the fingerprint of the user of the electronic device), the side screen touch mapping function is started.

[0190] 1704, determine whether the electronic device is currently in a folded state, if so, execute 1605, if not, output a first prompt message, the first prompt message is used to prompt the user that the electronic device is currently in an unfolded state and cannot use the side screen touch mapping function.

[0191] 1705. According to the user operation, the electronic device establishes a mapping relationship between the first display area on the side screen and the second display area on the main screen.

[0192] Among them, the process of the electronic device establishing a mapping relationship between the first display area on the side screen and the second display area on the main screen can be referred to the aforementioned embodiment and will not be repeated here.

[0193] 1706. The side screen reports a first touch event.

[0194] 1707, determine whether the fingerprint corresponding to the first touch event is successfully authenticated, if so, execute 1708, if not, output a second prompt message, the second prompt message is used to prompt the user that the fingerprint authentication fails.

[0195] 1708, start safe time.

[0196] In some embodiments, the electronic device detects a first touch event on the side screen. After the fingerprint corresponding to the first touch event is successfully verified, a safe time can be started. During this safe time, if the electronic device detects other touch events on the side screen, the fingerprint does not need to be verified. Outside of this safe time, if the electronic device detects other touch events on the side screen, the fingerprint needs to be verified again, which helps to improve the security of the device.

[0197] 1709 , determining whether there is a fourth area corresponding to the third display area corresponding to the first touch event in the mapping relationship, if yes, executing 1610 , if no, not responding.

[0198] 1710. The first application responds to a second touch event, where the second touch event is directed to a fourth area in the first interface, and the second touch event corresponds to the first touch event.

[0199] Exemplarily, the electronic device detects a first touch event on the side screen and maps it to a second touch event on the main screen or the sub-screen, thereby achieving reasonable use of the side screen.

[0200] The above-mentioned implementation modes of the embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0201] In combination with the above embodiments and related drawings, the embodiments of the present application provide a touch control method, which can be implemented in an electronic device with a foldable display screen (such as a mobile phone with a foldable screen, a tablet computer with a foldable screen, etc.). For example, the structure of the electronic device can be as follows Figure 1 , Figure 2 , Figure 3 and / or Figure 5 As shown. Figure 5 For example, the foldable display includes a first display area, a second display area, and a third display area. When the electronic device is in a folded state, the angle between the first display area and the second display area is less than or equal to a first preset angle, and the third display area is set between the first display area and the second display area. Fig.18 As shown, the method may include the following steps:

[0202] 1801. A first operation in the third display area is detected.

[0203] Exemplarily, when the electronic device is in a folded form, the third display area is the side screen, and the first operation may include any one of single-click, double-click, long press, slide, long press and continuous slide after long press.

[0204] 1802. Control the first display area and / or the second display area.

[0205] Exemplarily, controlling the first display area and / or the second display area may be updating the display interface in the first display area and / or the second display area; or controlling functions in the first display area and the second display area.

[0206] Exemplarily, the electronic device may control the first display area and / or the second display area according to the orientation. For example, when the electronic device determines that the first display area is facing the user, the first display area is controlled, and when the electronic device determines that the second display area is facing the user, the second display area is controlled. There are multiple ways to determine which display area of ​​the electronic device is facing the user.

[0207] For example, it is determined that the first touch area of ​​the first display area is smaller than the second touch area of ​​the second display area, and the first display area is controlled; or it is determined that the first touch area of ​​the first display area is larger than the second touch area of ​​the second display area, and the second display area is controlled. Figure 6 As shown in (b), the electronic device is in a folded state, and the user is holding the electronic device. When the contact area between the user and the secondary screen is greater than the contact area between the user and the main screen, it can be determined that the main screen is facing the user.

[0208] For another example, it is determined that the first distance between the second display area and the user is greater than the second distance between the first display area and the user, and the first display area is controlled; or it is determined that the second distance between the second display area and the user is less than the second distance between the first display area and the user, and the second display area is controlled. Exemplarily, a first sensor may be set on the first surface where the first display area of ​​the electronic device is located, and a second sensor may be set on the second surface where the second display area of ​​the electronic device is located. The first sensor may detect the first distance between the user and the first display area, and the second sensor may detect the second distance between the user and the second display area. If the first distance is greater than the second distance, the first display area is far away from the user and the second display area is close to the user, indicating that the second display area is facing the user; if the first distance is less than the second distance, the first display area is close to the user and the second display area is far away from the user, indicating that the first display area is facing the user. Among them, the first sensor may be a distance sensor, an infrared sensor, etc., and the second sensor may also be a distance sensor, an infrared sensor, etc.

[0209] For another example, when it is determined that the image captured by the first camera on the first surface where the first display area is located includes user-specific features (e.g., face, eyes, skin, clothing, etc.), the first display area is controlled; or when it is determined that the image captured by the second camera on the second surface where the second display area is located includes user-specific features (e.g., face, eyes, skin, clothing, etc.), the second display area is controlled. Exemplarily, a first camera may be set on the first surface where the first display area of ​​the electronic device is located, and a second camera may be set on the second surface where the second display area of ​​the electronic device is located. The first camera may capture a first image. If the first image includes a face, the first display area faces the user. If the second camera captures a second image, if the second image includes a face, the second display area faces the user. Alternatively, when the first image captured by the first camera includes a face and the second image captured by the second camera does not include a face, the first display area is determined to face the user. Alternatively, when the second image captured by the second camera includes a face and the first image captured by the first camera includes a face, the second display area is determined to face the user.

[0210] For another example, when it is determined that the first display area is on and the second display area is off, the first display area is controlled, or when it is determined that the first display area is off and the second display area is on, the second display area is controlled. Figure 6 Taking (b) as an example, the electronic device is in a folded state, the main screen is on, and the secondary screen is off. At this time, the electronic device can control the main screen through the first operation on the side screen.

[0211] In the above embodiments provided by the present application, the method provided by the embodiment of the present application is introduced from the perspective of the electronic device (mobile phone 100) as the execution subject. In order to implement the various functions in the method provided by the above embodiments of the present application, the terminal device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0212] As used in the above embodiments, the term "when..." or "after..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)", depending on the context. In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship and order between the entities.

[0213] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0214] Note: A portion of this patent application document contains material which is subject to copyright protection. The copyright owner reserves all rights reserved except for the production of copies of the material in the patent file or patent record in the Patent Office.

Claims

1. A touch control method, characterized in that: Applied to an electronic device including a main screen and a side screen, the method includes: The main screen displays a first interface of a game application, wherein the first interface includes a first control for realizing a game function; wherein the main screen displays the first interface in a horizontal position, and when the main screen displays the first interface in a horizontal position, the side screen is located above the main screen, and the side screen is black, and does not display the interface of the game application; When the electronic device detects a trigger operation to confirm mapping the controls of the first interface to the side screen, the electronic device prompts the user to drag the controls of the first interface to the side screen for mapping; If it is detected that the first control is dragged to the first position of the side screen, a third control is displayed at the first position of the side screen; the icon of the third control is different from the icon of the first control; After detecting that the operation setting of dragging the control of the first interface to the side screen for mapping is completed, hiding the first control of the first interface and lighting up the third control on the side screen; A user's touch operation on the third control is detected, and the first game function of the first control is executed.

2. The method according to claim 1, characterized in that The executing the first game function of the first control comprises: Update the first interface; or adjust the functions on the first interface.

3. The method according to claim 1 or 2, characterized in that Before executing the first game function of the first control, the method further includes: It is determined that a first touch area of ​​the main screen is smaller than or equal to a second touch area of ​​a screen disposed opposite to the main screen.

4. The method according to claim 1 or 2, characterized in that: Before executing the first game function of the first control, the method further includes: It is determined that a first distance between a screen arranged opposite to the main screen and a user is greater than a second distance between the main screen and the user.

5. The method according to claim 1 or 2, characterized in that: Before executing the first game function of the first control, the method further includes: It is determined that the image captured by the first camera of the main screen includes user-specific features.

6. The method according to claim 1 or 2, characterized in that: Before executing the first game function of the first control, the method further includes: Determine that the main screen is turned on and the screen set opposite to the main screen is turned off.

7. The method according to claim 1 or 2, characterized in that: The executing the first game function of the first control comprises: Adjust the brightness of the main screen display, or adjust the volume of the electronic device.

8. An electronic device, characterized in that: include: Main screen and side screen; one or more processors; one or more memories; One or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the electronic device performs the following steps: The main screen displays a first interface of a game application, wherein the first interface includes a first control, and the first control is used to implement a game function; wherein the main screen displays the first interface in a horizontal position, and when the main screen displays the first interface in a horizontal position, the side screen is located above the main screen, and the side screen is black, and does not display the interface of the game application; When the electronic device detects a trigger operation to confirm mapping the controls of the first interface to the side screen, the electronic device prompts the user to drag the controls of the first interface to the side screen for mapping; If it is detected that the first control is dragged to the first position of the side screen, a third control is displayed at the first position of the side screen; the icon of the third control is different from the icon of the first control; After detecting that the operation setting of dragging the control of the first interface to the side screen for mapping is completed, hiding the first control of the first interface and lighting up the third control on the side screen; A user's touch operation on the third control is detected, and the first game function of the first control is executed.

9. The electronic device according to claim 8, characterized in that: When the instructions are executed by the one or more processors, the electronic device performs the following steps: Update the first interface; or adjust the functions on the first interface.

10. The electronic device according to claim 8 or 9, characterized in that: When the instructions are executed by the one or more processors, the electronic device further performs the following steps: It is determined that a first touch area of ​​the main screen is smaller than or equal to a second touch area of ​​a screen disposed opposite to the main screen.

11. The electronic device according to claim 8 or 9, characterized in that: When the instructions are executed by the one or more processors, the electronic device further performs the following steps: It is determined that a first distance between a screen arranged opposite to the main screen and a user is greater than a second distance between the main screen and the user.

12. The electronic device according to claim 8 or 9, characterized in that: When the instructions are executed by the one or more processors, the electronic device further performs the following steps: It is determined that the image captured by the first camera of the main screen includes user-specific features.

13. The electronic device according to claim 8 or 9, characterized in that: When the instructions are executed by the one or more processors, the electronic device further performs the following steps: Determine that the main screen is turned on and the screen set opposite to the main screen is turned off.

14. The electronic device according to claim 8 or 9, characterized in that: When the instructions are executed by the one or more processors, the electronic device performs the following steps: Adjust the brightness of the main screen display, or adjust the volume of the electronic device.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the method according to any one of claims 1 to 7.

Images