Display method and electronic device

Abstract

The present application provides a display method and an electronic device; it relates to the field of terminal technology, and determines the speed of moving and displaying the first content based on the folding angle of the electronic device, so that the display effect of the first content meets the user's needs. The method is applied to a foldable electronic device, and the electronic device includes a first shell, a second shell and a rotating shaft. The first shell and the second shell can rotate relative to the rotating shaft, and a first circuit board and a second circuit board are respectively arranged in the first shell and the second shell, and a first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board. The electronic device determines the angle between the first shell and the second shell at least based on the first sensor and the second sensor. The method includes: the electronic device receives a first operation acting on the first content during the process of displaying the first content, and in response to the first operation, determines the moving speed of the first content according to the angle between the first shell and the second shell, and moves and displays the first content.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a display method and an electronic device. Background Art

[0002] With the development of smart terminal technology, the types of electronic device display screens have also become more diverse, including full-screen electronic devices, curved-screen electronic devices, foldable screen electronic devices, etc. Among them, foldable screen electronic devices are increasingly favored by users because of their foldable display screens, easy to carry, and variable display screen viewing area. For example, Figure 1 As shown in (a), the electronic device is a folding screen electronic device, and its display screen is foldable. Assume that the electronic device is an inner folding screen electronic device, such as Figure 1 As shown in (b), the electronic device folds the display screen inwardly using the rotating shaft, so that the display screen forms at least two screens (for example, screen A and screen B). Alternatively, assuming that the electronic device is an external folding screen electronic device, such as Figure 1 As shown in (c), the electronic device uses a rotating shaft to fold the display screen outward, so that the display screen forms at least two screens (for example, screen C and screen D). It can be seen that when the electronic device remains in a folded state, it can reduce the occupied space and be easy to carry. After the electronic device is unfolded, the display area of ​​the display screen can be increased, improving the user experience.

[0003] The virtual objects displayed on the display screen of the electronic device can move the display position in response to user operations. Figure 1 As shown in (a), it is assumed that in a gravity game scene, in response to the user's operation of tilting the electronic device, the virtual item M moves from position 1 to position 2. However, Figure 1 As shown in (b) or (c), the display screen of the electronic device is not fully unfolded as shown in Figure 1 In the fully expanded state shown in (a), if the virtual item needs to be displayed across screens (e.g., the virtual item displayed on screen A needs to be moved to screen B for display), the moving direction, moving speed, and final display position of the virtual item are different from those in the fully expanded state. Figure 1 The fully expanded display screen shown in (a) causes the final display effect to be different from the user's actual perception, affecting the user experience. Summary of the invention

[0004] The display method and electronic device provided in the embodiments of the present application can determine the moving speed of the first content for mobile display based on the folding angle of the electronic device, so that the display effect of the first content meets the user's needs and improves the user experience.

[0005] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:

[0006] In a first aspect, an embodiment of the present application provides a display method, which is applied to a foldable electronic device; the electronic device includes a first housing, a second housing and a rotating shaft; the first housing and the second housing can rotate relative to the rotating shaft; a first circuit board is arranged in the first housing, and a second circuit board is arranged in the second housing; a first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board; the electronic device determines the angle between the first housing and the second housing at least according to the first sensor and the second sensor; the method includes: the electronic device displays a first content through a display screen. A first operation acting on the first content is received. In response to the first operation, the first content is moved and displayed on the display screen. The first content is moved and displayed on the display screen, including: when the angle between the first housing and the second housing is a first angle, the first content is moved and displayed on the display screen at a first speed; when the angle between the first housing and the second housing is a second angle, the first content is moved and displayed on the display screen at a second speed; the first angle is different from the second angle, and the first speed is different from the second speed.

[0007] The first content includes, for example, various user interface elements, such as icons, controls, avatars, characters, game props, etc. For example, the first content is an application icon. For another example, the first content is a game character, game props, etc. displayed in a game interface. The angle between the first shell and the second shell can also be described as the folding angle of the electronic device.

[0008] In one embodiment, the first operation includes one or more of the following: an operation of clicking on the first content, an operation of long pressing the first content, an operation of clicking and dragging the first content, a sliding operation on the first content, a somatosensory operation, a preset gesture operation, an operation of operating a preset control, and an operation of tilting the display screen.

[0009] In this way, the electronic device can adaptively control the moving speed of the first content displayed on the display screen according to different folding angles, thereby making the movement trajectory and movement state of the first content close to the user's real perception and meeting the user's needs.

[0010] In a possible implementation, the electronic device determines the angle between the first shell and the second shell at least based on the first sensor and the second sensor, including: when the electronic device is in the first folded state, the first sensor obtains the first sensing parameter, the second sensor obtains the second sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is the first angle at least based on the first sensing parameter and the second sensing parameter. When the electronic device is in the second folded state, the first sensor obtains the third sensing parameter, the second sensor obtains the fourth sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is the second angle at least based on the third sensing parameter and the fourth sensing parameter.

[0011] The first folding state and the second folding state are used to represent the state of the electronic device at different folding angles. When the folding state changes, the sensor in the electronic device will measure parameters to determine the folding angle of the electronic device.

[0012] In some embodiments, the first sensor includes at least one of a first acceleration sensor or a first gyroscope sensor, and the second sensor includes at least one of a second acceleration sensor or a second gyroscope sensor. Exemplarily, based on a fusion algorithm of the acceleration sensor measurement value and the gyroscope sensor measurement value, the acceleration value measured by the acceleration sensor and the angular velocity components in each direction measured by the gyroscope sensor are integrated to obtain the virtual gravity acceleration of the electronic device in any posture and any motion mode, thereby determining the folding angle of the electronic device.

[0013] In a possible implementation, moving and displaying the first content on the display screen further includes: when the angle between the first shell and the second shell is a first angle, moving and displaying the first content on the display screen with a first acceleration; when the angle between the first shell and the second shell is a second angle, moving and displaying the first content on the display screen with a second acceleration, and the first acceleration is different from the second acceleration.

[0014] That is, when the electronic device is folded at different angles, the movement speed and acceleration of the first content are different. Based on different folding angles, the electronic device controls the movement speed and acceleration of the first content to meet the user's real perception needs.

[0015] In one possible implementation, the display screen includes a first display area and a second display area, the first display area is set on the first shell, and the second display area is set on the second shell. In response to a first operation, the first content is moved and displayed on the display screen, including: in response to the first operation, the first content displayed on the first display area is moved to the second display area for display.

[0016] Exemplarily, the electronic device displays the first content on the first display area, and in response to the first operation, moves the first content to the second display area. Wherein, the first shell and the second shell can rotate relative to the rotation axis, and the moving display process is to control the first content to be displayed across the rotation axis.

[0017] In a possible implementation, moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a first position on the first display area to a second position on the second display area. The trajectory may be continuous.

[0018] In some embodiments, the electronic device may be an inner folding screen electronic device or an outer folding screen electronic device. For example, when the folding angle of the electronic device is d, and when 0 degrees ≤ d ≤ 180 degrees, the electronic device is an inner folding screen electronic device, and the electronic device controls the first content to be continuously moved and displayed from the first display area to the second display area for display. Further, the electronic device can determine the speed and acceleration of the first content when it moves out of the cross-rotating axis area on the second display area according to the speed of the first content when it moves into the cross-rotating axis area on the first display area. The first content is controlled to move and display from entering the cross-rotating axis area to moving out of the cross-rotating axis area, and the obtained speed and acceleration are used to continue to control the movement and display of the first content from the position of the cross-rotating axis area. Among them, the speed when moving into the cross-rotating axis area and the speed when moving out of the cross-rotating axis area are linearly changed and transitioned in a preset manner, so as to control the moving speed of the first content in the cross-rotating axis area, and ensure the smoothness of the speed change and the smoothness of the dynamic effect of the first content during the movement of the cross-rotating axis area.

[0019] In a possible implementation, moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a third position to a fourth position on the first display area, and displaying a trajectory of the first content moving from a fifth position to a sixth position on the second display area, wherein the fourth position and the fifth position are different. The fourth position may be located in the first display area, and the fifth position may be located in the second display area.

[0020] In some embodiments, the folding angle of the electronic device is d, and when 180 degrees ≤ d ≤ 360 degrees, the electronic device is an external folding screen electronic device, and the first electronic device controls the first content to move from the first display area to the second display area, and the motion trajectory is discontinuous. Furthermore, the electronic device can determine the target position of the first content displayed on the second display area, as well as the speed and acceleration at the target position, based on the speed at which the first content moves from the first display area to the cross-axis area. The first content is controlled to move from entering the cross-axis area to the edge position of the first display area, and the edge position of the first display area corresponds to the axis position. Thereafter, the first content is directly displayed at the target position, that is, the first content is not displayed between the edge position of the first display area and the target position on the second display area, and the first content is continued to be controlled to move and display on the second display area from the target position using the obtained speed and acceleration.

[0021] In a second aspect, an embodiment of the present application provides an electronic device, which is a foldable electronic device; the electronic device includes a first housing, a second housing and a rotating shaft; the first housing and the second housing can rotate relative to the rotating shaft; a first circuit board is arranged in the first housing, and a second circuit board is arranged in the second housing; a first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board; the electronic device determines the angle between the first housing and the second housing at least according to the first sensor and the second sensor; the electronic device also includes: a processor, a memory and a display screen; the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, when the processor reads the computer instructions from the memory, the electronic device performs the following operations: displaying the first content through the display screen. Receive a first operation acting on the first content. In response to the first operation, move and display the first content on the display screen. Move and display the first content on the display screen, including: when the angle between the first housing and the second housing is a first angle, move and display the first content on the display screen at a first speed; when the angle between the first housing and the second housing is a second angle, move and display the first content on the display screen at a second speed; the first angle is different from the second angle, and the first speed is different from the second speed.

[0022] In a possible implementation, the electronic device determines the angle between the first shell and the second shell at least based on the first sensor and the second sensor, including: when the electronic device is in the first folded state, the first sensor obtains the first sensing parameter, the second sensor obtains the second sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is the first angle at least based on the first sensing parameter and the second sensing parameter. When the electronic device is in the second folded state, the first sensor obtains the third sensing parameter, the second sensor obtains the fourth sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is the second angle at least based on the third sensing parameter and the fourth sensing parameter.

[0023] In one possible implementation, when the processor reads computer instructions from the memory, it also causes the electronic device to perform the following operations: when the angle between the first shell and the second shell is a first angle, the first content is displayed on the display screen at a first acceleration; when the angle between the first shell and the second shell is a second angle, the first content is displayed on the display screen at a second acceleration, and the first acceleration is different from the second acceleration.

[0024] In one possible implementation, the display screen includes a first display area and a second display area, the first display area is set on the first shell, and the second display area is set on the second shell. In response to a first operation, the first content is moved and displayed on the display screen, including: in response to the first operation, the first content displayed on the first display area is moved to the second display area for display.

[0025] In a possible implementation, moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a first position on the first display area to a second position on the second display area. The trajectory may be continuous.

[0026] In a possible implementation, moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a third position on the first display area to a fourth position, and displaying a trajectory of the first content moving from a fifth position to a sixth position on the second display area, wherein the fourth position is different from the fifth position. The fourth position is located in the first display area, and the fifth position is located in the second display area of ​​the book search.

[0027] In a possible implementation manner, the first sensor includes at least one of a first acceleration sensor and a first gyroscope sensor, and the second sensor includes at least one of a second acceleration sensor and a second gyroscope sensor.

[0028] In one possible implementation, the first operation includes one or more of the following: an operation of clicking on the first content, an operation of long pressing the first content, an operation of clicking and dragging the first content, a sliding operation on the first content, a somatosensory operation, a preset gesture operation, an operation of operating a preset control, and an operation of tilting the display screen.

[0029] In addition, the technical effects of the electronic device described in the second aspect can refer to the technical effects of the display method described in the first aspect, and will not be repeated here.

[0030] In a third aspect, an embodiment of the present application provides an electronic device having a function of implementing the display method described in the first aspect and any possible implementation thereof. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0031] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes a display method as described in the first aspect and any possible implementation thereof.

[0032] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes a display method as described in the first aspect and any possible implementation thereof.

[0033] In a sixth aspect, an embodiment of the present application provides a circuit system, the circuit system includes a processing circuit, and the processing circuit is configured to execute the display method as described in the first aspect and any possible implementation thereof.

[0034] In the seventh aspect, an embodiment of the present application provides a chip system, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor, and when the at least one processor executes the instructions, the at least one processor executes the display method as described in the first aspect above and any possible implementation method thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 Schematic diagram of the foldable screen electronic device provided in the embodiment of the present application Figure 1 ;

[0036] Figure 2A A schematic diagram of the structure of the electronic device provided in the embodiment of the present application Figure 1 ;

[0037] Figure 2B Schematic diagram 2 of the foldable screen electronic device provided in an embodiment of the present application;

[0038] Figure 2C A schematic diagram of the sensor positions provided in the embodiment of the present application;

[0039] Figure 2D A schematic diagram of a display screen angle calculation scenario provided in an embodiment of the present application;

[0040] Figure 3 A schematic diagram of a software structure block diagram of an electronic device provided in an embodiment of the present application;

[0041] Figure 4 A schematic diagram of an interface provided in an embodiment of the present application;

[0042] Figure 5 Schematic diagram of a virtual item display scene provided in an embodiment of the present application Figure 1 ;

[0043] Figure 6 Schematic diagram 2 of a virtual item display scene provided in an embodiment of the present application;

[0044] Figure 7 Schematic diagram of a virtual item display scene provided in an embodiment of the present application Figure 3 ;

[0045] Figure 8 Schematic diagram of a virtual item display scene provided in an embodiment of the present application Figure 4 ;

[0046] Fig. 9 The display method process provided in the embodiment of the present application Figure 1 ;

[0047] Fig.10 Flow chart 2 of the display method provided in the embodiment of the present application;

[0048] Fig.11 A second structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The display method and electronic device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0050] The terms "including" and "having" and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0051] It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0052] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more. The "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0053] A display method provided in an embodiment of the present application can be applied to an electronic device. The electronic device can be a mobile phone, a tablet computer, a laptop computer, a large-screen display device, a wearable device, a vehicle-mounted device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence device, and other terminal devices with a display screen folding function. The embodiment of the present application does not impose any restrictions on the specific type of the electronic device.

[0054] For example, Figure 2A A schematic diagram of the structure of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0055] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0056] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0057] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0058] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0059] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0060] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0061] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0062] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0063] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0064] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0065] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0066] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.

[0067] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0068] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0069] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0070] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0071] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0072] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0073] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

[0074] In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. Figure 1 As shown in (a), the electronic device 100 includes a display screen. Figure 1 As shown in (b), the electronic device is folded inward along the rotation axis. After folding, the electronic device display screen forms two display areas, where the angle between the light emitting surfaces of the display areas is used to represent the folding angle of the display screen. Figure 2B As shown in (a), the display screen of the inward folding screen electronic device includes a display area A and a display area B. After the electronic device is folded inward along the rotation axis 1, the angle between the light emitting surface of the display area A and the light emitting surface of the display area B is d, and 0 degrees ≤ d ≤ 180 degrees. Or, Figure 2B As shown in (b), the display screen of the external folding screen electronic device includes a display area C and a display area D. After the electronic device is folded outward along the rotating shaft 2, the angle between the light emitting surface of the display area C and the light emitting surface of the display area D is d, and 180 degrees ≤ d ≤ 360 degrees. The sizes of the two display areas of the electronic device display screen are the same or different.

[0075] In some embodiments, the electronic device can be in a folded state (also described as a non-fully unfolded state) or an unfolded state (also described as a fully unfolded state). Specifically, the angle between the light-emitting surfaces of the display area (i.e., the folding angle of the electronic device) can be used to determine the state of the electronic device. For example, for an inner folding screen electronic device, when 150 degrees < d ≤ 180 degrees, Figure 2B As shown in (c), the electronic device is in an unfolded state, and the display area A and the display area B can be combined into one display area for displaying together. For another example, for an inward folding screen electronic device, when 0 degrees ≤ d ≤ 150 degrees, Figure 2BAs shown in (a), the electronic device is in a folded state, and the display area A and the display area B can display independently.

[0076] Correspondingly, the external folding screen electronic device can also determine the state of the electronic device according to the angle. For example, when 180 degrees ≤ d ≤ 210 degrees, the electronic device is in an unfolded state, and the two display areas are combined into one display area for display. When 210 degrees < d ≤ 360 degrees, the electronic device is in a folded state, and the two display areas can be displayed independently.

[0077] It can be understood that, in the above-mentioned various states of the electronic device, the angles are only exemplary illustrations, and the electronic device states may also be divided at other angles or angle ranges, which will not be elaborated herein.

[0078] In some embodiments, the electronic device 100 may further include multiple display screens. Figure 1 As shown in (c), the electronic device includes two display screens, display screen C and display screen D, which work independently, and the electronic device is folded by the relative rotation of display screen C and display screen D based on the rotation axis. An electronic device including multiple display screens can also be in the above-mentioned folded state or unfolded state, and the folding angle is used to determine the state of the electronic device.

[0079] In some embodiments, the electronic device can also be folded 360 degrees, for example, the folding angle of the electronic device is d', 0 degrees ≤ d' ≤ 360 degrees.

[0080] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0081] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0082] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0083] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0084] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0085] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0086] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0087] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0088] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0089] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by approaching the microphone 170C with his mouth to input the sound signal into the microphone 170C. The electronic device 100 can be provided with one or more microphones 170C.

[0090] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0091] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0092] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0093] In some embodiments, the electronic device further comprises a first shell and a second shell, the first shell and the second shell are rotatably connected via a rotating shaft, and the display screen is disposed on the first shell and the second shell. Figure 2C As shown in (a), two display areas of the display screen (such as display area A and display area B) are respectively arranged on the first shell and the second shell, and the display screen is folded by relative rotation of the first shell and the second shell. A first circuit board is arranged in the cavity of the first shell, and a second circuit board is arranged in the cavity of the second shell. A first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board. The first sensor includes at least one of a first acceleration sensor or a first gyroscope sensor, and the second sensor includes at least one of a second acceleration sensor or a second gyroscope sensor. For example, Figure 2C As shown in (a), in the internal folding screen electronic device, an acceleration sensor 21 and a gyroscope sensor 22 are arranged in the cavity of the first shell, and an acceleration sensor 23 and a gyroscope sensor 24 are arranged in the cavity of the second shell. Figure 2C As shown in (b), an external folding screen electronic device has an acceleration sensor 25 and a gyroscope sensor 26 disposed in the cavity of the first shell, and an acceleration sensor 27 and a gyroscope sensor 28 disposed in the cavity of the second shell. In the implementation of this application, the angle between the light-emitting surfaces of the two display areas is used to represent the angle between the first shell and the second shell.

[0094] In some embodiments, the electronic device uses an acceleration sensor and a gyroscope sensor to detect the angle between the light-emitting surfaces of the display area. For example, an inward folding screen electronic device is used as an example. Figure 2D As shown, the extension direction of the electronic device shaft is the y-axis, the perpendicular direction of the plane where the display area is located is the z-axis, and the perpendicular direction of the plane formed by the y-axis and the z-axis is the x-axis, and a coordinate system is established for each display area. It can be understood that, Figure 2DAs shown, in the current electronic device folding scene, the y-axis direction in the coordinate system of display area A and display area B is the same, then the acceleration sensor measurement value and / or the gyroscope sensor measurement value are used to respectively determine the projection value of the acceleration sensor measurement value and / or the gyroscope sensor measurement value on the xoz plane of each display area coordinate system, and finally the angle between the light-emitting surfaces of the two display areas can be determined. Thus, when the electronic device is in different folding states (i.e., when the folding angle is different), the electronic device can determine the folding angle using the acceleration sensor measurement value and / or the gyroscope sensor measurement value.

[0095] Exemplarily, when the electronic device is stationary in any posture, the acceleration measurement value is the projection value of the virtual gravity acceleration on the xyz three axes. Among them, the plane perpendicular to the angular bisector of the angle between the light-emitting surfaces of the display area is defined as a virtual horizontal plane, and the direction of the virtual gravity acceleration is perpendicular to the virtual horizontal plane. In some scenarios, when the electronic device moves irregularly, the acceleration measurement value will not only include the acceleration value caused by virtual gravity, but also the linear acceleration value caused by other movements. Therefore, using the fusion algorithm of the acceleration sensor measurement value and the gyroscope sensor measurement value, the acceleration value measured by the acceleration sensor and the angular velocity components in each direction measured by the gyroscope sensor are integrated to obtain the virtual gravity acceleration of the electronic device in any posture and any motion mode, thereby determining the angle.

[0096] For example, Figure 2D As shown, the coordinate system of display area A is defined as o1 system, and the coordinate system of display area B is defined as o2 system. The projections of virtual gravity acceleration on o1 system and o2 system are (gx1, gy1, gz1) and (gx2, gy2, gz2) respectively. Since the two coordinate systems share the same y-axis, the components of virtual gravity acceleration on the y-axis are the same, and the components of virtual gravity acceleration on the xoz plane of the two coordinate systems are the same, that is, the virtual gravity acceleration projection Gxz on the x1o1z1 plane on the display area A side is equal to the virtual gravity acceleration projection G'xz on the x2o2z2 plane on the display area B side. The relative rotation between the first shell and the second shell can be regarded as the relative rotation of the two coordinate systems, that is, the coordinate system o1 in the display area A can be obtained by the reverse rotation of the coordinate system o2 in the display area B. The angle d between the light emitting surfaces of display area A and display area B is obtained by using the relative rotation angle of the two coordinate systems, such as d=arccos(Gxz*G'xz / |Gxz|*|G'xz|)=arcos((gx1*gx2+gz1*gz2) / |gx1*gx2|*|gz1*gz2|).

[0097] It can be understood that the above method for obtaining the angle between the light emitting surfaces of the display area is only an exemplary description, and the embodiments of the present application do not make any specific limitation to this method.

[0098] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A.

[0099] In some embodiments, touch operations acting on the same touch position but with different touch operation strengths may correspond to different operation instructions. For example, when a touch operation with a touch operation strength less than a first pressure threshold acts on a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation strength greater than or equal to the first pressure threshold acts on a short message application icon, an instruction to create a new short message is executed.

[0100] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0101] The magnetic sensor 180D includes a Hall sensor, and the electronic device 100 can detect the opening and closing of the flip leather case by using the magnetic sensor 180D.

[0102] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0103] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The electronic device 100 may use the proximity light sensor 180G to detect when a user holds the electronic device 100 close to their ear to make a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G may also be used for automatic unlocking and locking of the screen in the leather case mode and the pocket mode.

[0104] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0105] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0106] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy, such as reducing the processor performance to reduce power consumption to achieve temperature protection, or using the output voltage of the battery 142 to perform a voltage boost to avoid abnormal shutdown caused by low temperature.

[0107] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0108] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of a human vocal part.

[0109] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0110] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0111] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0112] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting or removing the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

[0113] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0114] Figure 3 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0115] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0116] The application layer can include a series of application packages.

[0117] like Figure 3 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0118] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0119] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0120] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0121] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0122] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0123] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0124] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0125] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0126] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0127] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0128] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0129] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0130] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0131] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0132] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0133] A 2D graphics engine is a drawing engine for 2D drawings.

[0134] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0135] The following is an example of the workflow of the electronic device 100 software and hardware in combination with the display scenario. When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, timestamp of the touch operation, and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as an example of the operation of touching and dragging a virtual item, the virtual item calls the interface of the application framework layer, starts the display driver, and uses the surface manager in the system library, the three-dimensional graphics processing library, and the two-dimensional graphics engine to realize the mobile display of the virtual item. Among them, the virtual item includes, for example, various user interface (UI) elements, such as icons, controls, avatars, characters, game props, etc. For example, the virtual item is an application icon. For another example, the virtual item is a game character, game props, etc. displayed in the game interface.

[0136] In the following embodiments, a mobile phone is used as an example of the electronic device 100.

[0137] In some embodiments, when the mobile phone detects the user clicking and dragging the virtual item, the mobile phone can determine the corresponding moving position of the virtual item according to the operation time, dragging distance, touch pressure and other conditions. Figure 4In the interface 401 shown, the mobile phone displays the setting icon 41 at position 1. The mobile phone detects that the user clicks on the setting icon 41 and drags it in the direction indicated by the arrow 42. After that, at position 2, the mobile phone detects that the user leaves the display screen, that is, the setting icon 41 is no longer operated. At this time, the mobile phone displays the setting icon 41 at position 2, that is, in response to the user operation, the setting icon 41 is moved from position 1 to position 2. Alternatively, in another implementation, the mobile phone automatically moves the setting icon 41 from position 2 to position 3 along the direction indicated by the arrow 43 based on one or more of the conditions of the distance from position 1 to position 2, the speed at which the user drags the setting icon 41, and the time the user presses the display screen, wherein the direction indicated by the arrow 43 is the same as the direction indicated by the arrow 42. In the current scenario, if the mobile phone is a folding screen mobile phone, and the folding screen of the mobile phone is in an unfolded state, the final display position of the setting icon 41 (i.e., position 3) can be directly determined according to the above conditions. However, if the mobile phone is in the position 2, the user drags the setting icon 41 in the direction indicated by the arrow 43, and the user presses the display screen. Figure 4 After the rotating shaft represented by the dotted line a is folded, it is in a folded state. However, due to the angle between the light-emitting surface of display area A and the light-emitting surface of display area B, the position 3 where the virtual item (i.e., setting icon 41) finally stops and is displayed cannot meet the user's needs, or the movement speed of the virtual item in the process of automatically moving to the final display position cannot meet the user's needs. For another example, in some somatosensory game scenes, such as game scenes that use gravitational potential energy, the mobile phone is in a folded state. In response to the user's operation of moving the position of the electronic device display screen, which causes the direction of the virtual gravity acceleration of the virtual item to change, the virtual item displayed on display area A moves to display area B for display. If the influence of the angle is not considered, the display position or movement speed of the virtual item will be different from the user's actual perception.

[0138] For example, Figure 5 As shown in (a), the mobile phone is an inner folding screen mobile phone, the angle between the light emitting surface of the display area A and the light emitting surface of the display area B is the angle d1, and the virtual item M is displayed on the display area A. It can be understood that the virtual item M is the display content of the display screen, which can be displayed in the screen or on the screen. Figure 5 The virtual item M shown in (a) is only used to indicate the location of the virtual item, and is not used to indicate the display effect of the virtual item, which will not be explained below.

[0139] Assume that the current scene is a gravitational potential energy game scene, such as Figure 5As shown in (a), the mobile phone displays a virtual item M on display area A. The mobile phone detects that the user operates display area A to control the movement of virtual item M, so that the virtual item M obtains an initial velocity V0 parallel to the plane of display area A, and the virtual item M is preset to have a virtual gravity acceleration g perpendicular to the virtual horizontal plane. Based on V0 and g, the virtual item M moves, for example, to display area B. On display area B, the component g1 of the virtual gravity acceleration g of the virtual item M is in a different direction from the velocity V1, so that the virtual item M will eventually stay at a certain position on display area B. Assume that the mobile phone moves the virtual item M from display area A to display area B, as shown in FIG. Figure 5 As shown in (a), the user perceives that the virtual object should move at a slower speed on the display area B. However, if the mobile phone does not consider the influence of the angle d1 and still uses V0 to move the virtual object, there will be a difference with the user's perception, affecting the user experience.

[0140] In some embodiments, the angles between the light-emitting surfaces of the mobile phone display area are different, and the speeds obtained after the mobile phone controls the virtual object to be displayed across the display area are different. Figure 5 As shown in (a), the mobile phone displays a virtual item M on display area A. The mobile phone detects the user's operation to move the virtual item M, determines the initial speed V0 of the virtual item M, and determines that the angle between the light emitting surface of display area A and the light emitting surface of display area B is d1. The mobile phone controls the virtual item M to move and display on the display screen. After the virtual item M moves and displays to display area B, the movement speed obtained is V1. If the angles between the light emitting surfaces of the display areas are different, such as Figure 5 As shown in (b), the mobile phone displays a virtual item M on display area A. The mobile phone determines that the angle between the light emitting surface of display area A and the light emitting surface of display area B is angle d2, and d2 is greater than d1. The mobile phone determines that the virtual item M moves from the same position on display area A to display area B at the same initial speed V0. After the virtual item M moves and displays to display area B, the moving speed obtained is V2. If d2 is different from d1, then V2 is different from V1.

[0141] Furthermore, in the above Figure 5 In the scenes shown in (a) and (b), during the movement and display of the virtual item M, the same virtual gravity acceleration g acts on the virtual item M. Based on the angles between the light-emitting surfaces of different display areas, the components g1 and g2 of the virtual gravity acceleration g on the extension line of the movement speed of the virtual item M are different, so the acceleration obtained by the virtual item M during the movement and display process is different, and the final movement distance of the virtual item M on the display area B is different.

[0142] For example, Figure 4As shown, assuming that the mobile phone detects that the virtual item M enters the cross-axis area from a certain position (such as position 1) on the dotted line b shown on the display area A with the same initial speed V0, and moves to a certain position (such as position 2) on the dotted line c shown on the display area B, and the speed V2 of the virtual item M corresponding to the angle d2 at position 2 is greater than the speed V1 corresponding to the angle d1, then Figure 5 (a) The distance between the final virtual item M displayed on the display area B and the rotation axis should be less than Figure 5 (b) The distance between the final display position of the virtual item M on the display area B and the rotation axis. That is, when moving into the cross-rotation axis area at the same initial speed, the larger the angle, the greater the speed and acceleration obtained when the virtual item crosses the screen (can also be described as cross-axis) when moving out of the cross-rotation axis area. The definition of the cross-rotation axis area is described below and will not be repeated here.

[0143] Or, if Figure 5 As shown in (a), if the angle remains unchanged, the virtual item M moves to the display area B at different initial speeds at the same position on the display area A. It can be understood that in the current scene, based on the same virtual gravity acceleration, the greater the initial speed, the greater the speed obtained by the virtual item M after moving to the display area B, and the farther the moving distance.

[0144] Or, if Figure 5 As shown in (a), if the angle remains unchanged, the virtual object moves to the display area B at the same initial speed at different positions on the display area A. It can be understood that in the current scene, based on the same virtual gravity acceleration, the farther the initial position is from the rotation axis position, the greater the speed obtained by the virtual object after moving to the display area B, and the farther the moving distance.

[0145] Again exemplary, corresponding to the above Figure 5 In the scenes shown in (a) and (b), the same Figure 5 As shown in (c) and (d), the mobile phone is an external folding screen mobile phone. The mobile phone detects that the user operates the display area C to control the movement of the virtual item M, so that the virtual item M obtains the following Figure 5 In (c), the initial velocity V0 is parallel to the plane of the display area C. Based on the same initial velocity V0, the virtual item M enters the cross-axis area from the same position on the display area C, and moves across the axis to be displayed in the display area D. The angle d4 between the light emitting surface of the display area C and the light emitting surface of the display area D is greater than the angle d3. Therefore, when the virtual item M moves out of the cross-axis area on the display area D, the velocity corresponding to the angle d4 is greater than the velocity corresponding to the angle d3.

[0146] From this, it can be seen that after the display screen is folded, when displaying virtual objects across display areas, that is, when displaying virtual objects from one display area to another display area of ​​the same display screen, it is necessary to consider the impact of the angle on the movement speed and acceleration of the virtual objects, so that the movement speed and final moving distance of the virtual objects are the same as the user's real perception, meeting user needs.

[0147] The following is a detailed description of a method for obtaining the speed and acceleration of a virtual object after crossing the screen and a method for displaying the virtual object after crossing the screen.

[0148] In some embodiments, the initial speed of the virtual object entering the cross-axis region of the screen is used to determine the speed and acceleration of the virtual object moving out of the cross-axis region. Figure 4 As shown, the dotted line a indicates a position corresponding to the mobile phone pivot position, the area between the dotted line b and the dotted line a on the display area A is used to represent the cross-axis area on the display area A, and the area between the dotted line c and the dotted line a on the display area B is used to represent the cross-axis area on the display area B, so the cross-axis area of ​​the mobile phone display screen is the area between the dotted line b and the dotted line c. Among them, the cross-axis area can be represented by a fixed pixel position on the display screen, such as the pixel points on the dotted line b and the dotted line c are used to represent the edge position of the cross-axis area. If the mobile phone detects that the virtual item enters the edge position of the pixel point, it means that it enters the cross-axis area. Optionally, in the process of moving the virtual item, the mobile phone can determine the center pixel point position of the virtual item, and the mobile phone uses the center pixel point position to determine the moving position of the virtual item. For example, if the center pixel point is determined to be a pixel point among the edge pixel points of the cross-axis area on the display area A (i.e., the pixel point corresponding to the dotted line b), it is determined that the virtual item enters the cross-axis area. Correspondingly, if the central pixel is determined to be a pixel point among the edge pixels of the cross-axis area on the display area B (i.e., the pixel point corresponding to the dotted line c), it is determined that the virtual item has moved out of the cross-axis area. Alternatively, the mobile phone determines that the pixel points greater than or equal to a preset ratio among the pixels used to display the virtual item are the pixels in the cross-axis area, and then it is determined that the virtual item has entered the cross-axis area. Correspondingly, if the mobile phone determines that the pixel points less than a preset ratio among the pixels used to display the virtual item are the pixels in the cross-axis area, then it is determined that the virtual item has moved out of the cross-axis area. If more than 80% of the pixel points displaying the virtual item are the pixels in the cross-axis area, then it is determined that the virtual item has entered the cross-axis area. In the following, the process of moving the virtual item is described by taking the example of the mobile phone using the central pixel position of the virtual item to determine the position of the virtual item, which will not be repeated below.

[0149] Optional, such as Figure 4As shown, the distance between the dotted line b and the dotted line a is the same as the distance between the dotted line c and the dotted line a, that is, the cross-axis area on the display area A is the same size as the cross-axis area on the display area B. Specifically, the position and size of the cross-axis area on the mobile phone display can be pre-configured in the mobile phone. For example, according to the position and size of the mobile phone axis, the position and size of the cross-axis area on the display screen are determined, and the corresponding edge pixel point data is pre-configured in the mobile phone, so that the mobile phone determines whether the virtual object is located in the cross-axis area according to the moving position of the virtual object.

[0150] For example, Figure 6 As shown in (a), the mobile phone is folded inward using the hinge, and the angle between the light emitting surface of the display area A and the light emitting surface of the display area B is the angle d1, corresponding to Figure 4 The positions of the dashed lines a, b and c are shown as Figure 6 As shown in (a), relative to the virtual horizontal plane where the dotted line a is located, the height of the cross-axis area is h1. Figure 6 As shown in (b), the angle between the light emitting surface of the mobile phone display area A and the light emitting surface of the display area B is angle d2, d2>d1, corresponding to Figure 4 The positions of the dashed lines a, b and c are shown as Figure 6 As shown in (b), relative to the virtual horizontal plane where the dotted line a is located, the height of the cross-axis area is h2, then h2

[0151] For example, Figure 4 As shown, when the setting icon 41 moves to position 2, the mobile phone determines that the setting icon 41 enters the cross-axis area. Optionally, if the virtual item enters the cross-axis area, the virtual item will automatically continue to move, and the mobile phone will calculate the speed and acceleration of the virtual item moving out of the cross-axis area based on the speed corresponding to the moment when the virtual item enters the cross-axis area and the current angle, thereby determining the final display position of the virtual item, such as position 3.

[0152] ​Furthermore, the mobile phone can determine the moving speed of the virtual item in the cross-axis area according to the speed 1 when the virtual item enters the cross-axis area and the speed 2 when it moves out of the cross-axis area. For example, a preset method is used to perform linear change transition processing on speed 1 and speed 2, so as to control the moving speed of the virtual item in the cross-axis area, and ensure the smoothness of the speed change and the smoothness of the dynamic effect of the virtual item in the cross-axis area. Among them, the preset method of performing linear change transition processing on speed 1 and speed 2 can refer to the existing technology and will not be repeated here.

[0153] In some scenarios, the mobile phone is an internal folding screen mobile phone. Assume that the mobile phone detects that the virtual object enters the cross-axis area on the display area at an initial speed V0, and the preset virtual gravity acceleration is g. For example, Figure 7 As shown in (a), the angle between the light emitting surface of the mobile phone display area A and the light emitting surface of the display area B is angle d, and the mobile phone detects that the virtual item M enters the cross-axis area on the display area A at an initial speed V0. Figure 7 As shown in (b), based on V0 and g, the mobile phone determines that the virtual object M is subject to the virtual gravity in the direction of the angle bisector, and controls the virtual object to move along the display area A in the direction of the lower center of gravity. After moving to the lowest point (i.e., the edge position of the display area A, which corresponds to the position of the rotation axis of the folding screen mobile phone), the virtual object M continues to move along the display area B based on the horizontal component of the speed, as shown in FIG. Figure 7 As shown in (c), the mobile phone controls the virtual item M to move out of the cross-axis area on the display area B at a speed V1. That is, when the mobile phone is an internal folding screen mobile phone, in response to the operation of moving the virtual item M, the virtual item is controlled to move from the display area A to the display area B for display, and during the moving display process, the movement trajectory of the virtual item M is a continuous movement trajectory.

[0154] It is assumed that the time interval for switching the moving virtual item across the axis is △t, and the speed loss ratio for switching across the axis is r. Figure 7 In the scenario shown, the time interval from when the virtual item M enters the cross-axis area to when it exits the cross-axis area is △t, and the speed loss ratio of the virtual item M in the cross-axis area is r. Then, after the mobile phone uses the acceleration sensor and the gyroscope sensor to obtain the angle d between the light-emitting surface of the display area A and the light-emitting surface of the display area B, it determines the initial speed V0, the virtual gravity acceleration g, the cross-axis time interval is △t, and the switching speed loss ratio is r, then the acceleration a0 of the virtual item moving out of the cross-axis area is obtained as a0 = -1*g*cos(d / 2), and the moving speed V1 = V0*(1-r)+△t*a0. Among them, V0 ≥ 0, g > 0, △t > 0, r > 0, 0 degrees ≤ d ≤ 180 degrees.

[0155] After that, the mobile phone processes the linear relationship between V0 and V1 in a preset manner, and obtains the moving speed of the virtual item M during the movement across the axis area. The mobile phone uses the moving speed to control the virtual item M to move out of the axis area, and uses the acceleration a0 and the moving speed V1 to control the virtual item M to continue to move on the display area B until the speed changes to 0 and stops. According to the above formula, the inner folding screen mobile phone displays virtual items, and the virtual items move across the axis area. When the virtual gravity acceleration g is the same, the larger the angle d, the larger the acceleration a0. In addition, if the initial speed V0, the time interval across the axis is △t, the switching speed loss ratio is r, and the virtual gravity acceleration g are the same, the larger the angle d, the larger the moving speed V1. Correspondingly, when the virtual gravity acceleration g is the same, the smaller the angle d, the smaller the acceleration a0. If the initial speed V0, the time interval across the axis is △t, the switching speed loss ratio is r, and the virtual gravity acceleration g are the same, the smaller the angle d, the smaller the moving speed V1.

[0156] Furthermore, if the mobile phone is in an unfolded state, assuming that d is 180 degrees, the mobile phone uses the above formula to calculate that after the virtual item leaves the cross-axis area, the acceleration is 0, and the speed is less than the initial speed, that is, the mobile phone controls the virtual item to first decelerate and then move at a constant speed on display area B. Then, the mobile phone can obtain the preset moving distance and determine the stop position according to the preset moving distance. Finally, the virtual item is displayed at the stop position on display area B, completing the cross-axis display of the virtual item.

[0157] In some embodiments, the mobile phone determines the initial speed V0, the virtual gravity acceleration g, the cross-rotating axis time interval △t, and the switching speed loss ratio r according to preset conditions. Among them, the preset conditions include, for example, the length of time the mobile phone detects that the user presses the virtual item, the length of time the virtual item moves before the virtual item enters the cross-rotating axis area, the distance the virtual item moves before the virtual item enters the cross-rotating axis area, and one or more conditions in the difficulty level. For example, in a game scene, if the mobile phone detects that the difficulty level is low, the virtual gravity acceleration can be set lower and the cross-rotating axis time interval can be set longer. Then the speed change of the virtual item in the cross-rotating axis area is small, and the movement time is long, which is convenient for user control. For another example, in a game scene, if the mobile phone detects that the difficulty level is high, the virtual gravity acceleration can be set higher and the cross-rotating axis time interval can be set shorter. Then the speed change of the virtual item in the cross-rotating axis area is large, and the movement time is short, which increases the difficulty of user control. Among them, the mobile phone can determine the game difficulty level according to the user's settings. For another example, in a scene of moving virtual items, the mobile phone detects the moving distance and moving time of the virtual item before entering the cross-rotating axis area to determine the initial speed V0. For example, the longer the moving distance, the larger V0; for the same moving distance, the shorter the moving time, the larger V0. For another example, a table containing the correspondence between the initial speed V0, the virtual gravity acceleration g, the time interval △t across the rotating axis, and the switching speed loss ratio r is preset in the mobile phone. The mobile phone can determine other corresponding parameters by detecting any of the parameters. For example, if the mobile phone detects the moving speed of the virtual object in real time and obtains the initial speed V0, the values ​​of g, △t, and r are determined according to the corresponding relationship in the preset table.

[0158] In some embodiments, the mobile phone sets the initial speed of the virtual item when it enters the cross-axis area to 0, so the acceleration of the virtual item moving out of the cross-axis area is a0 = -1*g*cos(d / 2), and the moving speed V1 = △t*a0. That is, in the current scene, the mobile phone does not need to detect the initial speed V0, and can directly determine the corresponding moving speed V1 and acceleration a0 when leaving the cross-axis area based on the angle d, the virtual gravity acceleration g and the cross-axis time interval △t.

[0159] In some embodiments, after calculating the movement speed and acceleration of the virtual item when it moves out of the cross-axis area, the mobile phone controls the virtual item to move on display area B. If the movement speed of the virtual item has not become 0 when it moves to the edge of display area B, the virtual item can be controlled to return to display area A. When moving across the axis area again, the calculation method is the same as the above method, and the mobile phone can also calculate the movement speed and acceleration when it moves out of the cross-axis area on display area A. Thus, the above steps are repeated to control the virtual item to move on display area A and display area B until the movement speed becomes 0 and stops at a certain position for display.

[0160] In other scenarios, the mobile phone is an external folding screen mobile phone. Assume that the mobile phone detects that the virtual object enters the cross-axis area on the display area at an initial speed V0', and the virtual gravity acceleration is preset to g'. For example, Figure 8 As shown in (a), the angle between the light emitting surface of the mobile phone display area C and the light emitting surface of the display area D is angle d, and the mobile phone detects that the virtual item M enters the cross-axis area on the display area C at an initial speed V0'. Figure 8 As shown in (b), based on V0' and g', the mobile phone determines that the virtual object M is subject to the virtual gravity in the direction of the angle bisector, and controls the virtual object M to move along the display area C at a reduced speed to the edge position of the display area C (i.e., the top position of the current display area C), which corresponds to the position of the mobile phone's rotation axis. Figure 8 As shown in (c), the mobile phone controls the virtual item M to cross the distance P1 from the edge of the display area C and re-display it in the display area D, that is, the mobile phone needs to determine the value of P1, such as P1 = V0'*△t'. Then the virtual item M is re-displayed at the corresponding position (such as position P), where the distance between position P and the edge of the display area D is P1, and the edge position corresponds to the position of the mobile phone's rotation axis. For example, the mobile phone can determine the position P using the distance P1 and the direction of the velocity component. In addition, the mobile phone needs to determine the moving speed V1' and acceleration a0' obtained by the virtual item at position P.

[0161] Among them, position P may be located at the edge of the cross-axis region on the display area D, or may not be located at the edge of the cross-axis region. The virtual item M will not be displayed on the display area D during the process of crossing the distance P1, but will directly disappear from the edge of the display area C and then be displayed again at position P. In other words, when the mobile phone is an external folding screen mobile phone, in response to the operation of moving the virtual item M, the virtual item is controlled to move from the display area C to the display area D for display. During the mobile display process, the movement trajectory of the virtual item M is a discontinuous movement trajectory.

[0162] Assume that the switching time interval of the moving virtual object across the axis is △t', that is, Figure 8In the scenario shown, the time interval from when the virtual item M enters the cross-axis area to when it moves to position P is △t'. Moreover, in the process of the virtual item M entering the cross-axis area to position P, there is no speed loss, that is, the switching speed loss ratio is 0. Then, after the mobile phone uses the acceleration sensor and the gyroscope sensor to determine that the angle between the light-emitting surface of the display area C and the light-emitting surface of the display area D is d, the initial speed V0', the virtual gravity acceleration g', and the cross-axis time interval is △t', then the acceleration a0'=-1*g'*cos(d / 2) of the virtual item when it moves to position P on the display area D, and the moving speed V1'=V0'+△t'*a0'. Among them, V0'≥0, g'>0, △t'>0, 180 degrees≤d≤360 degrees.

[0163] Afterwards, based on V0' and V1', the mobile phone performs linear relationship processing on the movement speed of the virtual item M during the deceleration movement from the cross-rotation axis area to the edge position of the display area C in a preset manner, and performs linear relationship processing on the movement speed of the virtual item M during the acceleration movement from the edge position of the display area C to the position P on the display area. According to the movement speed after the linear relationship processing, the virtual item M is controlled to move from the display area C to the position P on the display area D, and then the acceleration a0' and the movement speed V1' are used to control the virtual item M to continue to move from the position P on the display area D. According to the above formula, when the external folding screen mobile phone displays virtual items and the virtual items move across the rotation axis area, when the gravity acceleration g' is the same, the larger the angle d, the larger the acceleration a0'. In addition, if the initial speed V0', the cross-rotation axis time interval △t' and the virtual gravity acceleration g' are the same, the larger the angle d, the larger the movement speed V1'. Correspondingly, when the gravity acceleration g' is the same, the smaller the angle d, the smaller the acceleration a0'. If the initial speed V0', the time interval across the rotation axis △t' and the virtual gravity acceleration g' are all the same, the smaller the angle d is, the smaller the moving speed V1' is.

[0164] Furthermore, if the mobile phone is in an unfolded state, assuming that d is 180 degrees, the mobile phone uses the above formula to calculate the position P of the virtual object on the display area D. When the acceleration is 0, the virtual object continues to move at a constant speed V0' on the display area D. Then, the mobile phone can obtain the preset moving distance, and determine the stop position on the display area D according to the preset moving distance. After that, the mobile phone controls the virtual object to move at a constant speed from the position P to the stop position, and stops moving the virtual object at the stop position, completing the process of controlling the cross-screen movement and display of the virtual object.

[0165] In some embodiments, the mobile phone determines the initial speed V0', the virtual gravity acceleration g', and the cross-axis time interval △t' according to preset conditions. The preset conditions and the method for determining each parameter according to the preset conditions can refer to the preset conditions corresponding to the internal folding screen mobile phone and the method for determining each parameter according to the preset conditions, which will not be repeated here.

[0166] It should be noted that in the above embodiments, an inward-folding screen mobile phone and an outward-folding screen mobile phone are taken as examples to illustrate the method of obtaining the speed and acceleration of the virtual object after being displayed across the axis. It can be understood that the above method is also applicable to the scenario where the angle of the mobile phone after folding is [0,360] degrees, which will not be elaborated on.

[0167] Therefore, the display method provided in the embodiment of the present application can determine the speed and acceleration of the virtual object after being displayed across the display area by detecting the angle between the light-emitting surfaces of the two display areas of the folding screen, thereby making the movement trajectory and movement state of the virtual object close to the user's real perception and meeting the user's needs.

[0168] For example, Fig. 9 A flow chart of a display method provided in an embodiment of the present application. The method is applied to an electronic device with an inner folding screen, see Fig. 9 As shown, the method includes S901-S904.

[0169] S901: The electronic device detects a first operation and determines that a virtual item enters a cross-axis area on a first display area. The display area of ​​the electronic device includes a first display area and a second display area.

[0170] Among them, the display screen of the inner folding screen electronic device includes two display areas, a first display area and a second display area, and the angle d between the light emitting surface of the first display area and the light emitting surface of the second display area is 0 degrees ≤ d ≤ 180 degrees. The state of the electronic device includes a folded state and an unfolded state. When the electronic device is in an unfolded state, the first display area and the second display area can be combined into one display area to work together. When the electronic device is in a folded state, the first display area and the second display area can work separately. Alternatively, the first display area and the second display area are display areas of two independent display screens, respectively, and the two independent display screens can achieve relative rotation based on the same shaft to complete the folding of the electronic device.

[0171] Virtual items include, for example, various UI elements, such as icons, controls, avatars, characters, game props, etc. For example, a virtual item is an application icon. Another example is a game character or game prop displayed in a game interface.

[0172] In some embodiments, the first operation includes, for example, any one or more of the following operations: clicking on a virtual item, long pressing a virtual item, clicking and dragging a virtual item, sliding on a virtual item, somatosensory operation, preset gesture operation, tilting the display screen of an electronic device, and operating a preset control. The operation of tilting the display screen of an electronic device refers to the operation of changing the direction of the virtual gravity acceleration of the virtual item.

[0173] In some embodiments, a fixed pixel point is used to define the cross-axis area on the display area. Figure 4 As shown, the pixel positions corresponding to the dotted lines b and c on the display area of ​​the electronic device are the edge positions of the cross-axis area. The electronic device detects that the user clicks and drags the setting icon 41 (i.e., the virtual item) from position 1 to position 2, and determines that position 2 is within the edge pixel points of the cross-axis area, then determines that the setting icon 41 enters the cross-axis area. Further, the electronic device determines that the virtual item enters the cross-axis area in the first display area (i.e., display area A), then determines that the virtual item needs to be moved from display area A to the second display area (i.e., display area B), and is displayed using the second display area, that is, the virtual item is displayed across display areas.

[0174] It should be noted that, due to the limitations of the electronic device structure, virtual items that require user operation are generally not set in the cross-axis area of ​​the electronic device display area to avoid repeatedly clicking the display screen corresponding to the display area, which increases the probability of damage to the axis. Therefore, after the electronic device determines that the virtual item has entered the cross-axis area, it needs to be moved out of the cross-axis area for display.

[0175] S902: The electronic device determines an angle between a light emitting surface of the first display area and a light emitting surface of the second display area.

[0176] In some embodiments, the electronic device uses an acceleration sensor to measure the gravity acceleration of the current electronic device, and uses a gyroscope sensor to measure the angular velocity component of the current electronic device, and based on a fusion algorithm, determines the angle between the light emitting surface of the first display area and the light emitting surface of the second display area.

[0177] It is understandable that the angle between the light emitting surface of the first display area and the light emitting surface of the second display area can also be described as the folding angle of the electronic device. The electronic device uses the angle to determine the state of the electronic device. The state of the electronic device includes, for example, a folded state and an unfolded state. For example, for an electronic device with an inner folding screen, when 0 degrees ≤ d < 180 degrees, the electronic device is in a folded state. When 150 degrees < d ≤ 180 degrees, the electronic device is in an unfolded state.

[0178] S903: The electronic device obtains preset parameters and determines the speed and acceleration of the virtual object when it moves out of the cross-axis area on the second display area.

[0179] In some embodiments, the preset parameters include, for example, an initial speed V0, a ​​virtual gravity acceleration g, a cross-axis time interval △t, and a switching speed loss ratio r. The electronic device determines the preset parameters according to the preset conditions. Among them, the preset conditions include, for example, one or more of the conditions of the electronic device detecting the duration of the user pressing the virtual item, the duration of the virtual item moving before the virtual item enters the cross-axis area, the distance the virtual item moves before the virtual item enters the cross-axis area, and the difficulty level. Optionally, the initial speed V0 is used to indicate the initial speed of the virtual item when it enters the cross-axis area, V0≥0. The virtual gravity acceleration g is used to indicate the gravity acceleration of the virtual item, g>0. The cross-axis time interval △t is used to indicate the duration from when the virtual item enters the cross-axis area to when it leaves the cross-axis area, △t>0. The switching speed loss ratio r is used to indicate the speed loss ratio of the virtual item during the movement of the cross-axis area, r>0. For example, when the electronic device controls the virtual item to move to the bottom of the first display area (i.e., the edge position corresponding to the axis on the first display area), it hits the second display area, causing speed loss. Among them, the method for the electronic device to determine the preset parameters according to the preset conditions can refer to the method for the mobile phone to determine the preset parameters according to the preset conditions mentioned above, which will not be repeated here.

[0180] In some embodiments, after the electronic device determines the values ​​of each preset parameter, it calculates the speed and acceleration of the virtual item when it moves out of the cross-axis area according to the preset parameter values. For example, the acceleration of the virtual item when it moves out of the cross-axis area is a0 = -1*g*cos(d / 2), and the moving speed V1 = V0*(1-r)+△t*a0.

[0181] In some embodiments, in order to ensure the smoothness of speed changes and the fluency of dynamic effects when the virtual item moves across the rotation axis area, the speed switching process of V0 and V1 may be subjected to linear change transition processing.

[0182] S904: The electronic device controls the virtual object to move and display on the second display area based on the speed and acceleration.

[0183] In some embodiments, after the electronic device determines the speed and acceleration values, it controls the virtual item to continue to move from the cross-axis position on the second display area until the speed changes to 0 and stops. According to the above formula for determining the acceleration and moving speed, it can be seen that when the virtual gravity acceleration g is the same, the larger the angle d is, the greater the acceleration a0 is. In addition, if the initial speed V0, the cross-axis time interval is △t, the switching speed loss ratio is r, and the virtual gravity acceleration g are the same, the larger the angle d is, the larger the moving speed V1 is, and the longer the moving distance on the second display screen is. Correspondingly, when the virtual gravity acceleration g is the same, the smaller the angle d is, the smaller the acceleration a0 is. If the initial speed V0, the cross-axis time interval is △t, the switching speed loss ratio is r, and the virtual gravity acceleration g are the same, the smaller the angle d is, the smaller the moving speed V1 is, and the shorter the moving display distance on the second display screen is.

[0184] Optionally, the electronic device may also execute the steps and functions executed by the mobile phone in the above embodiments, thereby realizing the display method provided in the above embodiments.

[0185] Therefore, the display method provided by the embodiment of the present application can detect the angle between the light-emitting surfaces of the two display areas of the folding screen, and determine the speed and acceleration of the virtual object after displaying across the display area according to preset parameters. This makes the movement trajectory and movement state of the virtual object close to the user's real perception and meets the user's needs.

[0186] For example, Fig.10 A flow chart of another display method provided in an embodiment of the present application. The method is applied to an external folding screen electronic device, see Fig.10 As shown, the method includes S1001-S1005.

[0187] S1001: The electronic device detects a first operation and determines that a virtual item enters a cross-axis region on a first display region. The electronic device display screen includes a first display region and a second display region.

[0188] Among them, the display screen of the external folding screen electronic device includes two display areas, a first display area and a second display area, and an angle d is formed between the light-emitting surface of the first display area and the light-emitting surface of the second display area, 180 degrees ≤ d ≤ 360 degrees. The state of the electronic device includes a folded state and an unfolded state. When the electronic device is in an unfolded state, the first display area and the second display area can be combined into one display area to work together. When the electronic device is in a folded state, the first display area and the second display area can work separately. Alternatively, the first display area and the second display area are display areas of two independent display screens, respectively, and the two independent display screens can achieve relative rotation based on the same shaft to complete the folding of the electronic device.

[0189] S1002: The electronic device determines an angle between a light emitting surface of a first display area and a light emitting surface of a second display area.

[0190] In some embodiments, the electronic device uses an acceleration sensor and a gyroscope sensor to determine the angle. In addition, the electronic device can determine the state of the electronic device based on the angle. The state of the electronic device includes, for example, a folded state and an unfolded state. For example, for an external folding screen electronic device, when 210 degrees < d ≤ 360 degrees, the electronic device is in a folded state. When 180 degrees ≤ d < 210 degrees, the electronic device is in an unfolded state.

[0191] Optionally, the remaining contents of step S1001-step S1002 may refer to the relevant contents of the above-mentioned step S901-step S902, which will not be repeated here.

[0192] S1003: The electronic device obtains preset parameters and determines the speed and acceleration of the virtual object on the second display area.

[0193] S1004: The electronic device determines an initial position of the virtual object on the second display area based on preset parameters, and displays the virtual object at the initial position.

[0194] In some embodiments, in the above steps S1003 and S1004, the preset parameters include, for example, the initial speed V0', the virtual gravity acceleration g', and the cross-axis time interval △t', and the electronic device determines the preset parameters according to the preset conditions. Among them, the preset conditions include, for example, the duration of the electronic device detecting that the user presses the virtual item, the duration of the virtual item moving before the virtual item enters the cross-axis area, the distance the virtual item moves before the virtual item enters the cross-axis area, and one or more conditions of the difficulty level. Optionally, the initial speed V0' is used to represent the initial speed of the virtual item when it enters the cross-axis area, V0'≥0. The virtual gravity acceleration g' is used to represent the gravity acceleration of the virtual item, g'>0. The cross-axis time interval △t' is used to represent the time interval from the virtual item entering the cross-axis area to the start of display in the second display area, △t'>0. Among them, the method for the electronic device to determine the preset parameters according to the preset conditions can refer to the method for the mobile phone to determine the preset parameters according to the preset conditions above, which will not be repeated here.

[0195] In some embodiments, after the electronic device determines the values ​​of each preset parameter, it calculates the initial distance of the virtual item from the rotation axis on the second display area according to the preset parameter values, and then obtains the initial position. After that, the speed and acceleration of the virtual item at the initial position are determined. For example, the initial distance P1 of the virtual item from the rotation axis when it moves to the second display area is P1 = V0'*△t', the acceleration when it moves to the initial position is a0' = -1*g'*cos(d / 2), and the moving speed when it moves to the initial position is V1' = V0'+△t'*a0'. Among them, 180 degrees ≤ d ≤ 360 degrees.

[0196] In some implementation cases, in order to ensure the smoothness of speed changes and the fluency of dynamic effects when the virtual object moves across the rotation axis area, the speed switching process of V0' and V1' may be subjected to linear change transition processing.

[0197] It should be noted that the embodiment of the present application does not specifically limit the execution order of the above step S1003 and step S1004. For example, the electronic device may first determine the initial position, and then determine the speed and acceleration at the initial position.

[0198] S1005: Based on the speed and acceleration, the electronic device controls the virtual object to move and display on the second display area starting from the initial position.

[0199] In some embodiments, after the electronic device determines the initial position, speed and acceleration value of the virtual item displayed on the second display area, the virtual item is controlled to continue to move from the initial position on the second display area. According to the above formulas of acceleration and moving speed, when the virtual gravity acceleration g is the same, the larger the angle d is, the greater the acceleration a0' is. In addition, if the initial speed V0', the time interval across the rotation axis is △t' and the virtual gravity acceleration g are the same, the larger the angle d is, the greater the moving speed V1' is. Correspondingly, when the virtual gravity acceleration g is the same, the smaller the angle d is, the smaller the acceleration a0' is. In addition, if the initial speed V0', the time interval across the rotation axis is △t' and the virtual gravity acceleration g are the same, the smaller the angle d is, the smaller the moving speed V1' is. Among them, the moving distance of the virtual item on the second display area can determine the corresponding position according to the moving speed V1' and the acceleration a0'. For example, the corresponding relationship between the moving distance and the moving speed V1' and the acceleration a0' is preset. After determining the moving distance according to the corresponding relationship, the electronic device directly obtains the final stop position, controls the virtual object to move to the end position according to the moving speed V1' and the acceleration a0', and then stops moving.

[0200] Optionally, the electronic device may also execute the steps and functions executed by the mobile phone in the above embodiments, thereby realizing the display method provided in the above embodiments.

[0201] Therefore, the display method provided in the embodiment of the present application can obtain the speed and acceleration of the virtual object's movement after crossing the display area after determining the angle between the light-emitting surfaces of the display area, and control the movement state of the virtual object to be close to the user's perception, thereby improving the user experience.

[0202] The above describes in detail the display method provided by the embodiment of the present application. Fig.11 The display device provided by the embodiment of the present application is described in detail.

[0203] In one possible design, Fig.11 This is a schematic diagram of the structure of a display device provided in an embodiment of the present application, and the display device may be an electronic device. Fig.11 As shown, the electronic device 1100 includes: a display unit 1101, a detection unit 1102 and a processing unit 1103. The electronic device 1100 can be used to implement the functions of the electronic device involved in the above method embodiment.

[0204] Optionally, the display unit 1101 is used to display the first content. The first content can also be described as a virtual item displayed by the display unit 1101. The virtual item includes, for example, various UI elements, such as icons, controls, avatars, characters, game props, etc. For example, the virtual item is an application icon. For another example, the virtual item is a game character or a game prop displayed in a game interface. The display unit 1101 is also used to support the electronic device 1100 to execute Fig. 9 Step S904 in; and / or, supporting the electronic device 1100 to execute Fig.10 Steps S1004 and S1005 in; and / or other processes for the technology described herein.

[0205] Optionally, the detection unit 1102 is configured to receive a first operation performed on the first content. The detection unit 1102 is further configured to support the electronic device 1100 to perform Fig. 9 Step S901 in; and / or, supporting the electronic device 1100 to execute Fig.10 Step S1001 in; and / or other processes for the technology described herein.

[0206] Optionally, the processing unit 1103 is used to control the display unit 1101 to move and display the first content in response to the first operation. The processing unit 1103 is also used to support the electronic device 1100 to perform Fig. 9 Steps S902, S903, and S904 in; and / or, supporting the electronic device 1100 to execute Fig.10 Step S1002, step S1003, step S1004 and step S1005 in; and / or other processes for the technology described in this document.

[0207] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0208] Optionally, Fig.11 The electronic device 1100 shown may also include a storage unit ( Fig.11 (not shown), the storage unit stores a program or instruction. When the display unit 1101, the detection unit 1102 and the processing unit 1103 execute the program or instruction, Fig.11 The electronic device 1100 shown can execute the display method described in the above method embodiment.

[0209] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0210] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0211] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0212] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0213] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0214] An embodiment of the present application also provides a storage medium for storing instructions used by the above-mentioned communication device.

[0215] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a server, the server executes the above-mentioned related method steps to implement the display method in the above-mentioned embodiment.

[0216] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the display method in the above-mentioned embodiment.

[0217] In addition, the embodiment of the present application further provides a device, which may be a component or a module, and may include one or more processors and a memory connected to each other; wherein the memory is used to store computer programs, and the one or more computer programs include instructions. When the instructions are executed by one or more processors, the device executes the display method in the above-mentioned method embodiments.

[0218] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

[0219] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0220] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0221] In the several embodiments provided in the present application, it should be understood that the disclosed method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.

[0222] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0223] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0224] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code. The above is only a specific implementation of the present application, but the scope of protection of the present application is not limited to this. Any changes or replacements within the technical scope disclosed in the present application should be covered within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the scope of protection of the claims.

Claims

1. A display method, applied to a foldable electronic device; the electronic device comprises a first shell, a second shell and a rotating shaft; the first shell and the second shell can rotate relative to the rotating shaft; a first circuit board is arranged in the first shell, and a second circuit board is arranged in the second shell; a first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board; the electronic device determines the angle between the first shell and the second shell at least according to the first sensor and the second sensor; characterized in that, The method comprises: The electronic device displays the first content through a display screen, the display screen includes a first display area and a second display area, the first display area is arranged on the first housing, and the second display area is arranged on the second housing; receiving a first operation acting on the first content; In response to the first operation, moving and displaying the first content on the display screen; The moving and displaying the first content on the display screen includes: moving the first content displayed on the first display area to the second display area for display, wherein when the angle between the first shell and the second shell is a first angle, in response to the first operation, the first content is moved and displayed on the second display area at a first speed; when the angle between the first shell and the second shell is a second angle, in response to the first operation, the first content is moved and displayed on the second display area at a second speed; the first angle is different from the second angle, and the first speed is different from the second speed; Moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a third position to a fourth position on the first display area, and displaying a trajectory of the first content moving from a fifth position to a sixth position on the second display area, wherein the fourth position is different from the fifth position.

2. The method according to claim 1, characterized in that: The electronic device determines the angle between the first shell and the second shell at least according to the first sensor and the second sensor, including: When the electronic device is in a first folding state, the first sensor acquires a first sensing parameter, the second sensor acquires a second sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is a first angle based at least on the first sensing parameter and the second sensing parameter; When the electronic device is in the second folding state, the first sensor obtains a third sensing parameter, the second sensor obtains a fourth sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is a second angle based at least on the third sensing parameter and the fourth sensing parameter.

3. The method according to claim 1 or 2, characterized in that: The step of moving and displaying the first content on the display screen further includes: When the angle between the first shell and the second shell is the first angle, the first content is displayed on the display screen at a first acceleration. When the angle between the first shell and the second shell is the second angle, the first content is displayed on the display screen at a second acceleration. The first acceleration is different from the second acceleration.

4. The method according to claim 1, characterized in that The fourth position is located in the first display area, and the fifth position is located in the second display area.

5. The method according to claim 1 or 2, characterized in that: The first sensor includes at least one of a first acceleration sensor and a first gyro sensor, and the second sensor includes at least one of a second acceleration sensor and a second gyro sensor.

6. The method according to claim 1 or 2, characterized in that: The first operation includes one or more of the following: an operation of clicking on the first content, an operation of long pressing the first content, an operation of clicking and dragging the first content, a sliding operation on the first content, a somatosensory operation, a preset gesture operation, an operation of operating a preset control, and an operation of tilting the display screen.

7. An electronic device, the electronic device is a foldable electronic device; the electronic device comprises a first shell, a second shell and a rotating shaft; the first shell and the second shell can rotate relative to the rotating shaft; a first circuit board is arranged in the first shell, and a second circuit board is arranged in the second shell; a first sensor is arranged on the first circuit board, and a second sensor is arranged on the second circuit board; the electronic device determines the angle between the first shell and the second shell at least according to the first sensor and the second sensor; characterized in that The electronic device further includes: a processor, a memory and a display screen; the memory and the display screen are coupled to the processor, the memory is used to store computer program codes, the computer program codes include computer instructions, and when the processor reads the computer instructions from the memory, the electronic device performs the following operations: Displaying first content through the display screen, the display screen includes a first display area and a second display area, the first display area is arranged on the first shell, and the second display area is arranged on the second shell; receiving a first operation acting on the first content; In response to the first operation, moving and displaying the first content on the display screen; The moving and displaying the first content on the display screen includes: moving the first content displayed on the first display area to the second display area for display, wherein when the angle between the first shell and the second shell is a first angle, in response to the first operation, the first content is moved and displayed on the second display area at a first speed; when the angle between the first shell and the second shell is a second angle, in response to the first operation, the first content is moved and displayed on the second display area at a second speed; the first angle is different from the second angle, and the first speed is different from the second speed; Moving the first content displayed on the first display area to the second display area for display includes: displaying a trajectory of the first content moving from a third position to a fourth position on the first display area, and displaying a trajectory of the first content moving from a fifth position to a sixth position on the second display area, wherein the fourth position is different from the fifth position.

8. The electronic device according to claim 7, characterized in that: The electronic device determines the angle between the first shell and the second shell at least according to the first sensor and the second sensor, including: When the electronic device is in a first folding state, the first sensor acquires a first sensing parameter, the second sensor acquires a second sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is a first angle based at least on the first sensing parameter and the second sensing parameter; When the electronic device is in the second folding state, the first sensor obtains a third sensing parameter, the second sensor obtains a fourth sensing parameter, and the electronic device determines that the angle between the first shell and the second shell is a second angle based at least on the third sensing parameter and the fourth sensing parameter.

9. The electronic device according to claim 7 or 8, characterized in that: When the processor reads the computer instructions from the memory, the electronic device also performs the following operations: When the angle between the first shell and the second shell is the first angle, the first content is displayed on the display screen at a first acceleration. When the angle between the first shell and the second shell is the second angle, the first content is displayed on the display screen at a second acceleration. The first acceleration is different from the second acceleration.

10. The electronic device according to claim 7, characterized in that: The fourth position is located in the first display area, and the fifth position is located in the second display area.

11. The electronic device according to claim 7 or 8, characterized in that: The first sensor includes at least one of a first acceleration sensor and a first gyro sensor, and the second sensor includes at least one of a second acceleration sensor and a second gyro sensor.

12. The electronic device according to claim 7 or 8, characterized in that: The first operation includes one or more of the following: an operation of clicking on the first content, an operation of long pressing the first content, an operation of clicking and dragging the first content, a sliding operation on the first content, a somatosensory operation, a preset gesture operation, an operation of operating a preset control, and an operation of tilting the display screen.

13. A computer-readable storage medium, characterized in that: The method comprises a program or an instruction. When the program or the instruction is executed, the method according to any one of claims 1 to 6 is implemented.

14. A computer program product, characterized in that The computer program product comprises: a computer program or instructions, and when the computer program or instructions are run on a computer, the computer is caused to perform the method according to any one of claims 1 to 6.

Images