Display method of electronic device with flexible screen and electronic device
By adjusting the field of view during changes in the flexible screen's state, the problem of field of view changes caused by screen switching is solved, improving the gaming experience. In particular, it ensures fairness of field of view and information content in competitive games, achieving better gaming effects.
Patent Information
- Application Number
- CN202011051006.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-15
- Publication Date
- 2025-12-12
- Estimated Expiration
- 2039-11-15
AI Technical Summary
When users use electronic devices with flexible screens, the change in field of view when the screen switches from one physical form to another may narrow the game's field of view, affecting the gaming experience, especially in competitive games where it may lead to defeat.
During the transition of the flexible screen from a folded state to an unfolded state, the field of view is adjusted so that the field of view of the first display interface is smaller than that of the second display interface, and the field of view is expanded in the unfolded state to ensure fairness of the game's field of view and increase the amount of information.
By adjusting the field of view during screen state changes, the user's gaming experience is enhanced, especially in competitive games where it ensures fairness in the field of view, increases the amount of information, and improves the overall gaming experience.
Smart Images

Figure CN112230793B_ABST
Abstract
Description
[0001] This application is a divisional application of the application with the application date of November 15, 2019, the Chinese application number of 201911121860.X, and the invention name of "a display method of an electronic device with a flexible screen and the electronic device". TECHNICAL FIELD
[0002] The present application relates to the technical field of terminals, in particular to a display method of an electronic device with a flexible screen and the electronic device. BACKGROUND
[0003] The flexible screen includes screen types such as flexible organic light-emitting diode (OLED), and compared with the traditional screen, the flexible screen is not only lighter and thinner in volume, but also has the characteristics of being bendable and flexible. With the popularization of mobile devices such as mobile phones, people's demand for large-screen mobile phones is becoming stronger and stronger. However, large-screen mobile phones have the significant problem of being inconvenient to carry, so the foldable screen mobile phone with stretchable and deformable screen becomes the main direction to improve the portability.
[0004] Currently, some manufacturers have applied flexible screens to electronic devices such as mobile phones and tablet computers. As shown in the figure, the user can fold the screen when using the mobile phone with the flexible screen, so that the flexibility and portability of the mobile phone are higher. Currently, when the user plays games using the foldable screen mobile phone, if the user switches the flexible screen from one physical form to another, the sudden narrow field of view of the game may be caused due to the change of the screen ratio. For some fighting games, if the field of view is narrowed, the user may lose the game, resulting in poor game experience of the user. Figure 1 SUMMARY
[0005] The present application provides a display method of an electronic device with a flexible screen and the electronic device, which helps to improve the game experience of the user when playing games.
[0006] In a first aspect, a display method of an electronic device with a flexible screen is provided, the method comprising: if the flexible screen is in a folded state, in response to a first operation of opening a game application, the electronic device displays an interface of the game application through a first display interface; in response to the flexible screen being converted from the folded state to an unfolded state, the electronic device displays the interface of the game application through the flexible screen in full screen, and the interface of the game application displayed by the flexible screen in full screen is a second display interface; wherein the field of view range of the first display interface in a first direction is a first field of view range, and the field of view range of the second display interface in the first direction is a second field of view range, and the first field of view range is smaller than the second field of view range.
[0007] In the embodiments of the present application, during the process of the flexible screen converting from the folded state to the unfolded state, the field of view range of the first display interface is smaller than the field of view range of the second display interface, the expansion of the field of view range helps the user to see more information, which helps to improve the game experience of the user during the game.
[0008] In some possible implementation manners, the window of the first display interface includes a first long side and a first short side; the window of the second display interface includes a second long side and a second short side; the field of view range of the first display interface in the first short side direction is a first field of view range, and the field of view range of the second display interface in the second short side direction is a second field of view range, the first field of view range being smaller than the second field of view range.
[0009] In the embodiments of the present application, during the process of the flexible screen converting from the folded state to the unfolded state, the field of view range of the first display interface in the first short side direction is smaller than the field of view range of the second display interface in the second short side direction, the expansion of the field of view range helps the user to see more information, which helps to improve the game experience of the user during the game.
[0010] In some possible implementation manners, the size of the first long side is the same as the size of the second long side; and the size of the first short side is smaller than the size of the second short side.
[0011] In some possible implementation manners, the first field of view range is smaller than the second field of view range, which can also be understood as that the content or information amount contained in the first field of view range is smaller than the content or information amount contained in the second field of view range.
[0012] With reference to the first aspect, in some implementation manners of the first aspect, the field of view range of the first display interface in the first long side direction is a third field of view range, and the field of view range of the second display interface in the second long side direction is a fourth field of view range, the third field of view range being greater than or equal to the fourth field of view range.
[0013] In the embodiments of the present application, for the fairness constraint of the game field of view, during the process of the flexible screen converting from the folded state to the unfolded state, the field of view range of the first display interface in the first long side direction is greater than the field of view range of the second display interface in the second long side direction, that is, compared with the first long side direction, the field of view range in the second long side direction is cropped; compared with the first short side direction, the field of view range in the second short side direction is expanded, so as to realize that the entire field of view area on the first display interface and the entire field of view area on the second display interface remain basically unchanged, and on the premise of guaranteeing the fairness of the game field of view, the game experience of the user during the game is improved.
[0014] In the embodiments of the present application, for some non-competitive games or competitive games without fairness constraints on the game field of view, during the process of the flexible screen being switched from the folded state to the unfolded state, the field of view range of the first display interface in the first long side direction is equal to the field of view range of the second display interface in the second long side direction, so that the field of view range in the second long side direction is maintained compared with the first long side direction, and the field of view range in the second short side direction is expanded compared with the first short side direction, so as to realize that the entire field of view area on the second display interface is larger than the entire field of view area on the first display interface, which is helpful to improve the game experience of the user when playing the game.
[0015] In some possible implementation manners, the size of the first long side and the size of the second long side are the same, including that the pixel value corresponding to the first long side and the pixel value corresponding to the second long side are the same; and the size of the first short side is smaller than the size of the second short side, including that the ratio of the pixel value corresponding to the first short side and the pixel value corresponding to the second short side is less than 1.
[0016] With reference to the first aspect, in some implementation manners of the first aspect, the method further includes: in response to the flexible screen being switched from the unfolded state to the folded state, displaying the interface of the game application through the first display interface.
[0017] With reference to the first aspect, in some implementation manners of the first aspect, the method further includes: the electronic device sends a request message to a server, the request message being used to request game configuration parameters, the game configuration parameters including first game configuration parameters and second game configuration parameters; the first game configuration parameters being used to determine display parameters of the interface of the game application displayed through the first display interface, and the second game configuration parameters being used to determine display parameters of the interface of the game application displayed through the second display interface; if the flexible screen is in the folded state, the electronic device determines the first display interface to display the interface of the game application according to the first game configuration parameters; and if the flexible screen is in the unfolded state, the electronic device determines the second display interface to display the interface of the game application according to the second game configuration parameters.
[0018] In the embodiments of the present application, the electronic device can obtain the game configuration parameters in different screen display states from the server, so as to determine the interface of the game application in the corresponding screen display state according to different game configuration parameters when the flexible screen is in different screen display states.
[0019] In a possible implementation of the first aspect, the method further includes: sending, by the electronic device, a request message to the server, the request message including first indication information, the first indication information being used to indicate that the flexible screen is in the folded state or the unfolded state; receiving, by the electronic device, a response message sent by the server, the response message including game configuration parameters; if the first indication information is used to indicate that the flexible screen is in the folded state, the game configuration parameters are used to determine display parameters of an interface of the game application displayed through the first display interface; if the first indication information is used to indicate that the flexible screen is in the unfolded state, the game configuration parameters are used to determine display parameters of an interface of the game application displayed through the second display interface; and displaying, by the electronic device, the interface of the game application according to the game configuration parameters.
[0020] In the embodiments of the present application, the electronic device can obtain the game configuration parameters in the current screen display state from the server, so that when the game configuration parameters in the current screen display state are obtained, the interface of the game application in the corresponding screen display state is determined according to the game configuration parameters.
[0021] In a second aspect, an apparatus is provided, which is included in an electronic device, and the apparatus has functions of implementing the behaviors of the electronic device in the above aspects and possible implementation manners. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions.
[0022] In a third aspect, an electronic device is provided, which includes: a flexible screen; one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and include instructions. When the instructions are executed by the electronic device, the electronic device performs the display method of the electronic device with the flexible screen in any possible implementation of the first aspect.
[0023] In a fourth aspect, a computer storage medium is provided, which includes computer instructions. When the computer instructions are run on an electronic device, the electronic device performs the display method of the electronic device with the flexible screen in any possible implementation of the first aspect.
[0024] In a fifth aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device performs the display method of the electronic device with the flexible screen in any possible implementation of the first aspect.
[0025] In a sixth aspect, a chip system is provided, which comprises at least one processor, when program instructions are executed in the at least one processor, the functions of the method of any one of the first aspect are realized on the electronic device. BRIEF DESCRIPTION OF DRAWINGS
[0026] Figure 1 Structure diagram of an electronic device with a flexible screen in the prior art;
[0027] Figure 2 Structure diagram of an electronic device with a flexible screen in the prior art; Figure 1
[0028] Figure 3A Structure diagram of an electronic device with a flexible screen in the prior art; Figure 2
[0029] Structure diagram of an electronic device with a flexible screen in the prior art; Figure 3B
[0030] Structure diagram of an electronic device with a flexible screen in the prior art; Figure 4 Figure 4
[0031] Figure 5A Structure diagram of an electronic device with a flexible screen in the prior art;
[0032] Figure 5B Structure diagram of an electronic device with a flexible screen in the prior art;
[0033] Figure 6A Structure diagram of an electronic device with a flexible screen in the prior art; Figure 1
[0034] Figure 6B Structure diagram of an electronic device with a flexible screen in the prior art; Figure 2
[0035] Figure 7A Structure diagram of an electronic device with a flexible screen in the prior art; Figure 1
[0036] Structure diagram of an electronic device with a flexible screen in the prior art; Figure 7B Figure 2 Structure diagram of an electronic device with a flexible screen in the prior art;
[0037] Figure 7C
[0038] Figure 7D Scenario diagram of the display method of the electronic device with a flexible screen provided in the embodiments of the present application Figure 4
[0039] Figure 8A Scenario diagram of the display method of the electronic device with a flexible screen provided in the embodiments of the present application
[0040] Figure 8B Scenario diagram of the display method of the electronic device with a flexible screen provided in the embodiments of the present application
[0041] Figure 9A Scenario diagram of the display method of the electronic device with a flexible screen provided in the embodiments of the present application
[0042] Figure 9B Scenario diagram of the display method of the electronic device with a flexible screen provided in the embodiments of the present application
[0043] Figure 10 Schematic flowchart of the display method of the electronic device with a flexible screen provided in the embodiments of the present application. DETAILED DESCRIPTION
[0044] The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0045] The display method of the electronic device with a flexible screen provided in the embodiments of the present application can be applied to electronic devices with a flexible screen such as mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, personal digital assistants (PDA), wearable devices, virtual reality devices, etc., and the present application does not make any limitation in this regard.
[0046] Taking a mobile phone 100 as an example of the above electronic device, Figure 2 a structural schematic diagram of the mobile phone is shown.
[0047] The mobile phone 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a radio frequency module 150, a communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a flexible screen 301, and a subscriber identification module (SIM) card interface 195, etc.
[0048] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.
[0049] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.
[0050] Among them, the controller can be the nerve center and command center of the mobile phone 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching instructions and executing instructions.
[0051] The memory in the processor 110 can also be provided for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. Avoiding repeated access, reducing the waiting time of the processor 110, thus improving the efficiency of the system.
[0052] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0053] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, realizing the touch function of the mobile phone 100.
[0054] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus, realizing the communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the communication module 160 through the I2S interface, realizing the function of answering the phone through the Bluetooth earphone.
[0055] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the communication module 160 can be coupled through the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the communication module 160 through the PCM interface, realizing the function of answering the phone through the Bluetooth earphone. The I2S interface and the PCM interface can both be used for audio communication.
[0056] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the communication module 160. For example, the processor 110 communicates with the Bluetooth module in the communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the communication module 160 through the UART interface to realize the function of playing music through the Bluetooth headset.
[0057] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the flexible screen 301 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to realize the shooting function of the mobile phone 100. The processor 110 and the flexible screen 301 communicate through the DSI interface to realize the display function of the mobile phone 100.
[0058] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the flexible screen 301, the communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0059] The USB interface 130 is an interface that meets the USB standard specification, which can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile phone 100, or to transmit data between the mobile phone 100 and peripheral devices. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0060] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the mobile phone 100. In some other embodiments of the present application, the mobile phone 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.
[0061] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive wireless charging input through a wireless charging coil of the mobile phone 100. The charging management module 140 can charge the battery 142 and supply power to the electronic devices through the power management module 141.
[0062] The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the flexible screen 301, the camera 193, and the communication module 160, etc. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.
[0063] The wireless communication function of the mobile phone 100 can be implemented through the antenna 1, the antenna 2, the radio frequency module 150, the communication module 160, the modem processor, and the baseband processor, etc.
[0064] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone 100 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.
[0065] The radio frequency module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the mobile phone 100. The radio frequency module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The radio frequency module 150 can receive electromagnetic waves from the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit the electromagnetic waves to the modem processor for demodulation. The radio frequency module 150 can also amplify signals modulated by the modem processor and convert the signals into electromagnetic waves radiated through the antenna 1. In some embodiments, at least part of the functional modules of the radio frequency module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the radio frequency module 150 and at least part of the modules of the processor 110 can be disposed in the same device.
[0066] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the flexible screen 301. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110 and be arranged in the same device as the radio frequency module 150 or other functional modules.
[0067] The communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. The communication module 160 can be one or more devices that integrate at least one communication processing module. The communication module 160 receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The communication module 160 can also receive signals to be transmitted from the processor 110, modulate them, amplify them, and convert them into electromagnetic wave radiation via the antenna 2.
[0068] In some embodiments, the antennas 1 and the radio frequency module 150 of the mobile phone 100 are coupled, and the antennas 2 and the communication module 160 are coupled, so that the mobile phone 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).
[0069] The mobile phone 100 implements a display function through a GPU, the flexible screen 301, and an application processor, etc. The GPU is a microprocessor for image processing, connected to the flexible screen 301 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information. In the embodiments of the present application, the flexible screen 301 can include a display and a touch device. The display is used to output display content to the user, and the touch device is used to receive touch events input by the user on the flexible screen 301.
[0070] As Figure 3AAs shown in (a) of FIG. 3, the flexible screen 301 can be displayed as a whole display area in the unfolded state. The user can fold the screen along one or more folding axes in the flexible screen 301. The positions of the folding axes can be pre-set or selected by the user in the flexible screen 301.
[0071] As shown in (a) of FIG. 3, the flexible screen 301 can be displayed as a whole display area in the unfolded state. The user can fold the screen along one or more folding axes in the flexible screen 301. The positions of the folding axes can be pre-set or selected by the user in the flexible screen 301. Figure 3A As shown in (b) of FIG. 3, after the user folds the flexible screen 301 along the folding axis AB in the flexible screen 301, the display interface of the mobile phone 100 can be divided into two display interfaces, i.e., display interface 1 and display interface 2, along the folding axis AB. In the embodiments of the present application, the display interface 1 and the display interface 2 after folding can be displayed as two independent display areas. For example, the display interface 1 can be referred to as the main screen of the mobile phone 100, and the display interface 2 can be referred to as the secondary screen of the mobile phone 100. The display areas of the main screen and the secondary screen can be the same or different. Alternatively, the display interface 1 can be referred to as the large screen of the mobile phone 100, and the display interface 2 can be referred to as the small screen of the mobile phone 100. Alternatively, the display interface 1 can be referred to as the inner screen of the mobile phone 100, and the display interface 2 can be referred to as the outer screen of the mobile phone 100.
[0072] Hereinafter, the display interface 1 is referred to as the main screen of the mobile phone 100, and the display interface 2 is referred to as the secondary screen of the mobile phone 100.
[0073] It should be noted that after the user folds the flexible screen 301 along the folding axis AB, the main screen and the secondary screen can be arranged oppositely, or the main screen and the secondary screen can be away from each other. As shown in (c) of FIG. 3, after the user folds the flexible screen 301, the main screen and the secondary screen are away from each other, at this time, the main screen and the secondary screen are exposed to the external environment, and the user can use the main screen for display or use the secondary screen for display. Figure 3A
[0074] In some embodiments, as shown in (c) of FIG. 3, after the user folds the flexible screen 301, the screen of the bending part (also referred to as the side screen) can also be used as an independent display interface, at this time, the flexible screen 301 is divided into three independent display interfaces, i.e., the main screen, the secondary screen and the side screen. Figure 3A
[0075] For example, as shown in (c) of FIG. 3, after the user folds the flexible screen 301, the screen of the bending part (also referred to as the side screen) can also be used as an independent display interface, at this time, the flexible screen 301 is divided into three independent display interfaces, i.e., the main screen, the secondary screen and the side screen. Figure 3B As shown, the size of the flexible screen 301 is 2480*2200 (in pixels), and the screen ratio is 8:7.1. The width of the folding axis AB on the flexible screen 301 is 166. After folding along the folding axis AB, the size of the right side of the flexible screen 301 is 2480*1144 (in pixels), and the screen ratio is 19.5:9. The area of the right side of the flexible screen 301 is divided into a main screen. The size of the left side of the flexible screen 301 is 2480*890 (in pixels), and the screen ratio is 25:9. The area of the left side of the flexible screen 301 is divided into a secondary screen. At this time, the folding axis AB with a size of 2480*166 can be used as a side screen. It should be understood that the folding axis referred to herein is only used for convenience of understanding. The folding axis can also be a folding band, a boundary line, a boundary band, or the like, which is not limited herein.
[0076] Referring to Figure 4 When the user folds the flexible screen 301, the main screen and the secondary screen divided therefrom are at a certain angle. In the embodiment of the present application, the mobile phone 100 can calculate the angle between the main screen and the secondary screen according to the data detected by one or more sensors.
[0077] For example, a gyroscope and an acceleration sensor can be arranged on the main screen 41 and the secondary screen 42 of the mobile phone 100, respectively. The gyroscope on the main screen 41 can detect the rotation angular velocity when the main screen 41 rotates, and the acceleration sensor on the main screen 41 can detect the acceleration generated when the main screen 41 moves. Further, the mobile phone 100 can determine the size and direction of the gravity G according to the data detected by the gyroscope and the acceleration sensor on the main screen 41. Similarly, the mobile phone 100 can also determine the size and direction of the gravity G according to the data detected by the gyroscope and the acceleration sensor on the secondary screen 42. Alternatively, if the sensor A can detect the size and direction of the gravity G, the sensor A can be arranged on the main screen 41 and the secondary screen 42, respectively. For example, the gyroscope and the acceleration sensor can be integrated into one sensor and arranged on the main screen 41 and the secondary screen 42, respectively.
[0078] Further, as Figure 4 shown, a corresponding coordinate system can be arranged on the main screen 41 and the secondary screen 42, respectively. For example, a Cartesian coordinate system O1 can be arranged in the secondary screen 42. In the Cartesian coordinate system O1, the x-axis is parallel to the shorter side of the secondary screen 42, the y-axis is parallel to the longer side of the secondary screen 42, and the z-axis is perpendicular to the plane formed by the x-axis and the y-axis and points outward from the secondary screen 42. Similarly, a Cartesian coordinate system O2 can be arranged in the main screen 41. In the Cartesian coordinate system O2, the x-axis is parallel to the shorter side of the main screen 41, the y-axis is parallel to the longer side of the main screen 41, and the z-axis is perpendicular to the plane formed by the x-axis and the y-axis and points inward from the main screen 41.
[0079] For example, the gyroscope and accelerometer in the secondary screen 42 can detect the magnitude and direction of gravity G in the Cartesian coordinate system O1, and the gyroscope and accelerometer in the main screen 41 can detect the magnitude and direction of gravity G in the Cartesian coordinate system O2. Since the y-axis points in the same direction in the Cartesian coordinate systems O1 and O2, the component G1 of gravity G in the x-axis and z-axis planes of the Cartesian coordinate system O1 is equal in magnitude but different in direction from the component G2 of gravity G in the x-axis and z-axis planes of the Cartesian coordinate system O2. The angle between component G1 and component G2 is the angle between the Cartesian coordinate systems O1 and O2, and similarly, it is the angle β between the secondary screen 42 and the main screen 41.
[0080] Therefore, by calculating the angle between the component G1 of gravity G in Cartesian coordinate system O1 and the component G2 of gravity G in Cartesian coordinate system O2, the mobile phone 100 can obtain the angle β between the secondary screen 42 and the main screen 41. It can be understood that the angle β between the main screen 41 and the secondary screen 42 is within a closed interval of 0 to 180°.
[0081] For example, such as Figure 5A As shown in (a), when the angle β between the main screen 41 and the secondary screen 42 is greater than a first threshold (e.g., 170°), the mobile phone 100 can determine that the flexible screen 301 is in an unfolded state. Figure 5A As shown in (b), when the angle β between the main screen 41 and the secondary screen 42 is less than a second threshold (e.g., 20°), the mobile phone 100 can determine that the flexible screen 301 is in a folded state. Alternatively, as... Figure 5A As shown in (c), when the included angle β between the main screen 41 and the secondary screen 42 is within a preset range (e.g., between 40° and 60°), the mobile phone 100 can determine that the flexible screen 301 is in a support state. In this embodiment, the physical form of the flexible screen 301 can be divided into an unfolded state and a non-unfolded state. Any physical form of the flexible screen 301 other than the unfolded state can be referred to as the non-unfolded state. For example, the support state and the folded state mentioned above both belong to the non-unfolded state.
[0082] Correspondingly, such as Figure 5B As shown in (a), when the angle β between the main screen 41 and the secondary screen 42 is greater than a first threshold (e.g., 170°), the mobile phone 100 can determine that the flexible screen 301 is in an unfolded state. Figure 5B As shown in (b), when the angle β between the main screen 41 and the secondary screen 42 is less than a second threshold (e.g., 20°), the mobile phone 100 can determine that the flexible screen 301 is in a folded state. Alternatively, as... Figure 5BWhen the angle β between the main screen 41 and the auxiliary screen 42 is within a preset range (for example, between 40° and 60°), the mobile phone 100 can determine that the flexible screen 301 is in the stand state.
[0083] The state of the flexible screen 301 can also be determined in other manners, for example, by setting a gravity sensor and an acceleration sensor on the mobile phone, and the like. The manner in which the state of the flexible screen 301 is determined in the embodiments of the present application is not limited in any way.
[0084] In the embodiments of the present application, when the flexible screen 301 is in the folded state or the stand state, the mobile phone 100 can light up one of the main screen 41 and the auxiliary screen 42. For example, the mobile phone 100 can light up the main screen 41 or the mobile phone 100 can light up the screen closer to the user. If the mobile phone 100 lights up the main screen 41, the mobile phone 100 can display the display interface of the corresponding game application through the main screen 41 after detecting the operation of the user opening the game application. At this time, the pixel size on the main screen 41 can be 2480*1144. When the user switches the flexible screen 301 from the folded state or the stand state to the unfolded state during the game playing process, the mobile phone 100 can light up the main screen 41 and the auxiliary screen 42 as a complete display screen. At this time, the pixel size on the large screen can be 2480*2200. Compared with the previous display of the interface of the game application only on the main screen 41, the field of view range in the X direction remains unchanged, and the field of view range in the Y direction is expanded, so as to realize the expansion of the game field of view area. Alternatively, the field of view range in the X direction is cropped, and the field of view range in the Y direction is expanded. The expansion of the field of view range in the Y direction can compensate for the cropping of the field of view range in the X direction, so as to ensure that the field of view area remains basically unchanged during the switching from the display on the main screen to the display on the large screen, and the fairness of the game is ensured.
[0085] It should be understood that, in the embodiments of the present application, the interface of the game application can be displayed through the display interface 1 in the main screen display state. The window of the display interface 1 includes a long side and a short side. The interface of the game application can be displayed through the full-screen display of the flexible screen in the large screen display state. The window of the full-screen display of the flexible screen includes a long side and a short side. The X direction can be the direction of the long side of the display interface 1 or the direction of the long side of the full-screen display of the flexible screen. The Y direction can be the direction of the short side of the display interface 1 or the direction of the short side of the full-screen display of the flexible screen.
[0086] In one embodiment, the size of the long side of the display interface 1 and the size of the long side of the full-screen display of the flexible screen can be the same. Alternatively, the number of pixels corresponding to the long side of the display interface 1 and the number of pixels corresponding to the long side of the full-screen display of the flexible screen can be the same. For example, Figure 3BAs shown, the pixel value corresponding to the long side of the display interface 1 is 2480, and the pixel value corresponding to the long side of the flexible screen in full screen display is 2480.
[0087] In one embodiment, the size of the short side of the display interface 1 is smaller than the size of the short side in full screen display of the flexible screen. Alternatively, the pixel value corresponding to the long side of the display interface 1 is smaller than the pixel value corresponding to the long side in full screen display of the flexible screen; or the ratio of the pixel value corresponding to the long side of the display interface 1 to the pixel value corresponding to the long side in full screen display of the flexible screen is less than 1. As shown in the following table, the pixel value corresponding to the long side of the display interface 1 is 2480, and the pixel value corresponding to the long side of the flexible screen in full screen display is 2480. Figure 3B As shown, the pixel value corresponding to the short side of the display interface 1 is 1144, and the pixel value corresponding to the long side of the flexible screen in full screen display is 2200.
[0088] For example, the pixel ratio of the length and width in the main screen state is 19.5:9, wherein the X direction is the direction corresponding to 19.5, and the Y direction is the direction corresponding to 9. For another example, the pixel ratio of the length and width in the large screen state is 8:7.1, wherein the X direction is the direction corresponding to 8, and the Y direction is the direction corresponding to 7.1. Alternatively, the X direction can be the direction of the side with more pixels, and the Y direction can be the direction of the side with less pixels.
[0089] It should also be understood that the field of view in the embodiments of the present application is related to the visible picture in the interface of the game application, and the expansion of the field of view in the Y direction can be understood as more and richer content or information displayed in the Y direction.
[0090] The sensor module 180 can include one or more of a gyroscope, an acceleration sensor, a pressure sensor, a barometric pressure sensor, a magnetic sensor (such as a Hall sensor), a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, a pyroelectric infrared sensor, an ambient light sensor, or a bone conduction sensor, and the like, and the embodiments of the present application do not limit the same.
[0091] The mobile phone 100 can realize the photographing function through the ISP, the camera 193, the video codec, the GPU, the flexible screen 301, and the application processor, etc.
[0092] The ISP is used to process the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the algorithm of the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be arranged in the camera 193.
[0093] Camera 193 is used to capture still images or videos. Objects project optical images through the lens to the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP to convert into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard image signal in RGB, YUV, or the like. In some embodiments, the mobile phone 100 can include one or N cameras 193, where N is a positive integer greater than 1.
[0094] The digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the mobile phone 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0095] The video codec is used to compress or decompress digital video. The mobile phone 100 can support one or more video codecs. In this way, the mobile phone 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.
[0096] The NPU is a neural-network (NN) computing processor that learns from the structure of biological neural networks, such as the transmission mode between human brain neurons, to quickly process input information and continuously self-learn. Through the NPU, the mobile phone 100 can implement intelligent cognitive applications, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0097] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, music, video, and other files are saved in the external memory card.
[0098] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 performs various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data (such as audio data, a phone book, etc.) created during use of the mobile phone 100, and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
[0099] The mobile phone 100 can realize an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, an application processor, and the like. For example, music playing, recording, and the like.
[0100] The audio module 170 is used to convert digital audio information into an analog audio signal output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode an audio signal. In some embodiments, the audio module 170 can be disposed in the processor 110, or part of the functions of the audio module 170 can be disposed in the processor 110.
[0101] The speaker 170A, also known as a “loudspeaker”, is used to convert an audio electrical signal into a sound signal. The mobile phone 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0102] The receiver 170B, also known as a “earpiece”, is used to convert an audio electrical signal into a sound signal. When the mobile phone 100 answers a call or a voice message, the receiver 170B can be held close to a human ear to listen to the voice.
[0103] The microphone 170C, also known as a “microphone”, “sound transducer”, is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user can speak into the microphone 170C close to the human mouth to input a sound signal into the microphone 170C. The mobile phone 100 can be provided with at least one microphone 170C. In other embodiments, the mobile phone 100 can be provided with two microphones 170C, which can not only collect sound signals, but also realize a noise reduction function. In other embodiments, the mobile phone 100 can be provided with three, four or more microphones 170C, which can not only collect sound signals and reduce noise, but also identify a sound source and realize a directional recording function, and the like.
[0104] The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0105] The keys 190 include a power-on key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The mobile phone 100 can receive key inputs and generate key signal inputs related to user settings and function control of the mobile phone 100.
[0106] The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, or for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, playing audio, and the like) can correspond to different vibration feedback effects. Touch operations on different regions of the flexible screen 301 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, received messages, alarms, games, and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effects can also be customizable.
[0107] The indicator 192 can be an indicator light, which can be used to indicate a charging state, a power change, or to indicate messages, missed calls, notifications, and the like.
[0108] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the mobile phone 100. The mobile phone 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195. The types of the multiple cards can be the same or different. The SIM card interface 195 can be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external storage cards. The mobile phone 100 interacts with a network through a SIM card to achieve functions such as calls and data communication. In some embodiments, the mobile phone 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the mobile phone 100 and cannot be separated from the mobile phone 100.
[0109] The software system of the mobile phone 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application take an Android system with a layered architecture as an example to illustrate the software structure of the mobile phone 100.
[0110] Figure 6A is a software structure block diagram of the mobile phone 100 according to an embodiment of the present application.
[0111] The layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0112] The application layer can include a series of application packages.
[0113] As shown in Figure 6A , the application layer can install camera, gallery, calendar, call, map, game, Bluetooth, music, video, short message, etc. applications.
[0114] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.
[0115] As shown in Figure 6A , the application framework layer can include display policy management service, power management service (PMS), display management service (DMS). Of course, the application framework layer can also include activity manager, window manager, content provider, view system, phone manager, resource manager, notification manager, etc., and the embodiments of the present application do not make any limitation on this.
[0116] Among them, the display policy management service can be used to obtain the specific physical form of the flexible screen from the underlying display system. Further, the display policy management service can determine the display parameters according to the specific physical form of the flexible screen. For example, the display parameters can include the field of view display size in the X direction or Y direction under the main screen, the field of view display size in the X direction or Y direction under the secondary screen, or the field of view display size in the X direction or Y direction under the large screen, etc.
[0117] For example, when the mobile phone detects that the user starts a non-competitive game (or a competitive game without field-of-view fairness constraint), and the flexible screen of the mobile phone is in the folded state or the support state, the field-of-view range of the game interface displayed on the main screen in the X direction is the first field-of-view range, and the field-of-view range in the Y direction is the second field-of-view range. When the mobile phone detects that the flexible screen in the folded state or the support state changes to the unfolded state, the mobile phone can keep the field-of-view range in the X direction unchanged and widen the field-of-view range in the Y direction to the third field-of-view range while lighting up the large screen. The third field-of-view range is larger than the second field-of-view range. In this way, after switching to the large screen display, the field-of-view area of the game displayed on the whole large screen is increased compared with the field-of-view area of the game displayed on the main screen, which helps to improve the game experience of the user when playing the game.
[0118] For example, when the mobile phone detects that the user starts a non-competitive game (or a competitive game without field-of-view fairness constraint), and the flexible screen of the mobile phone is in the folded state or the support state, the field-of-view range of the game interface displayed on the main screen in the X direction is the first field-of-view range, and the field-of-view range in the Y direction is the second field-of-view range. When the mobile phone detects that the flexible screen in the folded state or the support state changes to the unfolded state, the mobile phone can keep the field-of-view range in the X direction unchanged and widen the field-of-view range in the Y direction to the third field-of-view range while lighting up the large screen. The third field-of-view range is larger than the second field-of-view range. In this way, after switching to the large screen display, the field-of-view area of the game displayed on the whole large screen is increased compared with the field-of-view area of the game displayed on the main screen, which helps to improve the game experience of the user when playing the game.
[0119] It should be understood that, in the embodiments of the present application, the display parameters of the competitive game or the non-competitive game on the main screen, the auxiliary screen or the large screen can be issued to the mobile phone by the game server, and the display strategy management service can determine which display parameter to use according to the specific physical form of the flexible screen, so as to notify the display management service (DMS) of the corresponding display parameter. The DMS can display on the flexible screen through the surfaceflinger and the display driver. As shown in the figure, the system library and the kernel layer below the application program framework layer can be referred to as the underlying system, and the underlying system includes an underlying display system for providing a display service, for example, the underlying display system includes a display driver in the kernel layer and a surface manager in the system library. Moreover, the underlying system in the present application further includes a state monitoring service for identifying the physical form change of the flexible screen, which can be independently arranged in the underlying display system, or arranged in the system library and / or the kernel layer. Figure 6A
[0120] For example, the state monitoring service can invoke the sensor service to activate sensors such as gyroscopes and accelerometers for detection. The state monitoring service can calculate the angle between the main screen and the secondary screen based on the detection data reported by each sensor. Thus, by using the angle between the main screen and the secondary screen, the state monitoring service can determine the physical state of the flexible screen, such as whether it is in an unfolded state, a folded state, or a support state. Furthermore, the state monitoring service can report the determined physical state to the aforementioned display strategy management service.
[0121] and Figure 6A Similarly, such as Figure 6B The diagram illustrates the data flow within the Android operating system. For example, the hardware-level gyroscope and accelerometer report detected data to the sensor driver. The sensor driver then reports this data to the status monitoring service via the sensor service. Alternatively, the sensor driver can report the data via configuration changes messages. The status monitoring service determines the angle between the main screen and the secondary screen based on the data from the gyroscope and accelerometer, thus determining the physical form of the flexible screen. Furthermore, the status monitoring service reports the determined physical form of the flexible screen to the display strategy management service, which then decides on the display parameters for the current flexible screen. The display strategy management service notifies the display management service (DMS) of the determined display parameters. For example, when the flexible screen is in large-screen display mode, the DMS can power on the entire flexible screen via SurfaceFlinger and the display driver and display the game interface according to the corresponding display parameters in large-screen display mode. Additionally, the DMS can notify the window manager service (WMS) to create corresponding windows on the flexible screen for display.
[0122] In one embodiment, when the mobile phone detects a user's click on a game application (e.g., APP 3), the mobile phone can communicate with the game server. The mobile phone can send its model number to the game server, which is mainly for the game server to identify whether the mobile phone is a foldable screen phone. If the game server determines that the mobile phone is a foldable screen phone based on the model number, it can send game configuration parameters for different flexible screen forms to the mobile phone. The game configuration parameters for different forms can be stored in the game application at the application layer.
[0123] In another embodiment, when the phone detects that the user clicks the game application (for example, APP 3), the phone can communicate with the game server, and the phone can send the phone model and the current display state of the flexible screen of the phone to the game server. The game server can send the game configuration parameters corresponding to the current display state of the flexible screen of the phone to the phone.
[0124] For example, when the phone is in a folded state or a stand state, only the main screen of the flexible screen of the phone is lit, and the phone can notify the game server that the main screen is in a lit state. After obtaining the phone model and the current display state of the flexible screen of the phone, the game server can send the game configuration parameters corresponding to the display state of the main screen to the phone.
[0125] When the phone switches from the folded state or the stand state to the unfolded state, the flexible screen of the phone switches from the main screen display to the large screen display. At this time, the phone can continue to send the display phone model and the current display state of the flexible screen of the phone to the game server. After receiving the same, the game server can return the game configuration parameters corresponding to the display state of the large screen to the phone.
[0126] After the phone obtains the game configuration parameters corresponding to the screen mode from the game server, the game configuration parameters can be stored in the game application. After determining the physical form of the flexible screen of the phone, the display strategy management service can request the game configuration parameters corresponding to the game application (for example, APP 3) from the game application. The game application can send the game configuration parameters corresponding to the game application to the display strategy management service. The display strategy management service can send the game configuration parameters corresponding to the game application to the DMS, and the DMS can display the game interface on the flexible screen through the surfaceflinger and the display driver.
[0127] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.
[0128] The core library includes two parts: one part is the function function required to be called by the java language, and the other part is the core library of the Android.
[0129] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to execute the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection.
[0130] The system library can include multiple functional modules. For example: a surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), and 2D graphics engines (e.g., SGL). The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media libraries support playback and recording of various common audio and video formats, as well as still image files. The media libraries support various audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing libraries are used to implement 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.
[0131] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, sensor drivers, etc., but this application embodiment does not impose any limitations on this.
[0132] The following will use a mobile phone as an example of an electronic device and, in conjunction with the accompanying drawings, elaborate in detail on a display method for an electronic device with a flexible screen provided in this application.
[0133] Figure 7 illustrates a set of graphical user interfaces (GUIs) for a mobile phone, from which... Figure 7A to Figure 7D This demonstrates the process of a user switching from the main screen display mode to the large screen display mode when playing a competitive game (such as Honor of Kings) that has field-of-view fairness constraints.
[0134] See Figure 7A The GUI shown is the phone's desktop. The phone is currently folded, and the home screen can be turned on, displaying the desktop, which includes icons for one or more applications (APPs). These icons may include browser icons, calculator icons, weather icons, reading icons, photo album icons, and game application icon 701. When the phone detects a user tapping icon 701, it can display... Figure 7B The GUI shown.
[0135] When the phone detects that the user clicked on icon 710, the phone can send the phone model to the game's server. After receiving the phone model sent by the phone, if the game server determines that the phone is a foldable phone or has multiple screen modes, then the server can send the game configuration parameters for each screen mode to the phone.
[0136] Exemplarily, Table 1 shows display parameters of the server for different display states of the flexible screen of the mobile phone.
[0137] Table 1
[0138] Screen mode Game configuration parameters Main screen display state (19.5:9) Game configuration parameters 1 Sub screen display state (19.5:9) Game configuration parameters 2 Large screen display state (8:7.1) Game configuration parameters 3
[0139] The game configuration parameter 1 is used to determine display parameters of an interface of a game application in the main screen display state, and the display parameters can determine a field of view range in the X direction and a field of view range in the Y direction in the main screen display state.
[0140] The game configuration parameter 2 is used to determine display parameters of an interface of a game application in the secondary screen display state, and the display parameters can determine a field of view range in the X direction and a field of view range in the Y direction in the secondary screen display state.
[0141] The game configuration parameter 3 is used to determine display parameters of an interface of a game application in the large screen display state, and the display parameters can determine a field of view range in the X direction and a field of view range in the Y direction in the large screen display state.
[0142] The field of view range in the X direction in the main screen display state determined by the game configuration parameter 1 is greater than the field of view range in the X direction in the large screen display state determined by the game configuration parameter 3.
[0143] The field of view range in the Y direction in the main screen display state determined by the game configuration parameter 1 is less than the field of view range in the Y direction in the large screen display state determined by the game configuration parameter 3.
[0144] It should be understood that, in the embodiments of the present application, the field of view range is a relative width and is used to measure the content or information contained in the X direction or the Y direction. Specifically, in a game scene, the field of view range can be used to measure how many scene objects are contained in the corresponding scene. The field of view range in the Y direction in the main screen display state being less than the field of view range in the Y direction in the large screen display state can also be understood as the number of scene objects displayed in the Y direction in the main screen display state being less than the number of scene objects displayed in the Y direction in the large screen display state; and the field of view range in the X direction in the main screen display state being greater than the field of view range in the X direction in the large screen display state can also be understood as the number of scene objects displayed in the X direction in the main screen display state being greater than the number of scene objects displayed in the X direction in the large screen display state.
[0145] It should also be understood that in the embodiments of the present application, the screen ratio in the secondary screen display state and the main screen display state can be the same (for example, both are 19.5:9), so the field of view range in the X direction and the Y direction can be the same, and the field of view area in the secondary screen display state and the main screen display state can be the same; or the screen ratio in the secondary screen display state and the main screen display state can be different, so the field of view range in the X direction and the Y direction can be different, and the field of view area in the secondary screen display state and the main screen display state of the game with the field of view fairness constraint of the game remains basically unchanged.
[0146] It should also be understood that in the embodiments of the present application, in addition to determining the display parameters of the interface of the game application in the corresponding screen display state, the game configuration parameters can also determine the layout, position and spacing of the controls and other display parameters of the interface of the game application.
[0147] Referring to FIG. 7A, Figure 7B The GUI shown in FIG. 7A is the loading interface of the game. When the phone detects the operation of the user clicking the control 702, the phone can display the battle interface of the game. The phone can request the game configuration parameters in each screen form from the server when detecting whether the user opens the game application, or can request the display parameters in the current screen form from the server when the phone determines that the game enters the battle interface. When the phone receives the game configuration parameters in the main screen display state, the display strategy management service can obtain the corresponding game configuration parameters, and control the flexible screen to display accordingly.
[0148] When the phone detects that the user switches the flexible screen of the phone from the folded state to the unfolded state, the state monitoring service can obtain and calculate the data uploaded by the gyroscope sensor and the acceleration sensor in the hardware layer. When the state detection service determines that the flexible screen of the phone is in the unfolded form, the state monitoring service can report to the display strategy management service that the flexible screen of the phone has been in the unfolded state. The display strategy management service can continue to request the corresponding display parameters in the unfolded state from the game application 1 (for example, APP3 in FIG. 6) in the application layer. When the display strategy management service obtains the corresponding display parameters in the unfolded state from the game application 1, the display strategy management service can notify the DMS of the display parameters, and the DMS displays the game interface in the unfolded state on the flexible screen through the surfaceflinger and the display driver. Figure 6B
[0149] Referring to FIG. 7B, Figure 7D It can be seen that compared with the main screen display when the phone is in the folded state, the field of view range in the X direction is smaller, and the field of view range in the Y direction is widened, and the field of view expansion area can be as shown in FIG. 7B. Figure 7D As shown in FIG. 8, the game view area remains basically unchanged during the switching process from the main screen to the large screen, thus ensuring the fairness of the game.
[0150] For a battle game with a view fairness constraint, when the mobile phone switches from the main screen display state to the large screen display state, the X-direction view range in the main screen display state is greater than the X-direction view range in the large screen display state, and the Y-direction view range in the main screen display state is smaller than the Y-direction view range in the large screen display state. In this way, the entire view area remains basically unchanged before and after the switching, thus ensuring the fairness of the game. Meanwhile, the expansion of the Y-direction view range allows the user to see more information, Figure 7D Compared with Figure 7C As shown in FIG. 7, the user can see the sun, clouds, and river scenery content in the Y direction. Compared with the Y-direction view range in the main screen display state, the Y-direction view range in the large screen display state has more content or information, thus improving the user experience of the user when playing the battle game.
[0151] FIG. 8 shows a set of GUIs of the mobile phone, in which, from Figure 8A to Figure 8B The process in which the flexible screen of the mobile phone switches from the main screen display state to the large screen display state when the user plays another battle game (e.g., Peace Elite) is shown.
[0152] Referring to Figure 8A the GUI shown, which is the display interface displayed by the main screen of the mobile phone in the folded state. As can be seen from Figure 8A , the view in the Y direction of the main screen display is limited, and the player is not clear about the situation inside the wall when outside the wall. At this time, if the user wants to see the situation inside the wall, the flexible screen of the mobile phone can be changed from the folded state to the unfolded state.
[0153] Referring to Figure 8B the GUI shown, which is the display interface displayed by the large screen of the mobile phone in the unfolded state. Compared with Figure 8A , the view range in the X direction is reduced, and the view range in the Y direction is widened, and the view expansion area can be as shown in Figure 8B , the user can see the situation inside the wall when the flexible screen of the mobile phone is in the large screen display state, for example, the user can see the houses, trees, and flowers inside the wall, and so on. In this way, under the premise of ensuring the fairness of the game, the increase of the view in the Y direction allows the user to see more useful information, thus improving the user experience when playing the game.
[0154] In this embodiment of the application, for combat games with field-of-view fairness constraints, since the field of view in the Y direction is limited in the main screen state, the user can switch the phone from the folded state to the unfolded state, thereby switching the flexible screen of the phone from the main screen display state to the large screen display state. Although the field of view in the X direction becomes smaller, the field of view in the Y direction is expanded. The field of view area remains basically unchanged in the main screen display state and the large screen display state, which makes it easier for the user to see more combat information in the Y direction. The user can see the enemy when the enemy cannot see the user, which helps to improve the user experience during the game.
[0155] It should be understood that when the flexible screen of the above electronic device switches from the main screen display state to the large screen display state, the field of view in the X direction decreases while the field of view in the Y direction expands; or the field of view in the X direction expands while the field of view in the Y direction decreases, thereby keeping the field of view area in the large screen display state basically unchanged from that in the main screen display state.
[0156] The above has been approved. Figure 7A to Figure 7D as well as Figure 8A to Figure 8B This section describes the changes in the game's field of view between the main screen and large screen displays when playing competitive games with fair field of view constraints. For competitive games with fair field of view constraints, to ensure fairness, the flexible screen reduces the field of view in the X direction and expands (or compensates for) the field of view in the Y direction when switching from the main screen to the large screen display, ensuring that the field of view area remains essentially constant. The following section describes the changes in the game's field of view between the main screen and large screen displays when playing non-competitive games or competitive games without fair field of view constraints.
[0157] Figure 9 shows a set of GUIs for the mobile phone, from which... Figure 9A to Figure 9B This demonstrates the process of a user switching from the main screen display mode to the large screen display mode when playing a non-combat game (e.g., Minecraft).
[0158] See Figure 9A The GUI shown is the interface for non-combat games displayed on the main screen when the phone is in a folded state. It can be viewed from... Figure 9A As can be seen, due to the limited field of view in the Y direction displayed on the main screen, players can only see a portion of the trees in front of them. If users wish to see more of the Y direction, they can unfold the phone's flexible screen from its folded state.
[0159] See Figure 9B The GUI shown is the interface for non-combat games displayed on the large screen when the phone is in its unfolded state. Compared to... Figure 9AIn the X direction, the field of view range remains unchanged, and in the Y direction, the field of view range is widened, and the field of view expansion area can be as shown in FIG. 1C. Figure 9B As shown in FIG. 1D, when the flexible screen of the mobile phone is in the large-screen display state, the user can see the complete tree.
[0160] In one embodiment, when the user switches the mobile phone from the unfolded state to the folded state, the flexible screen of the mobile phone can be switched from the large-screen display state back to the main-screen display state, in which the field of view in the X direction remains unchanged and the field of view in the Y direction becomes smaller.
[0161] For non-competitive games or competitive games without fairness constraints on the game field of view, when the flexible screen is switched from the main-screen display state to the large-screen display state, the field of view in the X direction remains unchanged and the field of view in the Y direction is expanded. Compared with the overall field of view area in the main-screen display state, the user can see more information, improving the immersive experience of the user when playing the game.
[0162] It should be understood that the technical solutions of the embodiments of the present application can be applied to competitive games and non-competitive games, and can also be applied to other applications. For example, when the user browses a webpage in the main-screen display state, the displayed content of the page is less, at which time the user can switch the electronic device from the main-screen display to the large-screen display (for example, from the folded state to the unfolded state of the electronic device), at which time the displayed content when browsing the webpage can be increased compared with the main-screen display state, such as the number of displayed product information when the user is shopping online. For another example, when the user browses an e-book in the main-screen display state, the displayed content is less, and when switched from the main-screen display state to the large-screen display state, the displayed content of the entire screen can be increased compared with the main-screen display state.
[0163] The GUI provided by the embodiments of the present application is introduced above in combination with the GUI in Figure 7A to Figure 9B The display method of the electronic device with the flexible screen provided by the embodiments of the present application is introduced below in combination with Figure 10 The display method of the electronic device with the flexible screen provided by the embodiments of the present application is introduced below in combination with
[0164] Figure 10 A schematic flowchart of the display method 1000 of the electronic device with the flexible screen provided by the embodiments of the present application is shown as shown in FIG. 10A, and as shown, the execution subject of the method 1000 can be a mobile phone, and the method includes the following steps. Figure 10
[0165] S1001, the electronic device detects a first operation of the user opening a game application.
[0166] For example, as shown in FIG. 1A, the mobile phone detects the operation of the user opening the game application. Figure 7A
[0167] S1002, if the flexible screen is in the folded state, the electronic device displays an interface of the game application through the first display interface in response to the first operation.
[0168] As shown in Figure 7C , when the flexible screen of the mobile phone is in the folded state, the mobile phone can display the interface of the battle game application through the main screen.
[0169] As shown in Figure 8A , when the flexible screen of the mobile phone is in the folded state, the mobile phone can display the interface of another battle game application through the main screen.
[0170] As shown in Figure 9A , when the flexible screen of the mobile phone is in the folded state, the mobile phone can display the interface of a non-battle game application through the main screen.
[0171] S1003, in response to the flexible screen being converted from the folded state to the unfolded state, the electronic device displays the interface of the game application through the flexible screen in full screen, and the interface of the game application displayed through the flexible screen in full screen is a second display interface; wherein the field of view range of the first display interface in a first direction is a first field of view range, and the field of view range of the second display interface in the first direction is a second field of view range, and the first field of view range is smaller than the second field of view range.
[0172] As shown in Figure 7D , if the mobile phone detects that the user converts the flexible screen from the folded state to the unfolded state, the mobile phone can display the interface of the battle game application through the entire flexible screen. Compared with the interface of the battle game application shown in Figure 7C , it can be seen that the field of view range is expanded, and the user can see information such as the sun, clouds, and rivers.
[0173] As shown in Figure 8B , if the mobile phone detects that the user converts the flexible screen from the folded state to the unfolded state, the mobile phone can display the interface of another battle game application through the entire flexible screen. Compared with the interface of the game application shown in Figure 8A , the user can see information inside the wall, such as houses, trees, and grass.
[0174] As shown in Figure 9B , if the mobile phone detects that the user converts the flexible screen from the folded state to the unfolded state, the mobile phone can display the interface of a non-battle game application through the entire flexible screen. Compared with the interface of the game application shown in Figure 9A , the user can see complete information of the tree.
[0175] Optionally, the window of the first display interface comprises a first long side and a first short side; the window of the second display interface comprises a second long side and a second short side; a field of view range of the first display interface in the first short side direction is a first field of view range, and a field of view range of the second display interface in the second short side direction is a second field of view range, the first field of view range being smaller than the second field of view range.
[0176] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state. Figure 7D Figure 7C Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state.
[0177] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state. Figure 8B Figure 8A Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state.
[0178] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state. Figure 9B Figure 9A Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the Y direction is larger than that in the folded state.
[0179] In the embodiment of the application, in the process of the flexible screen being converted from the folded state to the unfolded state, the field of view range of the first display interface in the first short side direction is smaller than the field of view range of the second display interface in the second short side direction, the expansion of the field of view range helps the user to see more information, and thus helps to improve the game experience of the user in the game process.
[0180] Optionally, a field of view range of the first display interface in the first long side direction is a third field of view range, and a field of view range of the second display interface in the second long side direction is a fourth field of view range, the third field of view range being greater than or equal to the fourth field of view range.
[0181] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the X direction is smaller than that in the folded state. Figure 7D Figure 7C Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the X direction is smaller than that in the folded state.
[0182] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the X direction is smaller than that in the folded state. Figure 8B Figure 8A Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the X direction is smaller than that in the folded state.
[0183] Optionally, the first display interface displays the interface of the game application through the whole flexible screen in the unfolded state, and a field of view range in the X direction is smaller than that in the folded state. Figure 9B Figure 9A The field of view in the middle X direction remains unchanged.
[0184] In the embodiments of the present application, for some games with fairness constraints on the game field of view, during the process of the flexible screen being converted from the folded state to the unfolded state, the field of view range of the first display interface in the first long side direction is greater than the field of view range of the second display interface in the second long side direction, so that the field of view range in the second long side direction is cropped compared with the first long side direction, and the field of view range in the second short side direction is expanded compared with the first short side direction, so as to realize that the entire field of view area on the first display interface and the entire field of view area on the second display interface remain basically unchanged, and the game experience of the user when playing the game is improved on the premise of ensuring the fairness of the game field of view.
[0185] In the embodiments of the present application, for some non-competitive games or for some games without fairness constraints on the game field of view, during the process of the flexible screen being converted from the folded state to the unfolded state, the field of view range of the first display interface in the first long side direction is equal to the field of view range of the second display interface in the second long side direction, so that the field of view range in the second long side direction remains unchanged compared with the first long side direction, and the field of view range in the second short side direction is expanded compared with the first short side direction, so as to realize that the entire field of view area on the second display interface is larger than the entire field of view area on the first display interface, which is helpful to improve the game experience of the user when playing the game.
[0186] Those skilled in the art can understand that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0187] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.
[0188] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the described device embodiments are merely schematic. The division of the units is merely logical function division. There can be other division manners in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.
[0189] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0190] In addition, each functional unit in the various embodiments of the present application can be integrated into a processing unit, or each unit can be a physically independent unit, or two or more units can be integrated into one unit.
[0191] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.
[0192] The above is merely specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A display method applied to a system including an electronic device and a server, wherein the electronic device is a foldable electronic device, characterized in that, The method comprises: In response to the electronic device opening a preset application, the electronic device sends first information to a server, the preset application being a game application; The server sends configuration parameters to the electronic device according to the first information, the configuration parameters comprising a first configuration parameter and a second configuration parameter; The electronic device receives and stores the configuration parameters; When the electronic device is in an unfolded state, the electronic device displays a first display interface, the first display interface being a display interface of the preset application displayed according to the first configuration parameter; When the electronic device is in a folded state, the electronic device displays a second display interface, the second display interface being a display interface of the preset application displayed according to the second configuration parameter; A window of the first display interface comprises a first short side; A window of the second display interface comprises a second short side; The first display interface displays a field of view of the game application in the first short side direction, the field of view being a first field of view, the second display interface displays a field of view of the game application in the second short side direction, the field of view being a second field of view, the first field of view containing more game scene content or information than the second field of view; The window of the first display interface further comprises a first long side; The window of the second display interface further comprises a second long side; The first display interface displays a field of view of the game application in the first long side direction, the field of view being a third field of view, the second display interface displays a field of view of the game application in the second long side direction, the field of view being a fourth field of view, the third field of view containing less game scene content or information than the fourth field of view.
2. The method of claim 1, wherein, The method further comprises: When the electronic device is in an unfolded state, in response to the electronic device being converted from the unfolded state to a folded state, the electronic device displays an interface of the game application through the second display interface.
3. The method of claim 1, wherein, The first information comprises model information of the electronic device.
4. A system comprising a server and a foldable electronic device having a flexible screen, characterized in that, The electronic device is configured to: In response to the electronic device opening a preset application, the electronic device sends first information to a server, the preset application being a game application; The server is configured to: Receive the first information; Send configuration parameters to the electronic device according to the first information, the configuration parameters comprising a first configuration parameter and a second configuration parameter; The electronic device is further configured to: Receive and store the configuration parameters; When the electronic device is in an unfolded state, the electronic device displays a first display interface, the first display interface being a display interface of the preset application displayed according to the first configuration parameter; When the electronic device is in a folded state, the electronic device displays a second display interface, the second display interface being a display interface of the preset application displayed according to the second configuration parameter; A window of the first display interface comprises a first short side; A window of the second display interface comprises a second short side; The first display interface displays a first field of view range of the game application in the first short side direction, and the second display interface displays a second field of view range of the game application in the second short side direction, the first field of view range contains more game scene content or information than the second field of view range; The window of the first display interface further includes a first long side; The window of the second display interface further includes a second long side; The first display interface displays a third field of view range in the first long side direction, and the second display interface displays a fourth field of view range in the second long side direction, the third field of view range contains less content or information than the fourth field of view range.
5. The system of claim 4, wherein, The electronic device is further configured to: When the electronic device is in the unfolded state, in response to the electronic device being converted from the unfolded state to the folded state, the electronic device displays an interface of the game application through the second display interface.
6. The system of claim 4, wherein, The server is a game server.
7. The system of claim 4, wherein, The first information includes model information of the electronic device. 8.A display method applied to a foldable electronic device, comprising: The method includes: In response to the electronic device starting a preset application, the electronic device sends first information to a server, the preset application is a game application, and the first information is used by the server to determine configuration parameters, the configuration parameters including first configuration parameters and second configuration parameters; The electronic device receives and stores the configuration parameters; When the electronic device is in the unfolded state, the electronic device displays a first display interface, the first display interface being a display interface of the preset application displayed according to the first configuration parameters; When the electronic device is in the folded state, the electronic device displays a second display interface, the second display interface being a display interface of the preset application displayed according to the second configuration parameters; The window of the first display interface includes a first short side; The window of the second display interface includes a second short side; The first display interface displays a first field of view range of the game application in the first short side direction, and the second display interface displays a second field of view range of the game application in the second short side direction, the first field of view range contains more game scene content or information than the second field of view range; The window of the first display interface further includes a first long side; The window of the second display interface further includes a second long side; The first display interface displays a third field of view range in the first long side direction, and the second display interface displays a fourth field of view range in the second long side direction, the third field of view range contains less content or information than the fourth field of view range.
9. The method of claim 8, wherein, The method further includes: When the electronic device is in the unfolded state, in response to the electronic device being converted from the unfolded state to a folded state, the electronic device displays an interface of the game application through the second display interface.
10. The method according to claim 8 or 9, characterized in that, The first information includes model information of the electronic device.
11. A computer readable storage medium, characterized in that, The computer program product includes computer instructions, which, when executed on an electronic device, cause the electronic device to perform the display method of any one of claims 8 to 10.
Citation Information
Patent Citations
Information processing method and electronic equipment
CN104615336A
Intelligent ideological education display control system based on cloud platform and method thereof
CN109345890A
shortcut operation panel display method and device and a storage medium
CN109656439A
User terminal device and displaying method thereof
US20150227223A1
Data processing method and electronic equipment
CN105224526A