VR Display Control Method, Electronic Device and Computer Readable Storage Medium

Abstract

Embodiments of the present application disclose a VR display control method, an electronic device, and a computer-readable storage medium. Embodiments of the present application can generate a VR desktop, display the VR desktop on the virtual reality display device, and receive an operation on a first application icon on the VR desktop, where the first application icon is associated with a first application installed on the electronic device, so that the content of the first application can be displayed through the virtual reality display device. Among them, the content of the first application is displayed on a curved screen obtained by converting a rectangular screen. Embodiments of the present application can achieve the most comfortable curvature effect for the human eye through a VR virtual scene, enhance the user's visual experience, and improve the user's usage experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of terminals, and in particular, to a VR display control method, an electronic device, and a computer-readable storage medium. Background Art

[0002] An electronic device can establish a connection with a virtual reality (VR) headset through a data cable, and the interface displayed on the electronic device can be cast onto the display of the VR headset in real time. The user can operate the controls in the virtual screen of the headset display by operating the handle connected to the virtual display headset, that is, the user can complete the operation of the mobile phone in the VR headset. However, since the interface displayed on the electronic device is displayed in a rectangular form in the VR scene, when the user views the content at the edge of the screen, the user's visual experience will be reduced. Summary of the Invention

[0003] The embodiments of the present application provide a VR display control method, an electronic device, and a computer-readable storage medium. The embodiments of the present application can achieve the most comfortable curvature effect of the human eye through the VR virtual scene, which can enhance the user's visual experience and improve the user's usage experience.

[0004] In a first aspect, the embodiments of the present application provide a VR display control method, which is applied to an electronic device connected to a virtual reality display device. The method includes: generating a VR desktop, so that the VR desktop is displayed on the virtual reality display device, receiving an operation of a user on a first application icon on the VR desktop, where the first application icon is associated with a first application installed on the electronic device, and in response to the operation, displaying the content of the first application through the virtual reality display device, where the content of the first application is displayed on a curved screen obtained by converting a rectangular screen.

[0005] By adopting the embodiments of the present application, when the virtual reality display device is connected to the electronic device, a VR desktop can be generated, and then by receiving the operation of the user on the first application icon on the VR desktop, the content of the first application can be further displayed through the virtual reality display device, and the content of the first application can be displayed on a curved screen obtained by converting a rectangular screen. Therefore, the embodiments of the present application can achieve the most comfortable curvature effect of the human eye through the VR virtual scene, which can enhance the user's visual experience and improve the user's usage experience.

[0006] In combination with the first aspect, in a possible design, before displaying the VR desktop on the virtual reality display device, a connection is further established with the virtual reality display device, and the electronic device enters the VR mode.

[0007] Based on such a design, after the electronic device establishes a connection with the VR glasses, the electronic device will enter the VR mode.

[0008] Combined with the first aspect, in a possible design, after the electronic device enters the VR mode, the electronic device is in a screen-off state.

[0009] Based on such a design, since the user views through the VR glasses, the electronic device can turn off the screen, which helps to save power and prevent accidental operations.

[0010] Combined with the first aspect, in a possible design, establish a connection with the handle through the wireless network and receive the operation of the user on the first application icon through the handle.

[0011] Based on such a design, the user can use the handle for operations, improving the convenience of operations.

[0012] Combined with the first aspect, in a possible design, calculate the four vertex positions of the curved screen according to the four vertex positions of the rectangular screen, determine the two endpoint positions of the curved screen according to the four vertex positions of the curved screen, and determine the first angle between the two endpoint positions of the curved screen and the user.

[0013] Combined with the first aspect, in a possible design, divide the first angle into N equal parts, where N is an integer greater than or equal to 2, and calculate the N + 1 dot positions on the curved screen.

[0014] Based on such a design, therefore, multiple positions on the curved screen can be calculated according to the small angles of each screen.

[0015] Combined with the first aspect, in a possible design, splice the N + 1 dot positions on the curved screen.

[0016] Based on such a design, multiple rectangles can be spliced with multiple dot positions, that is, the rectangular screen can be converted into a curved screen.

[0017] Combined with the first aspect, in a possible design, obtain the two-dimensional coordinate ratio of the intersection point of the ray of the handle and the curved screen on the first curved surface, and use the two-dimensional coordinate ratio as the touch position where the handle operates the electronic device.

[0018] In a second aspect, an embodiment of the present application further provides an electronic device, including:

[0019] A memory for storing a computer program;

[0020] A processor for executing the computer program stored in the memory, and when the computer program is executed, the processor is configured to execute the VR display control method as described above.

[0021] By adopting the embodiments of the present application, when a virtual reality display device is connected to an electronic device, by receiving an operation of a user on a first application icon on the VR desktop, the display screen can be projected onto the virtual reality display device, and the display screen can be converted from a rectangular screen to a curved screen. Therefore, the embodiments of the present application can achieve the most comfortable curvature effect for the human eye through the VR virtual scene, enhance the user's visual experience, and improve the user's usage experience.

[0022] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, which includes computer instructions. When the computer instructions run on an electronic device, the electronic device is caused to execute the VR display control method as described above.

[0023] By adopting the embodiments of the present application, after generating a VR desktop after connecting to a virtual reality display device, by receiving an operation of a user on a first application icon on the VR desktop, the content of the first application can be displayed through the virtual reality display device, and the content of the first application can be displayed on a curved screen obtained by converting a rectangular screen. Therefore, the embodiments of the present application can achieve the most comfortable curvature effect for the human eye through the VR virtual scene, enhance the user's visual experience, and improve the user's usage experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of the connection between an electronic device and a VR glasses provided by an embodiment of the present application.

[0025] Figure 2 A schematic structural diagram of a handle provided by an embodiment of the present application.

[0026] Figure 3 A schematic diagram of the display screen of an electronic device projected into a VR glasses provided by an embodiment of the present application.

[0027] Figure 4 A schematic structural diagram of an electronic device to which the VR display control method provided by an embodiment of the present application is applicable.

[0028] Figure 5 A schematic structural diagram of an operating system provided by an embodiment of the present application.

[0029] Figure 6 A top view of a rectangular screen provided by an embodiment of the present application.

[0030] Figure 7Schematic diagram of a user viewing a rectangular screen provided by an embodiment of the present application.

[0031] Figure 8 Schematic diagram of a VR display control method provided by an embodiment of the present application.

[0032] Figure 9 Schematic diagram of another VR display control method provided by an embodiment of the present application.

[0033] Figure 10 Schematic diagram of a curved screen provided by an embodiment of the present application.

[0034] Figure 11 Schematic diagram of another curved screen provided by an embodiment of the present application.

[0035] Figure 12 Schematic diagram of a user viewing a curved screen provided by an embodiment of the present application.

[0036] Figure 13 Schematic diagram of a handle operation provided by an embodiment of the present application.

[0037] Description of main component symbols

[0038] Electronic device 100

[0039] Processor 110

[0040] External memory interface 120

[0041] Internal memory 121

[0042] USB interface 130

[0043] Charging management module 140

[0044] Power management module 141

[0045] Battery 142

[0046] Antennas 1, 2

[0047] Mobile communication module 150

[0048] Wireless communication module 160

[0049] Audio module 170

[0050] Speaker 170A

[0051] Receiver 170B

[0052] Microphone 170C

[0053] Headphone jack 170D

[0054] Sensor module 180

[0055] Pressure sensor 180A

[0056] Gyroscope sensor 180B

[0057] Barometric pressure sensor 180C

[0058] Magnetic sensor 180D

[0059] Acceleration sensor 180E

[0060] Distance sensor 180F

[0061] Proximity light sensor 180G

[0062] Fingerprint sensor 180H

[0063] Temperature sensor 180J

[0064] Touch sensor 180K

[0065] Ambient light sensor 180L

[0066] Bone conduction sensor 180M

[0067] Button 190

[0068] Motor 191

[0069] Indicator 192

[0070] Camera 193

[0071] Display screen 194

[0072] SIM card interface 195

[0073] VR glasses 200

[0074] Handle 300

[0075] The following specific embodiments will further illustrate the present application in conjunction with the above-mentioned drawings. Specific embodiments

[0076] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are some, rather than all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0077] The term "and / or" in this application describes the associated relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. In this text, the symbol " / " indicates that the associated objects are in an "or" relationship. For example, A / B means A or B.

[0078] In the embodiments of this application, terms such as "first" and "second" are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order. For example, the first application, the second application, etc. are used to distinguish different applications, rather than to describe a specific order of the applications. Features defined with "first" and "second" may explicitly or implicitly include one or more of such features.

[0079] In the description of the embodiments of this application, words such as "exemplary" or "for example" are used to give examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.

[0080] First, some nouns or terms involved in the embodiments of this application will be explained below.

[0081] Virtual Reality (VR) is a high-tech emerging in recent years. Virtual reality technology is a computer simulation system that can create and experience virtual worlds. It uses a computer to simulate and generate a virtual environment in a three-dimensional (also known as 3D) space. It is a system simulation of multi-source information fusion, interactive three-dimensional dynamic visual scenes, and entity behaviors, enabling users to immerse themselves in the VR scene. Simply put, VR is a virtual reality technology that allows users to integrate into the VR scene to the greatest extent through the rendering of the visual environment and enjoy an immersive experience.

[0082] The head-mounted virtual reality device in a virtual reality display device is a type of wearable device, also known as a virtual reality helmet, VR glasses, or glasses-type display.

[0083] The VR display control method provided by the embodiments of this application can be applied to a scenario where an electronic device 100 and VR glasses 200 are interconnected based on a connection line as Figure 1 shown.

[0084] In Figure 1In the scenario shown, the electronic device 100 can project the content of its display screen onto the VR glasses 200. The user can view photos, videos or play games through the VR glasses, so as to enjoy the experience of a larger screen. In addition, as Figure 1 shown, the electronic device 100 is connected to the handle 300 via Bluetooth. After the user connects the electronic device 100 and the VR glasses 200 with a data cable and wears the VR glasses 200, the user can operate the controls in the virtual screen of the glasses display by operating the handle 300.

[0085] Please refer to Figure 2 , the handle 300 includes hardware structures such as a touchpad, a return key, volume keys, a HOME (main menu) key, an indicator light, and a trigger key. Among them, the specific functions of each component are shown in Table 1.

[0086] Table 1

[0087]

[0088] As can be seen from Table 1, when the user holds down the touchpad and moves the handle, a sliding operation can be performed; when the user touches the touchpad on the handle lightly, a click operation can be performed, and when the user presses the HOME key briefly, the standby interface of the mobile phone can be returned.

[0089] For example, when the user clicks on a video application, the electronic device 100 runs the video application, and the VR glasses 200 can display the display interface of the video application in the virtual environment of the three-dimensional space. The embodiment of the present application realizes the most comfortable curvature effect of the human eye through the VR virtual scene, which can enhance the user's visual experience and improve the user's usage experience.

[0090] Please refer to Figure 3 , in a possible embodiment, after the user establishes a connection between the electronic device 100 and the VR glasses 200, the electronic device 100 enters the VR mode. The display screen of the electronic device 100 can be projected onto the VR glasses 200. As Figure 3 shown in a scenario, the rectangular screen of the electronic device 100 is projected onto the VR glasses 200. Therefore, the user can emit a ray from the handle 300 to the rectangular screen, and thus control the rectangular screen by the ray emitted from the handle 300.

[0091] It can be understood that in some possible implementation manners, the electronic device 100 and the VR glasses 200 may also be connected without a connection line, but are interconnected based on a communication network. Among them, the communication network may be a local area network or a wide area network relayed by a relay device. When the communication network is a local area network, for example, the communication network may be a short-range communication network such as a wifi hotspot network, a Bluetooth network, or a near field communication (NFC) network. When the communication network is a wide area network, for example, the communication network may be a 3rd-generation wireless telephone technology (3G) network, a 4th-generation mobile communication technology (4G) network, a 5th-generation mobile communication technology (5G) network, a future evolved public land mobile network (PLMN), or the Internet, etc.

[0092] In some embodiments of the present application, Figure 1 The illustrated electronic device 100 may be a portable electronic device further including other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, etc. Exemplary embodiments of the portable electronic device include, but are not limited to, portable electronic devices equipped with or other operating systems. The above portable electronic device may also be other portable electronic devices, such as a laptop with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present application, the above electronic device 100 may not be a portable electronic device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0093] Figure 4 The structural schematic diagram of the electronic device 100 is shown.

[0094] The electronic device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0095] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0096] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those illustrated, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0097] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0098] The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0099] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0100] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0101] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby implementing the touch function of the electronic device 100.

[0102] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a phone call through a Bluetooth headset.

[0103] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In some embodiments, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0104] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0105] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0106] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0107] The USB interface 130 is an interface that conforms to the USB standard specification. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0108] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only for illustrative purposes and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0109] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input from a wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0110] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0111] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0112] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0113] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves through the antenna 1 and radiate it out. In some embodiments, at least some functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be disposed in the same device.

[0114] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and be disposed in the same device as the mobile communication module 150 or other functional modules.

[0115] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be transmitted from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0116] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0117] Electronic device 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0118] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0119] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0120] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0121] The camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0122] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0123] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0124] The NPU is a neural-network (NN) computing processor. By learning from the structure of biological neural networks, such as learning from the transmission mode between human brain neurons, it can quickly process input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0125] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, the code of application programs (such as the camera application, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as images, videos collected by the camera application, etc.).

[0126] The internal memory 121 can also store the code of the VR display control method provided in the embodiments of this application. When the code of the VR display control method stored in the internal memory 121 is executed by the processor 110, the display interface of the application can be displayed in the virtual environment of the three-dimensional space. The VR virtual scene can achieve the most comfortable curvature effect for the human eye, which can enhance the user's visual experience and improve the user's usage experience.

[0127] In addition, the internal memory 121 can include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0128] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation of DDR SDRAM is generally referred to as DDR5 SDRAM), etc.;

[0129] Non-volatile memory may include disk storage devices, flash memory.

[0130] Flash memory can be classified into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle, and can be classified into single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the number of potential levels of the storage unit, and can be classified into universal flash storage (UFS), embedded multi media Card (eMMC), etc. according to the storage specification.

[0131] Random access memory can be directly read and written by the processor 110, can be used to store the operating system or executable programs (such as machine instructions) of other running programs, and can also be used to store data of users and application programs, etc.

[0132] Non-volatile memory can also store executable programs and store data of users and application programs, etc., and can be pre-loaded into random access memory for the processor 110 to directly read and write.

[0133] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and video are saved in the external non-volatile memory.

[0134] The electronic device 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor, etc. For example, music playback, recording, etc.

[0135] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0136] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or hands-free calls through the speaker 170A.

[0137] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, the voice can be listened to by placing the receiver 170B close to the human ear.

[0138] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak close to the microphone 170C with the mouth to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to implement functions such as collecting sound signals, noise reduction, identifying the sound source, and implementing a directional recording function.

[0139] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0140] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates having conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: When a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0141] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of jitter of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and enables the lens to offset the jitter of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenarios.

[0142] The barometric pressure sensor 180C is used to measure barometric pressure. In some embodiments, the electronic device 100 calculates the altitude based on the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0143] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, features such as automatic flip unlocking can be set.

[0144] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0145] A distance sensor 180F for measuring distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0146] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear for a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used for the holster mode, and the pocket mode automatically unlocks and locks the screen.

[0147] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.

[0148] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint taking pictures, fingerprint answering calls, etc.

[0149] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by low temperature. In some other embodiments, when the temperature is lower than yet another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0150] The touch sensor 180K, also known as the "touch control device". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 together form a touch screen, also known as the "touch control screen". The touch sensor 180K is used to detect touch operations acting thereon or in its vicinity. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a different position from that of the display screen 194.

[0151] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals of the vibrating bone mass of the human vocal tract. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.

[0152] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys or touch keys. The electronic device 100 can receive key inputs to generate key signal inputs related to the user settings and function controls of the electronic device 100.

[0153] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. Touch operations acting on different regions of the display screen 194 can also correspond to different vibration feedback effects for the motor 191. Different application scenarios (such as time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0154] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0155] The SIM card interface 195 is used to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact with and separation from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present invention, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the electronic device 100.

[0156] Figure 5 It is a block diagram of the software structure of the electronic device 100 in the embodiments of the present invention.

[0157] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0158] The application layer can include a series of application packages.

[0159] As Figure 5 shown, the application packages can include applications such as a camera, a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, video, short messages, and a VR glasses application. Among them, the VR glasses application includes a 3D background drawing module, a handle event management module, an application icon loading module, a virtual screen management module, and a virtual screen content acquisition module.

[0160] Among them, the 3D background drawing module is used to complete the drawing of the background picture displayed in the 3D virtual environment, so that the user can obtain the feeling of being in a real scene.

[0161] The handle event management module is used to process events from the handle, so that the user can operate the controls in the virtual display interface by operating the handle.

[0162] An application icon loading module, which is used to load and display the icons of several applications on an electronic device in a virtual environment of a VR glasses.

[0163] A virtual screen management module, which is used to create a virtual screen when a user clicks an application icon to start an application, and can destroy the virtual screen when the user closes the application.

[0164] A virtual screen content acquisition module, which is used to acquire the content in an application when the user clicks to start the application, and render the content in the application through distortion to achieve display in a virtual environment.

[0165] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0166] Such as Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a telephone manager, a resource manager, a notification manager, etc.

[0167] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0168] The content provider is used to store and obtain data, and make this data accessible to application programs. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, etc.

[0169] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0170] The telephone manager is used to provide the communication function of the electronic device 100. For example, the management of call states (including connection, disconnection, etc.).

[0171] The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, etc.

[0172] The notification manager enables an application to display notification information in the status bar. It can be used to convey informative messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is complete, a message reminder, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialogue window. For example, it can prompt text information in the status bar, emit a prompt tone, vibrate the electronic device, blink the indicator light, etc.

[0173] In the embodiments of the present application, in the application framework layer, there are an Activity Manager Service (AMS), a Window Manager Service (WMS), and a Display Manager Service (DMS). The application framework layer may also include an application keep-alive module, an event injection module, and a virtual screen management module. In the embodiments of the present application, the DMS transmits the display content of the electronic device 100 to the VR glasses application, and performs curved screen processing via the VR glasses application. Finally, the processed display data is sent back to the VR display framework, and further display processing is performed by the AMS / WMS.

[0174] Among them, the application keep-alive module is used to control the electronic device to enter the VR display mode after the application is started. In this mode, the electronic device can run multiple applications simultaneously and support each application to be in an active state at the same time.

[0175] The event injection module is used to obtain the events corresponding to the user's operations in the display mode and transmit the events to the virtual screen.

[0176] The virtual screen management module is used to provide the electronic device with the ability to create and destroy virtual screens.

[0177] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

[0178] The core libraries include two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core libraries of Android.

[0179] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0180] The system library may include multiple functional modules. For example: a surface manager, Media Libraries, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.

[0181] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0182] The media library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0183] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0184] The 2D graphics engine is a drawing engine for 2D drawing.

[0185] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0186] Next, in combination with the capture and photo-taking scenario, the working processes of the software and hardware of the electronic device 100 will be exemplarily described.

[0187] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including information such as touch coordinates and the timestamp of the touch operation). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation and the control corresponding to the click operation as the control of the camera application icon as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer, and captures a static image or video through the camera 193.

[0188] Based on the above hardware structure of the electronic device, various embodiments of the VR display control method of the present application are proposed.

[0189] In some possible implementation manners, such as Figure 6 and Figure 7As shown in [the figure], since the interface displayed on the electronic device is presented as a rectangular screen in the VR scenario. It can be understood that in one embodiment, this rectangular screen can be a flat rectangle. Therefore, when the user views the content at the edge of the rectangular screen, since the rectangular screen is a flat rectangle, an angle is formed between the user's line of sight and the flat rectangle when the user views the edge of the screen, thus reducing the user's visual effect and resulting in a poor experience. For this reason, the embodiments of the present application provide a VR display control method, which can be executed by an electronic device connected to a virtual reality display device, and the corresponding display algorithm of this method can be integrated into an application supporting VR.

[0190] Please refer to Figure 8 , and the following will, in combination with the accompanying drawings and actual application scenarios, illustrate the VR display control method provided by the embodiments of the present application. The specific steps are as follows:

[0191] Step S81, the electronic device establishes a connection with the VR glasses.

[0192] Before using the VR glasses, the user can use a data cable to connect the mobile phone to the VR glasses 200. The electronic device 100 is exemplified by a mobile phone. After the mobile phone establishes a connection with the VR glasses 200, the mobile phone will automatically enter the VR mode. At this time, the screen of the mobile phone can be in the off-screen state, which can help save power and prevent accidental operations. Then the user wears the VR glasses 200. At this time, the user can see the VR desktop in the VR glasses 200. In addition, the user can adjust the wearing position of the VR glasses 200 to make the picture clearer.

[0193] Step S82, the electronic device receives an operation of the user on the first application icon on the VR desktop.

[0194] After the electronic device 100 establishes a connection with the VR glasses 200, it will generate a VR desktop and enable the VR desktop to be displayed on the VR glasses 200.

[0195] In at least one embodiment of the present application, the electronic device 100 can receive an operation of the user on the first application icon on the VR desktop. Specifically, the first application icon can be associated with a first application installed on the electronic device. For example, taking the VR mobile phone screen mirroring as the first application, the VR mobile phone screen mirroring can be associated with an icon (such as the VR mobile phone screen mirroring icon) on the VR desktop. Therefore, when the electronic device 100 receives an operation of the user on the VR mobile phone screen mirroring icon, the application corresponding to the associated VR mobile phone screen mirroring icon (i.e., the VR mobile phone screen mirroring) is launched.

[0196] It can be understood that the electronic device 100 can establish a connection with the handle 300. In some possible implementation manners, the electronic device 100 can establish a connection with the handle through a wireless network. For example, the electronic device 100 can establish a connection with the handle 300 in the manner of Bluetooth.

[0197] The user operates the handle 300 to complete the operation of the application in the VR desktop. For example, taking the first application as VR mobile phone screen mirroring, when the user clicks the VR mobile phone screen mirroring icon through the handle 300, the electronic device 100 can, in response to the above operation, display the content of the application through the VR glasses 200, that is, the display screen of the electronic device 100 will be screen-mirrored to the VR glasses 200. At this time, the user can see the display screen of the electronic device 100 in the VR glasses 200.

[0198] Step S83: The display screen of the electronic device is screen-mirrored to the VR glasses, and the electronic device converts the display screen from a rectangular screen to a curved screen.

[0199] In a possible implementation manner, when the electronic device 100 detects that the user acts on the VR mobile phone screen mirroring icon, the electronic device 100 displays the content of the VR mobile phone screen mirroring through the VR glasses 200, and the content of the VR mobile phone screen mirroring is displayed on the curved screen obtained by converting the rectangular screen. Therefore, the user can view the display screen of the mobile phone as a curved display screen in the VR glasses 200, which can enhance the visual effect of the screen and further enhance the viewing experience of VR users, especially when playing videos on a large screen, it will bring an excellent visual impact effect.

[0200] In one embodiment, the electronic device 100 can convert the rectangular screen of the electronic device into a curved screen for display through a conversion method.

[0201] Please refer to Figure 9 , to implement the conversion of the rectangular screen of the electronic device into a curved screen for display, the embodiment of the present application provides a VR display control method, which may include but is not limited to the following steps:

[0202] Step S91: Obtain the first angle between the two end positions of the curved screen and the user.

[0203] When all positions on the display screen are at the same distance from the user, a more comfortable visual experience can be given to the user. Therefore, in the embodiment of the present application, the curvature of the curved screen can be the curvature of a circle with the audio-visual distance as the radius.

[0204] Combined with Figure 10 It can be known that a fixed number of points can be taken on the arc, and the arc can be simplified into the splicing of N sections of rectangles, so as to realize the conversion of the rectangular screen into a curved screen.

[0205] In the embodiments of the present application, the four vertex positions of the curved screen can be calculated through the four vertex positions of the rectangular screen, and the two endpoint positions of the curved screen can be determined according to the four vertex positions of the curved screen, and then the first angle between the two endpoint positions of the curved screen and the user can be determined.

[0206] For example, as Figure 11 shown is the top view of the curved screen. Assume that the two vertices of the rectangular screen are vertex A and vertex B respectively, then vertex A' and vertex B' are the two endpoints of the curved screen. It can be understood that assuming the distance between vertex A and vertex B is d1, and the distance between vertex A' and vertex B' is d2, then d1 = d2.

[0207] Assume the position of the user is O and the viewing distance of the user is r. Therefore, according to the distance d2 between vertex A' and vertex B' and the viewing distance r of the user, the angle ∠A'OB' between vertex A' and vertex B' and the user position can be calculated.

[0208] Step S92: Divide the first angle into N equal parts and calculate the positions of N + 1 dot points.

[0209] As an example, as Figure 10 shown, in one implementation, ∠A'OB' can be divided into 8 equal parts. Therefore, according to each small angle of the screen, the positions of A', B', P0, P1, P2, P3, P4, P5, P6 can be calculated, that is, the specific coordinate positions of A', B', P0, P1, P2, P3, P4, P5, P6 in the VR glasses can be found.

[0210] Step S93: Stitch together the N + 1 dot positions to convert the rectangular screen into a curved screen.

[0211] In the embodiments of the present application, A' can be stitched with P0, P0 can be stitched with P1, P1 can be stitched with P2, P3 can be stitched with P3, P3 can be stitched with P4, P4 can be stitched with P5, and P6 can be stitched with B'. Therefore, after stitching multiple dot positions with multiple rectangles, the conversion of the rectangular screen into a curved screen as Figure 12 shown can be achieved.

[0212] Please refer to Figure 13 , Figure 13 which is a schematic diagram of the operation of the curved screen by the handle 300 in the embodiments of the present application.

[0213] In the embodiments of the present application, Figure 13As shown in the figure, A', B', P0, P1, P2, P3, P4, P5, and P6 are the vertex positions of the curved screen, O is the position of the user, O' is the position of the handle 300 in the VR scene, and H is the intersection point of the handle ray and the curved screen.

[0214] It can be understood that the operation scheme of the handle ray can be one of the following situations:

[0215] In the embodiment of the present application, the ray O'H of the handle 300 can be sequentially intersected with the rectangles A'P0, P0P1, P1P2, P2P3, P3P4, P4P5, P5P6, and P6B' until the intersection of O'H and P2P3 at point H in space is obtained, thereby obtaining the position of H and the two-dimensional coordinates on the P2P3 rectangle.

[0216] Based on the position of the P2P3 rectangle in the entire curved surface A'B', the two-dimensional coordinate ratio of point H on the curved surface A'B' can finally be obtained, and this ratio can be used as the touch position for the handle 300 to operate the electronic device 100. In the embodiment of the present application, the most comfortable curvature effect for the human eye can be achieved through the VR virtual scene, which can enhance the user's visual experience and improve the user's usage experience.

[0217] The embodiment of the present application also provides a computer-readable storage medium. Computer instructions are stored in the readable storage medium, and when the instructions run on a computing device, the computing device can be made to execute the VR display control method provided in the foregoing embodiment.

[0218] For those skilled in the art, it is obvious that the present application is not limited to the details of the above exemplary embodiments, and without departing from the spirit or basic characteristics of the present application, the present application can be implemented in other specific forms. Therefore, as long as it is within the scope of the substantial spirit of the present application, appropriate changes and variations made to the above embodiments should fall within the scope of protection required by the present application.

Claims

1. A VR display control method is applied to an electronic device connected to a virtual reality display device, characterized in that, The method includes: Generating a VR desktop such that the VR desktop is displayed on the virtual reality display device; Receiving an operation on a first application icon on the VR desktop, where the first application icon is associated with a first application installed on the electronic device; In response to the operation, displaying the content of the first application through the virtual reality display device, and converting the display screen of the electronic device from a rectangular screen to a curved screen, where the content of the first application is displayed on the curved screen obtained by converting the rectangular screen; Wherein converting the display screen of the electronic device from the rectangular screen to the curved screen includes: Calculating the four vertex positions of the curved screen based on the four vertex positions of the rectangular screen; Determining the two end positions of the curved screen according to the four vertex positions of the curved screen, and determining a first angle between the two end positions of the curved screen and the user; Dividing the first angle into N equal parts and calculating N + 1 dot positions; Stitching together the N + 1 dot positions to convert the rectangular screen into the curved screen.

2. The VR display control method according to claim 1, wherein Before displaying the content of the first application through the virtual reality display device, it further includes: Establishing a connection with the virtual reality display device; The electronic device enters the VR mode.

3. The VR display control method according to claim 1 or 2, characterized in that The method further includes: After the electronic device enters the VR mode, the electronic device is in the screen-off state.

4. The VR display control method according to any one of claims 1 to 3, characterized in that, The method further includes: Establishing a connection with a handle through a wireless network; Receiving an operation on the first application icon by the user through the handle.

5. The VR display control method according to any one of claims 1 to 4, characterized in that: Obtaining the two-dimensional coordinate ratio of the intersection point of the ray of the handle and the curved screen on the first curved surface; Using the two-dimensional coordinate ratio as the touch position where the handle operates the electronic device.

6. An electronic device, characterized in that, It includes: A memory for storing a computer program; A processor for executing the computer program stored in the memory. When the computer program is executed, the processor is used to execute the VR display control method according to any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions. When the computer instructions run on the electronic device, the electronic device is caused to execute the VR display control method according to any one of claims 1 to 5.

Images