VR projection method, device, storage medium and terminal

Abstract

The embodiment of the present application provides a VR projection method, device, storage medium and mobile terminal, the method comprising: when detecting that the mobile terminal is in VR mode, hiding the desktop interface of the mobile terminal; recording the desktop interface to obtain a target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user's operation on the content; performing VR display of the target video on the screen of the mobile terminal to generate a VR picture. The embodiment of the present application can project all the content on the mobile terminal into VR glasses, allowing users to experience the resource content of the entire network, rather than being limited to the content on a certain software.

Description

Technical Field

[0001] The present application relates to the field of VR technology, and in particular to a VR projection method, device, storage medium and mobile terminal. Background Art

[0002] Currently, VR resources are limited. If you want to watch VR videos, you are limited to the corresponding app, which will lead to a poor user experience. The lack of huge resources will reduce the frequency and interest of users in using VR glasses.

[0003] Therefore, the prior art has defects and needs to be improved and developed. Summary of the invention

[0004] The embodiments of the present application provide a VR projection method, device, storage medium and mobile terminal, which can project all the content on the mobile terminal into VR glasses, so that users can experience the resource content of the entire network, rather than being limited to the content on a certain software.

[0005] The present application provides a VR projection method, the method comprising:

[0006] When detecting that the mobile terminal is in VR mode, hiding the desktop interface of the mobile terminal;

[0007] Recording the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content;

[0008] The target video is VR displayed on the screen of the mobile terminal to generate a VR picture.

[0009] In the VR projection method described in the embodiment of the present application, after recording the desktop interface to obtain the target video, the method further includes:

[0010] Acquire a first operation of the user on the VR screen;

[0011] Converting the first operation into a second operation of operating the desktop interface;

[0012] The mobile terminal performs corresponding processing according to the second operation, and updates the VR screen according to the processing result.

[0013] In the VR projection method described in the embodiment of the present application, converting the first operation into a second operation of operating the desktop interface includes:

[0014] Obtaining a size ratio of the VR screen to the desktop interface before hiding;

[0015] Based on the size ratio, establishing a correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding;

[0016] The first operation is converted into a second operation of operating the desktop interface based on the corresponding relationship of the coordinates.

[0017] In the VR projection method described in the embodiment of the present application, the first operation is a first click operation, the second operation is a second click operation, and the acquiring of the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface include:

[0018] Acquire a first coordinate of a click position corresponding to the first click operation;

[0019] Based on the correspondence relationship of the coordinates, a second coordinate corresponding to the first coordinate is acquired, where the second coordinate is a coordinate corresponding to a click position corresponding to the second click operation.

[0020] In the VR projection method described in the embodiment of the present application, the first operation is a first sliding operation, the second operation is a second sliding operation, and the acquiring the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface includes:

[0021] Acquire a first starting coordinate of the first sliding operation, where the first starting coordinate is a coordinate corresponding to a starting sliding point of the first sliding operation;

[0022] Based on the corresponding relationship of the coordinates, obtaining a second starting coordinate corresponding to the first starting coordinate, where the second starting coordinate is a coordinate corresponding to a starting sliding point of the second sliding operation;

[0023] Acquire a first end coordinate of the first sliding operation, where the first end coordinate is a coordinate corresponding to an end sliding point of the first sliding operation;

[0024] Based on the corresponding relationship of the coordinates, acquiring a second terminal coordinate corresponding to the first terminal coordinate, where the second terminal coordinate is a coordinate corresponding to a terminal sliding point of the second sliding operation;

[0025] The second sliding operation is obtained based on the second starting coordinate and the second ending coordinate.

[0026] In the VR projection method described in the embodiment of the present application, when it is detected that the mobile terminal turns on the VR mode, hiding the desktop interface of the mobile terminal includes:

[0027] When it is detected that the VR switch of the mobile terminal is turned on, the mobile terminal is controlled to turn on the VR mode and the desktop interface of the mobile terminal is hidden.

[0028] In the VR projection method described in the embodiment of the present application, the content displayed on the desktop interface is software, the sub-content generated by the user operating the software is a video on the software, and the screen recording of the desktop interface to obtain the target video includes:

[0029] Record the screen of the video playing on the software to obtain the target video.

[0030] The embodiment of the present application further provides a VR projection device, the device comprising:

[0031] A hiding module, used to hide the desktop interface of the mobile terminal when detecting that the mobile terminal turns on the VR mode;

[0032] A screen recording module, used to record the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content;

[0033] The display module is used to perform VR display of the target video on the screen of the mobile terminal to generate a VR picture.

[0034] An embodiment of the present application further provides a computer storage medium, wherein a computer program is stored in the computer storage medium. When the computer program is executed on a computer, the computer executes the VR projection method described in any embodiment.

[0035] An embodiment of the present application also provides a mobile terminal, which includes a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the VR projection method described in any embodiment by calling the computer program stored in the memory.

[0036] The embodiment of the present application hides the desktop interface of the mobile terminal when it is detected that the mobile terminal turns on the VR mode; the desktop interface is recorded to obtain the target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user's operation on the content; the target video is VR displayed on the screen of the mobile terminal to generate a VR picture. The embodiment of the present application does not need to enter a certain video APP to open the VR video before turning on the VR mode corresponding to the video, but can directly turn on the VR mode on the desktop interface of the mobile terminal, and then after turning on the VR mode, hide the desktop interface of the mobile terminal so that it is not displayed on the screen of the mobile terminal, then record the hidden desktop interface, and then display the recorded video on the screen of the mobile terminal for VR, so that all the content on the mobile terminal interface can be projected into the VR glasses, so that the user can experience the resource content of the entire network, rather than being limited to the content on a certain software. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0038] Figure 1 A flowchart of a VR projection method provided in an embodiment of the present application.

[0039] Figure 2 A schematic diagram of the structure of a VR projection device provided in an embodiment of the present application.

[0040] Figure 3 Another structural schematic diagram of the VR projection device provided in an embodiment of the present application.

[0041] Figure 4 A schematic diagram of the structure of a mobile terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0043] The embodiment of the present application provides a VR projection method, which can be applied to a mobile terminal. The mobile terminal can be a smart phone, a tablet computer, or other device.

[0044] See also Figure 1 , Figure 1 A flowchart of a VR projection method provided in an embodiment of the present application. The VR projection method is applied to a mobile terminal, and the method may include the following steps:

[0045] Step 101: When it is detected that the mobile terminal turns on the VR mode, the desktop interface of the mobile terminal is hidden.

[0046] Among them, the way to turn on the VR mode in this embodiment is to directly click the VR switch on the desktop interface of the mobile terminal and then turn on the VR mode, rather than entering a certain video APP to open the VR video and then turning on the VR mode corresponding to the video.

[0047] The desktop interface may be hidden by shrinking the desktop interface on the mobile terminal screen to a level that is invisible to human eyes.

[0048] In some embodiments, when detecting that the mobile terminal turns on the VR mode, hiding the desktop interface of the mobile terminal includes:

[0049] When it is detected that the VR switch of the mobile terminal is turned on, the mobile terminal is controlled to turn on the VR mode and the desktop interface of the mobile terminal is hidden.

[0050] Among them, the VR switch can be set on the desktop interface of the mobile terminal, or in a pull-down manner like a mobile phone, the mobile phone interface is pulled down, and a VR switch is set inside, marked as VR mode. Click the switch to turn on the VR mode, and click the switch again to turn off the VR mode.

[0051] Among them, after turning on the VR mode, users can watch the VR video displayed on the mobile terminal screen by wearing VR glasses.

[0052] Step 102, recording the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content.

[0053] Among them, the content displayed on the desktop interface may include all the software on the desktop (such as Mango TV, iQiyi, Youku Video, etc.), as well as various function switches set on the desktop (such as VR switch, flight mode switch, vibration mode switch, etc.).

[0054] The sub-content generated by the user's operation on the said content, for example, if the content displayed on the desktop interface is iQiyi APP, then the sub-content generated by the user's operation on the iQiyi APP may be the content on the iQiyi APP, including all the content displayed on the iQiyi APP interface, such as the interface content on the iQiyi APP, or TV series, movies, variety shows and other videos on the iQiyi APP.

[0055] In some embodiments, the content displayed on the desktop interface is software, the sub-content generated by the user operating the software is a video on the software, and recording the desktop interface to obtain the target video includes:

[0056] Record the screen of the video playing on the software to obtain the target video.

[0057] For example, the content displayed on the desktop interface is the iQiyi APP, and the sub-content generated by the user's operation on the iQiyi APP is a video on the iQiyi APP, then the screen playing the video is recorded to obtain the target video.

[0058] In some embodiments, after recording the desktop interface to obtain the target video, the method further includes:

[0059] Acquire a first operation of the user on the VR screen;

[0060] Converting the first operation into a second operation of operating the desktop interface;

[0061] The mobile terminal performs corresponding processing according to the second operation, and updates the VR screen according to the processing result.

[0062] Among them, the user indirectly operates the hidden desktop interface by operating on the VR screen (for example, opening the iQiyi APP on the desktop interface, and then selecting a VR movie on the iQiyi APP), that is, converting the user's first operation on the VR screen into a second operation of operating the desktop interface, thereby operating the desktop interface.

[0063] For example, at first the user is watching videos on the iQiyi APP, and then the user wants to change to another video software, such as watching videos on Mango TV. The user can exit the iQiyi APP on the VR screen and select Mango TV, thereby indirectly operating the hidden desktop interface, that is, corresponding to exiting the iQiyi APP on the desktop interface and selecting Mango TV. The mobile terminal will respond to the operation of exiting the iQiyi APP and selecting Mango TV, and update the VR screen according to the operation.

[0064] In some embodiments, converting the first operation into a second operation of operating the desktop interface includes:

[0065] Obtaining a size ratio of the VR screen to the desktop interface before hiding;

[0066] Based on the size ratio, establishing a correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding;

[0067] The first operation is converted into a second operation of operating the desktop interface based on the corresponding relationship of the coordinates.

[0068] Among them, by obtaining the size ratio of the VR screen and the desktop interface before hiding, a correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding is pre-established, so that the user's first operation on the VR screen can be converted into a second operation of operating the desktop interface according to the coordinate correspondence.

[0069] In some embodiments, the first operation is a first click operation, the second operation is a second click operation, and obtaining the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface includes:

[0070] Acquire a first coordinate of a click position corresponding to the first click operation;

[0071] Based on the correspondence relationship of the coordinates, a second coordinate corresponding to the first coordinate is acquired, where the second coordinate is a coordinate corresponding to a click position corresponding to the second click operation.

[0072] For example, the user clicks on position A on the VR screen, and the coordinates (first coordinates) of the position are (a, b). Since the correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding has been established in advance, the second coordinates on the desktop interface corresponding to the coordinates can be obtained through the coordinates (a, b) on the VR screen. For example, the coordinates on the desktop interface corresponding to the coordinates (a, b) on the VR screen are (c, d), and the click position on the desktop interface can be known through the coordinates (c, d).

[0073] In some embodiments, the first operation is a first sliding operation, the second operation is a second sliding operation, and acquiring the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface includes:

[0074] Acquire a first starting coordinate of the first sliding operation, where the first starting coordinate is a coordinate corresponding to a starting sliding point of the first sliding operation;

[0075] Based on the corresponding relationship of the coordinates, obtaining a second starting coordinate corresponding to the first starting coordinate, where the second starting coordinate is a coordinate corresponding to a starting sliding point of the second sliding operation;

[0076] Acquire a first end coordinate of the first sliding operation, where the first end coordinate is a coordinate corresponding to an end sliding point of the first sliding operation;

[0077] Based on the corresponding relationship of the coordinates, acquiring a second terminal coordinate corresponding to the first terminal coordinate, where the second terminal coordinate is a coordinate corresponding to a terminal sliding point of the second sliding operation;

[0078] The second sliding operation is obtained based on the second starting coordinate and the second ending coordinate.

[0079] Since the user is performing a sliding operation on the VR screen, there will be a sliding start point and a sliding end point (end point). Based on the corresponding relationship, the sliding start point of the first sliding operation will correspond to the sliding start point of the second sliding operation, and the sliding end point of the first sliding operation will correspond to the sliding end point of the second sliding operation. Therefore, the first starting coordinates of the first sliding operation (the sliding starting point coordinates of the first sliding operation) will correspond to the second starting coordinates of the second sliding operation (the sliding starting point coordinates of the second sliding operation), and the first ending coordinates of the first sliding operation (the sliding end point coordinates of the first sliding operation) will correspond to the second ending coordinates of the second sliding operation (the sliding end point coordinates of the second sliding operation). Based on the pre-set coordinate correspondence, the second operation of the operating desktop interface can be obtained by obtaining the user's first sliding operation on the VR screen.

[0080] Step 103: Perform VR display of the target video on the screen of the mobile terminal to generate a VR picture.

[0081] After the target video is acquired, the target video is displayed on the screen of the mobile terminal in VR, so that the user wearing VR glasses can watch the VR video.

[0082] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

[0083] In specific implementation, the present application is not limited by the execution order of the various steps described. If no conflict occurs, some steps can be performed in other orders or simultaneously.

[0084] As can be seen from the above, the VR projection method provided in the embodiment of the present application hides the desktop interface of the mobile terminal when it is detected that the mobile terminal turns on the VR mode; the desktop interface is recorded to obtain the target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user operating the content; the target video is VR displayed on the screen of the mobile terminal to generate a VR picture. The embodiment of the present application does not need to enter a certain video APP to open the VR video before turning on the VR mode corresponding to the video, but can directly turn on the VR mode on the desktop interface of the mobile terminal, and then after turning on the VR mode, hide the desktop interface of the mobile terminal so that it is not displayed on the screen of the mobile terminal, then record the hidden desktop interface, and then display the recorded video on the screen of the mobile terminal for VR, so that all the content on the mobile terminal interface can be projected into the VR glasses, so that the user can experience the resource content of the entire network, rather than being limited to the content on a certain software.

[0085] The embodiment of the present application further provides a VR projection device, which can be integrated in a mobile terminal. The mobile terminal can be a smart phone, a tablet computer, or other device.

[0086] See also Figure 2 , Figure 2 A schematic diagram of the structure of a VR projection device provided in an embodiment of the present application. The VR projection device 30 may include:

[0087] A hiding module 31 is used to hide the desktop interface of the mobile terminal when it is detected that the mobile terminal turns on the VR mode;

[0088] A screen recording module 32, used to record the desktop interface to obtain a target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user's operation on the content;

[0089] The display module 33 is used to perform VR display of the target video on the screen of the mobile terminal to generate a VR picture.

[0090] In some embodiments, the hiding module 31 is used to control the mobile terminal to turn on the VR mode and hide the desktop interface of the mobile terminal when it is detected that the VR switch of the mobile terminal is turned on.

[0091] In some embodiments, the screen recording module 32 is used to record the screen playing the video on the software to obtain the target video when the content displayed on the desktop interface is software and the sub-content generated by the user operating the software is a video on the software.

[0092] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same entity or several entities.

[0093] As can be seen from the above, the VR projection device 30 provided in the embodiment of the present application, when detecting that the mobile terminal turns on the VR mode, hides the desktop interface of the mobile terminal through the hiding module 31; records the desktop interface through the screen recording module 32 to obtain the target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user operating the content; and displays the target video on the screen of the mobile terminal through the display module 33 to generate a VR picture. The embodiment of the present application can project all the content on the mobile terminal interface into the VR glasses, so that the user can experience the resource content of the entire network, rather than being limited to the content on a certain software.

[0094] See also Figure 3 , Figure 3 Another structural diagram of a VR projection device provided in an embodiment of the present application, the vibration VR projection device 30 includes a memory 120, one or more processors 180, and one or more applications, wherein the one or more applications are stored in the memory 120 and configured to be executed by the processor 180; the processor 180 may include a hiding module 31, a screen recording module 32, and a display module 33. For example, the structure and connection relationship of the above components may be as follows:

[0095] The memory 120 can be used to store applications and data. The applications stored in the memory 120 include executable codes. The applications can be composed of various functional modules. The processor 180 executes various functional applications and data processing by running the applications stored in the memory 120. In addition, the memory 120 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 120 may also include a memory controller to provide the processor 180 with access to the memory 120.

[0096] The processor 180 is the control center of the device, and uses various interfaces and lines to connect various parts of the entire terminal, and executes various functions of the device and processes data by running or executing applications stored in the memory 120, and calling data stored in the memory 120, so as to monitor the device as a whole. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs.

[0097] Specifically in this embodiment, the processor 180 will load the executable code corresponding to the process of one or more applications into the memory 120 according to the following instructions, and the processor 180 will run the application stored in the memory 120 to implement various functions:

[0098] A hiding module 31 is used to hide the desktop interface of the mobile terminal when it is detected that the mobile terminal turns on the VR mode;

[0099] A screen recording module 32, used to record the desktop interface to obtain a target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user's operation on the content;

[0100] The display module 33 is used to perform VR display of the target video on the screen of the mobile terminal to generate a VR picture.

[0101] In some embodiments, the hiding module 31 is used to control the mobile terminal to turn on the VR mode and hide the desktop interface of the mobile terminal when it is detected that the VR switch of the mobile terminal is turned on.

[0102] In some embodiments, the screen recording module 32 is used to record the screen playing the video on the software to obtain the target video when the content displayed on the desktop interface is software and the sub-content generated by the user operating the software is a video on the software.

[0103] The embodiment of the present application also provides a mobile terminal, which can be a smart phone, a tablet computer or other device.

[0104] See also Figure 4 , Figure 4 The structure diagram of the mobile terminal provided in the embodiment of the present application is shown, and the mobile terminal can be used to implement the vibration adjustment method provided in the above embodiment. The mobile terminal 1200 can be a smart phone or a tablet computer.

[0105] like Figure 4 As shown, the mobile terminal 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one is shown in the figure) computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, a processor 180 including one or more (only one is shown in the figure) processing cores, and a power supply 190. Those skilled in the art will understand that Figure 4The structure of the mobile terminal 1200 shown in the figure does not constitute a limitation on the mobile terminal 1200, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0106] The RF circuit 110 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The RF circuit 110 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a user identity module (SIM) card, a memory, etc. The RF circuit 110 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices through a wireless network.

[0107] The memory 120 can be used to store software programs and modules, such as the program instructions / modules corresponding to the vibration adjustment method in the above embodiment. The processor 180 executes various functional applications and data processing by running the software programs and modules stored in the memory 120, and can project all the content on the mobile terminal interface into the VR glasses, so that the user can experience the resource content of the entire network, rather than being limited to the content on a certain software. The memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 120 may further include a memory remotely arranged relative to the processor 180, and these remote memories may be connected to the mobile terminal 1200 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0108] The input unit 130 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 130 may include a touch-sensitive surface 131 and other input devices 132. The touch-sensitive surface 131, also known as a touch display screen or a touch pad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 131), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 131 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 180, and can receive and execute commands sent by the processor 180. In addition, the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 131, the input unit 130 may further include other input devices 132. Specifically, other input devices 132 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc.

[0109] The display unit 140 may be used to display information input by the user or information provided to the user and various graphical user interfaces of the mobile terminal 1200, which may be composed of graphics, text, icons, videos and any combination thereof. The display unit 140 may include a display panel 141. Optionally, the display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141. When the touch-sensitive surface 131 detects a touch operation on or near it, it is transmitted to the processor 180 to determine the type of touch event. Subsequently, the processor 180 provides a corresponding visual output on the display panel 141 according to the type of touch event. Although in Figure 4 In the embodiment, the touch-sensitive surface 131 and the display panel 141 are implemented as two independent components to realize the input and output functions. However, in some embodiments, the touch-sensitive surface 131 and the display panel 141 can be integrated to realize the input and output functions.

[0110] The mobile terminal 1200 may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 141 and / or the backlight when the mobile terminal 1200 is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the mobile terminal 1200, they will not be repeated here.

[0111] The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile terminal 1200. The audio circuit 160 can transmit the received audio data to the speaker 161 after converting the received audio data into an electrical signal, which is converted into a sound signal for output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, and then the audio data is output to the processor 180 for processing, and then sent to another terminal through the RF circuit 110, or the audio data is output to the memory 120 for further processing. The audio circuit 160 may also include an earplug jack to provide communication between an external headset and the mobile terminal 1200.

[0112] The mobile terminal 1200 can help users send and receive emails, browse web pages, and access streaming media through the transmission module 170 (such as a Wi-Fi module), which provides users with wireless broadband Internet access. Figure 4 The transmission module 170 is shown, but it is understandable that it is not an essential component of the mobile terminal 1200 and can be omitted as needed without changing the essence of the invention.

[0113] The processor 180 is the control center of the mobile terminal 1200. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 120, and calling data stored in the memory 120, it executes various functions of the mobile terminal 1200 and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 180.

[0114] The mobile terminal 1200 also includes a power supply 190 (such as a battery) for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 180 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 190 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0115] Although not shown, the mobile terminal 1200 may also include a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail herein. Specifically in this embodiment, the display unit 140 of the mobile terminal 1200 is a touch screen display, and the mobile terminal 1200 also includes a memory 120, and one or more programs, wherein one or more programs are stored in the memory 120, and are configured to be executed by one or more processors 180. One or more programs include instructions for performing the following operations:

[0116] When detecting that the mobile terminal is in VR mode, hiding the desktop interface of the mobile terminal;

[0117] Recording the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content;

[0118] The target video is VR displayed on the screen of the mobile terminal to generate a VR picture.

[0119] In some embodiments, the processor 180 is used to obtain a first operation of the user on the VR screen;

[0120] Converting the first operation into a second operation of operating the desktop interface;

[0121] The mobile terminal performs corresponding processing according to the second operation, and updates the VR screen according to the processing result.

[0122] In some embodiments, the processor 180 is used to obtain a size ratio between the VR screen and the desktop interface before hiding;

[0123] Based on the size ratio, establishing a correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding;

[0124] The first operation is converted into a second operation of operating the desktop interface based on the corresponding relationship of the coordinates.

[0125] In some embodiments, the processor 180 is configured to, when the first operation is a first click operation and the second operation is a second click operation,

[0126] Acquire a first coordinate of a click position corresponding to the first click operation;

[0127] Based on the correspondence relationship of the coordinates, a second coordinate corresponding to the first coordinate is acquired, where the second coordinate is a coordinate corresponding to a click position corresponding to the second click operation.

[0128] In some embodiments, the processor 180 is configured to, when the first operation is a first sliding operation and the second operation is a second sliding operation, obtain a first starting coordinate of the first sliding operation, where the first starting coordinate is a coordinate corresponding to a starting sliding point of the first sliding operation;

[0129] Based on the corresponding relationship of the coordinates, obtaining a second starting coordinate corresponding to the first starting coordinate, where the second starting coordinate is a coordinate corresponding to a starting sliding point of the second sliding operation;

[0130] Acquire a first end coordinate of the first sliding operation, where the first end coordinate is a coordinate corresponding to an end sliding point of the first sliding operation;

[0131] Based on the corresponding relationship of the coordinates, acquiring a second terminal coordinate corresponding to the first terminal coordinate, where the second terminal coordinate is a coordinate corresponding to a terminal sliding point of the second sliding operation;

[0132] The second sliding operation is obtained based on the second starting coordinate and the second ending coordinate.

[0133] In some embodiments, the processor 180 is used to control the mobile terminal to turn on the VR mode and hide the desktop interface of the mobile terminal when it is detected that the VR switch of the mobile terminal is turned on.

[0134] In some embodiments, when the content displayed on the desktop interface is software and the sub-content generated by the user operating the software is a video on the software, the processor 180 is used to record the screen playing the video on the software to obtain the target video.

[0135] As can be seen from the above, the embodiment of the present application provides a mobile terminal 1200, and the mobile terminal 1200 performs the following steps: when it is detected that the mobile terminal turns on the VR mode, the desktop interface of the mobile terminal is hidden; the desktop interface is recorded to obtain the target video, wherein the desktop interface includes the content displayed on the desktop interface and the sub-content generated by the user operating the content; the target video is VR displayed on the screen of the mobile terminal to generate a VR picture. The embodiment of the present application does not need to enter a certain video APP to open the VR video, and then turn on the VR mode corresponding to the video, but can directly turn on the VR mode on the desktop interface of the mobile terminal, and then after turning on the VR mode, hide the desktop interface of the mobile terminal so that it is not displayed on the screen of the mobile terminal, and then record the hidden desktop interface, and then display the recorded video on the screen of the mobile terminal. VR, so that all the content on the mobile terminal interface can be projected into the VR glasses, so that users can experience the resource content of the entire network, rather than being limited to the content on a certain software.

[0136] An embodiment of the present application further provides a storage medium, wherein a computer program is stored in the storage medium. When the computer program runs on a computer, the computer executes the VR projection method described in any of the above embodiments.

[0137] It should be noted that, for the VR projection method described in this application, ordinary testers in this field can understand that all or part of the processes of the VR projection method described in the embodiment of this application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as stored in the memory of a mobile terminal, and executed by at least one processor in the mobile terminal, and the execution process may include the process of the embodiment of the vibration adjustment method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), etc.

[0138] For the vibration adjustment device of the embodiment of the present application, each functional module thereof can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.

[0139] The VR projection method, device, storage medium and mobile terminal provided in the embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application; at the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A VR projection method, characterized in that: The method comprises: When it is detected that the mobile terminal turns on the VR mode, the desktop interface of the mobile terminal is hidden; a VR switch is set in the desktop interface or the interface drop-down of the mobile terminal, and the VR mode is turned on by clicking the VR switch in the desktop interface or the interface drop-down of the mobile terminal; Recording the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content; Performing VR display on the screen of the mobile terminal to generate a VR picture; The content displayed on the desktop interface includes software, the sub-content generated by the user operating the software includes a video on the software, and the screen recording of the desktop interface to obtain a target video includes: Record the screen of the video playing on the software to obtain the target video.

2. The VR projection method according to claim 1, characterized in that: After recording the desktop interface to obtain the target video, the method further includes: Acquire a first operation of the user on the VR screen; Converting the first operation into a second operation of operating the desktop interface; The mobile terminal performs corresponding processing according to the second operation, and updates the VR screen according to the processing result.

3. The VR projection method according to claim 2, characterized in that: The converting the first operation into a second operation of operating the desktop interface includes: Obtaining a size ratio of the VR screen to the desktop interface before hiding; Based on the size ratio, establishing a correspondence between the coordinates on the VR screen and the coordinates on the desktop interface before hiding; The first operation is converted into a second operation of operating the desktop interface based on the corresponding relationship of the coordinates.

4. The VR projection method according to claim 3, characterized in that: The first operation is a first click operation, the second operation is a second click operation, and the acquiring the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface includes: Acquire a first coordinate of a click position corresponding to the first click operation; Based on the correspondence relationship of the coordinates, a second coordinate corresponding to the first coordinate is acquired, where the second coordinate is a coordinate corresponding to a click position corresponding to the second click operation.

5. The VR projection method according to claim 3, characterized in that: The first operation is a first sliding operation, the second operation is a second sliding operation, and the acquiring the first operation of the user on the VR screen and converting the first operation into a second operation of operating the desktop interface includes: Acquire a first starting coordinate of the first sliding operation, where the first starting coordinate is a coordinate corresponding to a starting sliding point of the first sliding operation; Based on the corresponding relationship of the coordinates, obtaining a second starting coordinate corresponding to the first starting coordinate, where the second starting coordinate is a coordinate corresponding to a starting sliding point of the second sliding operation; Acquire a first end coordinate of the first sliding operation, where the first end coordinate is a coordinate corresponding to an end sliding point of the first sliding operation; Based on the corresponding relationship of the coordinates, acquiring a second terminal coordinate corresponding to the first terminal coordinate, where the second terminal coordinate is a coordinate corresponding to a terminal sliding point of the second sliding operation; The second sliding operation is obtained based on the second starting coordinate and the second ending coordinate.

6. The VR projection method according to claim 1, characterized in that: When detecting that the mobile terminal turns on the VR mode, hiding the desktop interface of the mobile terminal includes: When it is detected that the VR switch of the mobile terminal is turned on, the mobile terminal is controlled to turn on the VR mode and the desktop interface of the mobile terminal is hidden.

7. A VR projection device, characterized in that: The device comprises: A hiding module is used to hide the desktop interface of the mobile terminal when it is detected that the mobile terminal turns on the VR mode; a VR switch is set in the desktop interface or the interface drop-down of the mobile terminal, and the VR mode is turned on by clicking the VR switch in the desktop interface or the interface drop-down of the mobile terminal; A screen recording module, used to record the desktop interface to obtain a target video, wherein the desktop interface includes content displayed on the desktop interface and sub-content generated by a user operating the content; A display module, used for performing VR display of the target video on the screen of the mobile terminal to generate a VR picture; The content displayed on the desktop interface includes software, the sub-content generated by the user operating the software includes a video on the software, and the screen recording module is specifically used for: Record the screen of the video playing on the software to obtain the target video.

8. A computer storage medium, characterized in that The computer storage medium stores a computer program, and when the computer program runs on a computer, the computer executes the VR projection method according to any one of claims 1 to 6.

9. A mobile terminal, characterized in that: The mobile terminal includes a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the VR projection method according to any one of claims 1 to 6 by calling the computer program stored in the memory.

Images