View display method, device, and storage medium

Abstract

Provided are a view display method, a device, and a storage medium. The view display method comprises: in response to detecting a starting instruction for converting a view of a target object from an initial dimension to a target dimension for display, creating a virtual runtime environment and a proxy display window for the target object, wherein the virtual runtime environment is a virtual runtime environment which is isolated from a real runtime environment of the target object and is used for running the target object, and the proxy display window is used for replacing a display window of the target object in the real runtime environment of the target object to display the target object; running the target object in the virtual runtime environment, and obtaining a view of the initial dimension of the target object; converting the view of the initial dimension into a view of the target dimension; and displaying the view of the target dimension in the proxy display window.

Description

View screen display method, device and storage medium

[0001] This disclosure claims priority to Chinese patent application No. 202410174569.3, filed on February 7, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of image display technology, and in particular to a view image display method, device, and storage medium. Background Art

[0003] With the development of three-dimensional (3D) technology, more and more display devices support naked-eye 3D display effects, allowing some display objects on the display device to be presented in 3D images. Taking commonly used applications (APPs) as an example, some technologies require the APP to complete the integration of 3D display functions to achieve the 3D display effect based on the device's 3D display characteristics. Summary of the Invention

[0004] In one aspect, an embodiment of the present disclosure provides a view screen display method. The view screen display method includes: in response to detecting an instruction to start converting a view screen of a target object from an initial dimension to a target dimension, creating a virtual operating environment and a proxy display window for the target object; the virtual operating environment is a virtual operating environment for operating the target object that is isolated from the target object's real operating environment; the proxy display window is used to display the target object in the target object's real operating environment instead of the target object's display window; the target object is run in the virtual operating environment and a view screen of the initial dimension of the target object is obtained; the view screen of the initial dimension is converted to a view screen of the target dimension; and the view screen of the target dimension is displayed in the proxy display window.

[0005] On the other hand, an embodiment of the present disclosure provides a view screen display method, which is applied to a display device. The display device includes: an operating environment management module, a window management module, and a dimension conversion module. The view screen display method includes: in response to detecting an opening instruction to convert the view screen of the target object from the initial dimension to the target dimension display, creating a virtual operating environment for the target object through the operating environment management module, and creating a proxy display window for the target object through the window management module; the virtual operating environment is a virtual operating environment for running the target object that is isolated from the real operating environment of the target object; the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object; the target object is run in the virtual operating environment through the operating environment management module, and the view screen of the initial dimension of the target object is obtained; the view screen of the initial dimension is converted into the view screen of the target dimension through the dimension conversion module; the view screen of the target dimension is displayed in the proxy display window through the window management module.

[0006] In another aspect, an embodiment of the present disclosure provides a view image display device. The display device includes: a processing module and an acquisition module;

[0007] The processing module is used to create a virtual operating environment and a proxy display window for the target object in response to detecting an activation instruction to convert the view screen of the target object from the initial dimension to the target dimension display; the virtual operating environment is a virtual operating environment for running the target object that is isolated from the real operating environment of the target object; the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object; the processing module is also used to run the target object in the virtual operating environment; the acquisition module is used to obtain the view screen of the initial dimension of the target object; the processing module is also used to convert the view screen of the initial dimension into the view screen of the target dimension; the processing module is also used to display the view screen of the target dimension in the proxy display window.

[0008] In another aspect, an embodiment of the present disclosure provides an electronic device. The electronic device includes a memory and a processor. The memory and the processor are coupled, the memory is configured to store a computer program, and the processor implements any of the above-described view screen display methods when executing the computer program.

[0009] On the other hand, an embodiment of the present disclosure provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implements the view screen display method of any of the above aspects.

[0010] On the other hand, an embodiment of the present disclosure provides a computer program product, which includes computer program instructions, and when the computer program instructions are executed by a processor, the view screen display method of any of the above aspects is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] To more clearly illustrate the technical solutions of the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure, and those skilled in the art can also derive other drawings based on these drawings.

[0012] FIG1 is a system architecture diagram of an electronic device according to some embodiments.

[0013] FIG2 is a flow chart of a method for displaying a view according to some embodiments.

[0014] FIG3 is a schematic diagram illustrating an example of an application display interface according to some embodiments.

[0015] FIG4 is a schematic flow chart of another method for displaying a view according to some embodiments.

[0016] FIG. 5 is a schematic diagram illustrating an example of a process of converting an application to a 3D display according to some embodiments.

[0017] FIG6 is a schematic diagram illustrating an example of proxy application control according to some embodiments.

[0018] FIG7 is a schematic structural diagram of a view image display device according to some embodiments.

[0019] FIG8 is a schematic structural diagram of a view image display device according to some embodiments. DETAILED DESCRIPTION

[0020] The following will clearly and completely describe the technical solutions of this disclosure in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of this disclosure, not all of them. All other embodiments derived by persons of ordinary skill in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0021] It should be noted that in this disclosure, expressions such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this disclosure as "exemplarily" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of expressions such as "exemplarily" or "for example" is intended to present the relevant concepts in a detailed manner.

[0022] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of the features.

[0023] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" herein is simply a description of an association relationship between associated objects, indicating that three possible relationships exist. For example, A and / or B can mean: only A, only B, and A and B. Furthermore, "at least one" means one or more, and "a plurality" means two or more.

[0024] Before introducing the view image display method provided by the embodiment of the present disclosure in detail, the implementation environment and application scenarios of the embodiment of the present disclosure are first introduced.

[0025] First, the application scenarios of the embodiments of the present disclosure are introduced.

[0026] Currently, the views displayed by 3D devices (i.e., display devices that support 3D display) are all the views displayed by the application's own display window within the 3D device. In other words, the 3D views displayed by 3D devices are all the 3D views displayed by the application's own display window within the 3D device. The 3D display effects of applications on 3D devices are mostly dependent on modifications and adaptations made to the application itself.

[0027] For example, if a video player app needs to convert the video it plays to 3D, it needs to be modified to include logic for reading system properties. If the device supports 3D display, the app needs to adapt the playback and display process, integrating 2D to 3D conversion before the image is rendered. Modifying all existing third-party apps would be a significant workload, and device manufacturers cannot force app developers to adapt to 3D display features.

[0028] That is to say, in some technologies, on devices that support 3D display, taking the APP commonly used by users as an example, the APP needs to complete the 3D display function integration modification according to the characteristics of whether the device supports 3D display in order to achieve the effect of displaying 3D pictures. For example, on different devices, the APP needs to read the system property configuration of whether the current device supports 3D display. If the system property flag does not support 3D display, the APP keeps the original logic unchanged. If the system property flag supports 3D display, the APP needs to implement the corresponding 3D display logic modification to display the application screen in 3D. In this way, the existing methods of displaying 3D effects in applications are all achieved by integrating the corresponding functional modules in the APP itself and adapting and modifying the 3D device.

[0029] However, among the multiple applications installed on 3D devices, some applications do not support the display of 3D view images. In order to make some applications compatible with 3D display in 3D devices, it is usually necessary to rely on the support of application developers, modify the playback and display process of the adapted application, and integrate the 2D to 3D function before the image is presented, so that the modified and adapted application can directly display the 3D view image through its own display window. In this way, when there are a large number of applications that need to be modified and adapted, it may cause a huge workload for adaptation, and there are many restrictions between different applications. Therefore, there is an urgent need for a universal and effective method that can realize the conversion of general applications from 2D effects to 3D effects.

[0030] In order to solve the above problems, the embodiment of the present disclosure provides a view screen display method, which is applied to the scenario where a terminal with a naked-eye 3D display screen displays a 3D screen, and is used to solve the problem that the display content on the terminal (such as APP, operating system, video, game, etc.) needs to be additionally developed and adapted on the 3D display device to present a 3D display effect. The present disclosure implements a general 2D to 3D proxy service method. When the display content on the terminal (including APP, desktop icons, video content on APP, game content, etc.) needs to be presented in 3D, the display screen can be converted from 2D to 3D by using the 3D conversion method of the present disclosure. The entire conversion process does not require any modification to the converted content in advance. Even third-party applications installed on the terminal do not need to make any modifications to present the APP screen in 3D effect, avoiding the process of application adaptation to 3D devices. The present disclosure expands the number of applications that support 3D display on 3D devices, and can support the conversion of 2D screens of content running in a virtual environment into 3D naked-eye display effects. The present disclosure is highly versatile and has high use value. In other words, the present disclosure adopts a universal solution to implement a universal 3D conversion proxy service to complete the corresponding conversion adaptation work. The application can adapt to the 3D function without modification and does not require third-party application adaptation development. It has few promotion restrictions and a wider range of usage scenarios.

[0031] The implementation environment of the embodiments of the present disclosure is introduced below.

[0032] As shown in FIG. 1 , FIG. 1 is a system architecture diagram of an electronic device according to some embodiments. The electronic device 100 may include: an object to be displayed 101 and a screen conversion service module 102 .

[0033] The screen conversion service module 102 includes an operating environment management module 103 , a window management module 104 , a dimension conversion module 105 and an agent control module 106 .

[0034] In the embodiment of the present disclosure, the operating environment management module 103 is used to manage the operating environment of the display object and collect view images of the display object in different operating environments.

[0035] The window management module 104 is used to manage the display window of the display object in the real running environment of the display object.

[0036] The dimension conversion module 105 is used to convert a view picture from a two-dimensional display to a three-dimensional display, or to convert a view picture from a three-dimensional display to a two-dimensional display.

[0037] The proxy control module 106 is used to convert operation instructions of different operating environments.

[0038] As an implementation, in response to a user input instruction for 3D display of the object 101 to be displayed, the electronic device 100 can, through the operating environment management module 103 in the screen conversion service module 102, isolate a virtual operating environment for the object 101 to simulate the operation of the object 101 outside of the object's real operating environment. Furthermore, through the window management module 104 in the screen conversion service module 102, create a proxy display window in the object's real operating environment to replace the display of the object's view. Next, the electronic device 100 can migrate the object 101 from the real operating environment to the virtual operating environment through the operating environment management module 103 and capture a 2D view of the object 101 running in the virtual operating environment. Subsequently, the electronic device 100 can convert the 2D view into a 3D view through the dimension conversion module 105 in the screen conversion service module 102, and display the 3D view through the proxy display window created by the window management module 104.

[0039] In some embodiments, after the proxy display window displays the 3D view, the electronic device 100 can receive, via the window management module 104, an initial operation instruction input by the user into the 3D view in the proxy display window, for instructing the object to be displayed 101 to execute a target event in the real operating environment. Subsequently, the electronic device 100 can, via the proxy control module 106 in the image conversion service module 102, convert the initial operation instruction into a target operation instruction for instructing the object to be displayed 101 to execute the target event in the virtual operating environment, and send the target operation instruction to the object to be displayed 101 in the virtual operating environment. Thereafter, the electronic device 100 can obtain the target view obtained by the object to be displayed 101 executing the target event, and synchronize the target view to the proxy display window for display.

[0040] It should be noted that the present embodiment does not limit the object to be displayed 101. For example, the object to be displayed 101 may be an app. For another example, the object to be displayed 101 may be a desktop icon. For another example, the object to be displayed 101 may be video content, game content, etc. on an app.

[0041] In an embodiment of the present disclosure, the electronic device 100 may be a terminal device supporting naked-eye 3D display, and the display screen of the electronic device includes a flat, curved, or flexible display screen.

[0042] The terminal can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook computer, or other device with transceiver functions. The embodiments of the present disclosure do not impose any particular restrictions on the form of the terminal. The terminal can interact with the user through one or more methods such as a keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0043] After introducing the application scenario and implementation environment of the embodiment of the present disclosure, the view screen display method provided by the embodiment of the present disclosure is introduced in detail below in combination with the above implementation environment.

[0044] An embodiment of the present disclosure provides a method for displaying a view screen. As shown in FIG2 , the method for displaying a view screen includes: S201 to S204 .

[0045] S201 : In response to detecting a start instruction to convert a view of a target object from an initial dimension to a target dimension, create a virtual operating environment and an agent display window for the target object.

[0046] The virtual operating environment is a virtual operating environment that is isolated from the real operating environment of the target object and is used to run the target object.

[0047] It should be noted that a virtual runtime environment (VRE) is an independent operating system environment created through software simulation on computer hardware. In this environment, users can install and run systems, applications, and services that are different from the host operating system.

[0048] For example, common virtual operating environment technologies include VMware, VirtualBox, Hyper-V, KVM (Kernel-based Virtual Machine) and Docker containers.

[0049] A real runtime environment is an environment where software or programs execute directly on actual hardware devices, without any virtualization technology involved. In this environment, the operating system, applications, and all related system resources interact directly with the physical hardware.

[0050] For example, if you install and run a Windows or Linux operating system directly on a computer without any virtual machine software installed, the operating system is running in a real operating environment. In this environment, applications can directly access and use all CPU, memory, hard disk, and other hardware resources, and performance is not affected by the additional overhead of the virtualization layer.

[0051] As an implementation, the display device is deployed with a screen conversion service module, which may include an operating environment management module. When the display device creates a virtual operating environment for a target object, the display device may create a virtual operating environment for the target object through the operating environment management module.

[0052] Regarding the process of the display device creating a virtual operating environment for the target object in the embodiment of the present disclosure, reference may be made to the description of creating a virtual operating environment through software simulation in some technologies, which will not be described in detail in the embodiment of the present disclosure.

[0053] In the embodiment of the present disclosure, the proxy display window is used to replace the display window of the target object in displaying the view screen of the target object in the real operating environment of the target object, and the display window of the target object displays the view screen of the target object in the virtual operating environment.

[0054] That is to say, the proxy display window can replace the original display window of the target object, receive and display the view screen of the target object, and then display the screen in the real operating environment, while the original display window of the target object receives and displays the view screen of the target object in the virtual operating environment.

[0055] In some embodiments, the proxy display window may intercept the view screen of the target object and display the view screen of the target object instead of the display window of the target object, and the display window of the target object does not display the view screen of the target object.

[0056] As an implementation method, the screen conversion service module may further include: a window management module. When the display device creates a proxy display window for the target object, the display device may create a proxy display window for the target object through the window management module.

[0057] It should be noted that in computer graphics and user interface design, a display window generally refers to the specific area used by an application or operating system to present images, text, or other visual content. It is a rectangular area, which can be the entire screen or a portion of the screen, used to receive and display data output from the application.

[0058] For the process of the display device creating a proxy display window for the target object in the embodiment of the present disclosure, reference may be made to the description of creating a display window in some technologies, which will not be described in detail in the embodiment of the present disclosure.

[0059] It should be noted that the embodiments of the present disclosure do not limit the target object. For example, the target object may be an app. For another example, the target object may be a desktop icon. For another example, the target object may be video content, game content, etc. on an app.

[0060] It should be noted that, in the embodiments of the present disclosure, the initial dimension may be higher than the target dimension, or the initial dimension may be lower than the target dimension.

[0061] Exemplarily, the initial dimension is 2D and the target dimension is 3D. Alternatively, the initial dimension is 3D and the target dimension is 2D.

[0062] That is to say, the embodiment of the present disclosure can not only display the original view picture in reduced dimension, but also display the original view picture in increased dimension, thereby expanding the application scenarios of view picture display.

[0063] In the embodiment of the present disclosure, the activation instruction may be triggered by a function switch set by the user operating system or a user interface switch.

[0064] As an implementation method, the display device can receive a switch operation input by the user to the screen conversion service module in the system setting function (or user interface) when the target object is running in the real running environment, and trigger the generation of a start instruction.

[0065] It should be noted that the embodiments of the present disclosure do not limit the display method of the screen conversion service module. For example, the screen conversion service module can be displayed via a floating window or a floating ball. For another example, the screen conversion service module can be displayed via a drop-down panel. For another example, the screen conversion service module can be displayed via a settings option.

[0066] For example, as shown in FIG3 , a display device 300 displays the interface of application A (i.e., the view of the target object) via a display window 301 of application A, and displays a floating display window 302 for the screen conversion service on display window 301. Display window 302 includes a switch to 3D display button 303 and an exit 3D display button 304. In response to a user clicking the switch to 3D display button 303, display device 300 can generate a conversion instruction to convert the interface of application A from 2D to 3D display, thereby detecting the conversion instruction for application A.

[0067] As another implementation manner, the display device may receive a switch operation input by the user in the screen conversion service module when the target object is not running in the real running environment, and further detect a conversion instruction for the target object.

[0068] Exemplarily, in conjunction with FIG3 , when the display device is started, a floating display window 302 as shown in FIG3 may be displayed.

[0069] That is to say, the display device can perform dimension conversion on the view screen of the object to be displayed when the object to be displayed is in different operating states, thereby improving the operability of the view screen display.

[0070] In some embodiments, the start instruction may be triggered by the system (ie, the display device) detecting that a preset condition is met.

[0071] It should be noted that the embodiments of the present disclosure do not limit the preset conditions. For example, the preset condition may be whether the object to be displayed is authorized for dimensional conversion. For another example, the preset condition may be whether the idle computing resources in the system are sufficient to perform dimensional conversion on the object to be displayed. For another example, the preset condition may be whether the object to be displayed has a history of dimensional conversion.

[0072] That is to say, the display device can trigger the opening instruction in a manual or automatic manner, thereby improving the operability of the view screen display.

[0073] S202: Run the target object in the virtual running environment, and obtain a view picture of the initial dimension of the target object.

[0074] In the embodiment of the present disclosure, the display device may run the target object in the virtual running environment through the running environment management module.

[0075] It should be noted that, before the target object is run in the virtual running environment, the display device may execute a corresponding management policy on the target object according to the running state of the target object.

[0076] As an implementation method, when the target object is in a running state in the real running environment, the display device can switch the target object running in the real running environment to the virtual running environment, and then run the target object in the virtual running environment.

[0077] In some embodiments, the display device switches the target object's operating container from a real operating environment to a virtual operating environment by modifying the target object's operating configuration parameters.

[0078] That is, switching the target object (such as an application process) to the virtual runtime environment means changing the runtime container to which the target object belongs, switching the target object from the original runtime environment (ie, the real runtime environment) to the runtime container corresponding to the virtual runtime environment.

[0079] As another implementation manner, when the target object is not in the running state in the real running environment, the display device can start the target object in the virtual running environment, and then run the target object in the virtual running environment.

[0080] In an embodiment of the present disclosure, the display device may obtain a view picture of an initial dimension displayed by a display window of a target object in a virtual operating environment through an operating environment management module.

[0081] As an implementation method, the display device can set a virtual operating environment image capture container in the operating environment management module. The image capture container is used to obtain a view of the target object in its initial dimensions. The display device can then use the image capture container in the environment management module to obtain a view of the target object in its initial dimensions running in the virtual operating environment.

[0082] S203: Convert the view picture of the initial dimension into the view picture of the target dimension.

[0083] As an implementation manner, the screen conversion service module may further include: a dimension conversion module. The display device may convert the view screen of the initial dimension into the view screen of the target dimension through the dimension conversion module.

[0084] It should be noted that, for the process of the display device in the embodiment of the present disclosure converting the view screen of the initial dimension into the view screen of the target dimension, reference can be made to the description of the dimensional conversion of the image in some technologies, which will not be elaborated in the embodiment of the present disclosure.

[0085] S204: Display the view screen of the target dimension in the agent display window.

[0086] As an implementation manner, the display device may obtain the view picture of the target dimension output by the dimension conversion module through the window management module, and display the view picture of the target dimension in the proxy display window through the window management module.

[0087] It can be understood that by isolating the object to be displayed in a virtual operating environment, a view of the object to be displayed in the virtual operating environment is obtained. The view is then converted to a 3D display effect and displayed through a pre-set display window proxy, allowing the 3D device to directly present the view in 3D. This avoids modifying and adapting the display process of the display object, improving the compatibility of the 3D display of the object on the 3D device.

[0088] In some embodiments, as shown in FIG4 , after S204 , the view screen display method may further include: S401 to S404 .

[0089] S401: Obtain a target operation instruction for a view screen of a target dimension in an agent display window.

[0090] The target operation instruction is used to instruct the target object to execute the target event.

[0091] For example, when the target object is a video playback APP, the target operation instruction may be an operation instruction for instructing the video playback APP to pause playback (i.e., the target event), or the target operation instruction may be an operation instruction for instructing the video playback APP to fast forward playback, or the target operation instruction may be an operation instruction for instructing the video playback APP to jump to 3 minutes and 12 seconds of playback.

[0092] As an implementation manner, the display device may obtain, through the window management module, the target operation instruction input by the user to the view picture of the target dimension in the agent display window.

[0093] As an implementation, a display device stores a preset correspondence between a plurality of first preset operating instructions in a real operating environment and a plurality of second preset operating instructions in a virtual operating environment. The display device can obtain a user's initial operating instruction for a view of a target dimension, where the initial operating instruction is an operating instruction for a target object in the real operating environment. The display device can then convert the initial operating instruction into an operating instruction for the target object in the virtual operating environment based on the preset correspondence to obtain the target operating instruction.

[0094] It should be noted that the event to be executed indicated by the first preset operation instruction is the same as the event to be executed indicated by the corresponding second preset operation instruction, and there is a difference in format between the first preset operation instruction and the corresponding second preset operation instruction.

[0095] For example, the preset correspondences in the display device may include: a correspondence A between operation instruction A1 (i.e., a first preset operation instruction) and operation instruction A2 (i.e., a second preset operation instruction), a correspondence B between operation instruction B1 and operation instruction B2, and a correspondence C between operation instruction C1 and operation instruction C2. Operation instructions A1 and A2 both indicate event A, operation instructions B1 and B2 both indicate event B, and operation instructions C1 and C2 both indicate event C. Operation instructions A1, B1, and C1 are all instructions in format A, and operation instructions A2, B2, and C2 are all instructions in format B. If the user's initial operation instruction on the 3D viewing image is operation instruction B1, the display device may determine, based on correspondence B, that the target operation instruction is operation instruction B2.

[0096] As an implementation, the screen conversion service module may further include: an agent control module. When the display device converts the initial operation instruction into the target operation instruction, the display device may convert the initial operation instruction into the target operation instruction through the agent control module.

[0097] S402: Send a target operation instruction to the target object.

[0098] As an implementation manner, the display device may send a target operation instruction to a target object running in the virtual running environment.

[0099] In some embodiments, during the process of the display device sending the target operation instruction to the target object, the display device may send the target operation instruction to the target object through the agent control module.

[0100] S403: Acquire the target view screen obtained by executing the target event of the target object.

[0101] As an implementation method, the display device can respond to the target operation event through the target object, execute the target event, and display the target view screen in the virtual operating environment through the display window of the target object, and at the same time obtain the target view screen through the environment management module.

[0102] S404: Synchronize the target view image to the proxy display window for display.

[0103] In the embodiment of the present disclosure, the display dimensions of the target view image are the initial dimensions. When the display device synchronizes the target view image to the proxy display window for display, the display device may convert the target view image from the initial dimensions to the target dimensions to obtain the converted target view image, and display the converted target view image in the proxy display window.

[0104] In some embodiments, during the process of the display device performing dimensional conversion on the target view picture, the display device may perform dimensional conversion on the target view picture through a dimensional conversion module to obtain a converted target view picture.

[0105] Similarly, in the process of the display device displaying the converted target view picture in the proxy display window, the display device can obtain the converted target view picture output by the dimension conversion module through the window management module, and display the converted target view picture in the proxy display window through the window management module.

[0106] It is understood that after receiving a user's operation instruction for the converted view, the operation instruction is converted into an instruction that matches the virtual operating environment to obtain the converted operation instruction, and the converted operation instruction is injected into the object to be displayed in the virtual operating environment. Next, a new view of the object to be displayed in the virtual operating environment is obtained in response to the converted operation instruction, and the new view is synchronized to the preset display window. In this way, while achieving a 3D display effect for the display object, the normal function of the display object can also be ensured.

[0107] In some embodiments, after the display device creates a virtual operating environment and a proxy display window for the target object in response to detecting a conversion instruction (i.e., S201), the display device may also delete the virtual operating environment and close the proxy display window in response to detecting an exit instruction instructing to stop converting the view screen of the target object from the initial dimension to the target dimension display.

[0108] For example, in combination with the display interface shown in FIG3 above, the display device can generate an exit instruction to stop converting the A application interface from two-dimensional display to three-dimensional display in response to the user's click operation on the exit three-dimensional display button 304, thereby detecting the exit instruction for the A application.

[0109] It is understandable that, in response to the dimensional conversion management of the view screen of the target object, the display device can construct a virtual operating environment and proxy display window for the target object in a targeted manner, and delete the virtual operating environment and proxy display window corresponding to the target object after the conversion is completed. In this way, for each display object that needs to be dimensional converted, the display device needs to create an adapted virtual operating environment and proxy display window for each display object that needs to be dimensional converted, and clear the virtual operating environment and proxy display window used by the historical display object after the conversion is completed, avoiding adaptation problems for subsequent objects that need to be dimensional converted, thereby improving the compatibility of the display object in 3D display on 3D devices.

[0110] In some embodiments, the display device may save a record of the dimensional conversion of the view screen of the target object in a preset log after deleting the virtual operating environment and closing the proxy display window.

[0111] In this way, by monitoring the dimension conversion process of the view screen, the historical objects involved in the dimension conversion can be recorded, thereby providing valuable reference for the subsequent management of the historical objects.

[0112] The following describes the view screen display method provided by the embodiments of the present disclosure, using examples. Based on a user operation instruction or a system detection request that triggers conversion of the target display content to 3D display, the display device moves the target display content to the virtual runtime environment of the 3D conversion service for execution. After receiving the output data of the application execution screen, the virtual runtime environment calls the 2D-to-3D conversion module to convert the application screen into a 3D display screen. Simultaneously, the 3D conversion service opens a screen display window to synchronously display the converted display content.

[0113] The display device then intercepts user action events in real time within the 3D display window. The 3D conversion service agent then relays the user actions to application A running in the virtual environment, completing the user control. This completes the conversion of application A from 2D to 3D display. The display and control of application A is now fully handled by the 3D conversion service agent, allowing the transition to 3D display without requiring any modifications to the application.

[0114] In an embodiment of the present disclosure, as shown in FIG5 , FIG5 shows an application conversion 3D display process, including:

[0115] The user opens application A that needs to be converted and selects to request that application A be converted to 3D display. For example, the user detects that a certain condition is met to trigger the 3D conversion service through a system switch, a floating window switch, or a 3D display device.

[0116] Next, the 3D conversion service in the 3D display device moves application A to a virtual environment for execution. For example, the 3D display device creates a virtual execution environment through the 3D conversion service and sets up a screen capture container for the virtual execution environment to obtain the display screen data of application A. The 3D display device then moves application A to the virtual environment for execution (the container to which the application process belongs during execution is switched to the virtual environment) and initializes the 3D screen display window for subsequent display of the converted 3D display screen.

[0117] Afterwards, the 3D display device obtains the real-time rendering data of application A. For example, when application A is running in a virtual operating environment, the 3D display device obtains the display screen data of application A in real time through the set data acquisition container and transmits the collected real-time screen data to the 2D to 3D processing module.

[0118] The 3D display device then calls the 2D-to-3D conversion module to convert the 2D real-time image data into 3D image data. For example, the 3D display device uses the 2D-to-3D conversion module to provide input and output buffers for data input and output. Once the 3D display device receives the application screen data to be converted, it passes it to the input buffer, where the 2D-to-3D conversion module completes the 3D conversion. The 2D-to-3D conversion module can be integrated into the 3D conversion service or pre-installed in the display device's operating system.

[0119] Afterwards, the 3D display device displays the 3D image data on the screen. For example, the 3D display device renders the data converted in step 5 onto the display window created in step 3 to complete the 3D image output display.

[0120] In some embodiments, as shown in FIG6 , the 3D display device can initialize a proxy display window and set a window event listener, thereby intercepting user operation events through the proxy display window and receiving operation events input by the user. The 3D display device can then parse and convert the operation events through the proxy control module and pass the parsed and converted operation events to the virtual operating environment (i.e., inject the events into the virtual operating environment). The 3D display device then distributes the events to application A, and application A responds to the operation events, completing proxy application control.

[0121] For example, after the proxy display window is initialized, the 3D display device sets a window event listener to listen for user operation events. Then, when the user touches or clicks the display window, the 3D display device intercepts the user operation event through the event listener, converts the intercepted operation event into an event that matches the virtual operating environment, repackages it, and forwards it to the virtual operating environment. Afterwards, the 3D display device receives the external injection event through the virtual operating environment, distributes the operation event to application A, and responds to the received operation event through application A according to its own logic, thereby completing the proxy control of application A in the virtual operating environment.

[0122] For example, let's say the 3D display device is an Android tablet. A user opens a video on the tablet. The 3D display device triggers a request to convert the video to 3D display. The user triggers the 3D conversion request by switching on the floating window and sending it to the 3D conversion service on the 3D display device.

[0123] The 3D display device uses the 3D conversion service to move the video to a virtual environment for execution. Upon receiving a request from the 3D conversion service, the 3D display device creates a virtual screen as a virtual execution environment. The 3D display device sets the virtual screen's display Surface as the image acquisition container for acquiring the application's display image data. Based on the 3D conversion service, the 3D display device uses moveTask to move the video task stack to the virtual screen for execution. The 3D display device then initializes the 3D surface view, which is used to display the converted 3D image.

[0124] Next, the 3D display device acquires the application's real-time rendering data. After the video runs in the virtual environment, the 3D display device acquires the video display data in real time through the configured Surface. The 3D display device then transmits the acquired real-time data to the 2D-to-3D processing module.

[0125] The 3D display device then calls the 2D-to-3D conversion module to convert the 2D real-time image data into 3D image data. The 2D-to-3D conversion module then provides the 3D display device with an inputSurface and an outputSurface for data input and output. Once the virtual runtime environment receives the image data to be converted, it passes it to the inputSurface, where the 2D-to-3D conversion module completes the 3D conversion. The 3D display device then displays the 3D image data on the screen.

[0126] Finally, the 3D display device renders the converted data output onto the created 3DSurfaceView to complete the 3D image display.

[0127] In addition, the 3D display device receives user input events through the proxy display window and transmits the events to the virtual runtime environment through the proxy control module, completing the proxy application control. After the 3D display device completes initialization of the proxy display window 3DSurfaceView, it sets a touch event listener. When the user clicks the video pause control button in the display window, the 3D display device receives the onTouch callback event through the listener. The 3D display device repackages the intercepted operation event, associates it with the virtual screen, and then injects it into the virtual screen. The 3D display device receives the externally injected touch event through the virtual screen and distributes the touch event to the video controller. After receiving the touch event through the video controller, the 3D display device triggers a click event and pauses the video playback to complete the operation response.

[0128] In some embodiments, for example, using application A as a game, the 3D display device enters 3D display mode either through a user-initiated conversion request or by automatically invoking a 3D conversion service based on system detection of pre-set conditions. For gaming scenarios, when the 3D display device detects that a user has opened a game, it can automatically invoke the 3D conversion service to convert the 2D game screen to 3D display, enhancing the user experience. Alternatively, the 3D conversion service can be automatically invoked upon startup to always convert the top-level application displayed on the screen to 3D, ensuring that all interfaces in the entire system are displayed in 3D.

[0129] It is understandable that, in order to realize the above functions, the view screen display device includes hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0130] The embodiment of the present disclosure can divide the view screen display device into functional modules according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical functional division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0131] In some embodiments, in combination with the system architecture diagram of the electronic device shown in FIG1 , the view screen display device may include: an operating environment management module 103 , a window management module 104 and a dimension conversion module 105 .

[0132] In response to detecting a start instruction to convert the target object's view from the initial dimension to the target dimension, a virtual operating environment is created for the target object by the operating environment management module 103, and a proxy display window is created for the target object by the window management module 104. The virtual operating environment is a virtual operating environment for running the target object that is isolated from the target object's real operating environment. The proxy display window is used to display the target object in the target object's real operating environment instead of the target object's display window. The target object is run in the virtual operating environment by the operating environment management module 103, and a view of the target object in the initial dimension is obtained. The view of the initial dimension is converted to a view of the target dimension by the dimension conversion module 105. The view of the target dimension is displayed in the proxy display window by the window management module 104.

[0133] In some embodiments, the display device may further include a proxy control module 106. After the window management module 104 displays the target dimension's view in the proxy display window, the window management module 104 obtains a target operation instruction for the target dimension's view in the proxy display window. The target operation instruction instructs a target object to execute a target event. The proxy control module 106 sends the target operation instruction to the target object and obtains a target view resulting from the target object's execution of the target event. The window management module 104 synchronizes the target view to the proxy display window for display.

[0134] The following describes the functional modules in the above-mentioned view screen display device by taking the display object 101 as application A and combining examples.

[0135] The runtime environment management module 103 can simulate the application runtime environment. When a user initiates a 3D conversion request for application A, it creates a virtual runtime environment and moves application A to this virtual environment for execution. (Moving to a virtual environment means changing the runtime container to which the application process belongs, switching the application process from its original runtime environment to the virtual runtime container.) Simultaneously, the runtime environment management module 103 collects and outputs real-time screen data from application A.

[0136] Dimension conversion module 105: can be used to realize 2D screen to 3D screen display. It receives the real-time 2D screen data of application A collected by the operating environment management module 103, converts the 2D screen into 3D screen data for output.

[0137] The window management module 104 can be used to output and display the 3D conversion results. It receives the 3D image data output by the dimension conversion module 105 and outputs it to the proxy display window in real time.

[0138] The proxy control module 106 can be used to receive user operation events in real time, pass the operation events to the virtual operating environment and distribute them to the converted application A to implement proxy control.

[0139] In some embodiments, FIG7 is a schematic diagram of the structure of a view image display device according to some embodiments. View image display device 700 can execute the view image display method shown in FIG2 and FIG4 in the above method embodiments. As shown in FIG7, view image display device 700 includes: an acquisition module 701 and a processing module 702.

[0140] Processing module 702 is used to create a virtual operating environment and a proxy display window for the target object in response to detecting an activation instruction to convert the target object's view screen from the initial dimension to the target dimension. The virtual operating environment is a virtual operating environment for running the target object that is isolated from the target object's real operating environment. The proxy display window is used to display the target object in the target object's real operating environment instead of the target object's display window. Processing module 702 is also used to run the target object in the virtual operating environment. Acquisition module 701 is used to acquire the target object's view screen of the initial dimension. Processing module 702 is also used to convert the view screen of the initial dimension to the view screen of the target dimension. Processing module 702 is also used to display the view screen of the target dimension in the proxy display window.

[0141] In some embodiments, the processing module 702 is further configured to set a picture collection container of the virtual operating environment, where the picture collection container is configured to obtain a view picture of an initial dimension of the target object.

[0142] In some embodiments, the start instruction is triggered by the user operating system setting a function switch or a user interface switch, or the start instruction is triggered by the system detecting that a preset condition is met.

[0143] In some embodiments, the initial dimension is higher than the target dimension, or alternatively, the initial dimension is lower than the target dimension.

[0144] In some embodiments, the view image display device 700 further includes a sending module 703. The acquisition module 701 is further configured to acquire a target operation instruction for a view image of a target dimension in the proxy display window. The target operation instruction is used to instruct a target object to execute a target event. The sending module 703 is further configured to send the target operation instruction to the target object. The acquisition module 701 is further configured to acquire a target view image obtained by the target object executing the target event. The processing module 702 is further configured to synchronize the target view image to the proxy display window for display.

[0145] In some embodiments, the acquisition module 701 is configured to acquire an initial operation instruction for a view of a target dimension, where the initial operation instruction is an operation instruction for a target object in a real operating environment. The processing module 702 is further configured to convert the initial operation instruction into an operation instruction for the target object in a virtual operating environment to obtain a target operation instruction.

[0146] In some embodiments, the processing module 702 is further configured to switch the target object running in the real running environment to the virtual running environment. The acquiring module 701 is configured to acquire a view image of an initial dimension displayed in a display window of the target object in the virtual running environment.

[0147] In some embodiments, the processing module 702 is configured to switch the target object's running container from a real running environment to a virtual running environment by modifying the running configuration parameters of the target object.

[0148] In some embodiments, the processing module 702 is further configured to delete the virtual operating environment and close the proxy display window in response to detecting an exit instruction indicating to stop converting the target object's view from the initial dimension to the target dimension.

[0149] In some embodiments, the display dimensions of the target view are initial dimensions. Processing module 702 is configured to convert the target view from the initial dimensions to the target dimensions to obtain a converted target view. Processing module 702 is further configured to display the converted target view in the proxy display window.

[0150] In the case of implementing the functions of the above-mentioned integrated modules in hardware, the embodiments of the present disclosure provide another network device structure for the view screen display device involved in the above-mentioned embodiments. As shown in Figure 8, the view screen display device 800 includes: a processor 802 and a bus 804. In some embodiments, the view screen display device 800 may also include a memory 801. In some embodiments, the view screen display device 800 may also include a communication interface 803.

[0151] The processor 802 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present disclosure. The processor 802 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processor 802 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present disclosure. The processor 802 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0152] The communication interface 803 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0153] The memory 801 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0154] As an implementation, the memory 801 may exist independently of the processor 802. The memory 801 may be connected to the processor 802 via a bus 804 and used to store instructions or program codes. When the processor 802 calls and executes the instructions or program codes stored in the memory 801, the view screen display method provided in the embodiment of the present disclosure can be implemented.

[0155] In another implementation, the memory 801 may also be integrated with the processor 802 .

[0156] Bus 804 can be an Extended Industry Standard Architecture (EISA) bus, etc. Bus 804 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG8 shows only one thick line, but this does not mean that there is only one bus or only one type of bus.

[0157] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the view screen display method described in any of the above embodiments.

[0158] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0159] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the view screen display method described in any one of the above embodiments.

[0160] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A method for displaying a view image, comprising: In response to detecting a start instruction to convert a view of a target object from an initial dimension to a target dimension, creating a virtual operating environment and a proxy display window for the target object; wherein the virtual operating environment is a virtual operating environment for operating the target object that is isolated from a real operating environment of the target object; and the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object. Running the target object in the virtual running environment, and obtaining a view picture of the initial dimension of the target object; Converting the view frame of the initial dimension to the view frame of the target dimension; The view screen of the target dimension is displayed in the agent display window.

2. The method according to claim 1, wherein The step of running the target object in the virtual running environment and obtaining the initial dimension view of the target object includes: A picture acquisition container of the virtual operating environment is set, where the picture acquisition container is used to obtain a view picture of the initial dimension of the target object.

3. The method according to claim 1, wherein The start instruction is triggered by the user operating system setting a function switch or a user interface switch, or the start instruction is triggered by the system detecting that a preset condition is met.

4. The method according to claim 1, wherein The initial dimension is higher than the target dimension, or the initial dimension is lower than the target dimension.

5. The method according to claim 1, wherein After displaying the view picture of the target dimension in the agent display window, the method further includes: Acquire a target operation instruction for the view picture of the target dimension in the proxy display window, wherein the target operation instruction is used to instruct the target object to execute a target event; Sending the target operation instruction to the target object, and obtaining the target view screen obtained by the target object by executing the target event; The target view screen is synchronized to the agent display window for display.

6. The method according to claim 5, wherein: The acquiring of the target operation instruction for the view picture of the target dimension in the agent display window includes: Acquire an initial operation instruction for the view screen of the target dimension, where the initial operation instruction is an operation instruction for the target object in the real operating environment; The initial operation instruction is converted into an operation instruction for the target object in the virtual operating environment to obtain the target operation instruction.

7. The method according to claim 1, wherein Before executing the target object in the virtual execution environment, the method further includes: Switching the target object running in the real operating environment to the virtual operating environment; The obtaining of the initial dimension view of the target object includes: Acquire a view picture of the initial dimension displayed in a display window of the target object in the virtual operating environment.

8. The method according to claim 7, wherein: The switching the target object running in the real operating environment to the virtual operating environment includes: By modifying the running configuration parameters of the target object, the running container of the target object is switched from the real running environment to the virtual running environment.

9. The method according to claim 1, further comprising: In response to detecting an exit instruction indicating to stop converting the target object's view from the initial dimension to the target dimension, the virtual execution environment is deleted and the agent display window is closed.

10. The method according to claim 5, wherein The display dimension of the target view picture is the initial dimension; The step of synchronizing the target view screen to the proxy display window for display includes: Converting the target view picture from the initial dimension to the target dimension to obtain the converted target view picture; The converted target view screen is displayed in the proxy display window.

11. A method for displaying a view image, wherein: The method is applied to a display device, and the display device includes: an operating environment management module, a window management module and a dimension conversion module; In response to detecting a start instruction to convert a view of a target object from an initial dimension to a target dimension, a virtual operating environment is created for the target object by the operating environment management module, and a proxy display window is created for the target object by the window management module; wherein the virtual operating environment is a virtual operating environment for operating the target object that is isolated from the real operating environment of the target object; and the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object; Run the target object in the virtual operating environment by the operating environment management module, and obtain the view picture of the initial dimension of the target object; Converting the view picture of the initial dimension into the view picture of the target dimension by the dimension conversion module; The view frame of the target dimension is displayed in the agent display window through the window management module.

12. The method according to claim 11, wherein The display device further includes: an agent control module; After displaying the view picture of the target dimension in the agent display window by the window management module, the method further includes: Acquiring, through the window management module, a target operation instruction for the view screen of the target dimension in the proxy display window, wherein the target operation instruction is used to instruct the target object to execute a target event; Sending the target operation instruction to the target object through the proxy control module, and obtaining the target view screen obtained by the target object by executing the target event; The target view screen is synchronized to the proxy display window for display through the window management module.

13. An electronic device comprising: memory and processor; The memory is coupled to the processor; The memory is used to store instructions executable by the processor; When the processor executes the instructions, the method according to any one of claims 1 to 12 is performed.

14. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer instructions, which, when executed on a computer, enable the computer to perform the method according to any one of claims 1 to 12.

Images