View picture display method and device, equipment and storage medium

Abstract

The invention provides a view picture display method and device, equipment and a storage medium, relates to the technical field of image display, and is used for solving the problem that the compatibility of 3D display of a display object in 3D equipment is poorer, and the method comprises the following steps: responding to a detected starting instruction for converting a view picture of a target object from an initial dimension to target dimension display; and creating a virtual operation environment and a proxy display window for the target object. Wherein the virtual operation environment is a virtual operation environment which is isolated from a real operation environment of the target object and is used for operating the target object. The proxy display window is used for replacing the display window of the target object to display the target object in the real operation environment of the target object. And running the target object in the virtual running environment, and obtaining a view picture of the initial dimension of the target object. And converting the view picture of the initial dimension into a view picture of the target dimension. And displaying the view picture of the target dimension in the proxy display window.

Description

Technical Field

[0001] The present disclosure relates to the field of image display technology, and in particular to a method, apparatus, device, and storage medium for displaying a view image. Background Art

[0002] With the development of three-dimensional (3D) technology, more and more display devices support naked-eye 3D display effects, which can present some display objects on the display device in 3D images. Taking commonly used applications (APPs) as an example, in the existing technology, APPs need to complete the integration of 3D display functions to modify the 3D display function according to whether the device supports 3D display characteristics in order to achieve the effect of displaying 3D images.

[0003] However, the vast number of apps and various display content (such as operating systems, desktop icons, video content, and game content) on display devices currently require extensive modifications and adaptations, resulting in a massive development workload. Therefore, improving the compatibility of display objects on 3D devices and enabling 3D display quickly and conveniently has become a pressing issue. Summary of the Invention

[0004] Embodiments of the present disclosure provide a view image display method, apparatus, device, and storage medium for solving the problem of poor compatibility of 3D display of display objects in 3D devices.

[0005] In one aspect, a view screen display method is provided, comprising: in response to detecting an instruction to convert a view screen of a target object from an initial dimension to a target dimension, creating a virtual operating environment and a proxy display window for the target object. The virtual operating environment is a virtual operating environment for operating the target object that is isolated from the target object's actual operating environment. The proxy display window is used to display the target object in the target object's actual operating environment, replacing the target object's display window. The target object is executed in the virtual operating environment, and a view screen of the target object in the initial dimension is obtained. The view screen of the initial dimension is converted to a view screen of the target dimension. The view screen of the target dimension is displayed in the proxy display window.

[0006] On the other hand, a view screen display method is provided, which is applied to a display device, wherein the display device includes: an operating environment management module, a window management module, and a dimension conversion module. The method includes: in response to detecting an activation instruction to convert the view screen of a target object from an initial dimension to a target dimension, creating a virtual operating environment for the target object through the operating environment management module, and creating a proxy display window for the target object through the window management module. The virtual operating environment is a virtual operating environment for running the target object that is isolated from the real operating environment of the target object. The proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object. The target object is run in the virtual operating environment through the operating environment management module, and a view screen of the initial dimension of the target object is obtained. The view screen of the initial dimension is converted into a view screen of the target dimension through the dimension conversion module. The view screen of the target dimension is displayed in the proxy display window through the window management module.

[0007] On the other hand, a view image display device is provided, which includes: a processing module and an acquisition module.

[0008] A processing module is configured to, in response to detecting an instruction to start converting the target object's view from an initial dimension to a target dimension, create a virtual operating environment and a proxy display window for the target object. The virtual operating environment is a virtual operating environment for operating the target object that is isolated from the target object's real operating environment. The proxy display window is configured to display the target object in the target object's real operating environment, replacing the target object's display window. The processing module is further configured to operate the target object in the virtual operating environment. An acquisition module is configured to acquire the target object's view of the initial dimension. The processing module is further configured to convert the view of the initial dimension to the view of the target dimension. The processing module is further configured to display the view of the target dimension in the proxy display window.

[0009] In yet another aspect, an electronic device is provided, comprising: a memory and a processor. The memory and the processor are coupled. The memory is configured to store a computer program. When the processor executes the computer program, the view screen display method of any of the above embodiments is implemented.

[0010] On the other hand, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the view screen display method of any of the above embodiments is implemented.

[0011] On the other hand, a computer program product is provided, which includes computer program instructions, and when the computer program instructions are executed by a processor, the view screen display method of any of the above embodiments is implemented.

[0012] In the disclosed embodiments, the object to be displayed is isolated in a virtual operating environment, and a view of the object in that virtual operating environment is obtained. This view is then converted to a 3D display effect and displayed via a pre-defined display window proxy, allowing the 3D device to directly present the 3D view. This avoids the need to modify or adapt the display process within the object, improving the compatibility of the object with 3D displays on 3D devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0014] Figure 1 A system architecture diagram of an electronic device provided in some embodiments of the present disclosure;

[0015] Figure 2 A flowchart of a view image display method provided in some embodiments of the present disclosure;

[0016] Figure 3 A schematic diagram of an example of an application display interface provided in some embodiments of the present disclosure;

[0017] Figure 4 A flowchart of another method for displaying a view screen provided in some embodiments of the present disclosure;

[0018] Figure 5 A schematic diagram of an example of an application conversion 3D display process provided in some embodiments of the present disclosure;

[0019] Figure 6 A schematic diagram of an example of proxy application control provided in some embodiments of the present disclosure;

[0020] Figure 7 A schematic structural diagram of a view image display device provided in some embodiments of the present disclosure;

[0021] Figure 8 A structural diagram of a view image display device provided in some embodiments of the present disclosure. DETAILED DESCRIPTION

[0022] The following will clearly and completely describe the technical solutions of this disclosure in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this disclosure, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of this disclosure without making any creative efforts shall fall within the scope of protection of this disclosure.

[0023] It should be noted that in this disclosure, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0024] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the quantity of the technical features indicated. Therefore, a feature specified as "first" or "second" may explicitly or implicitly include one or more of the features.

[0025] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" in this document simply describes an association relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A exists alone, A and B exists simultaneously, and B exists alone. Furthermore, "at least one" means one or more, and "a plurality" means two or more.

[0026] Before introducing the view image display method provided by the embodiment of the present disclosure in detail, the implementation environment and application scenarios of the embodiment of the present disclosure are first introduced.

[0027] First, the application scenarios of the embodiments of the present disclosure are introduced.

[0028] Currently, the views displayed by 3D devices (i.e., display devices that support 3D display) are all the views displayed by the application's own display window within the 3D device. In other words, the 3D views displayed by 3D devices are all the 3D views displayed by the application's own display window within the 3D device. The 3D display effects of applications on 3D devices are mostly dependent on modifications and adaptations made to the application itself.

[0029] For example, if a video player app needs to convert the video it plays to 3D, it needs to be modified to include logic for reading system properties. If the device supports 3D display, the app needs to adapt the playback and display process, integrating 2D to 3D conversion before the image is rendered. Modifying all existing third-party apps would be a significant workload, and device manufacturers cannot force app developers to adapt to 3D display features.

[0030] That is to say, in the prior art, on devices that support 3D display, taking the APP commonly used by users as an example, the APP needs to complete the 3D display function integration modification based on the characteristics of whether the device supports 3D display in order to achieve the effect of displaying 3D pictures. For example, on different devices, the APP needs to read the system property configuration of whether the current device supports 3D display. If the system property flag does not support 3D display, the APP keeps the original logic unchanged. If the system property flag supports 3D display, the APP needs to implement the corresponding 3D display logic modification to display the application screen in 3D. In this way, the current methods of displaying 3D effects in applications are all achieved by integrating the corresponding functional modules in the APP itself and adapting and modifying the 3D device.

[0031] However, among the multiple applications installed on 3D devices, some applications do not support the display of 3D view images. In order to make some applications compatible with 3D display in 3D devices, it is usually necessary to rely on the support of application developers, modify the playback and display process of the adapted application, and integrate the 2D to 3D function before the image is presented, so that the modified and adapted application can directly display the 3D view image through its own display window. In this way, if there are a large number of applications that need to be modified and adapted, it may cause a huge workload of adaptation, and there are many restrictions between different applications. Therefore, there is an urgent need for a universal and effective method that can realize the conversion of general applications from 2D effects to 3D effects.

[0032] In order to solve the above problems, the embodiment of the present disclosure provides a view screen display method, which is applied to the scenario where a terminal with a naked-eye 3D display screen displays a 3D screen, and is used to solve the problem that the display content on the terminal (such as APP, operating system, video, game, etc.) needs to be additionally developed and adapted on the 3D display device to present a 3D display effect. The present disclosure implements a general 2D to 3D proxy service method. When the display content on the terminal (including APP, desktop icons, video content on APP, game content, etc.) needs to be presented in 3D, the display screen can be converted from 2D to 3D by using the 3D conversion method of the present disclosure. The entire conversion process does not require any modification to the converted content in advance. Even third-party applications installed on the terminal do not need to make any modifications to present the APP screen in 3D effect, avoiding the process of application adaptation to 3D devices. The present disclosure expands the number of applications that support 3D display on 3D devices, and can support the conversion of 2D screens of content running in a virtual environment into 3D naked-eye screen display effects. This case has strong versatility and high use value. In other words, this disclosure adopts a universal solution, implementing a universal 3D conversion proxy service to complete the corresponding conversion adaptation work, so that applications can adapt to 3D functions without modification. There is no need for third-party application adaptation development, the promotion restrictions are small, and the use scenarios are more extensive.

[0033] The implementation environment of the embodiments of the present disclosure is introduced below.

[0034] like Figure 1 , which is a system architecture diagram of an electronic device provided by an embodiment of the present disclosure, the electronic device 100 may include: an object to be displayed 101 and a screen conversion service module 102 .

[0035] The screen conversion service module 102 includes: an operating environment management module 103 , a window management module 104 , a dimension conversion module 105 and an agent control module 106 .

[0036] In the embodiment of the present disclosure, the operating environment management module 103 is used to manage the operating environment of the display object and collect view images of the display object in different operating environments.

[0037] The window management module 104 is used to manage the display window of the display object in the real running environment of the display object.

[0038] The dimension conversion module 105 is used to convert a view picture from a two-dimensional display to a three-dimensional display, or to convert a view picture from a three-dimensional display to a two-dimensional display.

[0039] The proxy control module 106 is used to convert operation instructions of different operating environments.

[0040] As one possible implementation, in response to a user input instruction for 3D display of the object 101 to be displayed, the electronic device 100 can isolate a virtual operating environment for the object 101 to simulate its operation, outside of the object's actual operating environment, through the operating environment management module 103 within the screen conversion service module 102. Furthermore, the window management module 104 within the screen conversion service module 102 can create a proxy display window within the object's actual operating environment to replace the display of the object's view. Subsequently, the electronic device 100 can migrate the object 101 from its actual operating environment to the virtual operating environment through the operating environment management module 103 and capture a 2D view of the object 101 running in the virtual operating environment. Subsequently, the electronic device 100 can convert the 2D view into a 3D view through the dimension conversion module 105 within the screen conversion service module 102, and display the 3D view through the proxy display window created by the window management module 104.

[0041] Optionally, after the proxy display window displays the 3D view, the electronic device 100 can receive, via the window management module 104, an initial operation instruction input by the user into the 3D view in the proxy display window, for instructing the object to be displayed 101 to execute a target event in the real operating environment. Subsequently, the electronic device 100 can, via the proxy control module 106 in the screen conversion service module 102, convert the initial operation instruction into a target operation instruction for instructing the object to be displayed 101 to execute the target event in the virtual operating environment, and send the target operation instruction to the object to be displayed 101 in the virtual operating environment. Thereafter, the electronic device 100 can obtain the target view obtained by the object to be displayed 101 executing the target event, and synchronize the target view to the proxy display window for display.

[0042] It should be noted that the present embodiment does not limit the object to be displayed 101. For example, the object to be displayed 101 may be an app. For another example, the object to be displayed 101 may be a desktop icon. For another example, the object to be displayed 101 may be video content, game content, etc. on an app.

[0043] In the embodiment of the present disclosure, the electronic device 100 may be a terminal device supporting naked-eye 3D display, and its display screen includes a flat, curved, or flexible display screen.

[0044] The terminal may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook computer, or other device with transceiver functions. The embodiments of the present disclosure do not impose any particular restrictions on the specific form of the terminal. The terminal may interact with the user through one or more methods such as a keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0045] After introducing the application scenario and implementation environment of the embodiment of the present disclosure, the view screen display method provided by the embodiment of the present disclosure is introduced in detail below in combination with the above implementation environment.

[0046] The present disclosure provides a method for displaying a view image. Figure 2 As shown, the view screen display method may include: S201-S204.

[0047] S201 : In response to detecting a start instruction to convert a view screen of a target object from an initial dimension to a target dimension, create a virtual operating environment and an agent display window for the target object.

[0048] The virtual operating environment is a virtual operating environment that is isolated from the real operating environment of the target object and is used to run the target object.

[0049] It should be noted that a virtual runtime environment (VRE) is an independent operating system environment created through software simulation on computer hardware. In this environment, users can install and run systems, applications, and services that are different from the host operating system.

[0050] For example, common virtual operating environment technologies include VMware, VirtualBox, Hyper-V, KVM (Kernel-based Virtual Machine) and Docker containers.

[0051] A real runtime environment is an environment where software or programs execute directly on actual hardware devices, without any virtualization technology involved. In this environment, the operating system, applications, and all related system resources interact directly with the physical hardware.

[0052] For example, if you install and run a Windows or Linux operating system directly on a computer without any virtual machine software installed, the operating system is running in a real operating environment. Applications in this environment can directly access and use all CPU, memory, hard disk, and other hardware resources, and performance is not affected by the additional overhead of the virtualization layer.

[0053] As a possible implementation, the display device is deployed with a screen conversion service module, which may include an operating environment management module. When the display device creates a virtual operating environment for the target object, the display device can create a virtual operating environment for the target object through the operating environment management module.

[0054] Regarding the process of the display device creating a virtual operating environment for the target object in the embodiment of the present disclosure, reference may be made to the description of creating a virtual operating environment through software simulation in the prior art, which will not be described in detail here.

[0055] In the embodiment of the present disclosure, the proxy display window is used to replace the display window of the target object in displaying the view screen of the target object in the real operating environment of the target object, and the display window of the target object displays the view screen of the target object in the virtual operating environment.

[0056] That is to say, the proxy display window can replace the original display window of the target object, receive and display the view screen of the target object, and then display the screen in the real operating environment, while the original display window of the target object receives and displays the view screen of the target object in the virtual operating environment.

[0057] Optionally, the proxy display window may intercept the view screen of the target object and display the view screen of the target object instead of the display window of the target object, and the display window of the target object does not display the view screen of the target object.

[0058] As a possible implementation, the screen conversion service module may further include: a window management module. When the display device creates a proxy display window for the target object, the display device may create a proxy display window for the target object through the window management module.

[0059] It should be noted that in computer graphics and user interface design, a display window generally refers to the specific area used by an application or operating system to present images, text, or other visual content. It is a rectangular area, which can be the entire screen or a portion of the screen, used to receive and display data output from the application.

[0060] For the process of the display device creating a proxy display window for the target object in the embodiment of the present disclosure, reference may be made to the description of creating a display window in the prior art, which will not be described in detail here.

[0061] It should be noted that the embodiments of the present disclosure do not limit the target object. For example, the target object may be an app. For another example, the target object may be a desktop icon. For another example, the target object may be video content, game content, etc. on an app.

[0062] It should be noted that, in the embodiments of the present disclosure, the initial dimension may be higher than the target dimension, or the initial dimension may be lower than the target dimension.

[0063] Exemplarily, the initial dimension is 2D and the target dimension is 3D. Alternatively, the initial dimension is 3D and the target dimension is 2D.

[0064] That is, the embodiment of the present disclosure can not only display the original view picture in reduced dimension, but also display the original view picture in increased dimension, thereby expanding the application scenarios of view picture display.

[0065] In the embodiment of the present disclosure, the activation instruction may be triggered by a function switch set by the user operating system or a user interface switch.

[0066] As a possible implementation, the display device may receive a switch operation input by the user to the screen conversion service module in the system setting function (or user interface) while the target object is running in a real operating environment, thereby triggering the generation of a start instruction.

[0067] It should be noted that the embodiments of the present disclosure do not limit the display method of the screen conversion service module. For example, the screen conversion service module can be displayed via a floating window or a floating ball. For another example, the screen conversion service module can be displayed via a drop-down panel. For another example, the screen conversion service module can be displayed via a settings option.

[0068] For example, Figure 3 As shown, display device 300 displays application A's interface (i.e., the target object's view) via display window 301 of application A, and displays a floating window 302 for the screen conversion service on display window 301. Display window 302 includes a switch to 3D display button 303 and an exit 3D display button 304. Display device 300 can generate a conversion instruction to convert application A's interface from 2D to 3D display in response to a user clicking switch to 3D display button 303, thereby detecting the conversion instruction for application A.

[0069] As another possible implementation, the display device may receive a switch operation input by the user in the screen conversion service module when the target object is not running in the real running environment, thereby detecting a conversion instruction for the target object.

[0070] For example, combined Figure 3 When the display device is started, it can display Figure 3 A floating window 302 is shown.

[0071] That is to say, the display device can perform dimension conversion on the view screen of the object to be displayed when the object to be displayed is in different operating states, thereby improving the operability of the view screen display.

[0072] Optionally, the start instruction may be triggered by the system (ie, the display device) detecting that a preset condition is met.

[0073] It should be noted that the embodiments of the present disclosure do not limit the preset conditions. For example, the preset condition may be whether the object to be displayed is authorized for dimensional conversion. For another example, the preset condition may be whether the idle computing resources in the system are sufficient to perform dimensional conversion on the object to be displayed. For another example, the preset condition may be whether the object to be displayed has a history of dimensional conversion.

[0074] That is to say, the display device can trigger the opening instruction in a manual or automatic manner. In this way, the operability of the view picture display can be improved.

[0075] S202: Run the target object in the virtual running environment, and obtain a view picture of the initial dimension of the target object.

[0076] In the embodiment of the present disclosure, the display device may run the target object in the virtual running environment through the running environment management module.

[0077] It should be noted that, before the target object is run in the virtual running environment, the display device may execute a corresponding management policy on the target object according to the running state of the target object.

[0078] As a possible implementation, when the target object is in operation in the real operation environment, the display device may switch the target object running in the real operation environment to the virtual operation environment, and then run the target object in the virtual operation environment.

[0079] Optionally, the display device switches the target object's running container from a real running environment to a virtual running environment by modifying the running configuration parameters of the target object.

[0080] That is, switching the target object (such as an application process) to the virtual runtime environment means changing the runtime container to which the target object belongs, switching the target object from the original runtime environment (ie, the real runtime environment) to the runtime container corresponding to the virtual runtime environment.

[0081] As another possible implementation, when the target object is not in the running state in the real running environment, the display device may start the target object in the virtual running environment, and then run the target object in the virtual running environment.

[0082] In an embodiment of the present disclosure, the display device may obtain a view picture of an initial dimension displayed by a display window of a target object in a virtual operating environment through an operating environment management module.

[0083] As one possible implementation, the display device can set a virtual operating environment image capture container in the operating environment management module. The image capture container is used to obtain a view of the target object in its initial dimensions. The display device can then use the image capture container in the environment management module to obtain a view of the target object in its initial dimensions running in the virtual operating environment.

[0084] S203: Convert the view picture of the initial dimension into the view picture of the target dimension.

[0085] As a possible implementation, the screen conversion service module may further include: a dimension conversion module. The display device may convert the view screen of the initial dimension into the view screen of the target dimension through the dimension conversion module.

[0086] It should be noted that, for the process of converting the initial dimension view screen to the target dimension view screen by the display device in the embodiment of the present disclosure, reference may be made to the description of the dimensional conversion of the image in the prior art, which will not be repeated here.

[0087] S204: Display the view screen of the target dimension in the agent display window.

[0088] As a possible implementation manner, the display device may obtain the view picture of the target dimension output by the dimension conversion module through the window management module, and display the view picture of the target dimension in the proxy display window through the window management module.

[0089] It can be understood that by isolating the object to be displayed in a virtual operating environment, a view of the object to be displayed in the virtual operating environment is obtained. This view is then converted to a 3D display effect and displayed through a pre-set display window proxy, allowing the 3D device to directly present the view in 3D. This avoids modifying and adapting the display process of the display object, improving the compatibility of the 3D display of the object on 3D devices.

[0090] In some embodiments, as Figure 4 As shown, after S204, the view screen display method may further include: S401-S404.

[0091] S401: Obtain a target operation instruction for a view screen of a target dimension in an agent display window.

[0092] The target operation instruction is used to instruct the target object to execute the target event.

[0093] For example, when the target object is a video playback APP, the target operation instruction may be an operation instruction for instructing the video playback APP to pause playback (i.e., the target event), or the target operation instruction may be an operation instruction for instructing the video playback APP to fast forward playback.

[0094] Alternatively, the target operation instruction may be an operation instruction for instructing the video playback APP to jump to the 3 minute 12 second playback.

[0095] As a possible implementation manner, the display device may obtain, through the window management module, the target operation instruction input by the user to the view picture of the target dimension in the agent display window.

[0096] As one possible implementation, the display device stores a preset correspondence between a plurality of first preset operating instructions in the real operating environment and a plurality of second preset operating instructions in the virtual operating environment. The display device can obtain a user's initial operating instruction for a view of a target dimension, where the initial operating instruction is an operating instruction for a target object in the real operating environment. The display device can then convert the initial operating instruction into an operating instruction for the target object in the virtual operating environment based on the preset correspondence to obtain the target operating instruction.

[0097] It should be noted that the event to be executed indicated by the first preset operation instruction is the same as the event to be executed indicated by the corresponding second preset operation instruction, and there is a difference in format between the first preset operation instruction and the corresponding second preset operation instruction.

[0098] Exemplarily, the preset correspondences in the display device may include: a correspondence A between operation instruction A1 (i.e., a first preset operation instruction) and operation instruction A2 (i.e., a second preset operation instruction), a correspondence B between operation instruction B1 and operation instruction B2, and a correspondence C between operation instruction C1 and operation instruction C2. Operation instructions A1 and A2 both indicate event A, operation instructions B1 and B2 both indicate event B, and operation instructions C1 and C2 both indicate event C. Operation instructions A1, B1, and C1 are all instructions in format A, and operation instructions A2, B2, and C2 are all instructions in format B. If the user's initial operation instruction on the 3D viewing image is operation instruction B1, the display device may determine, based on correspondence B, that the target operation instruction is operation instruction B2.

[0099] As a possible implementation, the screen conversion service module may further include: an agent control module. When the display device converts the initial operation instruction into the target operation instruction, the display device may convert the initial operation instruction into the target operation instruction through the agent control module.

[0100] S402: Send a target operation instruction to the target object.

[0101] As a possible implementation manner, the display device may send a target operation instruction to a target object running in the virtual running environment.

[0102] Optionally, in the process of the display device sending the target operation instruction to the target object, the display device may send the target operation instruction to the target object through the agent control module.

[0103] S403: Acquire the target view screen obtained by executing the target event of the target object.

[0104] As a possible implementation method, the display device can respond to the target operation event through the target object, execute the target event, and display the target view screen in the virtual operating environment through the display window of the target object, and obtain the target view screen through the environment management module.

[0105] S404: Synchronize the target view image to the proxy display window for display.

[0106] In the embodiment of the present disclosure, the display dimensions of the target view image are the initial dimensions. When the display device synchronizes the target view image to the proxy display window for display, the display device may convert the target view image from the initial dimensions to the target dimensions to obtain the converted target view image, and display the converted target view image in the proxy display window.

[0107] Optionally, in the process of the display device performing dimensional conversion on the target view picture, the display device may perform dimensional conversion on the target view picture through a dimensional conversion module to obtain a converted target view picture.

[0108] Similarly, in the process of the display device displaying the converted target view picture in the proxy display window, the display device can obtain the converted target view picture output by the dimension conversion module through the window management module, and display the converted target view picture in the proxy display window through the window management module.

[0109] It is understood that after receiving a user's operation instruction for the converted view, the operation instruction is converted into an instruction that matches the virtual operating environment to obtain the converted operation instruction, and the converted operation instruction is injected into the object to be displayed in the virtual operating environment. Next, a new view of the object to be displayed in the virtual operating environment is obtained in response to the converted operation instruction, and the new view is synchronized to the preset display window. In this way, while achieving a 3D display effect for the display object, the normal function of the display object can also be ensured.

[0110] In some embodiments, after the display device creates a virtual operating environment and a proxy display window for the target object in response to detecting a conversion instruction (i.e., S201), the display device may also delete the virtual operating environment and close the proxy display window in response to detecting an exit instruction instructing to stop converting the view screen of the target object from the initial dimension to the target dimension display.

[0111] For example, in combination with the above Figure 3 As shown in the display interface, the display device can generate an exit instruction to stop converting the A application interface from two-dimensional display to three-dimensional display in response to the user clicking the exit three-dimensional display button 304, thereby detecting the exit instruction for the A application.

[0112] It is understood that, in response to the dimensional conversion management of the view screen of the target object, the display device can specifically build a virtual operating environment and proxy display window for the target object, and delete the virtual operating environment and proxy display window corresponding to the target object after the conversion is completed. In this way, for each display object that needs to undergo dimensional conversion, the display device needs to create an adapted virtual operating environment and proxy display window for it, and clear the virtual operating environment and proxy display window used by the historical display object after the conversion is completed, avoiding adaptation issues for subsequent objects that need to undergo dimensional conversion, thereby improving the compatibility of the display object in 3D display on 3D devices.

[0113] Optionally, the display device may save a record of the dimensional conversion of the view screen of the target object in a preset log after deleting the virtual operating environment and closing the proxy display window.

[0114] In this way, by monitoring the dimension conversion process of the view screen, the historical objects involved in the dimension conversion can be recorded, thereby providing valuable reference for the subsequent management of historical objects.

[0115] The following describes the view screen display method provided by the embodiments of the present disclosure, using specific examples. Based on a user operation instruction or a system detection request that triggers conversion of the target display content to 3D display, the display device moves the target display content to the virtual runtime environment of the 3D conversion service for execution. After receiving the output data of the application execution screen, the virtual runtime environment calls the 2D-to-3D conversion module to convert the application screen into a 3D display screen. Simultaneously, the 3D conversion service opens a screen display window to synchronously display the 3D-converted display content.

[0116] The display device then intercepts user action events in real time within the 3D display window. The 3D conversion service agent then relays the user actions to application A running in the virtual environment, completing the user control. This completes the conversion of application A from 2D to 3D display. The display and control of application A is now fully handled by the 3D conversion service agent, allowing the transition to 3D display without requiring any modifications to the application.

[0117] In the embodiment of the present disclosure, Figure 5 As shown, it shows the application conversion 3D display process, including:

[0118] The user opens application A that needs to be converted and selects to request that application A be converted to 3D display. For example, the user detects that a certain condition is met to trigger the 3D conversion service through a system switch, a floating window switch, or a 3D display device.

[0119] Next, the 3D conversion service in the 3D display device moves application A to a virtual environment for execution. For example, the 3D display device creates a virtual execution environment through the 3D conversion service and sets up a screen capture container for the virtual execution environment to obtain the display screen data of application A. The 3D display device then moves application A to the virtual environment for execution (the container to which the application process belongs during execution is switched to the virtual environment) and initializes the 3D screen display window for subsequent display of the converted 3D display screen.

[0120] Afterwards, the 3D display device obtains the real-time rendering data of application A. For example, when application A is running in a virtual operating environment, the 3D display device obtains the display screen data of application A in real time through the set data acquisition container and transmits the collected real-time screen data to the 2D to 3D processing module.

[0121] The 3D display device then calls the 2D-to-3D conversion module to convert the 2D real-time image data into 3D image data. For example, the 3D display device uses the 2D-to-3D conversion module to provide input and output buffers for data input and output. Once the 3D display device receives the application screen data to be converted, it passes it to the input buffer, where the 2D-to-3D conversion module completes the 3D conversion. The 2D-to-3D conversion module can be integrated into the 3D conversion service or pre-installed in the display device's operating system.

[0122] Afterwards, the 3D display device displays the 3D image data on the screen. For example, the 3D display device renders the data converted in step 5 onto the display window created in step 3 to complete the 3D image output display.

[0123] Optional, such as Figure 6 As shown, the 3D display device can initialize a proxy display window and set a window event listener. This allows the proxy display window to intercept user operation events and receive user input. The 3D display device can then parse and convert the operation events through the proxy control module and pass the parsed and converted operation events to the virtual runtime environment (i.e., inject the events into the virtual runtime environment). The 3D display device then distributes the events to application A, which responds to the operation events through application A, completing proxy application control.

[0124] Specifically, after the proxy display window is initialized, the 3D display device sets a window event listener to listen for user operation events. Then, when the user touches or clicks the display window, the 3D display device intercepts the user operation event through the event listener, converts the intercepted operation event into an event that matches the virtual operating environment, repackages it, and forwards it to the virtual operating environment. Afterwards, the 3D display device receives the external injection event through the virtual operating environment, distributes the operation event to application A, and responds to the received operation event through application A according to its own logic, thereby completing the proxy control of application A in the virtual operating environment.

[0125] For example, let's say the 3D display device is an Android tablet. A user opens a video on the tablet. The 3D display device triggers a request to convert the video to 3D display. The user triggers the 3D conversion request by switching on the floating window and sending it to the 3D conversion service on the 3D display device.

[0126] The 3D display device uses the 3D conversion service to move the video to a virtual environment for execution. Upon receiving a request from the 3D conversion service, the 3D display device creates a virtual screen as a virtual execution environment. The 3D display device sets the virtual screen's display Surface as the image acquisition container for acquiring the application's display image data. Based on the 3D conversion service, the 3D display device uses moveTask to move the video task stack to the virtual screen for execution. The 3D display device then initializes the 3D surface view, which is used to display the converted 3D image.

[0127] Next, the 3D display device acquires the application's real-time rendering data. After the video runs in the virtual environment, the 3D display device acquires the video display data in real time through the configured Surface. The 3D display device then transmits the acquired real-time data to the 2D-to-3D processing module.

[0128] The 3D display device then calls the 2D-to-3D conversion module to convert the 2D real-time image data into 3D image data. The 2D-to-3D conversion module then provides the 3D display device with an inputSurface and an outputSurface for data input and output. Once the virtual runtime environment receives the image data to be converted, it passes it to the inputSurface, where the 2D-to-3D conversion module completes the 3D conversion. The 3D display device then displays the 3D image data on the screen.

[0129] Finally, the 3D display device renders the converted data output onto the created 3DSurfaceView to complete the 3D image display.

[0130] In addition, the 3D display device receives user input events through the proxy display window and transmits the events to the virtual runtime environment through the proxy control module, completing the proxy application control. After the 3D display device completes initialization of the proxy display window 3DSurfaceView, it sets a touch event listener. When the user clicks the video pause control button in the display window, the 3D display device receives the onTouch callback event through the listener. The 3D display device repackages the intercepted operation event, associates it with the virtual screen, and then injects it into the virtual screen. The 3D display device receives the externally injected touch event through the virtual screen and distributes the touch event to the video controller. After receiving the touch event through the video controller, the 3D display device triggers a click event and pauses the video playback to complete the operation response.

[0131] Optionally, taking application A as a game, the 3D display device enters the 3D display state through the user's active conversion request or automatically calling the 3D conversion service after the system detects that preset conditions are met. For gaming scenarios, when the 3D display device detects that the user has opened a game, the 3D display device can automatically call the 3D conversion service to convert the 2D game screen to 3D display to enhance the user experience. The 3D conversion service can also be automatically called when the 3D display device is started, and the top application displayed on the screen is always converted to 3D, so that all interfaces of the entire system are displayed in 3D effects.

[0132] It is understandable that, in order to realize the above functions, the view screen display device includes hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0133] The embodiment of the present disclosure can divide the view screen display device into functional modules according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical functional division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0134] In some embodiments, combined Figure 1 As shown in the system architecture diagram of the electronic device, the view screen display device may include: an operating environment management module 103, a window management module 104 and a dimension conversion module 105.

[0135] In response to detecting a start instruction to convert the target object's view from the initial dimension to the target dimension, a virtual operating environment is created for the target object by the operating environment management module 103, and a proxy display window is created for the target object by the window management module 104. The virtual operating environment is a virtual operating environment for running the target object that is isolated from the target object's real operating environment. The proxy display window is used to display the target object in the target object's real operating environment, replacing the target object's display window. The target object is run in the virtual operating environment by the operating environment management module 103, and a view of the target object in the initial dimension is obtained. The view of the initial dimension is converted to a view of the target dimension by the dimension conversion module 105. The view of the target dimension is displayed in the proxy display window by the window management module 104.

[0136] Optionally, the display device may further include a proxy control module 106. After the window management module 104 displays the target dimension's view in the proxy display window, the window management module 104 obtains a target operation instruction for the target dimension's view in the proxy display window. The target operation instruction instructs a target object to execute a target event. The proxy control module 106 sends the target operation instruction to the target object and obtains a target view resulting from the target object's execution of the target event. The window management module 104 synchronizes the target view to the proxy display window for display.

[0137] The following describes the functional modules in the above-mentioned view screen display device by taking the display object 101 as application A and combining specific examples.

[0138] The runtime environment management module 103 can simulate the application runtime environment. When a user initiates a 3D conversion request for application A, it creates a virtual runtime environment and moves application A to this virtual environment for execution. (Moving to a virtual environment means changing the runtime container to which the application process belongs, switching the application process from its original runtime environment to the virtual runtime container.) Simultaneously, the runtime environment management module 103 collects and outputs real-time screen data from application A.

[0139] Dimension conversion module 105: can be used to realize 2D screen to 3D screen display. It receives the real-time 2D screen data of application A collected by the operating environment management module 103, converts the 2D screen into 3D screen data for output.

[0140] The window management module 104 can be used to output and display the 3D conversion results. It receives the 3D image data output by the dimension conversion module 105 and outputs it to the proxy display window in real time.

[0141] The proxy control module 106 can be used to receive user operation events in real time, pass the operation events to the virtual operating environment and distribute them to the converted application A to implement proxy control.

[0142] Optional, Figure 7 This is a structural diagram of a view image display device provided by an embodiment of the present disclosure. The view image display device 700 can execute the above method embodiment. Figure 2 、 Figure 4 The view screen display method shown in the figure. Figure 7 As shown, the view screen display device 700 includes: an acquisition module 701 and a processing module 702.

[0143] The processing module 702 is used to create a virtual operating environment and a proxy display window for the target object in response to detecting an activation instruction to convert the view screen of the target object from the initial dimension to the target dimension. The virtual operating environment is a virtual operating environment for running the target object that is isolated from the real operating environment of the target object. The proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object. The processing module 702 is also used to run the target object in the virtual operating environment. The acquisition module 701 is used to obtain the view screen of the initial dimension of the target object. The processing module 702 is also used to convert the view screen of the initial dimension to the view screen of the target dimension. The processing module 702 is also used to display the view screen of the target dimension in the proxy display window.

[0144] Optionally, the processing module 702 is further configured to set a picture acquisition container of the virtual operating environment, where the picture acquisition container is configured to obtain a view picture of an initial dimension of the target object.

[0145] Optionally, the start instruction is triggered by a function switch set by the user operating system or a user interface switch, or the start instruction is triggered by the system detecting that a preset condition is met.

[0146] Optionally, the initial dimension is higher than the target dimension, or the initial dimension is lower than the target dimension.

[0147] Optionally, the view image display device 700 further includes a sending module 703. The acquisition module 701 is further configured to acquire a target operation instruction for a view image of a target dimension in the proxy display window. The target operation instruction is used to instruct a target object to execute a target event. The sending module 703 is further configured to send the target operation instruction to the target object. The acquisition module 701 is further configured to acquire a target view image obtained by the target object executing the target event. The processing module 702 is further configured to synchronize the target view image to the proxy display window for display.

[0148] Optionally, acquisition module 701 is specifically configured to acquire an initial operation instruction for the view image of the target dimension, where the initial operation instruction is an operation instruction for the target object in the real operating environment. Processing module 702 is further configured to convert the initial operation instruction into an operation instruction for the target object in the virtual operating environment to obtain a target operation instruction.

[0149] Optionally, the processing module 702 is further configured to switch the target object running in the real running environment to the virtual running environment. The acquiring module 701 is specifically configured to acquire a view image of an initial dimension displayed in a display window of the target object in the virtual running environment.

[0150] Optionally, the processing module 702 is specifically configured to switch the target object's running container from a real running environment to a virtual running environment by modifying the running configuration parameters of the target object.

[0151] Optionally, the processing module 702 is further configured to delete the virtual operating environment and close the proxy display window in response to detecting an exit instruction indicating to stop converting the target object's view from the initial dimension to the target dimension.

[0152] Optionally, the display dimension of the target view is the initial dimension. The processing module 702 is specifically configured to convert the target view from the initial dimension to the target dimension to obtain a converted target view. The processing module 702 is further configured to display the converted target view in the proxy display window.

[0153] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present disclosure provides another possible network device structure of the view image display device involved in the above-mentioned embodiment. Figure 8 As shown, the view screen display device 800 includes: a processor 802 and a bus 804. Optionally, the view screen display device 800 may further include a memory 801; and optionally, the view screen display device 800 may further include a communication interface 803.

[0154] Processor 802 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 802 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 802 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, or a combination of a DSP and a microprocessor.

[0155] The communication interface 803 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0156] The memory 801 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0157] As a possible implementation, memory 801 may exist independently of processor 802. Memory 801 may be connected to processor 802 via bus 804 to store instructions or program code. When processor 802 calls and executes the instructions or program code stored in memory 801, the view screen display method provided in the embodiment of the present disclosure can be implemented.

[0158] In another possible implementation, the memory 801 may also be integrated with the processor 802 .

[0159] The bus 804 may be an extended industry standard architecture (EISA) bus, etc. The bus 804 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0160] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the view screen display method described in any of the above embodiments.

[0161] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0162] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the view screen display method described in any one of the above embodiments.

[0163] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A method for displaying a view image, characterized in that: The method comprises: In response to detecting a start instruction to convert a view of a target object from an initial dimension to a target dimension, creating a virtual operating environment and a proxy display window for the target object; wherein the virtual operating environment is a virtual operating environment for operating the target object that is isolated from a real operating environment of the target object; and the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object. Running the target object in the virtual running environment, and obtaining a view picture of the initial dimension of the target object; Converting the view frame of the initial dimension to the view frame of the target dimension; The view screen of the target dimension is displayed in the agent display window.

2. The method according to claim 1, characterized in that The step of running the target object in the virtual running environment and obtaining the initial dimension view of the target object includes: A picture acquisition container of the virtual operating environment is set, where the picture acquisition container is used to obtain a view picture of the initial dimension of the target object.

3. The method according to claim 1, characterized in that The start instruction is triggered by the user operating system setting a function switch or a user interface switch, or the start instruction is triggered by the system detecting that a preset condition is met.

4. The method according to claim 1, wherein The initial dimension is higher than the target dimension, or the initial dimension is lower than the target dimension.

5. The method according to claim 1, characterized in that After displaying the view picture of the target dimension in the agent display window, the method further includes: Acquire a target operation instruction for the view picture of the target dimension in the proxy display window, wherein the target operation instruction is used to instruct the target object to execute a target event; Sending the target operation instruction to the target object, and obtaining the target view screen obtained by the target object by executing the target event; The target view screen is synchronized to the agent display window for display.

6. The method according to claim 5, characterized in that The acquiring of the target operation instruction for the view picture of the target dimension in the agent display window includes: Acquire an initial operation instruction for the view screen of the target dimension, where the initial operation instruction is an operation instruction for the target object in the real operating environment; The initial operation instruction is converted into an operation instruction for the target object in the virtual operating environment to obtain the target operation instruction.

7. The method according to claim 1, characterized in that Before executing the target object in the virtual execution environment, the method further includes: Switching the target object running in the real operating environment to the virtual operating environment; The obtaining of the initial dimension view of the target object includes: Acquire a view picture of the initial dimension displayed in a display window of the target object in the virtual operating environment.

8. The method according to claim 7, characterized in that The switching the target object running in the real operating environment to the virtual operating environment includes: By modifying the running configuration parameters of the target object, the running container of the target object is switched from the real running environment to the virtual running environment.

9. The method according to claim 1, characterized in that The method further comprises: In response to detecting an exit instruction indicating to stop converting the target object's view from the initial dimension to the target dimension, the virtual execution environment is deleted and the agent display window is closed.

10. The method according to claim 5, characterized in that The display dimension of the target view picture is the initial dimension; The step of synchronizing the target view screen to the proxy display window for display includes: Converting the target view picture from the initial dimension to the target dimension to obtain the converted target view picture; The converted target view screen is displayed in the proxy display window.

11. A method for displaying a view image, characterized in that: Applied to a display device, the display device comprises: an operating environment management module, a window management module and a dimension conversion module; In response to detecting a start instruction to convert a view of a target object from an initial dimension to a target dimension, a virtual operating environment is created for the target object by the operating environment management module, and a proxy display window is created for the target object by the window management module; wherein the virtual operating environment is a virtual operating environment for operating the target object that is isolated from a real operating environment of the target object; and the proxy display window is used to display the target object in the real operating environment of the target object instead of the display window of the target object; Run the target object in the virtual operating environment by the operating environment management module, and obtain the view picture of the initial dimension of the target object; Converting the view picture of the initial dimension into the view picture of the target dimension by the dimension conversion module; The view frame of the target dimension is displayed in the agent display window through the window management module.

12. The method according to claim 11, characterized in that The display device further includes: an agent control module; After displaying the view picture of the target dimension in the agent display window by the window management module, the method further includes: Acquiring, through the window management module, a target operation instruction for the view screen of the target dimension in the proxy display window, wherein the target operation instruction is used to instruct the target object to execute a target event; Sending the target operation instruction to the target object through the proxy control module, and obtaining the target view screen obtained by the target object by executing the target event; The target view screen is synchronized to the proxy display window for display through the window management module.

13. An electronic device, characterized in that: include: memory and processor; Memory and processor coupling; The memory is used to store instructions executable by the processor; When the processor executes the instructions, the method according to any one of claims 1 to 12 is performed.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 12.

Images