Display method, system and equipment of projection screen picture and storage medium

By converting two-dimensional images into three-dimensional images in the receiving device and combining naked-eye 3D algorithm and camera data capture, the problem of insufficient 3D display effect in multi-screen collaboration is solved, and efficient 3D screen projection experience and immersive viewing are achieved.

CN120455769APending Publication Date: 2025-08-08ZTE TERMINAL CO LTD +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410175945.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-02-07
Publication Date
2025-08-08

AI Technical Summary

Technical Problem

In the existing multi-screen collaboration technology, the picture dimensions between the source device and the receiving device are consistent, resulting in the inability to exert 3D display effect on the receiving end, reducing the user's screen projection experience.

Method used

By converting two-dimensional images into three-dimensional images in the receiving device, a new surface control is generated using the naked-eye 3D algorithm, and combining the camera to capture user eye position data, efficient data transmission and 3D display effect from the source device to the receiving device is achieved.

Benefits of technology

It improves the user's screen projection experience, provides immersive viewing and enhanced human-computer interaction experience, and expands somatosensory interaction functions in the gaming field.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120455769A_ABST
    Figure CN120455769A_ABST
Patent Text Reader

Abstract

The invention provides a screen projection picture display method, system and device and a storage medium, relates to the technical field of screen projection, and is used for solving the problem that the screen projection experience of a user is poor. A first device establishes a communication connection with a second device. The first device displays a three-dimensional image of the target picture, and the second device displays a two-dimensional image of the target picture. Wherein the three-dimensional image of the target picture is obtained by performing conversion processing on the two-dimensional image of the target picture by the first equipment or the second equipment based on the screen projection operation instruction, and the screen projection operation instruction is used for indicating the three-dimensional image of the target picture to be displayed on the first equipment in a screen projection manner.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of screen projection technology, and in particular to a method, system, device and storage medium for displaying a projected screen. Background Art

[0002] With the rapid development of the digital media and entertainment industry, users' demand for a better viewing experience for movies and TV shows is growing. In addition to traditional mobile phones, tablets, and TVs, multi-screen collaboration is gradually becoming a new option for viewers to experience movies and TV shows.

[0003] Currently, multi-screen collaboration primarily uses video streaming for screen projection. The sending end (e.g., source) captures each frame and dynamically transmits it to the receiving end (e.g., sink). The sink then decodes the frame through a decoder and displays it on an interface object (e.g., SurfaceView).

[0004] However, in existing multi-screen collaboration, the dimensions of the images displayed by the source and sink are consistent. For example, when the image captured by the source is a two-dimensional (2D) image, the image displayed by the sink on the interface object is also a 2D image. In this way, when the sink supports 3D display effects, the 2D image projected by multi-screen collaboration fails to show the 3D display effect of the sink, reducing the user's screen projection experience. Summary of the Invention

[0005] The embodiments of the present disclosure provide a method, system, device, and storage medium for displaying a projection screen, which are used to solve the problem of poor screen projection experience for users.

[0006] On the one hand, a method for displaying a projected screen is provided, which is applied to a first device and includes: establishing a communication connection with a second device. After receiving a projection operation instruction sent by the second device, a three-dimensional image of a target screen is projected and displayed. The three-dimensional image of the target screen is obtained by the first device or the second device converting a two-dimensional image of the target screen based on the projection operation instruction, and the projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0007] In another aspect, a method for displaying a projected image is provided, which is applied to a second device and includes: after establishing a communication connection with a first device, sending a projection operation instruction to the first device, so that the first device projects and displays a three-dimensional image of a target image. The projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target image. The three-dimensional image of the target image is obtained by converting a two-dimensional image of the target image by the first device or the second device based on the projection operation instruction.

[0008] In another aspect, a method for displaying a projected screen is provided, comprising: establishing a communication connection between a first device and a second device. The first device displays a three-dimensional image of a target screen, and the second device displays a two-dimensional image of the target screen. The three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on a projection operation instruction, wherein the projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0009] In another aspect, a system for displaying a projected screen is provided, comprising: a first device and a second device. Both the first device and the second device store executable instructions. When the first device and the second device execute the instructions, they implement the method for displaying a projected screen according to any of the above embodiments.

[0010] On the other hand, a display device for projecting images is provided, which is applied to a first device and includes: a communication module and a display module.

[0011] A communication module is configured to establish a communication connection with a second device. A display module is configured to project and display a three-dimensional image of a target screen upon receiving a projection operation instruction from the second device. The three-dimensional image of the target screen is obtained by converting a two-dimensional image of the target screen by the first device or the second device based on the projection operation instruction, and the projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0012] On the other hand, a display device for projecting images is provided, which is applied to a second device and includes: a communication module.

[0013] The communication module is configured to, after establishing a communication connection with the first device, send a screen projection operation instruction to the first device, causing the first device to project and display a three-dimensional image of the target screen. The screen projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target screen. The three-dimensional image of the target screen is obtained by converting a two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0014] In yet another aspect, an electronic device is provided, comprising: a memory and a processor. The memory and the processor are coupled. The memory is configured to store a computer program. When the processor executes the computer program, the view screen display method of any of the above embodiments is implemented.

[0015] On the other hand, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method for displaying the projection screen of any of the above embodiments is implemented.

[0016] On the other hand, a computer program product is provided, which includes computer program instructions, and when the computer program instructions are executed by a processor, the method for displaying the projection screen described in any of the above embodiments is implemented.

[0017] In an embodiment of the present disclosure, the second device establishes a communication connection with the first device, and sends a projection operation instruction to the first device for instructing the first device to display a three-dimensional image of the screen to be projected in the second device, so that the second device displays a two-dimensional image of the screen to be projected, and the first device displays a three-dimensional image of the screen to be projected. The three-dimensional image of the screen to be projected is obtained by the first device or the second device converting the two-dimensional image of the screen to be projected based on the projection operation instruction. In this way, the dimensional conversion of the projected screen in multi-screen collaboration can be achieved, thereby improving the user's projection experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0019] Figure 1 A schematic diagram of a communication system provided for some embodiments of the present disclosure;

[0020] Figure 2 A schematic diagram of a flow chart of a method for displaying a projection screen provided in some embodiments of the present disclosure;

[0021] Figure 3 A schematic diagram of a flow chart of another method for displaying a projection screen provided in some embodiments of the present disclosure;

[0022] Figure 4 A schematic diagram of a flow chart of another method for displaying a projection screen provided in some embodiments of the present disclosure;

[0023] Figure 5 A schematic diagram of a flow chart of another method for displaying a projection screen provided in some embodiments of the present disclosure;

[0024] Figure 6 A schematic diagram of a flow chart of another method for displaying a projection screen provided in some embodiments of the present disclosure;

[0025] Figure 7 A schematic diagram of an example of screen projection display provided in some embodiments of the present disclosure;

[0026] Figure 8 A schematic diagram of an example of a screen projection interaction process provided in some embodiments of the present disclosure;

[0027] Figure 9 A schematic diagram illustrating another example of a screen projection interaction process provided in some embodiments of the present disclosure;

[0028] Figure 10 A schematic structural diagram of a display device for projecting images provided in some embodiments of the present disclosure;

[0029] Figure 11 A schematic structural diagram of another screen projection display device provided in some embodiments of the present disclosure;

[0030] Figure 12 A schematic structural diagram of a display device for projecting images provided in some embodiments of the present disclosure. DETAILED DESCRIPTION

[0031] The following will clearly and completely describe the technical solutions of this disclosure in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this disclosure, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of this disclosure without making any creative efforts shall fall within the scope of protection of this disclosure.

[0032] It should be noted that in this disclosure, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0033] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the quantity of the technical features indicated. Therefore, a feature specified as "first" or "second" may explicitly or implicitly include one or more of the features.

[0034] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" in this document simply describes an association relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A exists alone, A and B exists simultaneously, and B exists alone. Furthermore, "at least one" means one or more, and "a plurality" means two or more.

[0035] Before introducing in detail the method for displaying the projection screen provided by the embodiment of the present disclosure, the implementation environment and application scenarios of the embodiment of the present disclosure are first introduced.

[0036] First, the application scenarios of the embodiments of the present disclosure are introduced.

[0037] With the increasing popularity of mobile devices, multi-device interactive systems are becoming a new industry trend. To meet this market demand, technologies such as screen mirroring and application streaming have emerged. Therefore, improving the quality of screen mirroring and expanding its application scenarios are particularly critical.

[0038] In other words, with the rapid development of the digital media and entertainment industries, users' demand for a superior viewing experience is growing. In addition to traditional mobile phones, tablets, and TVs, screen projection is gradually becoming a new option for viewers to experience film and television works. The diversity and advanced features of this screen projection method, such as from traditional video client projection to TVs to more integrated multi-screen collaboration technology, are continuously expanding its scope and depth of application.

[0039] Currently, multi-screen collaboration technology primarily uses video streaming for screen projection. This method captures each frame and dynamically transmits it to the sink, which is then decoded by a decoder and displayed on a SurfaceView. While this method is technically feasible, it does not perform any special processing or optimization on the video itself.

[0040] That is to say, the multi-screen collaboration technologies currently on the market are mainly focused on achieving the transmission and interaction of two-dimensional images. Although these technologies support users to display the content of the source end in the form of a window on the sink end, and allow the source end device to be operated on the sink end to achieve cross-device transmission of files, they have some significant limitations. In particular, these technologies usually only provide a standard two-dimensional screen projection experience, and therefore lack visual depth and richness. More importantly, due to the limited response speed and data processing capabilities of existing technologies when dealing with highly dynamic and complex scenes, they have encountered technical obstacles in ensuring a smooth and synchronized multi-screen interactive experience. This not only limits the improvement of user experience, but also hinders the development of multi-screen technology in a wider range of application scenarios, especially in environments that require high dynamics and interactivity.

[0041] In order to solve the above problems, the embodiment of the present disclosure provides a method for displaying a projection screen, and the method for displaying a projection screen provided by the embodiment of the present disclosure is applied to a multi-screen collaboration scenario. By replacing the traditional projection screen surface control, a naked eye 3D algorithm is used to generate a new, 3D-processed surface control. The data processed in this way is then input into the original decoder, thereby achieving a unique 3D display effect on the projection screen device. In addition to the improvement in display effect, a new human-computer interaction experience can also be developed through the eye position data captured by the camera. That is to say, in the existing multi-screen collaboration framework, the present disclosure can achieve efficient data transmission from a source device (such as a mobile phone) to a receiving device (such as a tablet computer), and generates a new, 3D-processed surface control by adopting a naked eye 3D algorithm. The processed data is then input into the original decoder, thereby achieving a unique 3D display effect on the projection screen device, presenting content with a new 3D visual effect. In this way, in addition to simple picture transmission, deep 3D processing and optimization of the source data by the receiving end can provide users with an immersive viewing experience. Moreover, when processing naked-eye 3D images, the camera of the projected device can expand the human-computer interaction experience (such as adding somatosensory interaction) in many fields, especially in the gaming field, by capturing the user's eye position data and body movement data in real time, allowing users to interact with 3D scenes more realistically.

[0042] It should be noted that the embodiment of the present disclosure can directly transmit the 3D layout information of the mobile phone to the smart TV or TV box, work seamlessly with various Android devices, have a wide range of applications, and provide users with an unprecedented visual interaction experience.

[0043] The implementation environment of the embodiments of the present disclosure is introduced below.

[0044] like Figure 1 , which is a schematic diagram of a communication system provided by an embodiment of the present disclosure, the communication system may include: a second device (such as a transmitting end 101) and a first device (such as a receiving end 102).

[0045] The receiving end 102 can perform wired / wireless communication (such as WiFi, or other short-range communication technologies, etc.) with the transmitting end 101, and the receiving end 102 is a display screen that supports naked-eye 3D display.

[0046] In the disclosed embodiment, the transmitting end 101 may display a two-dimensional image of the screen to be projected and send the two-dimensional image encoding data of the screen to be projected to the receiving end 102. The receiving end 102 may then convert the two-dimensional image encoding data of the screen to be projected into three-dimensional image encoding data of the screen to be projected, and configure an interface object for projecting and displaying the three-dimensional image based on the three-dimensional image encoding data of the screen to be projected, thereby obtaining a three-dimensional image of the screen to be projected. The receiving end 102 may then display the three-dimensional image of the screen to be projected.

[0047] In some embodiments, receiving end 102 further includes a camera. After receiving end 102 receives the 2D image encoding data of the screen to be projected from transmitting end 101, receiving end 102 may collect the user's eye position data through the camera. Subsequently, when receiving end 102 converts the 2D image encoding data of the screen to be projected into 3D image encoding data of the screen to be projected, receiving end 102 may provide a reference for viewing angle when converting the 2D image of the screen to be projected into 3D image encoding data based on the user's eye position data, thereby obtaining the 3D image encoding data of the screen to be projected.

[0048] It should be noted that the embodiments of the present disclosure do not limit the screen to be projected. For example, the screen to be projected can be an application (APP) interface. For another example, the screen to be projected can be a desktop icon. For another example, the screen to be projected can be the video content, game content, etc. of the APP.

[0049] It's important to note that interface objects represent the visual elements through which users interact with computer programs. In the design and implementation of graphical user interfaces, an interface object can be any visible or operable component, such as buttons, text boxes, menus, scroll bars, windows, dialog boxes, and so on. Furthermore, in modern programming languages and frameworks, interface objects are typically encapsulated into classes or components. By instantiating these classes, specific interface elements can be created, and their behavior and appearance can be adjusted as needed, thereby building a rich and diverse application interface.

[0050] It should be noted that in the embodiments of the present disclosure, the transmitting end 101 may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook computer, or other device with transceiver functions. The embodiments of the present disclosure do not impose any particular limitation on the specific form of the transmitting end 101. The transmitting end 101 may interact with the user through one or more methods such as a keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0051] After introducing the application scenarios and implementation environment of the embodiment of the present disclosure, the display method of the projection screen provided by the embodiment of the present disclosure is introduced in detail in combination with the above-mentioned implementation environment.

[0052] The present disclosure provides a method for displaying a projection screen. Figure 2 As shown, the method for displaying the projection screen may include: S201-S203.

[0053] S201: A first device establishes a communication connection with a second device.

[0054] As a possible implementation method, the second device has a screen projection function for projecting a screen image to another device. In response to the user's operation to turn on the screen projection function, the second device can obtain the identifiers of multiple devices to be projected within a preset range, including the first device. Then, the second device can establish a communication connection with the first device in response to the user's operation on the identifier of the first device (such as a click operation, input operation, etc.).

[0055] It should be noted that the embodiments of the present disclosure do not limit the device identifier. For example, the device identifier may be the device name. For another example, the device identifier may be the device serial number. For another example, the device identifier may be the device network address.

[0056] In an embodiment of the present disclosure, the first device also has a screen projection function. Before the second device establishes a communication connection with the first device, the second device can send a first message to the first device to notify the start of screen projection in response to the user's operation of the identifier of the first device. Then, the first device can respond to the first message from the second device, turn on the screen projection function, and run the bus service of the screen projection function, so that the bus service of the screen projection function in the second device and the bus service of the screen projection function in the first device are in operation at the same time, and the second device and the first device establish a screen projection connection with each other, and then establish a communication connection between the first device and the second device.

[0057] S202: The second device displays a two-dimensional image of the target screen.

[0058] As a possible implementation, the second device stores multiple objects to be projected. In response to a user operation (such as a click operation) on a target object among the multiple objects to be projected, the second device can run the target object and obtain the two-dimensional image encoding data of the target screen when the target object is running, and then locally display the two-dimensional image of the target screen based on the two-dimensional image encoding data of the target screen.

[0059] That is to say, the target screen is a real-time view screen of the target object in the running state.

[0060] It should be noted that the embodiments of the present disclosure do not limit the target object. For example, the target object may be an app in a device. For another example, the target object may be a system desktop in a device. For another example, the target object may be a document file, a video file, etc. in a device.

[0061] In an embodiment of the present disclosure, a second device may include a display screen for displaying a screen image and a first interface object with a two-dimensional display effect. The second device may call the first interface object on the display screen, configure the first interface object on the display screen based on the two-dimensional image encoding data of the target screen, obtain the two-dimensional image of the target screen, and then display the two-dimensional image of the target screen on the display screen.

[0062] It should be noted that, for the process of the second device configuring the first interface object in the display screen according to the two-dimensional image coding data of the target screen, reference can be made to the introduction of configuring interface objects in the prior art, which will not be repeated here.

[0063] In some embodiments, after establishing a screen projection connection with the first device, the second device may, in response to a user's operation on a target object among multiple objects to be projected, display a prompt box containing a three-dimensional display button and a two-dimensional display button to inquire about the screen projection display effect of the target screen. Then, in response to the user clicking the three-dimensional display button in the prompt box, the second device may generate a screen projection operation instruction and send the screen projection operation instruction to the first device. The screen projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target screen. Thereafter, the first device may execute S203 in response to the screen projection operation instruction from the second device.

[0064] S203: The first device displays a three-dimensional image of the target screen.

[0065] As a possible implementation method, the first device may include a display screen for displaying a screen image and a second interface object for projecting the displayed image. The first device may start the display screen and call the second interface object in response to a projection operation instruction from the second device. Thereafter, the first device may obtain the image coding data of the target screen in the second device, configure the second interface object in the display screen according to the image coding data of the target screen, obtain a three-dimensional image of the target screen, and project the three-dimensional image of the target screen through the display screen.

[0066] In an embodiment of the present disclosure, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0067] Among them, if the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device based on the screen projection operation instruction, then the second interface object is an interface object with a two-dimensional display effect, and the image coding data of the target screen is three-dimensional image coding data.

[0068] If the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device based on the screen projection operation instruction, then the second interface object is a preset interface object for projecting and displaying the three-dimensional image (that is, an interface object with a three-dimensional display effect), and the image coding data of the target screen is two-dimensional image coding data.

[0069] It is understandable that the second device establishes a communication connection with the first device, and sends a projection operation instruction to the first device for instructing the first device to display a three-dimensional image of the screen to be projected in the second device, so that the second device displays a two-dimensional image of the screen to be projected, and the first device displays a three-dimensional image of the screen to be projected. The three-dimensional image of the screen to be projected is obtained by the first device or the second device converting the two-dimensional image of the screen to be projected based on the projection operation instruction. In this way, the dimensional conversion of the projected screen in multi-screen collaboration can be achieved, which improves the user's projection experience.

[0070] In some embodiments, the first device and the second device can determine that the two-dimensional image of the target screen is converted and processed by either the first device or the second device based on the idle computing resources of both parties and the stability of the communication link between the two parties, thereby realizing the conversion processing of the two-dimensional image of the target screen to obtain a three-dimensional image of the target screen.

[0071] It should be noted that, in the process of determining whether the two-dimensional image of the target screen is converted and processed by any one of the first device and the second device, the determination can be made by the second device, or by the first device.

[0072] The following takes the second device as an example and describes, in combination with specific examples, a process of determining whether the two-dimensional image of the target screen is converted and processed by any one of the first device and the second device.

[0073] In the embodiment of the present disclosure, in the above S201, the second device may obtain the computing power value of the second device and the computing power value of the first device, wherein the computing power value of the second device is used to indicate the idle computing power resources of the second device, and the computing power value of the first device is used to indicate the idle computing power resources of the first device.

[0074] As a possible implementation manner, the second device may obtain idle computing resources in the second device, and determine the computing power value of the second device based on the idle computing resources in the second device.

[0075] As a possible implementation, the first message may include first information for querying computing resources. The second device sends the first message including the first information to the first device, so that the first device, in response to the first information in the first message, obtains the idle computing resources of the first device and determines the computing power value of the first device based on the idle computing resources of the first device. The first device can then send a callback notification containing the computing power value of the first device back to the second device, so that the second device can obtain the computing power value of the first device from the callback notification received from the second device.

[0076] It should be noted that in the embodiments of this disclosure, the computing power of a device is directly proportional to its idle computing resources. That is, a device with a higher computing power value has more idle computing resources, while a device with a lower computing power value has fewer idle computing resources.

[0077] In the embodiment of the present disclosure, Figure 3 As shown, after S201, the method for displaying the projection screen may further include: S301-S308.

[0078] S301: A second device obtains a stable value of a communication link between a first device and a second device.

[0079] The stability value of the communication link between the first device and the second device is used to indicate the stability of the communication link between the first device and the second device.

[0080] It should be noted that in the embodiments of the present disclosure, the stability value of a communication link is proportional to its stability. That is, a communication link with a larger stability value has a better stability; a communication link with a smaller stability value has a worse stability.

[0081] In the embodiment of the present disclosure, the stable value of the communication link between the first device and the second device may be any of the following parameter values: bit error rate, packet loss rate, path loss value, effective isotropic radiated power, etc.

[0082] As a possible implementation method, the second device can monitor the communication link between it and the first device in real time or periodically test it, and determine the stable value of the communication link between it and the first device through statistical analysis and prediction algorithms, thereby obtaining the stable value of the communication link between it and the first device.

[0083] S302: The second device determines whether the computing power value of the first device is greater than the computing power value of the second device.

[0084] S303: The second device determines whether a stability value of the communication link between the first device and the second device is less than a preset threshold.

[0085] As a possible implementation method, the second device stores a preset threshold. The second device can compare the stability value of the communication link between the first device and the second device determined by the second device with the stored preset threshold to determine whether the stability value of the communication link between the first device and the second device is less than the preset threshold.

[0086] In some embodiments, when the second device determines that the computing power value of the first device is greater than the computing power value of the second device, and the stability value of the communication link between the first device and the second device is less than a preset threshold, the second device determines that the two-dimensional image of the target screen is converted and processed by the first device, and executes S304 after S202.

[0087] S304: The second device obtains the two-dimensional image encoding data of the target picture.

[0088] As a possible implementation manner, the second device may collect data of the two-dimensional image of the displayed target screen to obtain the two-dimensional image encoding data of the target screen.

[0089] S305: The second device sends the two-dimensional image encoding data of the target picture to the first device.

[0090] S306: The first device obtains the two-dimensional image coding data of the target picture in the second device.

[0091] In the embodiment of the present disclosure, the first device receives the two-dimensional image encoding data of the target picture from the second device to obtain the two-dimensional image encoding data of the target picture in the second device.

[0092] S307: The first device converts the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture.

[0093] As one possible implementation, a camera is deployed in the first device. During the process of converting the 2D image coded data of the target screen into 3D image coded data of the target screen, the first device may collect eye position data of the user within the field of view via the camera, and convert the 2D image coded data of the target screen into 3D image coded data of the target screen based on the eye position data. The eye position data is used to provide a reference for the viewing angle of the 3D screen during the dimensional conversion process.

[0094] It should be noted that, for the process of the first device converting the two-dimensional image coding data of the target screen into the three-dimensional image coding data of the target screen, reference can be made to the introduction of the conversion from two-dimensional image coding data to three-dimensional image coding data in the prior art, which will not be repeated here.

[0095] S308. The first device configures a preset interface object for projecting and displaying a three-dimensional image according to the three-dimensional image encoding data of the target screen, and obtains the three-dimensional image of the target screen.

[0096] As one possible implementation, the first device is deployed with a 3D control, and the 3D control includes a preset interface object (i.e., a 3D interface object). The first device can call the preset interface object from the 3D control for the first device's display screen to replace the initial interface object used to display the two-dimensional image on the first device. The first device can then configure the preset interface object on the display screen based on the three-dimensional image encoding data of the target screen, thereby obtaining a three-dimensional image of the target screen.

[0097] In the embodiment of the present disclosure, after the first device obtains the three-dimensional image of the target screen, the first device may execute S203 through a preset interface object on the display screen.

[0098] It is understood that if the computing power of the first device is higher than that of the second device and the communication link between the first and second devices is unstable, the 3D image of the screen to be projected is obtained by converting the 2D image of the screen to be projected by the second device based on the projection operation instruction. In this way, the computing power of the first device for dimensional conversion can be transferred to the second device, reducing the computing power load of the first device during the projection process.

[0099] In other embodiments, Figure 4 As shown, after S302 and S303, if the second device determines that the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to the preset threshold, the second device determines that the two-dimensional image of the target screen is converted and processed by the second device, and after S304, the second device can obtain a three-dimensional image of the target screen through the following S401-S402.

[0100] S401: The second device converts the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture.

[0101] As a possible implementation method, the second device can interact with the first device to obtain the user's eye position data collected by the first device, and convert the two-dimensional image coding data of the target screen into three-dimensional image coding data of the target screen based on the eye position data.

[0102] Optionally, the second device can send a second message to the first device to request the user's eye position data, so that the first device responds to the second message, collects the user's eye position data within the field of view through the camera, and feeds back a callback notification carrying the user's eye position data to the second device, thereby allowing the second device to obtain the user's eye position data from the callback notification from the first device.

[0103] S402: The second device configures a virtual interface object according to the three-dimensional image coding data of the target picture to obtain a three-dimensional image of the target picture.

[0104] As a possible implementation, the second device is deployed with a 3D control, and the 3D control includes a virtual interface object (i.e., a 3D interface object) for displaying a three-dimensional image on the virtual screen. The second device can create a virtual screen in the background space and call the virtual interface object for the virtual screen from the 3D control to replace the initial interface object used to display the two-dimensional image in the second device. The second device can then configure the virtual interface object in the virtual screen based on the three-dimensional image encoding data of the target screen to obtain the three-dimensional image of the target screen.

[0105] In the embodiment of the present disclosure, after the second device obtains the three-dimensional image of the target screen, the second device and the first device may go through the following S403-S406 to enable the first device to execute S203.

[0106] S403: The second device obtains target image coding data of a three-dimensional image of a target picture.

[0107] As a possible implementation method, after the second device obtains the three-dimensional image of the target screen, the second device can display the three-dimensional image of the target screen through a virtual interface object in the virtual screen, and obtain the target image encoding data by collecting data of the three-dimensional image of the target screen displayed in the virtual screen.

[0108] S404: The second device sends target image encoding data to the first device.

[0109] S405: The first device receives target image encoding data from the second device.

[0110] In the embodiment of the present disclosure, S203 may include: S406.

[0111] S406: The first device configures a preset interface object according to the target image coding data and displays the three-dimensional image of the target picture.

[0112] As a possible implementation manner, the first device may configure a preset interface object according to the target image coding data, obtain a three-dimensional image of the target screen, and display the three-dimensional image of the target screen through the preset interface object on the display screen.

[0113] Optionally, the first device may configure an initial interface object in the first device according to the target image coding data, obtain a three-dimensional image of the target screen, and display the three-dimensional image of the target screen through the initial interface object in the display screen.

[0114] It is understood that if the computing power of the first device is lower than that of the second device and the communication link between the first and second devices is relatively stable, the 3D image of the screen to be projected is obtained by converting the 2D image of the screen to be projected by the first device based on the projection operation instruction. This ensures that the first device can display the 3D image of the screen to be projected in a timely manner.

[0115] In some embodiments, if the second device determines that the computing power value of the first device is greater than the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the second device may inquire the user about the device that converts the two-dimensional image of the target screen by displaying a prompt box containing the identifier of the first device and the identifier of the second device. Afterwards, the second device may respond to the user's operation (such as a click operation, an input operation, etc.) on the identifier of the second device (or the identifier of the first device) in the prompt box, and determine that the two-dimensional image of the target screen is converted by the device indicated by the operation.

[0116] Optionally, after the second device displays the prompt box, the second device may determine, by timing, whether an operation of the user on the device identifier in the prompt box is received within a preset time.

[0117] If the second device determines that the user's operation on the device identifier in the prompt box is received within the preset time, the second device determines that the two-dimensional image of the target screen is converted and processed by the device indicated by the operation.

[0118] If the second device determines that it has not received the user's operation on the device identifier in the prompt box within a preset time, the second device can determine that the two-dimensional image of the target screen is converted and processed by the default device between the first device and the second device. The default device can be the sending end in the screen projection process (such as the second device), or the default device can be the receiving end in the screen projection process (such as the first device).

[0119] Similarly, if the second device determines that the computing power of the first device is less than or equal to the computing power of the second device, and the stability value of the communication link between the first and second devices is less than a preset threshold, the second device may display a prompt box containing the identifiers of the first and second devices, and inquire from the user about the device that will convert the two-dimensional image of the target screen. Afterwards, the second device may respond to the user's operation (such as a click operation, input operation, etc.) on the identifier of the second device (or the identifier of the first device) in the prompt box, and determine that the two-dimensional image of the target screen will be converted by the device indicated by the operation.

[0120] It can be understood that in the process of projecting the screen from the second device to the first device, the operability of the projected display can be improved by adding a device that manually determines the conversion processing of the picture.

[0121] In some embodiments, the second device stores a preset whitelist that includes identifiers of multiple preset objects that are allowed to be projected. After the second device establishes a communication connection with the first device, the second device can determine whether to project the target image by determining whether the preset whitelist includes the identifier of the target object.

[0122] As a possible implementation method, when the second device determines that the preset whitelist includes the identifier of the target object, the second device can send a screen projection operation instruction to the first device.

[0123] As another possible implementation, when the second device determines that the identifier of the target object is not included in the preset whitelist, the second device may not send the screen projection operation instruction to the first device, and display a prompt box indicating that the target object is not authorized to project the screen.

[0124] It is understandable that by authenticating the projection object through the whitelist, the authorized object can be projected and displayed. In this way, the security of the projection display can be improved.

[0125] The following describes the method for displaying the projection screen provided by the embodiment of the present disclosure, taking the second device as the execution subject. Figure 5 As shown, the method for displaying the projection screen may include: S501-S502.

[0126] S501: The second device establishes a communication connection with the first device.

[0127] It should be noted that, for the process of establishing a communication connection between the second device and the first device, reference may be made to the introduction of establishing a communication connection between the second device and the first device in S201 above, which will not be described in detail here.

[0128] In some embodiments, after the second device establishes a communication connection with the first device, the second device may execute S502.

[0129] S502. The second device sends a screen projection operation instruction to the first device, so that the first device displays a three-dimensional image of the target screen.

[0130] It should be noted that, for the process in which the second device sends a screen projection operation instruction to the second device so that the first device displays a three-dimensional image of the target screen, reference can be made to the above Figure 4 The processes of S301 to S406 in the illustrated embodiment are not described in detail here.

[0131] The following describes the method for displaying the projection screen provided by the embodiment of the present disclosure, taking the first device as the execution subject. Figure 6 As shown, the method for displaying the projection screen may include: S601-S602.

[0132] S601: A first device establishes a communication connection with a second device.

[0133] It should be noted that, for the process of establishing a communication connection between the first device and the second device, reference may be made to the introduction of establishing a communication connection between the second device and the first device in S201 above, which will not be described in detail here.

[0134] S602. After receiving the screen projection operation instruction sent by the second device, the first device projects and displays a three-dimensional image of the target screen.

[0135] It should be noted that, for the process of the first device projecting and displaying the three-dimensional image of the target screen after receiving the projection operation instruction sent by the second device, reference can be made to the above Figure 4 The processes of S306-S308 or S405-S406 in the illustrated embodiment are not described in detail here.

[0136] It is understandable that, when the second device displays the 2D image of the projected screen, the first device can convert the 2D image encoding data of the projected screen to obtain the 3D image encoding data of the projected screen, and then display the 3D image of the projected screen based on the 3D image encoding data of the projected screen. In this way, the dimensional conversion of the projected screen in multi-screen collaboration can be achieved, improving the user's screen projection experience.

[0137] In combination with the above-mentioned introduction that the second device determines that the two-dimensional image of the target screen is converted and processed by either the second device or the first device, the following takes the first device as an example and combines specific examples to introduce the process of determining that the two-dimensional image of the target screen is converted and processed by either the first device or the second device.

[0138] In an embodiment of the present disclosure, before a first device establishes a communication connection with a second device, the first device may obtain a computing power value of the second device and a computing power value of the first device.

[0139] As a possible implementation method, the first device can receive a first message including first information from the second device, and in response to the first information in the first message, obtain idle computing resources in the first device, and determine the computing power value of the first device based on the idle computing resources in the first device.

[0140] Optionally, before the second device sends the first message to the first device, the second device determines the computing power value of the second device by obtaining idle computing resources in the second device. Subsequently, when the second device sends the first message to the first device, the second device may include the computing power value of the second device in the first message, so that the first device obtains the computing power value of the second device from the first message received from the second device.

[0141] In an embodiment of the present disclosure, referring to the process of executing S301-S303 by the above-mentioned second device, the first device can obtain the stability value of the communication link between the first device and the second device, and determine whether the computing power value of the first device is greater than the computing power value of the second device, and whether the stability value of the communication link between the first device and the second device is less than a preset threshold, and then determine the device in the first device and the second device that performs conversion processing on the two-dimensional image of the target screen.

[0142] As a possible implementation method, when the first device determines that the first device is to convert the two-dimensional image of the target screen, the first device can send a third message to the second device to request the encoded data of the two-dimensional image of the target screen, so that the second device responds to the third message, executes the above S304-S305, and then executes S306-S308 through the first device to obtain a three-dimensional image of the target screen.

[0143] As another possible implementation, when the first device determines that the second device is to convert the two-dimensional image of the target screen, the first device may send a third message to the second device for requesting the encoded data of the three-dimensional image of the target screen, so that the second device responds to the third message, executes the above S304-S402, and thereby obtains the three-dimensional image of the target screen.

[0144] In the embodiment of the present disclosure, the second device executes S403-S404 above, so that the first device executes S405 to obtain the target coded data of the 3D image of the target picture, and executes S406 to display the 3D image of the target picture.

[0145] The following describes the method for displaying the projection screen provided by the embodiment of the present disclosure in conjunction with specific examples. Figure 7 As shown, the sending end establishes a Wi-Fi peer-to-peer (Wi-Fi P2P) connection with the multi-screen collaborative service of the receiving end through the multi-screen collaborative service of the sending end, so that the receiving end receives the screen to be projected from the sending end through the multi-screen collaborative service, and outputs the three-dimensional image of the screen to be projected through the 3D control in the receiving end.

[0146] For example, take the Android system as an example. Figure 8 As shown, it shows a screen projection interaction process between a sending end and a receiving end.

[0147] The sender notifies the receiver to start screen projection. The sender and receiver communicate via remote procedure call (RPC) to transmit basic device information (i.e., the device's computing power). The receiver returns this information to the sender via a callback and starts the bus service to prepare for establishing a screen projection connection. Then, after receiving the notification from the sender to start screen projection, the receiver starts the projection window and obtains the 3D interface object.

[0148] At this point, the receiving end will determine the interface object to use based on the sender's judgment of the screen projection application. If the screen projection application is on the whitelist, the system's own interface object will be replaced with the three-dimensional interface object in the 3D control.

[0149] Optionally, if the screen projection application is not an application in the whitelist, obtain the system's own interface object (such as a normal Surface).

[0150] Afterwards, after the projection window is prepared, the receiving end can send a callback notification that the projection window is ready to the sending end again, so that the sending end and the receiving end can establish a projection connection, start recording and encoding the screen of the projection application, and transmit the encoded data to the receiving end through a non-unique communication method.

[0151] The receiving end configures the previously acquired three-dimensional interface object in the decoder based on the data transmitted by the sending end, and decodes and plays it.

[0152] At this time, the interface object configured in the decoder is the 3D interface object in the 3D control, and the played picture is 3D processed by the 3D interface object, so it can display a 3D effect.

[0153] Optionally, if the interface object configured in the decoder is a system-provided interface object, the played image is not 3D processed and therefore cannot display a 3D effect.

[0154] Optional, such as Figure 9As shown, it shows another screen projection interaction process between the sending end and the receiving end, so that the receiving end can migrate the computing power of 3D processing to the sending end.

[0155] Among them, the sender notifies the receiver to start screen projection. The sender and the receiver transmit basic device information (i.e., the computing power value of the device) through RPC communication. The receiver returns it to the sender through a callback and starts the bus service to prepare to establish a screen projection connection. Then, after the receiver receives the notification from the sender to start screen projection, it starts the screen projection window, obtains the corresponding interface object of the system, and sends a callback notification to the sender that the screen projection window has been prepared.

[0156] Afterwards, the sending end can determine whether the screen projection application is in the whitelist, determine the screen dimensions displayed by the screen projection application on the receiving end, and send the screen projection data of the corresponding dimensions to the receiving end.

[0157] If the screen projection application is an application outside the whitelist, the sending end determines that the screen dimension displayed by the screen projection application on the receiving end is two-dimensional, and directly encodes the screen projection of the screen projection application, and then transmits the encoded data to the receiving end so that the receiving end decodes and plays the 2D screen of the screen projection application.

[0158] If the screen projection application is an application in the whitelist, the sender determines that the screen dimension displayed by the screen projection application on the receiving end is three-dimensional and creates a virtual screen. Then, the sender uses a three-dimensional interface object to replace the system's own interface object. At the same time, the receiving end collects eye position data through the camera and transmits it back to the sender, so that the sender obtains the eye position data. After that, the sender plays the eye position data captured by the camera on the virtual screen configured with the three-dimensional interface object, encodes the three-dimensional processed screen projection data, and transmits the encoded data to the receiving end, so that the receiving end decodes and plays the transmitted data to display the 3D effect.

[0159] It should be noted that Figure 8 and Figure 9 List two options. Figure 8 The solution has lower requirements on communication quality, but higher requirements on the hardware of the receiving end. Figure 9 The solution has lower hardware requirements for the receiving end, but higher requirements for the hardware requirements for the sending end and the WiFi communication quality. This disclosure will automatically determine which solution to use based on the on-site device information. If the hardware level of the sending and receiving ends is similar, the preferred solution is Figure 8 The solution is to ensure as little data transmission as possible.

[0160] In summary, the present disclosure can project various display contents (such as APP interface, operating system interface, video, game, etc.) on the source end to the sink end to display naked-eye 3D images. Moreover, the present disclosure can be particularly applied to certain mobile game scenarios, by projecting the mobile phone screen to the large-screen device to display the naked-eye 3D effect and perform real somatosensory interaction, providing users with a highly interactive and immersive 3D experience. In other words, the present disclosure has shown significant advantages in improving user experience. The present disclosure not only supports standard multi-screen collaboration functions, but also introduces naked-eye 3D technology, which means that users can enjoy a stereoscopic 3D visual experience on the sink end device without any additional 3D glasses. On the large-screen device, you can not only watch the 3D content projected from the mobile phone, but also directly operate the mobile phone. Some somatosensory games can even capture position data through the camera of the large-screen device for somatosensory interaction. In this way, a highly interactive and immersive 3D experience is provided to users.

[0161] It is understandable that, in order to realize the above functions, the display device of the projection screen includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0162] The embodiment of the present disclosure can divide the display device of the projection screen into functional modules according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0163] Figure 10 This is a structural diagram of a display device for projecting a screen provided by an embodiment of the present disclosure. The display device 1000 for projecting a screen can perform the above Figure 2 、 Figure 3 and Figure 4 The method of displaying the projection screen shown in the second device is executed. Figure 10 As shown, the display device 1000 for projecting the screen includes: a communication module 1001.

[0164] Communication module 1001 is configured to, after establishing a communication connection with a first device, send a screen projection operation instruction to the first device, causing the first device to project and display a 3D image of a target screen. The screen projection operation instruction instructs the first device to project and display a 3D image of the target screen. The 3D image of the target screen is obtained by converting a 2D image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0165] Optionally, when the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device.

[0166] Optionally, the display device 1000 for projecting an image further includes: an acquisition module 1002 and a processing module 1003. Acquisition module 1002 is configured to acquire 2D image coded data of a target image. Processing module 1003 is configured to convert the 2D image coded data of the target image into 3D image coded data of the target image. Processing module 1003 is further configured to configure a virtual interface object based on the 3D image coded data of the target image to obtain a 3D image of the target image.

[0167] Optionally, acquisition module 1002 is further configured to acquire eye position data of the user collected by the first device. The eye position data is used to provide a reference for viewing the 3D image during the dimensional conversion process. Processing module 1003 is specifically configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image based on the eye position data.

[0168] Optionally, the display apparatus 1000 for projecting an image further includes a sending module 1004. The acquisition module 1002 is further configured to acquire target image encoding data of a 3D image of the target image. The sending module 1004 is configured to send the target image encoding data to the first device, so that the first device displays the 3D image of the target image based on the target image encoding data.

[0169] Optionally, the processing module 1003 is further configured to determine whether the preset whitelist includes the target object corresponding to the target screen. The sending module 1004 is further configured to send a screen projection operation instruction to the first device if the preset whitelist includes the target object.

[0170] Figure 11 This is a schematic diagram of a display device for projecting a screen provided by an embodiment of the present disclosure. The display device 1100 for projecting a screen can perform the above Figure 2 、 Figure 3 and Figure 4The method of displaying the projection screen shown in the first device is executed. Figure 11 As shown, the display device 1100 for projecting the screen includes: a communication module 1101 and a display module 1102.

[0171] The communication module 1101 is configured to establish a communication connection with the second device. The display module 1102 is configured to project and display a three-dimensional image of the target screen upon receiving a projection operation instruction from the second device. The three-dimensional image of the target screen is obtained by converting a two-dimensional image of the target screen by the first device or the second device based on the projection operation instruction. The projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0172] Optionally, when the computing power value of the first device is greater than the computing power value of the second device and the stability value of the communication link between the first device and the second device is less than a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device.

[0173] Optionally, the display device 1100 for projecting an image further includes an acquisition module 1103 and a processing module 1104. Acquisition module 1103 is configured to acquire 2D image encoding data of a target image from a second device. Processing module 1104 is configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image. Processing module 1104 is further configured to configure a preset interface object for projecting and displaying a 3D image based on the 3D image encoding data of the target image, thereby obtaining a 3D image of the target image.

[0174] Optionally, acquisition module 1103 is further configured to collect eye position data of the user. This eye position data is used to provide a reference for viewing the 3D image during the dimensional conversion process. Processing module 1104 is specifically configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image based on the eye position data.

[0175] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present disclosure provides another possible network device structure of the display device of the projection screen involved in the above-mentioned embodiment. Figure 12 As shown, the display device 1200 for projecting a screen includes: a processor 1202 and a bus 1204. Optionally, the display device 1200 for projecting a screen may further include a memory 1201; optionally, the display device 1200 for projecting a screen may further include a communication interface 1203.

[0176] Processor 1202 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1202 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1202 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, or a combination of a DSP and a microprocessor.

[0177] The communication interface 1203 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, or wireless local area network (WLAN).

[0178] The memory 1201 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0179] As a possible implementation, the memory 1201 can exist independently of the processor 1202, and the memory 1201 can be connected to the processor 1202 via a bus 1204 for storing instructions or program codes. When the processor 1202 calls and executes the instructions or program codes stored in the memory 1201, the method for displaying the projection screen provided in the embodiment of the present disclosure can be implemented.

[0180] In another possible implementation, the memory 1201 may also be integrated with the processor 1202 .

[0181] The bus 1204 may be an extended industry standard architecture (EISA) bus, etc. The bus 1204 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 12 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0182] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the method for displaying a projection image as described in any of the above embodiments.

[0183] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0184] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the method for displaying a projection image as described in any of the above embodiments.

[0185] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A method for displaying a projection screen, characterized in that: Applied to a first device, the method includes: establishing a communication connection with a second device; After receiving the screen projection operation instruction sent by the second device, projecting and displaying the three-dimensional image of the target screen; Among them, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction, and the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be projected and displayed on the first device.

2. The method according to claim 1, characterized in that When the computing power value of the first device is greater than the computing power value of the second device and the stability value of the communication link between the first device and the second device is less than a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device.

3. The method according to claim 2, characterized in that When the computing power of the first device is greater than the computing power of the second device, and the stability value of the communication link between the first device and the second device is less than the preset threshold, the method further includes: Acquiring two-dimensional image encoding data of the target picture in the second device; Converting the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture; According to the three-dimensional image coding data of the target screen, a preset interface object for projecting and displaying the three-dimensional image is configured to obtain the three-dimensional image of the target screen.

4. The method according to claim 3, characterized in that The converting the two-dimensional image coding data of the target picture into the three-dimensional image coding data of the target picture includes: Collecting user eye position data, the eye position data is used to provide a reference for viewing angle of a three-dimensional image during the dimensional conversion process of the image; The two-dimensional image encoding data of the target picture is converted into three-dimensional image encoding data of the target picture according to the eye position data.

5. A method for displaying a projection screen, characterized in that: Applied to the second device, the method includes: After establishing a communication connection with the first device, sending a screen projection operation instruction to the first device so that the first device projects and displays a three-dimensional image of the target screen; Among them, the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be projected and displayed on the first device; the three-dimensional image of the target screen is obtained by the first device or the second device converting the two-dimensional image of the target screen based on the screen projection operation instruction.

6. The method according to claim 5, characterized in that When the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device.

7. The method according to claim 6, characterized in that When the computing power of the first device is less than or equal to the computing power of the second device, and a stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the method further includes: Acquiring two-dimensional image coding data of the target picture; Converting the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture; A virtual interface object is configured according to the three-dimensional image coding data of the target screen to obtain a three-dimensional image of the target screen.

8. The method according to claim 7, characterized in that The converting the two-dimensional image coding data of the target picture into the three-dimensional image coding data of the target picture includes: Acquiring eye position data of the user collected by the first device, wherein the eye position data is used to provide a reference for viewing perspective of a three-dimensional image during a dimensional conversion process of the image; The two-dimensional image encoding data of the target picture is converted into three-dimensional image encoding data of the target picture according to the eye position data.

9. The method according to claim 7, characterized in that After configuring the virtual interface object according to the three-dimensional image coding data of the target screen to obtain the three-dimensional image of the target screen, the method further includes: Target image coding data of the three-dimensional image of the target picture is acquired, and the target image coding data is sent to the first device, so that the first device displays the three-dimensional image of the target picture according to the target image coding data.

10. The method according to claim 5, characterized in that After establishing the communication connection with the first device, the method further includes: Determining whether a preset whitelist includes a target object corresponding to the target screen; When the target object is included in the preset whitelist, the screen projection operation instruction is sent to the first device.

11. A method for displaying a projection screen, characterized in that: The method comprises: The first device establishes a communication connection with the second device; The first device displays a three-dimensional image of a target screen, and the second device displays a two-dimensional image of the target screen; Among them, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction, and the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be displayed on the first device.

12. A screen projection display system, characterized in that: include: A first device and a second device; the first device and the second device both store executable instructions; the first device and the second device execute the method according to claim 11 when executing the instructions.

13. An electronic device, characterized in that: include: memory and processor; Memory and processor coupling; The memory is used to store instructions executable by the processor; When the processor executes the instructions, the method according to any one of claims 1 to 10 is performed.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.

Citation Information

Cited By

  • Screen-mirrored picture display method and system, electronic device and storage medium

    WO2025167324A1