Screen-mirrored picture display method and system, electronic device and storage medium

By using naked-eye 3D algorithm and camera to capture user data in multi-screen collaboration technology, the problem of insufficient visual depth in the existing technology is solved, and an efficient 3D display and immersive viewing experience is achieved, which improves the user interaction experience.

WO2025167324A1PCT designated stage Publication Date: 2025-08-14ZTE CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/139162
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-02-07
Filing Date
2024-12-13
Publication Date
2025-08-14

AI Technical Summary

Technical Problem

The existing multi-screen collaboration technology mainly focuses on the transmission and interaction of two-dimensional images, resulting in insufficient visual depth and richness. Especially when dealing with high dynamic and complex scenarios, it has limited response speed and data processing capabilities, which limits the improvement of user experience and the expansion of application scenarios.

Method used

By using the naked-eye 3D algorithm to generate new 3D-processed surface controls, input data into the original decoder, achieving a unique 3D display effect, and capturing user eye position data through the camera to develop human-computer interactive experience, improving the immersive viewing experience of screen projection devices.

Benefits of technology

It realizes efficient data transmission from the source device to the receiving device, provides a unique 3D display effect and immersive viewing experience, and expands the human-computer interaction experience, especially the somatosensory interaction function in the gaming field.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024139162_14082025_PF_FP_ABST
    Figure CN2024139162_14082025_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure provides a screen-mirrored picture display method and system, an electronic device and a storage medium. The method comprises: a first device establishes a communication connection with a second device (S201), the first device displays a three-dimensional image of a target picture (S203), and the second device displays a two-dimensional image of the target picture (S202), wherein the three-dimensional image of the target picture is obtained by the first device or the second device converting the two-dimensional image of the target picture on the basis of a screen mirroring operation instruction, and the screen mirroring operation instruction is used for instructing to display the three-dimensional image of the target picture on the first device by means of screen mirroring.
Need to check novelty before this filing date? Find Prior Art

Description

Screen projection display method and system, electronic device, and storage medium

[0001] This disclosure claims priority to Chinese patent application No. 202410175945.0, filed on February 7, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of screen projection technology, and in particular to a method and system for displaying a projected screen, an electronic device, and a storage medium. Background Art

[0003] With the rapid development of the digital media and entertainment industry, users' demand for a better viewing experience for movies and TV shows is growing. In addition to traditional mobile phones, tablets, and TVs, multi-screen collaboration is gradually becoming a new option for viewers to experience movies and TV shows.

[0004] Currently, multi-screen collaboration primarily uses video streaming for screen projection. The sending end (e.g., source) captures each frame and dynamically transmits it to the receiving end (e.g., sink). The sink then decodes the frame through a decoder and displays it on an interface object (e.g., SurfaceView). Summary of the Invention

[0005] On the one hand, a method for displaying a projected screen is provided, which is applied to a first device. The method for displaying a projected screen includes: establishing a communication connection with a second device. After receiving a projection operation instruction sent by the second device, a three-dimensional image of a target screen is projected and displayed. The three-dimensional image of the target screen is obtained by the first device or the second device converting the two-dimensional image of the target screen based on the projection operation instruction, and the projection operation instruction is used to instruct the three-dimensional image of the target screen to be projected and displayed on the first device.

[0006] On the other hand, a method for displaying a projected screen is provided, which is applied to a second device. The method for displaying a projected screen includes: after establishing a communication connection with a first device, sending a projection operation instruction to the first device so that the first device projects and displays a three-dimensional image of a target screen. The projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target screen. The three-dimensional image of the target screen is obtained by the first device or the second device converting the two-dimensional image of the target screen based on the projection operation instruction.

[0007] In another aspect, a method for displaying a projected screen is provided. The method includes: establishing a communication connection between a first device and a second device. The first device displays a three-dimensional image of a target screen, and the second device displays a two-dimensional image of the target screen. The three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on a projection operation instruction, wherein the projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0008] In another aspect, a system for displaying a projected screen is provided. The system includes a first device and a second device. The first device and the second device both store executable instructions. When the first device and the second device execute the instructions, they implement the method for displaying a projected screen described in any of the above aspects.

[0009] In another aspect, a device for displaying a projected image is provided, which is applied to a first device. The projected image display system includes: a communication module and a display module.

[0010] A communication module is configured to establish a communication connection with a second device. A display module is configured to project and display a three-dimensional image of a target screen upon receiving a projection operation instruction from the second device. The three-dimensional image of the target screen is obtained by converting a two-dimensional image of the target screen by the first device or the second device based on the projection operation instruction. The projection operation instruction is used to instruct the first device to project and display the three-dimensional image of the target screen.

[0011] In another aspect, a device for displaying a projected image is provided, which is applied to a second device. The device for displaying a projected image includes: a communication module.

[0012] The communication module is configured to, after establishing a communication connection with the first device, send a screen projection operation instruction to the first device, so that the first device projects and displays a three-dimensional image of the target screen. The screen projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target screen. The three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0013] In yet another aspect, an electronic device is provided. The electronic device includes a memory and a processor. The memory and the processor are coupled. The memory is configured to store a computer program. When the processor executes the computer program, the method for displaying a projected image described in any of the above aspects is implemented.

[0014] On the other hand, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method for displaying the projection screen described in any of the above aspects is implemented.

[0015] On the other hand, a computer program product is provided, which includes computer program instructions, and when the computer program instructions are executed by a processor, the method for displaying the projection screen described in any of the above aspects is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0017] FIG1 is a schematic diagram of a communication system according to some embodiments of the present disclosure.

[0018] FIG2 is a flow chart of a method for displaying a projection image according to some embodiments of the present disclosure.

[0019] FIG3 is a flowchart of another method for displaying a projection image according to some embodiments of the present disclosure.

[0020] FIG4 is a flow chart of another method for displaying a projection image according to some embodiments of the present disclosure.

[0021] FIG5 is a flowchart of another method for displaying a projection image according to some embodiments of the present disclosure.

[0022] FIG6 is a flowchart of another method for displaying a projection image according to some embodiments of the present disclosure.

[0023] FIG7 is a schematic diagram of an example of screen projection display according to some embodiments of the present disclosure.

[0024] FIG8 is a schematic diagram illustrating an example of a screen projection interaction process according to some embodiments of the present disclosure.

[0025] FIG9 is a schematic diagram of another example of a screen projection interaction process according to some embodiments of the present disclosure.

[0026] FIG10 is a schematic structural diagram of a display device for projecting images according to some embodiments of the present disclosure.

[0027] FIG11 is a schematic structural diagram of another device for displaying a projection image according to some embodiments of the present disclosure.

[0028] FIG12 is a schematic structural diagram of a display device for projecting a screen according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0029] To help those skilled in the art better understand the technical solutions of the embodiments of the present disclosure, the technical solutions of the present disclosure will be clearly and completely described below in conjunction with the drawings in the present disclosure. Obviously, the embodiments described are only some of the embodiments of the present disclosure, not all of them. Based on the embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0030] It should be noted that in this disclosure, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs in this disclosure. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0031] In the following, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features being referred to. Therefore, a feature defined with the terms "first," "second," etc., may explicitly or implicitly include one or more of such features.

[0032] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" herein is merely a description of an association relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: only A, only B, and both A and B. Furthermore, "at least one" means one or more, and "a plurality" means two or more.

[0033] Before introducing in detail the method for displaying the projection screen provided by the embodiment of the present disclosure, the implementation environment and application scenarios of the embodiment of the present disclosure are first introduced.

[0034] First, the application scenarios of the embodiments of the present disclosure are introduced.

[0035] With the increasing popularity of mobile devices, multi-device interactive systems are becoming a new industry trend. To meet this market demand, technologies such as screen mirroring and application streaming have emerged. Therefore, improving the quality of screen mirroring and expanding its application scenarios are particularly critical.

[0036] In other words, with the rapid development of the digital media and entertainment industries, users' demand for a superior viewing experience is growing. In addition to traditional mobile phones, tablets, and TVs, screen projection is gradually becoming a new option for viewers to experience film and television works. The diversity and advanced features of this screen projection method, such as from traditional video client projection to TVs to more integrated multi-screen collaboration technology, are continuously expanding its scope and depth of application.

[0037] Currently, multi-screen collaboration technology primarily uses video streaming for screen projection. This method captures each frame and dynamically transmits it to the sink, which is then decoded by a decoder and displayed on a SurfaceView. While this method is technically feasible, it does not perform any special processing or optimization on the video itself.

[0038] That is to say, the multi-screen collaboration technologies currently on the market are mainly focused on achieving the transmission and interaction of two-dimensional (2D) images. Although these technologies support users to display the content of the source end in the form of a window on the sink end, and allow the source end device to be operated on the sink end to achieve cross-device transmission of files, they have some significant limitations. In particular, these technologies usually only provide a standard two-dimensional screen projection experience, and therefore lack visual depth and richness. More importantly, due to the limited response speed and data processing capabilities of some technologies when dealing with highly dynamic and complex scenes, they have encountered technical obstacles in ensuring a smooth and synchronized multi-screen interactive experience. This not only limits the improvement of user experience, but also hinders the development of multi-screen technology in a wider range of application scenarios, especially in environments that require high dynamics and interactivity.

[0039] In order to solve the above problems, the embodiment of the present disclosure provides a method for displaying a projection screen, which is applied to a multi-screen collaborative scenario. By replacing the traditional projection screen surface control, a naked eye 3D algorithm is used to generate a new, 3D-processed surface control. The data processed in this way is then input into the original decoder, thereby achieving a unique 3D display effect on the projection screen device. In addition to the improvement in display effect, a new human-computer interaction experience can also be developed through the eye position data captured by the camera. That is to say, in a multi-screen collaborative framework, the present disclosure can achieve efficient data transmission from a source device (such as a mobile phone) to a receiving device (such as a tablet computer), and a new, 3D-processed surface control is generated by adopting a naked eye 3D algorithm. The data processed in this way is then input into the original decoder, thereby achieving a unique 3D display effect on the projection screen device, presenting content with a new 3D visual effect. In this way, in addition to simple picture transmission, deep 3D processing and optimization of the source data by the receiving end can provide users with an immersive viewing experience. Moreover, when processing naked-eye 3D images, the camera of the projection device can expand the human-computer interaction experience (such as adding somatosensory interaction) in many fields, especially in the gaming field, by capturing the user's eye position data and body movement data in real time, allowing users to interact with 3D scenes more realistically.

[0040] It should be noted that the embodiment of the present disclosure can directly transmit the 3D layout information of the mobile phone to the smart TV or TV box, so that the mobile phone can work seamlessly with various Android devices, with a wide range of applications, providing users with an unprecedented visual interaction experience.

[0041] The implementation environment of the embodiments of the present disclosure is introduced below.

[0042] As shown in FIG1 , which is a schematic diagram of a communication system provided in an embodiment of the present disclosure, the communication system may include: a second device (eg, a transmitting end 101 ) and a first device (eg, a receiving end 102 ).

[0043] The receiving end 102 can perform wired / wireless communication (such as Wi-Fi (wireless fidelity) or other short-range communication technologies) with the transmitting end 101, and the receiving end 102 has a display screen that supports naked-eye 3D display.

[0044] In the disclosed embodiment, the transmitting end 101 may display a two-dimensional image of the screen to be projected and send the two-dimensional image encoding data of the screen to be projected to the receiving end 102. The receiving end 102 may then convert the two-dimensional image encoding data of the screen to be projected into three-dimensional image encoding data of the screen to be projected, and configure an interface object for projecting and displaying the three-dimensional image based on the three-dimensional image encoding data of the screen to be projected, thereby obtaining a three-dimensional image of the screen to be projected. The receiving end 102 may then display the three-dimensional image of the screen to be projected.

[0045] In some embodiments, receiving end 102 further includes a camera. After receiving end 102 receives the 2D image encoding data of the screen to be projected from transmitting end 101, receiving end 102 may collect the user's eye position data through the camera. Subsequently, when receiving end 102 converts the 2D image encoding data of the screen to be projected into 3D image encoding data of the screen to be projected, receiving end 102 may provide a reference for viewing angle when converting the 2D image of the screen to be projected into 3D image encoding data based on the user's eye position data, thereby obtaining the 3D image encoding data of the screen to be projected.

[0046] It should be noted that the embodiments of the present disclosure do not limit the screen to be projected. For example, the screen to be projected can be an application (APP) interface. For another example, the screen to be projected can be a desktop icon. For another example, the screen to be projected can be the video content, game content, etc. of the APP.

[0047] It's important to note that interface objects represent the visual elements through which users interact with computer programs. In the design and implementation of graphical user interfaces, an interface object can be any visible or operable component, such as buttons, text boxes, menus, scroll bars, windows, dialog boxes, and so on. Furthermore, in modern programming languages ​​and frameworks, interface objects are typically encapsulated into classes or components. By instantiating these classes, specific interface elements can be created, and their behavior and appearance can be adjusted as needed, thereby building a rich and diverse application interface.

[0048] It should be noted that in the embodiments of the present disclosure, the transmitting end 101 may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook computer, or other device with transceiver functions. The embodiments of the present disclosure do not impose any particular limitation on the form of the transmitting end 101. The transmitting end 101 can interact with the user through one or more methods such as a keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0049] After introducing the application scenarios and implementation environment of the embodiment of the present disclosure, the display method of the projection screen provided by the embodiment of the present disclosure is introduced in detail in combination with the above-mentioned implementation environment.

[0050] An embodiment of the present disclosure provides a method for displaying a projection screen. As shown in FIG2 , the method for displaying a projection screen may include: S201 - S203 .

[0051] S201: A first device establishes a communication connection with a second device.

[0052] In one implementation, the second device has a screen projection function for projecting a screen image to another device. In response to a user's activation of the screen projection function, the second device can obtain the identifiers of multiple devices to be projected within a preset range, where the multiple devices to be projected include the first device. Then, the second device can establish a communication connection with the first device in response to a user's operation on the identifier of the first device (such as a click operation, an input operation, etc.).

[0053] It should be noted that the embodiments of the present disclosure do not limit the device identifier. For example, the device identifier may be the device name. For another example, the device identifier may be the device serial number. For another example, the device identifier may be the device network address.

[0054] In an embodiment of the present disclosure, the first device also has a screen projection function. Before the second device establishes a communication connection with the first device, the second device can send a first message to the first device to notify the start of screen projection in response to the user's operation of the identifier of the first device. Then, the first device can respond to the first message from the second device, turn on the screen projection function, and run the bus service of the screen projection function, so that the bus service of the screen projection function in the second device and the bus service of the screen projection function in the first device are in operation at the same time, and the second device and the first device establish a screen projection connection with each other, and then establish a communication connection between the first device and the second device.

[0055] S202: The second device displays a two-dimensional image of the target screen.

[0056] In one implementation, the second device stores multiple objects to be projected. In response to a user operation (e.g., a click operation) on a target object among the multiple objects to be projected, the second device can run the target object and obtain two-dimensional image encoding data of the target screen when the target object is running, and then locally display the two-dimensional image of the target screen based on the two-dimensional image encoding data of the target screen.

[0057] That is to say, the target screen is a real-time view screen of the target object in the running state.

[0058] It should be noted that the embodiments of the present disclosure do not limit the target object. For example, the target object may be an app in a device. For another example, the target object may be a system desktop in a device. For another example, the target object may be a document file, a video file, etc. in a device.

[0059] In an embodiment of the present disclosure, a second device may include a display screen for displaying a screen image and a first interface object with a two-dimensional display effect. The second device may call the first interface object on the display screen, configure the first interface object on the display screen based on the two-dimensional image encoding data of the target screen, obtain the two-dimensional image of the target screen, and then display the two-dimensional image of the target screen on the display screen.

[0060] It should be noted that, for the process of the second device configuring the first interface object in the display screen according to the two-dimensional image coding data of the target screen, reference can be made to the introduction of configuring interface objects in some technologies, which will not be repeated here.

[0061] In some embodiments, after establishing a screen projection connection with the first device, the second device may, in response to a user's operation on a target object among multiple objects to be projected, display a prompt box containing a three-dimensional display button and a two-dimensional display button to inquire about the screen projection display effect of the target screen. Then, in response to the user clicking the three-dimensional display button in the prompt box, the second device may generate a screen projection operation instruction and send the screen projection operation instruction to the first device. The screen projection operation instruction is used to instruct the first device to project and display a three-dimensional image of the target screen. Thereafter, the first device may execute S203 in response to the screen projection operation instruction from the second device.

[0062] S203: The first device displays a three-dimensional image of the target screen.

[0063] In one implementation, the first device may include a display screen for displaying a screen image and a second interface object for projecting the displayed image. The first device may activate the display screen and call the second interface object in response to a projection operation instruction from the second device. The first device may then obtain image encoding data of a target screen from the second device, configure the second interface object on the display screen based on the image encoding data of the target screen, obtain a three-dimensional image of the target screen, and project the three-dimensional image of the target screen through the display screen.

[0064] In an embodiment of the present disclosure, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0065] If the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device based on the screen projection operation instruction, then the second interface object is an interface object with a two-dimensional display effect, and the image coding data of the target screen is three-dimensional image coding data.

[0066] If the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device based on the projection operation instruction, then the second interface object is a preset interface object for projecting and displaying the three-dimensional image (that is, an interface object with a three-dimensional display effect), and the image coding data of the target screen is two-dimensional image coding data.

[0067] It is understandable that the second device establishes a communication connection with the first device, and sends a projection operation instruction to the first device to instruct the first device to display the three-dimensional image of the screen to be projected in the second device, so that the second device displays the two-dimensional image of the screen to be projected, and the first device displays the three-dimensional image of the screen to be projected. The three-dimensional image of the screen to be projected is obtained by the first device or the second device converting the two-dimensional image of the screen to be projected based on the projection operation instruction. In this way, the dimensional conversion of the projected screen in multi-screen collaboration can be achieved, which improves the user's projection experience.

[0068] In some embodiments, the first device and the second device can determine that the two-dimensional image of the target screen is converted and processed by either the first device or the second device based on the idle computing resources of both parties and the stability of the communication link between the two parties, thereby realizing the conversion processing of the two-dimensional image of the target screen to obtain a three-dimensional image of the target screen.

[0069] It should be noted that, in the process of determining whether the two-dimensional image of the target screen is converted and processed by any one of the first device and the second device, the conversion processing of the two-dimensional image of the target screen can be determined by the second device, or the conversion processing of the two-dimensional image of the target screen can be determined by the first device.

[0070] The following takes the second device as an example and describes, in combination with specific examples, a process of determining whether the two-dimensional image of the target screen is converted and processed by any one of the first device and the second device.

[0071] In the embodiment of the present disclosure, in the above S201, the second device may obtain the computing power value of the second device and the computing power value of the first device. The computing power value of the second device is used to indicate the idle computing power resources in the second device, and the computing power value of the first device is used to indicate the idle computing power resources in the first device.

[0072] In one implementation, the second device may obtain idle computing resources in the second device, and determine the computing power value of the second device based on the idle computing resources in the second device.

[0073] In one implementation, the first message may include first information for querying computing resources. The second device sends the first message including the first information to the first device, so that the first device, in response to the first information in the first message, obtains the idle computing resources of the first device and determines the computing power value of the first device based on the idle computing resources of the first device. The first device can then send a callback notification containing the computing power value of the first device back to the second device, so that the second device can obtain the computing power value of the first device from the callback notification received from the first device.

[0074] It should be noted that in the embodiments of this disclosure, the computing power of a device is directly proportional to its idle computing resources. That is, a device with a higher computing power value has more idle computing resources, while a device with a lower computing power value has fewer idle computing resources.

[0075] In an embodiment of the present disclosure, as shown in FIG3 , after S201 , the method for displaying the projection image may further include: S301 - S308 .

[0076] S301: A second device obtains a stable value of a communication link between a first device and a second device.

[0077] The stability value of the communication link between the first device and the second device is used to indicate the stability of the communication link between the first device and the second device.

[0078] It should be noted that in the embodiments of the present disclosure, the stability value of a communication link is proportional to its stability. That is, a communication link with a larger stability value has a better stability; a communication link with a smaller stability value has a worse stability.

[0079] In the embodiment of the present disclosure, the stable value of the communication link between the first device and the second device may be any of the following parameter values: bit error rate, packet loss rate, path loss value, effective isotropic radiated power, etc.

[0080] In one implementation, the second device can monitor the communication link between the second device and the first device in real time or periodically test it, and determine the stable value of the communication link between the second device and the first device through statistical analysis and prediction algorithms, thereby obtaining the stable value of the communication link between the second device and the first device.

[0081] S302: The second device determines whether the computing power value of the first device is greater than the computing power value of the second device.

[0082] S303: The second device determines whether a stability value of the communication link between the first device and the second device is less than a preset threshold.

[0083] In one implementation, the second device stores a preset threshold, and the second device can compare the stability value of the communication link between the first device and the second device determined by the second device with the stored preset threshold to determine whether the stability value of the communication link between the first device and the second device is less than the preset threshold.

[0084] In some embodiments, when the second device determines that the computing power value of the first device is greater than the computing power value of the second device, and the stability value of the communication link between the first device and the second device is less than a preset threshold, the second device determines that the two-dimensional image of the target screen is converted and processed by the first device, and executes S304 after S202.

[0085] S304: The second device obtains the two-dimensional image encoding data of the target picture.

[0086] In one implementation, the second device may collect data on the displayed two-dimensional image of the target screen to obtain two-dimensional image encoding data of the target screen.

[0087] S305: The second device sends the two-dimensional image encoding data of the target picture to the first device.

[0088] S306: The first device obtains the two-dimensional image coding data of the target picture in the second device.

[0089] In the embodiment of the present disclosure, the first device receives the two-dimensional image encoding data of the target picture from the second device to obtain the two-dimensional image encoding data of the target picture in the second device.

[0090] S307: The first device converts the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture.

[0091] In one implementation, a camera is deployed in a first device. During the process of converting 2D image coded data of a target screen into 3D image coded data of the target screen, the first device may collect eye position data of a user within a field of view via the camera, and convert the 2D image coded data of the target screen into 3D image coded data of the target screen based on the eye position data. The eye position data is used to provide a reference for the viewing angle of the 3D image during the dimensional conversion process.

[0092] It should be noted that, for the process of the first device converting the two-dimensional image coding data of the target screen into the three-dimensional image coding data of the target screen, reference can be made to the introduction of the conversion from two-dimensional image coding data to three-dimensional image coding data in some technologies, which will not be repeated here.

[0093] S308. The first device configures a preset interface object for projecting and displaying a three-dimensional image according to the three-dimensional image encoding data of the target screen, and obtains the three-dimensional image of the target screen.

[0094] In one implementation, a first device is deployed with a 3D control, and the 3D control includes a preset interface object (i.e., a 3D interface object). The first device can call the preset interface object from the 3D control for the first device's display screen to replace the initial interface object used to display a two-dimensional image on the first device. The first device can then configure the preset interface object on the display screen based on the 3D image encoding data of the target screen, thereby obtaining a three-dimensional image of the target screen.

[0095] In the embodiment of the present disclosure, after the first device obtains the three-dimensional image of the target screen, the first device may execute S203 through a preset interface object on the display screen.

[0096] It is understood that if the computing power of the first device is higher than that of the second device and the communication link between the first and second devices is unstable, the 3D image of the screen to be projected is obtained by converting the 2D image of the screen to be projected by the first device based on the projection operation instruction. In this way, the computing power of the second device for dimensional conversion can be transferred to the first device, reducing the computing power load of the second device during the projection process.

[0097] In other embodiments, as shown in Figure 4, after S302 and S303, if the second device determines that the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to the preset threshold, then the second device determines that the two-dimensional image of the target screen is converted and processed by the second device, and after S304, the second device can obtain a three-dimensional image of the target screen through the following S401-S402.

[0098] S401: The second device converts the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture.

[0099] In one implementation, the second device may interact with the first device to obtain the user's eye position data collected by the first device, and convert the two-dimensional image coding data of the target screen into three-dimensional image coding data of the target screen based on the eye position data.

[0100] In some embodiments, the second device may send a second message to the first device requesting the user's eye position data, so that the first device responds to the second message, collects the user's eye position data within the field of view through the camera, and feeds back a callback notification carrying the user's eye position data to the second device, thereby enabling the second device to obtain the user's eye position data from the callback notification from the first device.

[0101] S402: The second device configures a virtual interface object according to the three-dimensional image coding data of the target picture to obtain a three-dimensional image of the target picture.

[0102] In one implementation, the second device is deployed with a 3D control, and the 3D control includes a virtual interface object (i.e., a 3D interface object) for displaying a three-dimensional image on a virtual screen. The second device can create a virtual screen in a background space and call the virtual interface object for the virtual screen from the 3D control to replace the initial interface object used to display a two-dimensional image on the second device. The second device can then configure the virtual interface object on the virtual screen based on the three-dimensional image encoding data of the target screen to obtain the three-dimensional image of the target screen.

[0103] In the embodiment of the present disclosure, after the second device obtains the three-dimensional image of the target screen, the second device and the first device may go through the following S403-S406 to enable the first device to execute S203.

[0104] S403: The second device obtains target image coding data of a three-dimensional image of a target picture.

[0105] In one implementation, after the second device obtains the three-dimensional image of the target screen, the second device can display the three-dimensional image of the target screen through a virtual interface object on the virtual screen, and obtain target image encoding data by collecting data of the three-dimensional image of the target screen displayed on the virtual screen.

[0106] S404: The second device sends target image encoding data to the first device.

[0107] S405: The first device receives target image encoding data from the second device.

[0108] In the embodiment of the present disclosure, S203 may include: S406.

[0109] S406: The first device configures a preset interface object according to the target image coding data and displays the three-dimensional image of the target picture.

[0110] In one implementation, the first device may configure a preset interface object according to the target image coding data, obtain a three-dimensional image of the target screen, and display the three-dimensional image of the target screen through the preset interface object on the display screen.

[0111] In some embodiments, the first device may configure an initial interface object in the first device according to the target image encoding data, obtain a three-dimensional image of the target screen, and display the three-dimensional image of the target screen through the initial interface object in the display screen.

[0112] It is understood that if the computing power of the first device is lower than that of the second device and the communication link between the first and second devices is relatively stable, the 3D image of the screen to be projected is obtained by the second device converting the 2D image of the screen to be projected based on the projection operation instruction. This ensures that the first device can display the 3D image of the screen to be projected in a timely manner.

[0113] In some embodiments, if the second device determines that the computing power value of the first device is greater than the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the second device may inquire the user about the device that converts the two-dimensional image of the target screen by displaying a prompt box containing the identifier of the first device and the identifier of the second device. Afterwards, the second device may respond to the user's operation (such as a click operation, an input operation, etc.) on the identifier of the second device (or the identifier of the first device) in the prompt box, and determine that the two-dimensional image of the target screen is converted by the device indicated by the operation.

[0114] In some embodiments, after the second device displays the prompt box, the second device can determine, by timing, whether an operation of the user on the device identifier in the prompt box is received within a preset time.

[0115] If the second device determines that an operation on the device identifier in the prompt box is received from the user within a preset time, the second device determines that the two-dimensional image of the target screen is converted by the device indicated by the operation.

[0116] If the second device determines that it has not received the user's operation on the device identifier in the prompt box within a preset time, the second device can determine that the two-dimensional image of the target screen is converted and processed by the default device between the first device and the second device. The default device can be the sending end in the screen projection process (such as the second device), or the default device can be the receiving end in the screen projection process (such as the first device).

[0117] Similarly, if the second device determines that the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is less than a preset threshold, the second device can inquire the user about the device that converts the two-dimensional image of the target screen by displaying a prompt box containing the identifier of the first device and the identifier of the second device. Afterwards, the second device can respond to the user's operation (such as a click operation, an input operation, etc.) on the identifier of the second device (or the identifier of the first device) in the prompt box and determine that the two-dimensional image of the target screen is converted by the device indicated by the operation.

[0118] It can be understood that in the process of projecting the screen from the second device to the first device, the operability of the projected display can be improved by adding a device that manually determines the conversion processing of the picture.

[0119] In some embodiments, the second device stores a preset whitelist that includes identifiers of multiple preset objects that are allowed to be projected. After the second device establishes a communication connection with the first device, the second device can determine whether to project the target image by determining whether the preset whitelist includes the identifier of the target object.

[0120] In one implementation, when the second device determines that the preset whitelist includes the identifier of the target object, the second device can send a screen projection operation instruction to the first device.

[0121] In one implementation, when the second device determines that the identifier of the target object is not included in the preset whitelist, the second device may not send the screen projection operation instruction to the first device, and display a prompt box indicating that the target object is not authorized to project the screen.

[0122] It is understandable that by authenticating the projection object through the whitelist, the authorized object can be projected and displayed. In this way, the security of the projection display can be improved.

[0123] The following describes the method for displaying the projection screen provided by the embodiment of the present disclosure, taking the second device as the execution subject. As shown in FIG5 , the method for displaying the projection screen may include: S501 - S502 .

[0124] S501: The second device establishes a communication connection with the first device.

[0125] It should be noted that, for the process of establishing a communication connection between the second device and the first device, reference may be made to the introduction of establishing a communication connection between the second device and the first device in S201 above, which will not be described in detail here.

[0126] In some embodiments, after the second device establishes a communication connection with the first device, the second device may execute S502.

[0127] S502. The second device sends a screen projection operation instruction to the first device, so that the first device displays a three-dimensional image of the target screen.

[0128] It should be noted that, for the process of the second device sending a screen projection operation instruction to the first device so that the first device displays a three-dimensional image of the target screen, reference can be made to the processes S301-S406 in the embodiment shown in FIG4 above, which will not be repeated here.

[0129] The following describes the method for displaying a projection screen provided by an embodiment of the present disclosure, taking the first device as the execution subject. As shown in FIG6 , the method for displaying a projection screen may include: S601 - S602 .

[0130] S601: A first device establishes a communication connection with a second device.

[0131] It should be noted that, for the process of establishing a communication connection between the first device and the second device, reference may be made to the introduction of establishing a communication connection between the second device and the first device in S201 above, which will not be described in detail here.

[0132] S602. After receiving the screen projection operation instruction sent by the second device, the first device projects and displays a three-dimensional image of the target screen.

[0133] It should be noted that, for the process of the first device projecting and displaying the three-dimensional image of the target screen after receiving the projection operation instruction sent by the second device, reference can be made to the process S306-S308 or S405-S406 in the embodiment shown in FIG4 above, which will not be repeated here.

[0134] It is understandable that, when the second device displays the 2D image of the projected screen, the first device can convert the 2D image encoding data of the projected screen to obtain the 3D image encoding data of the projected screen, and then display the 3D image of the projected screen based on the 3D image encoding data of the projected screen. In this way, the dimensional conversion of the projected screen in multi-screen collaboration can be achieved, improving the user's screen projection experience.

[0135] In combination with the above-mentioned introduction that the second device determines that the two-dimensional image of the target screen is converted and processed by either the second device or the first device, the following takes the first device as an example and combines specific examples to introduce the process of determining that the two-dimensional image of the target screen is converted and processed by either the first device or the second device.

[0136] In an embodiment of the present disclosure, before a first device establishes a communication connection with a second device, the first device may obtain a computing power value of the second device and a computing power value of the first device.

[0137] In one implementation, the first device may receive a first message including first information from the second device, and in response to the first information in the first message, obtain idle computing resources in the first device, and determine the computing power value of the first device based on the idle computing resources in the first device.

[0138] In some embodiments, before the second device sends a first message to the first device, the second device determines the computing power value of the second device by obtaining idle computing resources in the second device. Subsequently, when the second device sends the first message to the first device, the second device may include the computing power value of the second device in the first message, so that the first device obtains the computing power value of the second device from the first message received from the second device.

[0139] In an embodiment of the present disclosure, referring to the process of executing S301-S303 by the above-mentioned second device, the first device can obtain the stability value of the communication link between the first device and the second device, and determine whether the computing power value of the first device is greater than the computing power value of the second device, and whether the stability value of the communication link between the first device and the second device is less than a preset threshold, and then determine the device in the first device and the second device that performs conversion processing on the two-dimensional image of the target screen.

[0140] In one implementation, when the first device determines that the first device is to convert the two-dimensional image of the target screen, the first device may send a third message to the second device for requesting the encoded data of the two-dimensional image of the target screen, so that the second device responds to the third message, executes the above S304-S305, and then executes S306-S308 through the first device to obtain a three-dimensional image of the target screen.

[0141] In one implementation, when the first device determines that the second device is to convert the two-dimensional image of the target screen, the first device may send a third message to the second device for requesting the encoded data of the three-dimensional image of the target screen, so that the second device responds to the third message and executes the above S304-S402 to obtain the three-dimensional image of the target screen.

[0142] In the embodiment of the present disclosure, the second device executes S403-S404 above, so that the first device executes S405 to obtain the target coded data of the 3D image of the target picture, and executes S406 to display the 3D image of the target picture.

[0143] The following describes the method for displaying the projection screen provided by the embodiment of the present disclosure with reference to specific examples. As shown in Figure 7, the sending end establishes a Wi-Fi peer-to-peer (Wi-Fi P2P) connection with the multi-screen collaborative service of the receiving end through the multi-screen collaborative service of the sending end, so that the receiving end receives the screen to be projected from the sending end through the multi-screen collaborative service, and outputs a three-dimensional image of the screen to be projected through the three-dimensional control in the receiving end.

[0144] Exemplarily, taking the Android system as an example, FIG8 shows a screen projection interaction process between a sending end and a receiving end.

[0145] The sender notifies the receiver to start screen projection. The sender and receiver communicate via remote procedure call (RPC) to transmit basic device information (i.e., the device's computing power). The receiver returns this information to the sender via a callback and starts the bus service, preparing to establish a screen projection connection. Then, after receiving the sender's notification to start screen projection, the receiver starts the projection window and obtains the 3D interface object.

[0146] At this point, the receiving end will determine the interface object to use based on the sender's judgment of the screen projection application. If the screen projection application is on the whitelist, the system's own interface object will be replaced with the three-dimensional interface object in the 3D control.

[0147] In some embodiments, if the screen projection application is an application outside the whitelist, the system's own interface object (such as a normal Surface) is obtained.

[0148] Afterwards, after the projection window is prepared, the receiving end can send a callback notification that the projection window is ready to the sending end again, so that the sending end and the receiving end can establish a projection connection, start recording and encoding the screen of the projection application, and transmit the encoded data to the receiving end through a non-unique communication method.

[0149] The receiving end configures the previously acquired three-dimensional interface object in the decoder based on the data transmitted by the sending end, and decodes and plays it.

[0150] At this time, the interface object configured in the decoder is the 3D interface object in the 3D control, and the played picture is 3D processed by the 3D interface object, so it can show a 3D effect.

[0151] In some embodiments, if the interface object configured in the decoder is a system-provided interface object, the played image is not 3D processed and therefore cannot display a 3D effect.

[0152] In some embodiments, FIG9 shows another screen projection interaction process between a transmitting end and a receiving end, so that the receiving end can migrate the computing power of 3D processing to the transmitting end.

[0153] The sender notifies the receiver to start screen projection. The sender and receiver transmit basic device information (i.e., the device's computing power) through RPC communication. The receiver returns this information to the sender through a callback and starts the bus service to prepare for establishing a screen projection connection. Then, after receiving the notification from the sender to start screen projection, the receiver starts the screen projection window, obtains the corresponding interface object of the system, and sends a callback notification to the sender that the screen projection window has been prepared.

[0154] Afterwards, the sending end can determine whether the screen projection application is in the whitelist, determine the screen dimensions displayed by the screen projection application on the receiving end, and send the screen projection data of the corresponding dimensions to the receiving end.

[0155] If the screen projection application is an application outside the whitelist, the sending end determines that the screen dimension displayed by the screen projection application on the receiving end is two-dimensional, and directly encodes the screen projection of the screen projection application, and then transmits the encoded data to the receiving end so that the receiving end decodes and plays the 2D screen of the screen projection application.

[0156] If the screen projection application is an application in the whitelist, the sender determines that the screen dimension displayed by the screen projection application on the receiving end is three-dimensional and creates a virtual screen. Then, the sender uses a three-dimensional interface object to replace the system's own interface object. At the same time, the receiving end collects eye position data through the camera and transmits it back to the sender, so that the sender obtains the eye position data. After that, the sender plays the eye position data captured by the camera on the virtual screen configured with the three-dimensional interface object, encodes the three-dimensional processed screen projection data, and transmits the encoded data to the receiving end, so that the receiving end decodes and plays the transmitted data to display the 3D effect.

[0157] It should be noted that Figures 8 and 9 illustrate two solutions. The solution in Figure 8 has lower communication quality requirements but higher hardware requirements on the receiving end. The solution in Figure 9 has lower hardware requirements on the receiving end but higher hardware requirements on the sending end and Wi-Fi communication quality. This disclosure automatically determines which solution to use based on on-site device information. If the hardware level of the sending and receiving ends is comparable, the solution in Figure 8 is preferred to minimize data transmission.

[0158] In summary, the present disclosure can project various display contents (such as APP interface, operating system interface, video, game, etc.) on the source end to the sink end to display naked-eye 3D images. Moreover, the present disclosure can be particularly applied to certain mobile game scenarios, by projecting the mobile phone screen to the large-screen device to display the naked-eye 3D effect and perform real somatosensory interaction, providing users with a highly interactive and immersive 3D experience. In other words, the present disclosure has shown significant advantages in improving user experience. The present disclosure not only supports standard multi-screen collaboration functions, but also introduces naked-eye 3D technology, which means that users can enjoy a stereoscopic 3D visual experience on the sink end device without any additional 3D glasses. On the large-screen device, you can not only watch the 3D content projected from the mobile phone, but also directly operate the mobile phone. Some somatosensory games can even capture position data through the camera of the large-screen device for somatosensory interaction. In this way, a highly interactive and immersive 3D experience is provided to users.

[0159] It is understandable that, in order to realize the above functions, the display device of the projection screen includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0160] The embodiment of the present disclosure can divide the display device of the projection screen into functional modules according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0161] FIG10 is a schematic diagram of the structure of a projection screen display device provided by an embodiment of the present disclosure. The projection screen display device 1000 can execute the method executed by the second device in the projection screen display method shown in FIG2, FIG3, and FIG4. As shown in FIG10, the projection screen display device 1000 includes: a communication module 1001.

[0162] Communication module 1001 is configured to, after establishing a communication connection with a first device, send a screen projection operation instruction to the first device, causing the first device to project and display a 3D image of a target screen. The screen projection operation instruction instructs the first device to project and display a 3D image of the target screen. The 3D image of the target screen is obtained by converting a 2D image of the target screen by the first device or the second device based on the screen projection operation instruction.

[0163] In some embodiments, when the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device.

[0164] In some embodiments, the display device 1000 for projecting an image further includes: an acquisition module 1002 and a processing module 1003. Acquisition module 1002 is configured to acquire 2D image encoding data of a target image. Processing module 1003 is configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image. Processing module 1003 is further configured to configure a virtual interface object based on the 3D image encoding data of the target image to obtain a 3D image of the target image.

[0165] In some embodiments, acquisition module 1002 is further configured to acquire eye position data of the user collected by the first device. The eye position data is used to provide a reference for viewing the 3D image during the dimensional conversion process. Processing module 1003 is configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image based on the eye position data.

[0166] In some embodiments, the display apparatus 1000 for projecting an image further includes a sending module 1004. The acquisition module 1002 is further configured to acquire target image encoding data of a 3D image of a target image. The sending module 1004 is configured to send the target image encoding data to the first device, so that the first device displays the 3D image of the target image based on the target image encoding data.

[0167] In some embodiments, the processing module 1003 is further configured to determine whether a preset whitelist includes a target object corresponding to the target screen. The sending module 1004 is further configured to send a screen projection operation instruction to the first device if the preset whitelist includes the target object.

[0168] Figure 11 is a schematic diagram of the structure of a projection screen display device provided in an embodiment of the present disclosure. Projection screen display device 1100 can execute the method executed by the first device in the projection screen display method shown in Figures 2, 3, and 4. As shown in Figure 11, projection screen display device 1100 includes: a communication module 1101 and a display module 1102.

[0169] The communication module 1101 is configured to establish a communication connection with the second device. The display module 1102 is configured to project and display a 3D image of the target screen upon receiving a projection operation instruction from the second device. The 3D image of the target screen is obtained by converting a 2D image of the target screen by the first device or the second device based on the projection operation instruction. The projection operation instruction is used to instruct the first device to project and display the 3D image of the target screen.

[0170] In some embodiments, when the computing power value of the first device is greater than the computing power value of the second device and the stability value of the communication link between the first device and the second device is less than a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device.

[0171] In some embodiments, the display device 1100 for projecting an image further includes an acquisition module 1103 and a processing module 1104. Acquisition module 1103 is configured to acquire 2D image encoding data of a target image from a second device. Processing module 1104 is configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image. Processing module 1104 is further configured to configure a preset interface object for projecting and displaying a 3D image based on the 3D image encoding data of the target image, thereby obtaining a 3D image of the target image.

[0172] In some embodiments, acquisition module 1103 is further configured to collect eye position data of the user. This eye position data is used to provide a reference for viewing the 3D image during the dimensional conversion process. Processing module 1104 is configured to convert the 2D image encoding data of the target image into 3D image encoding data of the target image based on the eye position data.

[0173] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiments of the present disclosure provide another network device structure of the display device for the screen projection involved in the above-mentioned embodiments. As shown in Figure 12, the screen projection display device 1200 includes: a memory 1201, a processor 1202, a communication interface 1203, and a bus 1204.

[0174] The memory 1201 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store dynamic information and instructions, an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0175] The processor 1202 may be a logic block, module, and circuit that implements or executes the various exemplary methods described in conjunction with the embodiments of the present disclosure. The processor 1202 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processor 1202 may also implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present disclosure. The processor 1202 may also be a combination that implements computing functions, for example, a combination of one or more microprocessors, a combination of a DSP (digital signal processor) and a microprocessor, and the like.

[0176] The communication interface 1203 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, or wireless local area network (WLAN).

[0177] In one implementation, the memory 1201 may exist independently of the processor 1202, and the memory 1201 may be connected to the processor 1202 via a bus 1204 for storing instructions or program codes. When the processor 1202 calls and executes the instructions or program codes stored in the memory 1201, the method for displaying the projection screen provided in the embodiment of the present disclosure can be implemented.

[0178] In one implementation, the memory 1201 may also be integrated with the processor 1202 .

[0179] Bus 1204 can be an Extended Industry Standard Architecture (EISA) bus, for example. Bus 1204 can be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, FIG12 shows bus 1204 using only a single bold line. This does not imply that there is only one bus or only one type of bus.

[0180] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the method for displaying a projection image as described in any of the above embodiments.

[0181] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0182] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the method for displaying a projection image as described in any of the above embodiments.

[0183] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A method for displaying a projection image, applied to a first device, wherein: The method comprises: establishing a communication connection with a second device; After receiving the screen projection operation instruction sent by the second device, projecting and displaying the three-dimensional image of the target screen; Among them, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction, and the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be projected and displayed on the first device.

2. The method according to claim 1, wherein When the computing power value of the first device is greater than the computing power value of the second device and the stability value of the communication link between the first device and the second device is less than a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device.

3. The method according to claim 2, wherein: When the computing power of the first device is greater than the computing power of the second device, and the stability value of the communication link between the first device and the second device is less than the preset threshold, the method further includes: Acquiring two-dimensional image encoding data of the target picture in the second device; Converting the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture; According to the three-dimensional image coding data of the target screen, a preset interface object for projecting and displaying the three-dimensional image is configured to obtain the three-dimensional image of the target screen.

4. The method according to claim 3, wherein: The converting the two-dimensional image coding data of the target picture into the three-dimensional image coding data of the target picture includes: Collecting user's eye position data, wherein the eye position data is used to provide a reference for viewing angle of the three-dimensional image during the dimensional conversion process of the picture; The two-dimensional image encoding data of the target picture is converted into three-dimensional image encoding data of the target picture according to the eye position data.

5. A method for displaying a projection image, applied to a second device, wherein: The method comprises: After establishing a communication connection with the first device, sending a screen projection operation instruction to the first device so that the first device projects and displays a three-dimensional image of the target screen; Among them, the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be projected and displayed on the first device; the three-dimensional image of the target screen is obtained by the first device or the second device converting the two-dimensional image of the target screen based on the screen projection operation instruction.

6. The method according to claim 5, wherein: When the computing power value of the first device is less than or equal to the computing power value of the second device, and the stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the second device.

7. The method according to claim 6, wherein: When the computing power of the first device is less than or equal to the computing power of the second device, and a stability value of the communication link between the first device and the second device is greater than or equal to a preset threshold, the method further includes: Acquiring two-dimensional image coding data of the target picture; Converting the two-dimensional image coding data of the target picture into three-dimensional image coding data of the target picture; A virtual interface object is configured according to the three-dimensional image coding data of the target screen to obtain a three-dimensional image of the target screen.

8. The method according to claim 7, wherein: The converting the two-dimensional image coding data of the target picture into the three-dimensional image coding data of the target picture includes: Acquiring eye position data of the user collected by the first device, wherein the eye position data is used to provide a reference for a viewing angle of a three-dimensional image during a dimensional conversion process of the image; The two-dimensional image encoding data of the target picture is converted into three-dimensional image encoding data of the target picture according to the eye position data.

9. The method according to claim 7, wherein: After configuring the virtual interface object according to the three-dimensional image coding data of the target screen to obtain the three-dimensional image of the target screen, the method further includes: Target image coding data of the three-dimensional image of the target picture is acquired, and the target image coding data is sent to the first device, so that the first device displays the three-dimensional image of the target picture according to the target image coding data.

10. The method according to claim 5, wherein After establishing the communication connection with the first device, the method further includes: Determining whether a preset whitelist includes a target object corresponding to the target screen; When the target object is included in the preset whitelist, the screen projection operation instruction is sent to the first device.

11. A method for displaying a projection image, comprising: The first device establishes a communication connection with the second device; The first device displays a three-dimensional image of a target screen, and the second device displays a two-dimensional image of the target screen; Among them, the three-dimensional image of the target screen is obtained by converting the two-dimensional image of the target screen by the first device or the second device based on the screen projection operation instruction, and the screen projection operation instruction is used to instruct the three-dimensional image of the target screen to be displayed on the first device.

12. A screen projection display system, comprising: A first device and a second device; wherein, the first device and the second device both store executable instructions; when the first device and the second device execute the instructions, they execute the method for displaying the projection screen according to claim 11.

13. An electronic device comprising: A memory and a processor; wherein the memory and the processor are coupled; the memory is used to store instructions executable by the processor; when the processor executes the instructions, it executes the method for displaying the projection screen according to any one of claims 1-10.

14. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the computer executes the method for displaying a projection screen according to any one of claims 1-11.

Citation Information

Patent Citations

  • Display method, system and equipment of projection screen picture and storage medium

    CN120455769A

  • Event processing and terminal controlling methods and devices

    CN106210869A

  • Video playing method and device, storage medium and computer equipment

    CN109561333A

  • Screen projection picture processing method and related device

    CN117440194A

  • Video communication system and video communication method

    JP2014086775A