An image processing method, device and storage medium

Abstract

The application discloses an image processing method, device and storage medium, comprising: writing first screen image data corresponding to a screen displayed picture into a device file arranged in an operating system, wherein the device file corresponds to a system camera associated with a first application program, wherein the first application program is used for converting two-dimensional displayed image data into three-dimensional displayed image data; and reading the first screen image data from the device file via the operating system by using the first application program, and converting the first screen image data into second screen image data used for three-dimensional display. Thus, the technical effect of 3D real-time conversion of third-party application content is achieved.

Description

Technical Field

[0001] This application relates to the field of image processing, and in particular to an image processing method, apparatus and storage medium. Background Technology

[0002] Currently, with the advancement of network communication technology, AR technology has seen increasing development and application. Considering factors such as computing power, battery life, and wearing experience, the current mainstream AR glasses architecture adopts an external computing model: the AR glasses are mainly responsible for display and user interaction functions, while the computing processing is handled by the terminal device (PC, tablet, mobile phone, etc.). The AR glasses and the terminal device, which serves as the computing unit, are connected via wired or wireless means.

[0003] Existing 3D content processing solutions typically suffer from problems such as a lack of content ecosystem, high adaptation complexity, and limitations of mobile technology. For example, the current 3D content ecosystem is not rich enough, with a large amount of content still in 2D format, thus lacking sufficient native 3D content to support AR application scenarios; dedicated 3D conversion applications need to run in computing units to achieve 2D to 3D conversion, but platforms or games that compute different 3D content require 3D conversion applications to adapt to different protocols or formats, thus increasing system complexity and user difficulty; the closed nature of mobile operating systems (such as Android) limits cross-application content processing, and the limitations of existing technology mean that video content corresponding to third-party applications cannot be 3D processed, and even if a 3D conversion application corresponding to AR glasses is installed, real-time 3D conversion of third-party application content cannot be achieved.

[0004] There is currently no effective solution to the technical problem in the existing technology that the installation of a 3D conversion application corresponding to AR glasses cannot perform real-time 3D conversion of video content from third-party applications. Summary of the Invention

[0005] The embodiments of this disclosure provide an image processing method, apparatus, and storage medium to at least solve the technical problem in the prior art that the installation of a 3D conversion application corresponding to AR glasses cannot perform real-time 3D conversion of video content from third-party applications.

[0006] According to one aspect of the present disclosure, an image processing method is provided, comprising: writing first screen image data corresponding to a screen display to a device file deployed in an operating system, wherein the device file corresponds to a system camera associated with a first application, wherein the first application is used to convert two-dimensional display image data into three-dimensional display image data; and using the first application to read the first screen image data from the device file via the operating system, and converting the first screen image data into second screen image data for three-dimensional display.

[0007] According to another aspect of the present disclosure, an image processing method is also provided, including: generating first screen image data corresponding to a screen display; and converting the screen image data into second screen image data for three-dimensional display.

[0008] According to another aspect of the present disclosure, a storage medium is also provided, the storage medium including a stored program, wherein, when the program is executed, a processor performs any of the methods described above.

[0009] According to another aspect of the present disclosure, an image processing apparatus is also provided, comprising: an image writing module, configured to write first screen image data corresponding to a screen display to a device file deployed on an operating system, wherein the device file corresponds to a system camera associated with a first application, wherein the first application is configured to convert two-dimensional display image data into three-dimensional display image data; and an image conversion module, configured to use the first application to read the first screen image data from the device file via the operating system and convert the first screen image data into second screen image data for three-dimensional display.

[0010] According to another aspect of the present disclosure, an image processing apparatus is also provided, including: a processor; and a memory connected to the processor, configured to provide the processor with instructions to process the following processing steps: writing first screen image data corresponding to a screen display to a device file deployed in an operating system, wherein the device file corresponds to a system camera associated with a first application, wherein the first application is used to convert two-dimensional display image data into three-dimensional display image data; and using the first application to read the first screen image data from the device file via the operating system and convert the first screen image data into second screen image data for three-dimensional display.

[0011] In this embodiment, an image processing method is provided for 3D image conversion. First, first screen image data corresponding to the displayed image is written to a device file deployed in the operating system. The device file corresponds to a system camera associated with a first application, which converts the two-dimensional image data into three-dimensional image data. Finally, the first application reads the first screen image data from the device file via the operating system and converts it into second screen image data for three-dimensional display.

[0012] As described above, this application does not directly obtain the corresponding video images from third-party applications. Instead, it records the video images played by third-party applications through screen recording, and then the first application performs 3D conversion processing on the recorded video images. Therefore, this screen recording operation is applicable to all third-party applications. In other words, regardless of which third-party application is running in the foreground on the mobile terminal, the recording operation can obtain the video images corresponding to the third-party application and perform real-time 3D conversion processing on the video images. This achieves the technical effect of real-time 3D conversion of third-party application content.

[0013] Furthermore, since the aforementioned device file corresponds to the system camera, and the first application corresponds to the system camera, for the first application, the first screen image data written to the device file is equivalent to the video image data corresponding to the system camera. Therefore, regardless of which third-party application the mobile terminal records the video image corresponding to, when the first screen image data is written to the device file, the first application will read the corresponding first screen image data from the device file and convert the first screen image data into second screen image data for 3D display.

[0014] This enables real-time 3D conversion of content from third-party applications. It also solves the technical problem in existing technologies where installing a 3D conversion application compatible with AR glasses prevents real-time 3D conversion of video content from third-party applications. Attached Figure Description

[0015] The accompanying drawings, which are included to provide a further understanding of this disclosure and form part of this application, illustrate exemplary embodiments of this disclosure and are used to explain this disclosure, but do not constitute an undue limitation of this disclosure. In the drawings:

[0016] Figure 1 This is a hardware structure block diagram of a computing device for implementing the method described in Embodiment 1 of this disclosure;

[0017] Figure 2This is a schematic diagram of a computing device for an image processing system according to Embodiment 1 of this disclosure;

[0018] Figure 3 This is a flowchart of the image processing method according to the first aspect of Embodiment 1 of this disclosure;

[0019] Figure 4 This is a schematic diagram of the hierarchical structure of the image processing system according to Embodiment 1 of this disclosure;

[0020] Figure 5 This is a flowchart of the image processing method according to the second aspect of Embodiment 1 of this disclosure;

[0021] Figure 6 This is a schematic diagram of the image processing apparatus according to Embodiment 2 of this disclosure; and

[0022] Figure 7 This is a schematic diagram of the image processing apparatus according to Embodiment 3 of the present disclosure. Detailed Implementation

[0023] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this disclosure.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] Example 1

[0026] According to this embodiment, an embodiment of an image processing method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0027] The method embodiments provided in this example can be executed on mobile terminals, computer terminals, or similar computing devices. Figure 1 A hardware block diagram of a computing device for implementing an image processing method is shown. Figure 1 As shown, a computing device may include one or more processors (processors may include, but are not limited to, microprocessors such as MCUs or programmable logic devices such as FPGAs), memory for storing data, transmission devices for communication functions, and input / output interfaces. The memory, transmission devices, and input / output interfaces are connected to the processor via a bus. In addition, it may also include a display, keyboard, and cursor control device connected to the input / output interfaces. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, a computing device may also include... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0028] It should be noted that the aforementioned one or more processors and / or other data processing circuits are generally referred to herein as "data processing circuits". These data processing circuits may be embodied, in whole or in part, in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuits may be a single, independent processing module, or may be integrated, in whole or in part, into any other element in a computing device. As involved in the embodiments of this disclosure, the data processing circuits serve as processor control (e.g., selection of a variable resistor termination path connected to an interface).

[0029] The memory can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the image processing method in this embodiment of the present disclosure. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby implementing the image processing method of the aforementioned application. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the computing device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0030] The transmission device is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the computing device's communication provider. In one example, the transmission device includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device may be a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0031] The display can be, for example, a touchscreen liquid crystal display (LCD), which allows users to interact with the user interface of the computing device.

[0032] It should be noted here that, in some optional embodiments, the above... Figure 1 The computing device shown may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that... Figure 1 This is only one instance of a specific particular instance, and is intended to illustrate the types of components that may exist in the aforementioned computing devices.

[0033] Figure 2 This is a schematic diagram of the image processing system according to this embodiment. (Refer to...) Figure 2 As shown, the system includes: a mobile terminal 100 and XR glasses 200 that are communicatively connected to the mobile terminal 100.

[0034] The mobile terminal 100 can perform 3D conversion processing on video images corresponding to third-party applications and generate corresponding 3D image data for 3D display. The XR glasses 200 are used to receive electrical signal data corresponding to the 3D image data and to display the 3D image in stereoscopic form. It should be noted that the mobile terminal 100 in the system can utilize the hardware structure described above.

[0035] Under the above operating environment, according to the first aspect of this embodiment, an image processing method is provided, the method comprising: Figure 2 The mobile terminal 100 shown is implemented. Figure 3 A flowchart illustrating the method is shown below. (Refer to...) Figure 3 As shown, the method includes:

[0036] S302: Write the first screen image data corresponding to the screen display to a device file deployed in the operating system, wherein the device file corresponds to the system camera associated with the first application, and wherein the first application is used to convert the two-dimensional display image data into three-dimensional display image data; and

[0037] S304: The first application reads the first screen image data from the device file via the operating system and converts the first screen image data into second screen image data for 3D display.

[0038] Specifically, refer to Figure 4 As shown, firstly, the application layer of the mobile terminal 100 is equipped with a second application (i.e., a screen recording app) and a third-party application (i.e., an application corresponding to the playback software). When the user sends a video image acquisition command to the screen capture module in the second application through the user interface (i.e., the system UI) of the mobile terminal 100, the screen capture module in the second application responds to the video image acquisition command sent by the user through the mobile terminal 100 and records the video image played by the third-party application through screen recording. Then, the screen capture module sends the video image obtained through screen recording to the data processing module in the second application, and the data processing module processes the video image to generate the first screen image data.

[0039] Furthermore, the data processing module in the second application writes the first screen image data into a device file deployed in the kernel layer of the mobile terminal 100 (S302). The device file corresponds to the system camera associated with the first application.

[0040] Furthermore, in this embodiment, the device file can be pre-defined at the HAL layer using a corresponding function to specify the device file corresponding to the system camera associated with the first application. Specifically, the first application obtains video images from the front-facing camera or rear-facing camera of the mobile terminal 100 by default. Therefore, the system camera in this embodiment corresponds to the default front-facing camera or rear-facing camera of the first application. Thus, in this embodiment, the device file can be pre-defined at the HAL layer using a corresponding function to specify the device file corresponding to the front-facing camera or rear-facing camera of the mobile terminal 100, so that the first application can read the first screen image data from the device file through the operating system.

[0041] Thus, the first application (i.e., the 3D conversion application) can read the first screen image data from the device file and convert the first screen image data displayed in two dimensions into second screen image data for three-dimensional display (S304).

[0042] Finally, the first application transmits the converted second-screen image data to the display driver in the kernel layer of the mobile terminal 100. The display driver converts the digital signal corresponding to the second-screen image data into an electrical signal and sends the converted second-screen image data to the XR glasses 200 via the USB-C interface. The XR glasses 200 generates and displays a 3D image based on the converted second-screen image data for the user to view.

[0043] As described in the background section, existing 3D content processing solutions typically suffer from problems such as a lack of content ecosystem, high adaptation complexity, and limitations of mobile technology. For example, the existing 3D content ecosystem is not rich enough, with a large amount of content still in 2D format, thus lacking sufficient native 3D content to support AR application scenarios; dedicated 3D conversion applications need to run in the computing unit to achieve 2D to 3D conversion, and platforms or games that compute different 3D content require 3D conversion applications to adapt to different protocols or formats, thus increasing system complexity and user difficulty; the closed nature of mobile operating systems (such as Android) limits cross-application content processing, and the limitations of existing technology mean that video content corresponding to third-party applications cannot be 3D processed, and even if a 3D conversion application corresponding to AR glasses is installed, real-time 3D conversion of third-party application content cannot be achieved.

[0044] In view of this, since this application does not directly obtain the corresponding video images from third-party applications, but records the video images played by third-party applications through screen recording, and then the first application performs 3D conversion processing on the recorded video images, this method of 3D conversion based on screen recording is applicable to all third-party applications. That is to say, regardless of which third-party application is occupying the foreground of the mobile terminal 100, the recording operation can obtain the video images corresponding to the third-party application and perform real-time 3D conversion processing on the video images. This achieves the technical effect of real-time 3D conversion of third-party application content.

[0045] Therefore, during use, the first screen image data corresponding to the screen display can be written to the device file deployed in the operating system. The first application can obtain the first screen image data corresponding to the screen display from the device file through the operating system, and convert the two-dimensional first screen image data into three-dimensional second screen image data. Then, the user can view the three-dimensional second screen image data on the XR glasses 200 connected to the mobile terminal 100.

[0046] This enables real-time 3D conversion of content from third-party applications. It also solves the technical problem in existing technologies where installing a 3D conversion application compatible with AR glasses prevents real-time 3D conversion of video content from third-party applications.

[0047] Optionally, the method further includes: using a second application to generate first screen image data through screen recording.

[0048] Specifically, refer to Figure 4 As shown, during use, the screen capture module in the second application (i.e., the screen recording APP) installed in the application layer of the mobile terminal 100 records the screen of the third-party application and sends the acquired screen (OR, video image) to the data processing module. After receiving the screen, the data processing module processes the screen and generates the first screen image data corresponding to the screen.

[0049] Therefore, since the second application generates the first screen image data through screen recording, and screen recording is applicable to all third-party applications (that is, using screen recording to obtain the display screen can avoid the closed nature of the operating system of the mobile terminal 100), it ensures that no matter which third-party application is occupying the foreground of the mobile terminal 100, the video image corresponding to the third-party application can be obtained through the recording operation and the video image can be processed in real time as 3D.

[0050] Optionally, the operation of writing the first screen image data corresponding to the screen display to a device file deployed in the operating system includes: using a second application to write the first screen image data to the device file.

[0051] Specifically, refer to Figure 4 As shown, the second application writes the first screen image data corresponding to the screen display to a device file deployed in the kernel layer. This ensures that the first application can read the corresponding first screen image data from the associated device file, enabling subsequent 3D transformation operations on the first screen image data.

[0052] Optionally, during the process of generating the first screen image data using the second application, a video can be played using playback software.

[0053] Specifically, refer to Figure 4 As shown, while the second application installed on the mobile terminal 100 is recording the content of the third-party application, the playback software on the mobile terminal 100, which is the third-party application, can simultaneously play the video for the user to watch. The third-party application includes, but is not limited to, applications capable of playing video images such as Douyin and Kuaishou. This ensures that the user can simultaneously perform screen recording and video viewing on the mobile terminal 100.

[0054] Optionally, it also includes: using a first application to transmit second screen image data to a stereoscopic display device.

[0055] Specifically, refer to Figure 4 As shown, the first application installed on the mobile terminal 100 reads the first screen image data from the device file, converts the two-dimensional first screen image data into a second screen image data for three-dimensional display, and the first application can transmit the second screen image data to the XR glasses 200 that are communicatively connected to the mobile terminal 100, thereby ensuring that the user can use the XR glasses 200 to view the corresponding stereoscopic display image.

[0056] Optionally, the operating system is either Android or HarmonyOS.

[0057] Specifically, refer to Figure 4 As shown, the operating system of mobile terminal 100 is either Android or HarmonyOS. It is important to note that those skilled in the art should understand that the above is merely an example of the types of operating systems used in mobile terminal 100, and the actual situation is not limited to this.

[0058] Thus, according to the first aspect of this embodiment, the technical effect of real-time 3D conversion of third-party application content is achieved.

[0059] Furthermore, according to a second aspect of this embodiment, an image processing method is provided, the method comprising: Figure 2 The mobile terminal 100 shown is implemented. Figure 5 A flowchart illustrating the method is shown below. (Refer to...) Figure 5 As shown, the method includes:

[0060] S502: Generate first screen image data corresponding to the screen display;

[0061] S504: Converts screen image data into second screen image data for 3D display.

[0062] Specifically, refer to Figure 4 As shown, the mobile terminal 100 can generate first screen image data corresponding to the screen display (S502). First, the application layer of the mobile terminal 100 (image processing system) has a second application (i.e., a screen recording app) and a third-party application (i.e., an application corresponding to the playback software) installed. When the user sends a video image acquisition command to the screen capture module in the second application through the user interface (i.e., the system UI) of the mobile terminal 100, the screen capture module in the second application responds to the video image acquisition command sent by the user through the mobile terminal 100 and records the video image played by the third-party application through screen recording. Then, the screen capture module sends the video image obtained through screen recording to the data processing module in the second application, where the data processing module processes the video image to generate the first screen image data.

[0063] Furthermore, the first application on the mobile terminal 100 converts the screen image data into second screen image data for 3D display (S504). Referring to the above description, since the device file in this embodiment corresponds to the system camera associated with the first application, the first application (i.e., the 3D conversion application) can read the first screen image data from the device file and convert the 2D first screen image data into second screen image data for 3D display.

[0064] Finally, the first application transmits the converted second-screen image data to the display driver in the kernel layer of the mobile terminal 100. The display driver converts the digital signal corresponding to the second-screen image data into an electrical signal and sends the converted second-screen image data to the XR glasses 200 via the USB-C interface. The XR glasses 200 generates and displays a 3D image based on the converted second-screen image data for the user to view.

[0065] Thus, according to the second aspect of this embodiment, the technical effect of real-time 3D conversion of third-party application content is achieved.

[0066] In addition, refer to Figure 1 As shown, according to a third aspect of this embodiment, a storage medium is provided. The storage medium includes a stored program, wherein, when the program is executed, a processor performs any of the methods described above.

[0067] Therefore, this embodiment does not directly obtain the corresponding video images from third-party applications. Instead, it records the video images played by the third-party applications through screen recording, and then the first application performs 3D conversion processing on the recorded video images. Thus, this method of 3D conversion based on screen recording is applicable to all third-party applications. In other words, regardless of which third-party application is in the foreground of the mobile terminal 100, the recording operation can obtain the video images corresponding to the third-party application and perform real-time 3D conversion processing on the video images. This achieves the technical effect of real-time 3D conversion of third-party application content. During use, the first screen image data corresponding to the screen display can be written to the device file deployed in the operating system. The first application can obtain the first screen image data corresponding to the screen display from the device file through the operating system and convert the two-dimensional first screen image data into three-dimensional second screen image data. The user can then view the three-dimensional second screen image data on the XR glasses 200 connected to the mobile terminal 100. This achieves the technical effect of real-time 3D conversion of third-party application content. This solves the technical problem in existing technologies where installing a 3D conversion application corresponding to AR glasses cannot perform real-time 3D conversion of video content from third-party applications.

[0068] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, because according to the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0069] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a mobile terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0070] Example 2

[0071] Figure 6 An image processing apparatus 600 according to a first aspect of this embodiment is shown, which corresponds to the method described according to the first aspect of Embodiment 1. Reference Figure 6 As shown, the device 600 includes: an image writing module 610, used to write first screen image data corresponding to the screen display to a device file deployed in the operating system, wherein the device file corresponds to a system camera associated with a first application, wherein the first application is used to convert the two-dimensional display image data into three-dimensional display image data; and an image conversion module 620, used to read the first screen image data from the device file via the operating system using the first application, and convert the first screen image data into second screen image data for three-dimensional display.

[0072] Optionally, the image processing device 600 further includes a screen recording module for generating first screen image data through screen recording operations using a second application.

[0073] Optionally, the image writing module 610 includes an image writing submodule for writing first screen image data to a device file using a second application.

[0074] Optionally, the image processing device 600 further includes a playback module for playing video using playback software during the process of generating first screen image data using a second application.

[0075] Optionally, the image processing apparatus 600 further includes a transmission module for transmitting second screen image data to a stereoscopic display device using a first application.

[0076] Optionally, the operating system is either Android or HarmonyOS.

[0077] Therefore, this embodiment does not directly obtain the corresponding video images from third-party applications. Instead, it records the video images played by the third-party applications through screen recording, and then the first application performs 3D conversion processing on the recorded video images. Thus, this method of 3D conversion based on screen recording is applicable to all third-party applications. In other words, regardless of which third-party application is in the foreground of the mobile terminal 100, the recording operation can obtain the video images corresponding to the third-party application and perform real-time 3D conversion processing on the video images. This achieves the technical effect of real-time 3D conversion of third-party application content. During use, the first screen image data corresponding to the screen display can be written to the device file deployed in the operating system. The first application can obtain the first screen image data corresponding to the screen display from the device file through the operating system and convert the two-dimensional first screen image data into three-dimensional second screen image data. The user can then view the three-dimensional second screen image data on the XR glasses 200 connected to the mobile terminal 100. This achieves the technical effect of real-time 3D conversion of third-party application content. This solves the technical problem in existing technologies where installing a 3D conversion application corresponding to AR glasses cannot perform real-time 3D conversion of video content from third-party applications.

[0078] Example 3

[0079] Figure 7 An image processing apparatus 700 according to a first aspect of this embodiment is shown, which corresponds to the method described according to the first aspect of Embodiment 1. Reference Figure 7 As shown, the device 700 includes: a processor 710; and a memory 720 connected to the processor 710, for providing the processor 710 with instructions to perform the following processing steps: writing first screen image data corresponding to a screen display to a device file deployed in the operating system, wherein the device file corresponds to a system camera associated with a first application, wherein the first application is used to convert two-dimensional display image data into three-dimensional display image data; and using the first application to read the first screen image data from the device file via the operating system, and converting the first screen image data into second screen image data for three-dimensional display.

[0080] Optionally, the memory 720 is also used to provide the processor with instructions to process the following steps: generating first screen image data using a second application through a screen recording operation.

[0081] Optionally, the operation of writing the first screen image data corresponding to the screen display to a device file deployed in the operating system includes: using a second application to write the first screen image data to the device file.

[0082] Optionally, the memory 720 is also used to provide the processor with instructions to perform the following processing steps: playing video using playback software during the process of generating first screen image data using a second application.

[0083] Optionally, the memory 720 is also used to provide the processor with instructions to perform the following processing steps: transmitting second screen image data to the stereoscopic display device using the first application.

[0084] Optionally, the operating system is either Android or HarmonyOS.

[0085] Therefore, this embodiment does not directly obtain the corresponding video images from third-party applications. Instead, it records the video images played by the third-party applications through screen recording, and then the first application performs 3D conversion processing on the recorded video images. Thus, this method of 3D conversion based on screen recording is applicable to all third-party applications. In other words, regardless of which third-party application is in the foreground of the mobile terminal 100, the recording operation can obtain the video images corresponding to the third-party application and perform real-time 3D conversion processing on the video images. This achieves the technical effect of real-time 3D conversion of third-party application content. During use, the first screen image data corresponding to the screen display can be written to the device file deployed in the operating system. The first application can obtain the first screen image data corresponding to the screen display from the device file through the operating system and convert the two-dimensional first screen image data into three-dimensional second screen image data. The user can then view the three-dimensional second screen image data on the XR glasses 200 connected to the mobile terminal 100. This achieves the technical effect of real-time 3D conversion of third-party application content. This solves the technical problem in existing technologies where installing a 3D conversion application corresponding to AR glasses cannot perform real-time 3D conversion of video content from third-party applications.

[0086] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0087] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0088] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0089] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0090] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0091] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0092] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. An image processing method, characterized in that, include: The second application uses screen recording to generate first screen image data from the video image played by the third-party application, wherein the third-party application is an application corresponding to the playback software. The first screen image data corresponding to the screen display is written to the device file deployed in the operating system, wherein the device file corresponds to the system camera associated with the first application, wherein the first application is used to convert the two-dimensional display image data into three-dimensional display image data, and the first application cannot directly obtain the video content of the third-party application; The first application reads the first screen image data from the device file via the operating system and converts the first screen image data into second screen image data for 3D display. as well as The first application transmits the converted second screen image data to the display driver of the kernel layer of the mobile terminal. The display driver converts the digital signal corresponding to the second screen image data into an electrical signal and sends the converted second screen image data to the XR glasses via the USB-C interface. The XR glasses generate and display a three-dimensional image based on the converted second screen image data.

2. The method according to claim 1, characterized in that, The operation of writing first screen image data corresponding to the screen display to a device file deployed in the operating system includes: using the second application to write the first screen image data to the device file.

3. The method according to claim 1, characterized in that, Also includes: During the process of generating the first screen image data using the second application, a video is played using playback software.

4. The method according to claim 1, characterized in that, It also includes using the first application to transmit the second screen image data to a stereoscopic display device.

5. The method according to claim 1, characterized in that, The operating system is either Android or HarmonyOS.

6. A storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program is executed, the method described in any one of claims 1 to 5 is performed by a processor.

7. An image processing apparatus, characterized in that, include: The screen recording module is used to generate first screen image data from the video image played by the third-party application through the screen recording operation of the second application, wherein the third-party application is the application corresponding to the playback software. An image writing module is used to write first screen image data corresponding to the screen display to a device file deployed on the operating system, wherein the device file corresponds to the system camera associated with the first application, wherein the first application is used to convert the two-dimensional display image data into three-dimensional display image data, and the first application cannot directly obtain the video content of the third-party application; The image conversion module is used to read the first screen image data from the device file via the operating system using the first application, and convert the first screen image data into second screen image data for three-dimensional display; as well as The first application transmits the converted second screen image data to the display driver of the kernel layer of the mobile terminal. The display driver converts the digital signal corresponding to the second screen image data into an electrical signal and sends the converted second screen image data to the XR glasses via the USB-C interface. The XR glasses generate and display a three-dimensional image based on the converted second screen image data.

8. An image processing apparatus, characterized in that, include: processor; as well as A memory, connected to the processor, for providing the processor with instructions to perform the following processing steps: The second application uses screen recording to generate first screen image data from the video image played by the third-party application, wherein the third-party application is an application corresponding to the playback software. The first screen image data corresponding to the screen display is written to the device file deployed in the operating system, wherein the device file corresponds to the system camera associated with the first application, wherein the first application is used to convert the two-dimensional display image data into three-dimensional display image data, and the first application cannot directly obtain the video content of the third-party application; The first application reads the first screen image data from the device file via the operating system and converts the first screen image data into second screen image data for 3D display. The first application transmits the converted second screen image data to the display driver of the kernel layer of the mobile terminal. The display driver converts the digital signal corresponding to the second screen image data into an electrical signal and sends the converted second screen image data to the XR glasses via the USB-C interface. The XR glasses generate and display a three-dimensional image based on the converted second screen image data.

Images