An image processing method, device and storage medium

Abstract

The application discloses an image processing method and device and a storage medium, and is applied to an electronic device, and comprises the following steps: acquiring a projection image from a mobile terminal in communication connection with the electronic device, and writing first projection image data corresponding to the projection image into a device file arranged in an operating system, wherein the device file corresponds to a system camera; and reading the first projection image data from the device file via the operating system by using a first application program associated with the system camera, and converting the first projection image data into second projection image data used for three-dimensional display.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to an image processing method, apparatus and storage medium. Background Technology

[0002] Currently, with the continuous development of AR technology, AR glasses, as its technological carrier, have also received widespread attention. Specifically, to display 3D video images using AR glasses, in existing technologies, the terminal device associated with the AR glasses (e.g., a computer) can directly send locally stored 3D video images to the AR glasses, thereby enabling the display of 3D video images. In addition, the terminal device associated with the AR glasses can also convert locally stored 2D video images into 3D video images or convert 2D video images obtained from third-party applications into 3D video images, thereby enabling the display of 3D video images using the AR glasses. Examples of third-party applications include TikTok and Kuaishou.

[0003] However, in the aforementioned scenarios, such as on mobile devices (e.g., smartphones), due to the limitations of the mobile device's operating system, the 3D conversion application cannot access the system UI or the display screen of any third-party applications to convert 2D image data into 3D image data. In other words, even if a 3D conversion application corresponding to AR glasses is installed on the mobile device, it cannot directly obtain video images from third-party applications and convert 2D image data into 3D image data in real time.

[0004] There is currently no effective solution to the technical problem in the existing technology that the 3D conversion application corresponding to AR glasses cannot directly obtain video images from third-party applications and convert two-dimensional image data into three-dimensional image data in real time. Summary of the Invention

[0005] The embodiments of this disclosure provide an image processing method, apparatus, and storage medium to at least solve the technical problem in the prior art that 3D conversion applications corresponding to AR glasses cannot directly obtain video images from third-party applications and convert two-dimensional image data into three-dimensional image data in real time.

[0006] According to one aspect of the present disclosure, an image processing method is provided, applied to an electronic device, comprising: acquiring a projected image from a mobile terminal communicatively connected to the electronic device, and writing first projected image data corresponding to the projected image into a device file deployed on an operating system, wherein the device file corresponds to a system camera; and using a first application associated with the system camera to read the first projected image data from the device file via the operating system, and converting the first projected image data into second projected image data for three-dimensional display.

[0007] According to another aspect of the present disclosure, an image processing method is also provided, including: generating first projection image data corresponding to a projection image; and converting the first projection image data into second projection image data for three-dimensional display.

[0008] According to another aspect of the present disclosure, a storage medium is also provided, the storage medium including a stored program, wherein, when the program is executed, a processor performs any of the methods described above.

[0009] According to another aspect of the present disclosure, an image processing apparatus is also provided, comprising: an image writing module, configured to acquire a projected image from a mobile terminal communicatively connected to an electronic device, and write first projected image data corresponding to the projected image into a device file deployed on an operating system, wherein the device file corresponds to a system camera; and an image conversion module, configured to read the first projected image data from the device file via the operating system using a first application associated with the system camera, and convert the first projected image data into second projected image data for three-dimensional display.

[0010] According to another aspect of the present disclosure, an image processing apparatus is also provided, comprising: a processor; and a memory connected to the processor, configured to provide the processor with instructions for processing the following processing steps: acquiring a projected image from a mobile terminal communicatively connected to an electronic device, and writing first projected image data corresponding to the projected image into a device file deployed on an operating system, wherein the device file corresponds to a system camera; and using a first application associated with the system camera to read the first projected image data from the device file via the operating system, and converting the first projected image data into second projected image data for three-dimensional display.

[0011] This application provides an image processing method. First, an electronic device acquires a projected image from a mobile terminal with a communication connection and writes first projected image data corresponding to the projected image into a device file deployed in the operating system. Then, the electronic device uses a first application associated with the system camera to read the first projected image data from the device file via the operating system and converts the first projected image data into second projected image data for 3D display.

[0012] As described above, when the electronic device in this application acquires a projected image sent by a mobile terminal connected via a communication link, it writes the first projected image data corresponding to the projected image into a device file. Since the device file corresponds to the system camera, and the first application corresponds to the system camera, regardless of which third-party application's video image the electronic device acquires, when the first projected image data corresponding to the video image is written into the device file corresponding to the system camera, the first application can read the first projected image data from the device file and convert it into second projected image data for 3D display.

[0013] Furthermore, since the third-party application providing the video images is installed on the mobile terminal, while the first application for converting the two-dimensional video images into three-dimensional video images is installed on the electronic device (i.e., the first and third applications are located on different devices), the restrictions imposed on the first application by the mobile terminal's operating system can be avoided, and the first application can obtain the video images from the third-party application through screen mirroring. This ensures that the first application can directly obtain the video images from the third-party application and convert the first screen-mirror image data corresponding to the video images into second screen-mirror image data for three-dimensional display in real time.

[0014] Therefore, by utilizing the screen projection operation described above, it is possible to acquire screen projection images corresponding to any third-party application and perform 3D processing on the acquired screen projection images in real time. This solves the technical problem in existing technologies where 3D conversion applications corresponding to AR glasses cannot directly acquire video images from third-party applications and convert 2D image data into 3D image data in real time. Attached Figure Description

[0015] The accompanying drawings, which are included to provide a further understanding of this disclosure and form part of this application, illustrate exemplary embodiments of this disclosure and are used to explain this disclosure, but do not constitute an undue limitation of this disclosure. In the drawings:

[0016] Figure 1 This is a hardware structure block diagram of a computing device for implementing the method described in Embodiment 1 of this disclosure;

[0017] Figure 2 This is a schematic diagram of the image processing system according to Embodiment 1 of this application;

[0018] Figure 3 This is a schematic flowchart of the image processing method according to the first aspect of Embodiment 1 of this application;

[0019] Figure 4This is a schematic diagram of the hierarchical structure of the image processing system according to Embodiment 1 of this application;

[0020] Figure 5 This is a schematic flowchart of the image processing method according to the second aspect of Embodiment 1 of this application;

[0021] Figure 6 This is a schematic diagram of the image processing apparatus according to Embodiment 2 of this application;

[0022] Figure 7 This is a schematic diagram of the image processing apparatus according to Embodiment 3 of this application. Detailed Implementation

[0023] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this disclosure.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] Example 1

[0026] According to this embodiment, an image processing method embodiment is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Also, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0027] The method embodiments provided in this example can be executed on mobile terminals, computer terminals, servers, or similar computing devices. Figure 1 A hardware block diagram of a computing device for implementing an image processing method is shown. Figure 1As shown, a computing device may include one or more processors (processors may include, but are not limited to, microprocessors such as MCUs or programmable logic devices such as FPGAs), memory for storing data, transmission devices for communication functions, and input / output interfaces. The memory, transmission devices, and input / output interfaces are connected to the processor via a bus. In addition, it may also include a display, keyboard, and cursor control device connected to the input / output interfaces. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, a computing device may also include... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0028] It should be noted that the aforementioned one or more processors and / or other data processing circuits are generally referred to herein as "data processing circuits". These data processing circuits may be embodied, in whole or in part, in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuits may be a single, independent processing module, or may be integrated, in whole or in part, into any other element in a computing device. As involved in the embodiments of this disclosure, the data processing circuits serve as processor control (e.g., selection of a variable resistor termination path connected to an interface).

[0029] The memory can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the image processing method in this embodiment of the present disclosure. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby implementing the image processing method of the aforementioned application. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the computing device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0030] The transmission device is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the computing device's communications provider. In one example, the transmission device includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device may be a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0031] The display can be, for example, a touchscreen liquid crystal display (LCD), which allows users to interact with the user interface of the computing device.

[0032] It should be noted here that, in some optional embodiments, the above... Figure 1 The computing device shown may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that... Figure 1 This is only one instance of a specific particular instance, and is intended to illustrate the types of components that may exist in the aforementioned computing devices.

[0033] Figure 2 This is a schematic diagram of the image processing system according to this embodiment. (Refer to...) Figure 2 As shown, the system includes a mobile terminal 100, an electronic device 200, and AR glasses 300. The mobile terminal 100 is communicatively connected to the electronic device 200 and actively initiates a screen projection operation to the electronic device 200, ensuring that the electronic device 200 acquires the projected image or, in response to an image acquisition request sent by the electronic device 200, transmits the projected image back to the electronic device 200. The electronic device 200 writes first projected image data corresponding to the projected image into a device file corresponding to the system camera, and uses a first application to convert the first projected image data read from the device file, thereby generating second projected image data for 3D display. The AR glasses 300 displays a 3D image corresponding to the second projected image data.

[0034] It should be noted that the hardware structure described above can be used for both the mobile terminal 100 and the electronic device 200 in the system.

[0035] Under the above operating environment, according to the first aspect of this embodiment, an image processing method is provided, the method comprising: Figure 2 The electronic device 200 shown is implemented. Figure 3 A flowchart illustrating the method is shown below. (Refer to...) Figure 3 As shown, the method includes:

[0036] S302: Acquire a projected image from a mobile terminal connected to an electronic device, and write the first projected image data corresponding to the projected image into a device file deployed in the operating system, wherein the device file corresponds to the system camera; and

[0037] S304: Using a first application associated with the system camera, read the first projection image data from the device file via the operating system, and convert the first projection image data into second projection image data for 3D display.

[0038] Specifically, Figure 4 This is a hierarchical structure framework diagram of the electronic device according to embodiments of this application. (Reference) Figure 4 As shown, firstly, the application layer of electronic device 200 has a second application (i.e., a screen mirroring app) installed, and the data acquisition module in the second application acquires the screen mirroring image from the mobile terminal 100 with which a communication connection has been established via a wireless communication circuit. Of course, in addition to acquiring the screen mirroring image from the mobile terminal 100 via a network communication circuit, electronic device 200 can also acquire the screen mirroring image from the mobile terminal 100 via a wired connection. For example, electronic device 200 may acquire the screen mirroring image from the mobile terminal 100 via an HDMI interface or a full-featured USB-C interface (supporting DP).

[0039] Furthermore, the electronic device 200 can acquire the projected image in various ways, such as responding to a projected image operation initiated by the mobile terminal 100. Alternatively, the electronic device 200 can actively send an image acquisition request to the mobile terminal 100 and receive the projected image returned by the mobile terminal 100. These details will be described in more detail later and will not be repeated here.

[0040] Then, the data acquisition module in the second application sends the acquired projection image to the data processing module, which processes the projection image and then writes the first projection image data into the device file deployed in the operating system (S302). In this embodiment, the device file can be pre-defined in the HAL layer using a corresponding function to specify the device file corresponding to the system camera associated with the first application (i.e., the 3D conversion APP). Specifically, the first application acquires video images from either the front or rear system camera of the mobile terminal by default; therefore, in this embodiment, the system camera corresponds to the default front or rear camera of the first application. Furthermore, in this embodiment, the device file can be pre-defined in the HAL layer using a corresponding function to specify the device file corresponding to the front or rear camera, allowing the first application to read the first projection image data from this device file through the operating system.

[0041] In other words, since the first application is associated with the system camera and the device file corresponds to the system camera, regardless of which third-party application the electronic device obtains the video image, as long as the first projection image data corresponding to the video image is written to the device file corresponding to the system camera, the electronic device 200 can use the first application to read the first projection image data from the device file.

[0042] Thus, the first application can read the first projected image data from the device file and convert it into second projected image data for 3D display (S304). The first application then sends the second projected image data to the display driver located in the kernel layer. The display driver is responsible for converting the digital image signal corresponding to the second projected image data into a displayable electrical signal, thereby controlling the brightness and color of each pixel. Finally, the display driver sends the converted second projected image data to the AR glasses via the USB-C interface, and the 3D image is displayed on the AR glasses 300.

[0043] As described in the background section, on mobile terminals (e.g., mobile phones), due to the limitations of the mobile terminal's operating system, 3D conversion applications cannot access the system UI or the display screen of any third-party applications and convert 2D image data into 3D image data. That is, if a third-party application is playing a video in the foreground, the 3D conversion application can only run in the background and cannot extract the video played by the third-party application or obtain video images from the third-party application.

[0044] In other words, even if a 3D conversion application corresponding to AR glasses is installed on a mobile terminal, it is impossible to directly obtain video images from third-party applications and convert two-dimensional image data into three-dimensional image data in real time.

[0045] In view of this, this application provides an image processing method. Furthermore, as described above, when the electronic device in this application acquires a projected image sent by a mobile terminal connected via a communication link, it writes the first projected image data corresponding to the projected image into a device file. Since the device file corresponds to the system camera, and the first application corresponds to the system camera, regardless of which third-party application's video image the electronic device acquires, when the first projected image data corresponding to the video image is written into the device file corresponding to the system camera, the first application can read the first projected image data from the device file and convert it into second projected image data for 3D display.

[0046] Furthermore, since the third-party application providing the video images is installed on the mobile terminal, while the first application for converting the two-dimensional video images into three-dimensional video images is installed on the electronic device (i.e., the first and third applications are located on different devices), the restrictions imposed on the first application by the mobile terminal's operating system can be avoided, and the first application can obtain the video images from the third-party application through screen mirroring. This ensures that the first application can directly obtain the video images from the third-party application and convert the first screen-mirror image data corresponding to the video images into second screen-mirror image data for three-dimensional display in real time.

[0047] Therefore, by utilizing the screen projection operation described above, it is possible to acquire screen projection images corresponding to any third-party application and perform 3D processing on the acquired screen projection images in real time. This solves the technical problem in existing technologies where 3D conversion applications corresponding to AR glasses cannot directly acquire video images from third-party applications and convert 2D image data into 3D image data in real time.

[0048] Optionally, it also includes: using a second application corresponding to the device file to respond to the screen mirroring operation initiated by the mobile terminal, acquiring the screen mirroring image and generating first screen mirroring image data.

[0049] Specifically, refer to Figure 4 As shown, when a user initiates a screen mirroring operation from a mobile terminal 100 to an electronic device 200, the electronic device 200 responds to the screen mirroring operation initiated by the mobile terminal 100 using a second application, and uses the data acquisition module in the second application to acquire the screen mirroring image from the mobile terminal 100. Then, the data processing module in the second application processes the screen mirroring image sent by the data acquisition module and generates the first screen mirroring image data.

[0050] Optionally, it further includes: sending an image acquisition request to the mobile terminal using a second application (i.e., a screen mirroring application) corresponding to the device file, wherein the image acquisition request is used to indicate the acquisition of a screen mirroring image; and receiving the screen mirroring image returned by the mobile terminal using the second application, and generating first screen mirroring image data based on the screen mirroring image.

[0051] Specifically, refer to Figure 4 As shown, the user can also use a second application in the electronic device 200 to send an image acquisition request for the screen-projected image to the mobile terminal 100 via a wireless communication circuit. The image acquisition request is used to instruct the user to acquire the screen-projected image.

[0052] Furthermore, in response to the image acquisition request, the mobile terminal 100 transmits the projected image back to the second application in the electronic device 200 via the wireless communication circuit. Upon receiving the projected image transmitted from the mobile terminal, the data acquisition module in the second application further processes the projected image sent by the data acquisition module and generates first projected image data.

[0053] Therefore, under the above circumstances, users can not only actively initiate screen projection operations from mobile terminal 100 to electronic device 200, but also send image acquisition requests from electronic device 200 to mobile terminal when using electronic device 200 instead of mobile terminal 100. This ensures that the first screen projection image data can be converted into the second screen projection image data for three-dimensional display in different usage scenarios, and ensures that users can view the technical effect of three-dimensional images through AR glasses 300.

[0054] Optionally, the operation of writing the first screen projection image data corresponding to the screen projection image into a device file deployed on the operating system includes: using a second application to write the first screen image data into the device file.

[0055] Specifically, since the second application is associated with the device file, when the data processing module of the second application receives the projected image acquired by the data acquisition module from the mobile terminal 100, it generates first projected image data based on the projected image and writes the first projected image data to the device file. Therefore, because the second application writes the first projected image data to the device file, the first application associated with the device file can read the first projected image data from the device file, thereby ensuring that the AR glasses 300 can display three-dimensional images.

[0056] Optionally, it also includes: using the first application to transmit the second projected image data to the stereoscopic display device.

[0057] Specifically, refer to Figure 4 As shown, when the first application converts the first projected image data into second projected image data for 3D display, it transmits the second projected image data to the display driver. The display driver is responsible for converting the digital image signal corresponding to the second projected image data into a displayable electrical signal, thereby controlling the brightness and color of each pixel. Finally, the display driver sends the converted second projected image data to the AR glasses 300 (i.e., the stereoscopic display device) via a full-function USB-C interface (supporting DP), and the 3D image is displayed on the AR glasses 300.

[0058] Optionally, the operating system is either Android or HarmonyOS.

[0059] Thus, according to the first aspect of this embodiment, the technical effect of being able to convert two-dimensional image data corresponding to a third-party application into three-dimensional image data in real time is achieved.

[0060] Furthermore, according to a second aspect of this embodiment, an image processing method is provided, the method comprising: Figure 2 The electronic device 200 shown is implemented. Figure 5 A flowchart illustrating the method is shown below. (Refer to...) Figure 5 As shown, the method includes:

[0061] S502: Generate the first projection image data corresponding to the projection image; and

[0062] S504: Convert the first projected image data into a second projected image data for 3D display.

[0063] Thus, according to the second aspect of this embodiment, the technical effect of being able to convert two-dimensional image data corresponding to a third-party application into three-dimensional image data in real time is achieved.

[0064] In addition, refer to Figure 1 As shown, according to a third aspect of this embodiment, a storage medium is provided. The storage medium includes a stored program, wherein, when the program is executed, a processor performs any of the methods described above.

[0065] Thus, according to this embodiment, the technical effect of being able to convert two-dimensional image data corresponding to third-party applications into three-dimensional image data in real time is achieved.

[0066] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, because according to the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0067] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0068] Example 2

[0069] Figure 6 An image processing apparatus 600 according to this embodiment is shown, which corresponds to the method described according to Embodiment 1. Reference Figure 6 As shown, the device 600 includes: an image writing module 610, used to acquire a projected image from a mobile terminal connected in communication with an electronic device, and write first projected image data corresponding to the projected image into a device file deployed in the operating system, wherein the device file corresponds to the system camera; and an image conversion module 620, used to read the first projected image data from the device file via the operating system using a first application associated with the system camera, and convert the first projected image data into second projected image data for three-dimensional display.

[0070] Optionally, the device 600 further includes: a first screen projection module, used to respond to the screen projection operation initiated by the mobile terminal using a second application corresponding to the device file, to acquire the screen projection image and generate first screen projection image data.

[0071] Optionally, the device 600 further includes: a second projection module, used to send an image acquisition request to the mobile terminal using a second application corresponding to the device file, wherein the image acquisition request is used to indicate the acquisition of a projection image; and a return image receiving module, used to receive the projection image returned by the mobile terminal using the second application, and generate first projection image data based on the projection image.

[0072] Optionally, the image writing module 610 includes: an image writing submodule for writing first screen image data to a device file using a second application.

[0073] Optionally, the device 600 further includes a video display module for transmitting a second projected image data to a stereoscopic display device using a first application.

[0074] Optionally, the operating system is either Android or HarmonyOS.

[0075] Thus, according to this embodiment, the technical effect of being able to convert two-dimensional image data corresponding to third-party applications into three-dimensional image data in real time is achieved.

[0076] Example 3

[0077] Figure 7 An image processing apparatus 700 according to this embodiment is shown, which corresponds to the method described according to Embodiment 1. Reference Figure 7 As shown, the device 700 includes: a processor 710; and a memory 720 connected to the processor 710, for providing the processor 710 with instructions to process the following steps: acquiring a projected image from a mobile terminal communicatively connected to an electronic device, and writing first projected image data corresponding to the projected image into a device file deployed in the operating system, wherein the device file corresponds to a system camera; and using a first application associated with the system camera to read the first projected image data from the device file via the operating system, and converting the first projected image data into second projected image data for 3D display.

[0078] Optionally, the device 700 further includes: responding to a screen mirroring operation initiated by a mobile terminal using a second application corresponding to the device file, acquiring a screen mirroring image and generating first screen mirroring image data.

[0079] Optionally, the device 700 further includes: sending an image acquisition request to the mobile terminal using a second application (i.e., a screen mirroring application) corresponding to the device file, wherein the image acquisition request is used to indicate the acquisition of a screen mirroring image; and receiving the screen mirroring image returned by the mobile terminal using the second application, and generating first screen mirroring image data based on the screen mirroring image.

[0080] Optionally, the operation of writing the first screen projection image data corresponding to the screen projection image into a device file deployed on the operating system includes: using a second application to write the first screen image data into the device file.

[0081] Optionally, the device 700 further includes: transmitting the second projected image data to the stereoscopic display device using a first application.

[0082] Thus, according to this embodiment, the technical effect of being able to convert two-dimensional image data corresponding to third-party applications into three-dimensional image data in real time is achieved.

[0083] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0084] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0085] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0086] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0087] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0088] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0089] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. An image processing method applied to electronic devices, characterized in that, include: The screen projection image is acquired from the mobile terminal that is communicatively connected to the electronic device, and the first screen projection image data corresponding to the screen projection image is written into the device file deployed in the operating system, wherein the device file corresponds to the system camera; as well as The system uses a first application associated with the camera to read first projection image data from the device file via the operating system, and converts the first projection image data into second projection image data for 3D display. The first application sends the second projection image data to the display driver, which converts the digital image signal corresponding to the second projection image data into a displayable electrical signal. The display driver then sends the converted second projection image data to the AR glasses via a USB-C interface, and the AR glasses display the 3D image. The method further includes: utilizing a second application corresponding to the device file to respond to a screen mirroring operation initiated by the mobile terminal, acquiring the screen mirroring image and generating the first screen mirroring image data, or The method further includes: sending an image acquisition request to the mobile terminal using a second application corresponding to the device file, wherein the image acquisition request is used to instruct the acquisition of the projected image; and The second application receives the screen projection image transmitted back by the mobile terminal and generates the first screen projection image data based on the screen projection image.

2. The method according to claim 1, characterized in that, The operation of writing the first projection image data corresponding to the projection image into the device file deployed in the operating system includes: The second application is used to write the first projected image data into the device file.

3. The method according to claim 1, characterized in that, The operating system is either Android or HarmonyOS.

4. A storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program is executed, the method described in any one of claims 1 to 3 is performed by a processor.

5. An image processing apparatus, characterized in that, include: An image writing module is used to acquire a projected image from a mobile terminal that is connected to an electronic device, and write the first projected image data corresponding to the projected image into a device file deployed in the operating system, wherein the device file corresponds to the system camera. as well as An image conversion module is used to read first projection image data from the device file via the operating system using a first application associated with the system camera, and convert the first projection image data into second projection image data for 3D display. The device also includes a video display module, used to send the second projection image data to a display driver via the first application, convert the digital image signal corresponding to the second projection image data into a displayable electrical signal via the display driver, and send the converted second projection image data to AR glasses via a USB-C interface using the display driver, and display a 3D image using the AR glasses. The device further includes: a first screen projection module, configured to respond to a screen projection operation initiated by the mobile terminal using a second application corresponding to the device file, acquire the screen projection image and generate the first screen projection image data, or The device further includes: a second screen projection module, configured to send an image acquisition request to the mobile terminal using a second application corresponding to the device file, wherein the image acquisition request is used to instruct the acquisition of the screen projection image; and The image receiving module is used to receive the screen projection image returned by the mobile terminal using the second application, and generate the first screen projection image data based on the screen projection image.

6. An image processing apparatus, characterized in that, include: processor; as well as A memory, connected to the processor, for providing the processor with instructions to perform the following processing steps: The system acquires a screen projection image from a mobile terminal that is connected to an electronic device, and writes the first screen projection image data corresponding to the screen projection image into a device file deployed in the operating system, wherein the device file corresponds to the system camera. as well as The system uses a first application associated with the camera to read first projection image data from the device file via the operating system, and converts the first projection image data into second projection image data for 3D display. The first application sends the second projection image data to the display driver, which converts the digital image signal corresponding to the second projection image data into a displayable electrical signal. The display driver then sends the converted second projection image data to the AR glasses via a USB-C interface, and the AR glasses display the 3D image. The method further includes: utilizing a second application corresponding to the device file to respond to a screen mirroring operation initiated by the mobile terminal, acquiring the screen mirroring image and generating the first screen mirroring image data, or The method further includes: sending an image acquisition request to the mobile terminal using a second application corresponding to the device file, wherein the image acquisition request is used to instruct the acquisition of the screen projection image; and receiving the screen projection image returned by the mobile terminal using the second application, and generating the first screen projection image data based on the screen projection image.

Images