Image processing methods and system, apparatus, electronic device and storage medium

Abstract

Provided in the present disclosure are image processing methods and system, an apparatus, an electronic device and a storage medium. On a content source device side, the following operations are performed: acquiring a source image and original information to be transmitted corresponding to the source image; packaging said original information to generate target information to be transmitted; encoding said target information in a preset area of the source image, so as to obtain a target image; and sending the target image to a head-mounted display device. On a head-mounted display device side, the following operations are performed: receiving a target image from a content source device; decoding the target image to obtain target information to be transmitted; on the basis of said target information, determining a source image and corresponding original information to be transmitted; and rendering the source image on the basis of said original information, and displaying the image on the head-mounted display device.

Description

Image processing methods, apparatus, systems, electronic devices and storage media

[0001] This disclosure claims priority to Chinese Patent Application No. CN202411997975.6, filed with the State Intellectual Property Office of China on December 31, 2024, entitled "Image Processing Method, Apparatus, System, Electronic Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the field of image technology, and in particular to an image processing method, apparatus, system, electronic device, and storage medium. Background Technology

[0003] Among related technologies, head-mounted display devices employing Augmented Reality (AR) and Virtual Reality (VR) technologies are becoming increasingly widespread. Head-mounted display devices can be used for content display. For example, they can be used to display movie footage, game visuals, etc. Summary of the Invention

[0004] According to one aspect of the present disclosure, an image processing method is provided, applied to a content source device, comprising: acquiring a source image and original information to be transmitted corresponding to the source image; encapsulating the original information to be transmitted to generate target information to be transmitted; encoding the target information to be transmitted in a preset area of ​​the source image to obtain a target image; and sending the target image to a head-mounted display device.

[0005] According to another aspect of the present disclosure, an image processing method is provided, applied to a head-mounted display device, comprising: receiving a target image from a content source device; decoding the target image to obtain target information to be transmitted; determining a source image and corresponding original information to be transmitted based on the target information to be transmitted; rendering the source image based on the original information to be transmitted; and displaying the image on the head-mounted display device.

[0006] According to another aspect of the present disclosure, an image processing system is provided, comprising: a content source device for performing the image processing method applied to the content source device described above; and a head-mounted display device for performing the image processing method applied to the head-mounted display device described above.

[0007] According to another aspect of this disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; and a processor for reading executable instructions from the memory and executing the instructions to implement any of the above-described image processing methods.

[0008] According to another aspect of this disclosure, a computer-readable storage medium is provided that stores a computer program for performing any of the above-described image processing methods.

[0009] The technical solutions of this disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0010] Figure 1 is a schematic diagram of the structure of an image processing system provided by some exemplary embodiments of this disclosure.

[0011] Figure 2 is a flowchart illustrating an image processing method provided by some exemplary embodiments of this disclosure.

[0012] Figure 3 is a flowchart illustrating an image acquisition method provided by some exemplary embodiments of this disclosure.

[0013] Figure 4-1 is a flowchart illustrating a method for generating encoded information provided by some exemplary embodiments of this disclosure.

[0014] Figure 4-2 is a schematic diagram of the generation of encoded information in some exemplary embodiments of this disclosure.

[0015] Figure 5 is a flowchart illustrating an information storage method provided by some exemplary embodiments of this disclosure.

[0016] Figure 6-1 is a flowchart illustrating an information generation method provided by some exemplary embodiments of this disclosure.

[0017] Figure 6-2 is a schematic diagram of the composition of target information to be transmitted in some exemplary embodiments of this disclosure.

[0018] Figure 7 is a flowchart illustrating an image processing method provided by some other exemplary embodiments of this disclosure.

[0019] Figure 8 is a flowchart illustrating an information acquisition method provided by some exemplary embodiments of this disclosure.

[0020] Figure 9 is a flowchart illustrating a method for obtaining information provided by other exemplary embodiments of this disclosure.

[0021] Figure 10 is a flowchart illustrating an information acquisition method provided in some exemplary embodiments of this disclosure.

[0022] Figure 11 is a flowchart illustrating an image display method provided by some exemplary embodiments of this disclosure.

[0023] Figure 12 is a schematic diagram of the structure of an image processing apparatus provided by some exemplary embodiments of the present disclosure.

[0024] Figure 13 is a schematic diagram of the structure of the encoding module in some exemplary embodiments of this disclosure.

[0025] Figure 14 is a schematic diagram of the structure of the encoding submodule in some exemplary embodiments of this disclosure.

[0026] Figure 15 is a schematic diagram of the structure of the storage submodule in some exemplary embodiments of this disclosure.

[0027] Figure 16 is a schematic diagram of the structure of the encapsulation module in some exemplary embodiments of this disclosure.

[0028] Figure 17 is a schematic diagram of the structure of an image processing apparatus provided by some other exemplary embodiments of the present disclosure.

[0029] Figure 18 is a schematic diagram of the structure of the decoding module in some exemplary embodiments of this disclosure.

[0030] Figure 19 is a schematic diagram of the structure of the restoration submodule in some exemplary embodiments of this disclosure.

[0031] Figure 20 is a schematic diagram of the structure of a defined module in some exemplary embodiments of this disclosure.

[0032] Figure 21 is a schematic diagram of the structure of the display module in some exemplary embodiments of this disclosure.

[0033] Figure 22 is a schematic diagram of the structure of an electronic device provided by some exemplary embodiments of this disclosure. Detailed Implementation

[0034] To explain this disclosure, exemplary embodiments of the disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the disclosure, and not all of them. It should be understood that the disclosure is not limited to exemplary embodiments.

[0035] It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this disclosure.

[0036] Exemplary Overview

[0037] Digital content can be transferred between two devices. The device used to send the digital content can be called the content source device. The device used to receive the digital content can be called the content receiving device.

[0038] Optionally, digital content may include, but is not limited to, images, audio, and video. Content source devices may include, but are not limited to, mobile phones, tablets, and desktop computers. Content receiving devices may include head-mounted displays.

[0039] Understandably, head-mounted display devices can also be called head-mounted displays (HMDs) or head-mounted displays. Head-mounted display devices can take the form of glasses, helmets, etc. They can include, but are not limited to, AR glasses and VR glasses.

[0040] In scenarios where digital content is transmitted from a content source device to a head-mounted display device, there may also be a need for the content source device to transmit additional information to the head-mounted display device. How to meet the needs of transmitting this additional information is a technical problem worthy of attention for those skilled in the art.

[0041] Figure 1 is a system architecture diagram for solving the technical problem in some exemplary embodiments of this disclosure, including a content source device 110 and a head-mounted display device 120. On the content source device 110 side, additional information to be transmitted can be encoded into the digital content to be transmitted, and the encoded digital content is sent to the head-mounted display device 120. On the head-mounted display device 120 side, the received digital content can be decoded, and additional information can be obtained from the decoding result. Thus, through the collaborative work of the content source device 110 and the head-mounted display device 120, the need for additional information transmission can be better met.

[0042] Exemplary methods

[0043] Figure 2 is a schematic flowchart of an image processing method provided by some exemplary embodiments of this disclosure. The method shown in Figure 2 can be applied to a content source device. The method shown in Figure 2 may include steps 210, 220, 230, and 240.

[0044] Step 210: Obtain the source image and the original information to be transmitted corresponding to the source image.

[0045] In some alternative embodiments of this disclosure, the source image may be digital content to be transmitted from the content source device to the head-mounted display device. The source image may be a color image. For example, the source image may be an RGB image, where R represents red, G represents green, and B represents blue. Alternatively, the source image may be a grayscale image.

[0046] In some optional embodiments of this disclosure, the original information to be transmitted corresponding to the source image may be additional information to be transmitted from the content source device to the head-mounted display device. Optionally, the original information to be transmitted corresponding to the source image may be associated with the source image. The association between the original information to be transmitted and the source image may be: the original information to be transmitted includes display timestamp information, used to indicate the time point at which the source image is displayed on the screen of the head-mounted display device (i.e., displayed through the display screen in the optical system of the head-mounted display device). Alternatively, the association between the original information to be transmitted and the source image may be: the original information to be transmitted includes at least one of the pose information and attitude information of the content source device, used as reference data for rendering the source image on the head-mounted display device side. It is understood that the above-mentioned original information to be transmitted may be information transmitted from the content source device to the head-mounted display device to assist the display of the head-mounted display device.

[0047] Optionally, the pose information mentioned above may include position information and attitude information. Pose information can be understood as the pose in a reference coordinate system. Position information can be understood as the position in a reference coordinate system. Attitude information can be understood as the attitude in a reference coordinate system. The reference coordinate system may, for example, be the world coordinate system.

[0048] Step 220: Encapsulate the original information to be transmitted to generate the target information to be transmitted.

[0049] In some optional embodiments of this disclosure, a header and a trailer can be added to the original information to be transmitted according to certain encapsulation rules to form a complete data packet that sequentially includes a header, the original information to be transmitted, and a trailer. This complete data packet can be used as the target information to be transmitted. It is understood that the target information to be transmitted can also be generated by encapsulating the original information to be transmitted in other ways; there is no single limitation here.

[0050] Step 230: Encode the target information to be transmitted in a preset area of ​​the source image to obtain the target image.

[0051] In some optional embodiments of this disclosure, the preset region of the source image can be a pre-defined area within the source image, which can be used to carry additional information transmitted from the content source device to the head-mounted display device. For example, the preset region of the source image can be the area containing the first row of pixels or the area containing the last row of pixels in the source image. Alternatively, the preset region can be the area containing the first column of pixels or the area containing the last column of pixels in the source image.

[0052] In some optional embodiments of this disclosure, the target information to be transmitted can be converted from one form to another and stored in a preset area of ​​the source image to achieve encoding of the target information to be transmitted in the preset area of ​​the source image, thereby updating the source image to the target image. Since the target information to be transmitted can be obtained by encapsulating the original information to be transmitted, the target image can be obtained by encoding the target information to be transmitted in the preset area of ​​the source image, and the target image can carry the original information to be transmitted.

[0053] Step 240: Send the target image to the head-mounted display device.

[0054] In some alternative embodiments of this disclosure, the content source device may transmit the target image to the head-mounted display device via a transmission interface. The transmission interface may include, but is not limited to, DisplayPort (DP), High-Definition Multimedia Interface (HDMI), etc.

[0055] In the embodiments of this disclosure, the source image can be digital content to be transmitted from the content source device to the head-mounted display device. The original information to be transmitted corresponding to the source image can be additional information that the content source device needs to transmit to the head-mounted display device and that is related to the source image. On the content source device side, the target information to be transmitted can be generated by encapsulating the original information to be transmitted, or the target image can be obtained by encoding the target information to be transmitted in a preset area of ​​the source image. On the head-mounted display device side, the original information to be transmitted, i.e., the additional information carried in the target image, can be obtained by decoding (which can be the reverse of encoding) and parsing (which can be the reverse of encapsulation) the target image. In this way, the additional information transmission requirements can be well met through the collaborative work of the content source device and the head-mounted display device. In addition, since the additional information is carried in the target image as digital content, the transmission of the additional information can be achieved by reusing the digital content transmission path, without adding new hardware (e.g., lines) for the transmission of additional information. Therefore, the implementation cost of transmitting additional information is low.

[0056] In some optional embodiments, the content source device and the head-mounted display device work together to construct a digital content transmission path. An image processing method is provided, applied to the content source device. The image processing method may include: acquiring a source image and corresponding raw information to be transmitted; encapsulating the raw information to be transmitted to generate target information to be transmitted; encoding the target information to be transmitted in a preset area of ​​the source image to obtain a target image; and sending the target image to the head-mounted display device through the digital content transmission path.

[0057] Figure 3 is a schematic flowchart of an image acquisition method provided by some exemplary embodiments of this disclosure. The method shown in Figure 3 can be applied to a content source device. The method shown in Figure 3 may include steps 310 and 320. Optionally, a combination of steps 310 and 320 can be used as an alternative implementation for obtaining a target image through encoding.

[0058] Step 310: Encode the target information to be transmitted to generate encoded information.

[0059] In some optional embodiments of this disclosure, the target information to be transmitted may include at least one unit of data information. For example, the target information to be transmitted may include N units of data information. N can be 1, 2, 3, 4, or an integer greater than 4, and will not be listed here. One unit of data information may be 1 byte of information. It is understood that 1 byte of information typically includes 8 bits of information. That is, 1 byte of information typically includes 8 binary characters.

[0060] As shown in Figure 4-1, the encoded information can be generated through the following steps.

[0061] Step 410: For the unit data information in the target information to be transmitted, perform the following operations: perform a preset verification operation on the unit data information to obtain a first verification code; convert the characters in the unit data information and the characters in the obtained first verification code into corresponding encoded feature values ​​according to the preset conversion rules; arrange the converted encoded feature values ​​in order to form a corresponding encoded feature value group.

[0062] In some optional embodiments of this disclosure, the preset verification operation may include, but is not limited to, the sum verification operation, the cyclic redundancy check (CRC) operation, the parity check operation, etc.

[0063] As described above, the target information to be transmitted can include N units of data. Taking a unit of data as 1 byte and the preset check operation as parity check as an example, since 1 byte of information includes 8 binary characters, we can count the number of binary characters that are 1. If the count is odd, the first checksum can be 1 (here, "1" is a binary character). If the count is even, the first checksum can be 0 (here, "0" is a binary character). Next, according to the preset conversion rules, the binary characters in the 8 binary characters included in the 1 byte of information and the binary character used as the first checksum can be converted into corresponding encoded feature values, thus obtaining 9 encoded feature values. The preset encoding rules can be, for example: if the binary character is 1, the corresponding encoded feature value is 255; if the binary character is 0, the corresponding encoded feature value is 0. Arranging these 9 encoded feature values ​​in sequence can form an encoded feature value group.

[0064] In an optional example, as shown in Figure 4-2, one byte of information can include eight binary characters, namely Z1, Z2, Z3, Z4, Z5, Z6, Z7, and Z8. According to a preset conversion rule, the encoded feature value obtained by converting Z1 can be R1, Z2 can be R2, Z3 can be R3, Z4 can be R4, Z5 can be R5, Z6 can be R6, Z7 can be R7, and Z8 can be R8. Furthermore, by performing a parity check operation on the one byte of information, a first checksum can be obtained, and the encoded feature value obtained by converting the first checksum can be R9. The sequence R1, R2, R3, R4, R5, R6, R7, R8, and R9 forms the encoded feature value group corresponding to the one byte of information.

[0065] Following the above method, N sets of encoded feature values ​​can be obtained, each corresponding one-to-one with one of the N units of data information in the target information to be transmitted. It is understood that the encoding method given above is merely an example; various encoding methods can be used depending on the actual needs, and there is no single limitation.

[0066] Step 420: Generate encoded information based on the encoded feature value group corresponding to the data information of each unit.

[0067] In some optional embodiments of this disclosure, the encoding information may include N groups of encoded feature values, each corresponding one-to-one with one of the N unit data information. Of course, in addition to the N groups of encoded feature values, the encoding information may also include other information. For example, a preset check operation can be performed on the N groups of encoded feature values ​​to obtain a corresponding checksum, and the encoding information may also include this checksum.

[0068] In the embodiment shown in Figure 4-1, for each unit data information in the target information to be transmitted, by combining preset verification operations and preset conversion rules, the unit data information can be efficiently and reliably converted into corresponding coded feature value groups. This achieves the conversion of unit data information from one form to another, and on this basis, it also enables the conversion of the target information to be transmitted from one form to another, obtaining coded information. Furthermore, due to the introduction of preset verification operations, the coded information contains verification information (e.g., a first checksum). On the head-mounted display device side, the verification information can be used to verify whether errors have occurred during the transmission process, further improving the accuracy of information transmission.

[0069] Of course, the method of encoding the target information to be transmitted and generating encoded information is not limited to this. For example, a unit of data information can be 1 bit, and the target information to be transmitted, consisting of N unit data information units, can be N bits. Then, according to a preset conversion rule, the N bits of information can be converted into corresponding N encoded feature values. Furthermore, a preset check operation can be performed on these N encoded feature values ​​to obtain the corresponding checksum. The encoded information can include these N encoded feature values ​​and the checksum.

[0070] It is understandable that regardless of how the encoded information is generated, the encoded information of the original information to be transmitted can be generated.

[0071] Step 320: Store the encoded information in a preset area of ​​the source image to obtain the target image.

[0072] In some alternative embodiments of this disclosure, at least a portion of the image data of a preset region of the source image can be replaced using encoded information to update the source image to the target image.

[0073] In the embodiments of this disclosure, converting the target information to be transmitted from one form to another can efficiently and reliably obtain encoded information. Storing the encoded information in a preset area of ​​the source image can efficiently and reliably obtain the target image carrying the original information to be transmitted. Thus, on the head-mounted display device side, by decoding and parsing the target image, the original information to be transmitted can be obtained efficiently and reliably.

[0074] It is understood that the content source device can install an application for running the head-mounted display device. This application can use the image processing method provided in this embodiment to encode the source image data provided by the content source device, obtaining a target image that can be decoded on the head-mounted display device. This allows the head-mounted display device to obtain the original information to be transmitted while simultaneously displaying the image provided by the content source device. The image processing method provided in this embodiment enables information transmission through the head-mounted display device and the corresponding driver, improving the security of information transmission. Optionally, the original information to be transmitted can assist the head-mounted display device in displaying the frame image, further improving the display effect of the head-mounted display device.

[0075] Figure 5 is a flowchart illustrating an information storage method provided by some exemplary embodiments of this disclosure. The method shown in Figure 5 can be applied to a content source device. The method shown in Figure 5 may include steps 510 and 520. Optionally, a combination of steps 510 and 520 can be used as an alternative implementation for storing encoded information in a preset area of ​​the source image.

[0076] Step 510: Determine a preset region in the source image.

[0077] Step 520: Store the encoded information in a preset area so that the encoded feature values ​​in the encoded information replace the pixel values ​​of the preset area of ​​the source image.

[0078] Here, taking an RGB image as the source image as an example, each pixel in the source image can have three pixel values: the R channel value, the G channel value, and the B channel value. If each of these three pixel values ​​is replaced with one coded feature value from the encoded information, then the three coded feature values ​​can be stored in the source image. As mentioned above, the encoded information can include N groups of coded feature values, and each group of coded feature values ​​can include nine coded feature values. Therefore, the encoded information can include a total of 9*N coded feature values. By replacing the three pixel values ​​of each pixel in the 9*N / 3 = 3N pixels in the preset area of ​​the source image with one coded feature value from the 9*N coded feature values, the encoded information can be stored in the preset area of ​​the source image.

[0079] Taking a grayscale image as an example, each pixel in the source image can have one pixel value. If this pixel value is replaced with one coded feature value from the encoded information, then one coded feature value can be stored in the source image. Since the encoded information includes a total of 9*N coded feature values, by replacing the pixel value of each of the 9*N pixels in the preset area of ​​the source image with one of the 9*N coded feature values, the encoded information can be stored in the preset area of ​​the source image.

[0080] In the embodiments of this disclosure, by replacing the original corresponding pixel values ​​of the preset area of ​​the source image with each encoded feature value in the encoded information, the storage of encoded information in the preset area of ​​the source image can be achieved efficiently and reliably.

[0081] Figure 6-1 is a schematic flowchart illustrating an information generation method provided by some exemplary embodiments of this disclosure. The method shown in Figure 6-1 can be applied to a content source device. The method shown in Figure 6-1 may include steps 610, 620, 630, and 640. Optionally, a combination of steps 610 to 640 can be used as an alternative implementation for generating target information to be transmitted.

[0082] Step 610: Perform a preset verification operation on the amount of information in the original information to be transmitted to obtain the second verification code.

[0083] In some optional embodiments of this disclosure, the preset check operation may include, but is not limited to, the sum check operation, the cyclic redundancy check operation, the parity check operation, etc.

[0084] In some optional embodiments of this disclosure, the amount of information in the original information to be transmitted can also be referred to as the length of the original information to be transmitted. The length of the original information to be transmitted can be, for example, 2 bytes. A second checksum can be obtained by performing a preset checksum operation on the amount of information in the original information to be transmitted. The length of the second checksum can be, for example, 1 byte.

[0085] Step 620: Concatenate the information, the second check code, and the original information to be transmitted to obtain the concatenated information.

[0086] In some optional embodiments of this disclosure, the information content, the second check code, and the original information to be transmitted can be concatenated in various ways, without specific limitations. For example, when concatenating the information content, the second check code, and the original information to be transmitted, the information content can be ordered first, the original information to be transmitted can be ordered last, and the second check code can be located between the information content and the original information to be transmitted, thereby obtaining concatenated information that sequentially includes the information content, the second check code, and the original information to be transmitted.

[0087] Step 630: Perform a preset verification operation on the spliced ​​information to obtain the third verification code.

[0088] In some alternative embodiments of this disclosure, similar to the second check code, the length of the third check code may be, for example, 1 byte.

[0089] Step 640: Concatenate the spliced ​​information and the third check code to obtain the target information to be transmitted.

[0090] In some optional embodiments of this disclosure, the concatenated information and the third checksum can be concatenated in various ways. For example, when concatenating the concatenated information and the third checksum, the concatenated information can be ordered first, followed by the third checksum, thus obtaining target information to be transmitted that sequentially includes the concatenated information and the third checksum. Thus, as shown in Figure 6-2, the target information to be transmitted can sequentially include information content, the second checksum, the original information to be transmitted, and the third checksum. The information content and the second checksum can be considered as a header added to the original information to be transmitted during the encapsulation process. The third checksum can be considered as a tail added to the original information to be transmitted during the encapsulation process.

[0091] In the embodiments of this disclosure, based on the amount of information in the original information to be transmitted and combined with a preset verification operation, the corresponding header and trailer can be added to the original information to be transmitted efficiently and quickly to form a complete data packet, thereby obtaining the target information to be transmitted and further improving the security of the target information to be transmitted. In addition, due to the introduction of the preset verification operation, the target information to be transmitted contains verification information (such as a second verification code, a third verification code, etc.). On the head-mounted display device side, the verification information can be used to verify whether there are any errors in the transmission process, and this verification process further improves the accuracy of the obtained target information to be transmitted.

[0092] Figure 7 is a schematic flowchart of an image processing method provided by some exemplary embodiments of this disclosure. The method shown in Figure 7 can be applied to a head-mounted display device. The method shown in Figure 7 may include steps 710, 720, 730, and 740.

[0093] Step 710: Receive the target image from the content source device.

[0094] In some alternative embodiments of this disclosure, the head-mounted display device may receive a target image from a content source device via a transmission interface.

[0095] Step 720: Decode the target image to obtain the target information to be transmitted.

[0096] As described above, on the content source device side, the target information to be transmitted can be encoded in a preset area of ​​the source image to obtain the target image. Correspondingly, on the head-mounted display device side, the target information to be transmitted can be restored by decoding the target image.

[0097] Step 730: Based on the target information to be transmitted, determine the source image and the corresponding original information to be transmitted.

[0098] In some optional embodiments of this disclosure, the target information to be transmitted can be processed in various ways to determine the source image and the corresponding original information to be transmitted from the target image. For example, a preset area storing the target information to be transmitted can be cropped from the target image to obtain the source image. Thus, the size of the source image can be slightly smaller than the source image in step 210 of this disclosure. For example, the number of rows in the source image can be one less than that in step 210 of this disclosure. Another example is that the number of columns in the source image can be one less than that in step 210 of this disclosure. Yet another example is that a specified local image can be used to replace the preset area in the target image, thereby obtaining a source image of the same size as the original source image.

[0099] In some optional embodiments of this disclosure, the target information to be transmitted may include the original information to be transmitted corresponding to the source image. The original information to be transmitted can be obtained by parsing the target information to be transmitted.

[0100] Step 740: Render the source image based on the original information to be transmitted, and display the image on the head-mounted display device.

[0101] In some optional embodiments of this disclosure, the head-mounted display device can render the image displayed on the head-mounted display device using an image rendering engine. Based on the original information to be transmitted, the rendering engine can be invoked to render the source image, and the rendered source image can be displayed on the screen. It is understood that the aforementioned original information to be transmitted can be used to render the source image displayed on the head-mounted display device, so that the display of the source image satisfies the characteristics indicated by the original information to be transmitted.

[0102] In the embodiments of this disclosure, on the head-mounted display device side, the original information to be transmitted, i.e., the additional information carried in the target image, can be obtained by decoding (which can be the reverse of encoding) and parsing (which can be the reverse of encapsulation) the target image from the content source device. Thus, through the collaborative work of the content source device and the head-mounted display device, the requirements for transmitting additional information can be well met. Since the additional information is carried in the target image as digital content, its transmission can be achieved by reusing the digital content transmission path, without needing to add new hardware (e.g., lines) for the transmission of additional information; therefore, the implementation cost of transmitting additional information is low. Furthermore, on the head-mounted display device side, the source image can be rendered based on the additional information carried in the target image. That is, the additional information can provide a valid reference for the image display at the head-mounted display device, which helps ensure the display effect of the head-mounted display device.

[0103] In some optional embodiments, the head-mounted display device and the content source device work together to construct a digital content transmission path. An image processing method is provided, applied to a head-mounted display device. The image processing method may include: acquiring a target image from the content source device via the digital content transmission path, wherein the target image is used to acquire a source image and original information to be transmitted; processing the target image to acquire the original information to be transmitted and the source image; rendering the source image based on the original information to be transmitted; and displaying the rendered image on the head-mounted display device.

[0104] Figure 8 is a flowchart illustrating an information acquisition method provided by some exemplary embodiments of this disclosure. The method shown in Figure 8 can be applied to a head-mounted display device. The method shown in Figure 8 may include steps 810 and 820. Optionally, a combination of steps 810 and 820 can be used as an alternative implementation for obtaining target information to be transmitted.

[0105] Step 810: Obtain encoding information from a preset region of the target image.

[0106] As described above, on the content source device side, the target image can be obtained by storing encoded information in a preset area of ​​the source image. That is, the preset area of ​​the target image can store encoded information. Therefore, on the head-mounted display device side, the encoded information can be obtained from the preset area of ​​the target image.

[0107] Step 820: Restore the encoded information to obtain the target information to be transmitted.

[0108] In some optional embodiments of this disclosure, the encoding information may include at least one group of encoded feature values. For example, the encoding information may include N groups of encoded feature values, and each group of encoded feature values ​​may include 9 encoded feature values. As shown in FIG9, restoring the encoded information to obtain the target information to be transmitted may include steps 910 and 920.

[0109] Step 910: For the encoded feature value group in the encoded information, perform the following operations: According to the restoration rule adapted to the preset conversion rule, restore the encoded feature value in the encoded feature value group to the corresponding character, and obtain multiple characters arranged in sequence; determine the first check code and the first group of characters from the multiple characters; perform a preset check operation on the first group of characters to obtain the fourth check code; in response to the fourth check code matching the first check code, determine the first group of characters as the unit data information obtained by restoring the encoded feature value group.

[0110] As described above, a preset encoding rule could be, for example, that if the binary character is 1, the corresponding encoding feature value is 255; if the binary character is 0, the corresponding encoding feature value is 0. Correspondingly, a restoration rule adapted to the preset conversion rule could be: if the encoding feature value is less than a preset threshold (e.g., 100, 120, 127, etc.), the corresponding binary character is 0; if the encoding feature value is greater than or equal to the preset threshold, the corresponding binary character is 1.

[0111] Taking a unit of data information as 1 byte and the preset check operation as parity check as an example, for each of the N encoded feature value groups, we can iterate through the 9 encoded feature values ​​included in that group. If the iterated encoded feature value is less than a preset threshold, it can be restored to the binary character 0. If the iterated encoded feature value is greater than or equal to the preset threshold, it can be restored to the binary character 1. In this way, we can obtain 9 binary characters that correspond one-to-one with these 9 encoded feature values ​​and are arranged in order. Next, we can determine the first check code and the first group of characters from these 9 binary characters. For example, the first group of characters can be composed of the first 8 binary characters in the sequence, and the last binary character in this group can be used as the first check code. Then, we can count the number of binary characters that are 1 in the first group of characters. If the count is odd, the fourth check code can be 1 (here, "1" is a binary character). If the count is even, the fourth checksum can be 0 (where "0" is a binary character). Next, the fourth checksum can be compared with the first checksum. If they are the same, it means no error occurred during transmission, and the first set of characters can be used as the 1-byte information obtained by restoring the encoded feature value group. If they are different, it means an error occurred during transmission, and the encoded feature value group can be discarded.

[0112] Assuming that no errors occur in the transmission of the N coded feature value groups, then following the above method, N units of data information corresponding one-to-one with the N coded feature value groups can be obtained.

[0113] Step 920: Based on the unit data information corresponding to each group of encoded feature values, obtain the target information to be transmitted.

[0114] Optionally, the target information to be transmitted may include N units of data information that correspond one-to-one with N groups of coded feature values.

[0115] In some embodiments, if some of the coded feature value groups in the N coded feature value groups may have been erroneous during transmission, the target information to be transmitted may include the unit data information corresponding to the remaining coded feature value groups respectively.

[0116] In the embodiment shown in Figure 9, for each group of encoded feature values ​​in the encoded information, combined with restoration rules adapted to preset conversion rules and preset verification operations, the corresponding unit data information can be restored efficiently and reliably. Based on this, the target information to be transmitted can be obtained efficiently and reliably. In addition, due to the introduction of preset verification operations, the transmission process can be verified based on verification information (e.g., the fourth check code), which helps to ensure the accuracy of the obtained target information to be transmitted.

[0117] Of course, the method of restoring the encoded information to obtain the target information to be transmitted is not limited to this. For example, as described above, in some embodiments, a unit of data information can be 1 bit of information, and the encoded information can include N encoded feature values ​​and 1 check code. Then, a preset check operation can be performed on the N encoded feature values, and the resulting check code can be compared with the check code in the encoded information. If the comparison result is that the two check codes are the same, then the N encoded feature values ​​can be restored to the corresponding N binary characters according to the restoration rule adapted to the preset conversion rule. These N binary characters can each be used as a unit of data information, and thus, these N binary characters can form the target information to be transmitted.

[0118] In the embodiments of this disclosure, encoded information can be obtained efficiently and reliably from a preset area of ​​the target image. Since the encoded information is generated on the content source device side by encoding the target information to be transmitted, on the head-mounted display device side, by performing reverse processing on the encoded information, the encoded information can be effectively restored, thereby obtaining the target information to be transmitted.

[0119] Figure 10 is a flowchart illustrating an information acquisition method provided by some exemplary embodiments of this disclosure. The method shown in Figure 10 can be applied to a head-mounted display device. The method shown in Figure 10 may include steps 1010, 1020, and 1030. Optionally, a combination of steps 1010 to 1030 can be used as an alternative implementation for obtaining the original information to be transmitted.

[0120] Step 1010: Determine the amount of information in the original information to be transmitted and the second check code corresponding to the amount of information from the target information to be transmitted.

[0121] In some optional embodiments of this disclosure, the composition of the target information to be transmitted can be seen in Figure 6-2. That is, the header of the target information to be transmitted may include the amount of information to be transmitted and a second checksum corresponding to the amount of information. Therefore, the amount of information to be transmitted and the second checksum corresponding to the amount of information can be obtained from the header of the target information to be transmitted.

[0122] Step 1020: Perform a preset verification operation on the information to obtain the fifth verification code.

[0123] In some alternative embodiments of this disclosure, similar to the second check code, the length of the fifth check code may be, for example, 1 byte.

[0124] Step 1030: In response to the matching of the fifth check code and the second check code, the original information to be transmitted is obtained from the target information to be transmitted according to the amount of information.

[0125] In some optional embodiments of this disclosure, the fifth checksum can be compared with the second checksum. If the fifth checksum and the second checksum are the same, it can be determined that no error occurred during the transmission of the information, and the information is accurate and reliable. Then, the original information to be transmitted can be obtained from the target information to be transmitted according to the information content. For example, if the information content is n bytes, the n bytes of information after the header can be obtained from the target information to be transmitted, and this n bytes of information can be used as the original information to be transmitted. If the fifth checksum and the second checksum are different, it can be determined that an error occurred during the transmission of the information, and the information is unreliable. In this case, it is not necessary to perform the step of obtaining the original information to be transmitted from the target information to be transmitted according to the information content.

[0126] In the embodiments of this disclosure, the information content and second checksum of the original information to be transmitted can be obtained from the header of the target information to be transmitted. Combined with a preset checksum calculation, the reliability of the information content can be assessed. If the information content is reliable, the original information to be transmitted can be obtained from the target information to be transmitted according to the information content. This further improves the accuracy of the obtained original information to be transmitted.

[0127] Figure 11 is a schematic flowchart of an image display method provided by some exemplary embodiments of this disclosure. The method shown in Figure 11 can be applied to a head-mounted display device. The method shown in Figure 11 may include steps 1110 and 1120. Optionally, a combination of steps 1110 and 1120 can be used as an alternative implementation for displaying an image on a head-mounted display device. In the method shown in Figure 11, the original information to be transmitted may include display timestamp information. The display timestamp information can be used to indicate the time point at which the source image is displayed on the head-mounted display device.

[0128] Step 1110: Obtain the spatial distribution information of the head-mounted display device at the time point indicated by the display timestamp information. The spatial distribution information includes at least one of pose information and attitude information.

[0129] In some optional embodiments of this disclosure, the head-mounted display device may be equipped with an inertial measurement unit (IMU). By integrating the angular velocity data collected by the IMU, the attitude information of the head-mounted display device at the time indicated by the display timestamp information can be obtained. By integrating the acceleration data collected by the IMU, the position information of the head-mounted display device at the time indicated by the display timestamp information can be obtained. This position information and the attitude information can be combined to form the pose information of the head-mounted display device at the time indicated by the display timestamp information. Thus, based on the data collected by the inertial measurement unit, the spatial distribution information of the head-mounted display device at the time indicated by the display timestamp information can be obtained.

[0130] Step 1120: Render the source image based on spatial distribution information and display the image on the head-mounted display device.

[0131] In some optional embodiments of this disclosure, the image rendering engine can determine the spatial distribution of the current frame source image based on the spatial distribution information, perform screen rendering, and obtain the corresponding display screen. The display screen can be updated to the optical system for display, so as to present the source image to the user.

[0132] In some optional embodiments, the aforementioned original information to be transmitted may include the time point at which the current frame source image is displayed on the head-mounted display device. Then, the spatial distribution information of the head-mounted display device at that time point can be determined, so that the head-mounted display device can determine the spatial orientation or pose of the current frame source image based on this spatial distribution information. The solution provided by this embodiment can improve the matching degree between the anchor position of the source image in space and the spatial distribution of the head-mounted display device, reducing the latency of the source image. Optionally, for each frame source image displayed on the head-mounted display device, the solution provided in this embodiment can accurately calculate the anchor position of the source image in space, thereby reducing the image latency of the head-mounted display device during the display process and ensuring the display effect of the head-mounted display device.

[0133] In the embodiments of this disclosure, on the head-mounted display device side, based on the display timestamp information included in the original information to be transmitted, the source image can be displayed on the screen at a specified time point on the content source device. Furthermore, the rendering of the source image references the spatial distribution information of the head-mounted display device at that time point. That is, the data referenced for rendering the source image is relatively accurate, which is beneficial for accurately calculating the anchor position in space for the source image, thereby ensuring the display effect of the head-mounted display device. If the spatial distribution information includes pose information, rendering the source image based on this pose information is beneficial for presenting a 3-DOF (3 degrees of freedom) display effect through the head-mounted display device. If the spatial distribution information includes pose information, rendering the source image based on this pose information is beneficial for presenting a 6-DOF (6-DOF) display effect through the head-mounted display device.

[0134] In some alternative examples, the scheme disclosed herein can be divided into two stages: an encoding stage and a decoding stage.

[0135] During the encoding stage, the content source device can add a header and a trailer to the original information to be transmitted to generate the target information to be transmitted. The header can sequentially include the amount of information in the original information to be transmitted, and a second checksum obtained by performing a preset check operation on the amount of information. The trailer can include a third checksum obtained by performing a preset check operation on the concatenation result of the amount of information, the second checksum, and the original information to be transmitted. The third checksum can be used to verify the correctness of the concatenation result. For each byte of information in the target information to be transmitted, the byte can be converted into 9 binary characters, where the first 8 binary characters can be the valid information part of the byte, and the last binary character can be the checksum character. Based on this, combined with preset conversion rules, the encoded feature value group corresponding to each byte of information in the target information to be transmitted can be obtained, thereby generating encoded information. Storing the encoded information in a preset area of ​​the source image (e.g., the first row of the source image) yields the target image.

[0136] During the decoding phase, the head-mounted display device can decode the target image to obtain the target information to be transmitted. For this target information, every nine encoded feature values ​​can be parsed as a group. Based on this, the information content and second checksum of the original information to be transmitted can be obtained from the header of the target information. A fifth checksum can be obtained by performing a preset checksum operation on the information content. If the fifth checksum is the same as the second checksum, the original information to be transmitted can be obtained from the target information according to the information content. The original information to be transmitted may include display timestamp information. Based on the posture information of the head-mounted display device at the time indicated by the display timestamp information, the source image can be rendered for image display on the head-mounted display device.

[0137] It is understood that the solution provided in the above embodiments can obtain the original information to be transmitted for auxiliary rendering through encoding and decoding during the display of the source image of the head-mounted display device, and render the source image displayed by the head-mounted display device based on the original information to be transmitted, which helps to improve the display effect of the head-mounted display device.

[0138] In some optional embodiments, the aforementioned original information to be transmitted can be the pose information or orientation information of the content source device. Therefore, the head-mounted display device can obtain the orientation of the content source device by decoding the received target image. When rendering the source image, a straight line or curve pointing from the content source device to the source image can be rendered according to the orientation of the content source device, thereby enabling the content source device to act as a controller to control the display of the head-mounted display device through the straight line or curve.

[0139] Exemplary System

[0140] Figure 1 is a schematic diagram of the structure of an image display system provided by some exemplary embodiments of the present disclosure. The method shown in Figure 1 may include a content source device 110 and a head-mounted display device 120.

[0141] Content source device 110 is configured to execute the method applied to the content source device in any of the above embodiments;

[0142] Head-mounted display device 120 is used to perform the method applied to a head-mounted display device in any of the above embodiments.

[0143] It is understood that the solution provided in this disclosure is applicable to a display system consisting of a content source device 110 and a head-mounted display device 120. The encoding and decoding of the original information to be transmitted can be achieved within the display system itself, eliminating the need for additional information transmission lines, thus improving information transmission efficiency and reducing information transmission costs. Simultaneously, the original information to be transmitted obtained by the head-mounted display device 120 can meet the high-quality spatial display requirements of the head-mounted display device 120.

[0144] In some alternative embodiments, the content source device 110 may install an application for running a head-mounted display device; the content source device 110 runs the application and executes the method applied to the content source device in any of the above embodiments to obtain a target image that can be decoded on the head-mounted display device; the head-mounted display device decodes the target image to obtain the original information to be transmitted; then, based on the original information to be transmitted, the source image is rendered, and the rendered image is displayed on the head-mounted display device.

[0145] In the system disclosed herein, the various optional embodiments, optional implementation methods and optional examples disclosed above can be flexibly selected and combined as needed to achieve the corresponding functions and effects, and this disclosure does not list them all.

[0146] Exemplary device

[0147] Figure 12 is a schematic diagram of the structure of an image processing apparatus provided in some exemplary embodiments of this disclosure. The apparatus shown in Figure 12 can be applied to a content source device. The apparatus shown in Figure 12 may include:

[0148] The acquisition module 1210 is used to acquire the source image and the corresponding original information to be transmitted;

[0149] The encapsulation module 1220 is used to encapsulate the original information to be transmitted to generate the target information to be transmitted.

[0150] The encoding module 1230 is used to encode the target information to be transmitted in a preset area of ​​the source image to obtain the target image;

[0151] The transmitting module 1240 is used to transmit the target image to the head-mounted display device.

[0152] In some optional embodiments of this disclosure, as shown in FIG13, the encoding module 1230 includes:

[0153] The encoding submodule 1310 is used to encode the target information to be transmitted and generate encoded information;

[0154] The storage submodule 1320 is used to store the encoded information into a preset area of ​​the source image to obtain the target image.

[0155] In some optional embodiments of this disclosure, the target information to be transmitted includes at least one unit of data information;

[0156] As shown in Figure 14, the encoding submodule 1310 includes:

[0157] The first processing unit 1410 is used to perform the following operations on the unit data information in the target information to be transmitted: perform a preset verification operation on the unit data information to obtain a first verification code; convert the characters in the unit data information and the characters in the obtained first verification code into corresponding encoded feature values ​​according to a preset conversion rule; and arrange the converted encoded feature values ​​in order to form a corresponding encoded feature value group.

[0158] The generation unit 1420 is used to generate encoded information based on the encoded feature value group corresponding to the data information of each unit.

[0159] In some optional embodiments of this disclosure, as shown in FIG15, the storage submodule 1320 includes:

[0160] The determining unit 1510 is used to determine a preset region in the source image;

[0161] Storage unit 1520 is used to store encoded information into a preset area so that the encoded feature value in the encoded information replaces the pixel value of the preset area of ​​the source image.

[0162] In some optional embodiments of this disclosure, as shown in FIG16, the encapsulation module 1220 includes:

[0163] The first verification operation submodule 1610 is used to perform a preset verification operation on the amount of information in the original information to be transmitted to obtain the second verification code.

[0164] The first splicing submodule 1620 is used to splice the information, the second check code and the original information to be transmitted to obtain spliced ​​information;

[0165] The second verification operation submodule 1610 is used to perform a preset verification operation on the spliced ​​information to obtain the third verification code;

[0166] The second splicing submodule 1640 is used to splice the splicing information and the third check code to obtain the target information to be transmitted.

[0167] Figure 17 is a schematic diagram of the structure of an image processing apparatus provided in some other exemplary embodiments of the present disclosure. The apparatus shown in Figure 17 can be applied to a head-mounted display device. The apparatus shown in Figure 17 may include:

[0168] Receiver module 1710 is used to receive a target image from a content source device;

[0169] The decoding module 1720 is used to decode the target image to obtain the target information to be transmitted;

[0170] The determination module 1730 is used to determine the source image and the corresponding original information to be transmitted based on the target information to be transmitted;

[0171] Display module 1740 is used to render source images based on the original information to be transmitted and to display the images on a head-mounted display device.

[0172] In some optional embodiments of this disclosure, as shown in FIG18, the decoding module 1720 includes:

[0173] The first acquisition submodule 1810 is used to acquire encoded information from a preset region of the target image;

[0174] The restoration submodule 1820 is used to restore the encoded information to obtain the target information to be transmitted.

[0175] In some optional embodiments of this disclosure, the encoding information includes at least one group of encoded feature values;

[0176] As shown in Figure 19, the restoration submodule 1820 includes:

[0177] The second processing unit 1910 is configured to perform the following operations on the encoded feature value group in the encoded information: according to the restoration rule adapted to the preset conversion rule, restore the encoded feature values ​​in the encoded feature value group to the corresponding characters, and obtain multiple characters arranged in sequence; determine the first check code and the first group of characters from the multiple characters; perform a preset check operation on the first group of characters to obtain the fourth check code; in response to the fourth check code matching the first check code, use the first group of characters as the unit data information obtained by restoring the encoded feature value group.

[0178] The acquisition unit 1920 is used to obtain the target information to be transmitted based on the unit data information corresponding to each group of encoded feature values.

[0179] In some optional embodiments of this disclosure, as shown in FIG20, the determining module 1730 includes:

[0180] The determination submodule 2010 is used to determine the amount of information to be transmitted and the second check code corresponding to the amount of information from the target information to be transmitted;

[0181] The third verification operation submodule 2020 is used to perform preset verification operations on the information to obtain the fifth verification code;

[0182] The second acquisition submodule 2030 is used to obtain the original information to be transmitted from the target information to be transmitted according to the amount of information in response to the matching of the fifth check code and the second check code.

[0183] In some optional embodiments of this disclosure, the original information to be transmitted includes display timestamp information;

[0184] As shown in Figure 21, the display module 1740 includes:

[0185] The third acquisition submodule 2110 is used to acquire the spatial distribution information of the head-mounted display device at the time point indicated by the display timestamp information. The spatial distribution information includes at least one of pose information and posture information.

[0186] Display submodule 2120 is used to render source images based on spatial distribution information and display the images on a head-mounted display device.

[0187] In the apparatus disclosed herein, the various optional embodiments, optional implementation methods and optional examples disclosed above can be flexibly selected and combined as needed to achieve the corresponding functions and effects, and this disclosure does not list them all.

[0188] Exemplary electronic devices

[0189] Figure 22 illustrates a block diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 2200 includes one or more processors 2210 and a memory 2220.

[0190] The processor 2210 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 2200 to perform desired functions.

[0191] The memory 2220 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 2210 may execute one or more computer program instructions to implement the methods of the various embodiments of this disclosure described above and / or other desired functions.

[0192] In one example, the electronic device 2200 may also include an input device 2230 and an output device 2240, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0193] The input device 2230 may also include, for example, a keyboard, a mouse, etc.

[0194] The output device 2240 can output various information to the outside, including, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0195] Of course, for simplicity, Figure 22 only shows some of the components of the electronic device 2200 that are relevant to this disclosure, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 2200 may include any other suitable components depending on the specific application.

[0196] Exemplary computer program products and computer-readable storage media

[0197] In addition to the methods and apparatus described above, embodiments of this disclosure may also be computer program products comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods according to various embodiments of this disclosure as described in the "Exemplary Methods" section of this specification.

[0198] Computer program products can be written in any combination of one or more programming languages ​​to perform the operations of embodiments of this disclosure. These programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0199] Furthermore, embodiments of this disclosure may also be computer-readable storage media storing computer program instructions thereon, which, when executed by a processor, cause the processor to perform the steps in the methods according to various embodiments of this disclosure described in the "Exemplary Methods" section above.

[0200] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0201] The basic principles of this disclosure have been described above with reference to specific embodiments. However, the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. The specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the specific details described above.

[0202] Various modifications and variations can be made to this disclosure without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this disclosure and their equivalents, this disclosure is also intended to include such modifications and variations.

Claims

1. An image processing method applied to a content source device, comprising: Obtain the source image and the corresponding raw information to be transmitted; The original information to be transmitted is encapsulated to generate the target information to be transmitted; The target information to be transmitted is encoded in a preset area of ​​the source image to obtain the target image; The target image is sent to the head-mounted display device.

2. The method according to claim 1, wherein, The step of encoding the target information to be transmitted in a preset region of the source image to obtain the target image includes: The target information to be transmitted is encoded to generate encoded information; The encoded information is stored in a preset area of ​​the source image to obtain the target image.

3. The method according to claim 2, wherein, The target information to be transmitted includes at least one unit of data information; The step of encoding the target information to be transmitted to generate encoded information includes: For the unit data information in the target information to be transmitted, the following operations are performed: a preset verification operation is performed on the unit data information to obtain a first verification code; according to a preset conversion rule, the characters in the unit data information and the characters in the obtained first verification code are converted into corresponding encoded feature values; the converted encoded feature values ​​are arranged in order to form a corresponding encoded feature value group. The encoded information is generated based on the encoded feature value group corresponding to the data information of each unit.

4. The method according to claim 2 or 3, wherein, The step of storing the encoded information into a preset area of ​​the source image includes: The preset region is determined in the source image; The encoded information is stored in the preset area so that the encoded feature values ​​in the encoded information replace the pixel values ​​of the preset area of ​​the source image.

5. The method according to any one of claims 1 to 4, wherein, The process of encapsulating the original information to be transmitted to generate the target information to be transmitted includes: A preset verification operation is performed on the amount of information in the original information to be transmitted to obtain a second verification code; The information quantity, the second check code, and the original information to be transmitted are concatenated to obtain concatenated information; A preset verification operation is performed on the spliced ​​information to obtain a third verification code; The spliced ​​information and the third check code are spliced ​​together to obtain the target information to be transmitted.

6. The method according to any one of claims 1 to 5, wherein, The original information to be transmitted is used to render the image displayed by the head-mounted display device, so that the image displayed by the head-mounted display device can meet the characteristics indicated by the original information to be transmitted.

7. An image processing method applied to a head-mounted display device, comprising: Receive the target image from the content source device; The target image is decoded to obtain the target information to be transmitted; Based on the target information to be transmitted, determine the source image and the corresponding original information to be transmitted; Render the source image based on the original information to be transmitted; The image is displayed on the head-mounted display device.

8. The method according to claim 7, wherein, Decoding the target image to obtain the target information to be transmitted includes: Encoded information is obtained from a preset region of the target image; The encoded information is restored to obtain the target information to be transmitted.

9. The method according to claim 8, wherein, The encoded information includes at least one group of encoded feature values; The process of restoring the encoded information to obtain the target information to be transmitted includes: For the encoded feature value group in the encoded information, the following operations are performed: according to the restoration rule adapted to the preset conversion rule, the encoded feature values ​​in the encoded feature value group are restored to the corresponding characters, resulting in a plurality of characters arranged in sequence; from the plurality of characters, a first check code and a first group of characters are determined; a preset check operation is performed on the first group of characters to obtain a fourth check code; in response to the fourth check code matching the first check code, the first group of characters is determined as the unit data information obtained by restoring the encoded feature value group; Based on the unit data information corresponding to each group of encoded feature values, the target information to be transmitted is obtained.

10. The method according to any one of claims 7 to 9, wherein, The step of determining the source image and the corresponding original information to be transmitted based on the target information to be transmitted includes: From the target information to be transmitted, determine the amount of information in the original information to be transmitted and the second check code corresponding to the amount of information; A preset verification operation is performed on the information to obtain the fifth verification code; In response to the fifth check code matching the second check code, the original information to be transmitted is obtained from the target information to be transmitted according to the amount of information.

11. The method according to any one of claims 7 to 10, wherein, The original information to be transmitted includes display timestamp information; The source image is rendered based on the original information to be transmitted; Displaying images on the head-mounted display device includes: The spatial distribution information of the head-mounted display device at the time point indicated by the display timestamp information is obtained, wherein the spatial distribution information includes at least one of pose information and posture information; The source image is rendered based on the spatial distribution information and then displayed on the head-mounted display device.

12. An image processing system, comprising: A content source device for performing the method as described in any one of claims 1 to 6; A head-mounted display device for performing the method as described in any one of claims 7 to 11.

13. The system according to claim 12, wherein, The content source device is used to install and run the application program of the head-mounted display device; Run the application and perform the method as described in any one of claims 1 to 6 to obtain a target image that can be decoded in the head-mounted display device; The head-mounted display device is used to decode the target image to obtain the original information to be transmitted; and to render the source image based on the original information to be transmitted, and to display the rendered image.

14. An electronic device, comprising: Memory, used to store computer program products; A processor for executing a computer program product stored in the memory, wherein, when the computer program product is executed, it implements the method as described in any one of claims 1 to 11.

15. A computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the method as described in any one of claims 1 to 11.

Images