File processing methods, communication apparatus, storage medium, and program product

Abstract

Provided in the present disclosure are file processing methods, a communication apparatus, a storage medium, and a program product. A file processing method comprises: acquiring a file to be decoded, wherein said file comprises an image and information associated with the image, the information associated with the image being used for describing the image or a feature attribute in a target region of the image; parsing said file to obtain the image and the information associated with the image; and on the basis of the information associated with the image, performing a corresponding operation on the image.

Description

File processing method, communication apparatus, storage medium, and program product

[0001] The present disclosure claims priority to Chinese Patent Application No. 202411329217.7, filed on September 23, 2024, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] The present disclosure relates to the technical field of image processing, and in particular to a file processing method, a communication apparatus, a storage medium, and a program product. BACKGROUND

[0003] In the technical field of computer vision, when processing images (such as image recognition, etc.), some associated information of the images will usually be generated, such as recognized text information, object information, scene information, etc. contained in the images. If the above associated information of the images is not saved in the file format of the pictures or videos, it will be lost in the transmission and reprocessing process, resulting in that the recognized information cannot be used across platforms or the same information is repeatedly generated, wasting computing resources. SUMMARY

[0004] In one aspect, a file processing method is provided. The file processing method includes:

[0005] obtaining a to-be-decoded file, the to-be-decoded file including an image and associated information of the image, the associated information of the image being used to describe a feature attribute in the image or a target region of the image;

[0006] parsing the to-be-decoded file to obtain the image and the associated information of the image;

[0007] operating on the image based on the associated information of the image.

[0008] In another aspect, a file processing method is provided. The file processing method includes:

[0009] obtaining an image and associated information of the image, the associated information of the image being used to describe a feature attribute in the image or a target region of the image;

[0010] encapsulating the associated information of the image into the image to obtain a to-be-decoded file;

[0011] sending the to-be-decoded file.

[0012] In yet another aspect, a file processing apparatus is provided. The file processing apparatus includes an obtaining module, a parsing module, and a processing module, wherein:

[0013] The acquisition module is configured to acquire a to-be-decoded file, the to-be-decoded file comprising an image and associated information of the image, the associated information of the image being used to describe a feature attribute in the image or a target region of the image.

[0014] The parsing module is configured to parse the to-be-decoded file to obtain the image and the associated information of the image.

[0015] The processing module is configured to perform an operation on the image based on the associated information of the image.

[0016] In another aspect, a file processing apparatus is provided. The file processing apparatus comprises an acquisition module, an encapsulation module, and a communication module, wherein:

[0017] The acquisition module is configured to acquire an image and associated information of the image, the associated information of the image being used to describe a feature attribute in the image or a target region of the image.

[0018] The encapsulation module is configured to encapsulate the associated information of the image into the image to obtain a to-be-decoded file.

[0019] The communication module is configured to send the to-be-decoded file.

[0020] In another aspect, a communication apparatus is provided. The communication apparatus comprises a memory and a processor, wherein the memory and the processor are coupled; the memory is configured to store instructions executable by the processor; and the processor implements the file processing method of any of the above aspects when executing the instructions.

[0021] In another aspect, a computer readable storage medium is provided, the computer readable storage medium storing computer instructions, when the computer instructions are executed on a computer (for example, a communication apparatus or a file processing apparatus), the computer instructions cause the computer to execute the file processing method of any of the above aspects.

[0022] In another aspect, a computer program product is provided. The computer program product comprises computer program instructions, the computer program instructions being executed to implement the file processing method of any of the above aspects. BRIEF DESCRIPTION OF DRAWINGS

[0023] FIG. 1 is a schematic diagram of an application scenario of a file processing method according to an embodiment of the present disclosure.

[0024] FIG. 2 is a flowchart of a file processing method according to an embodiment of the present disclosure.

[0025] FIG. 3 is a flowchart of another file processing method according to an embodiment of the present disclosure.

[0026] FIG. 4 is a schematic diagram of a structure of a file processing apparatus according to an embodiment of the present disclosure.

[0027] FIG. 5 is a structural schematic diagram of another file processing apparatus according to an embodiment of the present disclosure.

[0028] FIG. 6 is a structural schematic diagram of a communication apparatus according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order for those skilled in the art to better understand the technical solutions of the embodiments of the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present disclosure.

[0030] In the description of the present disclosure, unless otherwise specified, the symbol " / " represents the relationship of "or", for example, A / B can represent A or B. "And / or" herein only represents a description of the association between the objects, which means that there can be three relationships, for example, A and / or B can represent: only A, only B, and A and B. In addition, "at least one" means one or more, and "multiple" means two or more. "First", "second", and the like do not limit the quantity and execution order, and "first", "second", and the like do not necessarily mean that the corresponding objects are different.

[0031] It should be noted that in the present disclosure, the words "exemplarily" or "for example" are used to represent an example, illustration or description. Any embodiment or design scheme described as "exemplarily" or "for example" in the present disclosure should not be interpreted as more preferred or more advantageous than other embodiments or design schemes in the present disclosure. Rather, the words "exemplarily" or "for example" are intended to present the relevant concept in a specific manner.

[0032] With the continuous development of generation and processing technology in the image field, the scenarios of using artificial intelligence (AI) to process pictures are becoming more and more extensive, not only for ordinary users, but also for enterprise image or video processing business. In the process of processing pictures or videos, some image-related information will usually be generated, such as text information, target information, scene information contained in the image, etc.

[0033] In some embodiments, the text associated with the image mainly has two types:

[0034] 1. User description: used to give user description / annotation information readable by human eyes. Exemplarily, the definition of user description can be:

[0035] Box type: 'udes'

[0036] Property type: Descriptive item property

[0037] Container: ItemPropertyContainerBox

[0038] Mandatory (per associated item_ID): No

[0039] Quantity (per associated item_ID): Zero or more

[0040] The field UserDescriptionProperty allows associating an item or entity group with a user-defined name, description and tag; there can be several of such properties, with different language codes.

[0041] When several instances of UserDescriptionProperty are associated with the same item or entity group, they represent alternatives that can be expressed in different languages, and therefore the most appropriate one should be selected when used. At most one UserDescriptionProperty with the same alt_lang value should be applied to the same item or entity group.

[0042] In an example, the syntax of UserDescriptionProperty can be:

[0043] The semantics of the fields involved in the syntax of UserDescriptionProperty can be referred to the following. lang is a string containing a language tag string according to the relevant standards, such as "en-US", "fr-FR" or "zh-CN", which indicates the language of the text contained in the name, description and tag. When lang is null, the corresponding language is unknown / undefined.

[0044] name is a null-terminated UTF-8 string containing a human-readable name for the item or entity group. If not present (i.e., an empty string is provided), no name is provided.

[0045] description is a null-terminated UTF-8 string containing a human-readable description of the item or entity group. If not present (i.e., an empty string is provided), no description is provided.

[0046] tags is a null-terminated UTF-8 string containing user-defined tags associated with the item, separated by commas. If not present (i.e., an empty string is provided), no tags are provided.

[0047] 2. Accessibility text: used to present textual information when the image cannot be displayed. Exemplarily, the definition of Accessibility text can be:

[0048] Box Type: 'altt'

[0049] Property Type: Descriptive item property

[0050] Container: ItemPropertyContainerBox

[0051] Mandatory (per an item): No

[0052] Quantity (per an item): Zero or more

[0053] The field AccessibilityTextProperty contains a string that can be used as alternative text for the image if it cannot be displayed, similar to the alt attribute in HTML. The language used by the alternative text is indicated by the language tag string, which conforms to the relevant standards.

[0054] When several instances of AccessibilityTextProperty are associated with the same item, they represent options that can be expressed in different languages, and the most appropriate one should be chosen when used. At most one AccessibilityTextProperty with the same alt_lang value should be applied to the same item.

[0055] In an example, the syntax of AccessibilityTextProperty can be as follows:

[0056] The semantics of the part fields involved in the syntax of AccessibilityTextProperty can refer to the following. alt_text is a string, which is used as the alternative text of the image when the image cannot be displayed, similar to the alt text in HTML.

[0057] alt_lang is a string containing a language tag string conforming to the relevant standard, such as "en-US", "fr-FR" or "zh-CN", indicating the language of the text contained in alt_text. When alt_lang is empty, the language is unknown / undefined.

[0058] In combination with the above description, the present disclosure provides a file processing method, first obtaining a to-be-decoded file (wherein the to-be-decoded file includes an image and associated information of the image, and the associated information of the image is used to describe the feature attributes of the image or a target region in the image), parsing the to-be-decoded file to obtain the image and the associated information of the image; and based on the associated information of the image, performing a corresponding operation on the image. In this way, the associated information of the image and the image are jointly stored, and the associated information of the image can be seamlessly transmitted and shared between different platforms and devices, so that different platforms and devices can realize corresponding operations on the image by parsing the associated information, thereby improving the image processing efficiency. At the same time, the process of repeatedly identifying the image to obtain the associated information of the image can be avoided, which is conducive to realizing the compatibility and portability of information.

[0059] Exemplarily, FIG. 1 is a schematic diagram of an application scenario of a file processing method according to an embodiment of the present disclosure. As shown in FIG. 1, the execution end of the file processing method includes an image acquisition device 21, a control device 22, and a decoding device 23. The image acquisition device 21 is configured to acquire image data and send the image data to the control device 22. Taking a landscape image as an example of the image data, the image acquisition device 21 can be a digital camera, a smart phone, a camera carried by a drone, or the like. These devices usually have high-quality lenses, high-resolution image sensors, and advanced image processing technologies, and can capture fine textures and rich colors of the landscape. The control device 22 can be a computer product with communication and storage functions, such as a smart phone, a desktop computer, a notebook computer, a tablet computer, an embedded device, or other smart devices with communication and storage functions. The decoding device 23 can present the image and perform other corresponding operations, and can be a device with a display screen, including but not limited to a device with a liquid crystal display screen, an organic light-emitting diode display screen, an electronic ink screen (such as the screen used by Kindle), and the like, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart television, and the like.

[0060] In an embodiment, the image acquisition device 21, the control device 22, and the decoding device 23 are physically separate devices, wherein the image acquisition device 21 is configured to capture an image; the control device 22 acquires the image and associated information of the image from the image acquisition device 21, encapsulates the associated information of the image into the image to obtain a to-be-decoded file; and the decoding device 23 acquires the to-be-decoded file from the control device 22, parses (decapsulates) the to-be-decoded file to obtain the image and the associated information of the image, and performs an operation (for example, presentation) on the image based on the associated information of the image.

[0061] It should be noted that in some other embodiments, the image acquisition device 21 and the control device 22 can be a first device that is physically integrated as a whole, and the decoding device 23 can be another device that is physically separate from the first device; or the control device 22 and the decoding device 23 can be a second device that is physically integrated as a whole, and the image acquisition device 21 can be another device that is physically separate from the second device; or the image acquisition device, the control device, and the decoding device can be a third device that is physically integrated as a whole.

[0062] It should be noted that FIG. 1 is only one application scenario diagram of the file processing method, and the number of devices included in FIG. 1 and the names of the devices are not limited, and in addition to the devices shown in FIG. 1, other devices can also be included in the application scenario of the file processing method.

[0063] The application scenarios of the embodiments of the present disclosure are not limited. The system architecture and application scenarios described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those skilled in the art can know that, with the evolution of network architecture and the appearance of new business scenarios, the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems.

[0064] The embodiments of the present disclosure provide a file processing method. As shown in FIG. 2, the file processing method includes S101-S103.

[0065] S101, acquiring a to-be-decoded file, wherein the to-be-decoded file includes an image and associated information of the image, and the associated information of the image is used to describe a feature attribute in the image or a target region of the image.

[0066] The image is a single image or one or more images in a video sequence. The image can also be a partial region in a complete image. It can be understood that a video itself is composed of a series of continuous image sequences. The concepts of picture, video, video frame, video image, image, or image region mentioned in the subsequent description can be replaced equivalently.

[0067] The to-be-decoded file can be a picture / video bitstream or a media file including associated information of the image.

[0068] In some embodiments, the associated information of the image is obtained by performing at least one of the following operations on the image: text recognition, object recognition, scene recognition.

[0069] In some embodiments, the associated information of the image includes at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information, and third indication information.

[0070] The first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified (i.e., whether the associated information of the image is allowed to be modified by other encoding or decoding units), and the third indication information is used to indicate a language type of the associated information of the image.

[0071] In some embodiments, the type of the associated information of the image includes at least one of the following: text information in the image, object information in the image, scene information in the image, user-defined information, name information of the image, tag information of the image, and annotation description information of the image.

[0072] In some embodiments, the source of the associated information of the image includes creator addition and AI algorithm recognition.

[0073] In some embodiments, the content of the associated information of the image can be human-readable text or numbers or characters meeting specific criteria, according to the type of the associated information.

[0074] In some embodiments, the associated information of the image can be explicitly displayed in a specific area of the image or implicitly stored as metadata, according to the intention of the content creator. When the first indication information indicates that the associated information of the image needs to be displayed, the corresponding associated information needs to be presented at the same time when the image is presented.

[0075] In some embodiments, the associated information of the image further includes an indication of whether the associated information is used to describe a plurality of continuous images, i.e., according to the type and use of the associated information, the associated information can be used to describe a single image or a plurality of continuous images.

[0076] In some embodiments, the to-be-decoded file is obtained by encapsulating the associated information of the image into the image.

[0077] In some embodiments, the to-be-decoded file is obtained by encapsulating the associated information of the image into the image in the form of an International Organization for Standardization (ISO) base media file format (ISOBMFF) data box.

[0078] In some embodiments, the to-be-decoded file is obtained by encapsulating the associated information of the image into the image in the form of a supplemental enhancement information (SEI) message.

[0079] In some embodiments, the to-be-decoded file includes at least one of the following fields: an associated information type field, a first flag, a second flag, a third flag, a fourth flag, a fifth flag, a sixth flag, a seventh flag, an eighth flag, a ninth flag, a tenth flag, an eleventh flag, a twelfth flag, a thirteenth flag, a fourteenth flag, a fifteenth flag, and a sixteenth flag, wherein:

[0080] The associated information type field is used to determine the type of the associated information of the image.

[0081] The first flag is used to indicate whether the associated information of the image is displayed.

[0082] The second flag is used to indicate whether the associated information of the image can be modified by any processing device other than the creator.

[0083] The third flag is used to indicate that the associated information of the image is manually added by the creator or recognized by an artificial intelligence algorithm.

[0084] The fourth flag is used to indicate that the associated information of the image corresponds to a single image or a plurality of continuous images.

[0085] The fifth flag is used to indicate the number of associated information items contained in the associated information attribute of the image.

[0086] The sixth flag is used to determine whether to indicate the language type of the associated information of the image.

[0087] The seventh flag is used to indicate the value of the user-defined associated information.

[0088] The eighth flag is used to indicate the language string length of the associated information of the image.

[0089] The ninth flag is used to indicate the text string length of the associated information of the image.

[0090] The tenth flag is used to indicate a character in the language string of the associated information of the image.

[0091] The eleventh flag is used to indicate a character in the text string of the associated information of the image.

[0092] The twelfth flag is used to indicate the length of the object identifier string of the associated information of the image.

[0093] The thirteenth flag is used to indicate a character in the object identifier string of the associated information of the image.

[0094] The fourteenth flag is used to indicate the language type of the associated information of the image.

[0095] The fifteenth flag is used to indicate the string of the associated information of the image.

[0096] The sixteenth flag is used to indicate the value of the user-defined associated information.

[0097] In some embodiments, the indication manner of the associated information type field includes at least one of the following: a string form, an OID (Object Identifier) form, and a numerical form.

[0098] In this way, by saving the associated information of the image commonly used in image processing in the to-be-decoded file, the associated information of the image can be prevented from being lost in the transmission and processing process, so that the associated information of the image can be extracted from the file at any link of image transmission and processing, thereby saving the calculation resources required for repeated processing, and ensuring the cross-device and cross-platform application of the associated information of the image. For example, in the scene of processing a large number of video monitoring files to locate a target, the monitoring video often comes from different sources. If the associated information (object information) of the image already exists in these videos, the calculation resources and calculation time for AI recognition can be saved, so that the cost of locating the target is lower and the time efficiency is higher.

[0099] S102, parsing the to-be-decoded file to obtain the image and the associated information of the image.

[0100] The process of parsing the to-be-decoded file to obtain the decoded image can refer to the method specified in the video coding standard corresponding to the code stream type, which will not be described here.

[0101] In some embodiments, in the case where the to-be-decoded file is obtained by encapsulating the associated information of the image into the image through the ISOBMFF data box, the to-be-decoded file is parsed based on the ISOBMFF data box type.

[0102] S103, operating the image based on the associated information of the image.

[0103] In some embodiments, operating the image based on the associated information of the image includes at least one of the following:

[0104] In the case where the first indication information indicates that the associated information of the image needs to be displayed, the image and the associated information of the image are presented;

[0105] In the case where the associated information of the image includes text information in the image, the text information in the image is extracted;

[0106] In the case where the associated information of the image includes object information in the image, the image is classified and / or quickly located based on the object information in the image;

[0107] In the case where the associated information of the image includes scene information in the image, the content of the image is understood and / or the keywords of the scene in the image are discriminated based on the scene information in the image;

[0108] In the case where the associated information of the image includes user-defined information, it is determined whether to process the image and the associated information of the image based on the user-defined information.

[0109] It can be understood that when the associated information of the image contains text information in the image, the user can conveniently copy or modify the text information by extracting the text information. When the associated information of the image includes user-defined information, the associated information of the image is processed only when the meaning of the user-defined information is clear. Otherwise, the associated information of the image should be ignored.

[0110] In some embodiments, when the first indication information indicates that the associated information of the image does not need to be displayed, only the image is presented;

[0111] In some embodiments, when the second indication information indicates that the associated information of the image can be modified, the user is allowed to adjust the associated information of the image as needed while the associated information of the image is displayed.

[0112] In some embodiments, when the second indication information indicates that the associated information of the image cannot be modified, the associated information of the image is displayed as read-only while the associated information of the image is displayed, and the user cannot make any modification thereto (for example, when the associated information of the image is automatically generated by the system, it should not be changed by the user), which can be used to protect the integrity of the associated information of the image.

[0113] In some embodiments, the associated information of the image is displayed based on the language type of the associated information of the image indicated by the third indication information. For example, if the associated information of the image is originally written in English, but the user wants to view the information in Chinese, the third indication information indicates that the system translates the information into Chinese (if the system supports this function) or marks the original language in some way and provides a translation option.

[0114] In some embodiments, when the associated information of the image includes name information of the image, the image is classified and / or the content of the image is understood and / or indexed.

[0115] In some embodiments, when the associated information of the image includes tag information of the image, the image is indexed and / or classified.

[0116] Based on this, the associated information of the image and the image are jointly stored, so that the associated information of the image can be seamlessly transmitted and shared between different platforms and devices, so that different platforms and devices can operate the image by analyzing the associated information, thereby improving the image processing efficiency.

[0117] The embodiments of the present disclosure provide a file processing method. As shown in FIG. 3, the file processing method includes the following S201-S203.

[0118] S201, acquiring an image and associated information of the image, wherein the associated information of the image is used to describe a feature attribute in the image or a target region of the image.

[0119] The image (also referred to as a source image) is a single image or one or more images in a video sequence.

[0120] In some embodiments, the associated information of the image is obtained by at least one of the following operations on the image: text recognition, object recognition, scene recognition. There are various techniques for recognizing and processing the image to obtain the associated information of the image, and the present disclosure does not limit the use of any image processing technique, and thus will not be described in detail.

[0121] In some embodiments, the associated information of the image includes at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information, and third indication information; the first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified, and the third indication information is used to indicate a language type of the associated information of the image.

[0122] In some embodiments, the type of the associated information of the image includes at least one of the following: text information in the image, object information in the image, scene information in the image, a user-defined information type, name information of the image, tag information of the image, and annotation description information of the image.

[0123] S202, encapsulating the associated information of the image into the image to obtain a to-be-decoded file.

[0124] In some embodiments, the associated information of the image is encapsulated into the image by means of an ISOBMFF data box to obtain the to-be-decoded file.

[0125] In some embodiments, the associated information of the image is encapsulated into the image by means of an SEI message to obtain the to-be-decoded file.

[0126] S203, sending the to-be-decoded file.

[0127] In some embodiments, the to-be-decoded file is sent based on a preset rule. For example, the preset rule includes a sending period, a starting sending time, an ending sending time, a sending time slot, etc.

[0128] Other related descriptions of S201 to S203 can be referred to the descriptions in the above embodiments or examples, which will not be described here.

[0129] The implementation processes of encapsulating the associated information of the image into the image based on different manners are described below respectively.

[0130] Embodiment one, encapsulate the image's associated information into the image by the way of ISOBMFF data box, the syntax structure and semantic information involved in the process can correspond to the combination example of various cases described in the above embodiments or examples.

[0131] The following is to take ISOBMFF data box as an example, introduce the way of indicating the image's associated information in the picture.

[0132] Exemplarily, the definition of the image's associated information attribute (ImageAssociationInfoProperty) can be as follows:

[0133] Data box type: 'iafp';

[0134] Attribute type: descriptive item attribute;

[0135] Included in: ItemPropertyContainerBox;

[0136] Whether mandatory: no;

[0137] Number: 0, 1 or multiple.

[0138] The image's associated information attribute is used to describe the associated information in the image or the target area of the image, and the meaning and specific content of the associated information are determined by the type of the associated information. A picture or a target area of an image can have one or more image's associated information attributes. One associated information attribute can be used to describe one or more images (such as dynamic pictures).

[0139] Exemplarily, the syntax of ImageAssociationInfoProperty can be as follows:

[0140] The semantics of the partial fields involved in the syntax of the ImageAssociationInfoProperty can be referred to as follows. When the association_info_type (i.e. the above-mentioned association information type field) takes the value of 0, it indicates that the association information of the image is the text information within the image; when it takes the value of 1, it indicates that the association information of the image is the scene information within the image, which is indicated in the form of a human-readable string; when it takes the value of 2, it indicates that the association information of the image is the object information within the image, which is indicated in the form of a human-readable string; when it takes the value of 3, it indicates that the association information of the image is the object information within the image, which is indicated in the form of an OID, and the definition of the OID follows the definition of the relevant standard; when it takes the value of 4, it indicates that the association information of the image is user-defined information, wherein the value of the user-defined information is an integer, and the value of the corresponding field is distinguished by the user; when it takes the value of 5, it indicates that the association information of the image is user-defined information, and the user-defined information is indicated in the form of a human-readable string, and the value of the field is distinguished by the user.

[0141] When the presentation_flag (i.e. the above-mentioned first flag) takes the value of 0, it indicates that the association information of the image is not displayed; when it takes the value of 1, it indicates that the association information of the image can be displayed when the image is presented.

[0142] When the modification_flag (i.e. the above-mentioned second flag) takes the value of 0, it indicates that the association information of the image cannot be modified by any processing device other than the creator; when it takes the value of 1, it indicates that the association information of the image can be modified by any processing device other than the creator.

[0143] When the creation_flag (i.e. the above-mentioned third flag) takes the value of 0, it indicates that the association information of the image is manually added by the creator; when it takes the value of 1, it indicates that the association information of the image is obtained by an AI algorithm.

[0144] When the consecutive_flag (i.e. the above-mentioned fourth flag) takes the value of 0, it indicates that the association information of the image corresponds to a single image; when it takes the value of 1, it indicates that the association information of the image corresponds to multiple consecutive images. When this field takes the value of 1, the association information of the corresponding image needs to be associated with an entity group containing multiple images or with multiple consecutive video frame samples.

[0145] The num_info_entry (i.e. the above-mentioned fifth flag) indicates the number of association information entries contained in the association information attribute of the current image. When the association information attribute of an image contains multiple association information entries, the information indicated by these association information entries is in a mutually alternative relationship, such as different language expressions of the same information.

[0146] lang (i.e. the sixth flag bit described above) indicates the language type of the associated information of the image, the indication of the language type in this field shall comply with the relevant standard.

[0147] association_info_text indicates the text of the associated information of the image.

[0148] OID indicates the object identifier, the value of this field shall comply with the relevant standard.

[0149] user_defined_info (i.e. the seventh flag bit described above) indicates the value of the user-defined associated information.

[0150] The following is an example of indicating the associated information of the image in the sample with the ISOBMFF data box.

[0151] Exemplarily, the definition of the image associated information sample group (ImageAssociationInfoSampleGroupEntry) is as follows.

[0152] The image associated information sample group is used to describe the associated information of the sample or the sample region, the meaning and specific content of the associated information are determined by the type of the associated information. One sample or one sample region can have one or more associated information attributes. One associated information attribute can be used to describe one or more images (such as multiple video frames).

[0153] It should be noted that in the art, one sample usually corresponds to one frame of video image in the video.

[0154] Exemplarily, the syntax of the ImageAssociationInfoSampleGroupEntry can be as follows:

[0155] The semantics of some fields in the ImageAssociationInfoSampleGroupEntry can refer to the description of the semantics in the associated information attribute of the image described above, and will not be described one by one.

[0156] The following is an example of indicating the associated information of the image in the track with the ISOBMFF data box.

[0157] Exemplarily, the definition of the image associated information data box (ImageAssociationInfoBox) is as follows.

[0158] The image association information data box is used to describe the association information of all samples in a track. The meaning and specific content of the association information are determined by the type of the association information. One track can contain one or more association information data boxes.

[0159] It should be noted that in the art, one track usually refers to one video track, one video track contains one or more samples, and one sample usually corresponds to one frame of video image in a video.

[0160] Exemplarily, the syntax of the ImageAssociationInfoBox can be as follows:

[0161] The semantics of some fields in the ImageAssociationInfoBox can refer to the description of the semantics of the above-mentioned image association information attributes, and will not be described one by one.

[0162] Embodiment two, based on the binary bit stream SEI message mode, the association information of the image is encapsulated into the image, the syntax structure and semantic information involved in the process can correspond to the combination examples of various cases described in the above examples or embodiments. The related syntax structure can refer to Table 1.

[0163] Table 1

[0164] lang_length (also the eighth flag bit described above): indicates the length of the language string of the image association information.

[0165] association_info_text_length (also the ninth flag described above): indicates the length of the text string of the image association information.

[0166] char_lang (also the tenth flag described above): indicates one character of the language string of the image association information.

[0167] char_association_info_text (also the eleventh flag described above): indicates one character of the text string of the image association information.

[0168] oid_length (also the twelfth flag described above): indicates the length of the OID string of the image association information.

[0169] char_oid (also the thirteenth flag described above): indicates one character of the OID string of the image association information.

[0170] The semantics of the rest of the fields of this SEI message can refer to the description of the semantics of the above-mentioned picture association information property, and will not be described one by one.

[0171] Embodiment three, an extension example based on the existing ISOBMFF data box.

[0172] The user description property (UserDescriptionProperty) is used to describe the associated information of a picture or a picture area. The meaning and specific content of the associated information are determined by the associated information type. A picture or a picture area can have one or more associated information properties. One associated information property can be used to describe one or more images (such as dynamic pictures).

[0173] Exemplarily, the syntax of UserDescriptionProperty can be as follows:

[0174] The semantics of the part of the fields involved in UserDescriptionProperty can refer to the following content.

[0175] When the association_info_type (i.e., the association information type field described above) is 0, it indicates that the association information of the image is text information within the image; when the association_info_type is 1, it indicates that the association information of the image is scene information within the image, which is indicated in the form of a human-readable string; when the association_info_type is 2, it indicates that the association information of the image is object information within the image, which is indicated in the form of a human-readable string; when the association_info_type is 3, it indicates that the association information is object information within the image, which is indicated in the form of an OID, and the definition of the OID follows the definition of a related standard; when the association_info_type is 4, it indicates that the association information of the image is name information of the image, which is indicated in the form of a human-readable string; when the association_info_type is 5, it indicates that the association information of the image is annotation description information of the image; when the association_info_type is 6, it indicates that the association information of the image is label information of the image; when the association_info_type is 7, it indicates that the association information of the image is user-defined recognition information of the content of the image, wherein the user-defined recognition information of the content of the image is indicated in the form of a human-readable string, and the field value meaning corresponding thereto is distinguished by the user; when the association_info_type is 8, it indicates that the association information of the image is user-defined understanding information of the content of the image, which is indicated in the form of a human-readable string, and the field value meaning corresponding thereto is distinguished by the user; when the association_info_type is 9, it indicates that the association information of the image is user-defined recognition information of the content of the image, wherein the user-defined recognition information of the content of the image is an integer, and the field value meaning corresponding thereto is distinguished by the user; and when the association_info_type is 10, it indicates that the association information is user-defined understanding information of the content of the image, wherein the user-defined understanding information of the content of the image is an integer, and the field value meaning corresponding thereto is distinguished by the user.

[0176] When the presentation_flag (i.e., the first flag bit described above) is 0, it indicates that the association information of the image should not be displayed; and when the presentation_flag is 1, it indicates that the association information of the image can be displayed when the image is presented.

[0177] When the modification_flag (i.e., the second flag bit described above) is 0, it indicates that the association information of the image cannot be modified by any processing device other than the creator; and when the modification_flag is 1, it indicates that the association information of the image can be modified by any processing device other than the creator.

[0178] When the creation_flag (i.e., the third flag bit described above) is 0, it indicates that the association information of the image is manually added by the creator; and when the creation_flag is 1, it indicates that the association information of the image is obtained by an AI algorithm.

[0179] consecutive_flag (i.e. the fourth flag described above) takes the value of 0, indicating that the image's associated information corresponds to a single image; takes the value of 1, indicating that the image's associated information corresponds to multiple consecutive images. When the field takes the value of 1, the image's associated information needs to be associated to an entity group containing multiple images or to multiple consecutive video frame samples.

[0180] language_flag (i.e. the sixth flag described above) takes the value of 0, indicating that the language type of the image's associated information is not indicated; takes the value of 1, indicating that the language type of the image's associated information is indicated. When association_info_type takes the value of 3, language_flag can only take the value of 0.

[0181] num_info_entry (i.e. the fifth flag described above) indicates the number of associated information entries contained in the image's associated information attribute. When an image's associated information attribute contains multiple associated information entries, the information indicated by these associated information entries is in a mutually alternative relationship, such as different language expressions of the same information.

[0182] Lang (i.e. the fourteenth flag described above) indicates the language type of the image's associated information. The indication of the language type by this field should comply with the relevant standards (for example, the standard RFC 5646).

[0183] association_info_string (i.e. the fifteenth flag described above) is a string of the image's associated information.

[0184] user_defined_info (i.e. the sixteenth flag described above) is the value of the user-defined associated information.

[0185] The User Description Sample Group Entry is used to describe the associated information of a sample or a sample region. The meaning and specific content of the associated information are determined by the type of the associated information. A sample or a sample region can have one or more associated information attributes. An associated information attribute can be used to describe one or more images (such as multiple video frames).

[0186] Exemplarily, the syntax of the User Description Sample Group Entry can be as follows:

[0187] The semantics involved in the syntax of this user information sample group can refer to the semantic description in the user description attribute, and will not be described one by one.

[0188] The above describes the scheme of the embodiments of the present disclosure mainly from the perspective of the method. Hereinafter, a file processing apparatus is also shown for performing the file processing method in any of the above embodiments and possible implementation manners thereof. It can be understood that the file processing apparatus contains hardware structures and / or software modules corresponding to the execution of various functions in order to implement the file processing method; it should be easily realized by those skilled in the art that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or in the form of computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present disclosure.

[0189] The embodiments of the present disclosure can divide the file processing apparatus according to the method embodiments described above, for example, each function module can be divided corresponding to each function, or two or more functions can be integrated in one function module. The above integrated module can be realized in the form of hardware or in the form of software. It should be noted that the division of the modules in the embodiments of the present disclosure is illustrative, and is only a logical functional division. There can be another division manner when actually implemented. Hereinafter, taking the example of dividing each function module corresponding to each function is described.

[0190] FIG. 4 is a file processing apparatus provided by an embodiment of the present disclosure. The file processing apparatus 400 includes an acquisition module 401, an analysis module 402 and a processing module 403.

[0191] The acquisition module 401 is configured to acquire a to-be-decoded file, wherein the to-be-decoded file includes an image and associated information of the image, and the associated information of the image is used to describe a feature attribute in the image or a target region of the image.

[0192] The analysis module 402 is configured to analyze the to-be-decoded file to obtain the image and the associated information of the image.

[0193] The processing module 403 is configured to operate the image based on the associated information of the image.

[0194] In some embodiments, the associated information of the image includes at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information and third indication information; wherein the first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified, and the third indication information is used to indicate a language type of the associated information of the image.

[0195] In some embodiments, the type of the associated information of the image comprises at least one of the following: text information within the image, object information within the image, scene information within the image, user-defined information, name information of the image, tag information of the image, annotation description information of the image.

[0196] In some embodiments, the processing module 403 is configured to:

[0197] present the image and the associated information of the image in the case that the first indication information indicates that the associated information of the image needs to be displayed;

[0198] extract the text information within the image in the case that the associated information of the image comprises the text information within the image;

[0199] classify and / or perform a quick positioning operation on the image based on the object information within the image in the case that the associated information of the image comprises the object information within the image;

[0200] understand the content of the image and / or perform a keyword discrimination operation on the scene within the image based on the scene information within the image in the case that the associated information of the image comprises the scene information within the image;

[0201] determine whether to process the image and the associated information of the image based on the user-defined information in the case that the associated information of the image comprises the user-defined information.

[0202] In some embodiments, the to-be-decoded file is obtained by encapsulating the associated information of the image into the image in the form of an ISOBMFF data box.

[0203] In some embodiments, the to-be-decoded file is obtained by encapsulating the associated information of the image into the image in the form of an SEI message.

[0204] In some embodiments, the to-be-decoded file comprises at least one of the following fields: an associated information type field, a first flag, a second flag, a third flag, a fourth flag, a fifth flag, a sixth flag, a seventh flag, an eighth flag, a ninth flag, a tenth flag, an eleventh flag, a twelfth flag, a thirteenth flag, a fourteenth flag, a fifteenth flag, and a sixteenth flag, wherein:

[0205] the associated information type field is used to determine the type of the associated information of the image;

[0206] the first flag is used to indicate whether the associated information of the image is displayed;

[0207] the second flag is used to indicate whether the associated information of the image can be modified by any processing device other than the creator;

[0208] The third flag is used to indicate whether the associated information of the image is manually added by the creator or recognized by an artificial intelligence algorithm.

[0209] The fourth flag is used to indicate whether the associated information of the image corresponds to a single image or a plurality of continuous images.

[0210] The fifth flag is used to indicate the number of associated information items contained in the associated information attribute of the image.

[0211] The sixth flag is used to determine whether the language type of the associated information of the image is indicated.

[0212] The seventh flag is used to indicate the value of the user-defined associated information.

[0213] The eighth flag is used to indicate the length of the language string of the associated information of the image.

[0214] The ninth flag is used to indicate the length of the text string of the associated information of the image.

[0215] The tenth flag is used to indicate a character in the language string of the associated information of the image.

[0216] The eleventh flag is used to indicate a character in the text string of the associated information of the image.

[0217] The twelfth flag is used to indicate the length of the object identifier string of the associated information of the image.

[0218] The thirteenth flag is used to indicate a character in the object identifier string of the associated information of the image.

[0219] The fourteenth flag is used to indicate the language type of the associated information of the image.

[0220] The fifteenth flag is used to indicate the string of the associated information of the image.

[0221] The sixteenth flag is used to indicate the value of the user-defined associated information.

[0222] In some embodiments, the indication manner of the associated information type field includes at least one of the following: a string form, an object identifier form, and a numerical value form.

[0223] In some embodiments, the associated information of the image is obtained by performing at least one of the following operations on the image: text recognition, object recognition, and scene recognition.

[0224] In some embodiments, the image is a single image or one or more images in a video sequence.

[0225] For the above obtaining module 401, the analyzing module 402 and the processing module 403, more detailed descriptions, more detailed descriptions of technical features, and descriptions of beneficial effects can be referred to the corresponding method embodiments, which will not be repeated here.

[0226] FIG. 5 is another file processing apparatus provided by the embodiments of the present disclosure. The file processing apparatus 500 includes an obtaining module 501, an encapsulating module 502 and a communication module 503.

[0227] The obtaining module 501 is configured to obtain an image and associated information of the image, wherein the associated information of the image is used to describe a feature attribute in the image or a target region of the image.

[0228] The encapsulating module 502 is configured to encapsulate the associated information of the image into the image to obtain a to-be-decoded file.

[0229] The communication module 503 is configured to send the to-be-decoded file.

[0230] In some embodiments, the associated information of the image includes at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information, and third indication information; wherein the first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified, and the third indication information is used to indicate a language type of the associated information of the image.

[0231] In some embodiments, the type of the associated information of the image includes at least one of the following: text information in the image, object information in the image, scene information in the image, a user-defined information type, name information of the image, tag information of the image, and annotation description information of the image.

[0232] In some embodiments, the associated information of the image is obtained by at least one of the following operations on the image: text recognition, object recognition, and scene recognition.

[0233] In some embodiments, the image is a single image or one or more images in a video sequence.

[0234] In some embodiments, the encapsulating module 502 encapsulates the associated information of the image into the image by means of an ISOBMFF data box to obtain the to-be-decoded file.

[0235] In some embodiments, the encapsulating module 502 encapsulates the associated information of the image into the image by means of an SEI message to obtain the to-be-decoded file.

[0236] For more details of the above obtaining module 501, encapsulating module 502 and communication module 503, and more details of the technical features therein, as well as the description of the beneficial effects, etc., can refer to the corresponding method embodiment part above, and will not be repeated here.

[0237] It should be noted that the modules in FIG. 4 and FIG. 5 can also be referred to as units, for example, the communication module can be referred to as a communication unit. In addition, in the embodiment shown in FIG. 4 and FIG. 5, the name of each module can not be the name shown in the figure, for example, the communication module can also be referred to as a sending module or a receiving module.

[0238] Each unit or module in FIG. 4 and FIG. 5, if implemented in the form of a software function module and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present disclosure essentially or said part of the prior art that contributes to the technical solutions or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods in the various embodiments of the present disclosure. The storage medium storing the computer software product includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0239] In the case of realizing the functions of the above integrated modules in the form of hardware, the present embodiment also provides a possible structure of a communication device for executing the file processing method provided by the present embodiment. As shown in FIG. 6, the communication device 600 includes a memory 601, a processor 602, a communication interface 603 and a bus 604.

[0240] The memory 601 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, can be a random access memory (RAM) or other type of dynamic storage device that can store dynamic information and instructions, can be an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage medium, or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.

[0241] The processor 602 can be a logic block, a module, and a circuit that implements or executes various exemplary methods described in combination with the embodiments of the present disclosure. The processor 602 can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processor 602 can also implement or execute various exemplary logic blocks, modules, and circuits described in combination with the embodiments of the present disclosure. The processor 602 can also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0242] The communication interface 603 is configured to connect with other devices through a communication network. The communication network can be an Ethernet, a wireless access network, a wireless local area network (WLAN), and the like.

[0243] In an implementation manner, the memory 601 can exist independently of the processor 602, and the memory 601 can be connected with the processor 602 through the bus 604, and is configured to store instructions or program codes. When the processor 602 invokes and executes the instructions or program codes stored in the memory 601, the file processing method provided by the embodiments of the present disclosure can be implemented.

[0244] In an implementation manner, the memory 601 can also be integrated with the processor 602.

[0245] Bus 604, which can be an extended industry standard architecture (EISA) bus, a peripheral component interconnect (PCI) bus, or another type of bus, connects the various components of the computing device 600. The bus 604 can be split into buses, for example, an address bus, a data bus, a control bus, etc. For simplicity, the bus 604 is shown as a single bus, but it can be a combination of buses. The bus 604 can be implemented using different technologies depending on the requirements of the computing device 600. For example, the bus 604 can be a proprietary bus, a PCI bus, a Personal Computer Interface (PCI) bus, an Industry Standard Architecture (ISA) bus, an Extended ISA (EISA) bus, a Micro Channel Architecture (MCA) bus, a Video Electronics Standards Association (VESA) bus, a Super I / O bus, a Multibus, a CoreConnect, a NuBus, a HyperTransport, a RapidIO, or another type of bus.

[0246] Some embodiments of the present disclosure provide a computer readable storage medium (for example, a non-transitory computer readable storage medium) having stored computer program instructions, which, when executed on a computer, cause the computer to perform the file processing method according to any one of the above embodiments.

[0247] In an implementation manner, the computer can be the file processing apparatus described above, and the present disclosure does not limit the specific form of the computer.

[0248] In some examples, the computer readable storage medium described above can include, but is not limited to, a magnetic storage device (for example, a hard disk, a floppy disk, or a magnetic tape, etc.), an optical disc (for example, a compact disk (CD), a digital versatile disk (DVD), etc.), a smart card, and a flash memory device (for example, an erasable programmable read-only memory (EPROM), a card, a stick, or a key drive, etc.). The various computer readable storage media described in the present disclosure can represent one or more devices and / or other machine readable storage media for storing information. The term "machine readable storage medium" can include, but is not limited to, a wireless channel and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0249] The embodiments of the present disclosure provide a computer program product containing instructions, which, when executed on a computer, cause the computer to perform the file processing method according to any one of the above embodiments.

[0250] The above is only a specific implementation manner of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and any change or replacement within the technical scope disclosed in the present disclosure should be covered in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A file processing method, comprising: obtaining a to-be-decoded file, wherein the to-be-decoded file comprises an image and associated information of the image, and the associated information of the image is used to describe a feature attribute in the image or a target region of the image; parsing the to-be-decoded file to obtain the image and the associated information of the image; operating the image based on the associated information of the image.

2. The method of claim 1, wherein, The associated information of the image comprises at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information, and third indication information; wherein the first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified, and the third indication information is used to indicate a language type of the associated information of the image.

3. The method of claim 2, wherein, The type of the associated information of the image comprises at least one of the following: text information in the image, object information in the image, scene information in the image, user-defined information, name information of the image, tag information of the image, and annotation description information of the image.

4. The method of claim 3, wherein, The operation of the image based on the associated information of the image comprises at least one of the following: in a case where the first indication information indicates that the associated information of the image needs to be displayed, presenting the image and the associated information of the image; in a case where the associated information of the image comprises the text information in the image, extracting the text information in the image; in a case where the associated information of the image comprises the object information in the image, classifying and / or quickly positioning the image based on the object information in the image; in a case where the associated information of the image comprises the scene information in the image, understanding content of the image and / or discriminating a keyword of a scene in the image based on the scene information in the image; or in a case where the associated information of the image comprises the user-defined information, determining whether to process the image and the associated information of the image based on the user-defined information. The to-be-decoded file is obtained by encapsulating the associated information of the image into the image in an International Organization for Standardization Base Media File Format (ISOBMFF) data box manner.

5. The method of claim 1, wherein, The to-be-decoded file is obtained by encapsulating the associated information of the image into the image in a Supplemental Enhancement Information (SEI) message manner.

6. The method of claim 1, wherein, The to-be-decoded file comprises at least one of the following fields:

7. The method of claim 5 or 6, wherein, an associated information type field, a first flag, a second flag, a third flag, a fourth flag, a fifth flag, a sixth flag, a seventh flag, an eighth flag, a ninth flag, a tenth flag, an eleventh flag, a twelfth flag, a thirteenth flag, a fourteenth flag, a fifteenth flag, and a sixteenth flag, wherein the associated information type field is used to determine the type of the associated information of the image; the first flag is used to indicate whether the associated information of the image is displayed; ​ The second flag is used to indicate whether the associated information of the image can be modified by any processing device other than the creator; The third flag is used to indicate whether the associated information of the image is manually added by the creator or recognized by an artificial intelligence algorithm; The fourth flag is used to indicate whether the associated information of the image corresponds to a single image or a plurality of continuous images; The fifth flag is used to indicate the number of associated information items contained in the associated information attribute of the image; The sixth flag is used to determine whether to indicate the language type of the associated information of the image; The seventh flag is used to indicate the value of the user-defined associated information; The eighth flag is used to indicate the language string length of the associated information of the image; The ninth flag is used to indicate the text string length of the associated information of the image; The tenth flag is used to indicate a character in the language string of the associated information of the image; The eleventh flag is used to indicate a character in the text string of the associated information of the image; The twelfth flag is used to indicate the length of the object identifier string of the associated information of the image; The thirteenth flag is used to indicate a character in the object identifier string of the associated information of the image; The fourteenth flag is used to indicate the language type of the associated information of the image; The fifteenth flag is used to indicate the string of the associated information of the image; The sixteenth flag is used to indicate the value of the user-defined associated information.

8. The method of claim 7, wherein, The indication manner of the associated information type field includes at least one of the following: string form, object identifier form, numerical value form.

9. The method of claim 1, wherein, The associated information of the image is obtained by at least one of the following operations on the image: text recognition, object recognition, scene recognition.

10. The method of claim 9, wherein, The image is a single image or one or more images in a video sequence.

11. A file processing method, comprising: obtaining an image and associated information of the image, wherein the associated information of the image is used to describe the characteristic attribute of the image or a target region in the image; encapsulating the associated information of the image into the image to obtain a to-be-decoded file; sending the to-be-decoded file.

12. The method of claim 11, wherein, The associated information of the image includes at least one of the following: a type of the associated information of the image, a source of the associated information of the image, content of the associated information of the image, first indication information, second indication information, and third indication information; the first indication information is used to indicate whether the associated information of the image needs to be displayed, the second indication information is used to indicate whether the associated information of the image can be modified, and the third indication information is used to indicate a language type of the associated information of the image.

13. The method of claim 12, wherein, The type of the associated information of the image includes at least one of the following: text information in the image, object information in the image, scene information in the image, a user-defined information type, name information of the image, tag information of the image, and annotation description information of the image.

14. The method of claim 11, wherein, The associated information of the image is obtained by at least one of the following operations on the image: text recognition, object recognition, and scene recognition.

15. The method of claim 11, wherein, The image is a single image or one or more images in a video sequence.

16. The method of claim 11, wherein, The encapsulating the associated information of the image into the image to obtain a to-be-decoded file comprises: The encapsulating the associated information of the image into the image to obtain the to-be-decoded file comprises:

17. The method of claim 11, wherein, The encapsulating the associated information of the image into the image to obtain the to-be-decoded file comprises: The encapsulating the associated information of the image into the image to obtain the to-be-decoded file comprises:

18. A communications device comprising: The encapsulating the associated information of the image into the image to obtain the to-be-decoded file comprises:

19. A computer readable storage medium, wherein, A memory and a processor; wherein the memory and the processor are coupled; the memory is used for storing instructions executable by the processor; and the processor implements the method according to any one of claims 1 to 17 when executing the instructions.

20. A computer program product, wherein, The computer readable storage medium stores computer instructions, and when the computer instructions run on the communication device, the communication device executes the method according to any one of claims 1 to 17. The computer program product comprises computer program instructions, and when the computer program instructions are executed, the method according to any one of claims 1 to 17 is implemented.

Images