Processing method for graphic and audio pictures

Abstract

The present invention provides a method for processing graphic and audio picture data, which includes: when receiving a file creation command for establishing a picture index, embedding the first data carried by the file creation command into the first picture partition of the original picture in a steganographic manner to form a graphic and audio picture; or embedding the first data and the second data carried by the file creation command into the first picture partition of the original picture in a steganographic manner to form a graphic and audio picture; or embedding the first data carried by the file creation command into the first picture partition of the original picture in a steganographic manner and embedding the second data into the second picture partition of the original picture in a steganographic manner to form a graphic and audio picture. By means of the foregoing technical solution of the present invention, a user can generate a graphic and audio picture corresponding to a set first data and / or second data based on an ordinary electronic picture, i.e., the original picture.

Description

Technical Field

[0001] The present invention relates to an image processing technology, and particularly to an image management and application technology based on embedded data. Background Art

[0002] In the era of mobile Internet, the growth rate of the quantity and usage of image information has been on a high-speed growth trend for a long time. The efficient utilization of images is an important topic.

[0003] As is well known, image information stored in the form of electronic data exists in various formats, and there are dozens of common formats. No matter which image data file it is, the format information and content of the image are stored according to certain rules. Usually, in the format information, only content such as the arrangement of data and file identification is saved, and there is no information for describing the image content and other attributes.

[0004] In some devices, such as Huawei mobile phones and Apple mobile phones, some additional information will also be saved in the images; for example: the time when the image was formed, the geographical location, etc.; in addition, the image processing software in these devices will also use some specific methods to identify some specific information in the images, such as faces, and classify all the images stored in the device accordingly. However, on the one hand, this image information cannot exist independently of these specific devices. Once these images are separated from the corresponding devices, this image information will no longer exist. On the other hand, in most common images, such as PNG (a bitmap format using a lossless compression algorithm) format images or JPEG (Joint Photographic Experts Group) format images, there are only the format information and content data of the images, and there is no information such as the original image owner and image copyright mark. This causes considerable inconvenience for the search and use of images.

[0005] Therefore, the industry needs a technical solution for processing the images stored in devices. Using this solution, people can conveniently save various personalized information in the images so as to be able to quickly classify and search the images accordingly. At the same time, since these personalized information are saved together with the images themselves, when the images are separated from the original devices, the information saved in them can still be utilized. Summary of the Invention

[0006] The first object of the present invention is to provide a method for processing image data, which can create a file for an image to form a graphic image with personalized information.

[0007] The first object of the present invention is achieved by the following technical solutions:

[0008] When receiving a file - creating command for establishing a picture index, embed the first data carried by the file - creating command into the first picture partition of the original picture in a steganographic manner to form a picture - voice picture; or,

[0009] When receiving a file - creating command for establishing a picture index, embed the first data and the second data carried by the file - creating command into the first picture partition of the original picture in a steganographic manner to form a picture - voice picture; or,

[0010] When receiving a file - creating command for establishing a picture index, embed the first data carried by the file - creating command into the first picture partition of the original picture in a steganographic manner, and embed the second data into the second picture partition of the original picture in a steganographic manner to form a picture - voice picture;

[0011] Among them, the first data at least includes: the copyright identifier of the original picture;

[0012] The second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data.

[0013] By means of the foregoing technical solution of the present invention, a user can generate a picture - voice picture corresponding to the first data and / or the second data set by the user based on an ordinary electronic picture, that is, the original picture.

[0014] The second object of the present invention is to provide a method for processing picture data, which can perform queries among a large number of picture - voice pictures and quickly find the required picture - voice pictures by using the personalized information stored in the picture - voice pictures.

[0015] The second object of the present invention is achieved by the following technical solution:

[0016] When receiving a query command for finding a picture, parse each picture - voice picture in the picture storage area one by one, and obtain the first data and / or the second data embedded therein in a steganographic manner from the first picture partition of the picture - voice picture; and / or, obtain the second data embedded therein in a steganographic manner from the second picture partition of the picture - voice picture;

[0017] Compare the first data with the query first data carried in the query command, and when the first data is consistent with the query first data, output the picture - voice picture corresponding to the first data; and / or, compare the second data with the query second data carried in the query command, and when the second data is consistent with the query second data, output the picture - voice picture corresponding to the second data;

[0018] Among them, the first data at least includes: the copyright identifier of the picture - voice picture;

[0019] The second data at least includes: more than one set of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, markup data, and / or audio data.

[0020] By means of the foregoing technical solution of the present invention, a user can utilize the personalized information stored in the graphic-audio pictures to quickly find the required graphic-audio pictures among numerous graphic-audio pictures.

[0021] The purpose of the third aspect of the present invention is to provide a method for processing picture data, which can parse numerous graphic-audio pictures and establish index data of these graphic-audio pictures by using the personalized information stored in the graphic-audio pictures, so as to quickly find the required graphic-audio pictures when utilized subsequently.

[0022] The purpose of the third aspect of the present invention is achieved through the following technical solution:

[0023] Parse all the graphic-audio pictures in the picture storage area one by one, obtain the first data embedded in a steganographic manner from the first picture partition of the graphic-audio picture, and / or obtain the second data embedded in a steganographic manner from the second picture partition of the graphic-audio picture;

[0024] Establish a first database, and record the first data and / or the second data and the file name data of the graphic-audio picture corresponding to the first data and / or the second data one by one in the first database;

[0025] Among them, the first data at least includes: the copyright identifier of the graphic-audio picture;

[0026] The second data at least includes: more than one set of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, markup data, and / or audio data.

[0027] By means of the foregoing technical solution of the present invention, a user can parse numerous graphic-audio pictures and establish index data of these graphic-audio pictures by using the personalized information stored in the graphic-audio pictures, which facilitates quickly finding the required graphic-audio pictures when utilized subsequently.

[0028] The following further elaborates on the technical solution of the present invention in combination with each specific embodiment of the present invention: Specific Embodiment

[0029] The first type of specific embodiment of the present invention provides a technical solution for processing picture data, which specifically includes:

[0030] When receiving a file - creating command for establishing a picture index, the first data carried in the file - creating command is embedded in the first picture partition of the original picture in a steganographic manner to form a picture - audio picture. At least the copyright identifier of the original picture is included in the foregoing first data. The so - called copyright identifier may include data of the copyright information of the original author of the original picture, such as: the copyright registration certificate number officially assigned, the author name, etc.; it may also include the evidence - storing information assigned by a third party; these copyright identifiers can be encrypted in a specific way. In addition, unless otherwise stated, the meaning of all the first data that appears hereafter is the same as the foregoing first data.

[0031] The foregoing steganographic method embeds the first data into the original picture by taking advantage of the principle that the human eye is insensitive to slight changes in some pixel information in the original picture, and integrates the data into the content data of the original picture. Regarding the technical content of steganography, those skilled in the art can refer to the existing picture watermarking technology and adopt it according to specific needs, which is not limited in this embodiment and all subsequent embodiments.

[0032] Since the copyright identifier information carried in the first data usually has the copyright information of the original picture author, and this copyright identifier information is embedded in the first picture partition of the original picture in a steganographic manner; therefore, on one hand, the foregoing original picture can be distinguished from other original pictures or other picture - audio pictures by using this copyright identifier, and on the other hand, when needed, the steganographically - embedded first data can be read from the first picture partition of the picture - audio picture, and the corresponding copyright information fields can be extracted from it to implement functions such as querying and retrieving the picture - audio picture.

[0033] Of course, some copyright identifiers are not necessarily the copyright registration information officially assigned, but can also be the evidence - storing information assigned by a third party. The so - called evidence - storing generally refers to using a certain algorithm to process a work and its related information (including: author name, work name, etc.) in the sense of copyright in the form of electronic data, and attaching a time stamp to the result of this processing to form data uniquely related to the foregoing work.

[0034] After all the original pictures stored in a device are formed into picture - audio pictures by adopting the foregoing technical solution, at least the first data in the first picture partition of the picture - audio picture can be read to quickly find or retrieve picture - audio pictures with specific copyright information among the stored numerous picture - audio pictures. And this process does not require the participation of other auxiliary files or databases as in the prior art.

[0035] In some cases, not only the foregoing first data is allowed to exist in a picture - audio picture, but also some more special data can be embedded in the picture - audio picture in a steganographic manner, so that the foregoing querying and retrieving can also utilize these more special data.

[0036] The following technical solutions are provided in the second specific implementation mode of the present invention:

[0037] When a file creation command for creating a picture index is received, the first data and the second data carried by the file creation command are embedded into the first picture partition of the original picture in a steganographic manner to form a picture-audio picture.

[0038] The above-mentioned second data at least includes: one or more annotation information consisting of content identifiers and content bodies; the content identifier is used to mark the type of the content body; the content body information can be text data, markup data, audio data, or any combination of the above-mentioned data.

[0039] Among the aforementioned types of content information, text data is easy to understand, which is nothing more than some visible data content such as numbers, characters, symbols, etc.; as for audio data, it can be some audio codes with a certain format or link address information for obtaining audio data; and mark data is a kind of data content unique to the present invention, which is mainly used in specific positions or areas of audio and video images to highlight the information at the corresponding position in the audio and video images.

[0040] When displaying the various data carried by the audio and video images, it is often necessary to present them in a certain way that the sender wants. For example: the size and color of the symbols in the text data, the rhythm and volume of the audio data playback, the coordinate position, marking style and color of the mark data in the audio and video images, etc.; in some special cases, there may be more complex combined presentation methods; for example: when playing audio data, gradually display the text data to form a subtitle effect, etc. For this reason, in the second data of the present invention, there is also a need for the existence of a message sequence table, in which the various attribute information of the aforementioned content body information is stored; these attribute information can be used to indicate the recipient how to present various content body information.

[0041] In addition, unless otherwise specified, the meanings of all second data appearing thereafter are the same as the aforementioned second data.

[0042] In the second specific implementation of the present invention, the second data can be embedded into the first image partition of the original image together with the first data in a steganographic manner to form an image-sound image. Of course, when embedding, it is necessary to distinguish the first data from the second data to facilitate the receiver to distinguish them when extracting these data.

[0043] Although the technical solution taught by the second specific implementation manner of the present invention can be implemented, when both the first data and the second data need to be hidden in the same first picture partition, some data processing work must be done during the organization of the first data and the second data to distinguish them from each other.

[0044] The following technical solution is provided in the third specific implementation manner of the present invention:

[0045] When receiving a file creation command for establishing a picture index, the first data carried by the file creation command is embedded into the first picture partition of the original picture in a steganographic manner, and the second data is embedded into the second picture partition of the original picture in a steganographic manner to form a picture-audio picture.

[0046] In addition to being able to set up a first picture partition in the original picture, a second picture partition can also be set up; in this way, the second data can be embedded into the second picture partition in a steganographic manner. When the first data needs to be used, it is directly retrieved from the first picture partition; when the second data needs to be used, it is directly retrieved from the second picture partition. When specifically implementing the technical solution of the third specific implementation manner of the present invention, those skilled in the art can allocate the space occupied by the first picture partition and the second picture partition in the original picture according to specific data requirements. Of course, the first picture partition and the second picture partition can also be further subdivided respectively to meet the embedding arrangement for different types of data.

[0047] It should be noted that in the foregoing first, second, and third specific implementation manners, there is a file creation command and the first data carried by the file creation command. The so-called file creation means that the user converts some or all of the original pictures stored in the device into picture-audio pictures. Since there is a first picture partition for embedding the first data in the picture-audio pictures, after creating a file using the foregoing technical solution, the user can use the first data in the first picture partition to search or retrieve the picture-audio pictures; that is, to provide information preparation for searching or retrieving the picture-audio pictures.

[0048] It should be emphasized that there are the following essential differences between various existing original pictures and picture-and-audio pictures: On the one hand, the content data of various existing original pictures and other data used to describe the original pictures are usually stored separately, while picture-and-audio pictures directly embed these other data (the first data and / or the second data) into the content data of the picture-and-audio pictures by means of steganography, that is: part of the content in the content data of the picture-and-audio pictures is both the picture content and the first data and / or the second data. On the other hand, the storage of other data used to describe the original pictures in various existing original pictures is usually centrally stored in a storage area outside the content data based on certain rules, while in picture-and-audio pictures, it is directly stored in the specified content data area, and this content data area is divided into a first picture partition and / or a second picture partition, and different types of data are respectively embedded in different picture partitions. Therefore, when creating a file, at least the first data to be embedded in the first picture partition of the picture-and-audio picture needs to be carried in the file creation command. Doing so is also conducive to realizing the batch file creation of many picture-and-audio pictures with the same first data.

[0049] The aforementioned file creation operation is very valuable for devices storing a large number of original pictures. For example: In a smart phone with a camera function, a large number of original pictures are often stored. These original pictures are mainly the accumulation of daily shootings by smart phone users. In existing devices, due to the lack of the functions provided by the foregoing technical solutions of the present invention, the search, retrieval, and management of these original pictures will be a headache. It is very difficult for users to quickly find the one or more pictures they want to view among thousands of original pictures. After converting the original pictures stored in the device into picture-and-audio pictures using the various technical solutions provided by the foregoing specific embodiments of the present invention, the characteristics of the picture-and-audio pictures can be utilized to quickly retrieve and query the one or more pictures that the user wants to find among thousands of picture-and-audio pictures.

[0050] In the 4th type of specific embodiment of the present invention, the following technical solution is provided:

[0051] On the basis of any one of the technical solutions in the 1st - 3rd types of the present invention, a first database can be further established, and in this first database, the first data and / or the second data and the file name data of the picture-and-audio pictures and / or the original pictures corresponding to the first data and / or the second data are recorded one by one.

[0052] As described above: Due to the establishment of the graphic-audio pictures, people can quickly find the desired one or more graphic-audio pictures among thousands of them by using the foregoing technical solutions provided by the present invention. However, during the specific search or retrieval, after all, it is still necessary to access each graphic-audio picture one by one. This may reduce the speed or efficiency of the search and retrieval when there are too many graphic-audio pictures. For this reason, by using the technical solution provided by the fourth specific embodiment of the present invention, a first database can be established by using a database. In this first database, the file name of any graphic-audio picture is in one-to-one correspondence with its first data and / or second data. Therefore, if it is necessary to search or retrieve any graphic-audio picture, only by using the existing database function and using the first data and / or second data as the query or retrieval condition in the first database, the file name of the corresponding graphic-audio picture can be quickly found, and then the graphic-audio picture can be found.

[0053] In addition, in some cases, when performing the foregoing query or retrieval, it may be necessary to obtain the original picture corresponding to a graphic-audio picture. To achieve this purpose, the file name of any original picture can be in one-to-one correspondence with the first data and / or second data corresponding to the corresponding graphic-audio picture. Specifically, in a data record of the first database, in addition to storing the first data and / or second data, the file name of the graphic-audio picture and the file name of the original picture corresponding to the first data and / or second data are correspondingly stored. The various file names mentioned above may also carry path information.

[0054] Since the storage space of any device is limited, especially for some devices similar to smart terminals. And if a corresponding graphic-audio picture is generated and saved on the basis of storing the original picture, at least the demand for the picture storage space will be doubled. However, if the first database is established by using the fourth specific embodiment of the present invention, and the first data and / or second data and the file name data of the graphic-audio picture and / or the original picture corresponding to the first data and / or second data are recorded one by one in the first database, the user can choose to delete any one of the original picture and the graphic-audio picture from the device and keep the other one, so that the demand for the picture storage space will not be doubled. Of course, if the original picture is to be deleted, the user needs to back up the original picture on other storage devices for future needs.

[0055] The fifth specific embodiment of the present invention provides the following technical solution:

[0056] When a query command for searching for pictures is received, each picture-audio picture in the picture storage area is parsed one by one, and the first data and / or the second data embedded in a steganographic manner are obtained from the first picture partition of the picture-audio picture; and / or, the second data embedded in a steganographic manner is obtained from the second picture partition of the picture-audio picture.

[0057] Compare the first data with the query first data carried in the query command. When the first data is consistent with the first data, output the picture-audio picture corresponding to the first data; and / or, compare the second data with the query second data carried in the query command. When the second data is consistent with the query second data, output the picture-audio picture corresponding to the second data.

[0058] With the above technical solution, as long as there are any picture-audio pictures stored in the corresponding device, those picture-audio pictures that meet the query conditions can be found from these picture-audio pictures.

[0059] The sixth specific implementation manner of the present invention provides the following technical solution:

[0060] On the basis of the fifth specific implementation manner of the present invention, a first database is established, and the first data and / or the second data and the picture-audio picture file name data corresponding to the first data and / or the second data are recorded one by one in the first database.

[0061] In some cases, the pictures stored in some devices include both ordinary electronic pictures and picture-audio pictures. Based on the same problem faced by the fourth specific implementation manner of the present invention, that is, in order to prevent the speed or efficiency of searching and retrieving picture-audio pictures from decreasing when there are too many picture-audio pictures, the technical solution provided by the sixth specific implementation manner of the present invention can be used to establish a first database for all the picture-audio pictures stored in the device; in this way, the existing database function can be used to quickly find the file name of the corresponding picture-audio picture in the first database with the first data and / or the second data as the query or retrieval condition, and then find the picture-audio picture.

[0062] The seventh specific implementation manner of the present invention also provides the following technical solution:

[0063] Parse all the picture-audio pictures in the picture storage area one by one, and obtain the first data embedded in a steganographic manner from the first picture partition of the picture-audio picture, and / or obtain the second data embedded in a steganographic manner from the second picture partition of the picture-audio picture.

[0064] Establish a first database, and record the first data and / or the second data and the picture-audio picture file name data corresponding to the first data and / or the second data one by one in the first database.

[0065] The technical solution provided by the seventh specific implementation manner of the present invention is applicable to the following situation: In some devices storing a large number of graphic, audio, and picture files, since the sources of these graphic, audio, and picture files may vary, some are generated by the device itself, some are downloaded from the Internet, and some may be copied from other devices; when querying or retrieving some or a certain one of these graphic, audio, and picture files, it is of course possible to access each graphic, audio, and picture file one by one, but this may reduce the speed or efficiency of searching and retrieving in the case of too many graphic, audio, and picture files. For this reason, in some

[0066] devices, a function that can be automatically or manually started and run can be implanted. This function can use the technical solution provided by the seventh specific implementation manner of the present invention to establish a first database in these devices. In this way, when it is necessary to search for or retrieve any graphic, audio, and picture file, only by using the existing database function and using the first data and / or the second data as the query or retrieval condition in the first database, the file name of the corresponding graphic, audio, and picture file can be quickly found, and then the graphic, audio, and picture file can be found.

[0067] The present invention also provides the following technical solution in its eighth specific implementation manner:

[0068] Based on the various technical solutions provided by the fourth, sixth, and seventh specific implementation manners of the present invention, when the device detects that a new graphic, audio, and picture file is added to the picture storage area, the new graphic, audio, and picture file is parsed, and new first data embedded in a steganographic manner is obtained from the first picture partition of the new graphic, audio, and picture file, and / or new second data embedded in a steganographic manner is obtained from the second picture partition of the new graphic, audio, and picture file; the new first data and / or the new second data and the file name data of the new graphic, audio, and picture file corresponding to the new first data and / or the new second data are correspondingly recorded in the first database.

[0069] Among them, the new first data is similar to the foregoing first data and at least includes the copyright identifier of the new graphic, audio, and picture file; the new second data is similar to the foregoing second data and at least includes a set of more than one piece of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data.

[0070] After a device obtains a new graphic, audio, and picture file through means such as downloading from the Internet or copying from other devices, by means of the foregoing technical solution, the relevant information of this new graphic, audio, and picture file can be automatically added to the first database, so that when it is necessary to query or retrieve this new graphic, audio, and picture file later, it can also be found at a relatively high speed and efficiency like other graphic, audio, and picture files without accessing the new graphic, audio, and picture file itself.

[0071] The technical solution of the ninth specific implementation manner of the present invention provides a technical solution contrary to that of the eighth specific implementation manner of the present invention:

[0072] Based on the various technical solutions provided in the fourth, sixth, and seventh specific implementation manners of the present invention, when the device detects that a picture with audio removed is deleted from the picture storage area, obtain the removed first data embedded in a steganographic manner from the first picture partition of this picture with audio removed, and / or obtain the removed second data embedded in a steganographic manner from the second picture partition of this picture with audio removed; correspondingly delete the removed first data and / or the second data and the file name data of the picture with audio removed corresponding to the removed first data and / or the removed second data in the first database.

[0073] Among them, the removed first data is similar to the aforementioned first data, and at least includes the copyright logo of the picture with audio removed; the removed is similar to the aforementioned second data, and at least includes more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data.

[0074] Due to the operation of the software or the operation of the user on a device, a picture with audio may be deleted from the picture storage area of the device. Here, to distinguish it from other pictures with audio, it is called: a picture with audio removed. At this time, corresponding to the deletion of the picture with audio removed, it is also necessary to delete the first data and / or the second data of this picture with audio removed from the first database to avoid possible problems in the future.

[0075] Finally, it should be noted that: the above specific embodiments of the present invention are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for processing graphic-audio picture data, comprising: When receiving a file creation command for creating a picture index, embedding the first data carried by the file creation command into the first picture partition of the original picture in a steganographic manner, and embedding the second data into the second picture partition of the original picture in a steganographic manner to form a graphic-audio picture, so that when receiving a query command for searching for the graphic-audio picture, determining, according to the first data obtained from the first picture partition of the graphic-audio picture and the second data obtained from the second picture partition, the graphic-audio picture that is consistent with the query first data and query second data carried by the query command; wherein the first data at least includes: the copyright identifier of the original picture; The second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data; wherein the marker data is used at a specific position or area of the graphic-audio picture to highlight the information at the corresponding position in the graphic-audio picture; the second data further includes: a message sequence list, and various attribute information of the content body information is stored in the message sequence list, and the attribute information is used to indicate the manner in which the graphic-audio picture receiver presents the content body information.

2. The method according to claim 1, characterized in that It further includes: Creating a first database, and recording the first data and / or the second data and the file name data of the graphic-audio picture and / or the original picture corresponding to the first data and / or the second data one by one in the first database.

3. A method for processing graphic-audio picture data, comprising: When receiving a query command for searching for a picture, parsing each graphic-audio picture in the picture storage area one by one, and obtaining the first data embedded therein in a steganographic manner from the first picture partition of the graphic-audio picture; and / or, obtaining the second data embedded therein in a steganographic manner from the second picture partition of the graphic-audio picture; Comparing the first data with the query first data carried by the query command, and when the first data is consistent with the query first data, outputting the graphic-audio picture corresponding to the first data; and / or, comparing the second data with the query second data carried by the query command, and when the second data is consistent with the query second data, outputting the graphic-audio picture corresponding to the second data; wherein the first data at least includes: the copyright identifier of the graphic-audio picture; The second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data; wherein the marker data is used at a specific position or area of the graphic-audio picture to highlight the information at the corresponding position in the graphic-audio picture; the second data further includes: a message sequence list, and various attribute information of the content body information is stored in the message sequence list, and the attribute information is used to indicate the manner in which the graphic-audio picture receiver presents the content body information.

4. The method according to claim 3, wherein It further includes: Establish a first database, and record the first data and / or the second data and the graphic-audio-picture file name data corresponding to the first data and / or the second data one by one in the first database.

5. A method for processing graphic-audio-picture data, comprising: Parse all the graphic-audio-pictures in the picture storage area one by one, obtain the first data embedded in a steganographic manner from the first picture partition of the graphic-audio-picture, and obtain the second data embedded in a steganographic manner from the second picture partition of the graphic-audio-picture; Establish a first database, and record the first data and / or the second data and the graphic-audio-picture file name data corresponding to the first data and / or the second data one by one in the first database, so that when a query command for searching for a graphic-audio-picture is received, in the first database, determine the first data and the second data that are consistent with the query first data and the query second data carried by the query command and the graphic-audio-picture file name data corresponding to the first data and the second data; Wherein, the first data at least includes: the copyright identifier of the graphic-audio-picture; The second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data and / or audio data; wherein, the marker data is used at a specific position or area of the graphic-audio-picture to highlight the information at the corresponding position in the graphic-audio-picture; the second data further includes: a message sequence list, and various attribute information of the content body information is stored in the message sequence list, and the attribute information is used to indicate the manner in which the content body information is presented to the recipient of the graphic-audio-picture.

6. The method according to claim 2, 4 or 5, characterized in that Further includes: When it is detected that a new graphic-audio-picture is added to the picture storage area, parse the new graphic-audio-picture, obtain the new first data embedded in a steganographic manner from the first picture partition of the new graphic-audio-picture, and / or obtain the new second data embedded in a steganographic manner from the second picture partition of the new graphic-audio-picture; Record the new first data and / or the new second data and the new graphic-audio-picture file name data corresponding to the new first data and / or the new second data one by one in the first database; Wherein, the new first data at least includes: the copyright identifier of the new graphic-audio-picture; The new second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data and / or audio data; the new second data further includes: a message sequence list, and various attribute information of the content body information is stored in the message sequence list.

7. The method according to claim 2, 4 or 5, characterized in that Further includes: When it is detected that a removed graphic-audio-picture is deleted from the picture storage area, obtain the removed first data embedded in a steganographic manner from the first picture partition of the removed graphic-audio-picture, and / or obtain the removed second data embedded in a steganographic manner from the second picture partition of the removed graphic-audio-picture; Correspondingly delete the removed first data and / or removed second data in the first database, as well as the removed graphic, audio, and picture file name data corresponding to the removed first data and / or removed second data; Among them, the removed first data at least includes: the copyright identifier of the removed graphic, audio, and picture; The removed second data at least includes: more than one group of annotation information composed of a content identifier and a content body; the content identifier is used to label the type of the content body; the content body information at least includes: text data, marker data, and / or audio data; the removed second data further includes: a message sequence list, and various attribute information of the content body information is stored in the message sequence list.