Image processing method, device, electronic device and storage medium

By detecting feature points on the image data at the image capture end and saving feature point position information, the problem of large installation volume of image processing applications in the prior art is solved, and the effect of saving storage space and improving processing efficiency is achieved.

CN112036241BActive Publication Date: 2025-02-14BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202010733648.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-27
Publication Date
2025-02-14
Estimated Expiration
2040-07-27

AI Technical Summary

Technical Problem

Existing image processing applications require installation of multiple model files during installation, resulting in a significant increase in installation volume.

Method used

By detecting feature points on the image data at the image shooting end, obtaining feature point position information, and saving image data and feature point position information as target images, so as to directly use feature point position information in the target image for special effects on the image editing end deal with.

Benefits of technology

It reduces the installation volume of image processing applications, saves storage space on the image editing end, and improves image processing efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112036241B_ABST
    Figure CN112036241B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an image processing method, device, electronic device and storage medium, the method comprising: acquiring image data; performing feature point detection on the image data to obtain feature point position information of the captured image; and saving the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capturing end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on a model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application, thereby saving storage space on the image editing end.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image processing method, device, electronic device and storage medium. Background Art

[0002] With the continuous development of technology and the continuous progress of society, Internet companies are also booming. Many users can take various images they need through mobile phones and other terminals. Correspondingly, many image processing applications have also emerged.

[0003] In practical applications, when an image includes a face region, an image processing application usually needs to process the face region of the image. When processing the face region, it is necessary to locate each part of the face region. However, in order to accurately locate each part of the face region in real time, existing image processing applications usually rely on many model files, that is, when installing the image processing application, many model files need to be installed, which greatly increases the installation volume of the image processing application. Summary of the invention

[0004] In order to solve the technical problem in the related art that when installing an image processing application, many model files need to be installed, which greatly increases the installation volume of the image processing application, the embodiments of the present disclosure provide an image processing method, device, electronic device and storage medium. The technical solution of the present disclosure is as follows:

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an image processing method, the method comprising:

[0006] Get image data;

[0007] Performing feature point detection on the image data to obtain feature point position information of the captured image;

[0008] The image data and the feature point position information are saved as a target image.

[0009] Optionally, the captured image also includes an image attribute information file;

[0010] The step of saving the image data and the feature point position information as a target image comprises:

[0011] The feature point position information is stored in the image attribute information file to obtain a target image attribute information file;

[0012] A target image is generated based on the image data and the target image attribute information file.

[0013] Optionally, the method further includes:

[0014] The target image is uploaded to a server, wherein when the server performs image processing on the target image, the feature point position information of the target image remains unchanged.

[0015] Optionally, the image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

[0016] Optionally, the method further includes:

[0017] The server receives a target image download request from a first client and sends the target image to the first client; wherein the first client reads feature point position information from the target image and performs special effect processing on the target image based on the read feature point position information.

[0018] Optionally, the image attribute information file includes an exchangeable image file format data file, the exchangeable image file format data file includes a plurality of preset tags, and one of the plurality of preset tags is used to store the feature point position information.

[0019] According to a second aspect of an embodiment of the present disclosure, there is provided an image generating device, the device comprising:

[0020] An image data acquisition module is configured to acquire image data;

[0021] A feature point detection module is configured to perform feature point detection on the image data to obtain feature point position information of the captured image;

[0022] The target image generation module is configured to save the image data and the feature point position information as a target image.

[0023] Optionally, the captured image also includes an image attribute information file;

[0024] The target image generation module is further configured to execute:

[0025] The feature point position information is stored in the image attribute information file to obtain a target image attribute information file;

[0026] A target image is generated based on the image data and the target image attribute information file.

[0027] Optionally, the device is further configured to execute:

[0028] The target image is uploaded to a server, wherein when the server performs image processing on the target image, the feature point position information of the target image remains unchanged.

[0029] Optionally, the image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

[0030] Optionally, the server is configured to execute:

[0031] A target image download request is received from a first client and the target image is sent to the first client; wherein the first client reads feature point position information from the target image and performs special effect processing on the target image based on the read feature point position information.

[0032] Optionally, the image attribute information file includes an exchangeable image file format data file, the exchangeable image file format data file includes a plurality of preset tags, and one of the plurality of preset tags is used to store the feature point position information.

[0033] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, characterized in that it includes:

[0034] processor;

[0035] a memory for storing instructions executable by the processor;

[0036] Wherein, the processor is configured to execute the instructions to implement the image processing method described in the first aspect.

[0037] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the image processing method described in the first aspect.

[0038] According to a fifth aspect of an embodiment of the present disclosure, there is provided a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the image processing method described in the first aspect.

[0039] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 is a flowchart of an image processing method according to an exemplary embodiment;

[0041] Figure 2 is a structural block diagram of an image capturing end, a server and an image editing end according to an exemplary embodiment;

[0042] Figure 3 is a schematic diagram showing an interaction between a shooting end, a server and an editing end according to an exemplary embodiment;

[0043] Figure 4 is a block diagram of an image processing device according to an exemplary embodiment;

[0044] Figure 5 is a block diagram of a device for image processing according to an exemplary embodiment;

[0045] Figure 6 is a block diagram of another apparatus for image processing according to an exemplary embodiment;

[0046] Figure 7 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0047] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0048] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0049] In order to solve the technical problem in the related art that when installing an image processing application, many model files need to be installed, which greatly increases the installation volume of the image processing application, the embodiments of the present disclosure provide an image processing method, device, electronic device and storage medium.

[0050] First, an image processing method provided by an embodiment of the present disclosure will be introduced in detail.

[0051] It should be noted that the image processing method can be applied to an image processing device, which can be installed in an electronic device. The electronic device can be an image capturing end, and a shooting application is installed in the image capturing end, that is, the image capturing end has an image capturing function. The image capturing end can be a mobile phone, a tablet, etc. The embodiment of the present disclosure does not specifically limit the image capturing end.

[0052] like Figure 1 As shown, an image processing method provided by an embodiment of the present disclosure may include the following steps:

[0053] In step S11, image data is acquired.

[0054] Specifically, when the image capturing end receives an image capturing operation instruction, it can capture an image. When capturing an image, the image capturing end can obtain image data. The image data can be bitmap data. The pixels of the bitmap data can be assigned specific positions and color values. The color information of each pixel is represented by an RGB combination or a grayscale value.

[0055] And, according to the bit depth in the bitmap data, the bitmap can be divided into 1, 4, 8, 16, 24 and 32-bit images, etc. The more information bits used for each pixel, the more colors are available, the more realistic the color representation, and the larger the corresponding data volume. For example, for pixels with a bit depth of 1, the bitmap has only two possible values ​​(black and white), so it is also called a binary bitmap. An image with a bit depth of 8 has 256 possible values, and a grayscale image with a bit depth of 8 has 256 possible gray values.

[0056] In step S12, feature point detection is performed on the image data to obtain feature point position information of the captured image.

[0057] In the process of capturing an image, the image capture end can use the feature point position information to measure light in order to ensure the metering effect of the captured image. That is, in the process of capturing an image, the feature point position information of the captured image can be obtained. In addition, there is a preview process before capturing the captured image, so the accuracy of the detected feature point position information is relatively high.

[0058] Specifically, the image data may be input into a facial feature point detection module, and the facial feature point detection module performs feature point detection on the image data to obtain feature point position information of the captured image.

[0059] In practical applications, the feature point position information may be the feature point position information of a human face, or the feature point position information of an animal or plant included in the captured image. This is all reasonable, and the embodiments of the present disclosure do not specifically limit the feature point position information of the captured image.

[0060] In step S13, the image data and feature point position information are saved as a target image.

[0061] After obtaining the image data of the captured image and the feature point position information of the captured image, the image capture end can save the image data and the feature point position information as a target image. In this way, the target image carries the feature point position information. In subsequent steps, when the image editing end performs special effects processing on the target image, the feature point position information can be directly obtained from the target image, and special effects processing can be performed on the target image based on the feature point position information.

[0062] Unlike the prior art, after receiving the image to be processed with special effects, the image editing end does not need to rely on the model software of the image processing application to identify the feature point position information of the image to be processed with special effects. This not only saves the storage space of the image processing end, but also improves the efficiency of image processing. In addition, by directly using the feature point position information carried in the target image to process the target image, the problem of inconsistent accuracy of feature point position information caused by different feature point position recognition algorithms used by different terminals can be avoided.

[0063] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0064] exist Figure 1 Based on the illustrated embodiment, in one implementation, the captured image also includes an image attribute information file;

[0065] At this time, saving the image data and feature point location information as a target image may include the following steps, namely step a1 and step a2:

[0066] Step a1, storing the feature point position information in an image attribute information file to obtain a target image attribute information file.

[0067] Specifically, in addition to image data, the captured image may also include an image attribute information file, which may include attribute information of the captured image and the captured data. In practical applications, the image attribute information file may be attached to files such as JPEG and TIFF. Before saving the image data and feature point location information as the target image, the image capture end may store the feature point location information in the image attribute information file, so that in subsequent steps, when the image editing end performs special effects processing on the target image, it can quickly obtain the feature point location information from the image attribute information file of the target image.

[0068] As an implementation method of the embodiment of the present disclosure, the image attribute information file includes an exchangeable image file format data file, the exchangeable image file format data file includes multiple preset tags, and one of the multiple preset tags is used to store feature point position information.

[0069] Specifically, in this implementation, the image attribute information file may include an exchangeable image file format EXIF ​​data file, wherein EXIF ​​is the abbreviation of Exchangeable Image File Format, which is an exchangeable image file format. EXIF ​​data can record the attribute information and shooting data of the captured image, and it is usually attached to JPEG, TIFF and other files.

[0070] After obtaining the EXIF ​​data file, the image capture end can write the feature point location information into a preset tag in the EXIF ​​data to obtain the target EXIF ​​data file, so that in the subsequent steps, the image editing end can quickly read the feature point location information of the captured image from the preset tag in the target EXIF ​​data file.

[0071] Among them, the preset tag used to store the feature point position information of the captured image can be the User comments tag of the exif data file, and of course, it can also be other preset tags of the exif data file. The embodiment of the present disclosure does not specifically limit the preset tag for storing the feature point position information of the captured image.

[0072] It can be seen that through the technical solution provided by the embodiment of the present disclosure, the image capturing end obtains the target exif data file by writing the feature point position information into a preset tag of the exchangeable image file format exif data file, which is beneficial for the image editing end to quickly read the feature point position information of the captured image from the target exif data file, thereby further improving the image processing efficiency.

[0073] Step a2, generating a target image based on the image data and the target image attribute information file.

[0074] Specifically, after the image capturing end writes the feature point position information of the captured image into the image attribute information file and obtains the target image attribute information file, the image data and the target image attribute information file can be saved as a target image, which is beneficial for the image editing end to quickly read the feature point position information of the captured image from the target image attribute information file of the target image, thereby further improving image processing efficiency.

[0075] Based on the above embodiment, in one implementation, an image processing method provided by an embodiment of the present disclosure may further include the following steps:

[0076] The target image is uploaded to the server, wherein when the server performs image processing on the target image, the position information of the feature points of the target image remains unchanged.

[0077] In this embodiment, after obtaining the target image carrying the feature point location information of the captured image, the image capturing end can upload the target image to the server, so that in subsequent steps, the image editing end can download the target image from the server and perform special effects processing on the target image.

[0078] Furthermore, after receiving the target image, the server can perform image processing on the target image, but will not process the feature point position information of the captured image. That is to say, when the server performs image processing on the target image, the feature point position information of the target image remains unchanged. In this way, in subsequent steps, after the image editing end downloads the target image from the server, it can obtain the feature point position information of the captured image, and can directly perform special effects processing on the target image based on the feature point position information of the captured image.

[0079] In practical applications, the image processing of the target image by the server may include at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

[0080] Of course, the above only lists several image processing methods of the server for the target image. In practical applications, the server can also perform other image processing methods on the target image. However, when the server performs image processing on the target image, the feature point position information of the target image remains unchanged. The disclosed embodiment does not specifically limit the image processing method of the server for the target image.

[0081] It can be seen that through the technical solution provided by this embodiment, when the server processes the target image, it will not change the feature point position information of the captured image. In this way, the image editing end can directly obtain the feature point position information of the captured image, instead of relying on the model software of the image processing application to identify the facial feature point position information of the captured image after receiving the captured image, as in the prior art. Not only can it save the storage space of the image processing end, but it can also improve the efficiency of image processing. In addition, by directly using the existing facial feature point position information, it can avoid the problem of inconsistent accuracy of facial feature point position information caused by different feature point position recognition algorithms used by different terminals.

[0082] It is understandable that, in practical applications, the image editing end and the image capturing end may be located in the same terminal or in different terminals.

[0083] When the image editing end needs to perform special effects processing on the target image, it can send a target image download request to the server to download the target image from the server, then read the feature point position information from the target image, and perform special effects processing on the target object based on the read feature point position information.

[0084] In one implementation, when the image editing end needs to perform special effects processing on the target image, the image processing method may further include the following step b1:

[0085] Step b1: the server receives a target image download request from a first client and sends the target image to the first client.

[0086] The first client reads feature point position information from the target image, and performs special effect processing on the target image based on the read feature point position information.

[0087] It is understandable that the first client is the image editing terminal described in the above embodiment. When the image editing terminal needs to perform special effects processing on the target image, it can send a target image download request to the server. After receiving the target image download request, the server parses the target image download request and sends the target image to the image editing terminal, so that the image editing terminal can obtain the target image.

[0088] Furthermore, since the target image carries the feature point position information of the captured image, the image editing end can directly read the feature point position information from the target image after obtaining the target image. And the target image can be processed with special effects based on the read feature point position information. It should be noted that the specific special effects processing performed by the image editing end on the target image can be determined according to the actual situation, and the embodiments of the present disclosure do not specifically limit this.

[0089] For example, the feature point position information is facial feature point position information. Therefore, after obtaining the target image, the image editing end can read the facial feature point position information of the captured image from the target image, and can directly perform special effects processing such as beautification on the facial area of ​​the target image.

[0090] It can be seen that through the technical solution provided by this embodiment, the image editing end can directly obtain the feature point location information of the captured image from the target image, instead of relying on the model software of the image processing application to identify the facial feature point location information of the captured image after receiving the captured image, as in the prior art. This can not only save the storage space of the image processing end, but also improve the efficiency of image processing. In addition, by directly using the existing facial feature point location information, the problem of inconsistent accuracy of facial feature point location information caused by different feature point location recognition algorithms used by different terminals can be avoided.

[0091] In order to describe the solution clearly, the image processing method provided by the embodiment of the present disclosure will be described in detail below in combination with specific examples.

[0092] like Figure 2 As shown, it includes two terminals, namely a first terminal 210 and a second terminal 230, and a server 220. Of course, in practical applications, the number of terminals and the number of servers can be large, and the embodiment of the present disclosure does not specifically limit the number of terminals and servers.

[0093] Furthermore, the first terminal 210 may be an image capturing terminal. In this case, the first terminal 210 may include an image data acquiring module 211 , a feature point detecting module 212 , and a target image generating module 213 .

[0094] The image data acquisition module is configured to acquire image data;

[0095] A feature point detection module is configured to perform feature point detection on the image data to obtain feature point position information of the captured image;

[0096] The target image generation module is configured to save the image data and feature point position information as a target image.

[0097] Furthermore, when the captured image includes not only the image data but also the image attribute information file,

[0098] The target image generation module 213 is further configured to execute:

[0099] The feature point position information is stored in the image attribute information file to obtain the target image attribute information file;

[0100] A target image is generated based on the image data and the target image attribute information file.

[0101] In one implementation, the image attribute information file includes an exchangeable image file format data file, the exchangeable image file format data file includes a plurality of preset tags, and one of the plurality of preset tags is used to store feature point position information.

[0102] Furthermore, the image capturing terminal 210 may upload the target image to the server 220. The server 220 may include an image processing module 221.

[0103] The image processing module 221 may be configured to keep the feature point position information of the target image unchanged when performing image processing on the target image.

[0104] The above-mentioned image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image and converting the format of the target image.

[0105] Furthermore, the second terminal 230 may be an image editing terminal, which may download a target image from the server 220 and perform feature processing on the target image. The image editing terminal 230 may include an image downloading module 231 , a feature point location information reading module 232 , and an image special effect processing module 233 .

[0106] The image download module 231 may be configured to send a target image download request to a server to obtain the target image.

[0107] The feature point position information reading module 232 may be configured to read the feature point position information from the target image.

[0108] The image special effect processing module 233 may be configured to perform special effect processing on the target image based on the read feature point position information.

[0109] It should be noted that, in the method embodiment of the first aspect, the image capture end, the server and the image editing end have been described in detail, and will not be repeated here. Moreover, in practical applications, the first terminal 210 may also be an image editing end, and the second terminal 230 may also be an image capture end. It is understandable that when the first terminal 210 is an image editing end, it may also include an image download module, a feature point location information reading module and an image special effect processing module, and when the second terminal 230 is an image capture end, it may also include an image data acquisition module, a feature point detection module, and a target image generation module.

[0110] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0111] In order to describe the solution clearly, the image processing method provided by the embodiment of the present disclosure will be described in detail below in combination with the application scenario. Figure 3 shown.

[0112] from Figure 3 It can be seen that the shooting end can shoot an image and obtain the image data of the image, such as bitmap data and exif data; send the image data to the face feature point detection module to obtain the position information of the face feature points; write the obtained face feature point position information into the User comments tag of the exif data. And the exif data and bitmap data can be saved as a JPE image.

[0113] The server can scale, convert the format of the JPE image, etc., but the server will not discard or change the User comments tag in the EXIF ​​data.

[0114] The editor can download the JPE image from the server, read the exif data in the JPE image, and read the User comments tag in the exif data to obtain the facial key point position information of the image. The editor can then perform subsequent special effects processing based on the obtained facial key point position information.

[0115] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0116] According to a second aspect of an embodiment of the present disclosure, there is provided an image processing device, which is applied to an image capturing end, such as Figure 4 As shown, the device comprises:

[0117] The image data acquisition module 410 is configured to acquire the captured image data;

[0118] The feature point detection module 420 is configured to perform feature point detection on the image data to obtain feature point position information of the captured image;

[0119] The target image generating module 430 is configured to save the image data and the feature point position information as a target image.

[0120] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0121] Optionally, the captured image also includes an image attribute information file;

[0122] The target image generation module is further configured to execute:

[0123] The feature point position information is stored in the image attribute information file to obtain a target image attribute information file;

[0124] A target image is generated based on the image data and the target image attribute information file.

[0125] Optionally, the device is further configured to execute:

[0126] The target image is uploaded to a server, wherein when the server performs image processing on the target image, the feature point position information of the target image remains unchanged.

[0127] Optionally, the image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

[0128] Optionally, the server is configured to execute:

[0129] A target image download request is received from a first client and the target image is sent to the first client; wherein the first client reads feature point position information from the target image, and performs special effect processing on the target image based on the read feature point position information.

[0130] Optionally, the image attribute information file includes an exchangeable image file format data file, the exchangeable image file format data file includes a plurality of preset tags, and one of the plurality of preset tags is used to store the feature point position information.

[0131] Figure 5 1 is a block diagram of an apparatus 500 for image processing according to an exemplary embodiment. For example, the apparatus 500 may be a mobile phone, a computer, a digital broadcast electronic device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0132] Reference Figure 5 , the device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 515 .

[0133] The processing component 502 generally controls the overall operation of the device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 502 may include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.

[0134] The memory 504 is configured to store various types of data to support operations on the device 500. Examples of such data include instructions for any application or method operating on the device 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0135] The power supply component 507 provides power to the various components of the device 500. The power supply component 507 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 500.

[0136] The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the device 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0137] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), and when the device 500 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.

[0138] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0139] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the device 500. For example, the sensor assembly 514 can detect the open / closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500, and the sensor assembly 514 can also detect the position change of the device 500 or a component of the device 500, the presence or absence of user contact with the device 500, the orientation or acceleration / deceleration of the device 500, and the temperature change of the device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0140] The communication component 516 is configured to facilitate wired or wireless communication between the device 500 and other devices. The device 500 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0141] In an exemplary embodiment, the apparatus 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the image processing method described in the first aspect.

[0142] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, and the instructions can be executed by the processor 520 of the device 500 to complete the above method. Optionally, for example, the storage medium can be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0143] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0144] Figure 6 6 is a block diagram of an apparatus 600 for image processing according to an exemplary embodiment. For example, the apparatus 600 may be provided as a server. Figure 6 The apparatus 600 includes a processing component 622, which further includes one or more processors, and a memory resource represented by a memory 632 for storing instructions executable by the processing component 622, such as an application. The application stored in the memory 632 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 622 is configured to execute the instructions to perform the image processing method described in the first aspect.

[0145] The device 600 may also include a power supply component 626 configured to perform power management of the device 600, a wired or wireless network interface 650 configured to connect the device 600 to a network, and an input / output (I / O) interface 658. The device 600 may operate based on an operating system stored in the memory 632, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0146] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0147] According to a fifth aspect of the embodiments of the present disclosure, there is provided an electronic device, such as Figure 7 As shown, including:

[0148] Processor 710;

[0149] A memory 720 for storing instructions executable by the processor;

[0150] Wherein, the processor is configured to execute the instructions to implement the image processing method described in the first aspect.

[0151] In the technical solution provided by the embodiment of the present disclosure, the image capturing end obtains image data; performs feature point detection on the image data to obtain feature point information of the captured image; and sends the image data and feature point position information to the image editing end; after obtaining the image data and the feature point position information of the captured image, the image editing end can directly perform image processing on the captured image based on the image data and the feature point position information. It can be seen that through the technical solution of the embodiment of the present disclosure, the image editing end can directly obtain the feature point position information of the captured image from the image capturing end, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0152] According to a sixth aspect of an embodiment of the present disclosure, a storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the image processing method described in the first aspect.

[0153] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0154] According to a seventh aspect of an embodiment of the present disclosure, there is provided a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the image processing method described in the first aspect.

[0155] In the technical solution provided by the embodiment of the present disclosure, the image capture end obtains image data; performs feature point detection on the image data to obtain feature point position information of the captured image; and saves the image data and the feature point position information as a target image. It can be seen that through the technical solution of the embodiment of the present disclosure, the target image generated by the image capture end carries feature point position information, so that when the image editing end performs special effects processing on the target image, it can directly obtain the feature point position information of the captured image from the target image, without relying on the model file to identify the feature point information of the captured image, thereby reducing the installation volume of the image processing application and saving the storage space of the image editing end. In addition, since the image editing end does not need to detect the feature point position information of the captured image, time is saved and image processing efficiency is improved.

[0156] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0157] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, characterized in that: Applied to the image capturing end, the method includes: Get image data; During the image shooting process, feature point detection is performed on the image data to obtain feature point position information of the shot image; the feature point position information is obtained during the image shooting process and in a preview process before shooting the shot image; Saving the image data and the feature point position information as a target image; The captured image also includes an image attribute information file; and the image data and the feature point position information are saved as a target image, including: The feature point position information is stored in the image attribute information file to obtain a target image attribute information file; A target image is generated based on the image data and the target image attribute information file.

2. The method according to claim 1, characterized in that The method further comprises: The target image is uploaded to a server, wherein when the server performs image processing on the target image, the feature point position information of the target image remains unchanged.

3. The method according to claim 2, characterized in that The image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

4. The method according to claim 2, characterized in that: The method further comprises: The server receives a target image download request from a first client and sends the target image to the first client; wherein the first client reads feature point position information from the target image and performs special effect processing on the target image based on the read feature point position information.

5. The method according to claim 1, characterized in that: The image attribute information file includes an exchangeable image file format data file, and the exchangeable image file format data file includes a plurality of preset tags, wherein one of the plurality of preset tags is used to store the feature point position information.

6. An image generating device, characterized in that: Applied to an image capturing end, the device comprises: An image data acquisition module is configured to acquire image data; The feature point detection module is configured to perform feature point detection on the image data during the image shooting process to obtain feature point position information of the shot image; the feature point position information is obtained during the image shooting process and before shooting the shot image in a preview process; A target image generation module, configured to save the image data and the feature point position information as a target image; The captured image also includes an image attribute information file; the target image generation module is further configured to execute: The feature point position information is stored in the image attribute information file to obtain a target image attribute information file; A target image is generated based on the image data and the target image attribute information file.

7. The device according to claim 6, characterized in that The apparatus is also configured to perform: The target image is uploaded to a server, wherein when the server performs image processing on the target image, the feature point position information of the target image remains unchanged.

8. The device according to claim 7, characterized in that The image processing includes at least one of the following: reducing the target image, enlarging the target image, rotating the target image, compressing the target image, and converting the format of the target image.

9. The device according to claim 7, characterized in that The server is configured to perform: A target image download request is received from a first client and the target image is sent to the first client; wherein the first client reads feature point position information from the target image, and performs special effect processing on the target image based on the read feature point position information.

10. The device according to claim 6, characterized in that The image attribute information file includes an exchangeable image file format data file, and the exchangeable image file format data file includes a plurality of preset tags, wherein one of the plurality of preset tags is used to store the feature point position information.

11. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the image processing method according to any one of claims 1 to 5.

12. A storage medium, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the image processing method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Image retrieval system, method and device

    CN103927387A

  • Device and method for displaying three-dimensional image

    JP2010183267A

  • UCC service system based on pattern-animation

    KR1020100111930A