Image processing method, device, apparatus and storage medium

By sending images to the server for fusion processing and combining them with local algorithms, the problems of low efficiency and poor accuracy in mobile terminal image processing are solved, achieving a more efficient image fusion effect.

CN115082368BActive Publication Date: 2025-11-28BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210693158.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-17
Publication Date
2025-11-28
Estimated Expiration
2042-06-17

AI Technical Summary

Technical Problem

Mobile terminals suffer from low image processing efficiency and poor accuracy, a problem that current technologies cannot effectively solve.

Method used

Multiple images are sent to the server for fusion processing, utilizing the server's high computing power for image fusion, and then processed locally on the client side to improve efficiency and accuracy.

Benefits of technology

This reduces the data processing burden on the client side and improves the image fusion effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115082368B_ABST
    Figure CN115082368B_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide an image processing method, device and equipment and a storage medium. At least two original images are acquired. The at least two original images are displayed on a current picture in a set manner, and the at least two original images are sent to a server, so that the server performs fusion processing on the at least two original images. A first target image returned by the server is received, and the first target image is displayed on the current picture. The first target image is an image obtained by the server performing fusion processing on the at least two original images. The image processing method provided by the embodiments of the present disclosure sends the at least two original images to the server for fusion processing, which not only can reduce the data processing pressure of the client, but also can improve the fusion effect of the image.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of image processing, and particularly relate to an image processing method, device, apparatus and storage medium. BACKGROUND

[0002] At present, mobile terminals have become one of the indispensable tools for users to carry out entertainment activities. Users can use mobile terminals to perform various image processing. In the prior art, most of the image processing is achieved by running algorithms locally on the client. Due to the limitation of the hardware configuration of the mobile terminal, the efficiency of image processing is low, and the precision of the processed image is poor, which affects the image processing effect. SUMMARY

[0003] Embodiments of the present disclosure provide an image processing method, device, apparatus and storage medium, which sends multiple images to a server for fusion processing, thereby reducing the data processing pressure of the client and improving the fusion effect of the image.

[0004] In a first aspect, the embodiments of the present disclosure provide an image processing method, comprising:

[0005] obtaining at least two original images;

[0006] displaying the at least two original images on a current screen in a set manner, and sending the at least two original images to a server to make the server perform fusion processing on the at least two original images;

[0007] receiving a first target image returned by the server and displaying the first target image on the current screen, wherein the first target image is an image obtained by the server after performing fusion processing on the at least two original images.

[0008] In a second aspect, the embodiments of the present disclosure further provide an image processing device, comprising:

[0009] an original image obtaining module configured to obtain at least two original images;

[0010] an original image sending module configured to display the at least two original images on a current screen in a set manner, and send the at least two original images to a server to make the server perform fusion processing on the at least two original images;

[0011] a first target image displaying module configured to receive a first target image returned by the server and display the first target image on the current screen, wherein the first target image is an image obtained by the server after performing fusion processing on the at least two original images.

[0012] In a third aspect, the embodiments of the present disclosure further provide an electronic device, which comprises:

[0013] one or more processors;

[0014] a storage device configured to store one or more programs,

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the image processing method according to the embodiments of the present disclosure.

[0016] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium containing computer executable instructions for performing the image processing method according to the embodiments of the present disclosure when executed by a computer processor.

[0017] The embodiments of the present disclosure disclose an image processing method, device, equipment and storage medium, at least two original images are acquired; the at least two original images are displayed on a current picture in a set manner, and the at least two original images are sent to a server, so that the server performs fusion processing on the at least two original images; a first target image returned by the server is received, and the first target image is displayed on the current picture; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images. The image processing method provided by the embodiments of the present disclosure sends the at least two original images to the server for fusion processing, which not only can reduce the data processing pressure of the client, but also can improve the fusion effect of the image. BRIEF DESCRIPTION OF DRAWINGS

[0018] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent upon reading the following detailed description in conjunction with the accompanying drawings, in which like reference numerals refer to like elements. It is to be understood that the drawings are designed solely for purposes of illustration and not as a definition of the limits of the disclosure, for which reference should be made only to the appended claims. Throughout the drawings, like reference numerals indicate like elements.

[0019] Figure 1 is a flowchart of an image processing method provided by the embodiments of the present disclosure;

[0020] Figure 2a is a schematic diagram of a user selecting a local image provided by the embodiments of the present disclosure;

[0021] Figure 2b is an example diagram of original images displayed in a picture provided by the embodiments of the present disclosure;

[0022] Figure 2c is an example diagram of original images displayed in a picture provided by the embodiments of the present disclosure;

[0023] Figure 2dFIG. 1 is an example diagram provided by an embodiment of the present disclosure, showing a first target image being displayed;

[0024] Figure 3 FIG. 2 is a structural schematic diagram of an image processing device provided by an embodiment of the present disclosure;

[0025] Figure 4 FIG. 3 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described in more detail with reference to the drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein, but rather should be construed to encompass all modifications equivalent in meaning and scope. It is understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

[0027] It should be understood that the various steps of the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0028] The term “comprising” and variations thereof as used herein are open-ended, that is, “including but not limited to”. The term “based on” is “based, at least in part, on”. The term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; the term “some embodiments” means “at least some embodiments”. Related definitions are given below in the description of the various terms.

[0029] It should be noted that the terms “first”, “second”, and the like in the present disclosure are merely used to distinguish different devices, modules or units, and do not limit the functions performed by these devices, modules or units or the sequence or interdependence of these functions.

[0030] It should be noted that the terms “one”, “more than one” in the present disclosure are illustrative and not limiting, and those skilled in the art should understand that “one or more” should be understood unless otherwise explicitly stated in the context.

[0031] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are merely for illustrative purposes and do not limit the scope of the messages or information.

[0032] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type, use range, use scenario, etc. of the personal information involved in the present disclosure should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0033] For example, in response to receiving the active request of the user, the prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using the personal information of the user. Thus, the user can voluntarily choose whether to provide the personal information to the software or hardware such as the electronic device, application program, server or storage medium, etc. performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0034] As an optional but non-limiting implementation manner, in response to receiving the active request of the user, the manner of sending the prompt information to the user may, for example, be the manner of a pop-up window, and the prompt information may, for example, be presented in the form of text in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select "agree" or "disagree" to provide the personal information to the electronic device.

[0035] It can be understood that the above notification and obtaining of the authorization of the user are only illustrative, and do not limit the implementation manners of the present disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation manners of the present disclosure.

[0036] It can be understood that the data (including but not limited to the data itself, the acquisition or use of the data) involved in the present technical solutions should comply with the requirements of the relevant laws and regulations and the relevant provisions.

[0037] Figure 1 A flowchart of an image processing method provided by the embodiments of the present disclosure is shown. The embodiments of the present disclosure are applicable to the case of fusing multiple images. The method can be executed by an image processing device, which can be implemented in the form of software and / or hardware. Optionally, the image processing device can be implemented by an electronic device, which can be a mobile terminal, a PC terminal or a server, etc.

[0038] As shown in Figure 1 the method comprises:

[0039] S110, acquiring at least two original images.

[0040] The original images can be images to be processed. The manner of acquiring the at least two original images can be: acquiring the at least two original images through frame grabbing and / or local uploading. That is, the at least two original images can be acquired through frame grabbing, or acquired through local uploading, or acquired through frame grabbing and acquired through local uploading.

[0041] Optionally, the manner of acquiring the at least two original images can be: when a first operation triggered by the user is detected, performing continuous frame grabbing processing on the current screen at least twice to obtain the at least two original images; and / or when it is detected that the user selects at least two original images from the local and triggers a second operation, taking the at least two original images selected by the user as the at least two original images acquired.

[0042] The first operation can be an operation of triggering the terminal device to perform frame grabbing processing on the current screen, for example, can be single-clicking the screen, double-clicking the screen, detecting that the user makes a set gesture or posture, collecting a voice signal containing a set keyword, or the interface is provided with a control button for triggering frame grabbing, and the user triggers frame grabbing by clicking the control button. The triggering operation of the first operation is not limited in the embodiment. Frame grabbing can also be referred to as screen capturing. The content displayed on the current screen is captured by calling a frame grabbing function, thereby obtaining an original image. Optionally, the triggering manner of frame grabbing processing can also be realized by a countdown manner. When the terminal enters an image processing prop, the interface displays the countdown numbers “321”, and after the countdown ends, a frame grabbing operation is performed once. The countdown numbers “321” are continuously displayed, and after the countdown ends, a frame grabbing operation is performed once, until the number of frame grabbing reaches a set value. Specifically, when the user opens a certain image processing prop through the terminal device, the terminal device displays the image currently collected by the camera in real time on the current screen, or acquires a video file from a local database or a network database and plays the video file on the current interface. When the terminal device detects the first operation triggered by the user, the content displayed on the current screen is continuously frame grabbed at least twice to obtain at least two original images.

[0043] The second operation can be an operation for confirming the at least two original images selected by the user. In the embodiment, when the user opens a certain image processing prop through the terminal device, the interface displays a button for adding a local image. After the user clicks the button, the terminal displays the images stored locally on the current interface for the user to select. When it is detected that the user selects at least two original images therefrom and triggers the second operation, the at least two original images selected by the user are taken as the at least two original images acquired. Figure 2a is a schematic diagram of the user selecting a local image in the embodiment, as shown in Figure 2a The user clicks the “+” button, the terminal displays the images stored locally on the current interface, and it is assumed that the user selects image 1 and image 3 and clicks the “confirm” button. Then, image 1 and image 3 are taken as the original images finally acquired. In the embodiment, the original images are acquired by the frame grabbing manner or the local selection manner, which can improve the diversity of the original images.

[0044] Optionally, the manner of acquiring the at least two original images can be: in a process of performing the frame grabbing on the current picture for at least two times continuously, if it is detected that the user selects at least two original images from the local and triggers the second operation, the frame grabbing is terminated, the image acquired by the frame grabbing is deleted, and the at least two original images selected by the user are taken as the acquired at least two original images.

[0045] The process of performing the frame grabbing on the current picture for at least two times continuously can be understood as a period in which the frame grabbing on the current picture has been started but not completed. Specifically, in the process in which the terminal has started the frame grabbing on the current picture but not completed the frame grabbing, if it is detected that the user selects at least two original images from the local and triggers the second operation, the terminal is controlled to stop the frame grabbing on the current picture, the image acquired by the frame grabbing is deleted, and finally the at least two original images selected by the user are taken as the acquired at least two original images. In the embodiment, the image selected by the user from the local is preferentially taken as the acquired original image, which can meet the personalized demand of the user on the image processing.

[0046] S120, display the at least two original images on the current picture in a set manner and send the at least two original images to the server, so that the server performs the fusion processing on the at least two original images.

[0047] The set manner can be to display the at least two original images in a playing animation manner or to display the at least two original images statically for a set time length. The embodiment does not limit the manner of displaying the at least two original images on the current picture.

[0048] Optionally, the manner of displaying the at least two original images on the current picture in the set manner can be: acquiring a playing animation corresponding to each of the at least two original images; and displaying the at least two original images on the current picture in the playing animation.

[0049] The playing animation is composed of multiple frames, and each frame of the animation image contains motion information and display information of the original image in the picture. The motion information includes position information and rotation information, and the display information includes size information and transparency information. The position information can be understood as the position coordinates of the center point of the original image in the current frame, the rotation information can be understood as the included angle between the horizontal side of the original image and the horizontal direction or the vertical direction, or the included angle between the vertical side of the original image and the horizontal direction or the vertical direction. The size information can be the length and height of the original image, and the transparency information can be understood as the display transparency of the original image.

[0050] In this embodiment, the transparency information can be a value between 0 and 1, 0 representing full transparency and 1 representing full opacity. For the transparency information of the original images in the playing animation, the transparency information can be determined according to the overlapping degree of the original images. Specifically, when the original images do not overlap, the transparency information of each original image is 1, and when the original images overlap, the transparency of one or more original images can be adjusted according to the overlapping degree. A corresponding relationship between the overlapping degree and the transparency adjustment amount can be established in advance, so that the adjustment amount is determined according to the overlapping degree, and the transparency of one or more original images is adjusted based on the adjustment amount.

[0051] In this embodiment, the motion information and the display information of the original images in the playing animation can be set arbitrarily, or a plurality of candidate animations can be set in advance for the user to select, which is not limited herein. For example, taking two original images as an example, the playing animation corresponding to the two original images can be as follows: the two original images first fly into the current picture from the left and right upper boundaries of the screen respectively, when the two original images meet in the picture, the two original images move to the center of the picture, when the two original images move to the center of the picture, the two original images move in opposite directions, the two original images gradually overlap, and the animation ends when the two original images complete overlapping. Figure 2b is an example diagram of the display of the original images in the picture in this embodiment, as shown in Figure 2b The left original image is tilted to the left and the right original image is tilted to the right. In this embodiment, the at least two original images are displayed in the current picture according to the playing animation, which can improve the display diversity of the picture and improve the user experience.

[0052] Optionally, the manner of displaying the at least two original images in the current picture according to the set manner can be: obtaining a set material; displaying the at least two original images in the current picture according to a first transparency and displaying the set material in the current picture according to a second transparency.

[0053] The first transparency is greater than the second transparency, that is, the original image is not completely covered by the set material, and the original image can be seen through the set material. The set material can be a video file composed of a sequence of material images, that is, composed of a plurality of material images. The material image can be an image set by the developer in advance, and can be a sequence of material images for timing. For example, it can be a sequence of material images in the form of a progress bar, or a sequence of material images in the form of a countdown, or a sequence of material images combining the countdown and the progress bar, which is not limited herein. In this embodiment, the at least two original images and the set material are displayed in the current picture at the same time, and the time length during which the at least two original images are displayed in the current picture is determined by the time length corresponding to the set material. For example, Figure 2c is an example diagram of the display of the original images in the picture in this embodiment, as shown in Figure 2cAs shown, two original images are displayed in the current picture, and the setting material is an image sequence generated by a piece of prompt information. In this embodiment, the setting material and the at least two original images are displayed in the current picture at the same time, which can improve the diversity of picture display and improve the user experience.

[0054] In this embodiment, the at least two original images are sent to the server, and the process in which the server fuses the at least two original images can be: sending the at least two original images carrying the algorithm identifier to the server, so that the server calls the target fusion algorithm according to the algorithm identifier, to fuse the at least two original images by using the target fusion algorithm.

[0055] The algorithm identifier can be composed of an algorithm name, an algorithm storage address, and the like. The target fusion algorithm can be a constructed neural network model, such as a generative adversarial network model (GAN), and the like. In this embodiment, different fusion functions correspond to different fusion algorithms, and one image processing prop can set one or more fusion algorithms in the server, and the user can select the required fusion algorithm. Exemplarily, the fusion algorithm can be to fuse at least two face images into one “baby” image, or to fuse at least two face images into one virtual face image, or to fuse at least two images of different stylization into one new stylized image, and the like. The function of the fusion algorithm is not limited here, and can be set arbitrarily according to requirements.

[0056] In this embodiment, after the client sends the at least two original images to the server, the time for the server to return the first target image is uncertain due to the influence of network conditions and the time required for the target fusion algorithm to run. During the time period between sending the original images and receiving the first target image, the at least two original images can be displayed in the current picture in a set manner. That is, displaying the at least two original images in the current picture in a set manner and sending the at least two original images to the server are executed at the same time. In this embodiment, during the process of sending the at least two original images to the server for processing and fusion, the processing time of the target fusion algorithm of the server is reserved by displaying the at least two original images in the current picture in a set manner, which improves the flexibility of interface interaction.

[0057] In this embodiment, the at least two original images are sent to the server at the same time, and the process further includes the following steps: calling a local setting algorithm to process any one of the at least two original images to obtain a second target image.

[0058] Specifically, after obtaining the at least two original images, the target fusion algorithm of the server and the local setting algorithm of the local client are called in parallel to process the at least two original images, so as to obtain a first target image output by the target fusion algorithm and a second target image output by the local setting algorithm. In this embodiment, if the server can return the first target image to the client in time, the client displays the first target image preferentially, and if the server cannot return the first target image to the client in time, the client displays the second target image. Parallel calling of the target fusion algorithm of the server and the local setting algorithm of the local client to process the at least two original images takes into account both the high-precision computing capability of the server and the processing efficiency of the client.

[0059] The local setting algorithm and the target fusion algorithm correspond to each other. The local setting algorithm can be a constructed neural network model, for example, a generative adversarial network model (GAN) or the like. The local setting algorithm and the target fusion algorithm correspond to each other can be understood as that the local setting algorithm and the target fusion algorithm have the same function, and the local setting algorithm has lower precision and occupies less system resources than the target fusion algorithm. For example, assuming that the target fusion algorithm of the server can fuse at least two face images into one "baby" image, the local setting algorithm can convert one original image into a "baby" image. In this embodiment, the local setting algorithm is called to process any one of the at least two original images and the at least two original images are sent to the server for processing, which are executed synchronously. In this embodiment, when the client does not receive the first target image returned by the server within a set time length, the second target image output by the local setting algorithm is displayed on the current screen, which can prevent the current screen from being displayed without an image and improve user experience.

[0060] S130, receiving the first target image returned by the server and displaying the first target image on the current screen.

[0061] The first target image is an image obtained by the server after performing fusion processing on the at least two original images. In this embodiment, after receiving the first target image returned by the server, the first target image can be displayed on the current screen.

[0062] The way of displaying the first target image on the current screen can be that the first target image is displayed on the current screen alone or the first target image and the at least two original images are displayed on the current screen simultaneously. In this embodiment, the first target image can be displayed on the current screen in full screen or in a way smaller than the screen size. For example, Figure 2d is an example diagram of displaying the first target image in this embodiment, as Figure 2dAs shown, the first target image and the at least two original images are displayed simultaneously on the current screen.

[0063] Optionally, after the at least two original images are displayed on the current screen in the set manner, the method further includes the following step: if the first target image returned by the server is not received, displaying a second target image on the current screen. Alternatively, if the first target image returned by the server is not received, displaying set information on the current screen.

[0064] The set information can be information representing that the first target image returned by the server is not received, for example, "processing failure" and the like. In the embodiment, when the client does not receive the first target image returned by the server within the set time length, the set information is displayed on the current screen, which can prevent the case that the current screen has no content displayed, and can play a role of prompting the user, thereby improving the user experience.

[0065] The technical scheme of the embodiment of the present disclosure includes the following steps: obtaining at least two original images; displaying the at least two original images on a current screen in a set manner, and sending the at least two original images to a server, so that the server performs fusion processing on the at least two original images; receiving a first target image returned by the server, and displaying the first target image on the current screen; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images. The image processing method provided by the embodiment of the present disclosure sends the at least two original images to the server for fusion processing, which not only can reduce the data processing pressure of the client, but also can improve the fusion effect of the image.

[0066] Figure 3 As shown in a structural schematic diagram of an image processing device provided by an embodiment of the present disclosure, Figure 3 the device includes:

[0067] The original image obtaining module 310 is configured to obtain at least two original images.

[0068] The original image sending module 320 is configured to display the at least two original images on a current screen in a set manner, and send the at least two original images to a server, so that the server performs fusion processing on the at least two original images.

[0069] The first target image displaying module 330 is configured to receive a first target image returned by the server, and display the first target image on the current screen; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images.

[0070] Optionally, the original image obtaining module 310 is further configured to:

[0071] When the first operation triggered by the user is detected, the current picture is captured for at least twice successively to obtain at least two original images; and / or,

[0072] When it is detected that the user selects at least two original images from the local and triggers the second operation, the at least two original images selected by the user are taken as the at least two original images obtained.

[0073] Optionally, the original image obtaining module 310 is further configured to:

[0074] In the process of capturing the current picture for at least twice successively, if it is detected that the user selects at least two original images from the local and triggers the second operation, the capturing process is stopped, the images obtained by the capturing are deleted, and the at least two original images selected by the user are taken as the at least two original images obtained.

[0075] Optionally, the original image sending module 320 is further configured to:

[0076] The at least two original images carrying the algorithm identifier are sent to the server, so that the server calls the target fusion algorithm according to the algorithm identifier to perform fusion processing on the at least two original images by using the target fusion algorithm.

[0077] Optionally, the method further includes a second target image obtaining module configured to:

[0078] The local set algorithm is called to process any one of the at least two original images to obtain a second target image; wherein the local set algorithm corresponds to the target fusion algorithm.

[0079] Optionally, the method further includes a second target image displaying module configured to:

[0080] If the first target image returned by the server is not received, the second target image is displayed on the current picture.

[0081] Optionally, the method further includes an original image displaying module configured to:

[0082] The at least two original images correspond to respective playing animations;

[0083] The at least two original images are displayed on the current picture according to the playing animations.

[0084] Optionally, the original image displaying module is further configured to:

[0085] The at least two original images are displayed on the current picture according to the motion information and the display information; wherein the motion information includes position information and rotation information, and the display information includes size information and transparency information.

[0086] Optionally, the original image display module is further configured to:

[0087] acquire the set material;

[0088] display the at least two original images in the current picture according to a first transparency, and display the set material in the current picture according to a second transparency, wherein the first transparency is greater than the second transparency.

[0089] Optionally, the apparatus further comprises a set information display module configured to:

[0090] If the first target image returned by the server is not received, the set information is displayed in the current picture.

[0091] The image processing apparatus provided by the embodiments of the present disclosure can execute the image processing method provided by any of the embodiments of the present disclosure, and has the corresponding function modules and beneficial effects of the execution method.

[0092] It should be noted that each unit and module included in the apparatus is only divided according to the function logic, and is not limited to the above division, as long as the corresponding function can be implemented; in addition, the specific name of each functional unit is only for convenient mutual distinction, and is not used to limit the protection scope of the embodiments of the present disclosure.

[0093] Figure 4 A structural schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown in FIG. 5. Hereinafter, the structural schematic diagram of the electronic device (for example, a terminal device or a server) 500 suitable for implementing the embodiments of the present disclosure is shown in FIG. 5. Figure 4 Figure 4 The terminal device in the embodiments of the present disclosure can include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet Personal Computer), a PMP (Portable Multimedia Player), a vehicle-mounted terminal (for example, a vehicle-mounted navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. Figure 4 The electronic device shown is only an example, and should not bring any limitation to the functions and use range of the embodiments of the present disclosure.

[0094] As shown in FIG. 5, the electronic device 500 can include a bus 510, a processor 520, a memory 530, an input device 550, an output device 560, and a communication device 570. Figure 4 ​As shown, the electronic device 500 can include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501 that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 502 or loaded into a random access memory (RAM) 503 from a storage device 508. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0095] Generally, the following devices can be connected to the I / O interface 505: input devices 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 508 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 509. The communication devices 509 can allow the electronic device 500 to communicate wirelessly or wired with other devices to exchange data. Although Figure 4 The electronic device 500 is shown with various devices, but it should be understood that not all of the shown devices are required to be implemented or possessed. More or fewer devices can alternatively be implemented or possessed.

[0096] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 509, or installed from the storage devices 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the methods of embodiments of the present disclosure are performed.

[0097] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0098] The electronic device provided by the embodiments of the present disclosure and the image processing method provided by the above embodiments belong to the same inventive concept, and the technical details not described in detail in the present embodiments can be referred to the above embodiments, and the present embodiments have the same beneficial effects as the above embodiments.

[0099] The embodiments of the present disclosure provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the image processing method provided by the above embodiments.

[0100] Note that the computer readable medium described above in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination thereof. The computer readable storage medium can be, for example and without limitation, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the foregoing. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In the present disclosure, a computer readable signal medium can include a computer readable program code carried in a baseband or as part of a carrier wave, in which the computer readable program code can be used by or in connection with an instruction execution system, apparatus or device. Such a propagated computer readable signal medium can take many forms, including but not limited to, an electromagnetic signal, an optical signal or any suitable combination of the foregoing. The computer readable signal medium can also be any computer readable medium that can send, propagate or transfer a program for use by or in connection with an instruction execution system, apparatus or device. The program code contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to, wire, cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0101] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0102] The computer readable medium described above can be included in the electronic device; or can exist separately from the electronic device, and can be accessed via the electronic device.

[0103] The computer readable medium described above carries one or more programs, which when executed by the electronic device, cause the electronic device to:

[0104] The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to acquire at least two original images, display the at least two original images on a current screen in a set manner, and send the at least two original images to a server to cause the server to perform fusion processing on the at least two original images, receive a first target image returned by the server, and display the first target image on the current screen, wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images.

[0105] Computer program code for carrying out operations of the present disclosure can be written in any of one or more programming languages or combinations of languages including object or visual programming languages such as Java, Smalltalk, C++ or conventional procedural programming languages such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0106] The flow and block diagrams in the drawings show architectural, functional, and operational architectures of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow and block diagrams can represent a module, a segment, or a portion of code which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0107] The units described in the embodiments of the present disclosure can be implemented in the form of software, or can be implemented in the form of hardware. In some cases, the names of the units do not constitute a limitation on the units themselves. For example, the first acquisition unit can also be described as a unit that acquires at least two Internet protocol addresses.

[0108] The functions described above herein can be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on a chip (SOCs), complex programmable logic devices (CPLDs), etc.

[0109] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0110] According to one or more embodiments of the present disclosure, an image processing method is provided, comprising:

[0111] acquiring at least two original images;

[0112] displaying the at least two original images on a current frame in a set manner, and sending the at least two original images to a server, so that the server performs fusion processing on the at least two original images;

[0113] receiving a first target image returned by the server, and displaying the first target image on the current frame; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images.

[0114] Further, acquiring at least two original images comprises:

[0115] when a first operation triggered by a user is detected, performing continuous frame grabbing processing on the current frame at least twice to obtain at least two original images; and / or,

[0116] When it is detected that the user selects at least two original images from the local and triggers the second operation, the at least two original images selected by the user are taken as the obtained at least two original images.

[0117] Further, the at least two original images are obtained, including:

[0118] In the process of continuously performing the frame grabbing processing on the current picture for at least two times, if it is detected that the user selects at least two original images from the local and triggers the second operation, the frame grabbing processing is stopped, the images obtained by the frame grabbing are deleted, and the at least two original images selected by the user are taken as the obtained at least two original images.

[0119] Further, the at least two original images are sent to the server, so that the server performs fusion processing on the at least two original images, including:

[0120] The at least two original images carrying the algorithm identifier are sent to the server, so that the server calls a target fusion algorithm according to the algorithm identifier, to perform fusion processing on the at least two original images by using the target fusion algorithm.

[0121] Further, after the at least two original images are obtained, further including:

[0122] A local set algorithm is called to process any one of the at least two original images, to obtain a second target image; wherein the local set algorithm corresponds to the target fusion algorithm.

[0123] Further, after the at least two original images are displayed on the current picture in the set manner, further including:

[0124] If the first target image returned by the server is not received, the second target image is displayed on the current picture.

[0125] Further, the at least two original images are displayed on the current picture in the set manner, including:

[0126] The playing animations corresponding to the at least two original images are obtained respectively;

[0127] The at least two original images are displayed on the current picture according to the playing animations.

[0128] Further, the playing animations include motion information and display information of the original images in the picture; the at least two original images are displayed on the current picture according to the playing animations, including:

[0129] display the at least two original images on the current picture according to the motion information and the display information; wherein the motion information comprises position information and rotation information, and the display information comprises size information and transparency information.

[0130] Further, the displaying the at least two original images on the current picture according to the set mode comprises:

[0131] acquiring a set material;

[0132] displaying the at least two original images on the current picture according to a first transparency, and displaying the set material on the current picture according to a second transparency; wherein the first transparency is greater than the second transparency.

[0133] Further, after the displaying the at least two original images on the current picture according to the set mode, the method further comprises:

[0134] if the first target image returned by the server is not received, displaying set information on the current picture.

[0135] The above description is merely preferred embodiments of the present disclosure and a description of the principles of the technology employed. Those skilled in the art should understand that the disclosed scope of the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and should also cover other technical solutions formed by any combinations of the above technical features or equivalent features thereof without departing from the above disclosed concept. For example, the above features can be replaced with other technical features disclosed in the present disclosure (but not limited to) having similar functions to form technical solutions.

[0136] In addition, although each operation is depicted in a particular order, this should not be understood as requiring the operations to be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing can be advantageous. Likewise, although specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be combined in a single embodiment. Conversely, various features described in the context of a single embodiment can also be separated and implemented in multiple embodiments.

[0137] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. An image processing method, characterized by, The method comprises the following steps: acquiring at least two original images; displaying the at least two original images on a current screen in a set manner, and sending the at least two original images to a server, so that the server performs fusion processing on the at least two original images; receiving a first target image returned by the server, and displaying the first target image on the current screen; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images; sending the at least two original images to the server, so that the server performs fusion processing on the at least two original images, comprising: sending the at least two original images carrying an algorithm identifier to the server, so that the server calls a target fusion algorithm according to the algorithm identifier, to perform fusion processing on the at least two original images by using the target fusion algorithm, wherein the target fusion algorithm at least comprises: fusing at least two original images of different stylizations into a new stylized image.

2. The method of claim 1, wherein, The method of acquiring at least two original images comprises: when detecting a first operation triggered by a user, performing continuous frame grabbing processing on a current screen at least twice, to obtain at least two original images; and / or, when detecting that the user selects at least two original images from a local and triggers a second operation, taking the at least two original images selected by the user as the at least two original images obtained.

3. The method of claim 2, wherein, The method of acquiring at least two original images comprises: in the process of performing continuous frame grabbing processing on a current screen at least twice, if it is detected that a user selects at least two original images from a local and triggers a second operation, stopping the frame grabbing processing, deleting the images obtained by the frame grabbing, and taking the at least two original images selected by the user as the at least two original images obtained.

4. The method of claim 1, wherein, The method further comprises the following steps: calling a locally set algorithm to process any one of the at least two original images, to obtain a second target image; wherein the locally set algorithm corresponds to the target fusion algorithm.

5. The method of claim 4, wherein, The method further comprises the following steps: if the first target image returned by the server is not received, displaying the second target image on the current screen.

6. The method of claim 1, wherein, The method of displaying the at least two original images on a current screen in a set manner comprises: acquiring a playing animation corresponding to each of the at least two original images; displaying the at least two original images on the current screen according to the playing animation.

7. The method of claim 6, wherein, The playing animation comprises motion information and display information of the original images in the screen. The method of displaying the at least two original images on a current screen according to the playing animation comprises: displaying the at least two original images on the current screen according to the motion information and the display information; wherein the motion information comprises position information and rotation information, and the display information comprises size information and transparency information.

8. The method of claim 1, wherein, The method of displaying the at least two original images on a current screen in a set manner comprises: acquiring a set material; The at least two original images are displayed in the current picture according to a first transparency, and the setting material is displayed in the current picture according to a second transparency; wherein the first transparency is greater than the second transparency.

9. The method of claim 1, wherein, After the at least two original images are displayed in the current picture according to the setting mode, the method further comprises: If the first target image returned by the server is not received, the setting information is displayed in the current picture.

10. An image processing apparatus characterized by comprising: The method comprises: An original image acquisition module is configured to acquire at least two original images; An original image sending module is configured to display the at least two original images in the current picture according to a setting mode, and send the at least two original images to a server, so that the server performs fusion processing on the at least two original images; A first target image display module is configured to receive a first target image returned by the server, and display the first target image in the current picture; wherein the first target image is an image obtained by the server performing fusion processing on the at least two original images; The original image sending module is further configured to send the at least two original images carrying an algorithm identifier to the server, so that the server calls a target fusion algorithm according to the algorithm identifier, and performs fusion processing on the at least two original images by using the target fusion algorithm, wherein the target fusion algorithm at least comprises: fusing at least two original images of different styles into a new stylized image.

11. An electronic device, comprising: The electronic device comprises: One or more processors; A storage device configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the image processing method as claimed in any one of claims 1-9.

12. A storage medium containing computer executable instructions for performing the image processing method as claimed in any one of claims 1-9 when executed by a computer processor.

Citation Information

Patent Citations

  • Method and apparatus for intercepting video clip

    CN107295416A

  • Screenshot method and mobile terminal

    CN110062273A

  • Face recognition method and system based on AR glasses

    CN111783674A

  • Image processing method, device and equipment and computer readable storage medium

    CN112116684A