Image special effect setting method, image identification method, device, and electronic device

Abstract

The present disclosure provides a method for setting special image effects, a method for identifying images, and an apparatus for identifying images, related to the field of information processing technology. The method for setting special image effects includes a step of acquiring an image element (S101), a step of acquiring a target multimedia resource corresponding to the image element in response to a special effect setting operation for the image element (S102), and a step of associating the image element with the target multimedia resource and storing the result in a special effect setting file (S103). The special effect setting file is used to set the special effect on an original image, so that the target multimedia resource is played when the image element appears in the original image. A user can customize the image element and set the corresponding target multimedia resource, and when an image element is identified, the corresponding target multimedia resource is played, thereby making the setting of image special effects more flexible. [Drawing] Figure 1

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority from Chinese Patent Application No. 202010388454.6 filed on May 9, 2020, the entire contents of which are incorporated herein by reference.

[0002] [Technical field] The present disclosure relates to the technical field of information processing, and more particularly to a method for setting special image effects, an image identification method, an apparatus, and an electronic device. [Background technology]

[0003] With the development of computer technology and mobile communication technology, smart devices have become widely used. Users can use smart devices to obtain various information, take photos and videos, and share them with friends on social platforms. To enhance the playback experience of images and videos, users often add various special effects to the images and videos.

[0004] In the prior art, some applications trigger corresponding special effects by identifying specific image elements, such as facial expressions or gestures. Summary of the Invention

[0005] In the first aspect, obtaining an image element; Obtaining a target multimedia resource corresponding to the image element in response to a setting operation of a special effect on the image element; and storing the image element in a special effect setting file associated with the target multimedia resource; The special effect setting file is used to set the special effect on the original image, thereby providing a method for setting an image special effect, which reproduces the target multimedia resource when an image element appears on the original image.

[0006] In a second aspect, performing a classification process on the original image in response to an image classification trigger operation; and when an image element is identified in the original image, obtaining and playing a target multimedia resource corresponding to the image element; An image identification method is provided, in which the target multimedia resource is set using the image special effect setting method set forth in the first aspect of the present disclosure.

[0007] In a third aspect, a first acquisition module configured to acquire image elements; a first receiving module configured to acquire a target multimedia resource corresponding to the image element in response to a setting operation of a special effect on the image element; a first association module configured to associate the image element with the target multimedia resource and store the association in a special effect setting file; The special effect setting file is used to set the special effect on the original image, thereby providing an image special effect setting device that plays the target multimedia resource when the image element appears in the original image.

[0008] In a fourth aspect, an identification module configured to perform an identification process on the original image in response to an image identification trigger operation; a playback module configured to, when an image element is identified from the original image, retrieve and play a target multimedia resource corresponding to the image element; A video rendering device is provided, in which the target multimedia resource is set by the image special effect setting method set forth in the first aspect of the present disclosure.

[0009] In a fifth aspect, the present disclosure provides an electronic device, the electronic device comprising: one or more processors; Memory and and one or more applications stored in the memory and configured to be executed by one or more processors, the one or more applications configured to perform operations corresponding to the image special effect setting method set forth in the first aspect of the present disclosure or the image identification method set forth in the second aspect of the present disclosure.

[0010] In a sixth aspect, the present disclosure provides a computer-readable medium for storing computer instructions which, when executed on a computer, cause the computer to perform the method for setting image special effects set forth in the first aspect or the image identification method set forth in the second aspect of the present disclosure.

[0011] In order to describe the technical solutions in the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings used to describe the embodiments of the present disclosure. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a flowchart of a method for setting image special effects provided in an embodiment of the present disclosure. [Figure 2] 1 is a flowchart of an image identification method provided in an embodiment of the present disclosure. [Figure 3] 1 is a schematic structural diagram of an image special effect setting device provided in an embodiment of the present disclosure; [Figure 4] FIG. 1 is a schematic structural diagram of an image identification device provided in an embodiment of the present disclosure. [Figure 5] 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure; DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although specific embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments described herein, but rather these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0014] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in a different order and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the performance of illustrated steps. The scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "comprises" and variations thereof are open-ended inclusions, i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided in the description below.

[0016] It should be noted that concepts such as "first" and "second" referred to in this disclosure are used only to distinguish between devices, modules, or units, and are not intended to limit the devices, modules, or units to necessarily be different devices, modules, or units, nor are they intended to limit the order or interdependence of functions performed by these devices, modules, or units.

[0017] The modifications "a" and "multiple" referred to in this disclosure are exemplary rather than limiting, and one of ordinary skill in the art should understand them as "one or more" unless the context clearly dictates otherwise.

[0018] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0019] Usually, the special effect setting method requires the developer to develop a specific image recognition algorithm for a specific image element, which is inconvenient for the special effect designer to use.

[0020] Therefore, the present disclosure provides a method for setting image special effects, an image identification method, an apparatus, and an electronic device to solve the problems existing in the prior art.

[0021] The beneficial effects brought about by the technical solutions provided in the present disclosure are as follows: In the embodiments of the present disclosure, an image special effect setting method, an image identification method, and an image identification device are provided, which include: acquiring an image element; acquiring a target multimedia resource corresponding to the image element in response to a special effect setting operation for the image element; associating the image element with the target multimedia resource and storing the special effect setting file; and using the special effect setting file to set the special effect for the original image, thereby playing the target multimedia resource when the image element appears in the original image. In the present disclosure, a user can customize an image element and set the corresponding target multimedia resource; and when the image element is identified, the corresponding target multimedia resource is played, thereby making the setting of image special effects more flexible.

[0022] The technical solution of the present disclosure and how it solves the above-mentioned technical problems will be described in detail below with specific examples. Some of the following specific examples can be combined with each other, and some examples may not repeat the same or similar concepts or processes. Hereinafter, the embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0023] The image special effect setting method disclosed herein may specifically be a visualized image special effect setting tool. Based on this method, a designer of the image special effect setting file can generate an image special effect setting file through the image special effect setting tool. The image special effect setting file can set corresponding target multimedia resources for image elements in an original image. After a user identifies the image elements through a terminal device, the pre-set target multimedia resources are played.

[0024] FIG. 1 is a flowchart of a method for setting image special effects provided in an embodiment of the present disclosure. As shown in FIG. 1, the method may include the following steps: In step S101, an image element is obtained.

[0025] The subject of the present disclosure may be a terminal device such as a computer or a mobile phone. The image element may be any element within the original image selected by a user (the designer of the image special effect setting file), and specifically may include an image of a partial or entire area of ​​the original image. For example, if the original image includes a person, the person may be an image element.

[0026] Specific methods for acquiring image elements include directly receiving image elements introduced by a user, or receiving an original image introduced by a user and determining image elements according to an area selected by the user on the original image. After the image elements are acquired, they can be shown to the user, and the user can set the corresponding target multimedia resource according to the shown image elements.

[0027] In step S102, in response to a setting operation of a special effect for an image element, a target multimedia resource corresponding to the image element is obtained.

[0028] For example, in some instances, a user may perform a special effect setting operation on an image element. After obtaining the image element, the user may set a target multimedia resource corresponding to the image element through the special effect setting operation. The target multimedia resource is a file that is triggered to play after the image element is identified.

[0029] The content of the target multimedia resource may or may not be related to the content of the image element, and the format of the target multimedia resource may include multiple formats and is not limited by this disclosure.

[0030] Furthermore, the target multimedia resource may be one or at least two files. If the target multimedia resource is at least two files, the playback order of the at least two target multimedia resources corresponding to the image elements can be determined according to the user's playback order setting operation. After the image elements are identified, the target multimedia resources can be played in sequence according to the playback order.

[0031] In step S103, the image element is associated with the target multimedia resource and stored in the special effect setting file.

[0032] The special effect setting file is used to perform special effect settings on the original image, so that the target multimedia resource is played when the image element appears in the original image.

[0033] After the target multimedia resource corresponding to the image element of the original image is set, an association relationship between the image element and the corresponding target multimedia resource is established and stored in association with the image special effect setting file. After the user identifies the image element of the original image through the terminal device, he plays the target multimedia resource stored in association with the image element.

[0034] For specific methods of obtaining target multimedia resources in the present disclosure, please refer to the following examples.

[0035] The target multimedia resources in the technical solutions of the present disclosure can be directly called from the database.

[0036] In one possible implementation method, the step of obtaining a target multimedia resource corresponding to an image element includes: presenting the list of multimedia resources in response to a trigger operation on the list of multimedia resources; In response to a selection operation on a multimedia resource in the list of multimedia resources, the selected multimedia resource is designated as the target multimedia resource.

[0037] During actual use, according to the user's selection operation, at least one of images, videos, and audio can be directly selected as the target multimedia resource from the list of multimedia resources in the database, and the target multimedia resource can be directly called, which is more convenient for use.

[0038] For example, in some instances, a trigger operation on a list of multimedia resources and a selection operation on a multimedia resource within the list of multimedia resources are performed by a user.

[0039] In a possible implementation, the method comprises: obtaining a display area of ​​an image element; determining a display area of ​​the target multimedia resource based on the display area of ​​the image element; and storing the display area of ​​the target multimedia resource in association with the target multimedia resource in a special effect setting file.

[0040] During actual use, the display area of ​​the target multimedia resource can be determined based on the display area of ​​the image element. For example, the target multimedia resource may include a video containing multiple frame images. When a user-introduced image element is received, display area information of the image element, including the display position and size of the image element in the current interface, is obtained. After the user introduces each frame image of the video, the display position of each frame image can be determined based on the display position of the image element and the amount of positional change between the image element and the image of each frame. The amount of positional change between the image element and the image of each frame is determined based on the received user operation. The size of each frame image is determined based on the size of the image element, and the display area of ​​each frame image is determined based on the display position and size of each frame image. The display area of ​​each frame image is associated with the video and stored in a special effect setting file.

[0041] In the present disclosure, the display area of ​​the target multimedia resource is determined based on the display area of ​​the image element, so that the image element and the multimedia resource have a relative relationship in terms of position and size. When the image element is identified, a video is played in the display area stored in the special effect setting file, showing the effect of changing from a still image to a dynamic video.

[0042] In one example, the image element is a person image, the target multimedia resource is a video (image), and the video shows a dynamic person image. The display position of the image for each frame is determined according to the display position of the person image, and the size of the image for each frame is determined according to the size of the person image. The display position and size of the image for each frame are associated with the video and stored in a display effect setting file. When the video is played, the static person can be displayed at the original display position, and the dynamically changing effect can be displayed at the same size.

[0043] How to play the target multimedia resource in the present disclosure can also be set according to a user customization method, as detailed in the following examples.

[0044] In a possible implementation, the method comprises: In response to a playback setting operation of the multimedia resource, determining playback information corresponding to the target multimedia resource based on the playback setting operation; and associating the playback information with the target multimedia resource and storing it in a special effect setting file; The playback information includes at least one of loop playback, playback time, and playback count.

[0045] For example, in some instances, a playback setting operation for a multimedia resource is performed by a user.

[0046] During actual use, the playback information of the multimedia resource can be determined according to the user's playback setting operation, the multimedia resource can be played in a circular manner multiple times, the multimedia resource can be played according to the playback time set by the user, and the multimedia resource can be played a corresponding number of times according to the playback number set by the user, and the playback information is associated with the multimedia resource and stored in a special effect setting file.The image special effect setting file of the present disclosure is used to set a target multimedia resource corresponding to an image element, and when the image element is identified to trigger the playback of a video, the multimedia resource can be played according to the user's playback setting operation, making the playback of multimedia resources more flexible and meeting various needs of users.

[0047] In the present disclosure, in addition to directly receiving the target multimedia resource selected by the user, the target multimedia resource can also be generated, as detailed in the following examples.

[0048] In one possible implementation, the step of obtaining a target multimedia resource corresponding to an image element includes: The method includes generating a corresponding target multimedia resource based on the image element.

[0049] In actual use, a corresponding target multimedia resource can be generated based on the content of the image element. The content of the target multimedia resource includes the content of the image element, and the content can be added, deleted, or modified based on the image element to obtain a target multimedia resource corresponding to the image element. In the present disclosure, the target multimedia resource can be generated based on the image element, and the content of the target multimedia resource and the content of the image element are correlated. The target multimedia resource can be configured using the image special effect setting file in the present disclosure, and the user's need to trigger the playback of the target multimedia resource related to the content after the image element is identified can be met.

[0050] The target multimedia resources generated based on the image elements can include a variety of formats, as detailed in the examples below.

[0051] In one possible implementation, the step of generating a target multimedia resource based on the image element comprises: obtaining a special effect element; adding the special effect element to an image element; and generating a target multimedia resource; The special effect elements include at least one of text, images, makeup effects, filters, and audio.

[0052] During actual use, the special effect element can be acquired and added to the image element to generate a target multimedia resource. As a selection, a special effect element list is displayed in response to a user's selection operation of a special effect element list. When the user selects a special effect element from the special effect element list, the selected special effect element is added to the image element to generate a target multimedia resource corresponding to the image element. The image special effect setting file of the present disclosure can be used to set the target multimedia resource, and when the image element is identified, the target multimedia resource including the special effect element can be triggered.

[0053] The special effect elements may include at least one of text, video or still images, makeup effects, filters, audio, etc. The special effect elements may be obtained from a local special effect element library or a cloud special effect element library. Text, images, etc. may be added to the image elements, various styles of makeup effects (e.g., light makeup, heavy makeup, etc.) may be added to people in the image, and various styles of filters may be set, such as natural, whitening, nostalgic, black and white, and retro. The special effect elements are added to the image elements to generate target multimedia resources corresponding to the image elements. The configuration file for the image special effects in the present disclosure can be used to configure the target multimedia resources, identify the image elements, and trigger the target multimedia resources containing the special effect elements.

[0054] In one possible implementation, the step of associating the image element with the target multimedia resource and storing the image element in the special effect setting file comprises: generating an image identification model based on the image element to identify whether the image element appears in the original image; and associating the image identification model with the target multimedia resource and storing it in a special effects setting file.

[0055] During actual use, the features of the image elements are extracted, an image identification model corresponding to the image elements is generated based on the features of the image elements, and the image identification model is associated with the target multimedia resource and stored in the setting file of the image special effect to identify whether the identified image element appears in the original image. The image identification model in the present disclosure is an identification model determined for a small number of images related to the features of the image elements. Unlike the prior art, which requires a large number of training samples to develop a specific image identification algorithm for a specific image element, the present disclosure determines an image identification model based on user-customized image elements and sets the target multimedia resource corresponding to the image element of the original image, allowing for more flexible use.

[0056] In the method for setting image special effects provided in the embodiments of the present disclosure, an image element is obtained, and in response to the operation of setting a special effect on the image element, a target multimedia resource corresponding to the image element is obtained, the image element is associated with the target multimedia resource and stored in a special effect setting file, the special effect setting file performs the setting of the special effect on the original image, and when the image element appears in the original image, the target multimedia resource is played. In the present disclosure, a user can customize an image element and set the corresponding target multimedia resource, and when the image element is identified, the corresponding target multimedia resource is played, thereby making the setting of image special effects more flexible.

[0057] The setting file of the image special effect of the present disclosure can set a target multimedia resource corresponding to the image element of the original image, and after the user identifies the image element in the original image through the terminal device, the pre-set target multimedia resource is played. The process from image identification to triggering the playback of the multimedia resource is specifically demonstrated in the following example.

[0058] FIG. 2 is a flowchart of an image identification method provided in an embodiment of the present disclosure. As shown in FIG. 2, the method includes the following steps: In step S201, in response to an image recognition trigger operation, a recognition process is performed on the original image.

[0059] The image identification trigger operation may be an operation in which a user turns on the camera of the terminal device, and after the camera is turned on, the image identification model is used to identify the original image within the camera's shooting range.

[0060] In step S202, when an image element is identified in the original image, the target multimedia resource corresponding to the image element is obtained and played.

[0061] The target multimedia resource is set by the image special effect setting method provided in the embodiment of the present disclosure.

[0062] When it is identified by the image identification model that an image element is included in the original image, a target multimedia resource corresponding to the image element is obtained from the special effect setting file, and the target multimedia resource is played back based on the playback information corresponding to the target multimedia resource.

[0063] From identifying the image element to triggering the playback of the target multimedia resource, this can be done with the rendering link list. The image element and the associated target multimedia resource are rendered and displayed in order as each node of the rendering link list.

[0064] The image identification method provided in the embodiment of the present disclosure performs an identification process on an original image in response to an image identification trigger operation, and when an image element is identified from the original image, obtains and plays a target multimedia resource corresponding to the image element. The target multimedia resource is set by the image special effect setting method provided in the embodiment of the present disclosure. In the embodiment of the present disclosure, an identification process can be performed on an image element of the original image to trigger the playback of the corresponding target multimedia resource, which is easy to operate and use.

[0065] For example, in some instances, the image identification trigger action described above is performed by a user.

[0066] Based on the same principle as the method shown in FIG. 1 , the embodiment of the present disclosure further provides a picture special effect setting device 30 as shown in FIG. 3 , which includes: a first acquisition module 31 configured to acquire image elements; a first receiving module 32 configured to acquire a target multimedia resource corresponding to the image element in response to a setting operation of a special effect on the image element; a first association module 33 configured to associate the image element with the target multimedia resource and store it in a special effect setting file; The special effect setting file is used to perform special effect settings on the original image, so that the target multimedia resource is played when the image element appears in the original image.

[0067] In a possible implementation, the first receiving module 32 comprises: presenting the list of multimedia resources in response to a trigger operation on the list of multimedia resources; In response to a selection operation on a multimedia resource in the multimedia resource list, the selected multimedia resource is configured to be the target multimedia resource.

[0068] In a possible implementation method, the image special effect setting device 30 includes: a second acquisition module configured to acquire a display area of ​​the image element; a first determination module configured to determine a display area of ​​the target multimedia resource based on a display area of ​​the image element; and a second association module configured to store the display area of ​​the target multimedia resource in association with the target multimedia resource in the special effect setting file.

[0069] In a possible implementation method, the image special effect setting device 30 includes: a second determination module configured to, in response to the playback setting operation of the multimedia resource, determine playback information corresponding to the target multimedia resource based on the playback setting operation; a third association module configured to associate the playback information with the target multimedia resource and store the association information in the special effect setting file; The playback information includes at least one of loop playback, playback time, and playback count.

[0070] In a possible implementation method, when obtaining a target multimedia resource corresponding to an image element, the first receiving module 32: It is configured to generate a target multimedia resource corresponding to the image element based on the image element.

[0071] In a possible implementation method, when generating a target multimedia resource corresponding to the image element based on the image element, the first receiving module 32: The special effect element is configured to obtain and add the special effect element to the image element, and generate a target multimedia resource corresponding to the image element. The special effect elements include at least one of text, images, makeup effects, filters, and audio.

[0072] In a possible implementation, the first association module 33 generating an image identification model based on the image element for identifying whether the image element appears in the original image; The image identification model is configured to be associated with the target multimedia resource and stored in a special effects setting file.

[0073] The image special effect setting device in the embodiments of the present disclosure can implement the image special effect setting method provided in the embodiments of the present disclosure, and the implementation principles are similar, and the operations performed by each module in the image special effect setting device according to each embodiment of the present disclosure correspond to the steps of the image special effect setting method in each embodiment of the present disclosure. For a detailed description of the functions of each module of the image special effect setting device, please refer to the description of the corresponding image special effect setting method above, which will not be repeated here.

[0074] In an embodiment of the present disclosure, an image special effect setting device is provided, which acquires an image element, and in response to a special effect setting operation for the image element, acquires a target multimedia resource corresponding to the image element, associates the image element with the target multimedia resource and stores it in a special effect setting file, and uses the special effect setting file to set the special effect for the original image, thereby playing the target multimedia resource when the image element appears in the original image. In the present disclosure, a user can customize an image element and set the corresponding target multimedia resource, and when the image element is identified, the corresponding target multimedia resource is played, thereby making the setting of image special effects more flexible.

[0075] Based on the same principle as the method shown in FIG. 2, an embodiment of the present disclosure further provides an image identification device 40, as shown in FIG. 4, the image identification device 40: an identification module 41 configured to perform an identification process on the original image in response to an image identification trigger operation; and a playback module 42 configured to retrieve and play target multimedia resources corresponding to the image elements once the image elements are identified from the original image.

[0076] The target multimedia resource is set by the image special effect setting method provided in the embodiment of the present disclosure.

[0077] The image identification device in the embodiments of the present disclosure can implement the image identification method provided in the embodiments of the present disclosure, and the implementation principles are similar. The operations performed by each module of the image identification device in each embodiment of the present disclosure correspond to the steps of the image identification method in each embodiment of the present disclosure. For detailed functional descriptions of each module of the image identification device, please refer to the descriptions of the corresponding image identification method above, and they will not be repeated here.

[0078] The image identification device provided in the embodiments of the present disclosure can trigger the playback of the corresponding target multimedia resource by performing an identification process on the image elements of the original image, and is easy to operate and use.

[0079] Referring now to Figure 5, a schematic structural diagram of an electronic device 600 suitable for implementing the embodiments of the present disclosure is shown. Implementation entities of the technical solutions of the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as stationary terminals such as digital televisions and desktop computers. The electronic device shown in Figure 5 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0080] The electronic device includes a memory and a processor, where the processor is hereinafter referred to as a processing unit 601, and the memory can include at least one of a read-only memory (ROM) 602, a random access memory (RAM) 603, and a storage device 608, specifically as follows: 5, electronic device 600 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 601 that can execute various appropriate operations and processes according to programs stored in ROM (read-only memory) 602 or programs loaded from storage device 608 into RAM (random access memory) 603. RAM 603 also stores various programs and data necessary for the operation of electronic device 600. Processing unit 601, ROM 602, and RAM 603 are connected to one another by bus 604. I / O (input / output) interface 605 is also connected to bus 604.

[0081] Typically, input devices 606 including a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 607 including a liquid crystal display (LCD), speaker, vibrator, etc., storage devices 608 including magnetic tape, hard disk, etc., and communication devices 609 may be connected to the I / O interface 605. The communication devices 609 may enable the electronic device 600 to communicate and exchange data with other devices wirelessly or via wires. While FIG. 5 illustrates the electronic device 600 with a variety of devices, it should be understood that not all of the illustrated devices need be implemented or provided. Instead, more or fewer devices may be implemented or provided.

[0082] In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program embodied in a non-transitory computer-readable medium, the computer program including program code for performing the methods shown in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, or may be installed from the storage device 608 or the ROM 602. When the computer program is executed by the processing device 601, the functions defined in the methods of the embodiments of the present disclosure are performed.

[0083] It should be noted that the computer-readable medium described above in this disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer-readable storage media include, but are not limited to, an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program can be used by or in conjunction with an instruction execution system, apparatus, or device. However, in this disclosure, a computer-readable signal medium may include a data signal, either in baseband or propagated as part of a carrier wave, in which computer-readable program code is embodied. Such propagated data signals may take various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may be any computer-readable medium, other than a computer-readable storage medium, that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied in a computer-readable medium may be transmitted using any suitable medium, including, but not limited to, electrical wire, fiber optic cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0084] In some embodiments, clients and servers may communicate using any now known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks) and networks now known or later developed.

[0085] The computer-readable medium may be incorporated in the electronic device, or may exist independently of the electronic device.

[0086] The computer-readable medium has one or more programs embodied therein, and when the one or more programs are executed by the electronic device, the electronic device acquires an image element, and in response to a special effect setting operation for the image element, acquires a target multimedia resource corresponding to the image element, associates the image element with the target multimedia resource, stores the special effect setting file, and uses the special effect setting file to perform special effect setting on the original image, thereby playing the target multimedia resource when the image element appears in the original image; or, in response to an image identification trigger operation, performs an identification process on the original image, and when an image element is identified from the original image, acquires and plays a target multimedia resource corresponding to the image element, and the target multimedia resource is set by the image special effect setting method provided in the embodiments of the present disclosure.

[0087] Computer program code for carrying out operations of the present disclosure can be written in one or more programming languages, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., including conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can run entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet by an Internet Service Provider).

[0088] The flowcharts and block diagrams in the figures illustrate possible implementation architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, including one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than described in the figures. For example, two blocks shown in succession may actually be executed substantially simultaneously or in the reverse order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified functions or operations, or in a combination of dedicated hardware and computer instructions.

[0089] The modules or units related to the embodiments of the present disclosure may be implemented in software or hardware, and the names of the modules or units do not impose limitations on the units themselves under certain circumstances.

[0090] The functions described herein may be performed, at least in part, by one or more hardware logic components. For example, typical types of hardware logic components that may be used include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0091] In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include one or more wire-based electrical connections, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0092] According to one or more embodiments of the present disclosure, obtaining an image element; acquiring a target multimedia resource corresponding to the image element in response to a special effect setting operation for the image element; and storing the image element in a special effect setting file in association with the target multimedia resource.

[0093] The special effect setting file is used to perform special effect settings on the original image, so that the target multimedia resource is played when the image elements appear in the original image.

[0094] In a possible implementation, the step of obtaining a target multimedia resource corresponding to the image element comprises: presenting the list of multimedia resources in response to a trigger operation on the list of multimedia resources; In response to a selection operation on a multimedia resource in the list of multimedia resources, the selected multimedia resource is designated as the target multimedia resource.

[0095] In a possible implementation, the method comprises: obtaining a display area of ​​the image element; determining a display area of ​​the target multimedia resource based on a display area of ​​the image element; and storing the display area of ​​the target multimedia resource in a special effect setting file in association with the target multimedia resource.

[0096] In a possible implementation, the method comprises: In response to a playback setting operation of the multimedia resource, determining playback information corresponding to the target multimedia resource based on the playback setting operation; and storing the playback information in the special effect setting file in association with the target multimedia resource.

[0097] The playback information includes at least one of loop playback, playback time, and playback count.

[0098] In a possible implementation method, the step of obtaining a target multimedia resource corresponding to the image element includes: generating the target multimedia resource based on the image elements;

[0099] In a possible implementation method, the step of generating the target multimedia resource based on the image element comprises: The method includes the steps of obtaining a special effect element, adding the special effect element to the image element, and generating the target multimedia resource.

[0100] The special effect elements include at least one of text, images, makeup effects, filters, and audio.

[0101] In a possible implementation method, the step of associating the image element with the target multimedia resource and storing it in a special effect setting file comprises: generating an image identification model based on the image element to identify whether the image element appears in the original image; and associating the image identification model with the target multimedia resource and storing it in a special effects setting file.

[0102] According to one or more embodiments of the present disclosure, a method includes: performing a classification process on an original image in response to an image classification trigger operation; and once an image element is identified in the original image, obtaining and playing a target multimedia resource corresponding to the image element; The target multimedia resource is set using the image special effect setting method provided in the embodiment of the present disclosure.

[0103] According to one or more embodiments of the present disclosure, a first acquisition module configured to acquire image elements; a first receiving module configured to acquire a target multimedia resource corresponding to the image element in response to a setting operation of a special effect of the image element; a first associating module configured to associate the image element with the target multimedia resource and store the association in a special effect setting file.

[0104] The special effect setting file is used to perform special effect settings on the original image, so that the target multimedia resource is played when the image elements appear in the original image.

[0105] In a possible implementation, the first receiving module comprises: presenting the list of multimedia resources in response to a trigger operation on the list of multimedia resources; In response to a selection operation on a multimedia resource in the list of multimedia resources, the selected multimedia resource is configured to be the target multimedia resource.

[0106] In a possible implementation, the image special effect setting device comprises: a second acquisition module configured to acquire a display area of ​​the image element; a first determination module configured to determine a display area of ​​the target multimedia resource based on a display area of ​​the image element; and a second association module configured to associate a display area of ​​the target multimedia resource with the target multimedia resource and store the association in the special effect setting file.

[0107] In a possible implementation, the image special effect setting device comprises: a second determination module configured to, in response to a playback setting operation of the multimedia resource, determine playback information corresponding to the target multimedia resource based on the playback setting operation; and a third association module configured to associate the playback information with the target multimedia resource and store the association information in the special effect setting file.

[0108] The playback information includes at least one of loop playback, playback time, and playback count.

[0109] In a possible implementation, the first receiving module is configured, when receiving a target multimedia resource corresponding to an image element, to generate the target multimedia resource based on the image element.

[0110] In a possible implementation form, the first receiving module is configured to, when generating a target multimedia resource corresponding to an image element based on the image element, obtain a special effect element, add the special effect element to the image element, and generate the target multimedia resource.

[0111] The special effect elements include at least one of text, images, makeup effects, filters, and audio.

[0112] In a possible implementation, the first association module: generating an image identification model based on the image element for identifying whether the image element appears in the original image; The image identification model is configured to be associated with the target multimedia resource and stored in a special effects settings file.

[0113] According to one or more embodiments of the present disclosure, an identification module configured to perform an identification process on the original image in response to an image identification trigger operation; and a playback module configured to, when an image element is identified from the original image, retrieve and play a target multimedia resource corresponding to the image element.

[0114] The target multimedia resource is set by the image special effect setting method provided in the embodiment of the present disclosure.

[0115] In some examples of the present disclosure, operations such as setting special effects of the image elements, triggering a multimedia resource list, selecting a multimedia resource in the multimedia resource list, and setting the playback of the multimedia resource can be performed by a user.

[0116] According to one or more embodiments of the present disclosure, an electronic device is provided, the electronic device comprising: one or more processors; Memory and and one or more computer programs stored in the memory and configured to be executed by the one or more processors, the one or more computer programs configured to perform operations corresponding to the image special effect setting method or image identification method provided in the embodiments of the present disclosure.

[0117] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable medium for storing computer instructions that, when executed on a computer, enable the computer to perform the image special effect setting method or image identification method provided in the embodiments of the present disclosure.

[0118] The above description is merely a description of the preferred embodiments of the present disclosure and the technical principles adopted. Those skilled in the art will understand that the scope of disclosure contained in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalents without departing from the above disclosed concept. For example, it should cover technical solutions formed by replacing the above features with (but not limited to) technical features disclosed in the present disclosure that have similar functions.

[0119] Additionally, while operations are shown in a particular order, this should not be construed as requiring these operations to be performed in the particular order or sequential order shown. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, while the above description includes some implementation-specific details, these should not be construed as limitations on the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable combination.

[0120] Although the subject matter has been described in language specific to structural features and / or logical acts of a method, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. Acquiring image elements by directly receiving image elements introduced by a user or by receiving an original image introduced by a user and determining image elements according to an area selected by the user on the original image; acquiring a target multimedia resource corresponding to the image element in response to a special effect setting operation for the image element; and associating the image element with the target multimedia resource and storing it in a special effect setting file; The special effect setting file is used to set a special effect on an original image, thereby playing the target multimedia resource when the image element appears in the original image; The image element has an image of a part of an area of ​​the original image or an image of the entire area of ​​the original image, The method comprises: In response to a playback setting operation on the target multimedia resource, determining playback information corresponding to the target multimedia resource based on the playback setting operation; and storing the playback information in the special effect setting file in association with the target multimedia resource; The playback information includes at least one of loop playback, playback time, and playback count.

2. The step of obtaining a target multimedia resource corresponding to the image element includes: presenting the list of multimedia resources in response to a trigger operation on the list of multimedia resources; 2. The method of claim 1, further comprising: in response to a selection operation on a multimedia resource in the list of multimedia resources, designating the selected multimedia resource as the target multimedia resource.

3. obtaining a display area of ​​the image element; determining a display area of ​​the target multimedia resource based on a display area of ​​the image element; 3. The method of claim 1, further comprising the step of: storing a display area of ​​the target multimedia resource in the special effect setting file in association with the target multimedia resource.

4. The step of obtaining a target multimedia resource corresponding to the image element includes: The method of claim 1 , further comprising generating the target multimedia resource based on the image elements.

5. generating the target multimedia resource based on the image elements, obtaining a special effect element, adding the special effect element to the image element, and generating the target multimedia resource; The method of claim 4 , wherein the special effect elements include at least one of text, images, makeup effects, filters, and audio.

6. The step of associating the image element with the target multimedia resource and storing it in a special effect setting file comprises: generating an image identification model based on the image element to identify whether the image element appears in the original image; and storing the image identification model in association with the target multimedia resource in a special effects configuration file.

7. performing a classification process on the original image in response to an image classification trigger operation; If an image element is identified from the original image, obtaining and playing a target multimedia resource corresponding to the image element; The image identification method, wherein the target multimedia resource is set by the image special effect setting method according to any one of claims 1 to 6.

8. A first acquisition module configured to acquire image elements by directly receiving image elements introduced by a user or by receiving an original image introduced by a user and determining image elements according to an area selected by the user for the original image; a first receiving module configured to acquire a target multimedia resource corresponding to the image element in response to a setting operation of a special effect on the image element; a first association module configured to associate the image element with the target multimedia resource and store the association in a special effect setting file; The special effect setting file is used to set a special effect on an original image, thereby playing the target multimedia resource when the image element appears in the original image; The image element has an image of a part of an area of ​​the original image or an image of the entire area of ​​the original image, The image special effect setting device includes: a second determination module configured to, in response to a playback setting operation of the target multimedia resource, determine playback information corresponding to the target multimedia resource based on the playback setting operation; a third association module configured to associate the playback information with the target multimedia resource and store the association information in the special effect setting file; The playback information includes at least one of loop playback, playback time, and number of playbacks.

9. an identification module configured to perform an identification process on the original image in response to an image identification trigger operation; a playback module configured to, when an image element is identified from the original image, retrieve and play a target multimedia resource corresponding to the image element; The image identification device, wherein the target multimedia resource is set by the method for setting an image special effect according to any one of claims 1 to 6.

10. one or more processors; Memory and and one or more computer programs stored in the memory and configured to be executed by one or more processors, the one or more computer programs configured to perform the method for setting special image effects according to any one of claims 1 to 6 or the method for identifying images according to claim 7.

11. A computer-readable medium used to store computer instructions, which, when executed on a computer, enables the computer to perform the method for setting image special effects according to any one of claims 1 to 6 or the method for identifying images according to claim 7.

Images