Expression resource generation method and apparatus, device and storage medium

Abstract

Provided in the embodiments of the present disclosure are an expression resource generation method and apparatus. The method comprises: presenting an image acquisition interface associated with an application; acquiring a reference image via the image acquisition interface; and providing a second expression resource generated on the basis of the reference image and a first expression resource, the first expression resource being associated with the application, the second expression resource comprising a motion associated with a target object in the reference image, and the motion being determined on the basis of the first expression resource. In this way, the embodiments of the present disclosure can generate the second expression resource on the basis of the acquired reference image and the first expression resource, thereby helping a user to better obtain desired information.

Description

A method, apparatus, device, and storage medium for generating facial expression resources. Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to a method, apparatus, device, and computer-readable storage medium for generating facial expression resources. Background Technology

[0002] Social media applications, as a hallmark of the internet age, have transformed the way people communicate and interact in their daily lives. In traditional social interactions, text was the primary means of expression. However, with the development of the internet, emojis (also known as stickers or emoticons) have gradually become an important way for people to express their emotions and thoughts. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for generating facial expression resources is provided. The method includes: presenting an image acquisition interface associated with an application; acquiring a reference image via the image acquisition interface; and providing a second facial expression resource generated based on the reference image and a first facial expression resource associated with the application, wherein the second facial expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first facial expression resource.

[0004] In a second aspect of this disclosure, an apparatus for generating facial expression resources is provided. The apparatus includes: a presentation module configured to present an image acquisition interface associated with an application; an acquisition module configured to acquire a reference image via the image acquisition interface; and a providing module configured to provide a second facial expression resource generated based on the reference image and a first facial expression resource associated with the application, wherein the second facial expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first facial expression resource.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

[0010] Figures 2A to 2F show example interfaces for generating emoji resources according to some embodiments of the present disclosure;

[0011] Figure 3 shows a flowchart of an example process for generating emoji resources according to some disclosed embodiments;

[0012] Figure 4 shows a schematic structural block diagram of an example apparatus for generating facial expression resources according to some embodiments of the present disclosure; and

[0013] Figure 5 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0014] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0015] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0016] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0017] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0018] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0019] As mentioned above, social media applications, as a landmark product of the internet age, have changed the way people communicate and interact in their daily lives. In traditional social interactions, text was the primary tool for expression. However, with the development of the internet, emojis (also known as stickers or emoticons) have gradually become an important way for people to express their emotions and thoughts.

[0020] Embodiments of this disclosure propose a scheme for generating facial expression resources. The scheme includes: presenting an image acquisition interface associated with an application; acquiring a reference image via the image acquisition interface; and providing a second facial expression resource generated based on the reference image and a first facial expression resource associated with the application, wherein the second facial expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first facial expression resource.

[0021] In this way, embodiments of the present disclosure can generate second emoji resources based on the acquired reference images and first emoji resources, thereby helping users to better obtain the desired information.

[0022] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings. Example Environment

[0023] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0024] In this example environment 100, electronic device 110 may run an application 120 that supports the generation of emoji resources. Application 120 may be any suitable type of application for generating emoji resources, examples of which may include, but are not limited to, social applications, content sharing applications, online video applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0025] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting the generation of emoji resources.

[0026] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0027] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for application 120 in electronic device 110 that supports generating emoji resources.

[0028] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0029] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0030] The following description continues with reference to the accompanying drawings, outlining some exemplary embodiments of this disclosure. Example Interaction

[0031] Figures 2A to 2F illustrate example interfaces 200A to 200F according to some embodiments of the present disclosure. Interfaces 200A to 200F may be provided, for example, by the electronic device 110 shown in Figure 1.

[0032] In some embodiments, the electronic device 110 may present an interface 200A as shown in FIG. 2A to the user 140. Interface 200A may be a chat interface (i.e., a conversation interface) between the user 140 and their friend. The user 140 can send text messages or media messages to their friend through interface 200A. Such media messages may be, for example, images selected or captured by the user 140, or emoticon resources selected by the user 140 (also referred to as emoticons). Example 1:

[0033] In some embodiments, after presenting the conversational interface, the electronic device 110 can obtain a first emoticon (i.e., a first emoticon resource) selected by the user 140 to generate a second emoticon (i.e., a second emoticon resource). Specifically, the electronic device 110 can present the application's conversational interface, which includes an interactive entry point. Further, in response to the selection of the interactive entry point, the electronic device 110 can present a set of candidate emoticon resources associated with the application.

[0034] As an example, as shown in Figure 2A, the electronic device 110 can present an emoji generation entry 310 in the interface 200A. After the electronic device 110 receives the user 140's selection of the emoji generation entry 210, it can present the emoji resource library 220 as shown in Figure 2B. The emoji resource library 220 includes multiple candidate emoji packs (i.e., candidate emoji resources). Such emoji packs can be, for example, a set of emoji packs collected by the user 140, or a set of recommended emoji packs. Recommended emoji packs can be recommended to the user 140 by the server 130 based on the number of times multiple emoji packs have been used, or they can be determined by the server 130 based on the user 140's historical interaction information.

[0035] In some embodiments, after presenting the emoji resource library 220, the electronic device 110 can determine a first emoji by the user 140 selecting any emoji from the emoji resource library 220. Specifically, the electronic device 110 can present a set of candidate emoji resources associated with the application. Further, the electronic device 110 can receive a selection of a first emoji resource from the set of candidate emoji resources. As an example, after presenting the emoji resource library 220, the electronic device 110 can receive a selection of a first emoji 225 from the emoji resource library 220 by the user 140 to determine a first emoji 225 for generating a second emoji. The first emoji 225 can be a static image or a graphic (Graphics Interchange Format, GIF) with facial information. For example, the first emoji 225 can be an image of a person's face with "heart eyes," which can be cyclically zoomed in and out. Example 2:

[0036] In some embodiments, the electronic device 110 can also determine the first emoticon based on conversation messages in the conversation interface. Specifically, the electronic device 110 can present conversation messages including the first emoticon resource in the application's conversation interface. Further, the electronic device 110 can determine the first emoticon resource based on preset operations on the conversation messages.

[0037] As an example, as shown in Figure 2A, after user 140 sends a conversation message to a friend through electronic device 110, electronic device 110 can display the sent conversation message 215 on interface 200A. Conversation message 215 may, for example, include a first emoticon. Further, after receiving an interactive operation from user 140 on conversation message 215, electronic device 110 can display a first extension bar. The first extension bar includes a first emoticon generation control. Electronic device 110 can determine that conversation message 215 is the first emoticon in response to receiving a selection from user 140 of the first emoticon generation control in the extension bar.

[0038] In this way, users can more easily select the first emoji resource, thereby improving the generation process of the second emoji resource.

[0039] In some embodiments, when acquiring the first emoticon pack, the electronic device 110 can also determine whether the candidate emoticon pack selected by the user 140 includes an image portion of a second preset type. Specifically, the electronic device 110 can acquire the candidate emoticon resource selected by the user. Further, the electronic device 110 can determine the candidate emoticon resource as the first emoticon resource in response to the candidate emoticon including a reference object of the second preset type. As an example, the second preset type can be, for example, a person's facial expression. After receiving the candidate emoticon pack, the electronic device 110 can determine whether a person's facial expression exists in the candidate emoticon pack. If a person's facial expression exists, then the electronic device 110 can use the candidate emoticon pack as the first emoticon pack. For example, if the candidate emoticon pack is a "heart-shaped eye" emoticon pack, the electronic device 110 can determine that the "heart-shaped eye" emoticon pack contains an image region corresponding to the facial expression, that is, the eye portion replaced by a heart. The process of determining whether the candidate emoticon pack includes an image portion of the second preset type can be performed by the electronic device 110 or by the server 130.

[0040] After the first emoticon is determined, the electronic device 110 can acquire a reference image to obtain a second emoticon generated based on the first emoticon and the reference image. The following describes the interaction process of the electronic device 110 providing the second emoticon to the user 140.

[0041] In some embodiments, the electronic device 110 presents an image acquisition interface associated with an application. As an example, as shown in FIG2B, after receiving a selection of the first emoticon 225 from the user 140, the electronic device 110 can display the selection of the first emoticon 225 in a prominent style. Such a prominent style could be, for example, a bold border for the first emoticon 225, or displaying the first emoticon 225 in a different color. Further, the electronic device 110 can respond to the selection of the image upload control 230 by presenting an interface 200C as shown in FIG2C. Interface 200C can be a reference image acquisition interface, which could be, for example, an image capture interface.

[0042] In some embodiments, after the image acquisition interface is presented, the electronic device 110 can acquire a reference image via the image acquisition interface. For example, as shown in FIG2C, the electronic device 110 can acquire an image taken by the user 140 through the interface 200C, and use that image as a reference image for generating a second emoticon. In some scenarios, the electronic device 110 can also present a photo album based on the user 140's selection of the photo album entry 240. Further, when a target image in the photo album is selected by the user 140, the electronic device 110 can acquire that target image as a reference image for generating a second emoticon.

[0043] Alternatively or additionally, as shown in Figure 2A, the electronic device 110 may present an interface 200A. Interface 200A may be a conversation interface between user 140 and their friend. Interface 200A includes multiple conversation messages, such as conversation message 215. Conversation message 215 may include, for example, an image sent by user 140 to their friend via electronic device 110. Such an image may be one captured by user 140 through a camera interface, or it may be an image selected by user 140 from their photo album. Electronic device 110 may receive a long-press operation from user 140 on conversation message 215, displaying a second extended bar. The second extended bar includes at least a second emoji generation control. After receiving user 140's selection of the second emoji generation control, electronic device 110 may determine that the image in conversation message 215 is a reference image for generating a second emoji.

[0044] In some embodiments, when a reference image is acquired, the electronic device 110 also needs to determine that the reference image is associated with a first preset type. Specifically, the electronic device 110 may acquire a captured first image or an uploaded second image via an image acquisition interface. Further, the electronic device 110 may determine the first image or the second image as a reference image in response to the first image or the second image including a target object of the first preset type.

[0045] As an example, as shown in Figure 2C, after the user 140 clicks the shooting control 235, the electronic device 110 can acquire a first image captured by the user 140. The electronic device 110 can also acquire a second image selected by the user 140 via the album entry 240. Further, when the first or second image includes an image portion corresponding to a target object of a first preset type, the electronic device 110 can use the first or second image as a reference image. The image portion corresponding to the first preset type can, for example, be a facial image of a person. For example, the first image is a frontal photograph including a person's face, and the second image is a back photograph of a person. Then, the electronic device 110 can determine that the first image is a reference image for generating a second emoticon.

[0046] In some embodiments, after the first emoticon and reference image are determined, the electronic device 110 can send the first emoticon and reference image to the server 130, so that the server 130 can generate a second emoticon. Specifically, the server 130 can determine first motion information associated with a first set of feature points from the first emoticon resource. A set of feature points is associated with a reference object in the first emoticon resource. As an example, the first emoticon may be a "heart-shaped eyes" emoticon, and the server 130 can determine the facial expression (i.e., heart-shaped eyes) in the emoticon as the first set of feature points. Further, the server 130 can determine the first motion information of the heart-shaped eyes (e.g., the eyes turn into hearts and are cyclically zoomed in and out).

[0047] Furthermore, server 130 can determine second motion information associated with a second set of feature points in the reference image, based on the first motion information. This second set of feature points is associated with the target object. For example, server 130 can determine a second set of feature points in the reference image corresponding to the first set of feature points. For instance, if the first set of feature points is the eye portion of a first emoticon, then the second set of feature points could be the eyes of a person in the reference image. After determining the second set of feature points, server 130 can determine the second motion information based on the first motion information. The second motion information could be the movement trajectory of the eyes of a person in the reference image.

[0048] Finally, server 130 can generate a second facial expression resource based on the second motion information. For example, the second motion information could be eyes turning into hearts and looping in and out of focus. Server 130 can then add this animation effect (i.e., the second motion information) to a reference image so that the eyes of the person in the reference image turn into hearts and loop in and out of focus.

[0049] In some embodiments, after the second emoji is generated, the electronic device 110 can display a notification indicating that the generation is complete. Specifically, the electronic device 110 can display a notification within the application indicating that the second emoji resource has been generated. As an example, as shown in FIG2D, when the second emoji is generated, the electronic device 110 can display a prompt message 245 in the interface 200D. The prompt message 245 is used to remind that the second emoji has been generated, and the prompt message 245 includes a preview control 250. In this way, the user can be promptly reminded that the emoji has been generated, thereby improving the interactive experience between the user and the application.

[0050] Furthermore, the electronic device 110 can present a viewing interface in response to the triggering of the reminder. The viewing interface displays the second emoticon resource. As an example, as shown in FIG2D, after receiving the user 140's selection of the preview control 250, the electronic device 110 can present an interface 200E as shown in FIG2E. The interface 200E can be, for example, a preview interface (i.e., a viewing interface) of the second emoticon pack, displaying the generated second emoticon pack 255.

[0051] In some embodiments, the electronic device 110 can add the second emoticon to its favorites based on a second operation performed by the user on the second emoticon. Specifically, the electronic device 110 can add the second emoticon to the emoticon resource collection in the application in response to a second operation on the second emoticon resource. As an example, as shown in FIG2E, after receiving a selection of the favorites control 260 by the user 140, the electronic device 110 can add the second emoticon to its favorites. The favorites can be, for example, a collection of multiple emoticon resources. After the second emoticon is added to the favorites, the electronic device 110 can display the second emoticon 255 in the emoticon favorites collection 280 as shown in FIG2F.

[0052] In some embodiments, the electronic device 110 can also receive configuration information of the second emoticon pack from the user 140 in the interface 200E, and adjust the second emoticon pack based on the configuration information. Specifically, the electronic device 110 can set the public scope of the second emoticon resource in response to a third operation on the second emoticon resource. As an example, as shown in FIG2E, the interface 200E also includes a public control 265. The user 140 can switch the public status of the second emoticon pack via the public control 265. When the public control 265 is active, the second emoticon pack can be publicly displayed within a preset scope. The preset scope can be, for example, visible to everyone, or a public scope manually set by the user 140 (e.g., visible only to friends). When the second emoticon pack is visible to everyone, the second emoticon pack can be added to a preset emoticon store so that other users can see and use the second emoticon pack in the emoticon store.

[0053] In some scenarios, when the public control 265 is not selected by user 140, that is, when the public control 265 is not in an active state, the second emoticon can only be seen and used by user 140.

[0054] In this way, users can more easily select the visibility status of the second emoji, thereby improving the configuration efficiency of the second emoji.

[0055] In some embodiments, the electronic device 110 may receive a first keyword associated with the second emoji resource. Further, the electronic device 110 may associate the first keyword with the second emoji resource, enabling the second emoji resource to be acquired based on the first keyword. The second emoji resource is also associated with a second keyword, which is determined based on the first emoji resource and / or a reference image.

[0056] As an example, as shown in Figure 2E, the interface 200E also includes a keyword input component 270. User 140 can associate the second emoticon with the input first keyword via the keyword input component 270. In some scenarios, the electronic device 110 can also display preset keywords in the keyword input component 270, which can be generated by the server 130 based on the second emoticon. The first keyword could be, for example, "in love".

[0057] Additionally or alternatively, the second emoji may also be associated with a second keyword, which is determined based on the first emoji that generated the second emoji. For example, if the first emoji is the "heart eyes" emoji, then the second keyword could be "heart eyes".

[0058] Once the first keyword and the second keyword are associated with a second emoji, the second emoji can be retrieved based on the first and second keywords. As an example, electronic device 110 can display an emoji store, which includes multiple publicly available emojis and a search component. Electronic device 110 can retrieve the second keyword (i.e., "heart eyes") entered by user 140 via the search component, and retrieve the second emoji based on "heart eyes".

[0059] In this way, the second emoji can be more easily and quickly obtained and used by other users, thereby improving the efficiency of information acquisition.

[0060] In some embodiments, electronic device 110 may present an indicator element associated with sending a second emoji resource, the indicator element representing that the second emoji resource is generated based on a reference image and a first emoji resource. As an example, as shown in FIG2E, electronic device 110 may present an indicator element 275 in interface 200E to remind user 140 that the second emoji 255 is generated based on a reference image and a first emoji.

[0061] In some embodiments, once the second emoji has been generated and configured, the electronic device 110 can provide the second emoji to the user 140. Specifically, the electronic device 110 can provide a second emoji resource generated based on a reference image and a first emoji resource. The first emoji resource is associated with an application. The second emoji resource includes motion associated with a target object in the reference image, the motion being determined based on the first emoji resource.

[0062] As an example, as shown in Figures 2A to 2F, the electronic device 110 can receive the user 140's selection of the emoji control 285 and present an emoji collection 280 as shown in Figure 2F. The electronic device 110 can present the generated second emoji 255 in the emoji collection 280 to provide the second emoji 255 to the user 140.

[0063] In some embodiments, the second emoticon 255 can be used by the user 140. Specifically, the electronic device 110 can send the second emoticon resource in the application in response to a first operation on the second emoticon resource. As an example, as shown in FIG2F, the electronic device 110 can receive the user 140's selection of the second emoticon 255 from the emoticon collection 280. Further, the electronic device 110 can send the second emoticon 255 to the user 140's friends to display the second emoticon in the conversation interface.

[0064] In this way, embodiments of this disclosure can generate a second emoji resource based on the acquired reference image and the first emoji resource, thereby helping users better obtain the desired information. Example Process

[0065] Figure 3 shows a flowchart of an example process 300 for generating facial expression resources according to some embodiments of the present disclosure. Process 300 can be implemented at electronic device 110. Process 300 will now be described with reference to Figure 1.

[0066] As shown in Figure 3, in box 310, electronic device 110 presents an image acquisition interface associated with the application.

[0067] In frame 320, electronic device 110 acquires a reference image via an image acquisition interface.

[0068] In box 330, electronic device 110 provides a second expression resource generated based on a reference image and a first expression resource associated with an application, wherein the second expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first expression resource.

[0069] In some embodiments, process 300 further includes: presenting a set of candidate emoji resources associated with the application; and receiving a selection of a first emoji resource from the set of candidate emoji resources.

[0070] In some embodiments, presenting a set of candidate emoji resources associated with an application includes: presenting a conversational interface of the application, the conversational interface including an interactive entry point; and, in response to a selection of an interactive entry point, presenting a set of candidate emoji resources associated with the application.

[0071] In some embodiments, process 300 further includes: presenting a conversation message including a first emoticon resource in the conversation interface of the application; and determining the first emoticon resource based on a preset operation on the conversation message.

[0072] In some embodiments, providing a second emoticon resource generated based on a reference image and a first emoticon resource includes: presenting a notification in the application that the second emoticon resource has been generated; and, in response to the notification, presenting a viewing interface that displays the second emoticon resource.

[0073] In some embodiments, process 300 further includes: sending the second emoji resource in the application in response to a first operation on the second emoji resource.

[0074] In some embodiments, process 300 further includes: presenting an indicator element associated with the sent second expression resource, the indicator element indicating that the second expression resource was generated based on a reference image and a first expression resource.

[0075] In some embodiments, process 300 further includes: adding the second emoji resource to an emoji resource set in the application in response to a second operation on the second emoji resource.

[0076] In some embodiments, process 300 further includes: in response to a third operation on the second emoji resource, setting the public scope of the second emoji resource so that the second emoji resource can be accessed by users within the public scope.

[0077] In some embodiments, process 300 further includes: receiving a first keyword associated with the second emoji resource; and associating the first keyword with the second emoji resource, such that the second emoji resource can be obtained based on the first keyword.

[0078] In some embodiments, the second expression resource is also associated with a second keyword, which is determined based on the first expression resource and / or a reference image.

[0079] In some embodiments, acquiring a reference image via an image acquisition interface includes: acquiring a captured first image or an uploaded second image via the image acquisition interface; and determining the first image or the second image as a reference image in response to the first image or the second image including a target object of a first preset type.

[0080] In some embodiments, process 300 further includes: acquiring candidate emoji resources selected by the user; and determining the candidate emoji resources as first emoji resources in response to the candidate emoji resources including reference objects of a second preset type.

[0081] In some embodiments, the second expression resource is generated based on the following process: determining first motion information associated with a first set of feature points in a first expression resource, the first set of feature points being associated with a reference object in the first expression resource; determining second motion information associated with a second set of feature points in a reference image, the second set of feature points being associated with a target object, based on the first motion information; and generating the second expression resource based on the second motion information. Example apparatus and devices

[0082] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 shows a schematic structural block diagram of an example apparatus 400 for generating facial expression resources according to certain embodiments of this disclosure. Apparatus 400 may be implemented as or included in electronic device 110. The various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0083] As shown in Figure 4, the device 400 includes: a presentation module 410 configured to present an image acquisition interface associated with an application; an acquisition module 420 configured to acquire a reference image via the image acquisition interface; and a providing module 430 configured to provide a second expression resource generated based on the reference image and a first expression resource associated with the application, wherein the second expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first expression resource.

[0084] In some embodiments, the apparatus 400 further includes a resource presentation module configured to present a set of candidate emoji resources associated with an application; and to receive a selection of a first emoji resource from the set of candidate emoji resources.

[0085] In some embodiments, the resource presentation module is further configured to: present a session interface of the application, the session interface including an interactive entry point; and, in response to the selection of the interactive entry point, present a set of candidate emoji resources associated with the application.

[0086] In some embodiments, the device 400 further includes a message presentation module configured to present a conversation message including a first emoticon resource in a conversation interface of an application; and to determine the first emoticon resource based on a preset operation on the conversation message.

[0087] In some embodiments, the providing module 430 is further configured to: present a notification in the application that the second emoji resource has been generated; and, in response to the triggering of the notification, present a viewing interface that displays the second emoji resource.

[0088] In some embodiments, the apparatus 400 further includes a sending module configured to send the second emoji resource in an application in response to a first operation on the second emoji resource.

[0089] In some embodiments, the apparatus 400 further includes an element rendering module configured to render an indicator element associated with the sent second expression resource, the indicator element representing that the second expression resource was generated based on a reference image and a first expression resource.

[0090] In some embodiments, the apparatus 400 further includes an adding module configured to add the second emoji resource to an emoji resource set in the application in response to a second operation on the second emoji resource.

[0091] In some embodiments, the device 400 further includes a setting module configured to set the public scope of the second emoticon resource in response to a third operation on the second emoticon resource, such that the second emoticon resource can be accessed by users within the public scope.

[0092] In some embodiments, the device 400 further includes an association module configured to receive a first keyword associated with the second emoji resource; and to associate the first keyword with the second emoji resource, so that the second emoji resource can be obtained based on the first keyword.

[0093] In some embodiments, the second expression resource is also associated with a second keyword, which is determined based on the first expression resource and / or a reference image.

[0094] In some embodiments, the acquisition module 420 is further configured to: acquire a captured first image or an uploaded second image via an image acquisition interface; and determine the first image or the second image as a reference image in response to the first image or the second image including a target object of a first preset type.

[0095] In some embodiments, the device 400 further includes a determining module configured to acquire candidate expression resources selected by the user; and to determine the candidate expression resources as first expression resources in response to the candidate expression resources including reference objects of a second preset type.

[0096] In some embodiments, the second expression resource is generated based on the following process: determining first motion information associated with a first set of feature points in a first expression resource, the first set of feature points being associated with a reference object in the first expression resource; determining second motion information associated with a second set of feature points in a reference image, the second set of feature points being associated with a target object, based on the first motion information; and generating the second expression resource based on the second motion information.

[0097] As shown in Figure 5, the electronic device 500 is in the form of a general-purpose electronic device. Components of the electronic device 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in the memory 520. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0098] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0099] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0100] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0101] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0102] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0103] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0104] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0105] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0106] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0107] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating an expression resource, comprising: presenting an image acquisition interface associated with an application; acquiring, via the image acquisition interface, a reference image; and providing a second expression resource generated based on the reference image and a first expression resource, the first expression resource being associated with the application, wherein the second expression resource comprises a motion associated with a target object in the reference image, the motion being determined based on the first expression resource. 2.The method of claim 1, further comprising: presenting a set of candidate expression resources associated with the application; and receiving a selection of the first expression resource in the set of candidate expression resources. 3.The method of claim 2, wherein presenting a set of candidate expression resources associated with the application comprises: presenting a conversation interface of the application, the conversation interface comprising an interactive entry; and in response to a selection of the interactive entry, presenting a set of candidate expression resources associated with the application. 4.The method of claim 1, further comprising: presenting, in a conversation interface of the application, a conversation message comprising the first expression resource; and determining the first expression resource based on a preset operation on the conversation message. 5.The method of claim 1, wherein providing a second expression resource generated based on the reference image and a first expression resource comprises: presenting, in the application, a reminder about a completion of the generation of the second expression resource; and in response to a triggering of the reminder, presenting a viewing interface displaying the second expression resource. 6.The method of claim 1, further comprising: in response to a first operation on the second expression resource, sending the second expression resource in the application. 7.The method of claim 6, further comprising: presenting an indication element associated with the sent second expression resource, the indication element representing that the second expression resource is generated based on the reference image and the first expression resource. 8.The method of claim 1, further comprising: in response to a second operation on the second expression resource, adding the second expression resource to a collection of expression resources in the application. 9.The method of claim 1, further comprising: in response to a third operation on the second expression resource, setting a public range of the second expression resource, such that the second expression resource can be acquired by users within the public range. 10.The method of claim 1, further comprising: receiving a first keyword associated with the second expression resource; and associating the first keyword to the second expression resource, such that the second expression resource can be acquired based on the first keyword. 11.The method of claim 1, wherein the second expression resource is further associated to a second keyword, the second keyword being determined based on the first expression resource and / or the reference image. 12.The method of claim 1, wherein acquiring, via the image acquisition interface, a reference image comprises: ​ ​ ​ ​ ​ ​ acquire, via the image acquisition interface, a first image that is photographed or a second image that is uploaded; and determine the first image or the second image as the reference image in response to the first image or the second image including the target object of a first preset type.

13. The method of claim 1, further comprising: acquire a candidate expression resource selected by a user; and determine the candidate expression resource as the first expression resource in response to the candidate expression resource including a reference object of a second preset type.

14. The method of claim 1, wherein the second expression resource is generated based on a process comprising: determining, from the first expression resource, first motion information associated with a first set of feature points associated with a reference object in the first expression resource; determining, based on the first motion information, second motion information associated with a second set of feature points associated with the target object in the reference image; and generating the second expression resource based on the second motion information.

15. An apparatus for generating an expression resource, comprising: a presentation module configured to present an image acquisition interface associated with an application; an acquisition module configured to acquire, via the image acquisition interface, a reference image; and a providing module configured to provide a second expression resource generated based on the reference image and a first expression resource associated with the application, wherein the second expression resource includes motion associated with a target object in the reference image, the motion being determined based on the first expression resource.

16. An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1-14.

17. A computer-readable storage medium having stored thereon a computer program, the computer program being executable by a processor to implement the method according to any one of claims 1-14. ​ ​ ​

Images