Method, device, storage medium, and processor for generating emoticon package

Abstract

The present invention discloses a method, device, storage medium and processor for generating an emoticon package. The method comprises: providing a graphical user interface through a terminal device, and the emoticon package generation method comprises: detecting the amplitude of the movement change of a target object in the graphical user interface; in response to the amplitude of the movement change satisfying a first preset condition, intercepting a target image from the graphical user interface, wherein the content displayed in the target image comprises: the facial area and at least part of the limb area of ​​the target object; detecting the bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by the moment of intercepting the target image; in response to the bullet screen rate satisfying a second preset condition, determining the target text from the bullet screen content displayed in the first time period; and generating an emoticon package using the target image and the target text. The present invention solves the technical problem in the related art that the efficiency of generating emoticon packages is low due to the complex steps of making emoticon packages.

Description

Technical Field

[0001] The present invention relates to the field of emoticon package generation, and in particular to an emoticon package generation method, device, storage medium, and processor. Background Art

[0002] At present, the process of making emoticon packages usually requires background selection, text editing, synthesis operations, etc. The procedures are relatively complicated, which causes users to spend a long time when making emoticon packages for real-time scenes, which in turn leads to low efficiency in generating emoticon packages.

[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0004] The embodiments of the present invention provide a method, device, storage medium, and processor for generating an emoticon package, so as to at least solve the technical problem in the related art that the efficiency of generating an emoticon package is low due to the complicated steps of producing the emoticon package.

[0005] According to one aspect of an embodiment of the present invention, a method for generating an emoticon package is provided, wherein a graphical user interface is provided through a terminal device, and the method for generating an emoticon package comprises: detecting the amplitude of a change in a motion of a target object in the graphical user interface; in response to the amplitude of the change in the motion satisfying a first preset condition, capturing a target image from the graphical user interface, wherein the content displayed in the target image comprises at least one of the following: a facial area and at least part of a limb area of ​​the target object; detecting a bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by the moment when the target image is captured; in response to the bullet screen rate satisfying a second preset condition, determining a target text from the bullet screen content displayed in the first time period; and generating an emoticon package using the target image and the target text.

[0006] Optionally, detecting the amplitude of the change in the motion of the target object includes: obtaining a first motion of the target object within a second time period, and a second motion of the target object within a third time period, wherein the second time period is a historical time period, the third time period is a current time period, the first motion is an motion to be referenced, and the second motion is an motion to be compared; determining the amplitude of the motion change based on the first motion and the second motion.

[0007] Optionally, the motion change amplitude satisfying the first preset condition includes: the motion change amplitude exceeds a preset amplitude range.

[0008] Optionally, detecting the barrage rate within the first time period includes: obtaining the number of barrages appearing in the first time period and the duration corresponding to the first time period, wherein the starting time of the first time period is the time when the target picture is captured; determining the barrage rate based on the number of barrages and the duration.

[0009] Optionally, the barrage rate satisfies a second preset condition, including: the barrage rate exceeds a preset multiple of an average barrage rate.

[0010] Optionally, determining the target text from the barrage content displayed in the first time period includes: obtaining the barrage with the highest appearance frequency from the barrage content displayed in the first time period; and determining the target text using the barrage with the highest appearance frequency.

[0011] Optionally, determining the target text from the barrage content displayed in the first time period includes: obtaining the most frequently appearing keyword from the barrage content displayed in the first time period, wherein the most frequently appearing keyword is the word that appears most repeatedly in the barrage content; and determining the target text using the most frequently appearing keyword.

[0012] Optionally, generating an emoticon package using a target image and target text includes: determining a display position of a target object in the target image; determining a first area and a second area in the target image using the display position, wherein the first area is a display area of ​​the target text, and the second area is an area to be removed determined by the first area; filling the target text into any position in the first area and removing the second area to generate an emoticon package.

[0013] Optionally, the emoticon package generation method further includes: displaying the emoticon package in a pop-up window; and adjusting the display content and / or display position of the target text in response to an editing operation performed on the emoticon package.

[0014] Optionally, the emoticon package generation method also includes: displaying the emoticon package in a chat interface provided by a graphical user interface; or, displaying the emoticon package in the form of barrage in the graphical user interface.

[0015] According to one embodiment of the present invention, there is also provided an emoticon package generation device, which provides a graphical user interface through a terminal device, and the emoticon package generation device includes: a first detection module, used to detect the amplitude of the movement change of the target object in the graphical user interface; a capture module, used to capture a target image from the graphical user interface in response to the movement change amplitude satisfying a first preset condition, wherein the content displayed in the target image includes: the facial area and at least part of the limb area of ​​the target object; a second detection module, used to detect the barrage rate of the graphical user interface within a first time period, wherein the first time period is determined by the moment of capturing the target image; a determination module, used to determine the target text from the barrage content displayed within the first time period in response to the barrage rate satisfying the second preset condition; a generation module, used to generate an emoticon package using the target image and the target text.

[0016] According to one embodiment of the present invention, a non-volatile storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute any of the above-mentioned emoticon package generation methods when running.

[0017] According to one embodiment of the present invention, a processor is further provided, the processor being used to run a program, wherein the program is configured to execute any of the above-mentioned methods for generating an emoticon package when running.

[0018] According to one embodiment of the present invention, there is also provided an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any of the above-mentioned methods for generating an emoticon package.

[0019] In an embodiment of the present invention, the amplitude of the movement change of the target object in the graphical user interface is first detected. In response to the amplitude of the movement change satisfying the first preset condition, a target image can be intercepted from the graphical user interface, wherein the content displayed in the target image includes: the facial area and at least part of the limb area of ​​the target object, and the bullet screen rate of the graphical user interface in a first time period is detected, wherein the first time period is determined by the moment of intercepting the target image. In response to the bullet screen rate satisfying the second preset condition, the target text is determined from the bullet screen content displayed in the first time period, and an emoticon package is generated using the target image and the target text, thereby achieving the purpose of quickly generating an emoticon package. It is easy to notice that the target image and the target text used to make the emoticon package are both from the content displayed in real time by the graphical user interface. Therefore, the produced emoticon package is more closely related to the content currently displayed by the graphical user interface, making the emoticon package more appropriate to the current scene. This process does not require manual production by the user. The entire process is implemented based on the content displayed in the graphical user interface, which can improve the efficiency of generating emoticon packages, thereby solving the technical problem in the related art that the efficiency of generating emoticon packages is low due to the complex steps of emoticon package production. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0021] Figure 1 is a hardware structure block diagram of a mobile terminal according to an emoticon package generation method of an embodiment of the present invention;

[0022] Figure 2 is a flow chart of a method for generating an emoticon package according to an embodiment of the present invention;

[0023] Figure 3 is a schematic diagram of an emoticon package editing process according to an embodiment of the present invention;

[0024] Figure 4 is a flow chart of another emoticon package generation method according to an embodiment of the present invention;

[0025] Figure 5 is a schematic diagram of a pre-set emoticon package template according to an embodiment of the present invention;

[0026] Figure 6 is a schematic diagram of removing invalid parts in a picture according to an embodiment of the present invention;

[0027] Figure 7 is a schematic diagram of an emoticon package generating device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] The method embodiment can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, the mobile terminal can be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (MID for short), a PAD, a game console and other terminal devices. Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal of an expression package generation method according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1Only one is shown in the figure) processor 102 (processor 102 may include but is not limited to a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP) chip, a microprocessor (MCU), a programmable logic device (FPGA), a neural network processor (NPU), a tensor processor (TPU), an artificial intelligence (AI) type processor, etc.) and a memory 104 for storing data. Optionally, the mobile terminal may also include a transmission device 106 for communication functions, an input and output device 108, and a display device 110. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.

[0031] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the emoticon package generation method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, the above-mentioned emoticon package generation method is realized. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0032] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0033] The inputs in the input / output device 108 may come from a plurality of human interface devices (HIDs), such as keyboards and mice, game controllers, and other dedicated game controllers (such as steering wheels, fishing rods, dance mats, remote controls, etc.). In addition to providing input functions, some human interface devices may also provide output functions, such as force feedback and vibration of game controllers, audio output of controllers, etc.

[0034] The display device 110 may be, for example, a head-up display (HUD), a touch-screen liquid crystal display (LCD), and a touch display (also referred to as a "touch screen" or "touch display screen"). The liquid crystal display may enable a user to interact with a user interface of the mobile terminal. In some embodiments, the mobile terminal has a graphical user interface (GUI), and a user may interact with the GUI by finger contacts and / or gestures on a touch-sensitive surface, wherein the human-computer interaction functions here may optionally include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving emails, call interfaces, playing digital videos, playing digital music, and / or web browsing, etc. The executable instructions for executing the above-mentioned human-computer interaction functions are configured / stored in a computer program product or a readable storage medium executable by one or more processors.

[0035] According to an embodiment of the present invention, a method embodiment of emoticon package generation is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] Figure 2 is a flow chart of a method for generating an emoticon package according to an embodiment of the present invention. Figure 2 As shown, a graphical user interface is provided by a terminal device, and the method includes the following steps:

[0037] Step S202: detecting the range of motion change of the target object in the graphical user interface.

[0038] The above-mentioned graphical user interface may be a graphical user interface provided by an electronic device including a display screen, such as a terminal device or a computer device.

[0039] The above-mentioned graphical user interface may display the live broadcast screen of the anchor, the screen of the game scene, the screen of the real-time news, etc. The above-mentioned target object may be the anchor during the live broadcast, the virtual character in the game scene, and the party in the real-time news screen, etc. The target object may also be an actor in a TV series, an entertainment guest in an entertainment program, an anime character in anime, a virtual character, etc. This application takes the graphical user interface as the live broadcast interface and takes the anchor as the target object for explanation.

[0040] The change range of the above-mentioned target object can be the change range of the host's expression, or the change range of the host's body language, etc.

[0041] In an optional embodiment, the range of changes in the host's facial expressions in a live broadcast scene can be detected. When the range of changes in the host's facial expressions is too large, for example, when the host makes tense expressions such as laughing out loud, opening his mouth wide, etc., an expression package corresponding to the host's expression is generated by intercepting the host's expression, so that an expression package related to the host's current state can be quickly produced to increase the fun of interaction in the live broadcast room.

[0042] Step S204 , in response to the action change amplitude satisfying the first preset condition, capturing a target image from the graphical user interface.

[0043] The content displayed in the target image includes at least one of the following: a facial area and at least a part of a limb area of ​​the target object.

[0044] The first preset condition mentioned above can be set by yourself.

[0045] In an optional embodiment, when the amplitude of the motion change meets the first preset condition, it indicates that the amplitude of the motion change is a large amplitude change. Specifically, taking facial expressions as an example, facial organs are detected, such as eyes, mouth, nose, etc.; the state without change for a long time is taken as the standard state; when the amplitude of each organ changes exceeds a certain range, it can be regarded as an amplitude change. For example: the host will smile in a normal state. When the host laughs in a certain situation, it is detected that the amplitude of the mouth changes beyond a certain range, and it is considered that the amplitude of the host's motion change at this time is a large amplitude change.

[0046] In another optional embodiment, the first preset condition can be set according to the degree of change of the host's face, for example, according to the degree of change of the host's mouth shape, the degree of change of the host's eyebrows, and the degree of change of the host's eyes. The degree of change of the mouth shape can be determined by the angle of the mouth corners or the angle of the mouth opening, the degree of change of the eyebrows can be determined by the angle of the eyebrows, and the degree of change of the eyes can be determined by the size of the eyes opening.

[0047] In another optional embodiment, the first preset condition can also be set according to the degree of change of the host's limbs, for example, according to the degree of change of the host's arms, body, head, etc. The degree of change of the arms can be determined according to the angle of the arm's upward movement or the angle of rotation, the degree of change of the body can be determined according to the moving position of the body or the twisting angle of the body, and the degree of change of the head can be determined according to the moving position of the head or the twisting angle of the head.

[0048] In another optional embodiment, the amplitude of the host's movements can be monitored in real time. When the amplitude of the host's movements meets a first preset condition, a target image is captured from the graphical user interface so that a corresponding emoticon package can be created based on the target image, thereby increasing the fun of interaction during the live broadcast.

[0049] In another optional embodiment, a target image including a facial area and at least a portion of a limb area of ​​a target object can be captured from a graphical user interface according to a preset template, so that the captured target image is suitable for making an emoticon package, thereby improving the efficiency of making an emoticon package.

[0050] Step S206, detecting the bullet screen rate of the graphical user interface in the first time period.

[0051] The first time period is determined by the time when the target image is captured. The duration corresponding to the first time period can be preset by the user, for example, 3 seconds.

[0052] In an optional embodiment, the first time period is a few seconds before the moment of capturing the target image, for example, the screenshot is taken at time point T1, but the first time period starts from t seconds before time point T1.

[0053] In an optional embodiment, in the first time period, if the rate of bullet comments in the graphical user interface is fast or the number of bullet comments is large, it means that the host's current action can cause discussion among everyone. At this time, the user has a greater need to send the host's emoticon package. If the emoticon package can be quickly made at this time, it will increase the fun of the discussion. In the first time period, if the rate of bullet comments in the graphical user interface is low or the number of bullet comments is small, it means that the host's current action has not caused discussion among everyone. The action may be a normal activity action. At this time, the user has a smaller need to send an emoticon package, and it is not necessary to make an emoticon package based on the target image to reduce the occupation of operating resources.

[0054] Therefore, whether it is necessary to make an emoticon package can be determined by detecting the barrage rate of the graphical user interface in the first time period, so that when the emoticon package is needed, the fun of the discussion can be increased by making an emoticon package, and when the emoticon package is not needed, the making of the emoticon package is prohibited to save the usage of running resources.

[0055] Step S208, in response to the bullet screen rate satisfying the second preset condition, determining the target text from the bullet screen content displayed in the first time period.

[0056] The second preset condition mentioned above can be set by yourself.

[0057] In an optional embodiment, the rate of the bullet screen in the graphical user interface can be monitored in real time, and when the rate of the bullet screen meets the second preset condition, the target text can be determined from the bullet screen content displayed in the first time period. Specifically, the bullet screen content with the highest display frequency in the bullet screen content displayed in the first time period can be used as the target text, and the keyword with the highest frequency in the bullet screen content can also be obtained and extracted, and the keyword can be used as the target text.

[0058] An example of the step of using keywords as target text may be the following three comments: It is recommended that the host play Li Bai; the hero Li Bai is very elegant; the host plays Li Bai very well; the keyword with the highest frequency is Li Bai, and 'Li Bai' is extracted as the target text.

[0059] Step S210, generating an emoticon package using the target image and the target text.

[0060] In an optional embodiment, the target image and the target text may be set in a pre-set template to generate an emoticon package, wherein the pre-set template may specify the location of the target image and the location of the target text.

[0061] In another optional embodiment, after generating an emoticon package, the generated emoticon package can be displayed in a live broadcast scene, and the user can select the displayed emoticon package to send. The user can also edit the displayed emoticon package and send the edited emoticon package to the comment area or barrage of the live broadcast room.

[0062] In another optional embodiment, in a scenario where multiple anchors are connected to the microphone, each anchor is in a different screen, and expression / body detection is performed on each anchor separately; when any anchor undergoes a drastic change, the anchor's picture with the drastic change is captured, and an emoticon package is produced based on the anchor's picture.

[0063] Through the above steps, the amplitude of the movement change of the target object in the graphical user interface is first detected. In response to the amplitude of the movement change satisfying the first preset condition, a target image can be intercepted from the graphical user interface, wherein the content displayed in the target image includes: the facial area and at least part of the limb area of ​​the target object, and the bullet screen rate of the graphical user interface in the first time period is detected, wherein the first time period is determined by the moment of intercepting the target image. In response to the bullet screen rate satisfying the second preset condition, the target text is determined from the bullet screen content displayed in the first time period, and an emoticon package is generated using the target image and the target text, thereby achieving the purpose of quickly generating an emoticon package. It is easy to notice that the target image and the target text used to make the emoticon package are both from the content displayed in real time in the graphical user interface. Therefore, the produced emoticon package is more closely related to the content currently displayed in the graphical user interface, making the emoticon package more appropriate to the current scene. This process does not require manual production by the user. The entire process is implemented based on the content displayed in the graphical user interface, which can improve the efficiency of generating emoticon packages, thereby solving the technical problem in the related art that the efficiency of generating emoticon packages is low due to the complex steps of emoticon package production.

[0064] Optionally, detecting the amplitude of the change in the motion of the target object includes: obtaining a first motion of the target object within a second time period, and a second motion of the target object within a third time period, wherein the second time period is a historical time period, the third time period is a current time period, the first motion is an motion to be referenced, and the second motion is an motion to be compared; determining the amplitude of the motion change based on the first motion and the second motion.

[0065] In an optional embodiment, the first action of the host in the historical time period can be obtained and used as the reference action. Then, the second action of the host in the current time period can be obtained and used as the comparison action. By comparing the positional relationship between the first action and the second action, the change range of the host can be determined.

[0066] For example, the host's arm was placed on the table in the historical time period, while in the current time period, the host's arm left the table and was raised. The position relationship between the arm in the historical time period and the arm in the current time period has changed significantly. At this time, the amplitude of the host's movement change can be determined based on the position relationship of the host's arm.

[0067] In another optional embodiment, the non-overlapping area between the first action and the second action can also be obtained, and the area of ​​the non-overlapping area is used as the action change amplitude. If the area of ​​the non-overlapping area is larger, it means that the action change amplitude of the host is larger; if the area of ​​the non-overlapping area is smaller, it means that the action change amplitude of the host is smaller.

[0068] Optionally, the motion change amplitude satisfying the first preset condition includes: the motion change amplitude exceeds a preset amplitude range.

[0069] The above-mentioned preset amplitude can be determined according to the type of action.

[0070] In an optional embodiment, if the action change amplitude is the change amplitude of the corner of the mouth, the corresponding preset amplitude range may be the amplitude range of the upward movement of the corner of the mouth. If the action change amplitude is the change amplitude of the limbs, the corresponding preset amplitude range may be the amplitude range of the change of the limb position. If the action change amplitude is the change amplitude of the eyebrows, the corresponding preset amplitude range may be the amplitude range of the upward movement of the eyebrows.

[0071] Optionally, detecting the barrage rate within the first time period includes: obtaining the number of barrages appearing in the first time period and the duration corresponding to the first time period, wherein the starting time of the first time period is the time when the target picture is captured; determining the barrage rate based on the number of barrages and the duration.

[0072] The above-mentioned number of barrages is used to indicate the current discussion heat of the host. The higher the current discussion heat of the host, the higher the corresponding number of barrages. If the current discussion heat of the host is lower, the corresponding number of barrages is lower.

[0073] In an optional embodiment, when the target image is captured, the frequency of occurrence of the bullet comments may be detected. Specifically, the frequency of occurrence of the bullet comments may be obtained by dividing the number of bullet comments in the first time period by the length of time corresponding to the first time period. If the first time period is N minutes, the corresponding bullet comment rate = the number of bullet comments that appear in N minutes / N minutes.

[0074] Optionally, the barrage rate satisfies a second preset condition, including: the barrage rate exceeds a preset multiple of an average barrage rate.

[0075] The above average rate of barrage can be calculated in real time based on the current barrage rate and the historical barrage rate.

[0076] In an optional embodiment, when the barrage rate exceeds a preset multiple of the average barrage rate, it indicates that the discussion activity of the barrage is relatively high at this time. In order to increase the fun of barrage interaction or increase the fun of commenting, the target text can be determined from the barrage content, and an emoticon package can be created based on the target picture and target text to achieve the purpose of improving the user experience.

[0077] Optionally, determining the target text from the barrage content displayed in the first time period includes: obtaining the barrage with the highest appearance frequency from the barrage content displayed in the first time period; and determining the target text using the barrage with the highest appearance frequency.

[0078] In an optional embodiment, the most frequently appearing barrage can be obtained from the barrage content displayed in the first time period, and the most frequently appearing barrage can be used to determine the target text, so that the emoticon package made with the target text can meet the current live broadcast scene and enable users to interact through the emoticon package they made.

[0079] Optionally, determining the target text from the barrage content displayed in the first time period includes: obtaining the most frequently appearing keyword from the barrage content displayed in the first time period, wherein the most frequently appearing keyword is the word that appears most repeatedly in the barrage content; and determining the target text using the most frequently appearing keyword.

[0080] In an optional embodiment, if there are no repeated barrages in the barrage content, keywords with higher frequency of occurrence can be extracted from the barrage content as target texts. In the absence of repeated barrages, target texts related to the discussion content can be obtained for live broadcast scenes with high enough discussion heat, thereby making the emoticon package produced by the target text have real-time interactivity.

[0081] Optionally, generating an emoticon package using a target image and target text includes: determining a display position of a target object in the target image; determining a first area and a second area in the target image using the display position, wherein the first area is a display area of ​​the target text, and the second area is an area to be removed determined by the first area; filling the target text into any position in the first area and removing the second area to generate an emoticon package.

[0082] In an optional embodiment, the display position of the target object in the target image can be identified by a preset recognition model, and the display area of ​​the target text can be determined according to the display position. For example, after the display position is determined, the display area of ​​the target text can be set above the display position, or the display area of ​​the target text can be set at any position of the display position. There is no limitation on the setting method of the display area of ​​the target text.

[0083] Furthermore, after determining the first area, other areas except the area where the target object is displayed and the first area can be used as the second area, and the target text can be filled into any position in the first area and the second area can be removed to generate an emoticon package.

[0084] Optionally, the emoticon package generation method further includes: displaying the emoticon package in a pop-up window; and adjusting the display content and / or display position of the target text in response to an editing operation performed on the emoticon package.

[0085] In an optional embodiment, an emoticon package can be displayed above the send box in the comment area of ​​the live broadcast room, and editing controls and send controls can be displayed so that users can edit the emoticon package. Users can adjust the display content of the target text in the emoticon package or the display position of the target object to obtain an adjusted emoticon package, and send the adjusted emoticon package to the comment area by clicking the send control.

[0086] like Figure 3 The figure shows a schematic diagram of an emoticon package editing process. The emoticon package to be sent can be displayed above the sending box. The user can edit the emoticon package through the edit button, and can send the generated emoticon package or the edited emoticon package to the comment area through the send button.

[0087] In another optional embodiment, after editing or sending the emoticon package, the emoticon package is saved in a local emoticon library, and the user can reuse the emoticon package in the emoticon library.

[0088] Optionally, the emoticon package generation method also includes: displaying the emoticon package in a chat interface provided by a graphical user interface; or, displaying the emoticon package in the form of barrage in the graphical user interface.

[0089] In an optional embodiment, after the emoticon package is generated, the emoticon package can be directly displayed in the chat interface of the graphical user interface. The emoticon package can also be sent in the graphical user interface in the form of a bullet screen, wherein when the emoticon package is sent in the form of a bullet screen, the emoticon package can be cropped to avoid the generated emoticon package being too large and blocking the host.

[0090] For example, when displaying emoticons in the form of bullet screen, the image of the anchor in the live broadcast screen can be used as a reference, and the emoticons can be displayed at a size 1 / N of the anchor image. When the anchor image occupies 375*375px, the emoticons can be displayed at 1 / 3 of the size, that is, 125*125px.

[0091] Combine the following Figure 4 A preferred embodiment of the present invention is described in detail. Figure 4 As shown, the method may include the following steps:

[0092] Step S401, real-time monitoring of the host's expression changes;

[0093] Optionally, the host's expression changes may be determined by analyzing the host's facial organs, such as eyes, mouth shape, eyebrows, etc.

[0094] Optionally, before making an emoticon package, a preset emoticon package template can be set to determine the approximate position of the anchor image in the picture and text. Figure 5The figure shows a preset emoticon template. After identifying the human butcher features in the anchor image picture, the specific position of the anchor image can be obtained, and the corresponding text can be placed within the range N according to the position of the anchor image. If the range N exceeds the picture, the range ends at the edge of the picture.

[0095] Step S402, judging by the host's expression, when the host's expression changes significantly, capturing the current host's picture to obtain a target picture;

[0096] Step S403, while taking a screenshot, start detecting the current frequency of barrage appearance, and compare the current frequency of barrage appearance with the average barrage frequency of the live broadcast room. When the barrage frequency exceeds the preset value of the average barrage frequency, confirm to make an emoticon package;

[0097] Step S404, detecting all bullet comments in the first time period, obtaining the bullet comments with the highest frequency, and taking the bullet comments with the highest frequency as the target text;

[0098] Step S405, if the same bullet comment content is not detected, extract the keyword with the highest frequency of occurrence within the corresponding time and use it as the target text;

[0099] Step S406, based on the target text and the target picture, according to the preset template, the target text is placed in the target picture, and the invalid part in the picture is removed to generate an emoticon package;

[0100] like Figure 6 Shown is a schematic diagram of removing invalid parts of an image.

[0101] Step S407: After the emoticon package is generated, a bubble pop-up window may appear in the live broadcast room and display the generated emoticon package, support the user to edit the emoticon package, and send the edited emoticon package to the live broadcast room;

[0102] Optionally, after clicking Edit, the user can enter the emoticon package editing page, which supports the user to adjust the text position and content to obtain a modified emoticon package.

[0103] Step S408: After sending the emoticon package, the user can automatically save the emoticon package locally to support user reuse.

[0104] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0105] In this embodiment, an emoticon package generation device is also provided, which is used to implement the above embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the terms "unit" and "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0106] Figure 7 It is a schematic diagram of an emoticon package generating device according to one embodiment of the present invention, which provides a graphical user interface through a terminal device. The emoticon package generating device includes: a first detection module 702, an interception module 704, a second detection module 706, a determination module 708, and a generation module 710.

[0107] Among them, the first detection module is used to detect the change range of the movement of the target object in the graphical user interface; the interception module is used to intercept the target image from the graphical user interface in response to the movement change range satisfying the first preset condition, wherein the content displayed in the target image includes at least one of the following: the facial area and at least part of the limb area of ​​the target object; the second detection module is used to detect the barrage rate of the graphical user interface within a first time period, wherein the first time period is determined by the moment of intercepting the target image; the determination module is used to determine the target text from the barrage content displayed within the first time period in response to the barrage rate satisfying the second preset condition; the generation module is used to generate an emoticon package using the target image and the target text.

[0108] Optionally, the first detection module includes: a first acquisition unit and a first determination unit.

[0109] Among them, the first acquisition unit is used to obtain the first action of the target object within the second time period, and the second action of the target object within the third time period, wherein the second time period is a historical time period, the third time period is a current time period, the first action is an action to be referenced, and the second action is an action to be compared; the first determination unit is used to determine the amplitude of the action change based on the first action and the second action.

[0110] Optionally, the motion change amplitude satisfying the first preset condition includes: the motion change amplitude exceeds a preset amplitude range.

[0111] Optionally, the second detection module includes: a second acquisition unit and a second determination unit.

[0112] Among them, the second acquisition unit is used to obtain the number of barrages appearing in the first time period and the duration corresponding to the first time period, wherein the starting time of the first time period is the time when the target picture is captured; the second determination unit is used to determine the barrage rate based on the number and duration of barrages.

[0113] Optionally, the barrage rate satisfies a second preset condition, including: the barrage rate exceeds a preset multiple of an average barrage rate.

[0114] Optionally, the first determining module includes: a third acquiring unit and a third determining unit.

[0115] Among them, the third acquisition unit is used to obtain the most frequently appearing bullet screen from the bullet screen content displayed in the first time period; the third determination unit is used to determine the target text using the most frequently appearing bullet screen.

[0116] Optionally, the third acquisition unit includes: an acquisition subunit and a determination subunit.

[0117] Among them, the acquisition subunit is used to obtain the most frequently appearing keyword from the barrage content displayed in the first time period, wherein the most frequently appearing keyword is the word that appears most repeatedly in the barrage content; the determination subunit is used to determine the target text using the most frequently appearing keyword.

[0118] Optionally, the generating module includes: a fourth determining unit, a fifth determining unit, and a removing unit.

[0119] Among them, the fourth determination unit is used to determine the display position of the target object in the target image; the fifth determination unit is used to use the display position to determine the first area and the second area in the target image, wherein the first area is the display area of ​​the target text, and the second area is the area to be removed determined by the first area; the removal unit is used to fill the target text to any position in the first area and remove the second area to generate an emoticon package.

[0120] Optionally, the device further includes: a display module and an adjustment module.

[0121] Among them, the display module is used to display the emoticon package in the pop-up window; the adjustment module is used to respond to the editing operation performed on the emoticon package and adjust the display content and / or display position of the target text.

[0122] Optionally, the device further includes: a display module.

[0123] Among them, the display module is used to display the emoticon package in the chat interface provided by the graphical user interface; or, to display the emoticon package in the form of barrage in the graphical user interface.

[0124] It should be noted that the above-mentioned units and modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to this: the above-mentioned units and modules are all located in the same processor; or, the above-mentioned units and modules are located in different processors in any combination.

[0125] An embodiment of the present invention further provides a non-volatile storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0126] Optionally, in this embodiment, the non-volatile storage medium may be configured to store a computer program for performing the following steps:

[0127] S1, detecting the change amplitude of the motion of the target object in the graphical user interface;

[0128] S2, in response to the action change amplitude satisfying the first preset condition, intercepting a target image from the graphical user interface, wherein the content displayed in the target image includes: a facial area and at least a part of a limb area of ​​the target object;

[0129] S3, detecting the bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by the time when the target image is captured;

[0130] S4, in response to the bullet screen rate satisfying the second preset condition, determining the target text from the bullet screen content displayed in the first time period;

[0131] S5. Generate an emoticon package using the target image and target text.

[0132] Optionally, in this embodiment, the above-mentioned non-volatile storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0133] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0134] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0135] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0136] S1, detecting the change amplitude of the motion of the target object in the graphical user interface;

[0137] S2, in response to the action change amplitude satisfying the first preset condition, intercepting a target image from the graphical user interface, wherein the content displayed in the target image includes: a facial area and at least a part of a limb area of ​​the target object;

[0138] S3, detecting the bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by the time when the target image is captured;

[0139] S4, in response to the bullet screen rate satisfying the second preset condition, determining the target text from the bullet screen content displayed in the first time period;

[0140] S5. Generate an emoticon package using the target image and target text.

[0141] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0142] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0143] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0144] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0145] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0146] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0147] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for generating an emoticon package, characterized in that: A graphical user interface is provided by a terminal device, and the expression package generation method includes: Detecting a change in the motion of a target object in the graphical user interface; In response to the movement change amplitude satisfying a first preset condition, intercepting a target picture from the graphical user interface, wherein the content displayed in the target picture includes at least one of the following: a facial area and at least a part of a limb area of ​​the target object; Detecting a bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by a time when the target image is captured; In response to the bullet screen rate satisfying a second preset condition, determining a target text from the bullet screen content displayed in the first time period; Generate an emoticon package using the target image and the target text.

2. The expression package generation method according to claim 1, characterized in that: Detecting the change range of the movement of the target object includes: Acquire a first action of the target object within a second time period, and a second action of the target object within a third time period, wherein the second time period is a historical time period, the third time period is a current time period, the first action is an action to be referenced, and the second action is an action to be compared; The motion change range is determined based on the first motion and the second motion.

3. The expression package generation method according to claim 2, characterized in that: The action change range meeting the first preset condition includes: The action variation range exceeds the preset range.

4. The expression package generation method according to claim 1, characterized in that: Detecting the bullet screen rate in the first time period includes: Obtain the number of bullet comments that appear in the first time period and the duration corresponding to the first time period, wherein the start time of the first time period is the time when the target image is captured; The barrage rate is determined based on the number of barrages and the duration.

5. The expression package generation method according to claim 4, characterized in that: The rate at which the bullet screen rate satisfies the second preset condition includes: The barrage rate exceeds a preset multiple of the average barrage rate.

6. The expression package generation method according to claim 1, characterized in that: Determining the target text from the bullet screen content displayed in the first time period includes: Obtain the most frequently appearing bullet comment from the bullet comment content displayed in the first time period; The target text is determined using the bullet comments with the highest frequency of occurrence.

7. The expression package generation method according to claim 1, characterized in that: Determining the target text from the bullet screen content displayed in the first time period includes: Acquire the most frequently appearing keyword from the bullet-screen content displayed in the first time period, wherein the most frequently appearing keyword is the word that appears most repeatedly in the bullet-screen content; The target text is determined using the keyword with the highest occurrence frequency.

8. The expression package generation method according to claim 1, characterized in that: Generating the emoticon package using the target image and the target text includes: Determining a display position of the target object in the target image; Determine a first area and a second area in the target image using the display position, wherein the first area is a display area of ​​the target text, and the second area is an area to be removed determined by the first area; The target text is filled into any position in the first area and the second area is removed to generate the emoticon package.

9. The expression package generation method according to claim 1, characterized in that: The expression package generation method also includes: Displaying the emoticon package in a pop-up window; In response to the editing operation performed on the emoticon package, the display content and / or display position of the target text is adjusted.

10. The expression package generation method according to claim 1, characterized in that: The expression package generation method also includes: Displaying the emoticon package in a chat interface provided by the graphical user interface; or, The emoticon package is displayed in the graphical user interface in the form of barrage.

11. An emoticon package generating device, characterized in that: A graphical user interface is provided by a terminal device, and the expression package generating device comprises: A first detection module, used to detect the range of motion change of a target object in the graphical user interface; A capture module, configured to capture a target image from the graphical user interface in response to the motion change amplitude satisfying a first preset condition, wherein the content displayed in the target image includes: a facial area and at least a part of a limb area of ​​the target object; A second detection module is used to detect the bullet screen rate of the graphical user interface in a first time period, wherein the first time period is determined by the time when the target image is captured; A determination module, configured to determine a target text from the bullet-screen content displayed in the first time period in response to the bullet-screen rate satisfying a second preset condition; A generation module is used to generate an emoticon package using the target image and the target text.

12. A non-volatile storage medium, characterized in that: The non-volatile storage medium stores a computer program, wherein the computer program is configured to execute the emoticon package generation method described in any one of claims 1 to 10 when running.

13. A processor, characterized in that: The processor is used to run a program, wherein the program is configured to execute the emoticon package generation method described in any one of claims 1 to 10 when running.

14. An electronic device comprising a memory and a processor, characterized in that: The memory stores a computer program, and the processor is configured to run the computer program to execute the emoticon package generation method described in any one of claims 1 to 10.

Images