Emoticon animation display method and system

Abstract

The application relates to the technical field of computer image processing, and discloses an expression animation display method and system, the method comprising the following steps: when expression animation is displayed, a control instruction sent by a central control host is acquired, the control instruction is analyzed, and analyzed control information is obtained; whether the expression animation is upgraded is determined according to the control information; when it is determined that the expression animation is not upgraded, whether the expression animation is switched is determined according to the control information; when it is determined that the expression animation is switched, an expression resource animation in a TTF font file format is acquired from a character set; font picture switching is performed according to the expression resource animation, and screen display is adapted. The expression animation is displayed in a vector font TTF display animation picture and a Bluetooth service analysis instruction control expression animation upgrade display mode, so that the smoothness of expression animation display and the dynamic adaptation capability can be ensured, and the real-time update requirement of expression animation resources in an MCU system can be met.

Description

Technical Field

[0001] This invention relates to the field of computer image processing technology, and in particular to a method and system for displaying facial expression animation. Background Technology

[0002] As the entry point for human-machine interaction in smart cockpits, in-vehicle intelligent voice assistants have gradually become standard equipment in smart cars. However, because in-vehicle intelligent voice assistants typically display abstract, outlined facial expressions, they have relatively low requirements for the display driving capabilities of the main control unit, and are limited by factors such as space layout, screen size, device power consumption, and cost. The display of facial animations is generally achieved by displaying image sequences. Since low-cost MCUs usually lack the ability to hardware decode images, the image sequence is typically transcoded into a C file on a PC before being imported into the program. Upgrading the facial animation images requires upgrading the software version, making it impossible to directly update the facial image sequence. If software decoding is used to decode images in real time during animation display, low decoding efficiency and high resource consumption can lead to stuttering in the animation display.

[0003] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main objective of this invention is to provide a method and system for displaying animated expressions, aiming to solve the problem that existing devices do not support hardware decoding of images and are limited by their memory size and disk throughput performance, making efficient software decoding of images impossible.

[0005] To achieve the above objectives, the present invention provides a method for displaying animated facial expressions, the method comprising the following steps:

[0006] When displaying facial animations, the system obtains control commands sent by the central control unit, parses the control commands, and obtains the parsed control information.

[0007] Determine whether to upgrade the facial animation based on the control information;

[0008] If it is determined not to upgrade the facial animation, the control information is used to determine whether to switch the facial animation.

[0009] When determining the emoji animation to switch, retrieve the emoji resource animation in TTF font file format from the character set;

[0010] The font image is switched according to the animated emoji resource and adapted to the screen display.

[0011] Optionally, the step of obtaining the emoji resource animation in TTF font file format from the character set includes:

[0012] Obtain the identification code corresponding to the control information;

[0013] Obtain a pre-stored JSON file based on the identification code. The JSON file contains the correspondence between the emoji resource animations corresponding to the identification code and the character set.

[0014] The TTF font file format emoji resource animation is obtained from the character set based on the identification code.

[0015] Optionally, before obtaining the emoji resource animation in TTF font file format from the character set, the method further includes:

[0016] Develop a lightweight embedded graphics library;

[0017] Porting the FreeType library using a lightweight embedded graphics library;

[0018] The animated emoji resources obtained from the character set in TTF font file format include:

[0019] The character set is loaded using the FreeType library, and emoji resource animations in TTF font file format are obtained from the character set.

[0020] Optionally, after determining whether to upgrade the facial animation based on the control information, the method further includes:

[0021] When it is determined to upgrade the emoji animation, obtain the emoji animation resource files;

[0022] Extract the corresponding files from the facial animation resource files and configure them.

[0023] Optionally, the facial animation resource file includes a TTF file and a JSON file;

[0024] The extraction and configuration of corresponding files from the facial animation resource files includes:

[0025] The TTF file in the emoticon animation resource is read and stored in the FONTS directory. The JSON file is read and written to the system JSON file, which contains the correspondence between the emoticon animation resource and the character set.

[0026] Optionally, after determining whether to switch the facial expression animation based on the control information, the method further includes:

[0027] When it is determined not to switch the facial animation, the display state of the facial animation is controlled, including: playback state or paused state.

[0028] Optionally, applied to a backend server, the method for displaying animated expressions includes:

[0029] When an upload request is received, obtain the image sequence number of the images to be converted in the batch upload;

[0030] The acquired image outlines are converted into SVG format images, and the SVG format images are then batch converted into TTF files.

[0031] Obtain the Unicode code generated from the TTF file, write it into the database table, and perform a search to remove duplicates from the original database table to obtain a new database table;

[0032] The JSON file is determined based on the Unicode code and the image serial number, and the JSON file contains the correspondence between the emoji resource animation and the character set;

[0033] The TTF and JOSN files are packaged into an emoji resource file, which is then saved on a backend server.

[0034] Optionally, the step of converting the acquired image contours into SVG format images and batch converting the SVG format images to TTF files includes:

[0035] Convert the image outline extracted using OpenCV into an SVG format image;

[0036] Use FontForge to batch convert SVG format images to TTF files.

[0037] Furthermore, to achieve the above objectives, the present invention also proposes an facial expression animation display system, the facial expression animation display system comprising:

[0038] In-vehicle facial animation display device, central control host, and back-end server;

[0039] The backend server is used to acquire images to be converted in batches, convert the images to be converted into TTF files, and send the TTF files to the central control host;

[0040] The central control unit is used to acquire the TTF file and send the TTF file to the in-vehicle facial animation display device;

[0041] The central control unit is also used to acquire control commands through voice recognition and send control commands to the in-vehicle facial animation display device;

[0042] The in-vehicle facial animation display device is used to receive the TTF file and upgrade and switch the display of facial animation resources according to the control instructions.

[0043] Optionally, the in-vehicle facial animation display device includes a Bluetooth module, the central control host includes a Bluetooth module and a wireless WiFi module, and the back-end server includes a network module;

[0044] The in-vehicle facial animation display device and the central control host interact with each other via Bluetooth module;

[0045] The central control host and the back-end server exchange data via a wireless WiFi module and a network module.

[0046] The facial expression animation display system further includes: a memory, a processor, and a facial expression animation display program stored in the memory and executable on the processor, wherein the facial expression animation display program is configured to implement the facial expression animation display method described above.

[0047] This invention discloses a method and system for displaying animated facial expressions. The method includes: when displaying animated facial expressions, acquiring control commands sent by a central control unit and parsing the control commands to obtain parsed control information; determining whether to upgrade the animated facial expressions based on the control information; if it is determined not to upgrade the animated facial expressions, determining whether to switch the animated facial expressions based on the control information; if it is determined to switch the animated facial expressions, acquiring animated facial expression resources in TTF font file format from a character set; and switching the font image according to the animated facial expression resources and adapting it to the screen display. By displaying animated images using vector font TTF and controlling the upgrade display of animated facial expressions through Bluetooth service parsing commands, the smoothness of the animated facial expressions display and the ability to dynamically adapt can be guaranteed, meeting the real-time update requirements of animated facial expression resources in the MCU system. Attached Figure Description

[0048] Figure 1 This is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiments of the present invention;

[0049] Figure 2 This is a flowchart illustrating the first embodiment of the facial expression animation display method of the present invention;

[0050] Figure 3 This is a flowchart illustrating the second embodiment of the facial expression animation display method of the present invention;

[0051] Figure 4 This is a flowchart illustrating the third embodiment of the facial expression animation display method of the present invention;

[0052] Figure 5 This is a flowchart illustrating the upgrade and display process of the facial expression animation module in one embodiment of the facial expression animation display method of the present invention.

[0053] Figure 6This is a flowchart illustrating the fourth embodiment of the facial expression animation display method of the present invention;

[0054] Figure 7 This is a system module diagram of an embodiment of the facial expression animation display system of the present invention.

[0055] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0056] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.

[0057] Reference Figure 1 , Figure 1 This is a schematic diagram of the structure of the facial expression animation display device in the hardware operating environment involved in the embodiments of the present invention.

[0058] like Figure 1 As shown, the facial expression animation display device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wireless-Fidelity (Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.

[0059] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the facial animation display device and may include more or fewer parts than shown, or combine certain parts, or have different arrangements of parts.

[0060] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a network communication module, a user interface module, and an expression animation display program.

[0061] exist Figure 1In the illustrated facial animation display device, the network interface 1004 is mainly used for data communication with the network integrated platform workstation; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and memory 1005 in the facial animation display device of the present invention can be set in the facial animation display device, and the facial animation display device calls the facial animation display program stored in the memory 1005 through the processor 1001 and executes the facial animation display method provided in the embodiment of the present invention.

[0062] Based on the above hardware structure, an embodiment of the facial expression animation display method of the present invention is proposed.

[0063] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the facial expression animation display method of the present invention.

[0064] In the first embodiment, the facial expression animation display method includes the following steps:

[0065] Step S10: When displaying facial animation, obtain the control command sent by the central control host, and parse the control command to obtain the parsed control information.

[0066] It should be noted that the executing entity in this embodiment is an in-vehicle facial animation display device, which refers to a device that includes external speakers, SD card readability, USB and Bluetooth functionality, a simple amplifier, TV reception, and audio output. It is typically installed near the dashboard, on the roof, or behind the seats. Other devices with the same or similar functions, such as in-vehicle displays, can also be used; this embodiment does not limit this. In this embodiment, an in-vehicle facial animation display device is used as an example for explanation.

[0067] It should be understood that facial expression animation display refers to the facial expression animation resources converted and transmitted from the backend server to the display device for storage, and then, after being controlled by control information, whether to upgrade or switch the expressions and display them. The central control unit is used to acquire voice control commands through the voice control module and send them to the in-vehicle animation display device. Control commands refer to the control commands converted from the acquired voice commands.

[0068] Understandably, the system receives control commands from the central control unit, parses them to obtain control information, and then uses this information to control the display of facial animations. For example, when the driver prompts for an facial animation upgrade, and the central control unit's voice recognition command is "upgrade facial animation," it transmits the upgrade command as control information to the in-vehicle animation display device. After parsing and obtaining the upgrade facial animation information, the in-vehicle animation display device will upgrade and update the system's facial animation resources.

[0069] Step S20: Determine whether to upgrade the facial animation based on the control information.

[0070] It should be noted that the control information is obtained by converting the voice signals of the commands to upgrade or switch facial expressions into text information using speech recognition and text-to-speech technologies. Upon receiving the control information, a determination is made as to whether to upgrade the facial expression animation.

[0071] Step S30: If it is determined that the facial animation will not be upgraded, determine whether to switch the facial animation based on the control information.

[0072] It should be understood that determining not to upgrade the facial animation means that the current device receives control information from the control command parsing indicating that the facial animation should not be upgraded. In this case, there is no need to upgrade the facial animation resources, and the system still stores the original facial resource files for the driver's use. Then, the next step is performed based on whether the control information obtained from parsing the facial switching command indicates switching facial expressions or not switching facial expressions.

[0073] Furthermore, after step S30, the method also includes: controlling the display state of the facial expression animation when it is determined not to switch the facial expression animation.

[0074] It should be noted that when it is determined not to switch the emoji animation, it means that the current device obtains the control information obtained from the control command parsing and determines not to switch the emoji animation. The display status of the emoji animation refers to whether the emoji animation is in a playing state or a paused state.

[0075] Understandably, when the obtained control information is "do not upgrade emoticons" and "do not switch emoticons," the table controls the display state of the emoticon animation. For example, if the driver decides not to upgrade the emoticon and not to switch it, the table controls the display state of the current emoticon, showing it as either play or paused, and the driver can choose between play or pause.

[0076] Step S40: When determining to switch emoji animations, obtain emoji resource animations in TTF font file format from the character set.

[0077] It should be noted that a character set refers to a collection of different fonts. In this embodiment, the TTF font file format is a subset of the character set. The TTF font file format for emoticon resources refers to emoticon resources presented in TTF font format after TTF conversion.

[0078] Furthermore, step S40 also includes: obtaining the identification code corresponding to the control information; obtaining a pre-stored JSON file based on the identification code; and obtaining emoticon resource animations in TTF font file format from the character set based on the identification code.

[0079] It should be noted that the identification code corresponding to the control information refers to the identification code of the switched emoticon animation, and each emoticon animation has a unique identification code. The pre-stored JSON file refers to the JSON file stored in the system, which contains the correspondence between the emoticon resource animation corresponding to the identification code and the character set.

[0080] Understandably, the system retrieves the identification code, iterates through the JSON file to find the corresponding emoji animation resource and character set, and then obtains the emoji animation resource in TTF font file format from the character set. For example, when confirming the switch of emoji animation, the system obtains the identification code for the next emoji animation, searches the JSON file, and retrieves the corresponding TTF font file for the next emoji animation.

[0081] Step S50: Switch the font image according to the emoticon resource animation and adapt it to the screen display.

[0082] It's important to note that animation is achieved by switching images frame by frame, and similarly, emoji animation is achieved by switching font images. "Adapting to screen display" refers to displaying the emoji animation on the screen itself.

[0083] Understandably, due to the different screen sizes, it's necessary to adapt the display of emoji animations to the screen size. For example, if the current identification code is 101, the emoji animation resource corresponding to 101 is obtained, and the font image is continuously switched to form the emoji animation. If the screen size is 1024px, since the images are vector images, they can be losslessly transformed according to the screen size.

[0084] This embodiment obtains control commands sent by the central control unit during the display of facial animations, parses the commands to obtain parsed control information, determines whether to upgrade the facial animation based on the control information, and decides whether to switch the facial animation based on the control information if upgrading is not required. If switching is determined, facial animation resources in TTF font file format are obtained from the character set. The font image is then switched according to the facial animation resources and adapted to the screen display. By displaying animated images using vector font TTF and controlling the upgrade display of facial animations through Bluetooth service parsing commands, the smoothness and dynamic adaptation capabilities of the facial animation display can be guaranteed, meeting the real-time update requirements of facial animation resources in the MCU system.

[0085] In the first embodiment, as Figure 3 The second embodiment of the facial expression animation display method, prior to step S40, includes:

[0086] Step S401: Build a lightweight embedded graphics library.

[0087] It's important to note that the lightweight embedded graphics library refers to LVGL. Its key feature is its variety of modular graphics components, support for multiple input devices such as touchscreens, keyboards, encoders, and buttons, and support for multiple display devices. LVGL is not dependent on a specific hardware platform and can run on any display screen.

[0088] Understandably, the lightweight embedded graphics library was created to port the FreeType library, and font animations were displayed using the framework of the lightweight embedded graphics library.

[0089] Step S402: Port the FreeType library using a lightweight embedded graphics library.

[0090] It's understandable that the FreeType library refers to a portable font engine that provides a unified interface to access various font format files. The porting process mainly involves downloading and generating the FreeType dynamic library from the official website, unzipping and installing it, checking the directory structure, downloading the official interface lv_lib_freetype, copying the entire lv_lib_freetype folder to the embedded graphics library project directory, creating a separate lib directory, placing lv_lib_freetype in the lib directory, merging the header files from the library directory into the lv_lib_freetype directory, adding an mk file under lv_lib_freetype, and then returning to the project directory to add the link path and linked library to the Makefile, completing the porting of the lightweight embedded graphics library LVGL to the FreeType library.

[0091] This embodiment establishes a lightweight embedded graphics library and then ports the FreeType library through this lightweight embedded graphics library. Through this method, the FreeType library ported from LVGL enables the corresponding font images to display correctly and adapt to the screen, thus completing the font image switching.

[0092] In the first embodiment, as Figure 4 The third embodiment of the facial expression animation display method further includes, after step S20:

[0093] Step S201: When it is determined to upgrade the facial animation, obtain the facial animation resource file;

[0094] It should be noted that when upgrading the emoji animation is determined, it means that the current device receives control information from the control commands that indicates an upgrade of the emoji animation. In this case, the emoji animation resources need to be upgraded. The emoji animation resource file refers to the emoji animation resource file transmitted from the server, which is obtained by packaging a TTF file and a JSON file.

[0095] It should be understood that when different emoticon animations are needed, the display page cannot be displayed because the corresponding emoticon animation resources are not present in the system files. Therefore, it is necessary to update the system files to obtain the latest emoticon animations.

[0096] Step S202: Extract the corresponding files from the facial animation resource files and configure them.

[0097] It's understandable that extracting emoticon animation resource files refers to extracting the emoticon animation resource files sent from the server. These files are TTF and JSON files, which are then configured within the system after being obtained.

[0098] Further, step S202 includes: reading the TTF file from the facial animation resource and storing it in the FONTS directory, and reading the JSON file and writing it into the system JSON file.

[0099] It should be noted that the system's JSON file contains the mapping between emoji resource animations and character sets. Figure 5 This is a flowchart illustrating the upgrade and switching display process of the facial expression animation module in one embodiment of the facial expression animation display method of the present invention. After porting the FreeType library to the embedded graphics library, the display of font images can be realized. First, it is determined whether to upgrade the facial expressions. If the facial expressions are upgraded, the corresponding files are extracted from the file package and configured in the system. If the facial expressions are not upgraded, it is determined whether to switch the display of the facial expression animation. If the facial expression animation is switched, FreeType obtains the correspondence between the character set and the facial expression animation resource through the corresponding identification code and loads the character set. The embedded graphics library switches the display of the facial expression animation on the font image. If the facial expressions are not switched, the state of the facial expression animation is controlled.

[0100] This embodiment determines when to upgrade facial animations by obtaining facial animation resource files, extracting and configuring corresponding files from these files, reading TTF files from the facial animation resources and storing them in the FONTS directory, and reading JSON files and writing them to the system JSON file. By configuring the updated facial animation resources in this way, the richness of facial animation resources in the in-vehicle display device can be improved.

[0101] In the first embodiment, as Figure 6 The fourth embodiment of the facial expression animation display method further includes:

[0102] Step S10': Upon receiving an upload request, obtain the image sequence number of the images to be converted in batches.

[0103] It should be noted that this embodiment applies to the server side. Receiving an upload request refers to receiving a request from the user to upload an image. The sequence number of the image to be converted refers to the sequence number of the image uploaded by the user that needs to be converted.

[0104] Understandably, after obtaining the serial number of the image uploaded by the user, it is necessary to match the different serial numbers with the corresponding images.

[0105] Step S20': Convert the acquired image outline into an SVG format image, and batch convert the SVG format images into TTF files.

[0106] It should be noted that SVG format images refer to editable images. In this embodiment, the purpose of converting SVG format images to editable images is to batch convert SVG images to TTF files.

[0107] Further, step S20 includes: converting the image outline extracted by OpenCV into an SVG format image; and batch converting the SVG format images into TTF files using FontForge.

[0108] Understandably, when converting an image to SVG format, the outline is saved as an SVG image. The `findContorus` function in OpenCV is used to calculate the outline in the Canny image. The outline must be sharp. The outline path is then converted to an SVG path. This can be done in any image processing software, such as Inkscape or Photoshop, by obtaining the SVG path from the software and saving the converted SVG image to a specified folder. FontForge refers to a font editing and creation tool; SVG glyphs created using FontForge are saved as TTF files.

[0109] Step S30': Obtain the Unicode code generated by the TTF file, write it into the database table, and perform a search to remove duplicates from the original database table to obtain a new database table.

[0110] Understandably, Unicode codes are obtained by parsing TTF font files, with each character corresponding to a specific Unicode code.

[0111] Step S40': Determine the JSON file based on the Unicode code and the image sequence number.

[0112] Understandably, the JSON file contains the correspondence between emoji resource animations and character sets. The character set refers to the set of characters composed of Unicode codes, while the emoji resource animation refers to the ID of each emoji animation.

[0113] Step S50': Package the TTF file and JOSN file into an emoji resource file, and save the emoji resource file on the background server.

[0114] It is understandable that the TTF file and JOSN file are packaged into an .pak file containing emoticon resources and then saved by the server. After the central control unit receives the emoticon animation upgrade request from the in-vehicle emoticon display device, it will transmit the emoticon animation resource file package downloaded from the backend server to the in-vehicle animation display device.

[0115] This embodiment obtains the image sequence number of the images to be converted in batches upon receiving an upload request; converts the images into SVG format images based on the obtained image outlines, and then batches the SVG format images into TTF files; obtains the Unicode code generated from the TTF files, writes it into a database table, and performs a lookup and deduplication process on the original database table to obtain a new database table; determines a JSON file based on the Unicode code and the image sequence number, and the JSON file contains the correspondence between emoticon resource animations and character sets; and packages the TTF files and JSON files into an emoticon resource file and saves it on a background server. Through the above method, the original images are formatted and converted to emoticon animation resource files via TTF conversion, thereby ensuring that the emoticon animation resource format matches when the system updates the emoticon resource files.

[0116] Furthermore, this embodiment of the invention also proposes a storage medium storing an expression animation display program, which, when executed by a processor, implements the steps of the expression animation display method described above.

[0117] Since this storage medium adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be repeated here.

[0118] In addition, refer to Figure 7 This invention also proposes an expression animation display system, which includes:

[0119] The background server 10 is used to obtain the images to be converted in batches, convert the images to be converted into TTF files, and send the TTF files to the central control host;

[0120] The central control unit 20 is used to acquire TTF files and send the TTF files to the in-vehicle facial animation display device;

[0121] The in-vehicle facial animation display device 30 is used to receive the TTF file and upgrade and switch the display of facial animation resources according to the control instructions.

[0122] This embodiment obtains control commands sent by the central control unit during the display of facial animations, parses the commands to obtain parsed control information, determines whether to upgrade the facial animation based on the control information, and decides whether to switch the facial animation based on the control information if upgrading is not required. If switching is determined, facial animation resources in TTF font file format are obtained from the character set. The font image is then switched according to the facial animation resources and adapted to the screen display. By displaying animated images using vector font TTF and controlling the upgrade display of facial animations through Bluetooth service parsing commands, the smoothness and dynamic adaptation capabilities of the facial animation display can be guaranteed, meeting the real-time update requirements of facial animation resources in the MCU system.

[0123] In this embodiment, the backend server 10 further includes a network module.

[0124] In this embodiment, the central control host 20 also includes a Bluetooth module and a wireless WiFi module.

[0125] In this embodiment, the central control host 20 is also used to acquire control commands through voice recognition and send control commands to the in-vehicle facial animation display device;

[0126] In this embodiment, the in-vehicle facial animation display device 30 also includes a Bluetooth module.

[0127] In this embodiment, the in-vehicle facial animation display device 30 and the central control host 20 interact via Bluetooth module.

[0128] In this embodiment, the central control host 20 and the back-end server 10 interact with each other via a wireless WiFi module and a network module.

[0129] In this embodiment, the in-vehicle facial animation display device 30 uses an MCU as the main control chip, includes a Bluetooth module, and runs an RTOS system. The graphics system uses the lightweight embedded graphics library LVGL for displaying the facial animation module. It receives voice commands from the central control unit 20 via the Bluetooth module to control the facial animation and upgrade facial animation resources. The central control unit 20 includes Bluetooth and Wi-Fi modules, and a voice recognition module. It interacts with the user through the voice recognition module, connects to the backend service system via the Wi-Fi module to download facial animation resources, and achieves two-way communication with the in-vehicle intelligent voice assistant via the Bluetooth module. The backend server 10 includes an upload / download module and a TTF converter module. The upload / download module is used for users to upload facial animation sequences and to receive download requests from the central control unit. The TTF converter module converts the user-uploaded image sequences into TTF font files and encoding mapping configuration JSON files, and packages them into facial animation resource files.

[0130] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of this invention. In practical applications, those skilled in the art can select some or all of the workflow to achieve the purpose of this embodiment according to actual needs, and no restrictions are imposed here.

[0131] In addition, for technical details not described in detail in this embodiment, please refer to the facial animation display method provided in any embodiment of the present invention, which will not be repeated here.

[0132] Other embodiments or implementation methods of the facial expression animation display device described in this invention can be found in the above-described method embodiments, and will not be repeated here.

[0133] Furthermore, it should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0134] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0135] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory (ROM) / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, all-in-one platform workstation, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0136] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A method for displaying animated facial expressions, characterized in that, The method, applied to an in-vehicle facial animation display device, includes: When displaying facial animations, the system obtains control commands sent by the central control unit, parses the control commands, and obtains the parsed control information. Determine whether to upgrade the facial animation based on the control information; If it is determined not to upgrade the facial animation, the control information is used to determine whether to switch the facial animation. When determining the emoji animation to switch, retrieve the emoji resource animation in TTF font file format from the character set; The font image is switched according to the animated emoji resource and adapted to the screen display.

2. The method as described in claim 1, characterized in that, The animated emoji resources obtained from the character set in TTF font file format include: Obtain the identification code corresponding to the control information; Obtain a pre-stored JSON file based on the identification code. The JSON file contains the correspondence between the emoji resource animations corresponding to the identification code and the character set. The TTF font file format emoji resource animation is obtained from the character set based on the identification code.

3. The method as described in claim 1, characterized in that, Before obtaining the emoji resource animation in TTF font file format from the character set, the following steps are also included: Develop a lightweight embedded graphics library; Porting the FreeType library using a lightweight embedded graphics library; The animated emoji resources obtained from the character set in TTF font file format include: The character set is loaded using the FreeType library, and emoji resource animations in TTF font file format are obtained from the character set.

4. The method as described in claim 1, characterized in that, After determining whether to upgrade the facial animation based on the control information, the process further includes: When it is determined to upgrade the emoji animation, obtain the emoji animation resource files; Extract the corresponding files from the facial animation resource files and configure them.

5. The method as described in claim 4, characterized in that, The facial animation resource files include TTF files and JSON files; The extraction and configuration of corresponding files from the facial animation resource files includes: The TTF file in the emoticon animation resource is read and stored in the FONTS directory. The JSON file is read and written to the system JSON file, which contains the correspondence between the emoticon animation resource and the character set.

6. The method according to any one of claims 1 to 5, characterized in that, After determining whether to switch the facial expression animation based on the control information, the method further includes: When it is determined not to switch the facial animation, the display state of the facial animation is controlled, including: playback state or paused state.

7. A method for displaying animated facial expressions, characterized in that, The method for displaying animated emoticons, applied to a backend server, includes: When an upload request is received, obtain the image sequence number of the images to be converted in the batch upload; The acquired image outlines are converted into SVG format images, and the SVG format images are then batch converted into TTF files. Obtain the Unicode code generated from the TTF file, write it into the database table, and perform a search to remove duplicates from the original database table to obtain a new database table; The JSON file is determined based on the Unicode code and the image serial number, and the JSON file contains the correspondence between the emoji resource animation and the character set; The TTF and JOSN files are packaged into an emoji resource file, which is then saved on a backend server.

8. The method as described in claim 7, characterized in that, The step of converting the acquired image contours into SVG format images and batch converting the SVG format images to TTF files includes: Convert the image outline extracted using OpenCV into an SVG format image; Use FontForge to batch convert the SVG format images to TTF files.

9. An animated facial expression display system, characterized in that, The facial animation display system includes an in-vehicle facial animation display device, a central control host, and a back-end server; The backend server is used to acquire images to be converted in batches, convert the images to be converted into TTF files, and send the TTF files to the central control host; The central control unit is used to acquire the TTF file and send the TTF file to the in-vehicle facial animation display device; The central control unit is also used to acquire control commands through voice recognition and send control commands to the in-vehicle facial animation display device; The in-vehicle facial animation display device is used to acquire control commands sent by the central control host when displaying facial animations, and to parse the control commands to obtain parsed control information. Determine whether to upgrade the facial animation based on the control information; If it is determined not to upgrade the emoji animation, the control information is used to determine whether to switch the emoji animation; if it is determined to switch the emoji animation, the emoji resource animation in TTF font file format is obtained from the character set; The font image is switched according to the animated emoji resource and adapted to the screen display.

10. The system as described in claim 9, characterized in that, The in-vehicle facial animation display device includes a Bluetooth module, the central control host includes a Bluetooth module and a wireless WiFi module, and the back-end server includes a network module; The in-vehicle facial animation display device and the central control host interact with each other via Bluetooth module; The central control host and the back-end server exchange data via a wireless WiFi module and a network module.

Images