Virtual character control methods, vehicle terminals and servers

Abstract

This invention provides a method for controlling a virtual character, an in-vehicle terminal, and a server. Based on the recognition of a user's smile, the virtual character corresponding to that user is encouraged to grow. This establishes a close connection between the changes in the virtual character and the user, and this connection motivates the user to smile more often to further the growth of the virtual character, thus maintaining a positive mood for the user. Furthermore, the growth of the virtual character also enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

Description

Technical Field

[0001] This invention relates to the field of information technology, and in particular to a method for controlling virtual characters, an in-vehicle terminal, and a server. Background Technology

[0002] With the continuous development of Internet and information technology, various terminal devices have been widely used, and their functions have become increasingly rich.

[0003] In recent years, technologies have emerged that allow the display and control of virtual avatars on terminal devices, such as using cartoon avatars to play information and interact with users.

[0004] It should be noted that the above description of the technical background is only for the purpose of providing a clear and complete explanation of the technical solutions of the present invention and facilitating understanding by those skilled in the art. It should not be assumed that the above technical solutions are known to those skilled in the art simply because they have been described in the background section of this invention. Summary of the Invention

[0005] The inventors discovered that the virtual avatars currently displayed on terminal devices have relatively fixed appearances, which can easily cause users to lose interest after a period of use, resulting in a poor user experience. Furthermore, because existing virtual avatars only interact with users based on preset voices and actions, they cannot establish a closer connection with users, thus reducing the user experience.

[0006] To address at least one of the problems in the prior art, embodiments of the present invention provide a virtual character control method, an in-vehicle terminal, and a server. Based on the recognition of a user's smile, the method promotes the growth of the virtual character corresponding to that user. This establishes a close connection between the changes in the virtual character and the user, and this connection encourages the user to smile more often, thus promoting the growth of the virtual character and maintaining a positive mood. Furthermore, the growth of the virtual character enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0007] In addition, for example, when the method and apparatus are applied to in-vehicle devices, the growth of virtual characters can be promoted based on the recognition of the vehicle user's smile, which can also help the vehicle user maintain a good mood, thereby improving the user's concentration and driving safety.

[0008] According to a first aspect of the present invention, a method for controlling a virtual character is provided, the method comprising: recognizing a user's smile based on first information collected to obtain a first smile recognition result; and causing the virtual character corresponding to the user to grow based on the first smile recognition result.

[0009] According to a second aspect of the present invention, the step of causing the virtual character corresponding to the user to grow based on the first smile recognition result includes: determining the user's smile level based on the first smile recognition result; determining a first processing result based on the smile level and a first processing rule; and causing the virtual character corresponding to the user to grow based on the first processing result and / or the cumulative result of the first processing result.

[0010] According to a third aspect of the present invention, the step of causing the virtual character corresponding to the user to grow based on the first smile recognition result includes: determining a first processing result when the first smile recognition result contains a smile; and causing the virtual character corresponding to the user to grow when the first processing result is greater than a first threshold, and / or when the cumulative result of the first processing result is greater than a second threshold.

[0011] According to a fourth aspect of the present invention, wherein the first information is obtained by an in-vehicle device, the control method for the virtual character further includes: recognizing a user's smile based on the second information collected by the mobile terminal to obtain a second smile recognition result; determining a second processing result when the second smile recognition result contains a smile; and causing the virtual character corresponding to the user to grow based on the second processing result and / or the cumulative result of the second processing result.

[0012] According to a fifth aspect of the present invention, a final cumulative result is determined based on the cumulative result of the first processing result and the cumulative result of the second processing result, and the virtual character corresponding to the user is made to grow based on the final cumulative result.

[0013] According to a sixth aspect of the present invention, when the second smile recognition result is that it contains a smile, determining the second processing result includes: determining the user's smile level based on the second smile recognition result; and determining the second processing result based on the smile level and a second processing rule.

[0014] According to a seventh aspect of the present invention, a first processing result determined according to the first processing rule causes a virtual character to grow faster, corresponding to the same smile level, compared to a second processing result determined according to the second processing rule.

[0015] According to an eighth aspect of the present invention, when the user includes at least two users, the smiles of the at least two users are identified respectively based on the collected first information to obtain a first smile identification result for each of the at least two users; when the first smile identification result of at least one user is that it contains a smile, a first processing result for each of the at least one user is determined, and the virtual character corresponding to each of the at least one user is made to grow based on the first processing result and / or the cumulative result of the processing result for each of the at least one user.

[0016] According to a ninth aspect of the present invention, when the user includes at least two users, the smiles of the at least two users are identified respectively based on the collected first information to obtain a first smile identification result for each of the at least two users; when the first smile identification result of at least one user is that it contains a smile, a first processing result of the at least one user is determined, and the virtual character corresponding to the first user among the at least two users is made to grow based on the first processing result of the at least one user and / or the cumulative result of the first processing result.

[0017] According to a tenth aspect of the present invention, the method for controlling the virtual character further includes: displaying virtual characters corresponding to at least two users on the same screen.

[0018] According to an eleventh aspect of the present invention, the virtual characters corresponding to the at least two users have a specific relationship, and the virtual characters corresponding to the at least two users are able to interact with each other in accordance with the specific relationship.

[0019] According to a twelfth aspect of the present invention, the at least two users are at least two users traveling in the same vehicle.

[0020] According to a thirteenth aspect of the present invention, the growth of the virtual character includes at least one of the following: a change in the appearance of the virtual character; an increase in the actions of the virtual character; and an increase in the number of virtual characters.

[0021] According to a fourteenth aspect of the present invention, when the number of virtual characters increases to at least two, the at least two virtual characters have a specific relationship, and the at least two virtual characters are able to interact with each other in accordance with the specific relationship.

[0022] According to a fifteenth aspect of the present invention, the method for controlling the virtual character further includes: causing the virtual character to dynamically change in response to the user's voice, actions, or facial expressions.

[0023] According to a sixteenth aspect of the present invention, the method for controlling the virtual character further includes: increasing the user's points based on the growth level of the virtual character.

[0024] According to a seventeenth aspect of the present invention, the first information includes: first image information of the user collected by the vehicle-mounted device, and / or, first audio information of the user collected by the vehicle-mounted device; the second information includes: second image information of the user collected by the mobile terminal, and / or, second audio information of the user collected by the mobile terminal.

[0025] According to an eighteenth aspect of the present invention, a vehicle-mounted terminal is provided, the vehicle-mounted terminal comprising: a memory for storing a computer program; and a processor for implementing, when executing the computer program, the virtual character control method described in any one of the first to seventeenth aspects of the present invention.

[0026] According to a nineteenth aspect of the present invention, a server is provided, the server comprising: a memory for storing a computer program; and a processor for implementing, when executing the computer program, the virtual character control method described in any one of the first to seventeenth aspects of the present invention.

[0027] One of the beneficial effects of this invention is that it promotes the growth of the virtual character corresponding to the user based on the recognition results of the user's smile. This establishes a close connection between the changes in the virtual character and the user, and this connection encourages the user to smile more to promote the growth of the virtual character, thus maintaining a positive mood. Furthermore, the growth of the virtual character also enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0028] In addition, for example, when the method and apparatus are applied to in-vehicle devices, the growth of virtual characters can be promoted based on the recognition of the vehicle user's smile, which can also help the vehicle user maintain a good mood, thereby improving the user's concentration and driving safety.

[0029] Furthermore, by assigning levels to smiles and promoting the growth of virtual characters based on smile levels and preset rules, an appropriate growth mechanism can be provided for the growth of virtual characters. Moreover, higher-level smiles can promote the growth of virtual characters more quickly, thereby further improving the user experience.

[0030] Furthermore, when the first processing result obtained based on the first smile recognition result is greater than the first threshold, and / or when the cumulative result of the first processing result is greater than the second threshold, the virtual character corresponding to the user is allowed to grow, thus providing an appropriate growth mechanism for the growth of the virtual character.

[0031] Furthermore, in addition to recognizing users' smiles through information collected by in-vehicle devices to promote the growth of virtual characters, information can also be collected through mobile terminals to recognize users' smiles and promote the growth of virtual characters. This diversifies the growth path of virtual characters and can further enhance the user experience.

[0032] Furthermore, information collected through in-vehicle devices can accelerate the growth of virtual characters compared to mobile terminals, thereby providing an appropriate character growth mechanism.

[0033] Furthermore, when at least two users are involved, the growth of each user's virtual character can be promoted based on the smile recognition results of each user, and the virtual characters of at least two users can be displayed on the same screen. In this way, interaction can be generated between at least two users, thereby further enhancing the user experience.

[0034] Furthermore, by establishing specific relationships between at least two users' respective virtual characters and interacting with those relationships, it is beneficial to create a harmonious atmosphere among users and enhance their sense of intimacy, thereby further improving the user experience.

[0035] Furthermore, these at least two users must be passengers in the same vehicle. This creates a positive atmosphere within the vehicle, further enhancing driving safety and user experience.

[0036] Furthermore, when at least two users are involved, the smile recognition results of at least two users can be used to promote the growth of one of the users, such as the virtual character of the driver. This can enhance the driver's driving pleasure and motivation, thereby further improving driving safety and user experience.

[0037] Furthermore, the growth of the virtual character can include at least one of the following: changes in the virtual character's appearance, increases in the virtual character's actions, and increases in the number of virtual characters. In this way, changes in the virtual character's appearance can enrich the user's visual experience, changes in the virtual character's actions can expand the functions that the user can use, and increases in the number of virtual characters can greatly enhance the user's enjoyment of using the device, thereby further improving the user experience.

[0038] Furthermore, when the number of virtual characters increases to at least two, there is a specific relationship between the at least two virtual characters, and the at least two virtual characters can interact in accordance with the specific relationship. This can further increase the fun of the virtual characters and further enhance the user experience.

[0039] Furthermore, the virtual character can be made to dynamically change in response to the user's voice, actions, or facial expressions. This creates a dynamic interaction between the virtual character and the user, further enhancing the user experience. In addition, it can encourage users to use voice functions more often, which can further improve driving safety when applied to vehicles.

[0040] Furthermore, the user's points can be increased based on the virtual character's growth level, which can further enhance the user's enthusiasm for using the device and improve the user experience.

[0041] Embodiments of the present invention are disclosed in detail with reference to the following description and accompanying drawings. It should be understood that the embodiments of the present invention are not limited in scope thereto. Within the spirit and scope of the appended claims, embodiments of the present invention include many changes, modifications, and equivalents.

[0042] Features described and / or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, combined with features in other embodiments, or substituted for features in other embodiments.

[0043] It should be emphasized that the term "including / contains / has" as used herein refers to the presence of a feature, whole or component, but does not exclude the presence or addition of one or more other features, wholes or components. Attached Figure Description

[0044] The above and other objects, features and advantages of embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0045] Figure 1 This is a flowchart of one embodiment of the virtual character control method of Embodiment 1 of the present invention;

[0046] Figure 2 This is a flowchart of one embodiment of the method for implementing step 102 of Embodiment 1 of the present invention;

[0047] Figure 3 This is a flowchart of another embodiment of the virtual character control method of Embodiment 1 of the present invention;

[0048] Figure 4 This is a flowchart of one embodiment of the virtual character control method of Embodiment 2 of the present invention;

[0049] Figure 5 This is a flowchart of another embodiment of the virtual character control method of Embodiment 2 of the present invention;

[0050] Figure 6This is a schematic block diagram of the system configuration of the vehicle terminal in Embodiment 3 of the present invention;

[0051] Figure 7 This is a schematic block diagram of the system configuration of the server in Embodiment 4 of the present invention. Detailed Implementation

[0052] Referring to the accompanying drawings, the foregoing and other features of the invention will become apparent from the following description. Specific embodiments of the invention are specifically disclosed in the description and drawings, illustrating partial implementations in which the principles of the invention can be employed. It should be understood that the invention is not limited to the described embodiments, but includes all modifications and equivalents falling within the scope of the appended claims.

[0053] The following description, in conjunction with the accompanying drawings, illustrates the virtual character control method, vehicle-mounted terminal, and server according to embodiments of the present invention.

[0054] Example 1

[0055] Embodiment 1 of the present invention provides a method for controlling virtual characters.

[0056] Figure 1 This is a flowchart of one embodiment of the virtual character control method of Embodiment 1 of the present invention. Figure 1 As shown, the control methods for this virtual character include:

[0057] Step 101: Recognize the user's smile based on the collected first information to obtain the first smile recognition result; and

[0058] Step 102: Based on the first smile recognition result, make the virtual character corresponding to the user grow.

[0059] Because the growth of a user's virtual avatar is driven by the recognition of their smiles, a close connection is established between the avatar's changes and the user. This connection encourages the user to smile more, thus promoting the avatar's growth and maintaining a positive mood. Furthermore, the growth of the virtual avatar enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0060] Additionally, for example, when this method is applied to in-vehicle devices, the growth of virtual characters can be facilitated by recognizing the smiles of vehicle users. This can also help vehicle users maintain a good mood, thereby improving user focus and driving safety.

[0061] In this embodiment of the invention, the method can be executed by a terminal device or by a server connected to the terminal device.

[0062] For example, when a user begins using a terminal device, the method is continuously executed by the terminal device or a server connected to the terminal device.

[0063] In this embodiment of the invention, the first information is collected in real time, that is, continuously. When the first smile recognition result obtained in step 101 is no smile, the process returns to re-execute the step, that is, smile recognition continues based on the first information collected in real time.

[0064] In this embodiment of the invention, the user can be a user using various devices; this embodiment uses a vehicle user as an example for illustration. Furthermore, the user can be at least one user.

[0065] In this embodiment of the invention, the first information collected is obtained, for example, through an in-vehicle device. For example, the first information includes: the user's first image information collected by the in-vehicle device, and / or the user's first audio information collected by the in-vehicle device.

[0066] For example, the in-vehicle camera can capture the facial image of the user inside the vehicle as the first image information, and the in-vehicle microphone can capture the user's voice as the first audio information.

[0067] In step 101, the user's smile is identified based on the first information collected to obtain the first smile recognition result. The smile recognition based on the first information collected can be referenced from relevant technologies.

[0068] For example, existing models or algorithms can be used to recognize a user's facial expressions to determine whether the user's expressions contain features of "laughter"; in addition, existing models or algorithms can be used to recognize a user's speech to determine whether the user's speech contains sounds with features of "laughter".

[0069] For example, the model is based on a deep neural network and is trained.

[0070] In this embodiment of the invention, the first smile recognition result is, for example, "smile" or "no smile". In addition, the "smile" can be divided into levels, for example, the first smile recognition result is "smiling", "normal smile", "laughing", etc.

[0071] In step 102, the virtual character corresponding to the user is made to grow based on the first smile recognition result.

[0072] In this embodiment of the invention, the virtual character can be any type of virtual image, and the virtual image has a defined role. For example, a cartoon pet, a character, etc.

[0073] In this embodiment of the invention, the growth of a virtual character may include at least one of the following: a change in the appearance of the virtual character; an increase in the actions of the virtual character; and an increase in the number of virtual characters.

[0074] In this way, changing the appearance of virtual characters can enrich the user's visual experience, the actions of virtual characters can expand the functions that users can use, and the increase in the number of virtual characters greatly enhances the fun of using the device, which can further improve the user experience.

[0075] In embodiments of the present invention, changes to the image of a virtual character may include, for example, changes in age and appearance, skin color, clothing, and body shape.

[0076] In this embodiment of the invention, the virtual character's actions are increased to include, for example, the ability to jump, roll, make faces, and wave hands.

[0077] In this embodiment of the invention, increasing the number of virtual characters means that the number of virtual characters corresponding to the user can be increased from the initial one to two or more different characters.

[0078] In addition, when the number of virtual characters increases to at least two, the at least two virtual characters can have a specific relationship, and the at least two virtual characters can interact in accordance with that specific relationship.

[0079] This will further increase the fun of virtual characters and enhance the user experience.

[0080] For example, the number of virtual characters corresponding to the user increases to at least two, and the at least two virtual characters constitute a family member relationship.

[0081] In addition, the interactive actions corresponding to this specific relationship can be pre-set.

[0082] In this embodiment of the invention, the virtual character and its changes can be displayed on various terminal devices, such as on an in-vehicle terminal.

[0083] In step 102, the virtual character corresponding to the user can be made to grow simply by recognizing that the user is smiling, or the degree to which the virtual character corresponding to the user grows can be determined based on the level of the recognized smile.

[0084] Figure 2 This is a flowchart of one embodiment of the method for implementing step 102 of Embodiment 1 of the present invention. For example... Figure 2 As shown, the method includes:

[0085] Step 201: Determine the user's smile level based on the first smile recognition result;

[0086] Step 202: Determine the first processing result based on the smile level and the first processing rule; and

[0087] Step 203: Based on the first processing result and / or the cumulative result of the first processing result, the virtual character corresponding to the user is made to grow.

[0088] In this way, by assigning levels to smiles and promoting the growth of virtual characters based on smile levels and preset rules, an appropriate growth mechanism can be provided for the growth of virtual characters. Furthermore, higher-level smiles can promote the growth of virtual characters more quickly, thereby further improving the user experience.

[0089] For example, in the first smile recognition result, “smiling,” “normal smile,” and “big laugh” correspond to smile level 1, smile level 2, and smile level 3, respectively.

[0090] In this embodiment of the invention, the first processing rule is related to the source of the first information used to identify the smile, or in other words, the first processing rule is related to the application environment of the control method for the virtual character.

[0091] Additionally, the first processing result can be a score or evaluation value related to the virtual character's growth. The first processing result and its cumulative value correspond to the user.

[0092] For example, if the first information is collected through in-vehicle equipment, then the first processing rule corresponds to the in-vehicle equipment.

[0093] For example, according to the first processing rule, when a smile of level 1 is identified, the score is "5 points"; when a smile of level 2 is identified, the score is "10 points"; and when a smile of level 3 is identified, the score is "15 points". The specific correspondence between smile level and score can be set according to actual needs.

[0094] In this embodiment of the invention, the virtual character corresponding to the user can grow based on a first processing result, the cumulative result of the first processing result, or both. For example, the virtual character corresponding to the user grows when the first processing result is greater than a first threshold, and / or when the cumulative result of the first processing result is greater than a second threshold. This provides an appropriate growth mechanism for the virtual character.

[0095] The growth path of the user's virtual character can differ depending on the second threshold.

[0096] For example, when the score represented by the user's first processing result is greater than 10 points and the cumulative score is greater than 1000 points, the skin color of the virtual character corresponding to the user will change.

[0097] For example, when a user's accumulated score exceeds 2000 points, the user's corresponding virtual character will wear sunglasses;

[0098] For example, when a user's accumulated score exceeds 3000 points, the user's corresponding virtual character will wear a tie.

[0099] For example, when a user's accumulated score exceeds 5000 points, the virtual character corresponding to that user can perform a jumping action;

[0100] For example, when a user's accumulated score exceeds 10,000 points, a virtual character corresponding to that user is added.

[0101] Figure 3 This is a flowchart of another embodiment of the virtual character control method of Embodiment 1 of the present invention. Figure 3 As shown, the control methods for this virtual character include:

[0102] Step 301: Recognize the user's smile based on the first information collected by the in-vehicle device to obtain the first smile recognition result;

[0103] Step 302: When the first smile recognition result contains a smile, determine the first processing result;

[0104] Step 303: Recognize the user's smile based on the second information collected by the mobile terminal to obtain the second smile recognition result;

[0105] Step 304: When the second smile recognition result contains a smile, determine the second processing result, and

[0106] Step 305: Determine the final cumulative result based on the cumulative result of the first processing result and the cumulative result of the second processing result, and make the virtual character corresponding to the user grow according to the final cumulative result.

[0107] In this way, in addition to recognizing the user's smile through information collected by in-vehicle equipment to promote the growth of the virtual character, information can also be collected through mobile terminals to recognize the user's smile and promote the growth of the virtual character. This diversifies the growth path of the virtual character and can further enhance the user experience.

[0108] In this embodiment of the invention, the mobile terminal can be any mobile terminal device used by the user, such as a smartphone, a smart wearable device, or other portable terminal device.

[0109] In this embodiment of the invention, there is no restriction on the execution order between steps 301 to 302 and steps 303 to 304. That is to say, this embodiment of the invention does not restrict the order of smile recognition based on the first information collected by the vehicle-mounted device and smile recognition based on the second information collected by the mobile terminal.

[0110] For example, even when a user is not using a vehicle, they can still use their mobile device's smile recognition to help their virtual character grow in other situations, thus making the growth of the virtual character continuous and further enhancing the user experience.

[0111] In this embodiment of the invention, the second information may include the second image information of the user collected by the mobile terminal, and / or the second audio information of the user collected by the mobile terminal.

[0112] For example, the user's facial image is captured by the mobile terminal's camera as second image information, and the user's voice is captured by the mobile terminal's microphone as second audio information.

[0113] In this embodiment of the invention, the second information is collected in real time, that is, continuously. When the second smile recognition result obtained in step 303 is no smile, the process returns to re-execute the step, that is, smile recognition continues based on the real-time collected second information.

[0114] In step 304, with Figure 2 Steps 201 and 202 are similar; the user's smile level can be determined based on the second smile recognition result; and the second processing result can be determined based on the smile level and the second processing rule.

[0115] In this embodiment of the invention, the first processing rule and the second processing rule are different rules. For example, for the same smile level, the first processing result determined according to the first processing rule makes the virtual character grow faster than the second processing result determined according to the second processing rule.

[0116] For example, according to the first processing rule, when a smile of level 1 is identified, the score is "5 points", when a smile of level 2 is identified, the score is "10 points", and when a smile of level 3 is identified, the score is "15 points". According to the second processing rule, when a smile of level 1 is identified, the score is "1 point", when a smile of level 2 is identified, the score is "2 points", and when a smile of level 3 is identified, the score is "3 points".

[0117] In this way, information collected through in-vehicle devices can promote the growth of virtual characters more quickly than that collected through mobile terminals, thereby providing an appropriate character growth mechanism.

[0118] In step 305, a final cumulative result is determined based on the cumulative result of the first processing result and the cumulative result of the second processing result, and the virtual character corresponding to the user is made to grow based on the final cumulative result.

[0119] For example, the cumulative result of the first processing result and the cumulative result of the second processing result are added together, and the result obtained is the final cumulative result. This final cumulative result, like the first and second processing results, is also expressed in the form of a score or evaluation value.

[0120] Similarly, for example, when the final cumulative result exceeds a second threshold, the virtual character corresponding to the user is allowed to grow. The growth pattern of the virtual character can differ depending on the second threshold.

[0121] In this embodiment of the invention, when the user includes at least two users, the smiles of the at least two users can be identified respectively based on the collected first information to obtain the first smile identification result of each of the at least two users; when the first smile identification result of at least one user is that it contains a smile, the first processing result of each of the at least one user is determined, and the virtual character corresponding to each of the at least one user is made to grow based on the first processing result of each of the at least one user and / or the cumulative result of their respective processing results.

[0122] For example, facial images of all users in the car can be captured by in-car cameras and / or voices of all users in the car can be captured by in-car microphones, so as to perform smile recognition on each user separately, obtain the first smile recognition results of at least two users, and make their respective virtual characters grow according to their first smile recognition results.

[0123] In this case, the virtual characters corresponding to at least two users can be displayed on the same screen.

[0124] For example, if the at least two users are riding in the same vehicle, the virtual characters corresponding to the at least two users can be displayed on the same screen of the in-vehicle terminal.

[0125] This creates a positive atmosphere within the vehicle, further enhancing driving safety and user experience. Furthermore, it allows for interaction between at least two users, further improving the user experience.

[0126] In this embodiment of the invention, the virtual characters corresponding to the at least two users have a specific relationship, and the virtual characters corresponding to the at least two users can interact with each other in accordance with the specific relationship.

[0127] In this way, by establishing a specific relationship between at least two users' respective virtual characters and interacting with that specific relationship, it is beneficial to create a harmonious atmosphere among users and enhance their intimacy, thereby further improving the user experience.

[0128] In this embodiment of the invention, when the user includes at least two users, the smiles of the at least two users are identified respectively based on the collected first information to obtain the first smile identification result of each of the at least two users; when the first smile identification result of at least one user contains a smile, the first processing result of the at least one user is determined, and the virtual character corresponding to the first user among the at least two users is made to grow based on the first processing result of the at least one user and / or the cumulative result of the first processing result.

[0129] In this way, when at least two users are involved, the smile recognition results of at least two users can be used to promote the growth of one of the users, such as the virtual character of the driver. This can improve the driver's driving pleasure and motivation, thereby further improving driving safety and user experience.

[0130] For example, when at least two users are riding in the same vehicle, facial images of all users in the vehicle are captured by the in-vehicle camera and / or voices of all users in the vehicle are captured by the in-vehicle microphone, so as to perform smile recognition on each user separately, obtain the first smile recognition result of at least two users, and make the virtual character corresponding to the driver grow according to the first smile recognition result of at least two users.

[0131] In Embodiment 1 of the present invention, as Figure 1 As shown, the method may further include:

[0132] Step 103: Make the virtual character dynamically change in response to the user's voice, actions, or facial expressions.

[0133] This allows for dynamic interaction between virtual characters and users, further enhancing the user experience. In addition, it encourages users to make more use of voice functions, which can further improve driving safety when applied to vehicles.

[0134] In this embodiment of the invention, step 103 is an optional step.

[0135] For example, when a vehicle user controls the air conditioning in the car via voice, the virtual character can respond to the voice captured and recognized by the in-car microphone and perform a predetermined action, such as jumping or wagging its tail.

[0136] For example, when a vehicle user shows signs of fatigue, the virtual character can respond to that expression detected by the in-vehicle camera by performing a pre-defined action, such as a hug.

[0137] In Embodiment 1 of the present invention, as Figure 1 As shown, the method may further include:

[0138] Step 104: Increase the user's points based on the virtual character's growth level.

[0139] This will further enhance users' enthusiasm for using the device and improve the user experience.

[0140] In this embodiment of the invention, step 104 is an optional step.

[0141] For example, when the virtual character grows to adulthood, the user receives 100 points; when the virtual character grows to the point of having an additional character, the user receives 500 points.

[0142] In this embodiment of the invention, the points can be used for various services or activities, such as car purchase discounts, gift redemption, etc.

[0143] As demonstrated by the above embodiments, recognizing a user's smile promotes the growth of the corresponding virtual character. This establishes a close connection between the changes in the virtual character and the user, encouraging the user to smile more to further the character's growth and maintain a positive mood. Furthermore, the growth of the virtual character enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0144] In addition, for example, when the method and apparatus are applied to in-vehicle devices, the growth of virtual characters can be promoted based on the recognition of the vehicle user's smile, which can also help the vehicle user maintain a good mood, thereby improving the user's concentration and driving safety.

[0145] Furthermore, by assigning levels to smiles and promoting the growth of virtual characters based on smile levels and preset rules, an appropriate growth mechanism can be provided for the growth of virtual characters. Moreover, higher-level smiles can promote the growth of virtual characters more quickly, thereby further improving the user experience.

[0146] Furthermore, when the first processing result obtained based on the first smile recognition result is greater than the first threshold, and / or when the cumulative result of the first processing result is greater than the second threshold, the virtual character corresponding to the user is allowed to grow, thus providing an appropriate growth mechanism for the growth of the virtual character.

[0147] Furthermore, in addition to recognizing users' smiles through information collected by in-vehicle devices to promote the growth of virtual characters, information can also be collected through mobile terminals to recognize users' smiles and promote the growth of virtual characters. This diversifies the growth path of virtual characters and can further enhance the user experience.

[0148] Furthermore, information collected through in-vehicle devices can accelerate the growth of virtual characters compared to mobile terminals, thereby providing an appropriate character growth mechanism.

[0149] Furthermore, when at least two users are involved, the growth of each user's virtual character can be promoted based on the smile recognition results of each user, and the virtual characters of at least two users can be displayed on the same screen. In this way, interaction can be generated between at least two users, thereby further enhancing the user experience.

[0150] Furthermore, by establishing specific relationships between at least two users' respective virtual characters and interacting with those relationships, it is beneficial to create a harmonious atmosphere among users and enhance their sense of intimacy, thereby further improving the user experience.

[0151] Furthermore, these at least two users must be passengers in the same vehicle. This creates a positive atmosphere within the vehicle, further enhancing driving safety and user experience.

[0152] Furthermore, when at least two users are involved, the smile recognition results of at least two users can be used to promote the growth of one of the users, such as the virtual character of the driver. This can enhance the driver's driving pleasure and motivation, thereby further improving driving safety and user experience.

[0153] Furthermore, the growth of the virtual character can include at least one of the following: changes in the virtual character's appearance, increases in the virtual character's actions, and increases in the number of virtual characters. In this way, changes in the virtual character's appearance can enrich the user's visual experience, changes in the virtual character's actions can expand the functions that the user can use, and increases in the number of virtual characters can greatly enhance the user's enjoyment of using the device, thereby further improving the user experience.

[0154] Furthermore, when the number of virtual characters increases to at least two, there is a specific relationship between the at least two virtual characters, and the at least two virtual characters can interact in accordance with the specific relationship. This can further increase the fun of the virtual characters and further enhance the user experience.

[0155] Furthermore, the virtual character can be made to dynamically change in response to the user's voice, actions, or facial expressions. This creates a dynamic interaction between the virtual character and the user, further enhancing the user experience. In addition, it can encourage users to use voice functions more often, which can further improve driving safety when applied to vehicles.

[0156] Furthermore, the user's points can be increased based on the virtual character's growth level, which can further enhance the user's enthusiasm for using the device and improve the user experience.

[0157] Example 2

[0158] Embodiment 2 of the present invention provides a method for controlling virtual characters, which is applied to in-vehicle equipment, in-vehicle terminals, mobile terminals and servers used for collecting information.

[0159] Figure 4 This is a flowchart of one embodiment of the virtual character control method of Embodiment 2 of the present invention. Figure 4 As shown, the method includes:

[0160] Step 401: The in-vehicle device collects the user's initial information;

[0161] Step 402: The on-board device sends the first information to the on-board terminal;

[0162] Step 403: The vehicle terminal recognizes the user's smile based on the first information and obtains the first smile recognition result;

[0163] Step 404: When the first smile recognition result contains a smile, the vehicle terminal determines the first processing result;

[0164] Step 405: The mobile terminal collects the user's second information;

[0165] Step 406: The mobile terminal sends the second information to the vehicle terminal;

[0166] Step 407: The vehicle terminal recognizes the user's smile based on the second information and obtains the second smile recognition result;

[0167] Step 408: When the second smile recognition result contains a smile, the vehicle terminal determines the second processing result; and

[0168] Step 409: The vehicle terminal determines the final cumulative result based on the cumulative result of the first processing result and the cumulative result of the second processing result, and makes the virtual character corresponding to the user grow according to the final cumulative result;

[0169] Step 410: The in-vehicle terminal displays the growing virtual character.

[0170] In this embodiment of the invention, there is no restriction on the execution order between steps 401 to 404 and steps 405 to 408. That is to say, this embodiment of the invention does not restrict the order of smile recognition based on the first information collected by the vehicle-mounted device and smile recognition based on the second information collected by the mobile terminal.

[0171] In embodiments of the present invention, the in-vehicle device is, for example, an in-vehicle camera and / or an in-vehicle microphone.

[0172] In this embodiment of the invention, the vehicle terminal can also send information about the growing virtual character to the mobile terminal so that the growing virtual character can also be displayed on the mobile terminal.

[0173] Figure 5 This is a flowchart of another embodiment of the virtual character control method of Embodiment 2 of the present invention. Figure 5 As shown, the method includes:

[0174] Step 501: The in-vehicle device collects the user's initial information;

[0175] Step 502: The on-board device sends the first information to the server;

[0176] Step 503: The server identifies the user's smile based on the first information and obtains the first smile recognition result;

[0177] Step 504: When the first smile recognition result contains a smile, the server determines the first processing result;

[0178] Step 505: The mobile terminal collects the user's second information;

[0179] Step 506: The mobile terminal sends the second information to the server;

[0180] Step 507: The server identifies the user's smile based on the second information and obtains the second smile recognition result;

[0181] Step 508: When the second smile recognition result contains a smile, the server determines the second processing result; and

[0182] Step 509: The server determines the final cumulative result based on the cumulative result of the first processing result and the cumulative result of the second processing result, and makes the virtual character corresponding to the user grow according to the final cumulative result;

[0183] Step 510: The server sends the data of the grown virtual character to the vehicle terminal;

[0184] Step 511: The in-vehicle terminal displays the growing virtual character.

[0185] In this embodiment of the invention, there is no restriction on the execution order between steps 501 to 504 and steps 505 to 508. That is to say, this embodiment of the invention does not restrict the order of smile recognition based on the first information collected by the vehicle-mounted device and smile recognition based on the second information collected by the mobile terminal.

[0186] In embodiments of the present invention, the in-vehicle device is, for example, an in-vehicle camera and / or an in-vehicle microphone.

[0187] In this embodiment of the invention, the server can also send information about the growing virtual character to the mobile terminal so that the growing virtual character can also be displayed on the mobile terminal.

[0188] In this embodiment of the invention, the specific implementation of each of the above steps can be referred to the content described in Embodiment 1, and will not be repeated here.

[0189] As demonstrated by the above embodiments, recognizing a user's smile promotes the growth of the corresponding virtual character. This establishes a close connection between the changes in the virtual character and the user, encouraging the user to smile more to further the character's growth and maintain a positive mood. Furthermore, the growth of the virtual character enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0190] Example 3

[0191] Embodiment 3 of the present invention provides a vehicle-mounted terminal that can execute the virtual character control method described in Embodiment 1. The functions of the vehicle-mounted terminal are the same as those described in Embodiment 1, and repeated content will not be described in detail again.

[0192] Figure 6 This is a schematic block diagram of the system configuration of the vehicle-mounted terminal in Embodiment 3 of the present invention. Figure 6 As shown, the vehicle terminal 600 may include a processor 610 and a memory 620; the memory 620 is coupled to the processor 610. It is worth noting that this figure is exemplary; other types of structures may be used to supplement or replace this structure to implement telecommunications functions or other functions.

[0193] In one embodiment, the processor 610 may be configured to: recognize a user's smile based on the first information collected, and obtain a first smile recognition result; and to make the virtual character corresponding to the user grow based on the first smile recognition result.

[0194] like Figure 6 As shown, the vehicle-mounted terminal 600 may also include: a communication module 630, an input unit 640, a display 650, and a power supply 660. It is worth noting that the vehicle-mounted terminal 600 does not necessarily include these components. Figure 6 All components shown; in addition, the vehicle terminal 600 may also include Figure 6 For components not shown, please refer to relevant technologies.

[0195] like Figure 6 As shown, the processor 610, sometimes also referred to as a controller or operating control, may include a microprocessor or other processor device and / or logic device. The processor 610 receives input and controls the operation of various components of the vehicle terminal 600.

[0196] The memory 620 may be, for example, one or more of a cache, flash memory, hard drive, removable medium, volatile memory, non-volatile memory, or other suitable means. It can store various types of data, and also programs for executing related information. The processor 610 can execute the program stored in the memory 620 to perform information storage or processing, etc. The functions of other components are similar to those in the prior art and will not be described further here. The components of the vehicle terminal 600 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the invention.

[0197] As demonstrated by the above embodiments, recognizing a user's smile promotes the growth of the corresponding virtual character. This establishes a close connection between the changes in the virtual character and the user, encouraging the user to smile more to further the character's growth and maintain a positive mood. Furthermore, the growth of the virtual character enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0198] Example 4

[0199] Embodiment 4 of the present invention provides a server that can execute the virtual character control method described in Embodiment 1. The functions of the server are the same as those described in Embodiment 1, and repeated content will not be described in detail again.

[0200] Figure 7 This is a schematic block diagram of the system configuration of the server in Embodiment 4 of the present invention. Figure 7As shown, server 700 may include processor 710 and memory 720; memory 720 is coupled to processor 710. It is worth noting that this diagram is exemplary; other types of structures may be used to supplement or replace this structure to implement telecommunications functions or other functions.

[0201] In one embodiment, the processor 710 may be configured to: recognize a user's smile based on the first information collected, and obtain a first smile recognition result; and to make the virtual character corresponding to the user grow based on the first smile recognition result.

[0202] like Figure 7 As shown, server 700 may also include a communication module 730. It is worth noting that server 700 does not necessarily need to include this module. Figure 7 All components shown; in addition, server 700 may also include Figure 7 For components not shown, please refer to relevant technologies.

[0203] like Figure 7 As shown, the processor 710, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device, which receives input and controls the operation of various components of the server 700.

[0204] The memory 720 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable means. It can store various types of data, and also stores programs for executing related information. The processor 710 can execute the program stored in the memory 720 to perform information storage or processing, etc. The functions of other components are similar to those in existing systems and will not be described further here. The components of the server 700 can be implemented using dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the invention.

[0205] As demonstrated by the above embodiments, recognizing a user's smile promotes the growth of the corresponding virtual character. This establishes a close connection between the changes in the virtual character and the user, encouraging the user to smile more to further the character's growth and maintain a positive mood. Furthermore, the growth of the virtual character enriches its expressive forms and functions. Therefore, it effectively enhances the user experience.

[0206] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings, indicating how the principles of the present invention can be employed. However, it should be understood that the implementation of the present invention is not limited to the embodiments described above, but also includes all changes, modifications, and equivalents that do not depart from the spirit and scope of the present invention.

Claims

1. A method for controlling a virtual character, characterized in that, The control method for the virtual character includes: The user's smile is identified based on the first information collected by the in-vehicle device, and the first smile recognition result is obtained; Based on the first smile recognition result, the virtual character corresponding to the user is made to grow, and the virtual character growth includes at least one of the following: a change in the virtual character's appearance; an increase in the virtual character's actions; and an increase in the number of virtual characters; and The virtual character that has grown up is displayed on the in-vehicle terminal.

2. The method for controlling a virtual character according to claim 1, characterized in that, The step of making the virtual character corresponding to the user grow based on the first smile recognition result includes: The user's smile level is determined based on the first smile recognition result; Based on the smile level and the first processing rule, determine the first processing result; and The virtual character corresponding to the user grows based on the first processing result and / or the cumulative result of the first processing result.

3. The method for controlling a virtual character according to claim 1, characterized in that, The step of making the virtual character corresponding to the user grow based on the first smile recognition result includes: When the first smile recognition result indicates that a smile is present, the first processing result is determined; and When the first processing result is greater than the first threshold, and / or when the cumulative result of the first processing result is greater than the second threshold, the virtual character corresponding to the user is made to grow.

4. The method for controlling a virtual character according to claim 3, characterized in that, The method for controlling the virtual character also includes: The user's smile is identified based on the second information collected by the mobile terminal, and the second smile recognition result is obtained. When the second smile recognition result contains a smile, the second processing result is determined, and Based on the second processing result and / or the cumulative result of the second processing result, the virtual character corresponding to the user is made to grow.

5. The method for controlling a virtual character according to claim 4, characterized in that, The final cumulative result is determined based on the cumulative result of the first processing result and the cumulative result of the second processing result, and the virtual character corresponding to the user is made to grow based on the final cumulative result.

6. The method for controlling a virtual character according to claim 4, characterized in that, When the second smile recognition result is that a smile is present, the second processing result is determined, including: The user's smile level is determined based on the second smile recognition result; and Based on the smile level and the second processing rule, the second processing result is determined.

7. The method for controlling a virtual character according to claim 5, characterized in that, For the same smile level, the first processing result determined according to the first processing rule makes the virtual character grow faster than the second processing result determined according to the second processing rule.

8. The method for controlling a virtual character according to claim 1, characterized in that, When the user includes at least two users Based on the collected first information, the smiles of the at least two users are identified respectively to obtain the first smile recognition results of the at least two users; When the first smile recognition result for at least one user is that a smile is present, the first processing result for each of the at least one user is determined, and Based on the first processing result of each of the at least one user and / or the cumulative result of their respective processing results, the virtual characters corresponding to the at least one user are made to grow.

9. The method for controlling a virtual character according to claim 1, characterized in that, When the user includes at least two users Based on the collected first information, the smiles of the at least two users are identified respectively to obtain the first smile recognition results of the at least two users; When the first smile recognition result for at least one user is that a smile is present, the first processing result for the at least one user is determined, and Based on the first processing result of the at least one user and / or the cumulative result of the first processing result, the virtual character corresponding to the first user among the at least two users is made to grow.

10. The method for controlling a virtual character according to claim 8, characterized in that, The method for controlling the virtual character also includes: Display the virtual characters corresponding to at least two users on the same screen.

11. The method for controlling a virtual character according to claim 10, characterized in that, The virtual characters corresponding to the at least two users have a specific relationship, and the virtual characters corresponding to the at least two users can interact with each other in accordance with the specific relationship.

12. The method for controlling a virtual character according to claim 9, characterized in that, The at least two users are at least two users who are traveling in the same vehicle.

13. The method for controlling a virtual character according to claim 1, characterized in that, When the number of virtual characters increases to at least two, there is a specific relationship between the at least two virtual characters, and the at least two virtual characters are able to interact with each other in accordance with the specific relationship.

14. The method for controlling a virtual character according to claim 1, characterized in that, The method for controlling the virtual character also includes: The virtual character can dynamically change in response to the user's voice, actions, or facial expressions.

15. The method for controlling a virtual character according to claim 1, characterized in that, The method for controlling the virtual character also includes: The user's points are increased based on the growth level of the virtual character.

16. The method for controlling a virtual character according to claim 4, characterized in that, The first information includes: the first image information of the user collected by the in-vehicle device, and / or the first audio information of the user collected by the in-vehicle device; The second information includes: second image information of the user collected by the mobile terminal, and / or, second audio information of the user collected by the mobile terminal.

17. A vehicle-mounted terminal characterized in that, The vehicle-mounted terminal includes: Memory, which is used to store computer programs; A processor, which, when executing the computer program, implements the method for controlling a virtual character as described in any one of claims 1-16.

18. A server, characterized in that, The server includes: Memory, which is used to store computer programs; A processor, which, when executing the computer program, implements the method for controlling a virtual character as described in any one of claims 1-16.

Images