User interaction method and device, computer readable storage medium and electronic equipment
By acquiring user interaction data and using emotion state analysis models and environmental information to adjust the scene settings of virtual interactive objects, the problem of rigid interaction processes of virtual interactive objects is solved, and more flexible and richer user interaction effects are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- UBTECH ROBOTICS CORP LTD
- Filing Date
- 2025-12-31
- Publication Date
- 2026-05-01
AI Technical Summary
In existing technologies, the interaction process between virtual interactive objects and users is rather rigid and lacks flexibility.
By acquiring user interaction data, analyzing user emotional states using an emotion state analysis model, determining target interaction modes based on emotional states, controlling virtual interaction objects to adapt to different interaction modes, and adjusting the scene settings of virtual interaction objects in conjunction with environmental information.
It improves the flexibility and richness of interaction between virtual interactive objects and users, and enhances the interaction effect.
Smart Images
Figure CN121957337A_ABST
Abstract
Description
User interaction methods, devices, computer-readable storage media, and electronic devices Technical Field
[0001] This application belongs to the field of artificial intelligence technology, and in particular relates to a user interaction method, device, computer-readable storage medium and electronic device. Background Technology
[0002] With the development of technology, various electronic devices can be pre-programmed with cartoonish virtual interactive objects such as people or animals to interact with users. However, in current technology, the interaction process between virtual interactive objects and users is relatively rigid and inflexible. For example, virtual interactive objects often simply recite dialogue statements mechanically, lacking flexibility. Summary of the Invention
[0003] In view of this, embodiments of this application provide a user interaction method, apparatus, computer-readable storage medium, and electronic device to solve the problem of poor flexibility in existing user interaction methods.
[0004] A first aspect of this application provides a user interaction method, which may include:
[0005] Acquire user interaction data generated during the user's interaction with a preset virtual interactive object;
[0006] Perform user emotional state analysis on the user interaction data to obtain the user emotional state corresponding to the user interaction data;
[0007] Determine the target interaction pattern corresponding to the user's emotional state; wherein, different emotional states correspond to different interaction patterns;
[0008] Control the virtual interactive object to interact with the user according to the target interaction mode.
[0009] In one specific implementation of the first aspect, the step of performing user emotional state analysis on the user interaction data to obtain the user emotional state corresponding to the user interaction data may include:
[0010] Based on a preset emotion state analysis model, the user interaction data is analyzed to obtain the user emotion state corresponding to the user interaction data.
[0011] The emotion state analysis model is an artificial intelligence model trained on a preset training sample set for analyzing user emotion states. Each training sample in the training sample set includes user interaction sample data and a corresponding user emotion state label. During training, the emotion state analysis model takes the user interaction sample data of each training sample as input and the corresponding user emotion state label as the expected output.
[0012] In one specific implementation of the first aspect, determining the target interaction pattern corresponding to the user's emotional state may include:
[0013] Based on the preset interaction mode correspondence, the target interaction mode corresponding to the user's emotional state is determined;
[0014] The interaction mode correspondence refers to the correspondence between various emotional states and various interaction modes.
[0015] In one specific implementation of the first aspect, the user interaction method may further include:
[0016] Obtain the current environment information and set the scene in which the virtual interactive object is located based on the current environment information.
[0017] In one specific implementation of the first aspect, obtaining the current environment information and setting the scene of the virtual interactive object based on the current environment information may include:
[0018] Obtain the current time information through the preset time information interface;
[0019] Determine the first scene setting information corresponding to the current time information;
[0020] According to the first scene setting information, the scene in which the virtual interactive object is located is set to adapt to the current time information.
[0021] In one specific implementation of the first aspect, obtaining the current environment information and setting the scene of the virtual interactive object based on the current environment information may include:
[0022] Obtain current weather information through a preset weather information interface;
[0023] Determine the second scene setting information corresponding to the current weather information;
[0024] According to the second scene setting information, the scene in which the virtual interactive object is located is set to adapt to the current weather information.
[0025] In one specific implementation of the first aspect, obtaining the current environment information and setting the scene of the virtual interactive object based on the current environment information may include:
[0026] Obtain the current calendar information through the preset calendar information interface;
[0027] Determine the third scenario settings information corresponding to the current calendar information;
[0028] According to the third scene setting information, the scene in which the virtual interactive object is located is set to adapt to the current calendar information.
[0029] A second aspect of the embodiments of this application provides a user interaction device, which may include:
[0030] The interaction data acquisition module is used to acquire user interaction data generated by the user during the interaction with the preset virtual interactive object;
[0031] The emotion state analysis module is used to perform user emotion state analysis on the user interaction data to obtain the user emotion state corresponding to the user interaction data.
[0032] An interaction mode determination module is used to determine a target interaction mode corresponding to the user's emotional state; wherein, different emotional states correspond to different interaction modes.
[0033] The user interaction module is used to control the virtual interactive object to interact with the user according to the target interaction mode.
[0034] In one specific implementation of the second aspect, the emotion state analysis module can be specifically used to: perform user emotion state analysis on the user interaction data based on a preset emotion state analysis model to obtain the user emotion state corresponding to the user interaction data; wherein, the emotion state analysis model is an artificial intelligence model for performing user emotion state analysis, trained on a preset training sample set; each training sample in the training sample set includes user interaction sample data and a corresponding user emotion state label; during the training process, the emotion state analysis model takes the user interaction sample data of each training sample as input and the corresponding user emotion state label as the expected output.
[0035] In one specific implementation of the second aspect, the interaction mode determination module can be specifically used to: determine the target interaction mode corresponding to the user's emotional state based on a preset interaction mode correspondence; wherein, the interaction mode correspondence is the correspondence between various emotional states and various interaction modes.
[0036] In one specific implementation of the second aspect, the user interaction device may further include:
[0037] The scene setting module is used to obtain the current environment information and set the scene in which the virtual interactive object is located based on the current environment information.
[0038] In one specific implementation of the second aspect, the scene setting module may include:
[0039] The first scene setting unit is used to obtain the current time information through a preset time information interface; determine the first scene setting information corresponding to the current time information; and set the scene where the virtual interactive object is located according to the first scene setting information to adapt to the current time information.
[0040] In one specific implementation of the second aspect, the scene setting module may include:
[0041] The second scene setting unit is used to obtain the current weather information through a preset weather information interface; determine the second scene setting information corresponding to the current weather information; and set the scene where the virtual interactive object is located according to the second scene setting information to adapt to the current weather information.
[0042] In one specific implementation of the second aspect, the scene setting module may include:
[0043] The third scene setting unit is used to obtain the current calendar information through a preset calendar information interface; determine the third scene setting information corresponding to the current calendar information; and set the scene where the virtual interactive object is located according to the third scene setting information to adapt to the current calendar information.
[0044] A third aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the above-described user interaction methods.
[0045] A fourth aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of any of the above-described user interaction methods.
[0046] The fifth aspect of this application provides a computer program product that, when run on an electronic device, causes the electronic device to perform the steps of any of the above-described user interaction methods.
[0047] The beneficial effects of this application embodiment compared with the prior art are as follows: This application embodiment acquires user interaction data generated by the user during interaction with a preset virtual interactive object; analyzes the user's emotional state in the user interaction data to obtain the user's emotional state corresponding to the user interaction data; determines the target interaction mode corresponding to the user's emotional state; wherein different emotional states correspond to different interaction modes; and controls the virtual interactive object to interact with the user according to the target interaction mode. Through this application embodiment, different interaction modes corresponding to different emotional states can be preset. During the interaction with the user, the user's emotional state can be determined by analyzing the user interaction data, and the corresponding interaction mode can be adapted, thereby making the interaction between the virtual interactive object and the user more flexible and rich, and effectively improving the interaction effect with the user. Attached Figure Description
[0048] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0049] Figure 1 is a flowchart of an embodiment of a user interaction method in this application;
[0050] Figure 2 is a schematic flowchart illustrating the setting of the scene where the virtual interactive object is located based on time information;
[0051] Figure 3 is a schematic flowchart illustrating the setting of the scene where the virtual interactive object is located based on weather information;
[0052] Figure 4 is a schematic flowchart illustrating the setting of the scene where the virtual interactive object is located based on calendar information;
[0053] Figure 5 is a structural diagram of an embodiment of a user interaction device according to this application;
[0054] Figure 6 is a schematic block diagram of an electronic device according to an embodiment of this application. Detailed Implementation
[0055] To make the inventive objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described below are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0056] It should be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.
[0057] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.
[0058] It should also be further understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0059] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be interpreted, depending on the context, as "once determined," "in response to determination," "once [the described condition or event] is detected," or "in response to detection of [the described condition or event]."
[0060] Furthermore, in the description of this application, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0061] With the development of technology, various electronic devices can be pre-programmed with cartoonish virtual interactive objects such as people or animals to interact with users. However, in current technology, the interaction process between virtual interactive objects and users is relatively rigid and inflexible. For example, virtual interactive objects often simply recite dialogue statements mechanically, lacking flexibility.
[0062] In view of this, embodiments of this application provide a user interaction method, apparatus, computer-readable storage medium, and electronic device to solve the problem of poor flexibility in existing user interaction methods.
[0063] In this embodiment, different interaction modes can be preset to correspond to different emotional states. During the interaction with the user, the user's emotional state can be determined by analyzing the user's interaction data, and the corresponding interaction mode can be adapted, thereby making the interaction between the virtual interactive object and the user more flexible and rich, and effectively improving the interaction effect with the user.
[0064] Please refer to Figure 1. One embodiment of a user interaction method in this application may include:
[0065] Step S101: Obtain user interaction data generated during the user's interaction with a preset virtual interactive object.
[0066] In one specific implementation of this application, during the interaction between the user and the virtual interactive object, the electronic device carrying the virtual interactive object can collect data through a data acquisition device (which may include, but is not limited to, a voice data acquisition device, an image data acquisition device, etc.) to obtain multimodal user interaction data (which may include, but is not limited to, voice data, image data, etc.).
[0067] It should be noted that the user interaction data collection process involved in this application was carried out with the user's knowledge and permission, that is, the user interaction data collection process complies with relevant requirements and does not constitute an act that harms the public interest.
[0068] Step S102: Analyze the user's emotional state based on the user interaction data to obtain the user's emotional state corresponding to the user interaction data.
[0069] In one specific implementation of this application, various user emotional states can be preset. The specific setting method can be flexibly adjusted according to the actual situation, and this application does not limit it in this way.
[0070] As an example, different user emotional states may include, but are not limited to, one or more of the following: First state: the state when a user completes a task or shares something interesting; Second state: the state when a user asks a question or discovers something new; Third state: the state when a user encounters difficulties or tries something new; Fourth state: the state when a user receives homework tutoring or knowledge explanation; Fifth state: the state when a user completes something fun; Sixth state: the state when a user cries or expresses sadness; Seventh state: the state when a user unlocks a new achievement or receives a gift; and Eighth state: the state when a user is sleepy; and so on.
[0071] In one specific implementation of this application, user emotional state analysis can be performed on user interaction data based on a preset emotional state analysis model to obtain the user emotional state corresponding to the user interaction data.
[0072] The emotion state analysis model is an artificial intelligence model trained on a pre-defined training sample set for analyzing user emotion states. Each training sample in the set includes user interaction sample data and a corresponding user emotion state label. Specifically, the initial artificial intelligence model can be trained using the user interaction sample data of each training sample as input and the corresponding user emotion state label as the expected output, thereby obtaining the trained emotion state analysis model.
[0073] During training, for each training sample, an artificial intelligence model can process the user interaction sample data of that training sample to obtain the actual output of that training sample. Then, a preset loss function can be used to calculate the training loss value based on the expected output and the actual output of that training sample. In this embodiment, any loss function in the prior art can be selected to calculate the training loss value according to the actual situation; this embodiment does not impose any specific limitations on this.
[0074] After calculating the training loss value, the model parameters of the artificial intelligence model can be adjusted based on the training loss value. In this embodiment, assuming that the model parameters of the artificial intelligence model are the first model parameters in the initial state, the training loss value is backpropagated to modify the model parameters of the artificial intelligence model, resulting in the modified second model parameters. After modifying the parameters, the next training process is continued. In this training process, the training loss value is recalculated, and the training loss value is backpropagated to modify the model parameters of the artificial intelligence model, resulting in the modified third model parameters, and so on, repeating the above process continuously. The model parameters can be modified in each training process until the preset training conditions are met. The training conditions can be that the number of training iterations reaches a preset threshold, which can be set according to the actual situation, for example, it can be set to thousands, tens of thousands, hundreds of thousands or even larger values; the training conditions can also be that the artificial intelligence model converges. Since it is possible that the number of training iterations has not reached the threshold, but the artificial intelligence model has converged, it may lead to unnecessary duplication of work; or the artificial intelligence model may never converge, which may lead to an infinite loop and the training process cannot end. Based on the above two situations, the training conditions can also be that the number of training iterations reaches the threshold or the artificial intelligence model converges. Once the training conditions are met, the trained emotion state analysis model can be obtained.
[0075] Through the above process, the user interaction sample data and corresponding user emotional state labels of the training samples are used as the learning objects of the artificial intelligence model. After the training process, the artificial intelligence model can establish a mapping relationship between user interaction sample data and user emotional state labels. Thus, when faced with new user interaction sample data, the corresponding user emotional state can also be obtained according to this mapping relationship.
[0076] After training the emotion state analysis model, it can be used to analyze user emotion state on user interaction data, thereby obtaining the user emotion state corresponding to the user interaction data.
[0077] Step S103: Determine the target interaction mode corresponding to the user's emotional state.
[0078] Different emotional states can correspond to different interaction modes.
[0079] In one specific implementation of this application, a correspondence between various emotional states and various interaction modes can be pre-set, and this correspondence can be denoted as an interaction mode correspondence. The specific setting of the interaction mode correspondence can be flexibly configured according to actual circumstances, and this application does not impose specific limitations on it.
[0080] As an example, when the user's emotional state is in the first category—that is, when the user asks a question or discovers something new—the corresponding interaction mode can be identified as the "happy interaction mode." When the user's emotional state is in the second category—that is, when the user asks a question or discovers something new—the corresponding interaction mode can be identified as the "curiosity interaction mode." When the user's emotional state is in the third category—that is, when the user encounters difficulties or tries something new—the corresponding interaction mode can be identified as the "encouragement interaction mode." When the user's emotional state is in the fourth category—that is, when the user receives homework tutoring or knowledge explanation—the corresponding interaction mode can be identified as... The interaction mode is defined as follows: When the user's emotional state is in the fifth category (completing a fun activity), the corresponding interaction mode is "playful." When the user's emotional state is in the sixth category (crying or expressing sadness), the corresponding interaction mode is "sympathetic." When the user's emotional state is in the seventh category (unlocking a new achievement or receiving a gift), the corresponding interaction mode is "surprise." When the user's emotional state is in the eighth category (drowsy), the corresponding interaction mode is "drowsy." And so on.
[0081] After obtaining the user's emotional state corresponding to the user interaction data, the interaction pattern corresponding to the user's emotional state can be determined based on the correspondence between interaction patterns and recorded as the target interaction pattern.
[0082] Step S104: Control the virtual interactive object to interact with the user according to the target interaction mode.
[0083] The specific interactive content can be flexibly set according to the actual situation, and this application embodiment does not impose specific limitations on it.
[0084] As examples, in the "Happy" interaction mode, the virtual interactive object can be controlled to have its eyes curved into crescents, its mouth upturned, its scarf fluttering, and its ears twitching slightly; in the "Curiosity" interaction mode, the virtual interactive object can be controlled to raise its eyelashes, tilt its head slightly forward, rest its chin on its hands, and have half of its head peeking out of its yellow coat pocket (skeuomorphic design); in the "Encouragement" interaction mode, the virtual interactive object can be controlled to clench its fist and raise it high (similar to a cheering gesture), with a determined look, and a "You can do it!" text bubble appearing in the background; in the "Attentive" interaction mode, the virtual interactive object can be controlled to fold its hands in front of its chest, and its body... Leaning slightly forward, ears perked up (focused state), tone softened; for the playful interaction mode, the virtual interactive object can be controlled to blink one eye, stick out its tongue, and have a small tail wagging behind it (dynamic effect), saying "Hehe, aren't I amazing?"; for the distressed interaction mode, the virtual interactive object can be controlled to lower its eyelashes, redden its eyes (without tears), gently pat the user's screen (human-like gesture), saying "Don't be sad, I'm here with you"; for the surprise interaction mode, the virtual interactive object can be controlled to open its mouth wide (O-shape), its eyes turn into stars, and firework effects appear above its head, saying "Wow!"
[0085] "That's amazing!"; For the drowsy interaction mode, you can control the virtual interactive object to droop its eyelids (squint), yawn (open its mouth into an O shape), and say "It's getting late, time to sleep~"; etc.
[0086] In one specific implementation of this application, the electronic device can also obtain current environmental information through various preset information interfaces, and set the scene where the virtual interactive object is located according to the current environmental information, thereby making the interaction between the virtual interactive object and the user more flexible and rich, and effectively improving the interaction effect with the user.
[0087] The environmental information may include, but is not limited to, at least one of the following: time information, weather information, and calendar information.
[0088] Taking time information as an example, the process of setting the scene in which the virtual interactive object is located can include the steps shown in Figure 2:
[0089] Step S201: Obtain the current time information through the preset time information interface.
[0090] In one specific implementation of this application, the time information interface may include, but is not limited to, at least one of the following: a first time information interface for obtaining the local system time, and a second time information interface for obtaining the standard time provided by a specified server. The specific time information interface used can be flexibly set according to actual circumstances, and this application does not impose specific limitations on this.
[0091] Step S202: Determine the first scene setting information corresponding to the current time information.
[0092] In one specific implementation of this application, various correspondences between different time periods and different scene settings can be pre-set, and these can be denoted as time period-scene correspondences. The specific settings of the time period-scene correspondences can be flexibly configured according to actual circumstances, and this application does not impose specific limitations on this.
[0093] After obtaining the current time information, the scene setting information corresponding to the current time information can be determined based on the time period scene correspondence, and recorded as the first scene setting information.
[0094] Step S203: According to the first scene setting information, set the scene where the virtual interactive object is located to adapt to the current time information.
[0095] For example, if the current time is in the morning (7:00-9:00), the corresponding first scene setting could be a bright orange background. In this case, the main color of the scene where the virtual interactive object is located can be adjusted to bright orange to have an energizing effect. If the current time is in the afternoon (12:00-14:00), the corresponding first scene setting could be a light blue background. In this case, the main color of the scene where the virtual interactive object is located can be adjusted to light blue to have a calming effect. If the current time is in the evening (19:00-21:00), the corresponding first scene setting could be a warm yellow background. In this case, the main color of the scene where the virtual interactive object is located can be adjusted to warm yellow to increase a relaxing effect; and so on.
[0096] Taking weather information as an example, the process of setting up the scene where the virtual interactive object is located can include the steps shown in Figure 3:
[0097] Step S301: Obtain the current weather information through the preset weather information interface.
[0098] In this embodiment, the weather information interface may include, but is not limited to, at least one of the following: a first weather information interface for obtaining local system weather, and a second weather information interface for obtaining standard weather provided by a designated server. The specific weather information interface used can be flexibly configured according to actual circumstances, and this embodiment does not impose specific limitations on this.
[0099] Step S302: Determine the second scene setting information corresponding to the current weather information.
[0100] In one specific implementation of this application, various correspondences between different weather information and different scene setting information can be pre-set, and these can be denoted as weather-scene correspondences. The specific settings of the weather-scene correspondences can be flexibly configured according to actual circumstances, and this application does not impose specific limitations on this.
[0101] After obtaining the current weather information, the scene setting information corresponding to the current weather information can be determined based on the weather scene correspondence, and recorded as the second scene setting information.
[0102] Step S303: According to the second scene setting information, set the scene where the virtual interactive object is located to adapt to the current weather information.
[0103] As an example, if the current weather is sunny, the corresponding second scene settings could be: blue sky and white clouds, wearing sunglasses. In this case, an animation effect of blue sky and white clouds can be added to the scene where the virtual interactive object is located, and sunglasses can be given to the virtual interactive object. If the current weather is rainy, the corresponding second scene settings could be: raindrops falling, holding an umbrella. In this case, an animation effect of raindrops falling can be added to the scene where the virtual interactive object is located, and an umbrella can be given to the virtual interactive object. If the current weather is snowy, the corresponding second scene settings could be: snowflakes falling. In this case, an animation effect of snowflakes falling can be added to the scene where the virtual interactive object is located. And so on.
[0104] Taking calendar information as an example, the process of setting up the scene in which the virtual interactive object is located can include the steps shown in Figure 4:
[0105] Step S401: Obtain the current calendar information through the preset calendar information interface.
[0106] In this embodiment, the calendar information interface may include, but is not limited to, at least one of the following: a first calendar information interface for obtaining the local system calendar, and a second calendar information interface for obtaining the standard calendar provided by a specified server. The specific calendar information interface used can be flexibly configured according to actual circumstances, and this embodiment does not impose specific limitations on this.
[0107] Step S402: Determine the third scene setting information corresponding to the current calendar information.
[0108] In one specific implementation of this application, various correspondences between different calendar information and different scene setting information can be pre-set, and these correspondences can be denoted as calendar scene correspondences. The specific settings of the calendar scene correspondences can be flexibly configured according to actual circumstances, and this application does not impose specific limitations on this.
[0109] After obtaining the current calendar information, the scene setting information corresponding to the current calendar information can be determined based on the calendar scene correspondence, and recorded as the third scene setting information.
[0110] Step S403: According to the third scene setting information, set the scene where the virtual interactive object is located to adapt to the current calendar information.
[0111] As an example, if the current calendar information is Dragon Boat Festival, the corresponding third scene setting information could be: dragon boat racing and eating zongzi (sticky rice dumplings). In this case, animation effects of dragon boat racing and eating zongzi can be added to the scene where the virtual interactive object is located. If the current calendar information is Children's Day, the corresponding third scene setting information could be: balloons and cakes. In this case, animated elements such as balloons and cakes can be added to the scene where the virtual interactive object is located. If the current calendar information is exam week, the corresponding third scene setting information could be: encouragement stickers. In this case, text stickers such as "Go for it!" can be added to the scene where the virtual interactive object is located to encourage users. And so on.
[0112] In summary, this application embodiment acquires user interaction data generated during user interaction with a preset virtual interactive object; analyzes the user's emotional state based on the user interaction data to obtain the user's emotional state corresponding to the user interaction data; determines the target interaction mode corresponding to the user's emotional state; wherein different emotional states correspond to different interaction modes; and controls the virtual interactive object to interact with the user according to the target interaction mode. Through this application embodiment, different interaction modes corresponding to different emotional states can be preset. During the interaction process, the user's emotional state can be determined by analyzing the user interaction data, and the corresponding interaction mode can be adapted, thereby making the interaction between the virtual interactive object and the user more flexible and rich, effectively improving the interaction effect with the user.
[0113] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0114] Corresponding to the user interaction method described in the above embodiments, Figure 5 shows a structural diagram of an embodiment of a user interaction device provided in this application.
[0115] In this embodiment, a user interaction device may include:
[0116] The interaction data acquisition module 501 is used to acquire user interaction data generated by the user during the interaction with the preset virtual interaction object;
[0117] The emotion state analysis module 502 is used to perform user emotion state analysis on the user interaction data to obtain the user emotion state corresponding to the user interaction data.
[0118] The interaction mode determination module 503 is used to determine the target interaction mode corresponding to the user's emotional state; wherein, different emotional states correspond to different interaction modes.
[0119] User interaction module 504 is used to control the virtual interaction object to interact with the user according to the target interaction mode.
[0120] In one specific implementation of this application, the emotion state analysis module can be specifically used to: perform user emotion state analysis on the user interaction data based on a preset emotion state analysis model to obtain the user emotion state corresponding to the user interaction data; wherein, the emotion state analysis model is an artificial intelligence model for performing user emotion state analysis, trained on a preset training sample set; each training sample in the training sample set includes user interaction sample data and a corresponding user emotion state label; during the training process, the emotion state analysis model takes the user interaction sample data of each training sample as input and the corresponding user emotion state label as the expected output.
[0121] In one specific implementation of this application, the interaction mode determination module can be specifically used to: determine the target interaction mode corresponding to the user's emotional state based on a preset interaction mode correspondence; wherein, the interaction mode correspondence is the correspondence between various different emotional states and various different interaction modes.
[0122] In one specific implementation of this application embodiment, the user interaction device may further include:
[0123] The scene setting module is used to obtain the current environment information and set the scene in which the virtual interactive object is located based on the current environment information.
[0124] In one specific implementation of this application embodiment, the scene setting module may include:
[0125] The first scene setting unit is used to obtain the current time information through a preset time information interface; determine the first scene setting information corresponding to the current time information; and set the scene where the virtual interactive object is located according to the first scene setting information to adapt to the current time information.
[0126] In one specific implementation of this application embodiment, the scene setting module may include:
[0127] The second scene setting unit is used to obtain the current weather information through a preset weather information interface; determine the second scene setting information corresponding to the current weather information; and set the scene where the virtual interactive object is located according to the second scene setting information to adapt to the current weather information.
[0128] In one specific implementation of this application embodiment, the scene setting module may include:
[0129] The third scene setting unit is used to obtain the current calendar information through a preset calendar information interface; determine the third scene setting information corresponding to the current calendar information; and set the scene where the virtual interactive object is located according to the third scene setting information to adapt to the current calendar information.
[0130] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0131] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0132] Figure 6 shows a schematic block diagram of an electronic device provided in an embodiment of this application. For ease of explanation, only the parts related to the embodiment of this application are shown.
[0133] As shown in FIG6, the electronic device 6 of this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and executable on the processor 60. When the processor 60 executes the computer program 62, it implements the steps in the various user interaction method embodiments described above, such as steps S101 to S104 shown in FIG1. Alternatively, when the processor 60 executes the computer program 62, it implements the functions of each module / unit in the various device embodiments described above, such as the functions of modules 501 to 504 shown in FIG5.
[0134] For example, the computer program 62 may be divided into one or more modules / units, which are stored in the memory 61 and executed by the processor 60 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program 62 in the electronic device 6.
[0135] The electronic device 6 may include, but is not limited to, learning machines, mobile phones, tablet computers, desktop computers, laptops, handheld computers, robots, and servers. Those skilled in the art will understand that Figure 6 is merely an example of the electronic device 6 and does not constitute a limitation on the electronic device 6. It may include more or fewer components than shown, or combine certain components, or use different components. For example, the electronic device 6 may also include input / output devices, network access devices, buses, etc.
[0136] The processor 60 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0137] The memory 61 can be an internal storage unit of the electronic device 6, such as a hard disk or memory. The memory 61 can also be an external storage device of the electronic device 6, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory 61 can include both internal and external storage units of the electronic device 6. The memory 61 is used to store the computer program and other programs and data required by the electronic device 6. The memory 61 can also be used to temporarily store data that has been output or will be output.
[0138] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0139] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0140] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0141] In the embodiments provided in this application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings or direct couplings or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.
[0142] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0143] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0144] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals.
[0145] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. A user interaction method, characterized in that, include: Acquire user interaction data generated during the user's interaction with a preset virtual interactive object; Perform user emotional state analysis on the user interaction data to obtain the user emotional state corresponding to the user interaction data; Determine the target interaction mode corresponding to the user's emotional state; wherein different emotional states correspond to different interaction modes; control the virtual interaction object to interact with the user according to the target interaction mode.
2. The user interaction method according to claim 1, characterized in that, The step of performing user emotion state analysis on the user interaction data to obtain the user emotion state corresponding to the user interaction data includes: performing user emotion state analysis on the user interaction data based on a preset emotion state analysis model to obtain the user emotion state corresponding to the user interaction data; wherein, the emotion state analysis model is an artificial intelligence model for performing user emotion state analysis, trained on a preset training sample set; each training sample in the training sample set includes user interaction sample data and a corresponding user emotion state label; during the training process, the emotion state analysis model takes the user interaction sample data of each training sample as input and the corresponding user emotion state label as the expected output.
3. The user interaction method according to claim 1, characterized in that, The step of determining the target interaction mode corresponding to the user's emotional state includes: determining the target interaction mode corresponding to the user's emotional state based on a preset interaction mode correspondence; wherein, the interaction mode correspondence is the correspondence between various emotional states and various interaction modes.
4. The user interaction method according to any one of claims 1 to 3, characterized in that, Also includes: Obtain the current environment information and set the scene in which the virtual interactive object is located based on the current environment information.
5. The user interaction method according to claim 4, characterized in that, The step of obtaining current environmental information and setting the scene of the virtual interactive object according to the current environmental information includes: obtaining current time information through a preset time information interface; determining first scene setting information corresponding to the current time information; and setting the scene of the virtual interactive object according to the first scene setting information to adapt to the current time information.
6. The user interaction method according to claim 4, characterized in that, The step of obtaining current environmental information and setting the scene of the virtual interactive object according to the current environmental information includes: obtaining current weather information through a preset weather information interface; determining second scene setting information corresponding to the current weather information; and setting the scene of the virtual interactive object according to the second scene setting information to adapt to the current weather information.
7. The user interaction method according to claim 4, characterized in that, The step of obtaining current environmental information and setting the scene of the virtual interactive object according to the current environmental information includes: obtaining current calendar information through a preset calendar information interface; determining third scene setting information corresponding to the current calendar information; and setting the scene of the virtual interactive object according to the third scene setting information to adapt to the current calendar information.
8. A user interaction device, characterized in that, include: The interaction data acquisition module is used to acquire user interaction data generated by the user during the interaction with the preset virtual interactive object; The emotion state analysis module is used to analyze the user's emotion state in the user interaction data to obtain the user's emotion state corresponding to the user interaction data. An interaction mode determination module is used to determine a target interaction mode corresponding to the user's emotional state; wherein, different emotional states correspond to different interaction modes. The user interaction module is used to control the virtual interactive object to interact with the user according to the target interaction mode.
9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the user interaction method as described in any one of claims 1 to 7.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the user interaction method as described in any one of claims 1 to 7.