Method, device and computer readable storage medium for human-computer interaction

Abstract

Embodiments of the present application relate to the field of artificial intelligence, and provide a method and device for human-computer interaction and a computer readable storage medium. The method is applied to a human-computer interaction device, the human-computer interaction device has multiple interaction modes, the multiple interaction modes include a first interaction mode and a second interaction mode, and the method includes: determining that the human-computer interaction device is currently in the first interaction mode; and performing a first requested interaction action, the first requested interaction action is used to attract a user to interact in the first interaction mode, wherein the first requested interaction action is different from a second requested interaction action, and the second requested interaction action is used to attract the user to interact in the second interaction mode. The above method makes the human-computer interaction device adopt different actions to actively attract the user according to different situations corresponding to different interaction modes, so as to more effectively attract the user to interact.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence, and more specifically, to a method, apparatus, and computer-readable storage medium for human-computer interaction. Background Technology

[0002] With the continuous development of artificial intelligence technology, there are more and more types of robots. Among them, home robots are a relatively important type of robot, which can increase users' happiness and reduce their stress through interaction with them.

[0003] However, most existing home robots passively wait for users to initiate interaction, or use a single method to proactively request interaction, resulting in low user willingness to interact with the robots. Therefore, how to more effectively attract user interaction has become an urgent technical problem to be solved. Summary of the Invention

[0004] This application provides a method, apparatus, and computer-readable storage medium for human-computer interaction, which can actively attract users by adopting different actions according to different situations corresponding to different interaction modes, thereby more effectively attracting users to interact.

[0005] In a first aspect, a method for human-computer interaction is provided. The method is applied to a human-computer interaction device, which has multiple interaction modes, including a first interaction mode and a second interaction mode. The method includes: determining that the human-computer interaction device is currently in a first interaction mode; and executing a first request interaction action, which is used to attract a user to interact in the first interaction mode. The first request interaction action is different from a second request interaction action, which is used to attract a user to interact in the second interaction mode.

[0006] According to the technical solution provided in this application, by providing multiple interaction modes, each corresponding to different interaction actions, different actions can be taken to attract users more effectively according to different situations, thereby attracting users to interact more effectively.

[0007] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: determining the emotion value of the human-computer interaction device based on the user's feedback on the first request interaction action; and performing an emotion action based on the emotion value.

[0008] According to the above technical solution, by adjusting the emotion value of the human-computer interaction device based on user feedback, the human-computer interaction device can express different emotions, thereby giving the human-computer interaction device a stronger sense of life and increasing the user's interest in interacting with the human-computer interaction device.

[0009] In conjunction with the first aspect, in some implementations of the first aspect, emotional actions are performed based on the emotion value, including: when the emotion value is less than or equal to a first emotion threshold, performing actions that express anger and / or disappointment.

[0010] According to the above technical solution, by expressing negative emotions when the emotional value of the human-computer interaction device is in a low range, it is possible to evoke the user's empathy, thereby guiding the user to respond positively to the interaction requests issued by the human-computer interaction device and improving the user's sense of interaction with the human-computer interaction device.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, emotional actions are performed based on the emotion value, including: when the emotion value is greater than or equal to a second emotion threshold, performing an action that expresses happiness.

[0012] According to the above technical solution, by displaying positive emotions when the emotional value of the human-computer interaction device is in a high range, positive feedback can be given to the user, thereby attracting the user to continue to respond to the interaction requests issued by the human-computer interaction device and improving the user's sense of interaction with the human-computer interaction device.

[0013] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: executing a third request interaction action, the third request interaction action being used to further attract the user to interact based on the user's feedback to the first request interaction action in the first interaction mode.

[0014] According to the above technical solution, by continuing to make different request interactions based on user feedback, it is possible to further attract users and thus more effectively encourage them to interact.

[0015] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: when the switching condition is met, the human-computer interaction device switches from the first interaction mode to the second interaction mode.

[0016] According to the above technical solution, by switching the interaction mode of human-computer interaction when the external situation changes, the human-computer interaction device can make request interaction actions that are more in line with the external situation, thereby attracting users to interact more effectively.

[0017] In conjunction with the first aspect, in some implementations of the first aspect, determining that the human-computer interaction device is currently in a first interaction mode includes: when a face is detected and the distance between the face and the human-computer interaction device is greater than a first distance threshold, determining that the first interaction mode is a human-shaped mode, and a first request interaction action is used to attract the user to approach the human-computer interaction device.

[0018] According to the above technical solution, when the user is far away from the human-computer interaction device, the human-computer interaction device can attract the user to move closer through more obvious actions, thereby more easily attracting the user's attention, more effectively attracting the user to interact, and improving the user's interactive experience.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, determining that the human-computer interaction device is currently in a first interaction mode includes: when a face is detected and the distance between the face and the human-computer interaction device is less than a second distance threshold, determining that the first interaction mode is a face mode, and a first request interaction action is used to attract the user to interact with the human-computer interaction device at close range.

[0020] According to the above technical solution, when a user is near a human-computer interaction device, the device can attract the user to make close contact through actions, thereby increasing the fun of the interaction, attracting the user to interact more effectively, and improving the user's interactive experience.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, determining that the human-computer interaction device is currently in a first interaction mode includes: when a control voice is detected and / or a control command issued by an application is received, determining that the first interaction mode is a voice control mode, and a first request interaction action is used to attract the user to issue a voice command.

[0022] According to the above technical solution, when a user sets the human-computer interaction device to voice control mode, the human-computer interaction device can attract the user to issue voice commands through actions, thereby guiding the user's interaction method, attracting the user to interact more effectively, and improving the user's interaction experience.

[0023] In conjunction with the first aspect, in some implementations of the first aspect, determining that the human-computer interaction device is currently in a first interaction mode includes: when a specific gesture is detected, determining that the first interaction mode is a gesture mode, and a first request interaction action is used to attract the user to interact with the human-computer interaction device according to the intention of the specific gesture.

[0024] According to the above technical solution, when a user makes a gesture with a specific meaning, the human-computer interaction device can make an action that matches the meaning of the gesture to attract the user to interact, thereby attracting the user according to the user's intention, attracting the user to interact more effectively, and improving the user's interactive experience.

[0025] Secondly, a human-computer interaction device is provided, which has multiple interaction modes, including a first interaction mode and a second interaction mode. The device includes: a mode determination module for determining that the human-computer interaction device is currently in the first interaction mode; and an action execution module for executing a first request interaction action, which is used to attract the user to interact in the first interaction mode. The first request interaction action is different from the second request interaction action, which is used to attract the user to interact in the second interaction mode.

[0026] In conjunction with the second aspect, in some implementations of the second aspect, the device further includes: an emotion determination module, used to determine the emotion value of the human-computer interaction device based on the user's feedback on the first request interaction action; and an action execution module, used to execute an emotion action based on the emotion value.

[0027] In conjunction with the second aspect, in some implementations of the second aspect, the action execution module is specifically used to: perform actions that express anger and / or disappointment when the emotion value is less than or equal to the first emotion threshold.

[0028] In conjunction with the second aspect, in some implementations of the second aspect, the action execution module is specifically used to: perform an action that expresses happiness when the emotion value is greater than or equal to the second emotion threshold.

[0029] In conjunction with the second aspect, in some implementations of the second aspect, the action execution module is also used to: execute a third request interaction action, which is used in the first interaction mode to further attract the user to interact based on the user's feedback on the first request interaction action.

[0030] In conjunction with the second aspect, in some implementations of the second aspect, the mode determination module is also used to: when the switching conditions are met, the human-computer interaction device switches from the first interaction mode to the second interaction mode.

[0031] In conjunction with the second aspect, in some implementations of the second aspect, the mode determination module is specifically used to: when a face is detected and the distance between the face and the human-computer interaction device is greater than a first distance threshold, determine the first interaction mode as a human-shaped mode, and the first request interaction action is used to attract the user to approach the human-computer interaction device.

[0032] In conjunction with the second aspect, in some implementations of the second aspect, the mode determination module is specifically used to: when a face is detected and the distance between the face and the human-computer interaction device is less than a second distance threshold, determine the first interaction mode as a face mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device at close range.

[0033] In conjunction with the second aspect, in some implementations of the second aspect, the mode determination module is specifically used to: when a control voice is detected and / or a control command is received from the application, determine that the first interaction mode is a voice control mode, and the first request interaction action is used to attract the user to issue a voice command.

[0034] In conjunction with the second aspect, in some implementations of the second aspect, the mode determination module is specifically used to: when a specific gesture is detected, determine the first interaction mode as a gesture mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device according to the intention of the specific gesture.

[0035] Thirdly, a human-computer interaction device is provided, including a processor and a memory, wherein the memory is used to store instructions, and the processor is used to call and execute the instructions from the memory, causing the human-computer interaction device to perform the method in the first aspect or any possible implementation of the first aspect.

[0036] Optionally, the processor can be a general-purpose processor, which can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc.; when implemented in software, the processor can be a general-purpose processor that reads software code stored in memory, which can be integrated into the processor or exist independently outside the processor.

[0037] Fourthly, a chip is provided that acquires and executes instructions to implement the method in the first aspect or any possible implementation of the first aspect.

[0038] Optionally, as one implementation, the chip includes a processor and a data interface, through which the processor reads instructions stored in the memory and executes the method in the first aspect or any possible implementation of the first aspect.

[0039] Optionally, as one implementation, the chip may further include a memory storing instructions, and the processor is used to execute the instructions stored in the memory. When the instructions are executed, the processor is used to perform the method in the first aspect or any possible implementation of the first aspect.

[0040] Fifthly, a computer program product containing instructions is provided, which, when executed by a human-computer interaction device, causes the human-computer interaction device to perform the method described in the first aspect or any possible implementation thereof.

[0041] In a sixth aspect, a computer-readable storage medium is provided, including computer program instructions that, when executed by a human-computer interaction device, cause the human-computer interaction device to perform the method described in the first aspect or any possible implementation thereof.

[0042] As examples, these computer-readable storage media include, but are not limited to, one or more of the following: read-only memory (ROM), programmable ROM (PROM), erasable PROM (EPROM), flash memory, electrically EPROM (EEPROM), and hard drive.

[0043] Alternatively, as one implementation method, the aforementioned storage medium can specifically be a non-volatile storage medium. Attached Figure Description

[0044] Figure 1 This is a system schematic diagram of a human-computer interaction device provided in an embodiment of this application.

[0045] Figure 2 This is a schematic flowchart of a human-computer interaction method provided in an embodiment of this application.

[0046] Figure 3 This is a schematic flowchart of another human-computer interaction method provided in the embodiments of this application.

[0047] Figure 4 This is a schematic structural block diagram of a human-computer interaction device provided in an embodiment of this application.

[0048] Figure 5 This is a schematic structural block diagram of a human-computer interaction device provided in an embodiment of this application. Detailed Implementation

[0049] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0050] This application will present various aspects, embodiments, or features relating to systems comprising multiple devices, components, modules, etc. It should be understood and appreciated that individual systems may include additional devices, components, modules, etc., and / or may not include all devices, components, modules, etc. discussed in conjunction with the accompanying drawings. Furthermore, combinations of these approaches are also possible.

[0051] Furthermore, in the embodiments of this application, the words "exemplary," "for example," etc., are used to indicate that they are examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the term "exemplary" is intended to present the concept in a concrete manner.

[0052] In the embodiments of this application, "corresponding" and "corresponding" can sometimes be used interchangeably. It should be noted that when the distinction is not emphasized, their intended meanings are consistent.

[0053] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0054] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0055] With the continuous development of artificial intelligence technology, the types of robots are increasing. Among them, home robots are a relatively important type, as they can increase user happiness and reduce user stress through interaction. Most existing home robots adopt a passive interaction mode, that is, the user actively initiates the interaction, and the robot can only passively receive the interactive content.

[0056] In order to attract users to interact, some home robots offer proactive interaction capabilities. However, they can only attract users to interact in a fixed way and cannot provide more suitable ways according to different external situations. Therefore, the interaction methods are relatively simple and cannot meet users' needs for home robots (such as pet robots) to have a stronger sense of life, resulting in low user willingness to interact with home robots.

[0057] In view of this, embodiments of this application provide a method for human-computer interaction. The human-computer interaction device using this method has multiple interaction modes, and different interaction modes correspond to different external situations. By executing different request interaction actions in different interaction modes, more targeted actions can be used to actively attract users based on the user's state and / or intention, thereby attracting users to interact more effectively.

[0058] Figure 1 This is a system schematic diagram of a human-computer interaction device provided in an embodiment of this application. For example... Figure 1 As shown, the human-computer interaction device 100 may include a processor 110, an actuator 111, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 150, a sensor module 160, an audio module 170, a speaker 170A, a microphone 170B, a camera 180, a display screen 190, etc.

[0059] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the human-computer interaction device 100. In other embodiments of this application, the human-computer interaction device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0060] Processor 110 may include one or more processing units, such as a graphics processing unit (GPU), a controller, and memory. These processing units may be independent devices or integrated into one or more processors. The controller may serve as the central processing unit and command center of the human-computer interaction device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The memory stores instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has recently used or is recurring. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the processor 110's waiting time, and thus improves system efficiency.

[0061] In some embodiments, processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a USB interface, etc. The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple I2S buses. Processor 110 can be coupled to audio module 170 via the I2S bus to achieve communication between processor 110 and audio module 170. The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 150 can be coupled via a PCM bus interface. The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 150. The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 190 and the camera 180. The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 180, display 190, wireless communication module 150, sensor module 160, audio module 170, etc.

[0062] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the human-computer interaction device 100. In other embodiments of this application, the human-computer interaction device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0063] Actuator 111 is used to control the human-machine interface device 100 to move, rotate, jump, etc. Optionally, in some embodiments, if the human-machine interface device 100 includes ears, torso, and legs, actuator 111 is also used to control the torso to rotate relative to the legs, the legs to rotate relative to the torso, the torso to sway, or the ears to rotate along the torso, etc. Optionally, in some embodiments, actuator 111 may include at least one motor.

[0064] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the human-computer interaction device 100.

[0065] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the human-computer interaction device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the human-computer interaction device 100 (such as audio data, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0066] USB interface 130 is an interface that conforms to the USB standard specification, specifically it can be a Mini USB interface, Micro USB interface, USB Type C interface, etc. USB interface 130 can be used to connect a charger to charge the human-computer interaction device 100, and it can also be used for data transfer between the human-computer interaction device 100 and peripheral devices.

[0067] The charging management module 140 receives charging input from a charger, which can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the human-machine interface device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141. The power management module 141 connects the battery 142, the charging management module 140, and the processor 110.

[0068] The wireless communication module 150 can provide solutions for wireless communication applications on the human-computer interaction device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks) and Bluetooth (BT).

[0069] In some embodiments, the antenna of the human-computer interaction device 100 is coupled to the wireless communication module 150, enabling the human-computer interaction device 100 to communicate with networks and other devices via wireless communication technology.

[0070] Sensor module 160 may include at least one sensor. For example, sensor module 160 may include a pressure sensor, a touch sensor, a distance sensor, etc. The pressure sensor is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor / touch sensor may be located on the top of the head, neck, back, abdomen, etc., of the human-computer interaction device to sense user interaction actions such as touching or patting. The distance sensor is used to measure distance. The touch sensor, also called a "touch panel," may be located on the display screen 190. The touch sensor and the display screen 190 together form a touchscreen, also called a "touch screen." In some embodiments, the display screen 190 may display facial animations to represent the current emotional state of the human-computer interaction device.

[0071] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 may be located in processor 110, or some functional modules of audio module 170 may be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Microphone 170B, also called a "microphone" or "microphone," is used to convert sound signals into electrical signals.

[0072] The human-computer interaction device 100 can realize audio functions through an audio module 170, a speaker 170A, a microphone 170B, and a processor 110, such as voice playback and recording.

[0073] The camera 180 is used to capture still images or videos so that the processor 110 can detect events based on the images or videos acquired by the camera 180, and thus provide feedback on the events.

[0074] The display screen 190 is used to display images, videos, etc.

[0075] Figure 2A schematic flowchart illustrating a human-computer interaction method provided in an embodiment of this application is shown. Optionally, Figure 2 The method can be derived from Figure 1 The human-computer interaction device 100 shown is executed.

[0076] like Figure 2 As shown, the method includes the following steps.

[0077] S210: Determine that the human-computer interaction device is currently in the first interaction mode.

[0078] For example, the human-computer interaction device may include multiple interaction modes. In step S210, the human-computer interaction device can determine the first interaction mode, which is currently in one of the multiple interaction modes, based on the external situation. Optionally, the interaction modes of the human-computer interaction device may include, but are not limited to, humanoid mode, face mode, voice control mode, gesture mode, etc. The first interaction mode may be any one of the above-mentioned human-computer interaction modes.

[0079] For example, when the user is far from the human-computer interaction device, the first interaction mode can be a human-shaped mode. Specifically, the human-computer interaction device can determine whether it is in human-shaped mode based on whether a face is detected and the distance to the face. For example, Figure 1 The human-computer interaction device 100 shown can capture static images or videos through the camera 180. When a human face is identified in the captured static image or video, the sensor module 160 can measure the distance from the identified human face to the human-computer interaction device. When the distance is greater than a first distance threshold, it is determined that the human-computer interaction device 100 is in human form mode.

[0080] For example, when a user is near a human-computer interaction device, the first interaction mode could be face mode. Specifically, the human-computer interaction device can determine whether it is in face mode based on whether a face is detected and the distance to the face. For example, Figure 1 The human-computer interaction device 100 shown can capture static images or videos through the camera 180. When a face is identified in the captured static image or video, the sensor module 160 can measure the distance from the identified face to the human-computer interaction device. When the distance is less than a second distance threshold, it is determined that the human-computer interaction device 100 is in face mode.

[0081] For example, when a user enters voice control mode through an application (APP) or voice-controlled robot, the first interaction mode can be voice control mode. Specifically, the human-computer interaction device can determine whether it is in voice control mode based on whether it receives control voice or control commands from the APP. For example, Figure 1The human-computer interaction device 100 shown can receive sound signals through an audio module (e.g., microphone 170B). When a specific command is identified in the sound signal, it is determined that the human-computer interaction device 100 is in voice control mode; or after the user controls the human-computer interaction device 100 to enter voice control mode through an application, it is determined that the human-computer interaction device 100 is in voice control mode.

[0082] For example, when a user makes a gesture with a specific meaning, the first interaction mode can be a gesture mode. Specifically, the human-computer interaction device can determine whether it is in gesture mode based on whether a specific gesture is detected. For example, Figure 1 The human-computer interaction device 100 shown can capture static images or videos through the camera 180. When a specific gesture is recognized in the captured static image or video, it is determined that the human-computer interaction device 100 is currently in gesture mode.

[0083] It should be understood that the interaction mode names defined above are for ease of explanation only and do not constitute a limitation on the interaction modes. Interaction modes that can reflect the same or similar external situations may also have other names. For example, the humanoid mode in the embodiments of this application may also be called human body mode, long-distance mode, etc. in other implementations. This application does not make specific limitations in this regard.

[0084] S220: Execute the first request interaction action.

[0085] For example, in step S220, the human-computer interaction device can execute a corresponding request interaction action according to the current interaction mode, in order to more effectively attract the user to interact in that interaction mode. It should be understood that the request interaction action executed by the human-computer interaction device differs depending on the interaction mode. Specifically, the multiple interaction modes of the human-computer interaction device may include a first interaction mode and a second interaction mode. A first request interaction action is used to attract the user to interact in the first interaction mode, and a second request interaction action is used to attract the user to interact in the second interaction mode; therefore, the first request interaction action and the second request interaction action are different.

[0086] For example, when a human-computer interaction device is in humanoid mode, it can perform larger or more obvious actions, such as singing, dancing, spinning, or raising its leg to greet, because it is farther away from the user. This makes it easier to attract the attention of users at a distance and encourages them to come closer.

[0087] For example, when a human-computer interaction device is in face mode, it can perform more subtle but expressive movements because it is close to the user, thereby attracting the user to engage in close-range interaction. For example, it might look up at the user and then shyly hide its head, look down and ask for a pat, make a funny face to make the user laugh, pretend that its ear is broken and try to ask the user to help fix it, or show a game interface and ask to play a game with the user.

[0088] For example, when a human-computer interaction device is in voice control mode, it needs to receive the user's voice commands. It can attract the user to make voice sounds by moving their head or tilting their ear to listen, thereby guiding the user's interaction and improving the user's interactive experience.

[0089] For example, when a human-computer interaction device is in gesture mode, it can interpret the intent of the user's specific gestures. For instance, a heart shape represents liking, a fist represents a fist bump, a peace sign represents affirmation, touching the head represents affection, and both thumbs and index fingers at a 90-degree angle and clasped together indicate taking a photo. Based on this specific intent, the device can perform actions that match the meaning of the gesture to attract the user's interaction. For example, if the human-computer interaction device is a robotic pet dog, when the user extends their fist, the robotic pet dog can raise its front leg to make a fist bump gesture; when the user extends their palm, the robotic pet dog can bring its head close to the user's palm to show affection; or when the user makes a photo-taking gesture, the robotic pet dog can face the user and pose as if wanting the user to take a photo.

[0090] It should be understood that the first request interaction action in the first interaction mode is not unique; that is, multiple different request interaction actions can be executed within the same interaction mode. For example, in gesture mode, the human-computer interaction device can execute different request interaction actions based on the different intentions represented by different gestures of the user. Similarly, in humanoid or face mode, the human-computer interaction device can execute different request interaction actions based on different recognized faces. Taking face mode as an example, when the recognized face is a user face that the human-computer interaction device has recorded, the device can perform the action of extending its head towards the user for a touch; when the recognized face is a stranger's face that the device has not recorded, the device can perform the action of turning its head away.

[0091] By providing multiple interaction modes, each corresponding to different interaction actions, the technical solutions of this application can take more targeted actions to attract users according to different situations, thereby attracting users to interact more effectively.

[0092] In some possible implementations, in order to make the human-computer interaction device bring users a stronger sense of life, after executing the requested interaction action, the human-computer interaction device can adjust and execute subsequent actions based on user feedback and / or changes in external conditions, attracting users to interact through a series of related actions, thereby making the user experience a more complete and coherent interaction process and improving the user's interaction experience.

[0093] In this case, Figure 3 A schematic flowchart of another human-computer interaction method provided in an embodiment of this application is shown. Optionally, Figure 3The method can be derived from Figure 1 The human-computer interaction device 100 shown is executed.

[0094] like Figure 3 As shown, the method includes the following steps.

[0095] S310: Determine that the human-computer interaction device is currently in the first interaction mode.

[0096] S320: Execute the first request interaction action.

[0097] Optionally, the specific implementation of the above steps S310 and S320 can be found in the relevant descriptions of the corresponding steps S210 and S220 in the above embodiments, which will not be elaborated on here.

[0098] Optionally, the above method may further include optional steps S331, S332, S340 and S350.

[0099] S331: Determine the emotion value of the human-computer interaction device based on the user's feedback on the first request interaction action.

[0100] For example, a human-computer interaction device can adjust the displayed emotions through a parameter called "emotion value." In step S331, the device adjusts the emotion value based on the user's feedback to the requested interaction. For instance, when the user provides positive feedback, the original emotion value is increased by a preset emotion change value to determine the current emotion value; when the user does not respond to the interaction or provides negative feedback, the original emotion value is decreased by a preset emotion change value to determine the current emotion value. The original emotion value can be the initial emotion value or the value after the last change, thus making the device exhibit more continuous emotion changes. For example, when the device is powered on or initialized, the emotion value is set to an initial emotion value of 60. When a request is made and a positive response is received, the emotion value increases by 10 from 60 to 70, indicating an increase in positive emotion. When a request is made again but no response is received, the emotion value decreases by 20 from 70 to 50, indicating a decrease in positive emotion. It should be understood that the way the emotion value changes in the above examples is only for illustrative purposes and does not constitute a specific limitation. For example, an increase in the emotion value can also reflect an increase in negative emotions, and a decrease in the emotion value can reflect a decrease in negative emotions. No specific limitation is imposed.

[0101] S332: Perform an emotional action based on the emotion value.

[0102] For example, in step S332, the human-computer interaction device can perform corresponding emotional actions based on a determined emotion value to reflect the emotional changes of the human-computer interaction device. Specifically, the human-computer interaction device can perform different emotional actions according to different ranges of emotion values, thereby making the human-computer interaction device more lifelike and increasing the user's interest in interacting with the human-computer interaction device.

[0103] In some possible implementations, actions expressing anger and / or sadness are executed when the emotion value is less than or equal to a first emotion threshold. For example, with an upper limit of 100 for the emotion value, the human-computer interaction device can execute actions expressing anger and sadness, such as turning away and running away, when the emotion value is less than or equal to 40; or the human-computer interaction device can execute actions expressing sadness, such as bowing one's head and lying on the ground, when the emotion value is less than or equal to 20, and execute actions expressing anger, such as stomping one's feet or arching one's back. In addition to physical actions, the human-computer interaction device can also execute preset / real-time facial animations expressing anger or sadness through the display screen and play preset / real-time sounds expressing anger or sadness through the audio module. In this way, the human-computer interaction device can express negative emotions when the emotion value is in a low range, evoke the user's empathy, and thus guide the user to respond positively to the interaction requests issued by the human-computer interaction device.

[0104] In some possible implementations, when the emotion value is greater than or equal to a second emotion threshold, a happy action is performed. For example, if the upper limit of the emotion value is set to 100, the human-computer interaction device can perform happy actions, such as wagging its tail, shaking its ears, or spinning, when the emotion value is greater than or equal to 80. In addition to physical actions, the human-computer interaction device can also execute preset / real-time facial animations expressing happiness through the display screen and play preset / real-time sounds expressing happiness through the audio module. In this way, the human-computer interaction device can express positive emotions when the emotion value is in a high range, giving users positive feedback and thus attracting users to continue responding to the interaction requests issued by the human-computer interaction device.

[0105] S340: Execute the third request interaction action.

[0106] Specifically, the third request interaction action is used to further attract the user to interact based on the user's feedback to the first request interaction action in the first interaction mode. For example, in step S332, the human-computer interaction device can continue to make different request interaction actions based on the user's feedback, thereby further attracting the user to interact.

[0107] For example, when the system detects that the user's thumbs and index fingers are at a 90-degree angle and clasped together, the AI ​​interaction device determines that it is currently in gesture mode and that the user intends to take a picture. Therefore, it will pose for a picture in front of the user. When the user abandons the gesture, the AI ​​interaction device will make a pleading gesture and display a small camera icon on the screen. When the system detects that the user makes the photo-taking gesture again, the robot will pose for a picture again and make a kiss gesture to thank the user.

[0108] Through the technical solutions of the embodiments of this application, the human-computer interaction device can, after making a request for interaction, take further actions to attract the user to interact based on the user's feedback, thereby attracting the user to interact through a series of interrelated actions, making the user experience a more complete and coherent interaction process, and improving the user's interaction experience.

[0109] S350: When the switching conditions are met, the human-computer interaction device switches from the first interaction mode to the second interaction mode.

[0110] For example, in step S332, the human-computer interaction device can switch its interaction mode when the external situation changes. Specifically, the human-computer interaction device can continuously detect the external situation (e.g., capturing still images or videos through a camera, or receiving sound signals through a microphone), and when the detected external situation meets the switching conditions of the interaction mode, it switches to the corresponding interaction mode. Optionally, the switching conditions of the interaction mode can be the same as the conditions for determining the interaction mode in S210.

[0111] Optionally, step S350 can be executed before or after any step of the method, meaning the human-computer interaction device can switch its interaction mode at any time according to external circumstances. For example, step S350 can be executed before step S340, meaning the human-computer interaction device can make corresponding further request interaction actions based on the changed interaction mode and user feedback, thereby making the request interaction actions made by the human-computer interaction device more appropriate.

[0112] For example, when the user is far away, the human-computer interaction device is in humanoid mode and will attract the user's attention by dancing; when the user notices the human-computer interaction device's movements and approaches, the device switches to face mode when it detects that the distance to the user is less than a threshold, and because the user has given positive feedback, the artificial intelligence device will display a game interface and invite the user to play the game; when the device detects the user's gesture of reaching out to touch the user during the interaction, the artificial intelligence device switches to gesture mode and stretches its head toward the user's hand to request a touch.

[0113] Through the technical solutions of the embodiments of this application, the human-computer interaction device can not only take different request interaction actions according to different interaction modes, but also make subsequent actions to express emotions and / or further request user interaction based on user feedback. Moreover, the interaction mode can also be switched according to changes in external conditions, so that the user's interaction experience with the human-computer interaction device is coherent and vivid, thereby giving the human-computer interaction device a stronger sense of life and improving the user's interaction experience.

[0114] The above text combined Figure 2 and Figure 3 This application provides an embodiment of the human-computer interaction method. The following describes the method in conjunction with... Figure 4 and Figure 5 This application describes an embodiment of a human-computer interaction device. It should be understood that the device embodiments correspond to the method embodiments, and similar descriptions can be found in the method embodiments.

[0115] Figure 4 A schematic structural block diagram of a human-computer interaction device 400 provided in an embodiment of this application is shown.

[0116] like Figure 4 As shown, the device 400 includes: a pattern determination module 410, an action execution module 420, and optionally, an emotion determination module 430.

[0117] Specifically, the mode determination module 410 is used to determine that the human-computer interaction device is currently in a first interaction mode, wherein the device 400 has multiple interaction modes, including a first interaction mode and a second interaction mode.

[0118] Specifically, the action execution module 420 is used to execute a first request interaction action, which is used to attract the user to interact in a first interaction mode. The first request interaction action is different from the second request interaction action, which is used to attract the user to interact in a second interaction mode.

[0119] Optionally, the emotion determination module 430 is used to determine the emotion value of the human-computer interaction device based on the user's feedback to the first request interaction action; the action execution module 420 is also used to execute the emotion action based on the emotion value.

[0120] Optionally, in some possible implementations, the action execution module 420 is specifically used to perform actions that express anger and / or disappointment when the emotion value is less than or equal to a first emotion threshold.

[0121] Optionally, in some possible implementations, the action execution module 420 is specifically used to perform an action that expresses happiness when the emotion value is greater than or equal to a second emotion threshold.

[0122] Optionally, in some possible implementations, the action execution module 420 is further configured to execute a third request interaction action, which is used to further attract the user to interact based on the user's feedback to the first request interaction action in the first interaction mode.

[0123] Optionally, in some possible implementations, the mode determination module 410 is further configured to switch the human-computer interaction device from the first interaction mode to the second interaction mode when the switching conditions are met.

[0124] Optionally, in some possible implementations, the pattern determination module 410 is specifically used to determine the first interaction mode as a human-shaped mode when a face is detected and the distance between the face and the human-computer interaction device is greater than a first distance threshold, and the first request interaction action is used to attract the user to approach the human-computer interaction device.

[0125] Optionally, in some possible implementations, the pattern determination module 410 is specifically used to determine the first interaction mode as a face mode when a face is detected and the distance between the face and the human-computer interaction device is less than a second distance threshold, and the first request interaction action is used to attract the user to interact with the human-computer interaction device at close range.

[0126] Optionally, in some possible implementations, the mode determination module 410 is specifically used to determine the first interaction mode as a voice control mode when it detects control voice and / or receives control commands issued by the application, and the first request interaction action is used to attract the user to issue voice commands.

[0127] Optionally, in some possible implementations, the pattern determination module 410 is specifically used to determine the first interaction mode as a gesture mode when a specific gesture is detected, and the first request interaction action is used to attract the user to interact with the human-computer interaction device according to the intention of the specific gesture.

[0128] All of the above modules can be implemented in software or in hardware.

[0129] This application also provides a human-computer interaction device 500. For example... Figure 5 As shown, the human-computer interaction device 500 includes: one or more processors 510, and one or more memories 520. The one or more memories 520 store one or more computer programs, which include instructions. When the instructions are executed by the one or more processors 510, the human-computer interaction device 500 performs the aforementioned human-computer interaction method.

[0130] This application also provides a chip, which includes a processor and a data interface. The processor reads instructions stored in the memory through the data interface to execute the above-described human-computer interaction method.

[0131] This application also provides a computer program product containing instructions. The computer program product may be a software or program product containing instructions, capable of running on a computing device or stored on any usable medium. When the computer program product is run on a human-computer interaction device, it causes the human-computer interaction device to perform the aforementioned human-computer interaction method.

[0132] This application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that a computing device can store, or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive). The computer-readable storage medium includes instructions that instruct the computing device to perform the aforementioned human-computer interaction method.

[0133] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0134] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of this application.

Claims

1. A method for human-computer interaction, characterized in that, The method is applied to a human-computer interaction device, the human-computer interaction device having multiple interaction modes, the multiple interaction modes including a first interaction mode and a second interaction mode, the method comprising: It is determined that the human-computer interaction device is currently in the first interaction mode; Execute a first request interaction action, which is used to attract the user to interact in the first interaction mode. The first request interaction action is different from the second request interaction action, which is used to attract the user to interact in the second interaction mode. The method further includes: Based on the user's feedback on the first request interaction action, the emotion value of the human-computer interaction device is determined, wherein the emotion value is used to adjust the emotion expressed by the human-computer interaction device. Based on the stated emotion value, perform the corresponding emotional action. The step of determining the emotion value of the human-computer interaction device based on the user's feedback on the first request interaction action includes: determining an emotion change value based on the user's feedback on the first request interaction action; increasing or decreasing the emotion change value based on the first emotion value to determine a second emotion value, wherein the first emotion value is the emotion value of the human-computer interaction device after the last interaction between the human-computer interaction device and the user, and the second emotion value is the emotion value of the human-computer interaction device after the current interaction between the human-computer interaction device and the user. The step of performing an emotional action based on the emotional value includes: performing an action expressing anger and / or disappointment when the emotional value is less than or equal to a first emotional threshold; and performing an action expressing happiness when the emotional value is greater than or equal to a second emotional threshold.

2. The method according to claim 1, characterized in that, The method further includes: A third request interaction action is executed, which is used to further attract the user to interact based on the user's feedback on the first request interaction action in the first interaction mode.

3. The method according to claim 1, characterized in that, The method further includes: When the switching conditions are met, the human-computer interaction device switches from the first interaction mode to the second interaction mode.

4. The method according to any one of claims 1 to 3, characterized in that, Determining that the human-computer interaction device is currently in the first interaction mode includes: When a face is detected and the distance between the face and the human-computer interaction device is greater than a first distance threshold, the first interaction mode is determined to be a human-shaped mode, and the first request interaction action is used to attract the user to approach the human-computer interaction device.

5. The method according to any one of claims 1 to 3, characterized in that, Determining that the human-computer interaction device is currently in the first interaction mode includes: When a face is detected and the distance between the face and the human-computer interaction device is less than a second distance threshold, the first interaction mode is determined to be a face mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device at close range.

6. The method according to any one of claims 1 to 3, characterized in that, Determining that the human-computer interaction device is currently in the first interaction mode includes: When a control voice is detected and / or a control command is received from an application, the first interaction mode is determined to be a voice control mode, and the first request interaction action is used to attract the user to issue a voice command.

7. The method according to any one of claims 1 to 3, characterized in that, Determining that the human-computer interaction device is currently in the first interaction mode includes: When a specific gesture is detected, the first interaction mode is determined to be a gesture mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device according to the intention of the specific gesture.

8. A human-computer interaction device, characterized in that, The device has multiple interaction modes, including a first interaction mode and a second interaction mode, and the device includes: A mode determination module is used to determine that the human-computer interaction device is currently in the first interaction mode; An action execution module is used to execute a first request interaction action, which is used to attract the user to interact in the first interaction mode. The first request interaction action is different from a second request interaction action, which is used to attract the user to interact in the second interaction mode. The device further includes: An emotion determination module is used to determine the emotion value of the human-computer interaction device based on the user's feedback to the first request interaction action, wherein the emotion value is used to adjust the emotion expressed by the human-computer interaction device. The action execution module is further configured to perform emotional actions based on the emotion value. Specifically, the emotion determination module is used to: determine an emotion change value based on the user's feedback to the first request interaction action; and increase or decrease the emotion change value based on the first emotion value to determine a second emotion value, wherein the first emotion value is the emotion value of the human-computer interaction device after the last interaction between the human-computer interaction device and the user, and the second emotion value is the emotion value of the human-computer interaction device after the current interaction between the human-computer interaction device and the user. The action execution module is specifically used to: perform actions expressing anger and / or disappointment when the emotion value is less than or equal to a first emotion threshold; and perform actions expressing happiness when the emotion value is greater than or equal to a second emotion threshold.

9. The apparatus according to claim 8, characterized in that, The action execution module is also used for: A third request interaction action is executed, which is used to further attract the user to interact based on the user's feedback on the first request interaction action in the first interaction mode.

10. The apparatus according to claim 8, characterized in that, The pattern determination module is further configured to: When the switching conditions are met, the human-computer interaction device switches from the first interaction mode to the second interaction mode.

11. The apparatus according to any one of claims 8 to 10, characterized in that, The pattern determination module is used for: When a face is detected and the distance between the face and the human-computer interaction device is greater than a first distance threshold, the first interaction mode is determined to be a human-shaped mode, and the first request interaction action is used to attract the user to approach the human-computer interaction device.

12. The apparatus according to any one of claims 8 to 10, characterized in that, The pattern determination module is used for: When a face is detected and the distance between the face and the human-computer interaction device is less than a second distance threshold, the first interaction mode is determined to be a face mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device at close range.

13. The apparatus according to any one of claims 8 to 10, characterized in that, The pattern determination module is used for: When a control voice is detected and / or a control command is received from an application, the first interaction mode is determined to be a voice control mode, and the first request interaction action is used to attract the user to issue a voice command.

14. The apparatus according to any one of claims 8 to 10, characterized in that, The pattern determination module is used for: When a specific gesture is detected, the first interaction mode is determined to be a gesture mode, and the first request interaction action is used to attract the user to interact with the human-computer interaction device according to the intention of the specific gesture.

15. A human-computer interaction device, characterized in that, It includes a processor and a memory, the processor being configured to execute instructions stored in the memory to cause the human-computer interaction device to perform the method as described in any one of claims 1 to 7.

16. A computer-readable storage medium, characterized in that, It includes computer program instructions that, when executed by a human-computer interaction device, cause the human-computer interaction device to perform the method as described in any one of claims 1 to 7.

Images