Human-computer interaction device and human-computer interaction method

Abstract

A human-computer interaction device (300) and a human-computer interaction method, the human-computer interaction device (300) having a plurality of interaction modes, each interaction mode comprising at least one interaction state, the interaction state being used to indicate the state of the human-computer interaction device (300) in the process of interacting with the outside, the human-computer interaction device (300) comprising: a detection unit (310), the first detector detects a first event; the processing unit (320) is used for determining a first processing mode of the first event according to a first interaction mode in which the human-computer interaction device (300) is located and a first interaction state in the first interaction mode, and the first interaction mode is one of the multiple interaction modes. Thus, the human-computer interaction device (300) can flexibly process the detected event according to the interaction mode and the interaction state, thereby improving the interaction effect between the user and the human-computer interaction device (300), and contributing to improving the user experience.

Description

Human-computer interaction device and human-computer interaction method

[0001] The embodiments of the present application relate to the field of artificial intelligence technology, and more specifically, to a human-computer interaction device and a human-computer interaction method.

[0002] With the continuous development of artificial intelligence technology, there are more and more types of robots. Among them, home robots are a relatively important type of robot, which can increase the user's happiness and reduce the user's stress through interaction with the user.

[0003] However, the interactions between existing home robots and users are all pre-written and no longer change, that is, existing home robots can only perform human-computer interaction mechanically, resulting in a poor user experience.

[0004]

[0005] The embodiments of the present application provide a human-computer interaction device and a human-computer interaction method. The human-computer interaction device can flexibly process detected events according to the interaction mode and interaction state, thereby improving the interaction effect between the user and the human-computer interaction device and helping to improve the user experience.

[0006] In a first aspect, a human-computer interaction device is provided, wherein the human-computer interaction device has multiple interaction modes, each of the interaction modes includes at least one interaction state, and the interaction state is used to indicate the state of the human-computer interaction device in the process of interacting with the outside world. The human-computer interaction device includes: a detection unit, used to detect a first event; and a processing unit, used to determine a first processing method for the first event according to the first interaction mode of the human-computer interaction device and the first interaction state under the first interaction mode, wherein the first interaction mode is one of the multiple interaction modes.

[0007] Compared with the existing solutions that use the same feedback for the same event, the embodiments of the present application can flexibly process events based on the interaction mode and the interaction state under the interaction mode, thereby improving the accuracy of the human-computer interaction device's analysis of the user's behavioral intentions or external environment, improving the interaction effect between the user and the human-computer interaction device, and helping to improve the user experience.

[0008] In one achievable manner, the human-computer interaction device further includes: a first switching unit, configured to switch from the second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event.

[0009] At this time, the first event can be called an interactive state switching event. For example, the first event can be a pick-up event or a fall event.

[0010] After detecting the first event, the human-computer interaction device does not switch the current interaction mode but only switches the current interaction state based on the human-computer interaction device's analysis of the user's behavioral intention or the external environment, and determines the processing method for the first event based on the switched interaction state and the current first interaction mode, which can further improve the interaction effect between the user and the human-computer interaction device and further help to improve the user experience.

[0011] In another achievable manner, the human-computer interaction device further includes: a second switching unit, configured to switch from a third interaction state in a second interaction mode to the first interaction state in the first interaction mode according to the first event, the second interaction mode being one of the multiple interaction modes.

[0012] At this time, the first event may be referred to as an interactive mode switching event. For example, the first event may be a close-up face event, a long-distance face event, a human figure event, a voice input event, or an application program control event.

[0013] After detecting the first event, the human-computer interaction device not only changes the current interaction mode but also switches the current interaction state based on the human-computer interaction device's analysis of the user's behavioral intention or the external environment, and determines the processing method for the first event based on the switched interaction state and the switched first interaction mode, which can further improve the interaction effect between the user and the human-computer interaction device and further help to improve the user experience.

[0014] Further improving the accuracy of the human-computer interaction device's analysis of the user's behavioral intention or external environment, improving the interaction effect between the user and the human-computer interaction device, and further helping to improve the user experience.

[0015] In a second aspect, a human-computer interaction method is provided, and the human-computer interaction method is applied to a human-computer interaction device, the human-computer interaction device has multiple interaction modes, each of the interaction modes includes at least one interaction state, and the interaction state is used to indicate the state of the human-computer interaction device in the process of interacting with the outside world. The human-computer interaction method includes: detecting a first event; determining a first processing method for the first event according to the first interaction mode of the human-computer interaction device and the first interaction state under the first interaction mode, wherein the first interaction mode is one of the multiple interaction modes.

[0016] In one achievable manner, the method further includes: switching from the second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event.

[0017] Exemplarily, the first event is a picking up event or a falling down event.

[0018] In another achievable manner, the method further includes: switching from a third interaction state in a second interaction mode to the first interaction state in the first interaction mode according to the first event, the second interaction mode being one of the multiple interaction modes.

[0019] Exemplarily, the first event is a close-up face event, a long-distance face event, a human shape event, a voice input event, or an application manipulation event.

[0020] The technical effects of any possible implementation method of the second aspect can refer to the technical effects of the corresponding implementation method of the first aspect, and will not be repeated here.

[0021] In a third aspect, a human-computer interaction device is provided, comprising: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the human-computer interaction device to perform the human-computer interaction method as described in the second aspect or any possible implementation of the second aspect.

[0022] In a fourth aspect, a computer-readable storage medium is provided, comprising computer instructions. When the computer instructions are executed on a human-computer interaction device, the human-computer interaction device executes the human-computer interaction method as described in the second aspect or any possible implementation of the second aspect.

[0023] In a fifth aspect, a chip is provided, comprising at least one processor and an interface circuit, wherein the interface circuit is used to provide program instructions or data to the at least one processor, and the at least one processor is used to execute the program instructions to implement the human-computer interaction method as described in the second aspect or any possible implementation method of the second aspect.

[0024] In a sixth aspect, a computer program product is provided, which includes computer instructions; when part or all of the computer instructions are run on a computer, the human-computer interaction method described in the second aspect or any possible implementation of the second aspect is executed.

[0025] FIG1 is a schematic diagram of the hardware structure of a human-computer interaction device provided in an embodiment of the present application.

[0026] FIG2 is a schematic flowchart of an example of a human-computer interaction method provided in an embodiment of the present application.

[0027] FIG3 is a schematic flowchart of another human-computer interaction method provided in an embodiment of the present application.

[0028] FIG4 is a schematic flowchart of another human-computer interaction method provided in an embodiment of the present application.

[0029] FIG5 is a schematic structural diagram of an example of a human-computer interaction device provided in an embodiment of the present application.

[0030] FIG. 6 is a schematic structural diagram of another example of a human-computer interaction device provided in an embodiment of the present application.

[0031] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0032] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" means two or more than two.

[0033] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0034] For example, FIG1 shows a schematic diagram of a structure of a human-computer interaction device 100 provided in an embodiment of the present application.

[0035] For example, as shown in Figure 1, the human-computer interaction device 100 may include a processor 110, an actuator 111, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 150, a sensor module 160, an audio module 170, a speaker 170A, a microphone 170B, a camera 180, a display screen 190, etc.

[0036] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the human-computer interaction device 100. In other embodiments of the present application, the human-computer interaction device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0037] The processor 110 may include one or more processing units. For example, the processor 110 may include a graphics processing unit (GPU), a controller, a memory, etc. Different processing units may be independent devices or integrated into one or more processors.

[0038] The controller may be the nerve center and command center of the human-machine interaction device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0039] The memory is used to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0040] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a USB interface, etc. Among them, the I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 150 can be coupled via a PCM bus interface. The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 150. The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 190 and the camera 180. The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 180, the display screen 190, the wireless communication module 150, the sensor module 160, the audio module 170, etc.

[0041] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the human-computer interaction device 100. In other embodiments of the present application, the human-computer interaction device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0042] The actuator 111 is used to control the human-computer interaction device 100 to move, rotate, jump, etc. Optionally, in some embodiments, if the human-computer interaction device 100 includes ears, a trunk and legs, the actuator 111 is also used to control the trunk to rotate relative to the legs, the legs to rotate relative to the trunk, the trunk to shake, or the ears to rotate along the trunk, etc. Optionally, in some embodiments, the actuator 111 may include at least one motor.

[0043] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the human-computer interaction device 100 .

[0044] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the human-computer interaction device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as audio data, etc.) created during the use of the human-computer interaction device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0045] The USB interface 130 is an interface that complies with USB standard specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the human-machine interaction device 100, and may also be used to transmit data between the human-machine interaction device 100 and peripheral devices.

[0046] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the human-computer interaction device 100. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.

[0047] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), etc., applied to the human-computer interaction device 100.

[0048] In some embodiments, the antenna of the human-machine interaction device 100 is coupled to the wireless communication module 150 , so that the human-machine interaction device 100 can communicate with the network and other devices through wireless communication technology.

[0049] The sensor module 160 may include at least one sensor. For example, the sensor module 160 includes a touch sensor, a distance sensor, a posture sensor, etc. In some embodiments, the touch sensor is a capacitive sensor, which can be set on the top of the head, neck, back, abdomen, etc. of the human-computer interaction device to sense the user's touch, tap, and other interactive actions. The distance sensor is used to measure the distance between the human-computer interaction device and an object in the external environment or a user. The posture sensor is a gyroscope, which is used to sense the posture change of the human-computer interaction device.

[0050] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The microphone 170B, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0051] The human-computer interaction device 100 can implement audio functions such as voice playback and recording through the audio module 170, the speaker 170A, the microphone 170B, and the processor 110.

[0052] The camera 180 is used to capture static images or videos, so that the processor 110 can detect events based on the images or videos acquired by the camera 180 , and can thus process the events, etc.

[0053] The display screen 190 is used to display images, videos, etc. In some embodiments, the display screen 190 can display expression animations to express the current emotional state of the human-computer interaction device.

[0054] The human-computer interaction method provided in the embodiment of the present application is described below in conjunction with Figures 2 to 4.

[0055] FIG. 2 is a schematic flowchart of a human-computer interaction method 200 provided in an embodiment of the present application.

[0056] The human-computer interaction method 200 shown in FIG. 2 can be applied to the human-computer interaction device 100 shown in FIG. 1 .

[0057] For example, as shown in Fig. 2, method 200 includes S210 and S220, and S220 is performed after S210. S210 and S220 are described in detail below.

[0058] S210, detecting a first event.

[0059] The events involved in the embodiments of the present application can be understood as external environment change events of the human-computer interaction device.

[0060] Exemplarily, events may include but are not limited to obstacle events, face events, close-range face events, long-range face events, touch events, gesture events, application manipulation events, voice input events, desktop edge events, human shape events, pick-up events, falling events, etc.

[0061] Exemplarily, the human-computer interaction device may include a detection unit (such as a distance sensor, a camera, etc.), and the human-computer interaction device determines whether an obstacle event occurs through the detection unit.

[0062] For example, the human-computer interaction device will periodically send a detection signal through a distance sensor. Based on the signal reflected from the detection signal received by the human-computer interaction device, and / or combined with the static image or video captured by the camera, the human-computer interaction device can detect whether there are obstacles in the external environment. At this time, the human-computer interaction device has detected an obstacle event.

[0063] Furthermore, after determining that there is an obstacle event, the human-machine interaction device can also determine whether it is a sudden obstacle event or an approaching obstacle event based on the distance between the obstacle and the human-machine interaction device. Specifically, when the distance between the obstacle and the human-machine interaction device is less than or equal to a first distance threshold (e.g., 20 cm), it can be determined to be a sudden obstacle event; when the distance between the obstacle and the human-machine interaction device is greater than the first distance threshold, it can be determined to be an approaching obstacle event.

[0064] Exemplarily, the human-computer interaction device may include a camera, which collects images or videos through the camera, and determines whether there is a face event based on the collected images or videos.

[0065] For example, the human-computer interaction device may select target rectangular areas from left to right and from top to bottom on the image, and use the target rectangular areas as an observation window. Then, the features in the image area corresponding to each observation window are extracted, and it is determined whether the extracted features are features corresponding to a human face. If the extracted features match the features corresponding to a human face, it can be considered that there is a human face in the external environment of the human-computer interaction device, and the human-computer interaction device has detected a face event. The size of the target rectangular area can be determined based on the sizes of multiple faces that are statistically analyzed.

[0066] Exemplarily, when the human-computer interaction device detects a human face, it can be determined whether it is a close-range face event or a long-range face event based on the distance between the human face and the human-computer interaction device.

[0067] For example, when the human-computer interaction device detects a human face, and the distance between the human face and the human-computer interaction device is less than or equal to the second distance threshold, it can be determined that a close-range human face event exists.

[0068] For another example, when the human-computer interaction device detects a human face, and the distance between the human face and the human-computer interaction device is greater than a second distance threshold, it can be determined that a long-distance face event exists.

[0069] Exemplarily, the human-computer interaction device may include a touch sensor, and the human-computer interaction device determines whether a touch event occurs through a signal detected by the touch sensor.

[0070] For example, if the touch sensor is a capacitive sensor, and a capacitance signal change is detected in a certain event, and the capacitance signal is greater than a threshold value 1, then it can be considered that the user has touched the human-computer interaction device, and the human-computer interaction device has detected the touch event. Among them, the threshold value 1 can be determined based on multiple capacitance signals corresponding to multiple touch events.

[0071] Exemplarily, the human-computer interaction device may capture images or videos through a camera, and determine whether there is a gesture event based on the captured images or videos.

[0072] For example, the human-computer interaction device first extracts features from the image, and then matches the features in the image with preset gesture features (which may be stored in the human-computer interaction device). If the features in the image match the preset gesture features, then it can be considered that the user is making a gesture to the human-computer interaction device, and the human-computer interaction device has detected the gesture event.

[0073] Exemplarily, the human-computer interaction apparatus may determine whether there is an application manipulation event based on controls associated with the application.

[0074] For example, when the human-computer interaction device receives an operation instruction from a user to manipulate a control related to an application, the human-computer interaction device detects an application manipulation event.

[0075] Exemplarily, the human-computer interaction device may include a microphone, and the human-computer interaction device may determine whether there is a voice input event according to whether the microphone acquires sound in the external environment.

[0076] For example, when the microphone of the human-computer interaction device acquires the sound in the external environment, the human-computer interaction device detects a voice input event.

[0077] Exemplarily, a plurality of light sensors may be disposed at the bottom of the human-computer interaction device, so that it is possible to determine whether a desktop edge event occurs based on the light intensity collected by each light sensor.

[0078] For example, among the multiple light sensors of the human-computer interaction device, there is a light sensor that collects light intensity less than threshold 3, and there is a light sensor that collects light intensity greater than threshold 4, then it can be considered that the human-computer interaction device is at the edge of the desktop, and the human-computer interaction device has detected a desktop edge event. Among them, threshold 3 can be determined based on the light intensity collected by the light sensor when the human-computer interaction device stands still on the desktop with the bottom parallel to the desktop, and the light intensity collected by the light sensor when the human-computer interaction device walks on the desktop. Threshold 4 can be determined based on the light intensity collected by the light sensor when the human-computer interaction device walks on the desktop.

[0079] Exemplarily, the human-computer interaction device may collect images or videos through a camera, and determine whether there is a human-shaped event based on the collected images or videos.

[0080] For example, the human-computer interaction device first extracts features from the image, and then matches the features in the image with joint features of the human body and trunk features of the human body (which may be stored in the human-computer interaction device). If the features in the image match the preset hand joints and trunk features, then it can be considered that there is a user in the external environment of the human-computer interaction device, and the user is not very close to the human-computer interaction device (no face is detected), and the human-computer interaction device detects the human event. Among them, the joint features of the human body and the trunk features of the human body can be determined based on the joint features of multiple human bodies and the trunk features of the human body.

[0081] Exemplarily, the human-computer interaction device may be provided with a posture sensor, and determine whether there is a picking-up event or a falling-down event based on a signal detected by the posture sensor.

[0082] For example, based on the posture angle information detected by the posture sensor and combined with the external environment information collected by the camera, it can be determined whether the human-computer interaction device is picked up by the user. At this time, the human-computer interaction device detects the picking up event.

[0083] For example, based on the posture angle information detected by the posture sensor and combined with the external environment information collected by the camera, it can be determined whether the human-computer interaction device has fallen to the ground. At this time, the human-computer interaction device has detected a fall event.

[0084] S220: Determine a first processing method for a first event according to a first interaction mode of the human-computer interaction device and a first interaction state in the first interaction mode.

[0085] Optionally, in some embodiments, in order to improve the interaction efficiency between the user and the human-computer interaction device, the interaction mode of the human-computer interaction device may be set to multiple interaction modes.

[0086] Exemplarily, the interaction modes of the human-computer interaction device may include, but are not limited to, standby mode, human shape mode, face mode, application control mode, voice control mode, desktop mode, etc.

[0087] The human-computer interaction device has multiple interaction modes, and the first interaction mode is one of the multiple interaction modes of the human-computer interaction device, and which interaction mode among the multiple interaction modes is specifically determined based on the current external environment of the human-computer interaction device. For example, the human shape mode may be the interaction mode of the human-computer interaction device when it detects the presence of a human shape in its external environment. The face mode may be the interaction mode of the human-computer interaction device when it detects the presence of a close face in its external environment. The application control mode may be the interaction mode of the human-computer interaction device when it detects that an application is being manipulated. The voice control mode may be the interaction mode of the human-computer interaction device when it detects voice. The desktop mode may be the interaction mode of the human-computer interaction device when it detects the presence of a desktop in its external environment. The standby mode may be the default or regular interaction mode of the human-computer interaction device.

[0088] Each interaction mode of the human-computer interaction device includes at least one interaction state, and the interaction state is used to indicate the state of the human-computer interaction device in the process of interacting with the outside world. The first interaction state is the interaction state in the first interaction mode. When there are multiple interaction states in the first interaction mode, which interaction state in the first interaction mode the first interaction state is is determined based on the current external environment of the human-computer interaction device.

[0089] In one example, when the first interaction mode is the humanoid mode, the humanoid mode may include a standby state, a following state, a stroking state, a searching state, a gesture state, one or more hooking states, a picking up state, a falling state, and the like.

[0090] The standby state in the humanoid mode is the default or normal interactive state of the human-machine interaction device in the humanoid mode, and its standby purpose is to attract the user to approach and interact with it. When the human-machine interaction device is in the standby state in the humanoid mode, if an event related to its standby purpose is detected (such as a humanoid moving away event, a humanoid disappearing event, a stroking event, a gesture event, etc.), the human-machine interaction device will switch from the standby state to the corresponding interactive state in the same mode.

[0091] When the human-computer interaction device detects a human figure and the human figure is getting farther and farther away from it, the human-computer interaction device can enter the following state of the human figure mode. In the following state of the human figure mode, the main purpose of the human-computer interaction device is to follow the user, and weak feedback or no feedback will be given to interference events (such as obstacle events).

[0092] When the human-machine interaction device detects the user's stroking action, the human-machine interaction device may be in a stroking state of the human-shaped mode. In the stroking state of the human-shaped mode, the main purpose of the human-machine interaction device is to interact with the user.

[0093] When the human-machine interaction device detects that the human figure disappears, the human-machine interaction device may be in a human-figure mode to find a person. In the human-figure mode to find a person, the human-machine interaction device mainly aims to find a user, and it may preferentially process external human figure events or human face events.

[0094] When the human-machine interaction device detects a specific gesture of the user, the human-machine interaction device may be in a gesture state of the human-shaped mode. In the gesture state of the human-shaped mode, the main purpose of the human-machine interaction device is to recognize the user's interactive gesture and make corresponding feedback.

[0095] When the human-machine interaction device wants to attract the user to interact with it, the human-machine interaction device can be in the attractive state of the human-shaped mode. In the attractive state of the human-shaped mode, the main purpose of the human-machine interaction device is to attract the user to interact with it.

[0096] When the human-machine interaction device detects that it is picked up, the human-machine interaction device can be in the picked up state of the human-shaped mode. In the picked up state of the human-shaped mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and it can give priority to processing the event of its posture returning to normal.

[0097] When the human-machine interaction device detects that the user has fallen, the human-machine interaction device may be in a human-shaped mode of falling down. In the human-shaped mode of falling down, the main purpose of the human-machine interaction device is to restore its posture to normal, and the human-machine interaction device may give priority to processing the event of restoring its posture to normal.

[0098] In another example, when the first interaction mode is the face mode, the face mode may include a standby state, one or more stroking states, a searching state, a gesture state, one or more hooking states, a picking up state, a falling state, etc.

[0099] The standby state in the face mode is the default or normal interaction state of the human-machine interaction device in the face mode, and its standby purpose is to interact with the user at close range. When the human-machine interaction device is in the standby state in the face mode, if an event related to its standby purpose is detected (such as a touch event, a face disappearance event, a gesture event, etc.), the human-machine interaction device will switch from the standby state to the corresponding interaction state in the same mode.

[0100] When the human-machine interaction device detects the user's stroking action, the human-machine interaction device may be in a stroking state of the face mode. In the stroking state of the face mode, the main purpose of the human-machine interaction device is to interact with the user.

[0101] When the human-machine interaction device detects that the face disappears, the human-machine interaction device may be in a human-face mode to find a person. In the human-face mode to find a person, the main purpose of the human-machine interaction device is to find the user, and it may give priority to processing external human face events.

[0102] When the human-machine interaction device detects a specific gesture of the user, the human-machine interaction device may be in a gesture state of the face mode. In the gesture state of the face mode, the main purpose of the human-machine interaction device is to recognize the user's interactive gesture and make corresponding feedback.

[0103] When the human-machine interaction device wants to attract the user to interact with it, the human-machine interaction device can be in the attractive state of the face mode. In the attractive state of the face mode, the main purpose of the human-machine interaction device is to attract the user to interact with it.

[0104] When the human-machine interaction device detects that it is picked up, the human-machine interaction device can be in the picked up state of the face mode. In the picked up state of the face mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and it can give priority to processing the event of its posture returning to normal.

[0105] When the human-machine interaction device detects that the user has fallen, the human-machine interaction device may be in a falling state in a face mode. In the falling state in the face mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and the human-machine interaction device may prioritize processing the event of restoring its posture to normal.

[0106] In another example, when the first interaction mode is the voice control mode, the voice control mode may include a standby state, an incomprehensible state, a specific instruction feedback state, a person-finding state, a picking-up state, a falling state, and the like.

[0107] The standby state in the voice control mode is the default or normal interactive state of the human-machine interaction device in the voice control mode, and its standby purpose is to wait for the user to issue a voice command. When the human-machine interaction device is in the standby state in the voice control mode, it can process external voice input events first.

[0108] When the human-computer interaction device detects the user's voice command, but after semantic analysis of the voice command, no corresponding voice analysis result is obtained, the human-computer interaction device may be in the incomprehensible state of the voice control mode. In the incomprehensible state of the voice control mode, the main purpose of the human-computer interaction device is to feedback to the user that it does not understand the user's voice command, and it may prioritize processing of external voice commands.

[0109] When the human-computer interaction device detects the user's voice command and performs semantic analysis on the voice command to obtain the corresponding voice analysis result, the human-computer interaction device can be in the specific command feedback state of the voice control mode. In the specific command feedback state of the voice control mode, the main purpose of the human-computer interaction device is to execute the action corresponding to the user's voice command, and it can give priority to processing external voice commands.

[0110] When the human-machine interaction device does not receive the user's voice command within the preset time, the human-machine interaction device may be in the search state of the voice control mode. In the search state of the voice control mode, the main purpose of the human-machine interaction device is to find the user, and it may give priority to processing external face events and voice input events.

[0111] When the human-machine interaction device detects that it is picked up, the human-machine interaction device can be in the picked up state of the voice control mode. In the picked up state of the voice control mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and it can give priority to processing the event of its posture returning to normal.

[0112] When the human-machine interaction device detects that the user has fallen, the human-machine interaction device may be in the falling state of the voice control mode. In the falling state of the voice control mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and it may give priority to processing the event of restoring its posture to normal.

[0113] In yet another example, when the first interaction mode is a standby mode, the standby mode may include a standby state, a stroking state, an obstacle state, a picking up state, a falling state, and the like.

[0114] The standby state in the standby mode is the default or normal interactive state of the human-machine interaction device in the standby mode, and the standby purpose is autonomous navigation and / or observation of the external environment. When the human-machine interaction device is in the standby state of the standby mode, it can autonomously navigate and process events in the external environment.

[0115] When the human-machine interaction device detects the user's stroking action, the human-machine interaction device may be in a stroking state of the standby mode. In the stroking state of the standby mode, the main purpose of the human-machine interaction device is to interact with the user.

[0116] When the human-machine interaction device detects that it is picked up, the human-machine interaction device can be in the picked up state of the standby mode. In the picked up state of the standby mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and it can give priority to processing the event of its posture returning to normal.

[0117] When the human-machine interaction device detects that the user has fallen, the human-machine interaction device may be in a falling state in a standby mode. In the falling state in the standby mode, the main purpose of the human-machine interaction device is to restore its posture to normal, and the human-machine interaction device may prioritize processing the event of restoring its posture to normal.

[0118] When the human-machine interaction device detects an obstacle event, the human-machine interaction device may be in an obstacle state of a standby mode. In the obstacle state of the standby mode, the main purpose of the human-machine interaction device is to determine whether to avoid the obstacle or interact with the obstacle according to the type of the obstacle.

[0119] In the following, S220 is described in detail by taking the first event as case 1, case 2 and case 3 as an example.

[0120] Case 1: The first event is an interactive state switching event.

[0121] In case 1, as shown in FIG. 3 , the method 200 further includes S230 , which is executed between S210 and S220 . S230 is described in detail below.

[0122] S230: Switch from the second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event.

[0123] At this time, when the first event is a state switching event, there is no need to switch the current first interaction mode of the human-computer interaction device. It is only necessary to switch the current second interaction state of the human-computer interaction device to the first interaction state, and then execute S230, that is, determine the first processing method for the first event according to the first interaction state and the first interaction mode.

[0124] The first interaction state and the second interaction state are respectively two different interaction states in the first interaction mode.

[0125] Exemplarily, the first event may be an abnormal posture event, such as a pick-up event or a fall event, etc. When the human-computer interaction device detects an abnormal posture event, it may switch from any other interaction state (second interaction state) to an abnormal posture state (first interaction state) to prevent the abnormal posture event from causing harm to the human-computer interaction device itself or the user.

[0126] In one example, when the first event is a pick-up event, the first interaction mode is a standby mode, and the second interaction state is a standby state, the human-computer interaction device may first switch from the standby state (an example of the second interaction state) to the pick-up state (an example of the first interaction state). Then, according to the standby mode and the pick-up state in the standby mode, determining the first processing method of the pick-up event may include: twisting the body slightly to indicate to the user to put oneself down.

[0127] In another example, when the first event is a fall event, the first interaction mode is a standby mode, and the second interaction state is a standby state, the human-computer interaction device may first switch from the standby state (an example of the second interaction state) to the fall state (an example of the first interaction state). Then, according to the standby mode and the fall state in the standby mode, determining the first processing method of the fall event may include: prompting the user to enter the fall state by voice, and further, entering the dormant state after the voice prompt; or standing up again by itself.

[0128] In another example, when the first event is a pick-up event, the first interaction mode is a humanoid mode (or face mode), and the second interaction state is a gesture state, the human-computer interaction device may first switch from the gesture state (an example of the second interaction state) to the pick-up state (an example of the first interaction state). Then, according to the humanoid mode (or face mode) and the pick-up state in the humanoid mode (or face mode), determining the first processing method for the pick-up event may include: twisting the body slightly to signal the user to put oneself down.

[0129] In another example, when the first event is a falling event, the first interaction mode is a humanoid mode (or face mode), and the second interaction state is a gesture state, the human-computer interaction device may first switch from the gesture state (an example of the second interaction state) to the falling state (an example of the first interaction state). Then, according to the humanoid mode (or face mode) and the falling state in the humanoid mode (or face mode), determining the first processing method for the falling event may include: prompting the user to enter the falling state by voice, and further, entering the dormant state after the voice prompt; or standing up again by itself.

[0130] In another example, when the first event is a pick-up event, the first interaction mode is a voice control mode, and the second interaction state is a specific instruction state, the human-computer interaction device may first switch from the specific instruction state (an example of the second interaction state) to the pick-up state (an example of the first interaction state). Then, according to the face mode and the pick-up state in the face mode, determining that the first processing method for the pick-up event may include: twisting the body slightly to signal the user to put oneself down.

[0131] In another example, when the first event is a fall event, the first interaction mode is a voice control mode, and the second interaction state is a specific instruction state, the human-computer interaction device may first switch from the specific instruction state (an example of the second interaction state) to the fall state (an example of the first interaction state). Then, according to the voice control mode and the fall state in the voice control mode, determining the first processing method for the fall event may include: giving a voice prompt to the user to enter the fall state, and further, entering a dormant state after the voice prompt; or standing up again by itself.

[0132] Exemplarily, the first event may also be an event other than abnormal posture. For example, the first event may be an event related to the standby purpose in a specific interaction mode.

[0133] In one example, the first interaction mode is the face mode, and the second interaction state is the standby state. At this time, the purpose of the standby state is to interact with the user at close range, so the events related to the standby purpose may include touch events, gesture events, face disappearance events, etc. For example, the first event is a gesture event, and the human-computer interaction device can switch from the standby state (an example of the second interaction state) to the gesture state (an example of the first interaction state). In the gesture state, the human-computer interaction device will perform corresponding actions according to the user's specific gestures. For example, when the user's fist bump gesture is detected, the human-computer interaction device can perform a fist bump action.

[0134] In another example, the first interaction mode is the standby mode and the second interaction state is the standby state. At this time, the standby purpose is autonomous navigation and / or observation of the external environment, so the events related to the standby purpose may include obstacle events, empty field events, touch events, etc. For example, the first event is an obstacle event, and the human-computer interaction device can decide whether to interact with the obstacle according to the type of obstacle. If the obstacle type meets the interaction condition, the human-computer interaction device can switch from the standby state (an example of the second interaction state) to the obstacle state (an example of the first interaction state). In the obstacle state, the human-computer interaction device can push the obstacle to play.

[0135] In another example, the first interaction mode is the humanoid mode, and the second interaction state is the standby state. At this time, the purpose of the standby state is to attract the user to approach and interact with the user, so the events related to the standby purpose may include humanoid moving away events, humanoid disappearing events, gesture events, etc. For example, if the first event is a humanoid moving away event, the human-computer interaction device may switch from the standby state (an example of the second interaction state) to the following state (an example of the first interaction state). In the following state, the human-computer interaction state will follow the user's actions to attract the user's attention.

[0136] In another example, the first interaction mode is the voice control mode, and the second interaction state is the standby state. In this case, the purpose of the standby state is to wait for receiving the user's voice command, so the events related to the standby purpose may include specific command events, command incomprehensible events, and voice command not received events. For example, the first event is a specific command event, and the human-computer interaction device can be switched from the standby state (an example of the second interaction state) to the specific command state (an example of the first interaction state). In the specific command state, the human-computer interaction device can perform corresponding actions according to the specific content of the voice command issued by the user.

[0137] Case 2: The first event is an interactive mode switching event.

[0138] In case 2, as shown in FIG. 4 , the method 200 further includes S240 , which is executed between S210 and S220 . S240 is described in detail below.

[0139] S240: Switch from the third interaction state in the second interaction mode to the first interaction state in the first interaction mode according to the first event, wherein the second interaction mode is one of the plurality of interaction modes.

[0140] At this time, it can be considered that when the first event is an interaction mode switching event, it is necessary not only to switch the current second interaction mode of the human-computer interaction device to the first interaction mode, but also to switch the current third interaction state of the human-computer interaction device to the first interaction state, and then execute S230, that is, determine the first processing method for the first event according to the first interaction state and the first interaction mode.

[0141] Exemplarily, the first event may be, but is not limited to, a close-up face event, a long-distance face event, a human shape event, a voice input event, or an application program manipulation event.

[0142] In one example, when the first event is a close-range face event, the second interaction mode is a standby mode, and the third interaction state is a stroking state or an obstacle state, the human-computer interaction device may first switch from the stroking state of the standby mode (an example of the second interaction mode) or the obstacle state (an example of the third interaction state) to the standby state (an example of the first interaction state) of the face mode (an example of the first interaction mode). Then, according to the face mode and the standby state in the face mode, the processing method of the close-range face event is determined to include: comparing the detected face information with the recorded face information to confirm whether the face is recognized. If it is recognized face information, the human-computer interaction device can perform feedback to express happiness. If it is unknown face information, the human-computer interaction device can perform feedback to express doubt.

[0143] In another example, when the first event is a close-up face event, the second interaction mode is a humanoid mode, and the third interaction state is a stroking state, the human-computer interaction device may first switch from the stroking state (an example of the third interaction state) in the humanoid mode (an example of the second interaction mode) to the first-time face-seen state (an example of the first interaction state) in the face mode (an example of the first interaction mode). Then, based on the face mode and the first-time face-seen state in the face mode, the method for handling the close-up face event is determined to include: comparing the detected face information with the recorded face information to confirm whether the face is recognized. If it is recognized face information, the human-computer interaction device may perform feedback expressing happiness, and if it is unknown face information, the human-computer interaction device may perform feedback expressing doubt.

[0144] In another example, when the first event is a long-distance face event, the second interaction mode is a face mode, and the third interaction state is a search state, the human-computer interaction device may first switch from the search state (an example of the third interaction state) of the face mode (an example of the second interaction mode) to the standby state (an example of the first interaction state) of the human-shaped mode (an example of the first interaction mode). Then, according to the human-shaped mode and the standby state in the human-shaped mode, determining the processing method of the long-distance face event may include: attracting the user to interact with the human-computer interaction device. For example, the human-computer interaction device may perform larger or more obvious actions, such as singing, dancing, turning in circles, raising its legs to say hello, etc., so as to more easily attract the attention of distant users and attract users to get closer. Thereby, the bionic effect of the human-computer interaction device is improved, which helps to improve the user experience.

[0145] In another example, when the first event is a humanoid event, the second interaction mode is a face mode, and the third interaction state is a standby state, the human-computer interaction device may first switch from the standby state (an example of the third interaction state) of the face mode (an example of the second interaction mode) to the standby state (an example of the first interaction state) of the humanoid mode (an example of the first interaction mode). Then, according to the humanoid mode and the standby state in the humanoid mode, determining the processing method of the humanoid event may include: attracting the user to interact with the human-computer interaction device. For example, the human-computer interaction device may perform larger or more obvious actions, such as singing, dancing, turning in circles, raising its legs to say hello, etc., so as to more easily attract the attention of distant users and attract users to get closer. Thereby, the bionic effect of the human-computer interaction device is improved, which helps to improve the user experience.

[0146] In another example, when the first event is a voice input event, the second interaction mode is a face mode, and the third interaction state is a search state, the human-computer interaction device may first switch from the search state (an example of the third interaction state) of the face mode (an example of the second interaction mode) to the standby state (an example of the first interaction state) of the voice control mode (an example of the first interaction mode). Then, according to the voice control mode and the standby state in the voice control mode, determining the processing method of the voice input event may include: executing an action corresponding to the voice input event. For example, if the voice input event is "hello, loona", the action corresponding to the voice input event may include: tilting the head and tilting the ears to make a listening action. Thereby improving the bionic effect of the human-computer interaction device and helping to improve the user experience.

[0147] In another example, when the first event is an application manipulation event, the second interaction mode is a standby mode, and the third interaction state is a standby state, the human-computer interaction device may first switch from the standby state (an example of the third interaction state) of the standby mode (an example of the second interaction mode) to the standby state (an example of the first interaction state) of the application control mode (an example of the first interaction mode). Then, according to the application control mode and the standby state in the application control mode, determining the processing method of the application manipulation event may include: waiting with ears pricked up, or spinning in circles excitedly.

[0148] Case 3, the first event is other event.

[0149] In case 3, the method 200 does not need to perform any steps between S210 and S220. At this time, the first interaction mode is the current interaction mode of the human-machine interaction device, and the first interaction state is the current interaction state of the human-machine interaction device.

[0150] Among them, other events may include events other than the first event described in Case 1 and Case 2, that is, other events include events other than the interactive state switching event and the interactive mode switching event.

[0151] In one example, when the first interaction mode is the standby mode and the first interaction state is the picking up state, then when the human-computer interaction device detects a touch event (an example of a first event), a first processing method for the touch event may include: in the picking up state, the indicator light on the ear flashes, or the touch event is ignored and no response is given.

[0152] In another example, when the first interaction mode is the humanoid mode and the first interaction state is the following state, then when the human-computer interaction device detects an obstacle event (an example of the first event), a first processing method for the obstacle event may include: in the following state, responding weakly or not responding to the obstacle event, bypassing the obstacle and continuing to follow the user.

[0153] Some examples in the above method 200, such as examples of events, examples of interaction modes, and examples of interaction states, are merely examples provided to facilitate understanding of the solution and should not constitute limitations to the present application.

[0154] According to the above description of method 200, when the first event is a state switching event, the human-computer interaction device does not need to switch the current first interaction mode of the human-computer interaction device, but only needs to switch the current second interaction state of the human-computer interaction device to the first interaction state, and then determine the first processing method of the first event according to the first interaction state and the first interaction mode. When the first event is an interaction mode switching event, it is not only necessary to switch the current second interaction mode of the human-computer interaction device to the first interaction mode, but also to switch the current third interaction state of the human-computer interaction device to the first interaction state, and then determine the first processing method of the first event according to the first interaction state and the first interaction mode. When the first event is other events (non-state switching events or non-interaction mode switching events), the human-computer interaction device does not need to switch the current first interaction mode of the human-computer interaction device, nor does it need to switch the current first interaction state, and directly determines the first processing method of the first event according to the first interaction state and the first interaction mode. In this way, compared with the existing solution that uses the same feedback for the same event, in the above method 200, the human-computer interaction device can flexibly process the event based on the interaction mode and the interaction state under the interaction mode, thereby improving the accuracy of the human-computer interaction device's analysis of the user's behavioral intention or external environment, improving the interaction effect between the user and the human-computer interaction device, and helping to improve the user experience.

[0155] 5 and 6 , the device provided in the embodiment of the present application is described in detail.

[0156] FIG. 5 is a schematic structural diagram of an example of a human-computer interaction device 300 provided in an embodiment of the present application.

[0157] For example, as shown in FIG5 , the human-computer interaction device 300 has multiple interaction modes, each of which includes at least one interaction state, and the interaction state is used to indicate the state of the human-computer interaction device 300 in the process of interacting with the outside world. The human-computer interaction device 300 includes a detection unit 310 and a processing unit 320. The detection unit 310 is used to detect a first event; the processing unit 320 is used to determine a first processing method for the first event according to the first interaction mode of the human-computer interaction device and the first interaction state in the first interaction mode, wherein the first interaction mode is one of the multiple interaction modes.

[0158] Optionally, in one example, the human-computer interaction device 300 further includes a first switching unit, configured to switch from the second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event.

[0159] In this example, the first event may be a pick-up event or a fall-down event.

[0160] Optionally, in another example, the human-computer interaction device 300 further includes a second switching unit for switching from a third interaction state in the second interaction mode to a first interaction state in the first interaction mode according to a first event, and the second interaction mode is one of multiple interaction modes.

[0161] In this example, the first event may be a close-up face event, a long-distance face event, a human shape event, a voice input event, or a manipulation application event.

[0162] For other parts not described in FIG. 5 , please refer to the relevant description in method 200 , which will not be repeated here.

[0163] FIG. 6 shows a schematic structural diagram of a human-computer interaction device 400 provided in an embodiment of the present application.

[0164] For example, as shown in FIG6 , the human-computer interaction device 400 includes: one or more processors 410, one or more memories 420, and the one or more memories 420 store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors 410, the human-computer interaction device 400 executes the above method 200.

[0165] The embodiment of the present application provides a computer program product, which, when executed in a human-computer interaction device, enables the human-computer interaction device to execute the above method 200. Its implementation principle and technical effect are similar to those of the above method 200, and will not be described in detail here.

[0166] The embodiment of the present application provides a computer-readable storage medium, which contains instructions. When the instructions are executed on a device, the device executes the above method 200. The implementation principle and technical effect are similar and will not be described here.

[0167] The embodiment of the present application provides a chip, the chip is used to execute instructions, and when the chip is running, the above method 200 is executed. The implementation principle and technical effect thereof are similar, and will not be described in detail here.

[0168] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0169] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0170] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0171] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0172] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0173] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0174] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

A human-computer interaction device, characterized in that: The human-computer interaction device has multiple interaction modes, each of which includes at least one interaction state, and the interaction state is used to indicate the state of the human-computer interaction device in the process of interacting with the outside world. The human-computer interaction device includes: a detection unit, used to detect a first event; a processing unit, used to determine a first processing method for the first event based on the first interaction mode of the human-computer interaction device and the first interaction state under the first interaction mode, wherein the first interaction mode is one of the multiple interaction modes. The human-computer interaction device according to claim 1, characterized in that: The human-computer interaction device further includes: a first switching unit, configured to switch from the second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event. The human-computer interaction device according to claim 2, characterized in that: The first event is a picking up event or a falling down event. The human-computer interaction device according to claim 1, characterized in that: The human-computer interaction device further includes: a second switching unit, configured to switch from a third interaction state in a second interaction mode to the first interaction state in the first interaction mode according to the first event, wherein the second interaction mode is one of the plurality of interaction modes. The human-computer interaction device according to claim 4, characterized in that: The first event is a close-range human face event, a long-range human face event, a human shape event, a voice input event, or an application program control event. A human-computer interaction method, characterized in that: The human-computer interaction method is applied to a human-computer interaction device, the human-computer interaction device has multiple interaction modes, each of the interaction modes includes at least one interaction state, the interaction state is used to indicate the state of the human-computer interaction device in the process of interacting with the outside world, the human-computer interaction method includes: detecting a first event; determining a first processing method for the first event according to the first interaction mode of the human-computer interaction device and the first interaction state under the first interaction mode, wherein the first interaction mode is one of the multiple interaction modes. The human-computer interaction method according to claim 6, characterized in that: The method further includes: switching from a second interaction state in the first interaction mode to the first interaction state in the first interaction mode according to the first event. The human-computer interaction method according to claim 7, characterized in that: The first event is a picking up event or a falling down event. The human-computer interaction method according to claim 6, characterized in that: The method further includes: switching from a third interaction state in a second interaction mode to the first interaction state in the first interaction mode according to the first event, the second interaction mode being one of the plurality of interaction modes. The human-computer interaction method according to claim 9, characterized in that: The first event is a close-range human face event, a long-range human face event, a human shape event, a voice input event, or an application program control event. A human-computer interaction device, characterized in that: include: one or more processors; one or more memories; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the human-computer interaction device to perform the human-computer interaction method as described in any one of claims 6 to 10. A computer-readable storage medium, characterized in that The method comprises computer instructions, and when the computer instructions are executed on a human-computer interaction device, the human-computer interaction device executes the human-computer interaction method according to any one of claims 6 to 10. A chip, characterized in that: It comprises at least one processor and an interface circuit, wherein the interface circuit is used to provide program instructions or data to the at least one processor, and the at least one processor is used to execute the program instructions to implement the human-computer interaction method as described in any one of claims 6 to 10. A computer program product, characterized in that The computer program product includes computer instructions; when part or all of the computer instructions are run on a computer, the human-computer interaction method according to any one of claims 6 to 10 is executed.

Images