Human-computer interaction method and device, storage medium and terminal

Abstract

A human-computer interaction method, device, storage medium and human-computer interaction terminal, the human-computer interaction method comprising: acquiring a voice control instruction issued by a user; in the case where the voice control instruction is a position-related instruction, acquiring position information of the user relative to the human-computer interaction terminal; and applying an execution result of the voice control instruction to a position or region determined according to the position information.

Description

Technical Field

[0001] This article relates to the field of human-computer interaction technology, and in particular to a human-computer interaction method, device, storage medium and terminal. Background Technology

[0002] Voice assistants have become an indispensable part of smart homes, mobile devices, and personal assistants, and are widely used in daily life and work. Through speech recognition and natural language processing technologies, voice assistants can recognize and respond to users' voice commands, greatly improving the convenience of user interaction with devices. Summary of the Invention

[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.

[0004] This application provides a human-computer interaction method, applied to a human-computer interaction terminal, including:

[0005] Obtain voice control commands issued by the user;

[0006] Obtain the user's position information relative to the human-computer interaction terminal;

[0007] The execution result of the voice control command is applied to the location or area determined based on the orientation information.

[0008] In one exemplary embodiment, after obtaining the voice control command issued by the user, it is determined that the voice control command is a location-related command;

[0009] The location-related instructions include those whose execution results are related to the location.

[0010] In one exemplary embodiment, the location determined based on the orientation information includes:

[0011] The user's mapped position on the human-computer interaction terminal;

[0012] Applying the execution result of the voice control command to the location determined based on the orientation information includes:

[0013] The execution result of the voice control command is applied to the mapped position.

[0014] In one exemplary embodiment, the human-computer interaction terminal includes a screen;

[0015] The voice control commands include split-screen display commands;

[0016] The method further includes dividing the screen into at least two regions in response to the split-screen display instruction;

[0017] Applying the execution result of the voice control command to the area determined based on the location information includes:

[0018] Determine the area corresponding to the location information;

[0019] When the split-screen display command is received, the content currently displayed on the screen will be displayed in the area corresponding to the location information.

[0020] In one exemplary embodiment, dividing the screen into at least two regions includes: dividing the screen into two regions: a left region and a right region, based on the center line of the screen; the left region is located to the left of the center line, and the right region is located to the right of the center line;

[0021] The step of displaying the content currently displayed on the screen when the split-screen display instruction is received in the area corresponding to the location information includes:

[0022] If the area corresponding to the location information is located in the left area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the left area;

[0023] If the area corresponding to the location information is located in the right area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the right area.

[0024] In one exemplary embodiment, the human-computer interaction terminal includes a screen;

[0025] The user's mapped position on the human-computer interaction terminal includes:

[0026] Determine the first coordinates on the screen based on the orientation information;

[0027] The mapped position includes the first coordinates;

[0028] Applying the execution result of the voice control command to the mapped position includes:

[0029] The execution result of the voice control command is displayed at the first coordinate on the screen.

[0030] In one exemplary embodiment, the voice control command includes an insertion operation;

[0031] Displaying the execution result of the voice control command at the first coordinate on the screen includes: displaying the insertion object of the insertion operation at the first coordinate.

[0032] In one exemplary embodiment, the voice control command includes a screen projection operation;

[0033] Displaying the execution result of the voice control command at the first coordinate on the screen includes: determining the display position of the identifier of the device to be projected on the projection connection interface based on the first coordinate.

[0034] In one exemplary embodiment, displaying the execution result of the voice control command at the first coordinate on the screen further includes:

[0035] When the animation of connecting the human-computer interaction terminal and the device to be projected is executed on the screen projection connection interface, the animation is displayed starting from the display position.

[0036] This application provides a human-computer interaction method, applied to a human-computer interaction terminal, including:

[0037] The system acquires voice control commands issued by the user; if the voice control command is a location-related command, the system acquires the user's orientation information relative to the human-computer interaction terminal; wherein, the location-related command includes commands whose execution object is location-related.

[0038] The location-related execution object is determined based on the orientation information and the voice control command;

[0039] According to the voice control command, a control signal is sent to the execution object so that the execution object performs the operation of the voice control command.

[0040] This application also provides a human-computer interaction device, including a memory and a processor.

[0041] The memory is used to store programs for human-computer interaction;

[0042] The processor is configured to read the program that executes the human-computer interaction and execute the method described in any of the above embodiments.

[0043] This application provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are used to cause the computer to perform the methods described in any of the above embodiments.

[0044] This application also provides a human-computer interaction terminal, including a screen and the aforementioned human-computer interaction device.

[0045] After reading and understanding the accompanying diagrams and detailed descriptions, the other aspects can be understood.

[0046] Other features and advantages of this application will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the application. Other advantages of this application can be realized and obtained by means of the solutions described in the description and the accompanying drawings. Attached Figure Description

[0047] The accompanying drawings are used to provide an understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.

[0048] Figure 1 This is a schematic diagram of a human-computer interaction method according to an embodiment of this application;

[0049] Figure 2 for Figure 1 A schematic diagram illustrating one implementation of step 11;

[0050] Figure 3 This is a schematic diagram of the inserted graphics according to an embodiment of this application;

[0051] Figure 4 This is a schematic diagram of the inserted image in an embodiment of this application;

[0052] Figure 5 This is a schematic diagram of inserting a Maslow's hierarchy of needs according to an embodiment of this application;

[0053] Figure 6 This is a schematic diagram of the screen mirroring connection interface according to an embodiment of this application;

[0054] Figure 7 This is a schematic diagram of another human-computer interaction method according to an embodiment of this application;

[0055] Figure 8 This is a schematic diagram of a human-computer interaction device according to an embodiment of this application. Detailed Implementation

[0056] To make the objectives, technical solutions, and advantages of this disclosure clearer, the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. Note that the implementation methods can be carried out in many different forms. Those skilled in the art will readily understand that the methods and content can be transformed into various forms without departing from the spirit and scope of this disclosure. Therefore, this disclosure should not be construed as limited to the content described in the following embodiments. Without conflict, the embodiments and features in the embodiments of this disclosure can be arbitrarily combined with each other. To keep the following description of the embodiments of this disclosure clear and concise, detailed descriptions of some known functions and components have been omitted. The accompanying drawings of the embodiments of this disclosure only relate to the structures involved in the embodiments of this disclosure; other structures can be referred to in general design.

[0057] The ordinal numbers “first,” “second,” and “third” used in this specification are used to avoid confusion among the constituent elements, not to limit their quantity.

[0058] In this specification, for convenience, terms such as "middle," "upper," "lower," "front," "rear," "vertical," "horizontal," "top," "bottom," "inner," and "outer" are used to indicate orientation or positional relationships in conjunction with the accompanying drawings. This is solely for the purpose of facilitating the description and simplification, and does not imply that the device or component referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of this disclosure. The positional relationships of the constituent elements may be appropriately varied depending on the orientation of each constituent element being described. Therefore, the use of terms not limited to those described in the specification may be appropriately replaced as needed.

[0059] Traditional voice assistants have some limitations. For example, they are often rather rigid in executing commands, lacking a deep understanding of the user's operating environment and intentions. Furthermore, when executing location-sensitive commands, voice assistants often fail to accurately identify the user's intent and the direction of their operation, resulting in inaccurate command execution and negatively impacting the user experience.

[0060] To address the accuracy issue of voice assistants when executing location-sensitive commands, this application proposes a human-computer interaction method.

[0061] Figure 1 This is a schematic diagram of a human-computer interaction method according to an embodiment of this application. Figure 1 As shown, the human-computer interaction method includes the following steps 11 to 13:

[0062] Step 11: Obtain the voice control commands issued by the user;

[0063] Step 12: Obtain the user's orientation information relative to the human-computer interaction terminal;

[0064] Step 13: Apply the execution result of the voice control command to the location or area determined based on the orientation information.

[0065] This application embodiment obtains the voice control command issued by the user and the user's location information relative to the human-computer interaction terminal, and applies the execution result of the voice control command to the location or area determined according to the location information, so that the voice control command can be executed according to the user's location. Therefore, it can more accurately understand the user's intention and improve the practicality and user experience of the voice assistant.

[0066] In one exemplary embodiment, the method further includes step 14. Step 14 includes: after obtaining a voice control command issued by the user, determining that the voice control command is a location-related command;

[0067] The location-related instructions include those whose execution results are related to the location.

[0068] When steps 14 and 12 are combined, the specific steps may include steps 111 to 115 (e.g.) Figure 2 As shown):

[0069] Step 111: Receive voice control commands from the user;

[0070] Step 112: Determine whether the voice control command is a location-related command; if it is a location-related command, proceed to step 113; if it is not a location-related command, proceed to step 115.

[0071] Step 113: Determine whether the user's position relative to the human-computer interaction terminal can be obtained through sound source localization; if the user's position relative to the human-computer interaction terminal can be obtained through sound source localization, then step 12 ends; if the user's position relative to the human-computer interaction terminal cannot be obtained through sound source localization, then proceed to step 114.

[0072] Step 114: Determine whether the user's position information relative to the human-computer interaction terminal can be obtained through visual positioning; if the user's position information relative to the human-computer interaction terminal can be obtained through visual positioning, then the user's position information relative to the human-computer interaction terminal is obtained through visual positioning, and step 12 ends; if the user's position information relative to the human-computer interaction terminal cannot be obtained through visual positioning, then proceed to step 115.

[0073] Step 115: Display the execution result of the voice control command in the default position.

[0074] For example, a location-related instruction could be an "insert image" instruction, which specifies where on the screen to insert the image.

[0075] For step 12, in an exemplary embodiment, obtaining the user's orientation information relative to the human-computer interaction terminal may include:

[0076] The user's location information is obtained through sound source localization and / or visual localization.

[0077] For example, obtaining the user's location information through sound source localization may include: based on the characteristic that there is a time difference between the arrival of the voice control command issued by the same user at two microphones, the human-computer interaction terminal uses a sound source localization algorithm based on TDOA (Time Difference of Arrival) to determine the user's location information according to the time difference.

[0078] In other embodiments, the user's location can also be determined based on sound source localization algorithms such as controlled beamforming or high-resolution spectrum estimation.

[0079] For example, the user's location information may include the distance and angle (azimuth) of the user relative to the human-computer interaction terminal.

[0080] For example, the user's location can be obtained through visual positioning by using a camera installed on the human-computer interaction terminal to acquire images or video streams of the environment around the human-computer interaction terminal, and the distance between the face of the user closest to the human-computer interaction terminal in the image and the human-computer interaction terminal, as well as the azimuth angle between them, can be used as the user's location information.

[0081] In some embodiments, computer vision algorithms (such as SIFT, SURF, ORB, etc.) are used to detect feature points in an image. By matching the feature points with pre-stored reference points, the position and orientation relative to the human-computer interaction terminal are determined.

[0082] In other embodiments, a single-view image can be captured using a camera, and depth information can be inferred from clues in the image (such as perspective, shadows, etc.). Deep learning models (such as monocular depth estimation networks) can be used to improve accuracy. Alternatively, two cameras can be used to capture images of the same scene from different perspectives, and depth information can be calculated through triangulation. Binocular vision algorithms (such as stereo matching) can be used to calculate the user's orientation and distance relative to the cameras.

[0083] In step 13, the location determined based on the orientation information includes:

[0084] The user's mapped position on the human-computer interaction terminal;

[0085] Applying the execution result of the voice control command to the location determined based on the orientation information includes:

[0086] The execution result of the voice control command is applied to the mapped position.

[0087] In one exemplary embodiment, the human-computer interaction terminal includes a screen;

[0088] In one exemplary embodiment, the user's mapped position on the human-computer interaction terminal may include:

[0089] The first coordinates on the screen are determined based on the orientation information, and the mapped position includes the first coordinates.

[0090] In one exemplary embodiment, applying the execution result of the voice control command to the mapped location may include:

[0091] The execution result of the voice control command is displayed at the first coordinate on the screen.

[0092] In one exemplary embodiment, determining the first coordinates on the screen based on the orientation information may include:

[0093] Using a preset position on the screen as the origin, the distance and angle of the user relative to the human-computer interaction terminal are converted into coordinates relative to the origin.

[0094] The coordinates relative to the origin are the first coordinates.

[0095] For example, the preset position can be the center of the screen.

[0096] For example, the distance and angle of the user relative to the human-computer interaction terminal can be converted into coordinates relative to the origin using the following method.

[0097] First, convert the angles in the azimuth information to radians.

[0098] Assuming that the human-computer interaction terminal and the user are first projected onto the plane where the user is standing, and a first planar rectangular coordinate system is established with the human-computer interaction terminal at the origin, then the user's position is (x1, y1).

[0099] Then x1 is equal to the cosine of the distance in radians multiplied by the azimuth information; y1 is equal to the sine of the distance in radians multiplied by the azimuth information.

[0100] The human-computer interaction terminal is mapped to the center of the screen, and a second planar rectangular coordinate system is established with the center of the screen as the origin. Then the coordinates of the user's position on the screen are (x2, y2).

[0101] x2=width / 2+(x1*width / (2*distance));

[0102] y2=height / 2-(y1*height / (2*distance));

[0103] Here, width represents the screen width (in pixels), height represents the screen height (in pixels), and distance represents the user distance.

[0104] In some other embodiments, the distance and angle of the user relative to the human-computer interaction terminal can be converted into coordinates relative to the origin using the following method.

[0105] First, we need to define a coordinate system.

[0106] Screen coordinate system: The origin can be the bottom left corner of the screen, with the X-axis pointing to the right and the Y-axis pointing upwards.

[0107] User coordinate system: The user's position can be represented by their distance from the screen and their azimuth angle.

[0108] Secondly, calculate the user's location.

[0109] Given the known distance D (the straight-line distance between the user and the screen) and the azimuth angle θ (the orientation angle of the user relative to the screen), trigonometric functions can be used to calculate the user's position in the screen coordinate system.

[0110] Assuming the azimuth angle θ is measured counterclockwise from the positive X-axis, the user's coordinates (x, y) in the screen coordinate system can be calculated using the following formula:

[0111] x = D·cos(θ);

[0112] y = D·sin(θ);

[0113] Where D is the straight-line distance between the user and the screen; θ is the orientation angle of the user relative to the screen (in radians).

[0114] Finally, the user's coordinates in the screen coordinate system are mapped to the screen.

[0115] Based on the screen's resolution and aspect ratio, the calculated (x, y) coordinates are converted into actual pixel values. For example, if the screen width is W pixels and the height is H pixels, the conversion can be performed as follows:

[0116] If the range of x and y is from 0 to 1 (normalized), then:

[0117] pixelX = x·W;

[0118] pixelY = y·H;

[0119] This allows the user's mapped points or related information to be displayed on the graphical interface based on the calculated pixel positions.

[0120] In one exemplary embodiment, the human-computer interaction terminal includes a screen;

[0121] The voice control commands include split-screen display commands;

[0122] The method further includes dividing the screen into at least two regions in response to the split-screen display instruction;

[0123] Applying the execution result of the voice control command to the area determined based on the location information includes:

[0124] Determine the area corresponding to the location information;

[0125] When the split-screen display command is received, the content currently displayed on the screen will be displayed in the area corresponding to the location information.

[0126] For example, dividing the screen into two areas, or three areas, etc.

[0127] In one exemplary embodiment, dividing the screen into at least two regions includes: dividing the screen into two regions: a left region and a right region, based on the center line of the screen; the left region is located to the left of the center line, and the right region is located to the right of the center line;

[0128] The step of displaying the content currently displayed on the screen when the split-screen display instruction is received in the area corresponding to the location information includes:

[0129] If the area corresponding to the location information is located in the left area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the left area;

[0130] If the area corresponding to the location information is located in the right area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the right area.

[0131] In one exemplary embodiment, the content currently displayed on the screen when the split-screen display instruction is received can also be displayed at a position corresponding to the orientation information.

[0132] For example, the user's first coordinates on the screen before the division can be determined based on the orientation information; the area where the first coordinates are located on the screen after the division can be determined.

[0133] When the split-screen display command is received, the content currently displayed on the screen will be displayed in the area corresponding to the first coordinate.

[0134] For example, if the first coordinate is located in the left area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the left area;

[0135] When the first coordinate is located in the right area, the content that the screen is displaying when the split-screen display instruction is received is displayed in the right area.

[0136] For example, determine whether the first coordinate is located to the left of the screen center line. If the first coordinate is located to the left of the screen center line, display the current screen application on the left side of the screen. If the first coordinate is located to the right of the screen center line, display the current screen application on the right side of the screen.

[0137] For example, the center line of the screen can be a straight line extending from the center of the screen in the height direction.

[0138] By displaying the current screen application on the side closer to the user, making it easier for the user to see, the user experience can be improved.

[0139] In one exemplary embodiment, the human-computer interaction terminal includes a screen;

[0140] Determining the user's mapped position on the human-computer interaction terminal based on the orientation information includes:

[0141] Determine the first coordinates on the screen based on the orientation information;

[0142] The mapped position includes the first coordinates;

[0143] Applying the execution result of the voice control command to the mapped position includes:

[0144] The execution result of the voice control command is displayed at the first coordinate on the screen.

[0145] In one exemplary embodiment, the voice control command may include an insertion operation;

[0146] Displaying the execution result of the target control command at the first coordinate on the screen includes: displaying the insertion object of the insertion operation at the first coordinate.

[0147] For example, the inserted object may include floating or draggable elements such as graphics, images, tables, videos, and pop-ups.

[0148] For example, to insert a graphic, you can insert the graphic at the canvas position at the first coordinate on the screen (e.g., ...). Figures 3 to 5 (As shown).

[0149] In one exemplary embodiment, the voice control command includes a screen projection operation;

[0150] Displaying the execution result of the target control command at the first coordinate on the screen includes: determining the display position of the identifier of the device to be projected on the projection connection interface based on the first coordinate.

[0151] In some other embodiments, the step of outputting the execution result of the voice control command at the first coordinate on the screen further includes: when the animation of the human-computer interaction terminal connecting with the device to be projected is executed on the projection connection interface, the animation is displayed starting from the display position.

[0152] For example Figure 6 As shown, a screen mirroring interface is displayed on the screen of the human-computer interaction terminal. The interface displays the human-computer interaction terminal as a large sphere element, and the device to be mirrored (which can be a user-held mobile terminal, such as a mobile phone) as a small sphere element at a predetermined position on a large circular track centered on the large sphere (i.e., the aforementioned display position). This predetermined position is determined based on the user's orientation mapped onto the screen, i.e., the aforementioned first coordinates. The predetermined position can be the intersection of the line connecting the first coordinates and the large sphere element with the aforementioned large circular track. In this case, the human-computer interaction terminal can be a television, computer, etc.

[0153] For example, when the connection animation is executed on the screen projection connection interface, the device to be projected flies from the predetermined position to the center of the large sphere, indicating that the device to be projected has established a connection with the human-computer interaction device.

[0154] By displaying the user's location on the screen mirroring connection interface, the sluggish command execution of the voice assistant can be improved, thus enhancing the user experience.

[0155] Figure 7 This is a schematic diagram of another human-computer interaction method according to an embodiment of this application, as shown below. Figure 7 As shown, the human-computer interaction method includes the following steps 71 to 73:

[0156] Step 71: Obtain the voice control command issued by the user; if the voice control command is a location-related command, obtain the user's orientation information relative to the human-computer interaction terminal.

[0157] Step 72: Determine the execution object related to the location based on the orientation information and the voice control command;

[0158] Step 73: Send a control signal to the execution object according to the voice control command, so that the execution object performs the operation of the voice control command.

[0159] The location-related instructions include instructions related to the location of the execution object;

[0160] This application embodiment obtains the user's location information relative to the human-computer interaction terminal when the user's voice control command is a location-related command; determines the location-related execution object based on the location information and the voice control command; and sends a control signal to the execution object according to the voice control command, so that the execution object performs the operation of the voice control command. This allows the execution object of the voice control command to be determined based on the user's location, thereby enabling a more accurate understanding of the user's intent and improving the practicality and user experience of the voice assistant.

[0161] For example, if a user issues a voice control command to "open the window" inside the car, the voice assistant of the human-computer interaction terminal can select the window closest to the user as the target of the command based on the user's location information, thus opening only the window closest to the user.

[0162] This application also provides a human-computer interaction device, such as... Figure 8 As shown, it includes a memory 100 and a processor 200.

[0163] The memory 100 is used to store programs for human-computer interaction;

[0164] The processor 200 is used to read and execute the program for the human-computer interaction and execute the method described in any of the above embodiments.

[0165] This application provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are used to cause the computer to perform the methods described in any of the above embodiments.

[0166] This application also provides a human-computer interaction terminal, including a screen and the aforementioned human-computer interaction device.

[0167] This application describes several embodiments, but these descriptions are exemplary and not restrictive, and it will be apparent to those skilled in the art that many more embodiments and implementations are possible within the scope of the embodiments described herein. Although many possible combinations of features are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are also possible. Unless specifically limited, any feature or element of any embodiment may be used in combination with, or may replace, any feature or element of any other embodiment.

[0168] This application includes and contemplates combinations of features and elements known to those skilled in the art. The embodiments, features, and elements disclosed in this application may also be combined with any conventional features or elements to form a unique inventive scheme as defined by the claims. Any feature or element of any embodiment may also be combined with features or elements from other inventive schemes to form another unique inventive scheme as defined by the claims. Therefore, it should be understood that any feature shown and / or discussed in this application may be implemented individually or in any suitable combination. Therefore, the embodiments are not limited except by the limitations imposed by the appended claims and their equivalents. Furthermore, various modifications and changes may be made within the scope of the appended claims.

[0169] Furthermore, in describing representative embodiments, the specification may have presented methods and / or processes as a specific sequence of steps. However, the method or process should not be limited to the specific order of steps described herein, to the extent that it does not depend on such a specific order. As will be understood by those skilled in the art, other sequences of steps are also possible. Therefore, the specific order of steps set forth in the specification should not be construed as a limitation of the claims. Moreover, the claims concerning the method and / or process should not be limited to the steps performed in the written order, and those skilled in the art will readily understand that these orders can be varied and still remain within the spirit and scope of the embodiments of this application.

Claims

1. A human-computer interaction method applied to a human-computer interaction terminal, characterized in that, include: Obtain voice control commands issued by the user; Obtain the user's position information relative to the human-computer interaction terminal; The execution result of the voice control command is applied to the location or area determined based on the orientation information.

2. The human-computer interaction method as described in claim 1, characterized in that: After obtaining the voice control command issued by the user, it is determined that the voice control command is a location-related command; The location-related instructions include those whose execution results are related to the location.

3. The human-computer interaction method as described in claim 1 or 2, characterized in that: The location determined based on the orientation information includes: The user's mapped position on the human-computer interaction terminal; Applying the execution result of the voice control command to the location determined based on the orientation information includes: The execution result of the voice control command is applied to the mapped position.

4. The human-computer interaction method as described in claim 1 or 2, characterized in that: The human-computer interaction terminal includes a screen; The voice control commands include split-screen display commands; The method further includes dividing the screen into at least two regions in response to the split-screen display instruction; Applying the execution result of the voice control command to the area determined based on the location information includes: Determine the area corresponding to the location information; When the split-screen display command is received, the content currently displayed on the screen will be displayed in the area corresponding to the location information.

5. The human-computer interaction method as described in claim 4, characterized in that: The step of dividing the screen into at least two regions includes: dividing the screen into two regions according to the center line of the screen: a left region and a right region; the left region is located to the left of the center line, and the right region is located to the right of the center line; The step of displaying the content currently displayed on the screen when the split-screen display instruction is received in the area corresponding to the location information includes: If the area corresponding to the location information is located in the left area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the left area; If the area corresponding to the location information is located in the right area, the content that the screen is displaying when the split-screen display instruction is received will be displayed in the right area.

6. The human-computer interaction method as described in claim 3, characterized in that: The human-computer interaction terminal includes a screen; The user's mapped position on the human-computer interaction terminal includes: Determine the first coordinates on the screen based on the orientation information; The mapped position includes the first coordinates; Applying the execution result of the voice control command to the mapped position includes: The execution result of the voice control command is displayed at the first coordinate on the screen.

7. The human-computer interaction method as described in claim 6, characterized in that: The voice control commands include an insertion operation; Displaying the execution result of the voice control command at the first coordinate on the screen includes: displaying the insertion object of the insertion operation at the first coordinate.

8. The human-computer interaction method as described in claim 6, characterized in that: The voice control commands include screen mirroring. Displaying the execution result of the voice control command at the first coordinate on the screen includes: determining the display position of the identifier of the device to be projected on the projection connection interface based on the first coordinate.

9. The human-computer interaction method as described in claim 8, characterized in that: The step of displaying the execution result of the voice control command at the first coordinate on the screen further includes: When the animation of connecting the human-computer interaction terminal and the device to be projected is executed on the screen projection connection interface, the animation is displayed starting from the display position.

10. A human-computer interaction method, applied to a human-computer interaction terminal, characterized in that, include: Obtain voice control commands issued by the user; When the voice control command is a location-related command, the user's orientation information relative to the human-computer interaction terminal is obtained; wherein, the location-related command includes commands whose execution object is location-related; The location-related execution object is determined based on the orientation information and the voice control command; According to the voice control command, a control signal is sent to the execution object so that the execution object performs the operation of the voice control command.

11. A human-computer interaction device, comprising a memory and a processor, characterized in that, The memory is used to store programs for human-computer interaction; The processor is configured to read the program that executes the human-computer interaction and execute the method according to any one of claims 1 to 10.

12. A computer-readable storage medium storing computer-executable instructions, wherein, The computer-executable instructions are used to cause the computer to perform the method according to any one of claims 1 to 10.

13. A human-computer interaction terminal, comprising the human-computer interaction device as described in claim 11.

Images