Human-computer interaction system, server, interaction terminal, interaction method and electronic device

Abstract

The present disclosure provides a human-computer interaction system, a server, an interaction terminal, an interaction method and electronic equipment, relates to the technical field of computers, and in particular to the technical field of human-computer interaction. The human-computer interaction system comprises a server, a first interaction terminal and a second interaction terminal. The first interaction terminal is configured to receive a voice input, perform voice recognition on the voice input to generate a first request instruction, and send the first request instruction to the server. The server is configured to, in response to receiving the first request instruction, store a control instruction corresponding to the first request instruction in a cache. The second interaction terminal is configured to, based on a second request instruction, call an interface in the server to read the control instruction from the cache of the server via the interface, and run the read control instruction to display content corresponding to the control instruction.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, in particular to the technical field of human-computer interaction, and more particularly to a human-computer interaction system, a server, an interaction terminal, an interaction method, an electronic device, a computer readable storage medium and a computer program product. BACKGROUND

[0002] Human-computer interaction technology refers to a technology for realizing a dialogue between a human and a computer in an effective manner through computer input and output devices. With the development and widespread application of speech recognition technology, human-computer interaction using speech recognition technology is becoming more and more common. There is a demand for human-computer interaction through speech in scenarios such as the use of a highway information display screen.

[0003] The methods described in this section can not be the methods that have been previously conceived or adopted. Unless otherwise indicated, it should not be assumed that any of the methods described in this section are considered prior art merely because of their inclusion in this section. Similarly, issues mentioned in this section should not be assumed to have been admitted to be prior art in any jurisdiction merely because of their inclusion in this section. SUMMARY

[0004] The present disclosure provides a human-computer interaction system, a server, an interaction terminal, an interaction method, an electronic device, a computer readable storage medium and a computer program product.

[0005] According to an aspect of the present disclosure, a human-computer interaction system is provided, comprising a server, a first interaction terminal and a second interaction terminal. The first interaction terminal is configured to: receive a speech input of a user; generate a first request instruction by performing speech recognition on the speech input; and send the first request instruction to the server. The server is configured to: in response to receiving the first request instruction, store a control instruction corresponding to the first request instruction in a cache. The second interaction terminal is configured to: based on a second request instruction, invoke an interface in the server to read the control instruction from the cache of the server via the interface; and run the read control instruction to display content corresponding to the control instruction.

[0006] According to another aspect of the present disclosure, a server for a human-computer interaction system is provided, the system further comprising a first interaction terminal and a second interaction terminal. The server is configured to: based on a first request instruction, store a control instruction corresponding to the first request instruction in a cache, wherein the first request instruction is generated by performing speech recognition on a speech input of a user; configure a corresponding interface for the control instruction stored in the cache; and in response to receiving an invocation of the second interaction terminal, provide the control instruction to the second interaction terminal via the interface.

[0007] According to another aspect of the present disclosure, an interaction terminal for a human-computer interaction system is provided, the system further comprising a server. The interaction terminal is configured to: invoke, based on a second request instruction, an interface in the server to read a control instruction from a cache of the server via the interface, wherein the second request instruction is generated by performing speech recognition on a speech input of a user; and run the read control instruction to display content corresponding to the control instruction.

[0008] According to another aspect of the present disclosure, an interaction method performed by a server for a human-computer interaction system is provided, the system further comprising a first interaction terminal and a second interaction terminal. The method comprises: storing, based on a first request instruction, a control instruction corresponding to the first request instruction in a cache, wherein the first request instruction is generated by performing speech recognition on a speech input of a user; configuring a corresponding interface for the control instruction stored in the cache; and in response to receiving an invocation of the second interaction terminal, providing the control instruction to the second interaction terminal via the interface.

[0009] According to another aspect of the present disclosure, an interaction method performed by an interaction terminal for a human-computer interaction system is provided, the system further comprising a server. The method comprises: invoking, based on a second request instruction, an interface in the server to read a control instruction from a cache of the server via the interface, wherein the second request instruction is generated by performing speech recognition on a speech input of a user; and running the read control instruction to display content corresponding to the control instruction.

[0010] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform any of the above methods.

[0011] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to perform any of the above methods.

[0012] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a processor, implements any of the above methods.

[0013] According to one or more embodiments of the present disclosure, resource occupation in a human-computer interaction system can be reduced.

[0014] It is to be understood that the details set forth herein do not limit the scope of the embodiments of the present disclosure but merely constitute illustrative examples of how the embodiments can be BRIEF DESCRIPTION OF DRAWINGS

[0015] The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments and together with the description serve to explain exemplary implementations of the embodiments. The illustrated embodiments are merely examples and other embodiments can be used without departing from the scope of the claims. Throughout the drawings, like referenced numerals are used to designate like elements, but not necessarily on the same scale.

[0016] Figure 1 shows a schematic diagram of an exemplary system in which the various methods described herein can be implemented according to embodiments of the present disclosure;

[0017] Figure 2 shows a structural block diagram of a human-computer interaction system according to embodiments of the present disclosure;

[0018] Figure 3 shows an application scenario diagram of a human-computer interaction system according to embodiments of the present disclosure;

[0019] Figure 4 shows a flowchart of an interaction method performed by a server for a human-computer interaction system according to embodiments of the present disclosure;

[0020] Figure 5 shows a flowchart of an interaction method performed by an interaction terminal for a human-computer interaction system according to embodiments of the present disclosure; and

[0021] Figure 6 shows a structural block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure. DETAILED DESCRIPTION

[0022] Exemplary embodiments of the present disclosure are described herein with reference to the accompanying drawings, which are included to provide a further understanding of the embodiments of the present disclosure and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments and together with the description serve to explain exemplary implementations of the embodiments. The illustrated embodiments are merely examples and other embodiments can be used without departing from the scope of the claims. As such, those skilled in the art will recognize that changes can be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, to the extent there are variations of the present disclosure, those variations are contemplated in accordance with the embodiments of the present disclosure. It is therefore intended that the disclosure not be limited to the particular embodiments described herein.

[0023] In the present disclosure, the terms "first", "second", and the like are used to describe various elements only for the purpose of distinguishing one element from another, and the terms are not intended to imply a relative importance of the elements. In some examples, a first element and a second element can refer to the same instance of the element, and in some cases, they can refer to different instances of the element based on the context of description.

[0024] The terminology used in the description of the various described examples herein is for the purpose of describing particular examples only and is not intended to be limiting. Unless specifically defined herein, any terms that refer to a certain element can also refer to one or more instances of that element. In addition, the term "and / or" as used herein encompasses any and all possible combinations of the listed items.

[0025] As mentioned above, there is a need for human-computer interaction through voice in scenarios such as using a highway information display screen. For example, an interactive terminal (e.g., an interactive terminal including a highway information display screen) can be arranged in a highway information exhibition hall to display highway information, and a server in communication connection with the interactive terminal can be arranged to process voice data.

[0026] In the related art, a user can interact with an interactive terminal arranged in an exhibition hall through voice. The interactive terminal can receive voice input of the user, and can communicate with a server using a long connection based on, for example, a WebSocket protocol, where the WebSocket is a protocol for full-duplex communication over a single TCP (Transmission Control Protocol) connection. The server performs a series of operations based on the voice input, and then pushes a control command corresponding to the content of the voice input to the interactive terminal based on the above protocol. However, in this application scenario, the user can not need to interact with the interactive terminal at all times, and maintaining such a long connection usually requires occupying a large amount of system resources.

[0027] The present disclosure provides a data processing method, by storing, by a server, a control instruction corresponding to a first request instruction in a cache of the server, and calling, by a second interactive terminal, an interface in the server based on a second request instruction, thereby reading the control instruction in the cache of the server via the called interface. In this way, the long connection communication between the server and the second interactive terminal can be eliminated, and the interface in the server is called by the second interactive terminal based on the second request instruction only when the user needs to interact with the interactive terminal, thereby reducing the occupation of system resources of the human-computer interaction system by the long connection communication.

[0028] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0029] Figure 1 A schematic diagram illustrating an example system 100 in which various methods and apparatus described herein can be implemented in accordance with embodiments of the disclosure is shown. With reference to Figure 1 The system 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. The client devices 101, 102, 103, 104, 105, and 106 can be configured to execute one or more application programs.

[0030] In embodiments of the disclosure, the server 120 can run one or more services or software applications that enable the interactive methods in accordance with embodiments of the disclosure to be performed.

[0031] In certain embodiments, the server 120 can also provide other services or software applications that can include non-virtual and virtual environments. In certain embodiments, these services can be provided as web-based services or cloud services, for example, to users of the client devices 101, 102, 103, 104, 105, and / or 106 under a software as a service (SaaS) model.

[0032] In Figure 1 In the illustrated configuration, the server 120 can include one or more components implementing the functionality performed by the server 120. These components can include software components, hardware components, or a combination thereof, executable by one or more processors. Users operating the client devices 101, 102, 103, 104, 105, and / or 106 can in turn utilize one or more client application programs to interact with the server 120 to utilize the services provided by these components. It will be appreciated that various different system configurations are possible, which can vary from the system 100. Thus, Figure 1 The system 100 is one example of a system for implementing the various methods described herein and is not intended to be limiting.

[0033] A user can interact with the client devices 101, 102, 103, 104, 105, and / or 106 in a human-machine dialogue. The client devices can provide an interface that enables a user of the client device to interact with the client device. The client devices can also output information to the user via the interface. Although Figure 1 Only six client devices are depicted, but one of skill in the art will appreciate that the disclosure can support any number of client devices.

[0034] Client devices 101, 102, 103, 104, 105, and / or 106 can include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, smart screen devices, self-service kiosk devices, service robots, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and the like. These computer devices can run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, Linux or Linux-like operating systems (such as GOOGLE Chrome OS); or including various mobile operating systems, such as MICROSOFT Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices can include cellular telephones, smartphones, tablet computers, personal digital assistants (PDAs), and the like. Wearable devices can include head-mounted displays (such as smart glasses) and other devices. Gaming systems can include various handheld gaming devices, Internet-enabled gaming devices, and the like. Client devices are capable of executing a variety of different applications, such as various Internet-related applications, communication applications (such as email applications), short message service (SMS) applications, and can use various communication protocols.

[0035] Network 110 can be any type of network familiar to those skilled in the art that can support data communications using any of a variety of available protocols, including without limitation TCP / IP, SNA, IPX, etc. As examples, one or more of networks 110 can be a LAN, an Ethernet network, a Token Ring network, a WAN, the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a public switched telephone network (PSTN), an infrared network, a wireless network (e.g., a Bluetooth, WIMAX, and / or Wi-Fi network), and / or any combination of these and / or other networks.

[0036] Server 120 can include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, midrange servers), blade servers, mainframe computers, server clusters, or any other appropriate arrangement and / or combination. Server 120 can include one or more virtual machines running a virtual operating system, or other computing architectures involving virtualization (such as one or more flexible pools of logical storage devices that can be virtualized to maintain virtual storage devices for servers). In various embodiments, server 120 can run one or more services or software applications that provide the functionality described below.

[0037] The computing units in server 120 can run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. Server 120 can also run any of a variety of additional server applications and / or mid-tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.

[0038] In some embodiments, server 120 can include one or more applications to analyze and consolidate data feeds and / or event updates from users of client devices 101, 102, 103, 104, 105, and / or 106. Server 120 can also include one or more applications to present the data feeds and / or real-time events via one or more display devices of client devices 101, 102, 103, 104, 105, and / or 106.

[0039] In some embodiments, server 120 can be a server of a distributed system, or a server in combination with a blockchain. Server 120 can also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. The cloud server is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business expansion in traditional physical host and virtual private server (VPS, Virtual Private Server) services.

[0040] System 100 can also include one or more databases 130. In certain embodiments, these databases can be used to store data and other information. For example, one or more of databases 130 can be used to store information such as audio files and video files. Databases 130 can reside in a variety of locations. For example, databases used by server 120 can reside locally to server 120, or can be remote from server 120 and can communicate with server 120 via a network- or application-specific connection. Databases 130 can be of different types. In certain embodiments, databases used by server 120 can be, for example, relational databases. One or more of these databases can store, update, and retrieve data to and from the databases in response to commands.

[0041] In certain embodiments, one or more of databases 130 can also be used by applications to store application data. Databases used by applications can be different types of databases, such as key-value stores, object stores, or regular stores backed by file systems.

[0042] Figure 1 System 100 can be configured and operated in various ways to enable the application of the various methods and apparatuses described in accordance with this disclosure.

[0043] Figure 2 A structural block diagram of a human-computer interaction system 200 is shown according to an embodiment of the present disclosure.

[0044] As shown in Figure 2 The human-computer interaction system 200 includes a first interaction terminal 210, a second interaction terminal 220, and a server 230.

[0045] The first interaction terminal 210 is configured to receive a voice input of a user, generate a first request instruction by performing voice recognition on the voice input, and send the first request instruction to the server 230.

[0046] The server 230 is configured to, in response to receiving the first request instruction, store a control instruction corresponding to the first request instruction in a cache.

[0047] The second interaction terminal 220 is configured to, based on a second request instruction, call an interface in the server 230 to read the control instruction from the cache of the server 230 via the interface, and run the read control instruction to display content corresponding to the control instruction.

[0048] By storing the control instruction corresponding to the first request instruction in the cache of the server 230 by the server 230, and calling the interface in the server 230 based on the second request instruction by the second interaction terminal 220, the control instruction in the cache of the server 230 is read via the called interface. Thus, the long connection communication between the server 230 and the second interaction terminal 220 can be eliminated, and the interface in the server 230 is called by the second interaction terminal 220 based on the second request instruction only when the user needs to interact with the interaction terminal (210 or 220), reducing the occupation of system resources by the long connection communication.

[0049] In one example, the second interaction terminal 220 can be an interaction terminal including a large screen. The large screen can be used to display pictures to the audience in an exhibition hall, thereby realizing human-computer interaction. For example, the large screen can run the control instruction of the display image or video read by the second interaction terminal 220, thereby displaying the corresponding image or video to the user.

[0050] According to some embodiments, the first interaction terminal 210 can be a recognition robot capable of following the movement of the user. For example, the first interaction terminal 210 can be a voice recognition robot capable of following the movement of the user. In some scenarios, the user can need to move back and forth in front of the second interaction terminal 220 including a large screen to observe the picture displayed by the second interaction terminal 220 in all directions; in some other scenarios, the user can not be able to approach the second interaction terminal 220 including a large screen. In the above scenarios, the first interaction terminal 210 can follow the user, so as to timely acquire the voice input of the user and perform corresponding voice recognition, thereby providing a more smooth human-computer interaction experience.

[0051] In some examples, the recognition robot can be woken up by the user inputting specific voice content, and can twist the head of the robot to face the user, so as to indicate that the user can continue to input voice to interact.

[0052] In some examples, the recognition robot can be a recognition robot with a proximity sensor, which can be woken up when the user approaches the recognition robot, and twist the head of the robot to face the user, so as to indicate that the user can continue to input voice to interact.

[0053] In addition, it should be understood that the communication transmission between the first interaction terminal 210 and the second interaction terminal 220, and between the first interaction terminal 210 and the server 230 can be in the form of wireless communication, which will not be repeated here.

[0054] According to some embodiments, the second request instruction is received from the first interaction terminal 210. In other words, the second interaction terminal 220 can acquire the first request instruction generated by the first interaction terminal 210 (for example, by wireless transmission), and call the corresponding interface in the server 230 based on the request instruction, so as to read the control instruction corresponding to the request instruction from the cache of the server 230 via the interface. Thus, only by performing voice recognition on the voice input of the user by the first interaction terminal 210, the first interaction terminal 210 and the second interaction terminal 220 can both acquire the request instruction generated by performing voice recognition on the voice input, thereby ensuring that the request instructions acquired by the first interaction terminal 210 and the second interaction terminal 220 are consistent, and improving the accuracy of voice interaction.

[0055] According to some embodiments, the second interaction terminal 220 can be further configured to: receive the voice input of the user; and generate the second request instruction by performing voice recognition on the received voice input. In other words, the voice input of the user mentioned above can also be received by the second interaction terminal 220 (for example, the second interaction terminal 220 can include a sound collection unit such as a microphone), and the second interaction terminal 220 can also perform voice recognition on the received voice input to generate the second request instruction, just as the first interaction terminal 210 described above. Based on the second request instruction generated by the second interaction terminal 220, the second interaction terminal 220 calls the interface corresponding to the request instruction in the server 230, thereby reading the control instruction stored in the cache of the server 230. In this way, by collecting the voice input of the user and performing voice recognition by both the first interaction terminal 210 and the second interaction terminal 220, the channel for collecting the voice input of the user can be increased, and the user experience can be further improved.

[0056] According to some embodiments, the second interaction terminal 220 can be further configured to send feedback to the first interaction terminal 210 in response to successfully running the control instruction. And the first interaction terminal 210 can be further configured to perform voice broadcast based on the feedback in response to receiving the feedback. In this way, when the second interaction terminal 220 successfully runs the control instruction, the user can get voice broadcast feedback from the first interaction terminal 210, so that the user can further understand that the current interaction has been successfully executed, and the user experience can be optimized. For example, the user inputs voice to request the second interaction terminal 220 to play a video on a large screen, and when the second interaction terminal 220 successfully runs the control instruction, i.e., successfully plays the video, sends feedback to the first interaction terminal 210 (such as a recognition robot following the user), and the first interaction terminal 210 then performs voice broadcast to the user to inform the user that the video has been successfully played.

[0057] In some scenarios, the second interaction terminal 220 may, due to unstable signal transmission or system itself, fail to successfully execute the corresponding control instruction, which means that the interaction expected by the user fails to be completed.

[0058] According to some embodiments, the first interaction terminal 210 can be further configured to: start timing in response to determining that the first request instruction has been sent; and send the first request instruction to the server 230 again in response to not receiving feedback from the second interaction terminal 220 within a time threshold. If the first interaction terminal 210 fails to receive feedback from the second interaction terminal 220 within a certain time after sending the first request instruction, it means that the interaction fails to be completed, and by sending the first request instruction to the server 230 again, it can ensure that the second interaction terminal 220 successfully completes the operation expected by the user, and the user experience can be improved.

[0059] According to some embodiments, the first interaction terminal 210 can be further configured to: in response to determining that the first request instruction has been sent, capture an image of the second interaction terminal currently displayed; perform image recognition on the captured image; and in response to not recognizing a preset identifier in the image, send the first request instruction to the server 230 again. By capturing the image of the second interaction terminal 220 currently displayed and recognizing the preset identifier in the image, when the preset identifier is not recognized, it may mean that the interaction fails to complete, and by sending the first request instruction to the server 230 again, it can ensure that the second interaction terminal 220 successfully completes the operation expected by the user, improving the user experience. The preset identifier can be a preset two-dimensional code, and when the image of the second interaction terminal 220 currently displayed captured by the first interaction terminal 210 does not include the preset two-dimensional code, it may mean that the operation expected by the user fails to be successfully executed.

[0060] In the following, the application scenario of the man-machine interaction system 200 according to the embodiments of the present disclosure will be further described. Figure 3 The man-machine interaction system 200 according to the embodiments of the present disclosure will be further described. Figure 3 The application scenario of the man-machine interaction system according to the embodiments of the present disclosure is shown. In the scenario, the first interaction terminal 310, the second interaction terminal 320 and the server 330 are similar to the first interaction terminal 210, the second interaction terminal 220 and the server 230 described above with respect to the man-machine interaction system 200. Figure 3 In the scenario, the first interaction terminal 310, the second interaction terminal 320 and the server 330 are similar to the first interaction terminal 210, the second interaction terminal 220 and the server 230 described above with respect to the man-machine interaction system 200. Figure 2 Here, the identification robot is taken as the first interaction terminal 310, and the interaction terminal including a large screen is taken as the second interaction terminal 320. In addition, Figure 3 The user 340 in the scenario is also shown.

[0061] As shown, the user 340 can stand in front of the large screen of the second interaction terminal 320, and the first interaction terminal 310 can follow the user 340. The user 340 can make a voice input, for example, the user 340 can say the voice of “play the road condition of the highway”, the first interaction terminal 310 receives the voice input of the user 340; and generates a first request instruction by performing voice recognition on the voice input (for example, recognizing the above voice “play the road condition of the highway” into corresponding text as the first request instruction); further, the first interaction terminal 310 sends the first request instruction to the server 330 (step S302). Figure 3 The server 330 stores a control instruction (for example, a program of playing the road condition of the highway and a corresponding source file) corresponding to the first request instruction (for example, “play the road condition of the highway”) in the cache of the server 330 in response to receiving the first request instruction.

[0062]

[0063] ​The second interaction terminal 320 can invoke an interface in the server 330 based on the second request instruction to read the control instruction from the cache of the server 330 via the interface (step S303); and run the read control instruction to display the content corresponding to the control instruction (for example, play the road condition of the highway by the large screen of the second interaction terminal 320).

[0064] In some examples, the second interaction terminal 320 can obtain the first request instruction generated by the first interaction terminal 310 from the first interaction terminal 310 (step S304) as the second request instruction. In some examples, the second interaction terminal 320 can also receive the voice input of the user 340 (step S305), and generate the corresponding second request instruction by performing voice recognition on the received voice input, and invoke the interface of the server 330 based on the second request instruction generated by the second interaction terminal 320 itself.

[0065] In some examples, the second interaction terminal 320 can send feedback to the first interaction terminal 310 in response to successfully playing the highway road condition (step S306). And the first interaction terminal 310 can be further configured to perform voice broadcast to the user 340 based on the feedback in response to receiving the feedback.

[0066] In some examples, the first interaction terminal 310 can start timing in response to determining that the first request instruction has been sent; and send the first request instruction to the server 330 again in response to not receiving feedback from the second interaction terminal 320 within a time threshold.

[0067] In some examples, the first interaction terminal 310 can capture an image currently displayed by the second interaction terminal 320 in response to determining that the first request instruction has been sent, and perform image recognition on the captured image; and send the first request instruction to the server 330 again in response to not recognizing a preset identifier in the image.

[0068] According to an aspect of the present disclosure, a server for a human-computer interaction system is also provided, the system further comprising a first interaction terminal and a second interaction terminal, wherein the server is configured to: store a control instruction corresponding to a first request instruction in a cache based on the first request instruction, wherein the first request instruction is generated by performing voice recognition on a voice input of a user; configure a corresponding interface for the control instruction stored in the cache; and provide the control instruction to the second interaction terminal via the interface in response to receiving an invocation of the second interaction terminal.

[0069] Thus, by storing the control instruction corresponding to the first request instruction in the cache of the server by the server, the control instruction can be invoked by the second interactive terminal, thereby eliminating the long connection communication between the server and the second interactive terminal, and reducing the occupation of system resources by communication.

[0070] According to an aspect of the present disclosure, an interactive method performed by an interactive terminal for a human-computer interaction system is also provided, the system further comprising a server, wherein the interactive terminal is configured to: based on a second request instruction, invoke an interface in the server to read a control instruction from a cache of the server via the interface, wherein the second request instruction is generated by speech recognition on a voice input of a user; and run the read control instruction to display content corresponding to the control instruction.

[0071] Thus, by invoking the interface in the server based on the second request instruction by the second interactive terminal, the control instruction in the cache of the server is read via the invoked interface. The long connection communication between the server and the second interactive terminal can be eliminated, and the occupation of system resources by communication is reduced.

[0072] Figure 4 A flowchart of an interactive method 400 performed by a server for a human-computer interaction system according to an embodiment of the present disclosure is shown.

[0073] As shown in Figure 4 , the method 400 comprises: step S410, storing a control instruction corresponding to a first request instruction in a cache based on the first request instruction, wherein the first request instruction is generated by speech recognition on a voice input of a user; step S420, configuring a corresponding interface for the control instruction stored in the cache; and step S430, in response to receiving an invocation of a second interactive terminal, providing the control instruction to the second interactive terminal via the interface. Thus, by storing the control instruction corresponding to the first request instruction in the cache of the server by the server, the control instruction can be invoked by the second interactive terminal, thereby eliminating the long connection communication between the server and the second interactive terminal, and reducing the occupation of system resources by communication.

[0074] Figure 5 A flowchart of an interactive method 500 performed by an interactive terminal for a human-computer interaction system according to an embodiment of the present disclosure is shown.

[0075] As shown in Figure 5As shown, the method 500 includes: step S510, invoking an interface in the server based on the second request instruction to read the control instruction from the cache of the server via the interface, wherein the second request instruction is generated by performing speech recognition on the speech input of the user; and step S520, running the read control instruction to display content corresponding to the control instruction.

[0076] Thus, by invoking the interface in the server based on the second request instruction by the second interaction terminal, the control instruction in the cache of the server is read via the invoked interface. The long connection communication between the server and the second interaction terminal can be eliminated, and the occupation of system resources by communication is reduced.

[0077] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above method.

[0078] According to another aspect of the present disclosure, a non-transitory computer readable storage medium storing computer instructions is also provided, wherein the computer instructions are used to enable the computer to perform the above method.

[0079] According to another aspect of the present disclosure, a computer program product comprising a computer program is also provided, wherein the computer program, when executed by a processor, implements the above method.

[0080] Figure 6 A structural block diagram of an exemplary electronic device 600 that can be used to implement embodiments of the present disclosure is shown.

[0081] Reference Figure 6 The structural block diagram of an electronic device 600 that can be a server or a client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent a variety of forms of digital electronic computing devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections, and relationships, and their functions, are merely examples and are not intended to limit implementations of the present disclosure described and / or claimed herein.

[0082] As Figure 6As shown, the electronic device 600 includes a computing unit 601 that can perform various appropriate actions and processes in accordance with a computer program stored in a read only memory (ROM) 602 or a computer program loaded into a random access memory (RAM) 603 from a storage unit 608. Various programs and data required for the operation of the electronic device 600 can also be stored in the RAM 603. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0083] A plurality of components in the electronic device 600 are connected to the I / O interface 605, including an input unit 606, an output unit 607, a storage unit 608, and a communication unit 609. The input unit 606 can be any type of device that can input information to the electronic device 600, can receive inputted digital or character information, and generate key signal inputs related to user settings and / or function controls of the electronic device, and can include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and / or a remote controller. The output unit 607 can be any type of device that can present information, and can include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 608 can include, but is not limited to, a magnetic disk, an optical disk. The communication unit 609 allows the electronic device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and can include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth TM device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0084] The computing unit 601 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, and the like. The computing unit 601 performs various methods and processes described above. For example, in some embodiments, the methods described herein can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 608. In some embodiments, portions or all of the computer program can be loaded and / or installed onto the electronic device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded onto the RAM 603 and executed by the computing unit 601, one or more steps of the methods described above can be performed. Alternatively, in other embodiments, the computing unit 601 can be configured to perform the methods described herein by any other suitable means, such as by means of firmware.

[0085] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a complex programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0086] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0087] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0088] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0089] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0090] The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0091] It should be understood that the various forms of flow illustrated above can be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technology disclosed in the present disclosure can be achieved, which is not limited herein.

[0092] While embodiments or examples of the present disclosure have been described with reference to the drawings, it should be understood that the above-described methods, systems, and devices are merely exemplary embodiments or examples, and the scope of the present disclosure is not limited by these embodiments or examples, but is only limited by the claims and their equivalents. Various elements in the embodiments or examples can be omitted or replaced by equivalent elements thereof. In addition, each step can be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples can be combined in various ways. It is important that many of the elements described herein can be replaced by equivalent elements that appear after the present disclosure as technology evolves.

Claims

1. A human-machine interaction system comprising a server, a first interaction terminal and a second interaction terminal, wherein, the first interaction terminal is configured to: receive a voice input of a user; generate a first request instruction by performing voice recognition on the voice input; and send the first request instruction to the server, and wherein, the server is configured to: in response to receiving the first request instruction, store a control instruction corresponding to the first request instruction in a cache, and wherein, the second interaction terminal is configured to: based on a second request instruction, invoke an interface in the server to read the control instruction from the cache of the server via the interface; and run the read control instruction to display content corresponding to the control instruction, wherein the second request instruction is generated by performing voice recognition on the voice input. the second interaction terminal is further configured to:

2. The system of claim 1, wherein, receive the voice input of the user; and generate the second request instruction by performing voice recognition on the received voice input. the second request instruction is received from the first interaction terminal.

3. The system of claim 1, wherein, the second interaction terminal is further configured to, in response to successfully running the control instruction, send feedback to the first interaction terminal, and 4. The system of any one of claims 1 to 3, wherein, wherein the first interaction terminal is further configured to, in response to receiving the feedback, perform voice broadcast based on the feedback. the first interaction terminal is further configured to:

5. The system of any one of claims 1 to 3, wherein, in response to determining that the first request instruction has been sent, start timing; and in response to not receiving feedback from the second interaction terminal within a time threshold, send the first request instruction to the server again. the first interaction terminal is further configured to:

6. The system of any one of claims 1 to 3, wherein, in response to determining that the first request instruction has been sent, capture an image currently displayed by the second interaction terminal; perform image recognition on the captured image; and in response to not recognizing a preset identifier in the image, send the first request instruction to the server again. the first interaction terminal is a recognition robot capable of following the movement of a user.

7. The system of any one of claims 1 to 3, wherein, the server is configured to:

8. A server for a human-machine interaction system, the system further comprising a first interaction terminal and a second interaction terminal, wherein, based on a first request instruction, store a control instruction corresponding to the first request instruction in a cache, wherein the first request instruction is generated by performing voice recognition on a voice input of a user; configure a corresponding interface for the control instruction stored in the cache; and in response to receiving an invocation of the second interaction terminal, provide the control instruction to the second interaction terminal via the interface. the interaction terminal is configured to:

9. An interaction terminal for a human-machine interaction system, the system further comprising a server, wherein, based on a second request instruction, invoke an interface in the server to read a control instruction from a cache of the server via the interface, wherein the second request instruction is generated by performing voice recognition on a voice input of a user; and run the read control instruction to display content corresponding to the control instruction. the system further comprises a first interaction terminal and a second interaction terminal, and the method comprises:

10. An interaction method performed by a server for a human-machine interaction system, wherein, ​ store, based on the first request instruction, a control instruction corresponding to the first request instruction in a cache, wherein the first request instruction is generated by performing speech recognition on a voice input of a user; configure a corresponding interface for the control instruction stored in the cache; and in response to receiving a call of the second interaction terminal, provide the control instruction to the second interaction terminal via the interface.

11. An interaction method performed by an interaction terminal for a human-machine interaction system, wherein, The system further comprises a server, and the method comprises: based on a second request instruction, call an interface in the server to read a control instruction from a cache of the server via the interface, wherein the second request instruction is generated by performing speech recognition on a voice input of a user; and run the read control instruction to display content corresponding to the control instruction. 12.An electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 10-11.

13. A non-transitory computer readable storage medium having stored thereon computer instructions, wherein, The computer instructions are for causing the computer to perform the method according to any one of claims 10-11.

14. A computer program product comprising a computer program, wherein, The computer program, when executed by a processor, implements the method of any one of claims 10-11. The computer program, when executed by a processor, implements the method of any one of claims 10-11.

Images