Intelligent AI multi-mode dialogue interaction display system

Through the intelligent AI multimodal dialogue and interactive display system, multimodal input and remote connection technology are used to solve the problem of communication barriers between smart AI and elderly users, improve the communication quality and protect privacy, and expand the application of smart AI scope.

CN119311807APending Publication Date: 2025-01-14ANHUI FANLIAN INFORMATION TECH CO LTD

Patent Information

Application Number
CN202411864864.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-18
Publication Date
2025-01-14

AI Technical Summary

Technical Problem

Existing smart AI devices have major communication barriers when communicating with elderly users due to factors such as unclear semantic expression and difficulty in mutual understanding, which limits their scope of use.

Method used

An intelligent AI multi-modal dialogue and interaction display system was designed, including an intelligent AI terminal and an interaction assistance platform. Through multi-modal input module, reminder module, user feature library and dialogue privacy security module, the hardware of users and intelligent AI terminals is realized. Connect, use the user's personal information for remote connection, replace the intelligent AI terminal with smart AI terminals to communicate without language barriers, and combine sound insulation cloth covers and microphones for privacy protection.

Benefits of technology

It effectively improves the communication quality between elderly users and smart AI terminals, expands the scope of application of smart AI, and protects users' privacy information through privacy detection and sound insulation, reducing the risk of privacy leakage during communication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119311807A_ABST
    Figure CN119311807A_ABST
Patent Text Reader

Abstract

The invention relates to an intelligent AI multi-mode dialogue interaction display system applied to the field of electronic digital data processing, an interaction auxiliary terminal integrating a plurality of interaction modes is innovatively arranged, an online login-free use mode is provided for dialogue interaction between a user and an intelligent AI terminal, and on the basis that the use of young users is not influenced, the user experience is improved. The intelligent AI terminal provides great use convenience for the elderly user, when a communication barrier exists between a user with a nonstandard language and the intelligent AI terminal, the intelligent AI terminal can read information such as a user native place in the interaction auxiliary terminal, and an online user in the same region is remotely connected to the user, so that the user replaces the intelligent AI terminal to answer questions for the user, and the user experience is improved. The communication quality of the elderly user and the intelligent AI terminal is effectively improved, in addition, in the remote connection process, in combination with the sound insulation confidentiality means and the privacy detection means of the interaction auxiliary terminal, the privacy information of the elderly user with weak safety awareness is not easily obtained by surrounding personnel or remote personnel.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an interactive display system, and in particular to an intelligent AI multimodal dialogue interactive display system applied in the field of electronic digital data processing. Background Art

[0002] Intelligent AI digital human is a virtual image based on artificial intelligence technology. It can interact and communicate with humans through natural language processing and machine learning algorithms. Intelligent AI digital human not only has highly realistic appearance and voice, but can also understand and respond to various questions and needs of users. They can play a role in multiple fields, such as customer service, education, entertainment, etc., providing efficient and convenient services.

[0003] For example, the specification of Chinese patent CN117908683B discloses an intelligent mobile AI digital human interaction method and system based on a transparent display device. The target user is interactively identified and tracked through the transparent display device to obtain voice data, expression data and action data; feature extraction and feature correlation analysis are performed to generate digital human dialogue response parameters, digital human expression response parameters and digital human action response parameters; an initial intelligent mobile AI digital human interaction execution parameter combination is generated; a first intelligent mobile AI digital human is generated and a multi-dimensional digital human execution strategy adjustment is performed to obtain a voice response execution strategy, an expression response execution strategy and an action response execution strategy; a target intelligent mobile AI digital human interaction execution parameter combination is determined and the response is optimized to obtain a second intelligent mobile AI digital human. This application improves the control accuracy of intelligent mobile AI digital human interaction through a transparent display device.

[0004] Existing intelligent AI can achieve barrier-free communication with young users. However, for the special group of elderly users, due to their general decline in cognitive ability and non-standard Mandarin, there are great communication barriers between the two due to unclear semantic expression and difficulty in mutual understanding, which makes the use of intelligent AI still have great limitations. Summary of the invention

[0005] In view of the above-mentioned prior art, the technical problem to be solved by the present invention is that when existing intelligent AI devices communicate with elderly users, there are large communication barriers due to factors such as unclear semantic expression and difficulty in mutual understanding.

[0006] To solve the above problems, the present invention provides an intelligent AI multimodal dialogue interactive display system, including an intelligent AI terminal and an interactive auxiliary platform, the intelligent AI terminal includes a transmission module 1, a data recognition module, a multimodal display module, an information reading module and a connection module, the interactive auxiliary platform includes a dialogue interaction system and an interactive auxiliary terminal, the interactive auxiliary terminal is connected to the intelligent AI terminal by hardware through a connector, and the dialogue interaction system includes a multimodal input module, a transmission module 2, a reminder module, a user feature library and a dialogue privacy security module; The multimodal input module includes a text input unit, a recording unit and a gesture recognition unit. The second transmission module is used to transmit data to the intelligent AI terminal and receive output data of the intelligent AI terminal. The reminder module is used to give voice prompts to the user. The user feature library stores the user's personal information, and the personal information includes gender, age and place of origin. The transmission module is used to transmit data to the interactive assistance platform and receive the output data of the interactive assistance platform. The data identification module is used to identify the output data of the interactive assistance platform and make corresponding reply content. The multimodal display module is used to display the reply content to the user, and it includes a text output unit, an audio playback unit and a video unit. The information reading module is used to read the user's personal information in the user feature library. The connection module is used to realize remote data transmission between different interactive assistance platforms.

[0007] An intelligent AI multimodal dialogue interactive display system, the use method of which includes the following steps: S1. User R connects the interactive auxiliary terminal to the intelligent AI terminal through hardware, so that the circuits of the two terminals are connected and data transmission is performed; S2. User R inputs the interactive content into the interactive auxiliary terminal through the multimodal input module, and transmits it to the intelligent AI terminal through the interactive auxiliary terminal. After the intelligent AI terminal recognizes the interactive content, it makes corresponding reply content and displays it directly on the intelligent AI terminal; S3. When the intelligent AI terminal has difficulty in recognizing the content of the voice interaction, it commands the interactive auxiliary terminal to issue a voice reminder, prompting the user R to re-enter the interactive content. When the intelligent AI terminal fails to recognize the interactive content for multiple times, it asks the user R through the interactive auxiliary terminal whether a remote connection is needed for answering; S4. When user R agrees to remote connection for answering, the intelligent AI terminal first reads the personal information of user R in the interactive assistance terminal, then obtains user information from multiple other online interactive assistance terminals, selects an interactive assistance terminal h that is in the same region as user R and has been connected the most times, and sends a connection request to it; S5. When user H holding the interactive assistance terminal h agrees to the connection request, he or she can have an online voice communication process with user R without language barriers, and user H will answer questions for user R instead of the intelligent AI terminal; S6. When the user H holding the interactive auxiliary terminal h refuses the connection request, step S4 is repeated to reconnect the user remotely.

[0008] As a further supplement to the present application, the conversation privacy security module includes a content extraction unit, a privacy detection unit and a privacy vocabulary library.

[0009] As a further supplement to this application, step S5 specifically includes the following process: S5-1. During online voice communication, after the user inputs voice content into the interactive assistance terminal, the content extraction unit recognizes the voice content and extracts keywords; S5-2. The keywords are identified and compared through the privacy detection unit. When there are no privacy words, the voice content is transmitted to the intelligent AI terminal, and then transmitted by the intelligent AI terminal to another interactive assistance terminal connected remotely. When there are privacy words, the interactive assistance terminal issues a voice prompt to remind the user that there is privacy content and re-enter it.

[0010] As a further supplement to the present application, the interactive auxiliary terminal includes a terminal body, the terminal body is connected to the connector via a wire, and a touch screen is fixedly connected to the front end of the terminal body.

[0011] As another improvement of the present application, the outer end of the terminal body is fixedly connected to an outer ring, the front end of the outer ring is fixedly connected to a sound insulation cloth cover and a microphone, the end of the sound insulation cloth cover away from the outer ring is fixedly connected to a rubber ring, and a plurality of evenly distributed inflatable expanders are fixedly connected between the outer ring and the rubber ring.

[0012] As another improvement supplement of the present application, a handle is provided on the lower side of the terminal body, an inner groove is provided at the lower end of the terminal body, the handle is slidably connected to the inside of the inner groove, a pair of side ends of the handle are fixedly connected to sliders, a pair of inner walls of the inner groove are provided with sliding grooves slidably connected to the sliders, the outer end of the handle is fixedly connected to an air storage bag for storing gas, and an air guide hose is fixedly connected between the air storage bag and the outer ring.

[0013] As another improved supplement of the present application, the inflatable telescopic device includes a telescopic rod and a flexible sealing sleeve mounted on the outside of the telescopic rod, an annular cavity is opened inside the outer ring, the end of the air guide hose is fixedly passed through the outer ring and is connected to the annular cavity, and a plurality of air guide channels are opened on the inner wall of the annular cavity near the sound insulation cloth sleeve, the plurality of air guide channels respectively correspond to the plurality of inflatable telescopic devices, and the opening of the air guide channel is located between the telescopic rod and the flexible sealing sleeve.

[0014] As another improved supplement to the present application, the maximum length of a pair of telescopic rods near the upper and lower ends of the terminal body is greater than the maximum length of a pair of telescopic rods near the left and right ends of the terminal body, and the shortest lengths of the multiple telescopic rods after contraction are the same.

[0015] As another improved supplement to the present application, a lanyard is fixedly connected to the outer end of the terminal body, a threaded sleeve is fixedly connected to the end of the lanyard away from the terminal body, a threaded rod is fixedly connected to the outer end of the connector, the threaded sleeve is threadedly connected to the outer end of the threaded rod, and the lanyard, threaded sleeve, wire and connector form a wearable and detachable chain ring structure.

[0016] In summary, the present application innovatively sets up an interactive assistance terminal that integrates multiple interactive methods such as text, voice, and action, and provides a method of use without online login for the dialogue interaction between users and smart AI terminals. On the basis of not affecting the use of young users, it provides greater convenience for the use of elderly users who lack online operation capabilities, cognitive understanding capabilities, etc. When there is a communication barrier between the user with non-standard voice and the smart AI terminal, the smart AI terminal can read the user's native place and other information in the interactive assistance terminal, and remotely connect the user to an online user in the same region, so that the user can answer questions for the user instead of the smart AI terminal. At the same time, the two can also conduct other communication processes such as experience sharing and knowledge learning, which effectively improves the communication quality between the elderly users and the smart AI terminals and makes the application scope of the smart AI terminals wider. In addition, in the process of remote connection and communication, combined with the sound insulation and confidentiality means of the interactive assistance terminal and the privacy detection means for voice, the privacy information of elderly users with weak security awareness can be effectively protected, so that their privacy information is not easily obtained by surrounding people or remote connection personnel. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a system diagram of the first and second implementation modes of the present application; Figure 2 A three-dimensional diagram of the interactive auxiliary terminal in the first and second embodiments of the present application; Figure 3 The third embodiment of the interactive auxiliary terminal in the second embodiment of the present application is Figure 1 ; Figure 4 The third embodiment of the interactive auxiliary terminal in the second embodiment of the present application is Figure 2 ; Figure 5 The third embodiment of the interactive auxiliary terminal in the second embodiment of the present application is Figure 3 ; Figure 6 A partial stereoscopic diagram of the interactive auxiliary terminal in the second embodiment of the present application; Figure 7 This is a schematic diagram of the side structure of the interactive auxiliary terminal in the second implementation mode of the present application; Figure 8 for Figure 7 Schematic diagram of the structure at A in the middle.

[0018] Description of the numbers in the figure: 1 terminal body, 101 inner groove, 102 slide groove, 2 outer ring, 201 annular cavity, 202 air guide channel, 3 sound insulation cloth cover, 4 rubber ring, 5 inflatable retractor, 51 telescopic rod, 52 flexible sealing sleeve, 6 microphone, 7 handle, 701 slider, 8 air storage bag, 9 air guide hose, 10 magnetic coating, 11 hanging rope, 12 threaded sleeve, DETAILED DESCRIPTION

[0019] The following describes two implementation modes of the present application in detail with reference to the accompanying drawings.

[0020] The first implementation method: The present invention provides an intelligent AI multi-modal dialogue interactive display system, please refer to Figure 1 , including an intelligent AI terminal and an interactive assistance platform. The interactive assistance platform includes a dialogue interaction system and an interactive assistance terminal. The interactive assistance terminal is hardware-connected to the intelligent AI terminal through a connector. The dialogue interaction system includes a multimodal input module, a transmission module 2, a reminder module, a user feature library and a dialogue privacy and security module.

[0021] The multimodal input module includes a text input unit, a recording unit and a gesture recognition unit. Users can choose the appropriate input method according to their own situation. For elderly users, due to common conditions such as decreased eyesight and limited knowledge, using a recording unit for voice input is a relatively simple method. For users with speech disorders, text input or gesture input can be used. Transmission module 2 is used to transmit data to the intelligent AI terminal and receive output data from the intelligent AI terminal. The reminder module is used to give voice prompts to the user. The user feature library stores the user's personal information, and the personal information includes gender, age and place of origin. Since elderly users generally speak non-standard Mandarin and their accents vary from region to region, the place of origin information in the personal information is an important factor in overcoming communication barriers and affecting remote connections in the later stage.

[0022] See also Figure 1 The intelligent AI terminal includes a transmission module 1, a data identification module, a multimodal display module, an information reading module and a connection module. The transmission module 1 is used to transmit data to the interactive assistance platform and receive output data of the interactive assistance platform. The data identification module is used to identify the output data of the interactive assistance platform and make corresponding reply content. The multimodal display module is used to display the reply content to the user, and it includes a text output unit, an audio playback unit and a video unit. According to the reply content, the intelligent AI terminal automatically selects a suitable output method to present the reply content. The information reading module is used to read user personal information in the user feature library. The connection module is used to realize remote data transmission between different interactive assistance platforms.

[0023] An intelligent AI multimodal dialogue interactive display system, the use method of which includes the following steps: S1. User R connects the interactive auxiliary terminal to the intelligent AI terminal through hardware, so that the circuits of the two terminals are connected and data transmission is performed; S2. User R inputs the interactive content into the interactive auxiliary terminal through the multimodal input module, and transmits it to the intelligent AI terminal through the interactive auxiliary terminal. After the intelligent AI terminal recognizes the interactive content, it makes corresponding reply content and displays it directly on the intelligent AI terminal; S3. When the intelligent AI terminal has difficulty in recognizing the content of the voice interaction, it commands the interactive auxiliary terminal to issue a voice reminder, prompting the user R to re-enter the interactive content. When the intelligent AI terminal fails to recognize the interactive content for multiple times, it asks the user R through the interactive auxiliary terminal whether a remote connection is needed for answering; S4. When user R agrees to remote connection for answering, the intelligent AI terminal first reads the personal information of user R in the interactive assistance terminal, then obtains user information from multiple other online interactive assistance terminals, selects an interactive assistance terminal h that is in the same region as user R and has been connected the most times, and sends a connection request to it; S5. When user H holding the interactive assistance terminal h agrees to the connection request, he or she can have an online voice communication process with user R without language barriers, and user H will answer questions for user R instead of the intelligent AI terminal; S6. When the user H holding the interactive auxiliary terminal h refuses the connection request, step S4 is repeated to reconnect the user remotely.

[0024] For step S1, the general login method in the prior art is mostly through a user name and password. However, considering the weak online intelligent operation ability of elderly users, this application realizes the use of manual hardware connection instead of online intelligent login method through the connection between the interactive auxiliary terminal and the intelligent AI terminal, which provides great convenience for the use of elderly users. At the same time, by storing user personal information in the user feature library of the interactive auxiliary terminal, the intelligent AI terminal can smoothly read user information in the later remote connection.

[0025] For step S3, when the smart AI terminal fails to recognize the voice interaction content for many times, it indicates to a certain extent that the voice content input by the user has a non-standard language problem, resulting in a communication barrier between the smart AI terminal and user R. At this time, according to the native place information of user R, the user is connected to an online user H from the same region, and the online user H replaces the smart AI terminal to communicate with user R. Since the two have the same native place, there is less likely to be any obstacle in the online voice communication between the two. In addition, the large number of connections can indicate to a certain extent that user H has remotely connected with other users many times, and it is not easy for him to have problems such as language communication barriers. User H can answer questions for user R instead of the smart AI terminal. At the same time, the two can also conduct other communication processes such as experience sharing and knowledge learning, which effectively improves the communication quality between the elderly user and the smart AI terminal and makes the application scope of the smart AI terminal wider.

[0026] The conversation privacy and security module includes a content extraction unit, a privacy detection unit and a privacy vocabulary.

[0027] Step S5 specifically includes the following process: S5-1. During online voice communication, after the user inputs voice content into the interactive assistance terminal, the content extraction unit recognizes the voice content and extracts keywords; S5-2. The keywords are identified and compared through the privacy detection unit. When there are no privacy words, the voice content is transmitted to the intelligent AI terminal, and then transmitted by the intelligent AI terminal to another interactive assistance terminal connected remotely. When there are privacy words, the interactive assistance terminal issues a voice prompt to remind the user that there is privacy content and re-enter it.

[0028] Since the elderly have a weak sense of security about their personal privacy when communicating, in order to reduce the privacy leakage of users during online remote communication, this application performs pre-privacy detection on the communication content through the dialogue privacy security module, which can effectively reduce the leakage of users' own privacy, make up for the lack of users' security awareness, and improve the security of remote communication.

[0029] The interactive auxiliary terminal includes a terminal body 1, which is connected to a connector via a wire, and the connector is hardware-connected to an interface on the intelligent AI terminal to achieve circuit connectivity. A touch screen is fixedly connected to the front end of the terminal body 1, and the touch screen is convenient for users to operate.

[0030] Second implementation method: This embodiment adds the following contents to the terminal body 1 based on the embodiment 1: Figure 2The outer end of the terminal body 1 is fixedly connected to an outer ring 2, the front end of the outer ring 2 is fixedly connected to a soundproof cloth cover 3 and a microphone 6, the microphone 6 is electrically connected to the multimodal input module, and can be used to collect user voice to form audio data, and the end of the soundproof cloth cover 3 away from the outer ring 2 is fixedly connected to a rubber ring 4, combined with Figure 5 and Figure 7 As shown, a plurality of evenly distributed inflatable expanders 5 are fixedly connected between the outer ring 2 and the rubber ring 4 .

[0031] See also Figure 3 , Figure 6 and Figure 7 A handle 7 is provided on the lower side of the terminal body 1, an inner groove 101 is provided at the lower end of the terminal body 1, the handle 7 is slidably connected to the inside of the inner groove 101, a pair of side ends of the handle 7 are fixedly connected with a slider 701, a pair of inner walls of the inner groove 101 are provided with a slide groove 102 slidably connected to the slider 701, the upper end of the handle 7 and the upper inner wall of the inner groove 101 are coated with a magnetic coating 10, and the magnetic force of the magnetic coating 10 can make the handle 7 stably stored in the inner groove 101 when not in use, thereby reducing the volume of the interactive auxiliary terminal, and the outer end of the handle 7 is fixedly connected with a gas storage bag 8 for storing gas, and a gas guide hose 9 is fixedly connected between the gas storage bag 8 and the outer ring 2.

[0032] Combination Figure 5 and Figure 8 The inflatable retractor 5 includes a telescopic rod 51 and a flexible sealing sleeve 52 sleeved on the outside of the telescopic rod 51. An annular cavity 201 is opened inside the outer ring 2. The end of the air guide hose 9 is fixedly passed through the outer ring 2 and communicated with the annular cavity 201. A plurality of air guide channels 202 are opened on the inner wall of the annular cavity 201 near the sound insulation cloth cover 3. The plurality of air guide channels 202 correspond to the plurality of inflatable retractors 5 one by one, and the opening position of the air guide channel 202 is located between the telescopic rod 51 and the flexible sealing sleeve 52. The maximum length of a pair of telescopic rods 51 near the upper and lower ends of the terminal body 1 is greater than the maximum length of a pair of telescopic rods 51 near the left and right ends of the terminal body 1, and the shortest length of the plurality of telescopic rods 51 after contraction is the same.

[0033] The air storage bag 8 is made of an inelastic flexible material, such as a plastic film, so that when the air storage bag 8 is not subjected to external force, the gas can be stably stored inside the air storage bag 8. The air storage bag 8 is in a normal unfolded state and is partially stored in the inner groove 101, and is not easily squeezed by external objects, such as Figure 4 As shown, when using the interactive auxiliary terminal, the user manually pulls the handle 7 downward and holds the handle 7 to facilitate the use of the terminal body 1; When users need to communicate through language input, Figure 5As shown, the air storage bag 8 can be manually held and force can be applied thereto, so that the gas in the air storage bag 8 is released to the inside of the flexible sealing sleeve 52 through the air guide hose 9, the annular cavity 201 and the air guide channel 202, and the flexible sealing sleeve 52 is inflated, thereby driving the telescopic rod 51 to extend, and the rubber ring 4 and the sound insulation cloth cover 3 are pushed toward the front end of the terminal body 1, and combined with the different maximum extension lengths of the telescopic rod 51 at different positions, the rubber ring 4 is finally moved to a certain distance in front of the terminal body 1, and presents a curved structure that adapts to the periphery of the human mouth (its structure is similar to the contour structure of the mouthpiece used in the vital capacity test). At this time, the user keeps holding the air storage bag 8, and then covers the rubber ring 4 on the outside of the mouth, and then performs voice input. The sound insulation cloth cover 3 and the rubber ring 4 can effectively block the sound of the user's communication, which not only makes the user's communication process less likely to cause noise interference to the outside world, but also makes it difficult for people around to steal the user's leaked privacy information, which has great practical benefits to the outside world and the user himself.

[0034] See also Figure 5 The outer end of the terminal body 1 is fixedly connected to a hanging rope 11, and the end of the hanging rope 11 away from the terminal body 1 is fixedly connected to a threaded sleeve 12, and the outer end of the joint is fixedly connected to a threaded rod, and the threaded sleeve 12 is threadedly connected to the outer end of the threaded rod. The hanging rope 11, the threaded sleeve 12, the wire and the joint form a wearable and detachable chain ring structure. The user can hang the chain ring around the neck so that the terminal body 1 is hung in front of the body, which is convenient for the user to carry and not easy to lose or forget. It is more suitable for elderly users; when it needs to be used, the threaded sleeve 12 can be unscrewed from the threaded rod, and then the joint can be connected to the smart AI terminal.

[0035] In view of current practical needs, the above-mentioned implementation mode adopted in this application is not limited to the scope of protection. Various changes made within the knowledge scope of technical personnel in this field without departing from the concept of this application still fall within the scope of protection of the present invention.

Claims

1. An intelligent AI multimodal dialogue interactive display system, characterized by: It includes an intelligent AI terminal and an interactive assistance platform, wherein the intelligent AI terminal includes a transmission module 1, a data identification module, a multimodal display module, an information reading module and a connection module, and the interactive assistance platform includes a dialogue interaction system and an interactive assistance terminal, wherein the interactive assistance terminal is connected to the intelligent AI terminal by hardware via a connector, and the dialogue interaction system includes a multimodal input module, a transmission module 2, a reminder module, a user feature library and a dialogue privacy and security module; The multimodal input module includes a text input unit, a recording unit and a gesture recognition unit. The second transmission module is used to transmit data to the intelligent AI terminal and receive output data of the intelligent AI terminal. The reminder module is used to give voice prompts to the user. The user feature library stores the user's personal information, and the personal information includes gender, age and place of origin. The transmission module is used to transmit data to the interactive assistance platform and receive output data of the interactive assistance platform. The data identification module is used to identify the output data of the interactive assistance platform and make corresponding reply content. The multimodal display module is used to display the reply content to the user, and it includes a text output unit, an audio playback unit and a video unit. The information reading module is used to read user personal information in the user feature library. The connection module is used to realize remote data transmission between different interactive assistance platforms.

2. The intelligent AI multi-modal dialogue interactive display system according to claim 1, characterized in that: The method of use includes the following steps: S1. User R connects the interactive auxiliary terminal to the intelligent AI terminal through hardware, so that the circuits of the two terminals are connected and data transmission is performed; S2. User R inputs the interactive content into the interactive auxiliary terminal through the multimodal input module, and transmits it to the intelligent AI terminal through the interactive auxiliary terminal. After the intelligent AI terminal recognizes the interactive content, it makes corresponding reply content and displays it directly on the intelligent AI terminal; S3. When the intelligent AI terminal has difficulty in recognizing the content of the voice interaction, it commands the interactive auxiliary terminal to issue a voice reminder, prompting the user R to re-enter the interactive content. When the intelligent AI terminal fails to recognize the interactive content for multiple times, it asks the user R through the interactive auxiliary terminal whether a remote connection is needed for answering; S4. When user R agrees to remote connection for answering, the intelligent AI terminal first reads the personal information of user R in the interactive assistance terminal, then obtains user information from multiple other online interactive assistance terminals, selects an interactive assistance terminal h that is in the same region as user R and has been connected the most times, and sends a connection request to it; S5. When user H holding the interactive assistance terminal h agrees to the connection request, he or she can have an online voice communication process with user R without language barriers. User H will answer questions for user R instead of the intelligent AI terminal; S6. When the user H holding the interactive auxiliary terminal h refuses the connection request, step S4 is repeated to reconnect the user remotely.

3. The intelligent AI multi-modal dialogue interactive display system according to claim 2, characterized in that: The conversation privacy security module includes a content extraction unit, a privacy detection unit and a privacy vocabulary library.

4. The intelligent AI multi-modal dialogue interactive display system according to claim 3, characterized in that: The step S5 specifically includes the following process: S5-1. During online voice communication, after the user inputs voice content into the interactive assistance terminal, the content extraction unit recognizes the voice content and extracts keywords; S5-2. The keywords are identified and compared through the privacy detection unit. When there are no privacy words, the voice content is transmitted to the intelligent AI terminal, and then transmitted by the intelligent AI terminal to another interactive assistance terminal connected remotely. When there are privacy words, the interactive assistance terminal issues a voice prompt to remind the user that there is privacy content and re-enter it.

5. The intelligent AI multi-modal dialogue interactive display system according to claim 1, characterized in that: The interactive auxiliary terminal comprises a terminal body (1), the terminal body (1) is connected to a connector via a wire, and a touch screen is fixedly connected to the front end of the terminal body (1).

6. The intelligent AI multi-modal dialogue interactive display system according to claim 5, characterized in that: The outer end of the terminal body (1) is fixedly connected to an outer ring (2), the front end of the outer ring (2) is fixedly connected to a soundproofing cloth sleeve (3) and a microphone (6), the end of the soundproofing cloth sleeve (3) away from the outer ring (2) is fixedly connected to a rubber ring (4), and a plurality of evenly distributed inflatable expanders (5) are fixedly connected between the outer ring (2) and the rubber ring (4).

7. The intelligent AI multi-modal dialogue interactive display system according to claim 6, characterized in that: A handle (7) is provided at the lower side of the terminal body (1), an inner groove (101) is provided at the lower end of the terminal body (1), the handle (7) is slidably connected to the inside of the inner groove (101), a pair of side ends of the handle (7) are fixedly connected to sliders (701), a pair of inner walls of the inner groove (101) are provided with slide grooves (102) slidably connected to the sliders (701), an outer end of the handle (7) is fixedly connected to a gas storage bag (8) for storing gas, and a gas guide hose (9) is fixedly connected between the gas storage bag (8) and the outer ring (2).

8. The intelligent AI multi-modal dialogue interactive display system according to claim 7, characterized in that: The inflatable telescopic device (5) comprises a telescopic rod (51) and a flexible sealing sleeve (52) sleeved on the outside of the telescopic rod (51); an annular cavity (201) is provided inside the outer ring (2); an end of the air guide hose (9) is fixedly passed through the outer ring (2) and communicated with the annular cavity (201); a plurality of air guide channels (202) are provided on the inner wall of the annular cavity (201) close to the sound insulation cloth sleeve (3); the plurality of air guide channels (202) correspond to the plurality of inflatable telescopic devices (5) one by one, respectively, and the opening of the air guide channel (202) is located between the telescopic rod (51) and the flexible sealing sleeve (52).

9. The intelligent AI multi-modal dialogue interactive display system according to claim 8, characterized in that: The maximum length of a pair of telescopic rods (51) near the upper and lower ends of the terminal body (1) is greater than the maximum length of a pair of telescopic rods (51) near the left and right ends of the terminal body (1), and the shortest lengths of the plurality of telescopic rods (51) after contraction are the same.

10. The intelligent AI multi-modal dialogue interactive display system according to claim 5, characterized in that: The outer end of the terminal body (1) is fixedly connected to a hanging rope (11), one end of the hanging rope (11) away from the terminal body (1) is fixedly connected to a threaded sleeve (12), the outer end of the connector is fixedly connected to a threaded rod, the threaded sleeve (12) is threadedly connected to the outer end of the threaded rod, and the hanging rope (11), the threaded sleeve (12), the wire and the connector form a wearable and detachable chain ring structure.

Citation Information

Patent Citations

  • Intelligent mobile AI digital human interaction method and system based on transparent display device

    CN117908683B

  • Earphone muffle

    CN101102344A

  • Real voice information intelligent interactive system and method based on aged user

    CN110223681A

  • Intelligent interactive remote auxiliary video system

    CN113965550A

  • Entrance guard talkback indoor unit device and system based on artificial intelligence

    CN118658232A

Cited By

  • Old-people-oriented offline AI accompanying pet privacy encryption interaction method and system

    CN122595349A