Portable storage device capable of achieving intelligent question and answer interaction

Abstract

The invention discloses a portable storage device capable of realizing intelligent question and answer interaction, which comprises the following steps: acquiring operating system information of an inserted display device, and automatically loading a platform component and resources of a corresponding operating system according to the operating system information of the display device; the semantic matching engine is connected with a cloud or a local knowledge base; the AI question and answer component responds to a question put forward through the display device, retrieves in a knowledge base by using a semantic matching engine to obtain an answer to the question, or calls a large language model API to obtain the answer to the question; and the TTS component converts the answer to the question into voice and synchronously plays the mouth shape through the virtual 3D image model. According to the method and the device, the corresponding platform components and resources can be automatically loaded according to the information of the operating system of the display equipment, and immersive enterprise image display and intelligent question and answer interaction based on semantic understanding are realized by combining the virtual 3D image with the built-in company propaganda material knowledge base, so that the interactivity and the information accuracy of propaganda are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent devices, and in particular to a portable storage device capable of realizing intelligent question-answering interaction. Background Art

[0002] To showcase a company's image and enhance its publicity, existing technology offers a corporate USB flash drive with built-in video playback, PowerPoint presentations, and PDF readers. Once plugged into a computer, it automatically displays multimedia content. Typically, these flash drives are manufactured as card-style flash drives, with the company logo, profile, and contact information printed on the surface to highlight the company's image. However, existing corporate USB flash drives have the following drawbacks:

[0003] First, the functions are limited. It can only play built-in videos, PPT and PDF documents, and cannot achieve intelligent interaction.

[0004] Second, it usually only supports Windows or MacOS systems and cannot automatically adapt to PC and mobile device cross-platforms. Summary of the Invention

[0005] In response to the above-mentioned defects, the technical problem to be solved by the present invention is to provide a convenient storage device that can realize intelligent question-and-answer interaction, so as to solve the problem that existing enterprise USB flash drive storage devices cannot perform intelligent interaction, cannot automatically adapt to PC and mobile device cross-platforms, and have certain limitations in use.

[0006] To this end, the present application provides a portable storage device capable of realizing intelligent question-and-answer interaction, which is used to be plugged into a display device via a USB interface and realize intelligent question-and-answer interaction through the display device. It is characterized in that the portable storage device capable of realizing intelligent question-and-answer interaction includes:

[0007] An acquisition module, used to obtain operating system information of the inserted display device;

[0008] The initialization module is used to perform initialization operations based on the operating system information of the display device and automatically load the platform components and resources of the corresponding operating system;

[0009] The core functional modules include a virtual 3D image model, a semantic matching engine, a TTS component, and an AI question-and-answer component. The semantic matching engine connects to a cloud or local knowledge base. The AI ​​question-and-answer component responds to questions raised through the display device, uses the semantic matching engine to retrieve answers from the knowledge base, or calls a large language model API to obtain answers. The TTS component converts the answers to questions into speech and plays them lip-synced through the virtual 3D image model.

[0010] Based on the above technical solution, this application can perform initialization operations according to the operating system information of the display device, automatically load the platform components and resources of the corresponding operating system, so that it can automatically adapt and run when it is plugged into a display device with any operating system, and through the virtual 3D image combined with the built-in company promotional material knowledge base, it can realize immersive corporate image display and intelligent question-and-answer interaction based on semantic understanding, thereby improving the interactivity of the promotion and the accuracy of information.

[0011] In the above technical solution, preferably, the TTS component pre-installs multiple TTS timbre libraries for the virtual 3D avatar model to call, and switches to the corresponding timbre in response to a timbre switching instruction issued by the timbre switching component, allowing users to select their favorite music for playback, thereby improving the user experience.

[0012] In the above technical solution, preferably, the core functional module also includes a voice cloning component for cloning the user's voice to generate a personalized voice for selection of the timbre switching command. The user can personalize the voice, further improving the user experience.

[0013] In the above technical solution, preferably, the virtual 3D image model is constructed based on Unity3D rendering and released based on multiple platforms so that it can be used on Windows, macOS, iOS and Android system platforms.

[0014] In the above technical solution, preferably, a guide module is also included to guide the installation of the acquisition module, the initialization module and the core function module, thereby realizing plug-and-play and easy use.

[0015] In the above technical solution, preferably, the boot module is a boot file stored in a root directory of a portable storage device, and is used to display installation boot information.

[0016] In the above technical solution, preferably, the guide file is a QR code.

[0017] In the above technical solution, preferably, the boot file includes an automatic jump link or an APK installation package. For Android systems and display devices, the portable storage device can be automatically installed after being inserted, without the need for manual operation by the user, and is easy to use.

[0018] In the above technical solution, preferably, the display device is a PC, a smart TV, a smart large screen or a mobile terminal, and the operating system of the display device is Windows, macOS, iOS or Android.

[0019] In the above technical solution, preferably, the question is input through the physical keyboard, virtual keyboard or voice of the display device. Questions can be asked in a variety of ways, which is convenient to use.

[0020] As can be seen from the above technical solution, the portable storage device provided by the present invention, which can realize intelligent question-and-answer interaction, solves the problems of the existing technology that cannot realize intelligent interaction, cannot automatically adapt to cross-platform PC and mobile devices, has certain limitations, and is inconvenient to use. Compared with the existing technology, the present invention has the following beneficial effects:

[0021] After the portable storage device is inserted into the display device, it can automatically obtain the operating system information of the inserted display device, perform initialization operations according to the operating system information of the display device, and automatically load the platform components and resources of the corresponding operating system, so that it can automatically adapt and run when it is plugged into a display device with any operating system. The core functional modules include a virtual 3D image model, a semantic matching engine, a TTS component, and an AI question-and-answer component. For questions raised by users, the virtual 3D image can be combined with the built-in company promotional material knowledge base to achieve immersive corporate image display and intelligent question-and-answer interaction based on semantic understanding, thereby improving the interactivity of the promotion and the accuracy of information. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces and describes the drawings required for use in the embodiments of the present invention or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0023] Figure 1 This is a system architecture diagram of the portable storage device provided by the present invention that can realize intelligent question-and-answer interaction. DETAILED DESCRIPTION

[0024] The following will clearly and completely describe the technical solutions of the embodiments of the present invention in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0025] In order to more clearly explain and illustrate the technical solution and implementation of the present invention, several preferred specific embodiments for implementing the technical solution of the present invention are introduced below.

[0026] It should be noted that the directional words such as "inside, outside", "front, back" and "left, right" in this article are expressed based on the product usage status. Obviously, the use of the corresponding directional words does not constitute a limitation on the scope of protection of this scheme.

[0027] like Figure 1 As shown, the present application provides a portable storage device that can realize intelligent question-answering interaction, including an acquisition module 10, an initialization module 20 and a core function module 30. The carrier form of the portable storage device can be a USB flash drive, which is connected to the display device through a USB interface, and the intelligent question-answering interaction is realized through the display device.

[0028] The acquisition module 10 is used to monitor the insertion operation of the portable storage device on the display device, and acquire the operating system information of the inserted display device in response to the insertion operation.

[0029] The initialization module 20 is used to perform initialization operations based on the device's operating system information, automatically load corresponding platform components and resources, and provide a corresponding operating environment. The display device can be a PC, smart TV, smart large screen, or mobile terminal, and the operating system of the display device can be Windows, macOS, iOS, or Android. The corresponding platform components include Windows platform components, macOS platform components, iOS platform components, and Android platform components. For example: kernel, development framework, and graphics system. After initialization, any display device using any operating system can run the core function module 30 to achieve intelligent question-and-answer interaction.

[0030] The core functional module 30 includes a virtual 3D image model 31 , a semantic matching engine 32 , a TTS component 33 and an AI question-and-answer component 34 .

[0031] The virtual 3D image model 31 is built based on Unity3D rendering and released on a multi-platform basis so that it can be used on Windows, macOS, iOS and Android system platforms.

[0032] The AI ​​question-answering component 34 responds to questions raised through the display device, uses a semantic matching engine to retrieve answers to questions in the knowledge base, or calls a large language model API to obtain answers to questions; the TTS component converts the answers to questions into speech and plays them lip-synced through a virtual 3D image model.

[0033] Among them, the semantic matching engine 32 is connected to the cloud or local knowledge base, which is a private knowledge base for company promotional materials. After the user enters a voice or text question, NLP is first used to segment the question, perform semantic analysis, and identify the intent. Then the semantic matching engine 32 retrieves the most relevant content in the knowledge base as the basis for answering and generates an answer. The answers obtained based on the private knowledge base of the company's promotional materials are more accurate. On the other hand, the large language model API interface can also be used to call the LLM large language model through the API to answer questions unrelated to the company, expanding the scope of application of this application.

[0034] Specifically, the file system of the portable storage device is pre-installed with startup instructions and multi-platform installation packages to facilitate quick access by users. Among them, there is an AutoRun or custom startup program in the root directory to realize the automatic operation of the Windows system and perform initialization operations. For Mac systems, the startup process of the above-mentioned custom startup program can be simplified by prompting the user to manually open it or using Launch Agent. For mobile devices, since it cannot be popped up automatically, boot files, QR codes and shortcuts are set to guide users to start.

[0035] After the initialization module is activated, the UI application interface is displayed on the display device. The UI application interface includes an avatar display area and a question area. The avatar display area displays a virtual 3D avatar, and the question area has a text input box and an audio input button. Questions can be entered using text or voice, and the virtual 3D avatar answers. The voice input is a conventional technology in the field and will not be detailed here.

[0036] The core functional module 30 also includes a timbre switching component 35, a sound cloning component 37, and an OTA component 37. The TTS component has multiple preset TTS timbre libraries for the virtual 3D image model to call, and responds to a timbre switching instruction issued by the timbre switching component to switch to the corresponding timbre.

[0037] The Voice Cloning component clones the user's voice to generate a personalized voice for voice switching commands. Using the Voice Cloning component, users can customize their voice for use with their virtual 3D avatars. Voice data is stored locally, ensuring real-time access and low-latency playback.

[0038] The OTA module is used for system upgrades of portable storage devices.

[0039] The core functional modules in this application are written in the same programming language, such as C#, and developed using a unified technology stack. The same technology, programming language, framework or tool set is used to develop applications for different platforms, thereby achieving code reuse and reducing maintenance costs.

[0040] For the web front-end (PC), Window and macOS systems use the Electron or Angular framework, and for the mobile side, the Flutter or React Native framework is used.

[0041] Electro is an open-source framework developed by GitHub that allows developers to build cross-platform desktop applications using pure front-end technologies (HTML, CSS, and JavaScript). Electro combines the Chromium browser engine with Node.js. Applications developed are packaged in an environment that includes Chromium and Node.js, allowing them to run on any operating system that supports these components, including Windows and macOS.

[0042] Flutter is an open-source mobile application development framework launched by Google. Written in the Dart language, it provides developers with a comprehensive set of tools and libraries for building high-performance, high-fidelity mobile applications. At its core, Flutter is the concept of widgets, with all UI elements being widgets. Flutter comes with its own rendering engine (Skia), which allows it to directly draw UIs without relying on native components, allowing applications to run on both iOS and Android using the same code.

[0043] React Native is an open-source framework developed by Facebook that allows developers to build native mobile apps using JavaScript and React, mapping React components to native UI components to provide a near-native app experience. By abstracting a common API layer, React Native allows developers to share most of their code across iOS and Android.

[0044] An implementation example is as follows:

[0045] Use JavaScript and React to build UI application interface and logic.

[0046] Use the APIs and modules provided by React Native to interact with device features.

[0047] Configure the project to support iOS and Android platforms.

[0048] Generate application bundles appropriate for each platform using their respective build tools.

[0049] For mobile installation boot, different mobile device operating systems can use different boot methods.

[0050] (1) Designing a boot file, that is, a boot module is a boot file stored in the root directory of a portable storage device.

[0051] Store README.txt or START_HERE.html in the root directory of the portable storage device. After inserting the portable storage device, a guide message (such as a TXT / HTML / image file) will be displayed. Follow the instructions to install the app. For Android, the guide file can be opened automatically or manually after the portable storage device is inserted. For iOS, you need to manually open the "Files" app, use the "Files" app to open the guide file, and then follow the instructions to install the app.

[0052] (2) The boot file is a QR code.

[0053] The QR code can contain an app download link (App Store / Google Play or enterprise-signed installation package). For Android, after inserting a portable storage device, a "USB device connected" notification may pop up. Users can tap the notification to access the file manager, find the QR code image on the portable storage device, and scan it using the system camera or WeChat / Alipay to download or launch the app. For iOS, open the USB drive in the "Files" app, find the QR code image, long-press it, and select "Scan with Camera" to download or launch the app.

[0054] (3) Shortcut guide (Android only).

[0055] Create a shortcut in the root directory of the portable storage device, including an automatic jump link or APK installation package. After the user inserts the portable storage device, the "Select Open Method" dialog box pops up and the target application is launched directly.

[0056] Through the above design, even if the mobile terminal cannot automatically pop up the prompt, it can still efficiently guide the user to complete the startup process.

[0057] This application also provides a method for implementing intelligent question-answering interaction using a portable storage device, comprising the following steps:

[0058] Step 110: Obtain operating system information of the inserted display device.

[0059] Step 120 : performing initialization operations according to the operating system information of the display device, and automatically loading platform components and resources corresponding to the operating system.

[0060] Step 130 , in response to the question raised through the display device, the semantic matching engine is used to search the knowledge base to obtain the answer to the question, or the large language model API is called to obtain the answer to the question.

[0061] Step 140 : Convert the answer to the question into speech and play it through the virtual 3D image model in sync with the lip movements.

[0062] Based on the description of the above specific embodiments, the portable storage device capable of realizing intelligent question-answering interaction provided by the present invention has the following advantages over the prior art:

[0063] First, it performs initialization operations based on the operating system information of the display device, automatically loading the platform components and resources of the corresponding operating system, so that it can automatically adapt and run when plugged into a display device with any operating system. It also combines virtual 3D images with a built-in company promotional material knowledge base to achieve immersive corporate image display and intelligent question-and-answer interaction based on semantic understanding, surpassing traditional static promotion, attracting user attention, improving the interactivity of promotion and the accuracy of information, and increasing user satisfaction and consultation efficiency.

[0064] Second, multi-platform compatibility ensures wider user coverage and improves promotion effectiveness.

[0065] Third, platform adaptation ensures a smooth and consistent user experience on different devices and enhances user stickiness.

[0066] Fourth, it adopts a portable structure similar to a USB flash drive, which is convenient to carry and give as a gift. It is plug-and-play and runs automatically, without the need for complicated installation procedures, and is easy to use.

[0067] Finally, it should be noted that the terms "comprise," "include," or any other variations thereof, as used herein, are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0068] The present invention is not limited to the above-mentioned optimal implementation mode. Anyone should be aware that any structural changes made under the inspiration of the present invention, and any technical solutions that are the same or similar to the present invention, fall within the scope of protection of the present invention.

Claims

1. A portable storage device capable of realizing intelligent question-answering interaction, which is used to be connected to a display device via a USB interface and realize intelligent question-answering interaction through the display device, characterized in that: The portable storage device capable of realizing intelligent question-answering interaction includes: An acquisition module, used to obtain operating system information of the inserted display device; The initialization module is used to perform initialization operations based on the operating system information of the display device and automatically load the platform components and resources of the corresponding operating system; The core functional modules include a virtual 3D image model, a semantic matching engine, a TTS component, and an AI question-and-answer component. The semantic matching engine connects to a cloud or local knowledge base. The AI ​​question-and-answer component responds to questions raised through the display device, uses the semantic matching engine to retrieve answers from the knowledge base, or calls a large language model API to obtain answers. The TTS component converts the answers to questions into speech and plays them lip-synced through the virtual 3D image model.

2. The portable storage device capable of realizing intelligent question-answering interaction according to claim 1, characterized in that: The TTS component presets multiple sets of TTS timbre libraries for the virtual 3D image model to call, and switches to the corresponding timbre in response to the timbre switching instruction issued by the timbre switching component.

3. The portable storage device capable of realizing intelligent question-answering interaction according to claim 2, characterized in that: The core functional module also includes a voice cloning component for cloning and generating personalized voice for selection of timbre switching instructions.

4. The portable storage device capable of realizing intelligent question-answering interaction according to claim 1, characterized in that: The virtual 3D image model is built based on Unity3D rendering and released on a multi-platform basis so that it can be used on Windows, macOS, iOS and Android system platforms.

5. The portable storage device capable of realizing intelligent question-answering interaction according to claim 1, characterized in that: It also includes a boot module for guiding the installation of the acquisition module, the initialization module and the core function module.

6. The portable storage device capable of realizing intelligent question-answering interaction according to claim 5, characterized in that: The boot module is a boot file stored in the root directory of the portable storage device and is used to display installation boot information.

7. The portable storage device capable of realizing intelligent question-answering interaction according to claim 6, characterized in that: The boot file is a QR code.

8. The portable storage device capable of realizing intelligent question-answering interaction according to claim 5, characterized in that: The boot file includes an automatic jump link or an APK installation package.

9. The portable storage device capable of realizing intelligent question-answering interaction according to claim 1, characterized in that: The display device is a PC, smart TV, smart large screen or mobile terminal, and the operating system of the display device is Windows, macOS, iOS or Android.

10. The portable storage device capable of realizing intelligent question-answer interaction according to claim 1, characterized in that: Enter the question by presenting the device's physical keyboard, virtual keyboard, or by voice.

Images