Intelligent photo album system based on artificial intelligence technology and interaction method

By integrating a large language model system into the intelligent album system, the intelligent Q&A interaction between user voice and device is achieved, and the problem of single functions of the existing intelligent album system is solved, improving the user experience and intelligent application scenarios of the device.

CN118964650APending Publication Date: 2024-11-15YANXI DIGITAL TECHNOLOGY (WUXI) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411037692.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The existing smart photo album system has a single function and limited user experience, which cannot provide an interactive and intelligent experience. Especially with the development of dialogue capabilities of large language models, users' demand for smart devices has exceeded basic photo display and video playback.

Method used

Design an intelligent album system based on artificial intelligence technology, collect user voice through the intelligent album terminal and interact with the large language model server, generate reply text and visual display and voice broadcast to realize intelligent question-and-answer function.

Benefits of technology

It improves the user experience and provides more intelligent application scenarios, making the smart album equipment equipped with intelligent Q&A interactive functions, and enhances the convenience of the device and information consultation capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118964650A_ABST
    Figure CN118964650A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent photo album system and an interaction method based on an artificial intelligence technology, and relates to the technical field of intelligent photo albums, the intelligent photo album system comprises an intelligent photo album terminal and a big language model server configured with a big language model system; the intelligent terminal photo album terminal is used for collecting user voice; the large language model server is used for receiving the user voice, analyzing the user voice by using a large language model system and generating a corresponding reply text; and the intelligent photo album terminal is further used for visually displaying the reply text and converting the reply text into voice for broadcasting. By integrating the large language model system, the intelligent question and answer interaction function between the user and the photo album device is achieved, the use experience of the user is improved, and the intelligent photo album device has more intelligent application scenes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of smart photo albums, and in particular to a smart photo album system and an interaction method based on artificial intelligence technology. Background Art

[0002] At present, the smart photo album systems on the market mainly support basic photo display and video playback functions, such as Figure 1 As shown, the functions are relatively simple and the user experience is limited. With the rapid development of artificial intelligence technology, especially the significant improvement of the conversation ability of large language models, users' demand for smart devices is no longer limited to basic display and playback functions, but they expect to get more interactive and intelligent experiences. Summary of the invention

[0003] In view of the defects in the prior art, the present invention provides an intelligent photo album system and interaction method based on artificial intelligence technology. The present invention can not only display photos and videos, but also communicate with a large language model through voice, thereby providing users with more convenient and intelligent information consultation and interactive experience.

[0004] On the one hand, the present invention provides a smart photo album system based on artificial intelligence technology, the system comprising a smart photo album terminal and a large language model server configured with a large language model system; the smart terminal photo album terminal is used to collect user voice and send the user voice to the large language model server; the large language model server is used to receive the user voice, use the large language model system to parse the user voice and generate corresponding reply text, and return the reply text to the smart photo album terminal; the smart photo album terminal is further used to visually display the reply text, and convert the reply text into voice for broadcasting.

[0005] Preferably, the smart album terminal includes a microphone, a display screen and a speaker; the microphone is used to collect user voice; the display screen is used to visually display conversation text, reply text, photos or videos; and the speaker is used to play reply text or audio.

[0006] Preferably, the smart album terminal device is installed with a smart album APP.

[0007] Preferably, a smart album server is also included, which is used to provide smart album services and smart question and answer services. The smart question and answer services include preprocessing the user voice sent by the smart album terminal or preprocessing the reply text returned by the large model server.

[0008] On the other hand, a smart album interaction method based on artificial intelligence technology includes:

[0009] Step 1: The smart terminal photo album terminal collects user voice;

[0010] Step 2: The large language model server receives the user voice, uses the large language model system to analyze the user voice and generates a corresponding reply text;

[0011] Step 3: The smart photo album terminal visually displays the reply text and converts the reply text into voice for broadcast.

[0012] Preferably, in step 1, the smart album terminal collecting the user voice includes: collecting the user voice through a microphone.

[0013] Preferably, in step 2, the large language model server receives the user voice including: receiving the user voice sent by the smart album terminal, and converting the user voice into dialogue text; or receiving the dialogue text obtained after the smart album terminal converts the user voice through the smart album APP.

[0014] Preferably, in step 3, the smart album terminal visually displays the reply text, and converts the reply text into voice for broadcasting, including: visually displaying the reply text through a display screen, and voice broadcasting the reply text through a speaker.

[0015] Preferably, in step 2, before the large language model server receives the user voice, it also includes: the smart album server receives the user voice, pre-processes the user voice, and after using the large language model system to parse the user voice and generate a corresponding reply text, it also includes: the smart album server receives the reply text, and pre-processes the reply text.

[0016] The beneficial effects of the present invention are embodied in that an intelligent photo album system based on artificial intelligence technology provided by an embodiment of the present invention realizes an intelligent question-and-answer interaction function between a user and a photo album device by integrating a large language model system, which not only improves the user experience, but also enables the intelligent photo album device to have more intelligent application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the specific embodiments or the description of the prior art. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn according to the actual scale.

[0018] Figure 1 It is a structural schematic diagram of a smart photo album system in the prior art;

[0019] Figure 2 A schematic diagram of the structure of an intelligent photo album system based on artificial intelligence technology provided by an embodiment of the present invention;

[0020] Figure 3 A schematic diagram of the structure of another smart photo album system based on artificial intelligence technology provided by an embodiment of the present invention;

[0021] Figure 4 An intelligent photo album interaction method based on artificial intelligence technology is provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] The following embodiments of the technical solution of the present invention are described in detail in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore only used as examples, and cannot be used to limit the protection scope of the present invention.

[0023] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application should have the common meanings understood by those skilled in the art to which the present invention belongs.

[0024] Example 1

[0025] like Figure 2 As shown, the present invention provides a smart album system based on artificial intelligence technology, the system comprising a smart album terminal and a large language model server configured with a large language model system; the smart terminal album terminal is used to collect user voice, and send the user voice to the large language model server; the large language model server is used to receive the user voice, use the large language model system to parse the user voice and generate a corresponding reply text, and return the reply text to the smart album terminal; the smart album terminal is further used to visually display the reply text, and convert the reply text into voice for broadcasting.

[0026] Specifically, the smart photo album terminal includes a microphone, a display screen and a speaker; the microphone is used to collect user voice; the display screen is used to visually display conversation text, reply text, photos or videos; and the speaker is used to play reply text or audio.

[0027] Specifically, the smart photo album terminal device is installed with a smart photo album APP.

[0028] It should be noted that the collected user voice can be processed locally through the smart album terminal to convert the user voice into dialogue text, or the collected user voice can be processed in the cloud through the large language model server to convert the user voice into dialogue text. The specific processing method of the user voice is not limited in the embodiments of the present invention.

[0029] The smart album system provided in the embodiment of the present invention consists of two main parts: a smart album terminal and a large language model server. The smart album terminal is equipped with hardware devices such as a microphone, a display and a speaker, and is also installed with a smart album APP, which integrates functions such as album management and voice interaction.

[0030] Example 2

[0031] like Figure 3 As shown, this embodiment is expanded on the basis of Embodiment 1, and a smart album server is added as a part of the system, further improving the functionality of the system and user experience.

[0032] In Example 2, the functions of the smart album terminal and the large language model server are basically the same as those described in Example 1. The smart album terminal is responsible for collecting voice, displaying information and playing audio, providing an intuitive interactive interface for users. The large language model server is responsible for parsing voice and generating reply text to achieve intelligent dialogue with users.

[0033] The difference is that in Example 2, the interaction between the smart album terminal and the large language model server is closer and more efficient. The smart album server is also configured with a large language model to improve the intelligent question and answer service, so as to achieve pre-processing of the user's voice request such as voice enhancement, noise elimination, etc. This helps to improve the accuracy of speech recognition and ensure that user instructions or questions are correctly parsed. Similarly, the reply text generated by the large language model server will also be pre-processed by the smart album server, such as text formatting, semantic optimization, etc., and then sent to the smart album terminal for display and broadcast, which helps to improve the clarity and accuracy of the reply text and makes it easier for users to understand.

[0034] It should be noted that the big language model configured in the smart album server is different from the big language model in the big language model system.

[0035] The embodiment of the present invention not only improves the accuracy of speech recognition and the clarity of reply text by adding an intelligent photo album server and configuring a large language model for preprocessing, but also reduces the computational burden of the large language model server and improves the response speed and efficiency of the overall system. At the same time, the intelligent photo album server, as an intermediate layer, realizes seamless switching when the large language model system is replaced, ensuring the continuity and stability of user services.

[0036] Example 3

[0037] like Figure 4 As shown, an embodiment of the present invention further provides an intelligent album interaction method based on artificial intelligence technology, the method comprising:

[0038] Step 1: The smart terminal photo album terminal collects user voice;

[0039] Step 2: The large language model server receives the user voice, uses the large language model system to analyze the user voice and generates a corresponding reply text;

[0040] Step 3: The smart photo album terminal visually displays the reply text and converts the reply text into voice for broadcast.

[0041] In the embodiment of the present invention, in step 1, the smart album terminal collecting the user voice includes: collecting the user voice through a microphone.

[0042] In an embodiment of the present invention, in step 2, the large language model server receives the user voice including: receiving the user voice sent by the smart album terminal and converting the user voice into dialogue text; or receiving the dialogue text obtained after the smart album terminal converts the user voice through the smart album APP.

[0043] In an embodiment of the present invention, in step 3, the smart photo album terminal visually displays the reply text, and converts the reply text into voice for broadcasting, including: visually displaying the reply text through a display screen, and voice broadcasting the reply text through a speaker.

[0044] In an embodiment of the present invention, in step 2, before the large language model server receives the user voice, it also includes: the smart photo album server receives the user voice, pre-processes the user voice, and uses the large language model system to parse the user voice and generate a corresponding reply text, and then it also includes: the smart photo album server receives the reply text and pre-processes the reply text.

[0045] It should be understood that the smart album interaction method based on artificial intelligence technology provided in the embodiment of the present invention and the smart album system based on artificial intelligence technology provided in the above embodiment are based on the same inventive concept. For more specific working principles of each step in the embodiment of the present invention, please refer to the above embodiment and will not be repeated in the embodiment of the present invention.

[0046] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention.

Claims

1. An intelligent photo album system based on artificial intelligence technology, characterized in that: It includes a smart photo album terminal and a large language model server equipped with a large language model system; the smart photo album terminal is used to collect user voice and send the user voice to the large language model server; the large language model server is used to receive the user voice, use the large language model system to parse the user voice and generate corresponding reply text, and return the reply text to the smart photo album terminal; the smart photo album terminal is further used to visually display the reply text, and convert the reply text into voice for broadcasting.

2. The intelligent photo album system based on artificial intelligence technology according to claim 1, characterized in that: The smart photo album terminal includes a microphone, a display screen and a speaker; the microphone is used to collect user voice; the display screen is used to visually display conversation text, reply text, photos or videos; and the speaker is used to play reply text or audio.

3. The intelligent photo album system based on artificial intelligence technology according to claim 1, characterized in that: The smart photo album terminal device is installed with a smart photo album APP.

4. The intelligent photo album system based on artificial intelligence technology according to claim 1, characterized in that: It also includes a smart album server, which is used to provide smart album services and smart question and answer services. The smart question and answer services include preprocessing the user voice sent by the smart album terminal or preprocessing the reply text returned by the large model server.

5. A smart album interaction method based on artificial intelligence technology, characterized in that: include: Step 1: The smart terminal photo album terminal collects user voice; Step 2: The large language model server receives the user voice, uses the large language model system to analyze the user voice and generates a corresponding reply text; Step 3: The smart photo album terminal visually displays the reply text and converts the reply text into voice for broadcast.

6. The intelligent album interaction method based on artificial intelligence technology according to claim 5, characterized in that: In step 1, the smart album terminal collects the user voice including: collecting the user voice through a microphone.

7. The intelligent album interaction method based on artificial intelligence technology according to claim 6 is characterized in that: In step 2, the large language model server receives the user voice including: receiving the user voice sent by the smart album terminal and converting the user voice into dialogue text; or receiving the dialogue text obtained after the smart album terminal converts the user voice through the smart album APP.

8. The intelligent album interaction method based on artificial intelligence technology according to claim 8 is characterized in that: In step 3, the smart album terminal visually displays the reply text, and converts the reply text into voice for broadcasting, including: visually displaying the reply text through a display screen, and voice broadcasting the reply text through a speaker.

9. The intelligent album interaction method based on artificial intelligence technology according to claim 1, characterized in that: In step 2, before the large language model server receives the user voice, it also includes: the smart photo album server receives the user voice, pre-processes the user voice, and uses the large language model system to parse the user voice and generate a corresponding reply text, and then it also includes: the smart photo album server receives the reply text and pre-processes the reply text.