Intelligent photo album system supporting voice on-demand video

Abstract

The invention discloses an intelligent photo album system supporting voice on-demand video, which comprises intelligent photo album terminal equipment, the intelligent photo album terminal equipment is in interactive connection with an intelligent photo album server or a video platform server, and the intelligent photo album server is in interactive connection with a large language model server or the video platform server. The large language model server is interactively connected with the video platform server; the large language model server is used for analyzing the voice input information of the user and transmitting the voice input information to the video platform server for corresponding video retrieval, and the language information can be converted into text information according to the language information input by the user; according to the method and the device, the corresponding video is retrieved in the video platform server through the large language model server, and the video is displayed through the intelligent photo album terminal equipment, so that the intelligence of video retrieval and playing is improved, and the user interaction experience is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent photo albums, and particularly relates to an intelligent photo album system that supports voice-on-demand video. Background Art

[0002] With the rapid development of the digital information era, the traditional ways of using paper and words to record, preserve memories and transmit information have gradually been replaced by pictures, videos and other means. The 5G era has further accelerated data transmission. Digital information is everywhere around us, within easy reach, and the information resources are increasing at an unprecedented speed. This has also brought some problems. Storage requires a large amount of disk space. All kinds of photos are scattered in everyone's mobile devices, computers or cloud disks and are constantly increasing. The time cost of viewing and organizing them is extremely high. For a family, how to better organize family members' photos so that everyone can find the right resources in this vast amount of pictures and quickly and efficiently produce a qualified and high-quality photo album set, and meet these needs anytime and anywhere has become increasingly important. Therefore, intelligent photo albums have emerged as the times require.

[0003] As disclosed in the invention with the publication number CN119052400A, an intelligent photo album system and an interaction method that support video calls. The system includes a mobile terminal, a server and an intelligent photo album terminal. The server is used for: receiving a video call request initiated by the mobile terminal or the intelligent photo album terminal; establishing a data transmission channel between the mobile terminal and the intelligent photo album terminal; and transmitting audio and video information based on the data transmission channel. Implementing the technical solution provided by the embodiments of the present invention provides an intelligent photo album that supports video calls. The applicable scenarios are: Scenario 1: Parents do not allow children to use mobile phones, but there is a call need between parents and children. Then, the intelligent photo album that supports video calls provided by this embodiment can be used to solve the problem; Scenario 2: Elderly people are not proficient in using smart phones and may lose their mobile phones. The intelligent photo album is a fixed device with a large screen. The intelligent photo album of this embodiment can not only meet the video call needs of the elderly, but also is convenient to operate.

[0004] Although the above technical solution can make video calls, it cannot search for video information corresponding to the user's voice instructions and play the corresponding videos according to the user's voice instructions. The overall degree of intelligence is not high, which affects the user experience. Therefore, we propose an intelligent photo album system that supports voice-on-demand video. Summary of the Invention

[0005] The purpose of the present invention is to provide an intelligent photo album system that supports voice-on-demand video, so as to solve the problems in the prior art in the above background art that it cannot search for video information corresponding to the user's voice instructions, play the corresponding videos, the overall degree of intelligence is not high, and it affects the user experience.

[0006] To achieve the above object, the present invention provides the following technical solution: An intelligent photo album system supporting voice-on-demand video, including an intelligent photo album terminal device, the intelligent photo album terminal device is interactively connected with an intelligent photo album server or a video platform server, the intelligent photo album server is interactively connected with a large language model server or a video platform server, and the large language model server is interactively connected with the video platform server;

[0007] The large language model server is used to analyze the user voice input information and transmit it to the video platform server for corresponding video retrieval.

[0008] Preferably, the intelligent photo album terminal device includes a microphone, and the microphone is interactively connected with the intelligent photo album APP module.

[0009] Preferably, the intelligent photo album APP module is interactively connected with a speaker and a display screen, and the speaker and the display screen are arranged in the intelligent photo album terminal device.

[0010] Preferably, the intelligent photo album APP module is also interactively connected with an intelligent question answering module or a video platform system, the intelligent question answering module is arranged in the intelligent photo album server, and the video platform system is arranged in the video platform server.

[0011] Preferably, the intelligent question answering module is interactively connected with a large language model system or a video platform system, and the large language model system is arranged in the large language model server.

[0012] Preferably, the large language model server is also interactively connected with the video platform system.

[0013] Preferably, the microphone is used to collect user language input information.

[0014] Preferably, the display screen is used to display the dialogue text information generated by converting the user language and play the retrieved video picture.

[0015] Preferably, the speaker is used to play the sound in the retrieved video.

[0016] Compared with the prior art, the beneficial effect of the present invention is:

[0017] The present invention can convert the language information into text information according to the user input language information, then retrieve the corresponding video in the video platform server through the large language model server, and then display the video through the intelligent photo album terminal device, improving the intelligence of video retrieval and playback and enhancing the user interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1Schematic diagram of the overall framework of Embodiment 1 of the present invention;

[0019] Figure 2 Schematic diagram of the overall framework of Embodiment 2 of the present invention;

[0020] Figure 3 Schematic diagram of the overall framework of Embodiment 3 of the present invention;

[0021] Figure 4 Schematic diagram of the overall framework of Embodiment 4 of the present invention. Detailed implementation manners

[0022] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0023] Embodiment 1

[0024] Please refer to Figure 1 , the present invention provides a technical solution: an intelligent photo album system supporting voice-on-demand video, including an intelligent photo album terminal device, the intelligent photo album terminal device is interactively connected with an intelligent photo album server, the intelligent photo album server is interactively connected with a large language model server, and the large language model server is interactively connected with a video platform server; the large language model server is used to analyze the user voice input information and transmit it to the video platform server for corresponding video retrieval.

[0025] Specifically, the intelligent photo album terminal device includes a microphone, and the microphone is interactively connected with an intelligent photo album APP module; the intelligent photo album APP module is interactively connected with a speaker and a display screen, and the speaker and the display screen are arranged in the intelligent photo album terminal device; the intelligent photo album APP module is also interactively connected with an intelligent question answering module, the intelligent question answering module is arranged in the intelligent photo album server, the intelligent question answering module is interactively connected with a large language model system, and the large language model system is arranged in the large language model server; the large language model server is also interactively connected with a video platform system.

[0026] Furthermore, the microphone is used to collect user language input information.

[0027] Furthermore, the display screen is used to display the dialogue text information generated by converting the user language and play the retrieved video picture.

[0028] Furthermore, the speaker is used to play the sound in the retrieved video.

[0029] The specific usage steps of this embodiment are as follows:

[0030] Step 1: The microphone collects the user's voice information and transmits the voice information to the intelligent photo album APP module;

[0031] Step 2: The intelligent photo album APP module converts the voice information into dialogue text and displays the dialogue text generated by the conversion of the user's voice through the display screen;

[0032] Step 3: The intelligent photo album APP module sends the converted dialogue text to the intelligent question - answering module in the intelligent photo album server through the wireless network;

[0033] Step 4: The intelligent question - answering module sends the user's dialogue text to the large - language model system in the large - language model server through the wireless network;

[0034] Step 5: The large - language model system retrieves in the video platform system in the video platform server according to the video to be played as required by the user;

[0035] Step 6: The video platform system transmits the retrieved video information to the large - language model system;

[0036] Step 7: The large - language model system transmits the retrieved video information to the intelligent photo album server;

[0037] Step 8: The intelligent photo album server transmits the retrieved video information to the intelligent photo album terminal device;

[0038] Step 9: Play the retrieved video picture through the display screen;

[0039] Step 10: Play the sound in the retrieved video through the speaker.

[0040] Embodiment Two

[0041] Please refer to Figure 2 , an intelligent photo album system supporting voice - on - demand video, including an intelligent photo album terminal device, the intelligent photo album terminal device is interactively connected with an intelligent photo album server, and the intelligent photo album server is interactively connected with a video platform server.

[0042] Specifically, the intelligent photo album terminal device includes a microphone, the microphone is interactively connected with the intelligent photo album APP module; the intelligent photo album APP module is interactively connected with a speaker and a display screen, the speaker and the display screen are arranged in the intelligent photo album terminal device; the intelligent photo album APP module is also interactively connected with an intelligent question - answering module, the intelligent question - answering module is arranged in the intelligent photo album server, and the intelligent question - answering module is interactively connected with the video platform system.

[0043] The specific usage method of this embodiment is as follows:

[0044] Step 1: The microphone collects the user's voice information and transmits the voice information to the intelligent album APP module;

[0045] Step 2: The intelligent album APP module converts the voice information into a dialogue text and displays the dialogue text generated from the user's voice through the display screen;

[0046] Step 3: The intelligent album APP module sends the converted dialogue text to the intelligent question - answering module in the intelligent album server through the wireless network;

[0047] Step 4: The intelligent question - answering module sends the user's video retrieval instruction to the video platform system in the video platform server through the wireless network, and the video platform system retrieves according to the user's video retrieval instruction;

[0048] Step 5: The video platform system transmits the retrieved video information to the intelligent album server;

[0049] Step 6: The intelligent album server transmits the retrieved video information to the intelligent album terminal device;

[0050] Step 7: Play the retrieved video picture through the display screen;

[0051] Step 8: Play the sound in the retrieved video through the speaker.

[0052] Embodiment Three

[0053] Please refer to Figure 3 , an intelligent album system supporting voice - on - demand video, including an intelligent album terminal device, and the intelligent album terminal device is interactively connected with the video platform server.

[0054] Specifically, the intelligent album terminal device includes a microphone, and the microphone is interactively connected with the intelligent album APP module; the intelligent album APP module is interactively connected with the speaker and the display screen, and the speaker and the display screen are arranged in the intelligent album terminal device; the intelligent album APP module is also interactively connected with the video platform system.

[0055] The specific usage method of this embodiment is as follows:

[0056] Step 1: The microphone collects the user's voice information and transmits the voice information to the intelligent album APP module;

[0057] Step 2: The intelligent album APP module converts the voice information into a dialogue text and displays the dialogue text generated from the user's voice through the display screen;

[0058] Step 3: The smart album APP module parses the conversation text, extracts the user video retrieval instruction, sends the user video retrieval instruction to the video platform system in the video platform server via a wireless network, and performs retrieval in the video platform system in the video platform server;

[0059] Step 4: The video platform system transmits the retrieved video information to the smart album terminal device;

[0060] Step 5: Play the retrieved video screen through the display screen;

[0061] Step 6: Play the sound in the retrieved video through the speaker.

[0062] Embodiment 4

[0063] See also Figure 4 A smart album system supporting voice-on-demand video includes a smart album terminal device, the smart album terminal device includes a microphone, the microphone is interactively connected with a smart album APP module; the smart album APP module is interactively connected with a display screen, and the display screen is set in the smart album terminal device; the smart album APP module is also interactively connected with a video APP, and the video APP is interactively connected with a speaker and a display screen.

[0064] The specific usage method of this embodiment is as follows:

[0065] Step 1: The microphone collects user voice information and transmits the voice information to the smart album APP module;

[0066] Step 2: The smart photo album APP module converts the voice information into dialogue text, and displays the dialogue text converted from the user's voice on the display screen;

[0067] Step 3: After the smart album APP module analyzes the user's voice command, it calls the video APP to play the specified video;

[0068] Step 4: Play the retrieved video screen through the display screen;

[0069] Step 5: Play the sound in the retrieved video through the speaker.

[0070] In summary:

[0071] The present invention can convert language information into text information according to the language information input by the user, then search for the corresponding video in the video platform server through the large language model server, and then display the video through the smart album terminal device, thereby improving the intelligence of video retrieval and playback and improving the user interaction experience.

[0072] Although embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present invention, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An intelligent photo album system supporting voice-on-demand video, characterized in that: It includes an intelligent photo album terminal device, which is interactively connected to an intelligent photo album server or a video platform server. The intelligent photo album server is interactively connected to a large language model server or a video platform server. The large language model server is interactively connected to the video platform server; The large language model server is used to analyze the user voice input information and transmit it to the video platform server for corresponding video retrieval.

2. The intelligent photo album system for supporting voice-on-demand video according to claim 1, characterized in that: The intelligent photo album terminal device includes a microphone, and the microphone is interactively connected to the intelligent photo album APP module.

3. The intelligent photo album system for supporting voice-on-demand video according to claim 2, characterized in that: The intelligent photo album APP module is interactively connected to a speaker and a display screen, and the speaker and the display screen are arranged in the intelligent photo album terminal device.

4. An intelligent photo album system supporting voice-on-demand video according to claim 3, characterized in that: The intelligent photo album APP module is also interactively connected to an intelligent question-answering module or a video platform system. The intelligent question-answering module is arranged in the intelligent photo album server, and the video platform system is arranged in the video platform server.

5. An intelligent photo album system supporting voice-on-demand video according to claim 4, characterized in that: The intelligent question-answering module is interactively connected to a large language model system or a video platform system, and the large language model system is arranged in the large language model server.

6. The intelligent photo album system for supporting voice-on-demand video according to claim 5, wherein: The large language model server is also interactively connected to the video platform system.

7. The intelligent photo album system for supporting voice-on-demand video according to claim 2, characterized in that: The microphone is used to collect user language input information.

8. The intelligent photo album system for supporting voice-on-demand video according to claim 3, wherein: The display screen is used to display the dialogue text information generated by the conversion of the user language and play the retrieved video picture.

9. The intelligent photo album system supporting voice-on-demand video according to claim 3, characterized in that: The speaker is used to play the sound in the retrieved video.

Images