Multi-mode musical instrument cultural relic display platform based on Chinese musical instruments

Abstract

The invention discloses a multi-mode musical instrument cultural relic display platform based on Chinese musical instruments, and the platform comprises an input end which comprises a musical instrument inquired by a motor, a question inputted to AI, and a two-dimensional code corresponding to the inputted musical instrument; the database engine and the four types of SQL are associated with input information of the input end, and the information of the input end is associated and retrieved in the database; all data related to the corresponding musical instruments are stored in the database; and the output end outputs all the musical instrument information associated with the information input by the input end in the database, so that the user experience is improved: a user can obtain the information more quickly and more conveniently, and the form of the information is richer and more interactive, thereby improving the overall user experience; the multi-modal information display and deep learning recommendation functions enable the learning and science popularization process to be more efficient and attractive.

Description

Technical Field

[0001] The present invention relates to the field of mini-program production, and in particular to a multimodal musical instrument cultural relic display platform based on Chinese musical instruments. Background Art

[0002] Most of the existing mini-programs on the market are mini-programs for visiting reservations and collection display of a certain museum, such as the Palace Museum, the National Museum, the China Silk Museum, etc. There is no mini-program specifically for Chinese musical instruments. For this reason, we proposed a multimodal musical instrument cultural relic display platform based on Chinese musical instruments. Summary of the invention

[0003] To solve the above problems, the present invention aims to solve the problems raised in the background technology.

[0004] The present invention provides a multi-modal musical instrument cultural relic display platform based on Chinese musical instruments, comprising:

[0005] An input end, the input end including the musical instrument queried by the motor, the question input to the AI, and the QR code corresponding to the input musical instrument;

[0006] A database engine and four types of SQL, wherein the database engine and the four types of SQL are associated with input information at the input end, and the input information is associated and retrieved in the database;

[0007] A database, in which all data related to the corresponding musical instrument are stored;

[0008] The output end outputs all the musical instrument information associated with the input information of the input end in the database.

[0009] Furthermore, the technical support of the platform includes mobile application development, QR code scanning technology, camera recognition technology, 3D model display technology, artificial intelligence, multimodal knowledge graph, text reading technology, multimedia information processing, database technology and user interface design.

[0010] Furthermore, the output modes of the output end include picture display, audio playback, text display, video display, and text reading.

[0011] Furthermore, the mobile application development: includes user interface design, front-end logic processing, and back-end service interaction;

[0012] The QR code scanning technology: users enter the mini program by scanning the QR code;

[0013] The photo recognition technology: uses a mobile phone camera to capture images of musical instruments, processes the images, including denoising, reducing the impact of light, etc., extracts key features from the images, performs target detection through the yolov5 model, identifies the corresponding musical instrument, and jumps to the corresponding page;

[0014] The three-dimensional model display: 3D modeling and rendering of musical instrument artifact models, and the display capability of 3D models embedded in the mini program;

[0015] The artificial intelligence (AI) function in the mini program relies on natural language processing and machine learning technology to achieve natural interaction with users;

[0016] The multimodal knowledge graph: combines text, images, audio, video and other media forms to construct a knowledge graph related to musical instruments, involving knowledge representation, knowledge reasoning and knowledge fusion technology;

[0017] The text reading technology: converts text information such as the literature records and characteristics of musical instruments into voice output;

[0018] The multimedia information processing: processing and displaying the audio and video data of musical instruments, involves the encoding, decoding, transmission and playback technology of multimedia data.

[0019] The database technology: The backend needs to store and manage a large amount of instrument data, including text, images, 3D models, audio and video;

[0020] The user interface design is to design an easy-to-use and attractive user interface to enhance the user interaction experience.

[0021] Furthermore, the database is a dynamic database, and the data in the database can be continuously updated.

[0022] The beneficial effects of the present invention are:

[0023] 1. Improve user experience: Users can obtain information more quickly and conveniently, and the information is in a richer and more interactive form, thereby improving the overall user experience.

[0024] 2. Enhance the educational and popular science effects: Multimodal information display and deep learning recommendation functions make the learning and popular science process more efficient and attractive, and help enhance the public's understanding and interest in national musical instruments.

[0025] 3. Personalized services: Personalized recommendations and human-computer dialogue systems provide users with more personalized services and meet the specific needs of different users.

[0026] 4. Promote cultural communication: The mini program of the present invention can be used as an effective tool for music education and cultural communication, and is helpful to inherit and promote the culture of national musical instruments. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a system diagram of the present invention;

[0028] Figure 2 It is a practical demonstration diagram of the present invention. DETAILED DESCRIPTION

[0029] The present invention is further described in detail below through specific embodiments in conjunction with the accompanying drawings.

[0030] A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments, including:

[0031] An input end, the input end including the musical instrument queried by the motor, the question input to the AI, and the QR code corresponding to the input musical instrument;

[0032] A database engine and four types of SQL, wherein the database engine and the four types of SQL are associated with input information at the input end, and the input information is associated and retrieved in the database;

[0033] A database, in which all data related to the corresponding musical instrument are stored;

[0034] The output end outputs all the musical instrument information associated with the input information of the input end in the database.

[0035] The platform's technical support includes mobile application development, QR code scanning technology, camera recognition technology, 3D model display technology, artificial intelligence, multimodal knowledge graphs, text reading technology, multimedia information processing, database technology and user interface design.

[0036] The output modes of the output end include picture display, audio playback, text display, video display, and text reading.

[0037] Mobile application development: As a lightweight mobile application, the development of this patent involves software development technology for mobile platforms, including user interface design, front-end logic processing, and back-end service interaction.

[0038] QR code scanning technology: Users enter the mini program by scanning the QR code, which involves QR code generation, recognition and decoding technology, and needs to ensure that the information in the QR code can be recognized quickly and accurately.

[0039] Photo recognition technology: Use the mobile phone camera to capture the image of the instrument and process the image, including denoising, reducing the impact of light, etc., extract key features from the image, perform target detection through the yolov5 model, identify the corresponding instrument and jump to the corresponding page.

[0040] 3D model display: Displaying musical instrument artifact models requires 3D modeling and rendering technology, as well as the ability to embed 3D models in mini-programs.

[0041] Artificial Intelligence (AI): The human-computer dialogue function in the mini program relies on natural language processing and machine learning technology to achieve natural interaction with users.

[0042] Multimodal knowledge graph: Combining multiple media forms such as text, images, audio, video, etc. to build a knowledge graph related to musical instruments, which involves knowledge representation, knowledge reasoning and knowledge fusion technologies.

[0043] Text-to-speech technology: Converting text information such as the literature records and characteristics of musical instruments into voice output requires text-to-speech technology.

[0044] Multimedia information processing: processing and displaying audio and video materials of musical instruments, involving the encoding, decoding, transmission and playback technology of multimedia data.

[0045] Database technology: The backend needs to store and manage a large amount of instrument data, including text, images, 3D models, audio and video, etc., which involves database design and management technology.

[0046] User interface design: Designing easy-to-use and attractive user interfaces to enhance user interaction experience requires UI design techniques.

[0047] The database is a dynamic database, and the data in the database can be continuously updated.

[0048] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments, characterized in that: include: An input end, the input end including the musical instrument queried by the motor, the question input to the AI, and the QR code corresponding to the input musical instrument; A database engine and four types of SQL, wherein the database engine and the four types of SQL are associated with input information at the input end, and the input information is associated and retrieved in the database; A database, in which all data related to the corresponding musical instrument are stored; The output end outputs all the musical instrument information associated with the input information of the input end in the database.

2. A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments according to claim 1, characterized in that: The platform's technical support includes mobile application development, QR code scanning technology, camera recognition technology, 3D model display technology, artificial intelligence, multimodal knowledge graphs, text reading technology, multimedia information processing, database technology and user interface design.

3. A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments according to claim 3, characterized in that: The output modes of the output end include picture display, audio playback, text display, video display, and text reading.

4. A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments according to claim 3, characterized in that: The mobile application development: includes user interface design, front-end logic processing, and back-end service interaction; The QR code scanning technology: users enter the mini program by scanning the QR code; The photo recognition technology: uses a mobile phone camera to capture images of musical instruments, processes the images, including denoising, reducing the impact of light, etc., extracts key features from the images, performs target detection through the yolov5 model, identifies the corresponding musical instrument, and jumps to the corresponding page; The three-dimensional model display: 3D modeling and rendering of musical instrument artifact models, and the display capability of 3D models embedded in the mini program; The artificial intelligence (AI) function in the mini program relies on natural language processing and machine learning technology to achieve natural interaction with users; The multimodal knowledge graph: combines multiple media forms such as text, images, audio, video, etc. to construct a knowledge graph related to musical instruments, involving knowledge representation, knowledge reasoning and knowledge fusion technology; The text reading technology: converts text information such as the literature records and characteristics of musical instruments into voice output; The multimedia information processing: processing and displaying the audio and video data of musical instruments, involves the encoding, decoding, transmission and playback technology of multimedia data. The database technology: The backend needs to store and manage a large amount of instrument data, including text, images, 3D models, audio and video; The user interface design is to design an easy-to-use and attractive user interface to enhance the user interaction experience.

5. A multi-modal musical instrument cultural relic display platform based on Chinese musical instruments according to claim 1, characterized in that: The database is a dynamic database, and the data in the database can be continuously updated.

Images