Cultural relic souvenir interaction method and device, storage medium and electronic equipment

Abstract

The application provides an artifact souvenir interaction method and device, a storage medium and electronic equipment, the method comprises the following steps: S1, detecting and capturing the face image of the user; S2, feature extraction is carried out on the captured face image; S3, the feature of the selected artifact is extracted; S4, the face feature and the artifact feature are fused; S5, according to the fusion result, the fusion image with face and artifact features is generated; S6, the generated fusion image is personalized adjusted and optimized; S7, the fusion image is outputted.The application collects a large amount of artifact images, artistic works and portrait data, etc., which are used for training AI drawing model. Key features are extracted from the data, and the model is trained using deep learning algorithm, and personalized drawing works are generated according to the photo of the user and the selected artifact artistic style.

Description

Technical Field

[0001] This invention belongs to the field of AI virtual reality technology, specifically relating to interactive methods, devices, storage media, and electronic devices for preserving cultural relics. Background Technology

[0002] Museum visitor souvenir services have always been an important factor in increasing user engagement and enhancing the user's cultural experience. However, the current museum souvenir market is almost entirely untapped, with many overlooked user pain points: when visiting museums, visitors expect to leave unique memories of interacting with cultural relics, but traditional services struggle to meet this need; traditional museum visitor souvenir services are basically limited to souvenirs, lacking novel and unique forms of commemoration; traditional souvenirs lack personalization, have limited choices, and low practicality, and the museum environment cannot satisfy the need for people to "take photos" with cultural relics.

[0003] Publication No. CN109118591A discloses a cloud-based system and method for cultural relic recognition and interaction based on augmented reality (AR) technology. The system includes an AR scene module, a cultural relic feature extraction module, a cultural relic recognition module, a feature matching module, a model control module, a cultural relic model module, and a model feedback module. The AR scene module provides the user with a realistic surrounding scene by utilizing the phone's camera function. The cultural relic feature extraction module takes a frontal photo of the cultural relic using a camera, uploads it to the cloud, extracts feature points from the photo, and performs dimensionality reduction to obtain feature data. The cultural relic recognition module takes a photo of the current scene every second using the phone's camera, uploads it to the cloud, performs feature extraction and dimensionality reduction, and then performs feature matching with the feature data stored in the cloud. The cultural relic model module adjusts the size of the cultural relic model to match the size of the real cultural relic model, ensuring a good user experience. This application discloses a method for cultural relic feature extraction, but it cannot be integrated with tourism souvenir photography.

[0004] Publication No. CN2901726Y discloses a virtual tourism device that allows people to experience scenery from various places without leaving home, and can also synthesize photos of people visiting different landscapes as souvenirs. The virtual tourism device provided by this utility model allows users to input their photos or images into the storage module of an image synthesizer via an input device. The synthesis module of the image synthesizer then performs real-time keying, processing, and synthesis of the user's photos or images with real-world images or scenes of the selected scenery, outputting the results to an output module, which then outputs them through an output device. Simultaneously, when the user has not specified a destination, the synthesis module will display various real-world images or scenes of different landscapes through the output device for the user to preview and select, giving the user the feeling of being there while traveling. This application can achieve image keying and synthesis of landscapes to create a virtual reality scenario, but it cannot generate various personalized photos.

[0005] This application empowers the traditional cultural and creative market with AI, enabling tourists to gain a deeper understanding of the history and culture behind cultural relics (dynastic relics, clothing styles, and costume characteristics), meeting tourists' three major needs: personalization, lasting memories, and the ability to take them away. It forms a closed loop of customized cultural and creative experiences for museums, allowing more people to encounter, appreciate, and fall in love with cultural relics. Summary of the Invention

[0006] The technical problem to be solved by the present invention is to provide a method, device, storage medium and electronic device for commemorating cultural relics, in order to address the shortcomings of the prior art.

[0007] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows:

[0008] A method for interactive commemorative use of cultural relics is provided, comprising the following steps: S1, detecting and capturing the user's facial image; S2, extracting features from the captured facial image; S3, extracting features from the selected cultural relic; S4, fusing the facial features and cultural relic features; S5, generating a fused image with facial and cultural relic features based on the fusion result; S6, making personalized adjustments and optimizations to the generated fused image; S7, outputting the fused image.

[0009] Preferably, step S5 further includes: extracting the artifact patterns and brief descriptions of the selected artifacts based on the fused image data, and generating a fused image using an AI drawing model.

[0010] Preferably, step S4 further includes: combining the user's facial features with the features of the cultural relic to generate a unique outfit with the features of the cultural relic; and generating clothing with the features of the cultural relic and matching the dynasty of the cultural relic, so as to provide the user with a personalized commemorative photo experience.

[0011] Preferably, the method for constructing the AI ​​painting model includes: S11, collecting image data and images of cultural relics; S12, extracting key features from the collected image data and images of cultural relics; and S13, training the AI ​​painting model using the extracted key features.

[0012] Preferably, step S5 further includes: selecting different colors, brushstrokes, and textures, adding museum logos and descriptions of the cultural relics, and adjusting and customizing the generated fused image.

[0013] A cultural relic commemorative interactive device is also provided for executing the cultural relic commemorative interactive method, comprising: an AI control module, an image acquisition module, a wireless communication module, a display module, and a power module; the AI ​​control module, image acquisition module, wireless communication module, and display module are respectively connected to the power module via wires; the wireless communication module is connected between the image acquisition module and the AI ​​control module via a cable; wherein, the image acquisition module is used to detect and capture the user's facial image in step S1, and is also used to extract features from the captured facial image and extract cultural relic features in step S2; the AI ​​control module is an artificial intelligence control module, used to control the acquisition module to perform data acquisition and processing, and to fuse, adjust, and optimize the features acquired in step S6; the wireless communication module is used for wireless communication between the AI ​​control module and the image acquisition module; the display module is used to display the fused image and interactive operations in step S7; and the power module is used to provide power to each module.

[0014] Preferably, the AI ​​control module is also used to generate personalized dress-up styles and character makeup and hair based on user input and preset cultural relic art styles.

[0015] A computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements any one of the methods for interactive preservation of cultural relics.

[0016] An electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the aforementioned interactive method for commemorating cultural relics.

[0017] The current museum souvenir market is almost entirely untapped, with numerous overlooked user pain points: visitors expect to create unique memories of interacting with artifacts while touring museums, but traditional services struggle to meet this need; extracting artifact features during photo opportunities is very difficult. While CN109118591A discloses a cloud-based artifact recognition and interaction system and method based on augmented reality technology, the system includes an augmented reality scene module, an artifact feature extraction module, an artifact recognition module, a feature matching module, a model control module, an artifact model module, and a model feedback module, it can accurately extract artifact features, but it cannot perform secondary processing of those features, nor can it create personalized photos with people.

[0018] Publication number CN2901726Y discloses a virtual tourism device that allows people to experience scenery from various places without leaving home, and can also synthesize photos of people visiting different scenic spots as souvenirs. The virtual tourism device provided by this utility model inputs the user's photos or images into the storage module of an image synthesizer via an input device. The image synthesizer's synthesis module then performs real-time image matting of the user's photos or images with real-world images or scenes of the selected scenery. While it can synthesize scenic photos with tourist images, it cannot meet the personalized and interactive needs of tourists.

[0019] Moreover, in the field of photography where AI technology is prevalent, personalization and virtual-real interaction have become the most demanded directions in the market. Simple feature extraction and image synthesis can no longer meet the actual needs of tourists.

[0020] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0021] This invention addresses the generation of personalized souvenirs featuring portraits and designated cultural relics in cultural tourism settings. It collects a large amount of data, including images of cultural relics, artworks, and portraits, to train an AI painting model. Key features are extracted from the data, and a deep learning algorithm is used to train the model, enabling it to generate paintings with the artistic style of the cultural relics based on the input features and parameters. Personalized paintings are generated based on the user's photo and selected artistic style. Users can further adjust and customize the generated paintings within a mini-program, such as adjusting colors, brushstrokes, and textures, thus fulfilling their personalized needs.

[0022] AI-powered art creation tools are characterized by their ability to quickly generate artworks, providing creative inspiration and improving efficiency. Image fusion technology can combine different image elements to create entirely new images or visual effects. The advantage of image synthesis technology lies in its ability to create realistic composite images, enabling the construction of creative and virtual scenes. Facial recognition technology is characterized by its high accuracy, rapid recognition, and contactless operation.

[0023] Meanwhile, the AI ​​painting technology module can generate personalized dress-up styles and character makeup based on user input and preset art styles of cultural relics, providing users with a unique commemorative experience. Furthermore, the specific implementation methods may vary depending on the technologies and algorithms used, further realizing the personalization and interactive needs of customers. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 : Schematic diagram of the interactive method for commemorating cultural relics in this invention;

[0026] Figure 2 : Schematic diagram of the cultural relic commemorative interactive device of the present invention. Detailed Implementation

[0027] To better understand the present invention, the following embodiments further illustrate the content of the invention, but the scope of protection of the present invention is not limited to the following embodiments. Numerous specific details are set forth in the following description to provide a more thorough understanding of the invention. However, it will be apparent to those skilled in the art that the present invention can be practiced without one or more of these details.

[0028] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0029] Example 1: This application provides an interactive method for commemorating cultural relics, specifically as follows: Figure 1 As shown, it includes the following steps:

[0030] S1, Face Detection and Capture: Using a camera or other image acquisition device, detect and capture the user's face image.

[0031] S2, Feature Extraction: Extract features from the captured face images, such as key point detection and facial expression analysis.

[0032] S3, Cultural Relics Feature Extraction: At the same time, the system will also extract the features of the selected cultural relics, such as shape, color, texture, etc.

[0033] S4, Fusion Algorithm: This algorithm combines facial features and artifact features. This can be achieved through image processing techniques or deep learning algorithms.

[0034] S5, Generate fused image: Based on the fusion result, generate a fused image with facial and artifact features.

[0035] S6, Adjustment and Optimization: Users can adjust and optimize the generated fused image according to their personal preferences, such as the realism of faces, brightness, contrast, saturation, etc.

[0036] S7, Output and Display: The final merged image can be output through a display screen or printing device and displayed to the user.

[0037] Furthermore, step S5 also includes: using an AI painting model to generate a fused image, uploading the image data generated by the hardware, extracting the pattern parts and a concise introduction of the cultural relic based on the portrait, the content of which may include other meaningful content such as cultural relic stickers, and generating cultural and creative products in various formats, which can realize personalized customization of cultural and creative products by users.

[0038] Furthermore, this includes the implementation of face fusion technology, which combines a user's facial features with those of a cultural relic to generate unique attire featuring the relic's characteristics. Based on the dynasty in which the relic dates, it can also generate period-appropriate clothing featuring the same relic's features, providing users with a personalized commemorative photo experience. The specific implementation methods may vary depending on the technology and algorithms used. At the same time, to ensure user privacy and security, appropriate data protection measures must be taken when using face fusion technology.

[0039] Furthermore, the method for constructing the AI ​​painting model includes:

[0040] S11, Data Acquisition: Collect a large amount of image data, including various cultural relics, works of art, portraits, etc., for training AI painting models.

[0041] S12, Feature Extraction: Using image processing techniques, key features such as color, shape, and texture are extracted from the collected data.

[0042] S13, Model Training: Using deep learning algorithms, train the AI ​​painting model. During training, the model learns how to generate artistic portraits with the style of cultural relics based on the input features and parameters.

[0043] When a user takes a photo or selects a facial image at the interactive photo booth, the system extracts relevant features and inputs them into a trained AI painting model. The model then generates a personalized portrait based on the input features and a preset artistic style of the cultural relic.

[0044] Step S5 further includes: users can further adjust and customize the generated photos in the personalized cultural and creative customization mini-program according to their own preferences and needs. Preferably, different colors, brushstrokes, textures, etc., can be selected, and museum logos and cultural relic introductions can be added to achieve more personalized commemorative photos that suit individual preferences.

[0045] Furthermore, the AI ​​painting technology module can generate personalized dress-up styles and character makeup based on user input and preset cultural relic art styles, providing users with a unique commemorative experience.

[0046] This invention addresses the generation of personalized souvenirs featuring portraits and designated cultural relics in cultural tourism settings. It collects a large amount of data, including images of cultural relics, artworks, and portraits, to train an AI painting model. Key features are extracted from the data, and a deep learning algorithm is used to train the model, enabling it to generate paintings with the artistic style of the cultural relics based on the input features and parameters. Personalized paintings are generated based on the user's photo and selected artistic style. Users can further adjust and customize the generated paintings within a mini-program, such as adjusting colors, brushstrokes, and textures, thus fulfilling their personalized needs.

[0047] AI-powered art creation tools are characterized by their ability to quickly generate artworks, providing creative inspiration and improving efficiency. Image fusion technology can combine different image elements to create entirely new images or visual effects. The advantage of image synthesis technology lies in its ability to create realistic composite images, enabling the construction of creative and virtual scenes. Facial recognition technology is characterized by its high accuracy, rapid recognition, and contactless operation.

[0048] Meanwhile, the AI ​​painting technology module can generate personalized dress-up styles and character makeup based on user input and preset art styles of cultural relics, providing users with a unique commemorative experience. Furthermore, the specific implementation methods may vary depending on the technologies and algorithms used, further realizing the personalization and interactive needs of customers.

[0049] Example 2: Based on the same inventive concept as Example 1 above, a cultural relic commemorative interactive device is provided for executing the method of Example 1, such as... Figure 2 As shown, it includes: an AI control module, an image acquisition module, a wireless communication module, a display module, and a power supply module. The AI ​​control module, image acquisition module, wireless communication module, and display module are respectively connected to the power supply module via wires. The wireless communication module is connected between the image acquisition module and the AI ​​control module via a cable. The AI ​​control module is an artificial intelligence control module used to control the acquisition module to perform data acquisition and processing.

[0050] The image acquisition module is used to detect and capture the user's face image in step S1, and is also used to extract features from the captured face image and extract cultural relic features in step S2.

[0051] The AI ​​control module is an artificial intelligence control module used to control the acquisition module to acquire and process data, and to fuse, adjust and optimize the features acquired in step S6.

[0052] The wireless communication module is used for wireless communication between the AI ​​control module and the image acquisition module;

[0053] The display module is used to display the fused image and interactive operations in step S7;

[0054] The personalized commemorative interactive device adopts a flexible and scalable hardware and software architecture. This allows for the rapid integration of new technologies and functions into the device, enabling flexibility in technology iteration and upgrades. The physical photography screen is set in a specific area of ​​the museum, and its size and shape can be adjusted according to actual needs. The physical photography screen includes a display screen and operation buttons. The display screen is used to display background information of the cultural relics and the generated fused image, while the operation buttons are used to control the display content and operation mode of the display screen. The image acquisition device is set near the physical photography screen to capture the user's facial image. The image acquisition device can be a camera, etc., and the captured facial image can be transmitted to the physical photography screen via wired or wireless means.

[0055] This device provides a personalized experience for visitors to remember cultural relics, using AI technology and a user-centric approach, thereby strengthening the emotional bond between visitors and the relics. Through interactive experiences, it popularizes knowledge about cultural relics and enhances public awareness of cultural relic protection. It also meets the needs of modern consumers for personalized experiences, allowing visitors to freely choose cultural relics and design styles.

[0056] Example 3: The present invention also provides an electronic device for a method of interactive commemorative preservation of cultural relics. The electronic device includes a memory, at least one processor, a computer program stored in the memory and executable on the at least one processor, and at least one communication bus. The memory can be used to store the computer program, and the processor implements the steps of the method of interactive commemorative preservation of cultural relics in Example 1 by running or executing the computer program stored in the memory and calling data stored in the memory.

[0057] Preferably, the electronic device is a server. The system needs to build a suitable server in the cloud and deploy the corresponding applications. The server needs to support functions such as multi-user access, data storage, and real-time control.

[0058] Data processing and control: The data processing and control program runs on the server. Through data analysis and algorithm processing, it analyzes the data collected by the sensors and issues control commands based on the analysis results to achieve remote control.

[0059] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The solutions in the embodiments of this application can be implemented in various computer languages, such as the object-oriented programming language Java and the interpreted scripting language JavaScript.

[0060] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0061] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0062] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0063] Furthermore, those skilled in the art should understand that although many problems exist in the prior art, each embodiment or technical solution of the present invention can be improved in only one or a few aspects, without necessarily solving all the technical problems listed in the prior art or the background art simultaneously. Those skilled in the art should understand that any content not mentioned in a claim should not be construed as a limitation on that claim.

[0064] Finally, it should be noted that the above embodiments are only used to illustrate preferred embodiments of the present invention and are not intended to limit it. Any other modifications or equivalent substitutions made by those skilled in the art to the technical solutions of the present invention, as long as they do not depart from the spirit and scope of the technical solutions of the present invention, should be covered within the scope of the claims of the present invention.

Claims

1. A method for interactive commemorative use of cultural relics, characterized in that: Includes the following steps: S1 detects and captures the user's face image; S2, feature extraction is performed on the captured face image; S3, Extract the features of the selected cultural relic; S4 integrates facial features and cultural relic features; S5. Based on the fusion result, generate a fused image with facial and cultural relic features; S6, personalizes and optimizes the generated fused image; S7 outputs the fused image.

2. The interactive method for commemorating cultural relics as described in claim 1, characterized in that: Step S5 further includes: extracting the patterns and descriptions of the selected cultural relics from the fused image data, and generating a fused image using an AI drawing model.

3. The interactive method for commemorating cultural relics as described in claim 2, characterized in that: Step S4 further includes: combining facial features with cultural relic features to generate an outfit with cultural relic features; and generating clothing with cultural relic features that matches the dynasty of the cultural relic, based on the dynasty in which the cultural relic is located.

4. The interactive method for commemorating cultural relics as described in claim 2, characterized in that: The method for constructing the AI ​​painting model includes: S11, collecting image data and images of cultural relics; S12, extract key features from the collected image data and images of cultural relics; S13, using the extracted key features to train an AI painting model.

5. The interactive method for commemorating cultural relics as described in claim 2, characterized in that: Step S5 further includes: selecting different colors, brushstrokes, and textures, adding museum logos and descriptions of the cultural relics, and adjusting and customizing the generated fused image.

6. A cultural relic commemorative interactive device, used to execute the cultural relic commemorative interactive method as described in any one of claims 1-5, characterized in that, include: The system comprises an AI control module, an image acquisition module, a wireless communication module, a display module, and a power supply module. The AI ​​control module, image acquisition module, wireless communication module, and display module are each connected to the power supply module via wires. The wireless communication module is connected between the image acquisition module and the AI ​​control module via a cable. The image acquisition module is used to detect and capture the user's face image in step S1, and is also used to extract features from the captured face image and extract cultural relic features in step S2. The AI ​​control module is an artificial intelligence control module used to control the acquisition module to acquire and process data, and to fuse, adjust and optimize the features acquired in step S6. The wireless communication module is used for wireless communication between the AI ​​control module and the image acquisition module; The display module is used to display the fused image and interactive operations in step S7; The power module is used to provide power to the device.

7. The interactive device for commemorating cultural relics as described in claim 6, characterized in that: The AI ​​control module is also used to generate personalized dress-up styles and character makeup and hair based on user input and preset cultural relic art styles.

8. A computer-readable storage medium storing a computer program that, when executed by a processor, implements an interactive method for commemorating cultural relics as described in any one of claims 1-5.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements an interactive method for commemorating cultural relics as described in any one of claims 1-5.

Images