Artistic design system and method based on VR technology

Abstract

The invention discloses an artistic design system and method based on a VR technology, and belongs to the technical field of creativity interaction, and the system comprises a data collection module which is used for obtaining the omnibearing information data of a creativity product; the holographic imaging module is used for obtaining a three-dimensional image of the cultural and creative product according to the omnibearing information data and projecting the three-dimensional image on a holographic display screen; the live-action collaboration module is used for fusing the three-dimensional image of the cultural and creative product with a space map and providing independent or collaborative interaction experience; the user interaction module is used for automatically adjusting a control instruction according to the specific gesture action of each user so as to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; the content management module is used for managing and updating all-around information data of the cultural and creative products; and the security verification module is used for allowing the authorized user to access and interact with the three-dimensional image of the creative product. The problem that in the prior art, Chinese creative product display lacks interactivity and personalized experience is solved.

Description

Technical Field

[0001] The present invention relates to the field of cultural and creative interactive technologies, and in particular to an art design system and method based on VR technology. Background Art

[0002] In recent years, with the booming development of the cultural and creative industry, the display methods of cultural and creative products have been constantly evolving. Traditional cultural and creative systems mainly rely on two-dimensional pictures, text descriptions, or simple video displays. Although these methods can convey the basic information of cultural and creative products, they have obvious deficiencies in attracting users' attention and providing immersive experiences. To improve the display effect, some advanced cultural and creative systems have begun to introduce virtual reality (VR) and augmented reality (AR) technologies to enrich users' visual experiences by simulating three-dimensional environments or overlaying virtual information. However, most of these systems still remain at the simple interaction at the visual level, lacking functions of in-depth interaction and user personalization, and are difficult to meet the needs of users for diversified and personalized experiences.

[0003] Although the existing cultural and creative systems have made certain progress in display effects and interactivity, there are still many deficiencies. First of all, most cultural and creative systems are still relatively single in information collection, mainly relying on static images and video materials, and it is difficult to comprehensively and vividly display the characteristics and connotations of cultural and creative products. Secondly, in terms of interactive experience, the existing systems often lack the function of real-scene collaboration, and users cannot interact with other users in real time in the same virtual space, reducing the sociality and interest. In addition, functions such as personalized gesture control and content intelligent management are also less applied in the existing systems, resulting in an unsmooth and personalized user experience. More importantly, there are loopholes in the security authentication of the existing systems, which cannot effectively prevent unauthorized access and malicious operations, bringing potential risks to the copyright protection of cultural and creative products and user privacy. Therefore, it is particularly important to develop a digital image holographic interactive system for cultural and creative products that can overcome these deficiencies. Summary of the Invention

[0004] The present invention provides an art design system based on VR technology, which realizes functions such as omni-directional information collection, three-dimensional stereoscopic image generation, real-scene collaborative interaction, personalized gesture control, content intelligent management, and security identity authentication, so as to solve the problem of lack of interactivity and personalized experience in the display of cultural and creative products in the prior art.

[0005] To solve the above technical problems, the present invention provides the following technical solutions: In a first aspect, the present invention provides an art design system based on VR technology, including: Data acquisition module, which utilizes natural language processing technology, an in-built automatic image acquisition chip, and multi-feature fusion and adaptive thresholding to obtain all-round information data of cultural and creative products, where the all-round information data includes text data, image data, and video data; Holographic imaging module, which, based on the all-round information data, obtains encoded light wave information through a wavefront reconstruction algorithm, and uses the principle of optical interference to obtain a hologram based on the encoded light wave information and a reference light wave. Then, it uses a laser source to irradiate the hologram to obtain a three-dimensional stereoscopic image of the cultural and creative product, and projects the three-dimensional stereoscopic image onto a holographic display screen; Real-scene collaboration module, which real-time monitors the position change data of each user in three-dimensional space and constructs a space map, and fuses the three-dimensional image of the cultural and creative product with the space map to provide independent or collaborative interactive experiences; User interaction module, which automatically adjusts control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; Content management module, which manages and updates the all-round information data of the cultural and creative products of the data acquisition module; Security verification module, which uses biometric technology to authenticate users and only allows authorized users to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

[0006] Furthermore, the data acquisition module is configured to perform the following actions: Automatically access and locate web pages related to cultural and creative products using a web page parsing algorithm: Simulate user operations to capture the text data of cultural and creative products, and use natural language processing technology to clean, segment, and perform part-of-speech tagging on the text data to obtain the processed text data of cultural and creative products; Use the in-built automatic image acquisition chip to automatically capture images of cultural and creative products, generate frame memory addresses at the same time, and refresh the image data in real time to obtain the image data of cultural and creative products; Automatically obtain the video stream of cultural and creative products, and perform real-time analysis on the video stream through multi-feature fusion and adaptive thresholding to obtain representative key frames, and extract the feature information and scene information of cultural and creative products to obtain the video data of cultural and creative products.

[0007] Furthermore, the method for performing real-time analysis on the video stream through multi-feature fusion and adaptive thresholding to obtain representative key frames includes: Using a shot boundary detection algorithm to segment the video stream into multiple shots; For each frame within each shot, extract color features, texture features, and motion features and fuse them to obtain a multi-feature fusion vector, where the The multi - feature fusion vector representation of a frame is as follows: ; In the formula, represents the multi - feature fusion vector of the th frame, represents the weight coefficient of the color feature of the th frame , represents the weight coefficient of the texture feature of the th frame , represents the weight coefficient of the motion feature of the th frame ; Using structural similarity, calculate the magnitude of the difference between frames within a shot, and dynamically adjust the adaptive threshold. Among them, more key frames are extracted in places with large differences, and fewer key frames are extracted in places with small differences. The difference between frames within the shot is expressed as: ; In the formula, represents the difference between the th frame and the th frame within the shot, represents the structural similarity index between the multi - feature fusion vector of the th frame and the multi - feature fusion vector of the th frame; Within each shot, according to the multi - feature fusion vector and the adaptive threshold, preset the number of clusters according to the length of the shot, and use the K - means clustering algorithm to cluster the candidate key frames according to the number of clusters, and select the center of each cluster as the representative key frame. Among them, the adaptive threshold is expressed as: ; In the formula, represents the adaptive threshold, represents the average value of the difference between frames, is the standard deviation of the difference between frames is the adjustment coefficient for controlling the sensitivity of the adaptive threshold.

[0008] Furthermore, the holographic imaging module is configured to perform the following actions: Using the wavefront reconstruction algorithm, encode the omnidirectional information data into optical wave information to obtain the encoded optical wave information; Using the principle of optical interference, use a laser to interfere the encoded optical wave information with a reference optical wave to obtain an interference pattern, and record the interference pattern on a holographic medium to form a hologram; Irradiate the hologram with a laser source having good coherence that matches the wavelength, direction, and phase of the laser to generate an original image and a conjugate image, obtaining a three-dimensional stereoscopic image of the cultural and creative product; After adjusting the parameters of the three-dimensional stereoscopic image, present the three-dimensional stereoscopic image on a holographic display screen. The parameters of the three-dimensional stereoscopic image include size, brightness, and angle.

[0009] Furthermore, the real-scene collaboration module is configured to perform the following actions: Based on computer vision-based spatial positioning technology and infrared sensors, continuously monitor and obtain the position change data of each user in three-dimensional space; Use a position recognition algorithm to process the position change data of each user in three-dimensional space in real time, and calculate the position of each user relative to the holographic display screen; And construct a spatial map of the surrounding environment of each user according to the position of each user relative to the holographic display screen; Through AR technology, fuse the three-dimensional stereoscopic image of the cultural and creative product on the holographic display screen with the spatial map of the surrounding environment of a single user or multiple users, providing an independent or collaborative interaction experience.

[0010] Furthermore, the user interaction module is configured to perform the following actions: Use a camera to continuously monitor the hand movements of multiple users, and identify specific gesture actions of multiple users based on image processing technology; Based on the specific gesture actions of each user, gradually learn and identify the personalized gesture habits of each user through machine learning algorithms, and automatically adjust the control instructions according to the personalized gesture habits of each user; The control instructions are used to dynamically adjust the position, scaling ratio of the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen, or switch the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen.

[0011] Furthermore, the content management module is configured to perform the following actions: Obtain the omni-directional information data of the cultural and creative product from the data acquisition module, perform cleaning, deduplication, and integration to obtain the processed omni-directional information data of the cultural and creative product; Based on the processed omni-directional information data of the cultural and creative product, classify the cultural and creative product according to business requirements, and store it on the blockchain according to the classification results; Based on the type, theme, and style of the cultural and creative product, establish a multi-dimensional data index on the blockchain, supporting keyword search, image recognition, and video clip matching retrieval functions; Establish a regular update mechanism to monitor market changes, user feedback, and all-round information data of the cultural and creative products in real time. Regularly update the all-round information data of the cultural and creative products on the blockchain, and mark or delete outdated or invalid data.

[0012] Further, the security verification module is configured to perform the following actions: Use sensors to capture the user's biometric information and compare it with the authorized user biometric information database pre-stored in the system. When the biometric information exactly matches the biometric information of a certain authorized user in the database, allow the user to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

[0013] Further, the security verification module is further configured to perform the following actions: Dynamically adjust the access rights and operation rights of the user to the three-dimensional stereoscopic image of the cultural and creative product according to the user's identity and permissions; Record the user's access and operation logs for auditing and tracking, and send an alarm prompt when unauthorized access or abnormal operations are detected.

[0014] In a second aspect, the present invention provides an art design method based on VR technology, including: Use natural language processing technology, built-in automatic image acquisition chips, and multi-feature fusion and adaptive threshold to obtain all-round information data of cultural and creative products. The all-round information data includes text data, image data, and video data; According to the all-round information data, obtain the encoded light wave information through a wavefront reconstruction algorithm, and use the principle of optical interference to obtain a hologram according to the encoded light wave information and the reference light wave. Then use a laser source to irradiate the hologram to obtain a three-dimensional stereoscopic image of the cultural and creative product, and project the three-dimensional stereoscopic image onto a holographic display screen; Real-time monitor the position change data of each user in three-dimensional space and construct a space map, and fuse the three-dimensional image of the cultural and creative product with the space map to provide an independent or collaborative interaction experience; Automatically adjust the control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; Manage and update the all-round information data of the cultural and creative products of the data acquisition module; Use biometric technology to authenticate the user's identity, and only allow authorized users to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

[0015] The beneficial effects of the present invention: 1. The digital image holographic interaction system for cultural and creative products provided by the present invention can comprehensively and accurately collect the text, image, and video data of cultural and creative products through the data acquisition module; through the holographic imaging module, using advanced wavefront reconstruction algorithms and the principle of optical interference, it converts the text, image, and video data of cultural and creative products into three-dimensional stereoscopic images and projects them onto a holographic display screen, bringing an unprecedented visual shock to users; through the real-scene collaboration module, it can monitor the user's position in real time, integrate the three-dimensional stereoscopic image of the cultural and creative product with the space map, and achieve independent or collaborative interaction experiences, greatly enhancing the user's sense of participation and interactivity. At the same time, the user interaction module allows users to dynamically adjust the image through specific gesture actions, further meeting the needs of personalized experiences. The present invention makes the display of cultural and creative products more vivid and interesting, effectively improving user satisfaction and loyalty.

[0016] 2. The digital image holographic interaction system for cultural and creative products of the present invention uses advanced biometric technology for identity verification through the security verification module, ensuring that only authorized users can access and interact with the three-dimensional stereoscopic image of cultural and creative products, effectively preventing unauthorized access and malicious operations, and protecting the copyright security of cultural and creative products. At the same time, the content management module is responsible for managing and updating the comprehensive information data of cultural and creative products, ensuring the accuracy and timeliness of the display content, not only enhancing the user's trust in the display of cultural and creative products but also providing strong support for the healthy development of the cultural and creative industry.

[0017] 3. The present invention not only integrates color features, texture features, and motion features to form a comprehensive multi-feature fusion vector but also intelligently adjusts the extraction density of key frames according to the size of the inter-frame difference within the lens by dynamically adjusting the threshold strategy, ensuring that parts with drastic changes in video content such as action scene transitions and color mutations can be fully captured, while appropriately reducing the number of key frames for relatively stable parts of the content. Thus, while ensuring the representativeness of key frames, redundant information is effectively reduced, significantly improving the accuracy and efficiency of video key frame extraction.

[0018] 4. Further, using the K-means clustering algorithm and combining the length of the lens to preset the number of clusters, automatically selects the center of each cluster from the candidate key frames as the final key frame, not only improving the automation degree of key frame selection but also dynamically adjusting the adaptive threshold based on the average value and standard deviation of the inter-frame difference, increasing the flexibility of control, further enhancing the adaptability of the algorithm to different types of video content, and making the extraction of key frames more accurate and efficient. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a schematic diagram of the module architecture of the digital image holographic interaction system for cultural and creative products provided by an embodiment of the present invention; Figure 2Schematic flowchart of obtaining representative key frames based on multi - feature fusion and adaptive threshold provided by an embodiment of the present invention; Figure 3 Schematic flowchart of obtaining representative key frames based on multi - feature fusion and adaptive threshold provided by another embodiment of the present invention. Detailed implementation manners

[0020] To make the above - mentioned objects, features and advantages of the present invention more obvious and understandable, the following will describe the detailed implementation manners of the present invention in conjunction with the accompanying drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of them.

[0021] Embodiment 1, referring to Figure 1 , which is an embodiment of the present invention, provides an art design system based on VR technology, including: A data acquisition module, which uses natural language processing technology, a built - in automatic image acquisition chip and multi - feature fusion and adaptive threshold to obtain all - round information data of cultural and creative products. The all - round information data includes text data, image data and video data.

[0022] The present invention uses natural language processing technology, a built - in automatic image acquisition chip and video stream processing technology to obtain all - round information data of cultural and creative products from multiple dimensions including text, image and video. By collecting rich data, the present invention can comprehensively and accurately reflect the characteristics and details of cultural and creative products, improving the authenticity and attractiveness of the display.

[0023] A holographic imaging module, according to the all - round information data, obtains encoded light wave information through a wavefront reconstruction algorithm, and uses the principle of optical interference to obtain a hologram according to the encoded light wave information and a reference light wave, and then uses a laser source to irradiate the hologram to obtain a three - dimensional stereoscopic image of the cultural and creative product, and projects the three - dimensional stereoscopic image on a holographic display screen.

[0024] The present invention obtains encoded light wave information through a wavefront reconstruction algorithm according to the all - round information data, generates a hologram using the principle of optical interference, then uses a laser source to irradiate the hologram to obtain a three - dimensional stereoscopic image of the cultural and creative product, and projects it on a holographic display screen. The holographic imaging technology enables the cultural and creative products to be presented in a three - dimensional stereoscopic form, bringing a strong visual impact and immersion feeling to the audience. The display method provided by the present invention is not only novel and unique, but also can effectively attract the attention of the audience and improve the display effect.

[0025] A real - scene collaboration module, which real - time monitors the position change data of each user in the three - dimensional space and constructs a space map, and fuses the three - dimensional image of the cultural and creative product with the space map to provide independent or collaborative interaction experiences.

[0026] Through real-time monitoring of the position change data of each user in the three-dimensional space, a spatial map is constructed, and the three-dimensional image of the cultural and creative product is integrated with the spatial map. Through real-time monitoring and integration technology, the real-scene collaboration module can achieve seamless docking of the three-dimensional image of the cultural and creative product with the real environment. The real-scene collaboration module provides users with a more natural and smooth interaction experience, and good experience effects can be obtained whether it is independent exploration or collaborative cooperation.

[0027] The user interaction module automatically adjusts the control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen.

[0028] According to the specific gesture actions of the user, the control instructions are automatically adjusted to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen. Through gesture recognition technology, the user interaction module enables users to directly and conveniently control the display content and method of the cultural and creative product, which not only improves the user's participation but also enhances the interestingness and interactivity of the display.

[0029] The content management module manages and updates the all-round information data of the cultural and creative products of the data acquisition module.

[0030] By managing and updating the all-round information data of the cultural and creative products obtained by the data acquisition module, the accuracy and timeliness of the display content are ensured. By regularly updating and maintaining the data, it can be ensured that the display of the cultural and creative products is always consistent with the actual situation, meeting the needs and expectations of users.

[0031] The security verification module uses biometric technology to authenticate the identity of users and only allows authorized users to access and interact with the three-dimensional image of the cultural and creative product.

[0032] The present invention uses biometric technology to authenticate the identity of users and only allows authorized users to access and interact with the three-dimensional image of the cultural and creative product. Through a strict security verification mechanism, the security verification module ensures the security and reliability of the display system. Only authorized users who have passed the identity verification can access and interact with the three-dimensional image of the cultural and creative product, effectively preventing unauthorized access and abuse.

[0033] In summary, each module of the present invention plays an indispensable role and jointly constitutes an efficient, secure, and interactive display system for cultural and creative products. Through the collaborative work of each module, the system can provide users with a comprehensive, real, and interesting display experience of cultural and creative products.

[0034] Embodiment 2 is another embodiment of the present invention. The difference between this embodiment and the first embodiment is that it provides specific configuration actions of an art design system based on VR technology.

[0035] A data acquisition module that uses natural language processing technology, an in-built automatic image acquisition chip, and multi-feature fusion and adaptive thresholding to obtain all-round information data of cultural and creative products. The all-round information data includes text data, image data, and video data.

[0036] In this embodiment, the data acquisition module is configured to perform the following actions: Automatically access and locate web pages related to cultural and creative products using a web parsing algorithm: Simulate user operations to capture the text data of cultural and creative products, and use natural language processing technology to clean, segment, and part-of-speech tag the text data to obtain the processed text data of cultural and creative products.

[0037] Natural language processing technology is mainly used to perform semantic analysis, sentiment analysis, entity recognition, etc. on text information by using interdisciplinary knowledge of linguistics, computer science, and artificial intelligence.

[0038] In this embodiment, natural language processing technology is mainly used to process and analyze text data related to cultural and creative products. In the display of cultural and creative products, natural language processing technology automatically extracts text information such as product descriptions, historical backgrounds, and design concepts, and converts it into structured data for subsequent processing and display.

[0039] Use the in-built automatic image acquisition chip to automatically capture images of cultural and creative products, generate frame memory addresses at the same time, and refresh image data in real time to obtain image data of cultural and creative products.

[0040] The automatic image acquisition chip is responsible for capturing image data of cultural and creative products. The automatic image acquisition chip is built with an image sensor that can capture image information such as the appearance, details, and colors of the product. Through preset acquisition parameters including resolution, frame rate, etc., the automatic image acquisition chip can capture images in real time or at regular intervals.

[0041] In this embodiment, image data is the key to displaying product appearance and details. The automatic image acquisition chip can ensure the accuracy and consistency of image data of cultural and creative products, providing a reliable basis for subsequent image processing and analysis.

[0042] Automatically obtain the video stream of cultural and creative products, and perform real-time analysis on the video stream through multi-feature fusion and adaptive thresholding to obtain representative key frames, extract feature information and scene information of cultural and creative products, and obtain video data of cultural and creative products.

[0043] In this embodiment, the method of obtaining representative key frames by performing real-time analysis on the video stream through multi-feature fusion and adaptive thresholding, as Figure 2 shown, includes: The video stream is segmented into multiple shots using a shot boundary detection algorithm; For each frame within each shot, color features, texture features, and motion features are extracted and fused to obtain a multi-feature fusion vector. Among them, the multi-feature fusion vector of the th frame is expressed as: ; In the formula, represents the multi-feature fusion vector of the th frame, represents the weight coefficient of the color feature of the th frame, represents the weight coefficient of the texture feature of the th frame, represents the weight coefficient of the motion feature of the th frame; Using structural similarity, the magnitude of the inter-frame difference within the shot is calculated, and the adaptive threshold is dynamically adjusted. Among them, more key frames are extracted in places with large differences, and fewer key frames are extracted in places with small differences. The inter-frame difference within the shot is expressed as: ; In the formula, represents the inter-frame difference between the th frame and the th frame within the shot, represents the structural similarity index between the multi-feature fusion vector of the th frame and the multi-feature fusion vector of the th frame; Within each shot, according to the multi-feature fusion vector and the adaptive threshold, the number of clusters is preset according to the length of the shot. The K-means clustering algorithm is used to cluster the candidate key frames according to the number of clusters, and the center of each cluster is selected as the representative key frame. Among them, the adaptive threshold is expressed as: ; In the formula, represents the adaptive threshold, represents the average value of the inter-frame differences, the standard deviation of the inter-frame differences is the adjustment coefficient for controlling the sensitivity of the adaptive threshold.

[0044] The present invention also uses algorithms such as video compression, transmission, and decoding to process and transmit the video data of cultural and creative products, and transmits the video data to a display device or a storage medium in an efficient and smooth manner.

[0045] In this embodiment, the video data can display the dynamic effects, usage scenarios, or production processes of the cultural and creative products, ensuring the real-time nature and clarity of the video data and enhancing the viewing experience of the audience.

[0046] The holographic imaging module, based on the omnidirectional information data, obtains the encoded light wave information through a wavefront reconstruction algorithm, and using the principle of optical interference, obtains a hologram based on the encoded light wave information and a reference light wave. Then, the hologram is irradiated with a laser source to obtain a three-dimensional stereoscopic image of the cultural and creative product, and the three-dimensional stereoscopic image is projected onto a holographic display screen.

[0047] In this embodiment, the holographic imaging module is configured to perform the following actions: Using the wavefront reconstruction algorithm, encode the omnidirectional information data into light wave information to obtain the encoded light wave information.

[0048] The wavefront reconstruction algorithm uses mathematical and physical models to simulate the propagation process of the light waves emitted by an object in space, thereby reconstructing the wavefront information of the object, including three-dimensional features such as the shape, size, color, and surface details of the object.

[0049] In this embodiment, the wavefront reconstruction algorithm calculates the amplitude and phase information of the light waves emitted by the object at various points in space based on the collected omnidirectional information data of the cultural and creative product, forming the encoded light wave information.

[0050] Using the principle of optical interference, interfere the encoded light wave information with the reference light wave using a laser to obtain an interference pattern, and record the interference pattern on a holographic medium to form a hologram.

[0051] The principle of optical interference uses the interference phenomenon of light to record the three-dimensional image of an object. When two or more coherent light waves meet at a certain point in space, they will interfere with each other to form bright and dark interference fringes. These interference fringes record the amplitude and phase information of the light waves.

[0052] In this embodiment, the encoded light wave information and the reference light wave are a coherent light wave with a known amplitude and phase that meet on the recording medium, interfere, and form a hologram.

[0053] Irradiate the hologram with a laser source having good coherence that matches the wavelength, direction, and phase of the laser to generate a primary image and a conjugate image, obtaining a three-dimensional stereoscopic image of the cultural and creative product.

[0054] Laser has high coherence and monochromaticity, and can accurately reproduce the light wave information recorded in the hologram. When the laser irradiates the hologram, it will interact with the interference fringes in the hologram, generating a diffraction phenomenon, thereby reproducing the three-dimensional image of the object.

[0055] In this embodiment, a laser source is used to irradiate a hologram to reproduce a three-dimensional image of an object. The laser source irradiates the hologram at a specific angle and intensity, causing the interference fringes in the hologram to be excited and generating diffracted light waves. These diffracted light waves recombine in space to form a three-dimensional stereoscopic image of the cultural and creative product.

[0056] After adjusting the parameters of the three-dimensional stereoscopic image, the three-dimensional stereoscopic image is presented on a holographic display screen. The parameters of the three-dimensional stereoscopic image include size, brightness, and angle.

[0057] The holographic display screen uses special materials and structures and can efficiently transmit and display diffracted light waves, thus presenting a clear three-dimensional image.

[0058] In this embodiment, the holographic display screen is used to display the three-dimensional stereoscopic image of the cultural and creative product to the audience. The holographic display screen receives the diffracted light waves generated by the laser source irradiating the hologram and converts the diffracted light waves into a three-dimensional stereoscopic image that the audience can see. The audience can observe the three-dimensional image of the cultural and creative product from different perspectives and distances to obtain a more realistic and immersive display experience.

[0059] The real-scene collaboration module monitors the position change data of each user in the three-dimensional space in real time and constructs a space map, fusing the three-dimensional image of the cultural and creative product with the space map to provide independent or collaborative interaction experiences.

[0060] In this embodiment, the real-scene collaboration module is configured to perform the following actions: Based on computer vision-based spatial positioning technology and infrared sensors, monitor and obtain the position change data of each user in the three-dimensional space in real time.

[0061] In this embodiment, computer vision technology is used to capture the dynamics of users in the three-dimensional space through a camera and use image processing algorithms to identify and track the movement trajectories of users. Infrared sensors are used to detect the positions and actions of users by emitting and receiving infrared light and have the characteristics of high sensitivity and fast response speed.

[0062] Use a position recognition algorithm to process the position change data of each user in the three-dimensional space in real time, calculate the position of each user relative to the holographic display screen, and construct a space map of the environment around each user according to the position of each user relative to the holographic display screen.

[0063] In this embodiment, based on the captured user position and action data, calculate the precise position of each user relative to the holographic display screen. Combining spatial positioning information and environmental characteristics, construct a space map of the environment around each user to provide accurate positioning information for users and simultaneously construct the spatial structure of the environment around users.

[0064] Through AR technology, the three-dimensional stereoscopic images of cultural and creative products on the holographic display screen are integrated with the spatial map of the surrounding environment of a single user or multiple users, providing independent or collaborative interaction experiences.

[0065] AR technology combines computer-generated images, videos, or three-dimensional models with the real environment to create a visual effect of the blend of virtual and reality.

[0066] In this embodiment, the three-dimensional stereoscopic images of cultural and creative products on the holographic display screen are integrated with the spatial map of the user. According to the user's position and actions, the display position and angle of the three-dimensional images of cultural and creative products are adjusted in real time to keep them consistent with the user's perspective.

[0067] In this embodiment, when there is only one user, the system can provide personalized display and interaction experiences for the user, such as adjusting the display angle of cultural and creative products according to the user's movement trajectory.

[0068] In this embodiment, when there are multiple users, the system can identify the positions and actions of each user and accordingly adjust the display mode of cultural and creative products to achieve collaborative interaction among multiple people.

[0069] The user interaction module automatically adjusts the control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional images of cultural and creative products on the holographic display screen.

[0070] In this embodiment, the user interaction module is configured to perform the following actions: Continuously monitor the hand actions of multiple users using a camera, and identify the specific gesture actions of multiple users based on image processing technology.

[0071] In this embodiment, a highly sensitive camera is used to continuously monitor the hand actions of multiple users to ensure that the subtle changes in gestures are captured, and then through steps such as image preprocessing, feature extraction, and classification, the specific gesture actions of users are identified.

[0072] Based on the specific gesture actions of each user, gradually learn and identify the personalized gesture habits of each user through machine learning algorithms, and automatically adjust the control instructions according to the personalized gesture habits of each user.

[0073] In this embodiment, a dataset is obtained by collecting the hand action data of each user, including gesture types, action speeds, intensities, etc. Machine learning algorithms are used to train the dataset, and gradually learn and identify the personalized gesture habits of each user. In practical applications, according to the gesture action data of users, the personalized gesture habits of users are quickly identified.

[0074] The control instruction is used to dynamically adjust the position or scaling ratio of the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen, or to switch the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen.

[0075] In this embodiment, according to the user's gesture actions and personalized gesture habits, corresponding control instructions are generated, and the system sends the control instructions to the control system of the holographic display screen to achieve real-time control of the three-dimensional stereoscopic image of the cultural and creative product; the user can adjust the scaling ratio of the three-dimensional stereoscopic image of the cultural and creative product through the scaling action of the gesture; the user can switch the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen through the gesture instruction.

[0076] The content management module manages and updates the omnidirectional information data of the cultural and creative products of the data acquisition module.

[0077] In this embodiment, the content management module is configured to perform the following actions: Obtain the omnidirectional information data of the cultural and creative products from the data acquisition module, perform cleaning, deduplication and integration to obtain the processed omnidirectional information data of the cultural and creative products; Based on the processed omnidirectional information data of the cultural and creative products, classify the cultural and creative products according to business requirements, and store them on the blockchain according to the classification results.

[0078] In this embodiment, according to business requirements, the processed omnidirectional information data of the cultural and creative products is classified, such as being divided by type into artworks and souvenirs, by theme into history and culture, and by style into classical, modern, etc.

[0079] Blockchain storage: Store the classified cultural and creative product information on the blockchain, and utilize the characteristics of decentralization and immutability of the blockchain to ensure the authenticity and security of the data.

[0080] Based on the type, theme and style of the cultural and creative products, establish multi-dimensional data indexes on the blockchain to support keyword search, image recognition and video clip matching retrieval functions.

[0081] In this embodiment, on the blockchain, according to multi-dimensional information such as the type, theme and style of the cultural and creative products, establish data indexes to support multiple retrieval methods, such as keyword search, image recognition and video clip matching, etc. The user can quickly find the cultural and creative product information that meets the requirements by inputting keywords, uploading images or video clips and using the retrieval functions provided by the system.

[0082] Establish a regular update mechanism, monitor market changes, user feedback and the omnidirectional information data of the cultural and creative products in real time, regularly update the omnidirectional information data of the cultural and creative products on the blockchain, and mark or delete outdated or invalid data.

[0083] In this embodiment, a regular update mechanism is established to ensure that the data in the system always remains up-to-date, reflecting the actual situation of the market. Regularly updating the cultural and creative product information on the blockchain can keep the system clean and efficient.

[0084] A security verification module that uses biometric technology to authenticate users and only allows authorized users to access and interact with the three-dimensional images of the cultural and creative products.

[0085] In this embodiment, the security verification module is configured to perform the following actions: Capture the biometric information of the user using a sensor and compare it with the pre-stored authorized user biometric information database in the system. When the biometric information exactly matches the biometric information of an authorized user in the database, the user is allowed to access and interact with the three-dimensional images of the cultural and creative products.

[0086] This embodiment uses a high-precision biometric sensor to capture the biometric information of the user. For example, fingerprint information is captured through a fingerprint scanner, or facial features are captured through a facial recognition camera. Then, the captured biometric information is compared with the pre-stored authorized user biometric information database in the system.

[0087] In this embodiment, the authorized user biometric information database stores the biometric data of authorized users for verifying the identity of users. When the captured biometric information exactly matches the biometric information of an authorized user in the database, the verification is passed, and the user is allowed to access and interact with the three-dimensional images of the cultural and creative products.

[0088] In this embodiment, the security verification module is further configured to perform the following actions: Dynamically adjust the access and operation permissions of the user to the three-dimensional images of the cultural and creative products according to the user's identity and permissions.

[0089] In this embodiment, the security verification module not only verifies the identity of the user but also dynamically adjusts the access and operation permissions of the user to the three-dimensional images of the cultural and creative products, such as viewing permissions, editing permissions, deletion permissions, etc., according to the user's identity and permissions. After the user passes the identity verification, the system automatically adjusts their permissions to ensure that the user can only access and operate the three-dimensional images of the cultural and creative products they are authorized to.

[0090] Record the access and operation logs of the user for auditing and tracking, and send an alarm prompt when unauthorized access or abnormal operations are detected.

[0091] In this embodiment, the security verification module is also used to record the access and operation logs of users, including information such as access time, access content, operation type, etc. These log data can be used for subsequent auditing and tracking, helping system administrators understand the access and operation behaviors of users, and ensuring the security and compliance of the system.

[0092] In this embodiment, the system can also detect unauthorized access or abnormal operations by analyzing the log data, such as multiple failed login attempts, illegal access to specific resources, etc. When unauthorized access or abnormal operations are detected, the security verification module immediately sends an alarm prompt to the system administrator or relevant security personnel. After receiving the alarm, the system administrator can immediately take response measures, such as locking the account, investigating the cause of the incident, strengthening security protection, etc., to ensure the security and stability of the system.

[0093] Embodiment 3 With the same inventive concept as other embodiments, this embodiment introduces an art design method based on VR technology, including: Using natural language processing technology, built-in automatic image acquisition chips and multi-feature fusion and adaptive threshold to obtain all-round information data of cultural and creative products, and the all-round information data includes text data, image data and video data; According to the all-round information data, encoded light wave information is obtained through a wavefront reconstruction algorithm, and using the principle of optical interference, a hologram is obtained based on the encoded light wave information and a reference light wave. Then, the hologram is irradiated by a laser source to obtain a three-dimensional stereoscopic image of the cultural and creative product, and the three-dimensional stereoscopic image is projected onto a holographic display screen; Real-time monitor the position change data of each user in the three-dimensional space and construct a space map, and fuse the three-dimensional image of the cultural and creative product with the space map to provide an independent or collaborative interaction experience; According to the specific gesture actions of each user, automatically adjust the control instructions to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; Manage and update the all-round information data of the cultural and creative products of the data acquisition module; Use biometric technology to authenticate users, and only allow authorized users to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

[0094] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code. Among them, the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk. These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, and the instruction device implements the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 specified in one block or multiple blocks.

[0095] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered by the scope of the claims of the present invention.

Claims

1. An art design system based on VR technology, characterized in that Including: A data acquisition module that uses natural language processing technology, an built-in automatic image acquisition chip, and multi-feature fusion and adaptive thresholding to obtain all-round information data of cultural and creative products. The all-round information data includes text data, image data, and video data; A holographic imaging module that, based on the all-round information data, obtains encoded light wave information through a wavefront reconstruction algorithm, and uses the principle of optical interference to obtain a hologram based on the encoded light wave information and a reference light wave. Then, a laser source is used to irradiate the hologram to obtain a three-dimensional stereoscopic image of the cultural and creative product, and the three-dimensional stereoscopic image is projected onto a holographic display screen; A real-scene collaboration module that real-time monitors the position change data of each user in three-dimensional space and constructs a space map, and fuses the three-dimensional image of the cultural and creative product with the space map to provide an independent or collaborative interaction experience; A user interaction module that automatically adjusts control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; A content management module that manages and updates the all-round information data of the cultural and creative products of the data acquisition module; A security verification module that uses biometric technology to authenticate the identity of users and only allows authorized users to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

2. The digital image holographic interactive system for cultural and creative products according to claim 1, wherein The data acquisition module is configured to perform the following actions: Automatically access and locate web pages related to cultural and creative products using a web page parsing algorithm: Simulate user operations to capture the text data of cultural and creative products, and use natural language processing technology to clean, segment, and part-of-speech tag the text data to obtain the processed text data of cultural and creative products; Automatically capture images of cultural and creative products using the built-in automatic image acquisition chip, generate frame memory addresses at the same time, and real-time refresh the image data to obtain the image data of cultural and creative products; Automatically obtain the video stream of cultural and creative products, and perform real-time analysis on the video stream through multi-feature fusion and adaptive thresholding to obtain representative key frames, and extract the feature information and scene information of cultural and creative products to obtain the video data of cultural and creative products.

3. The digital image holographic interaction system for cultural and creative products according to claim 2, wherein, The method of performing real-time analysis on the video stream through multi-feature fusion and adaptive thresholding to obtain representative key frames includes: Using a shot boundary detection algorithm to segment the video stream into multiple shots; For each frame within each shot, color features, texture features, and motion features are extracted and fused to obtain a multi-feature fusion vector. Among them, the multi-feature fusion vector of the th frame is expressed as: ； Wherein, represents the multi - feature fusion vector of the th frame, represents the weight coefficient of the color feature of the th frame, ; represents the weight coefficient of the texture feature of the th frame, ; represents the weight coefficient of the motion feature of the th frame . Using structural similarity to calculate the magnitude of the inter-frame difference within a shot, and dynamically adjust the adaptive threshold. Among them, more key frames are extracted in places with large differences, and fewer key frames are extracted in places with small differences. The inter-frame difference within the shot is expressed as: ； In the formula, represents the inter-frame difference between the -th frame and the -th frame, represents the structural similarity index between the multi-feature fusion vector of the -th frame and the multi-feature fusion vector of the -th frame; Within each shot, according to the multi-feature fusion vector and the adaptive threshold, preset the number of clusters according to the length of the shot, and use the K-means clustering algorithm to cluster the candidate key frames according to the number of clusters, and select the center of each cluster as the representative key frame. Among them, the adaptive threshold is expressed as: ； In the formula, represents the adaptive threshold, represents the average value of the inter-frame differences, the standard deviation of the inter-frame differences is the adjustment coefficient for controlling the sensitivity of the adaptive threshold.

4. The digital image holographic interactive system for cultural and creative products according to claim 1, wherein, The holographic imaging module is configured to perform the following actions: Using a wavefront reconstruction algorithm to encode the all-round information data into light wave information to obtain the encoded light wave information; Using the principle of optical interference, a laser is used to interfere the encoded light wave information with a reference light wave to obtain an interference pattern, and the interference pattern is recorded on a holographic medium to form a hologram; Irradiating the hologram with a laser source having good coherence matching the wavelength, direction, and phase of the laser to generate an original image and a conjugate image, and obtaining a three-dimensional stereoscopic image of the cultural and creative product; After adjusting the parameters of the three-dimensional stereoscopic image, presenting the three-dimensional stereoscopic image on a holographic display screen, and the parameters of the three-dimensional stereoscopic image include size, brightness, and angle.

5. The digital image holographic interactive system for cultural and creative products according to claim 1, wherein The live collaboration module is configured to perform the following actions: Based on computer vision-based spatial positioning technology and infrared sensors, real-time monitor and obtain the position change data of each user in three-dimensional space; Use a position recognition algorithm to process the position change data of each user in three-dimensional space in real time, and calculate the position of each user relative to the holographic display screen; And construct a spatial map of the surrounding environment of each user according to the position of each user relative to the holographic display screen; Through AR technology, fuse the three-dimensional stereoscopic image of the cultural and creative product on the holographic display screen with the spatial map of the surrounding environment of a single user or multiple users to provide an independent or collaborative interaction experience.

6. The digital image holographic interaction system for cultural and creative products according to claim 1, characterized in that, The user interaction module is configured to perform the following actions: Use a camera to continuously monitor the hand movements of multiple users, and identify specific gesture actions of multiple users based on image processing technology; Based on the specific gesture actions of each user, gradually learn and identify the personalized gesture habits of each user through a machine learning algorithm, and automatically adjust the control instructions according to the personalized gesture habits of each user; The control instructions are used to dynamically adjust the position, scaling ratio of the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen, or switch the three-dimensional stereoscopic image of the cultural and creative product projected on the holographic display screen.

7. The digital image holographic interactive system for cultural and creative products according to claim 1, wherein The content management module is configured to perform the following actions: Obtain the omnidirectional information data of the cultural and creative product from the data acquisition module, perform cleaning, deduplication, and integration to obtain the processed omnidirectional information data of the cultural and creative product; Based on the processed omnidirectional information data of the cultural and creative product, classify the cultural and creative product according to business requirements, and store it on the blockchain according to the classification results; Based on the type, theme, and style of the cultural and creative product, establish a multi-dimensional data index on the blockchain to support keyword search, image recognition, and video clip matching retrieval functions; Establish a regular update mechanism, real-time monitor market changes, user feedback, and the omnidirectional information data of the cultural and creative product, regularly update the omnidirectional information data of the cultural and creative product on the blockchain, and mark or delete outdated or invalid data.

8. The digital image holographic interaction system for cultural and creative products according to claim 1, characterized in that, The security verification module is configured to perform the following actions: Use a sensor to capture the biological information of the user, and compare it with the authorized user biological information database pre-stored in the system. When the biological information completely matches the biological information of a certain authorized user in the database, allow the user to access and interact with the three-dimensional stereoscopic image of the cultural and creative product.

9. The digital image holographic interactive system for cultural and creative products according to claim 7, characterized in that, The security verification module is further configured to perform the following actions: Dynamically adjust the access and operation permissions of users to the three-dimensional stereoscopic images of cultural and creative products according to the identities and permissions of the users; Record the access and operation logs of users for auditing and tracking, and send an alarm prompt when unauthorized access or abnormal operations are detected.

10. An art design method based on VR technology, characterized in that, Including: Utilize natural language processing technology, built-in automatic image acquisition chips, and multi-feature fusion and adaptive thresholding to obtain the omnidirectional information data of cultural and creative products, and the omnidirectional information data includes text data, image data, and video data; According to the omnidirectional information data, obtain the encoded light wave information through a wavefront reconstruction algorithm, and utilize the principle of optical interference. According to the encoded light wave information and the reference light wave, obtain a hologram, and then use a laser source to irradiate the hologram to obtain the three-dimensional stereoscopic image of the cultural and creative product, and project the three-dimensional stereoscopic image on a holographic display screen; Real-time monitor the position change data of each user in the three-dimensional space and construct a space map, and fuse the three-dimensional image of the cultural and creative product with the space map to provide an independent or collaborative interaction experience; Automatically adjust the control instructions according to the specific gesture actions of each user to dynamically adjust the three-dimensional image of the cultural and creative product on the holographic display screen; Manage and update the omnidirectional information data of the cultural and creative products of the data acquisition module; Authenticate the users using biometric technology, and only allow authorized users to access and interact with the three-dimensional stereoscopic images of the cultural and creative products.

Images