A system for constructing immersive cultural tourism experiences based on digital cultural and creative interactions

Abstract

This application provides a system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction, relating to the field of digital cultural and creative interaction technology. The system collects virtual reality image information of the target cultural tourism site and generates a digital cultural and creative information database based on this information. It collects interaction data from the target user, extracts the sensitivity of the digital cultural and creative information database based on this data to obtain unit sensitivity values, and determines personalized sensitivity masks based on these unit sensitivity values. It acquires environmental information of the target cultural tourism scene, targets the virtual reality image information of the target cultural tourism site using the personalized sensitivity masks and environmental information, and obtains personalized sequence images of the target user during the immersive cultural tourism experience. Based on these personalized sequence images, it determines virtual interactive images. The virtual interactive images are then input into a preset virtual reality terminal, outputting immersive cultural tourism experience images to the target user. This application can enhance the user's immersive experience by incorporating user interests and preferences, achieving personalized dissemination of cultural tourism content.

Description

Technical Field

[0001] This application relates to the field of digital cultural and creative interactive technology, and more specifically, to a system for constructing an immersive cultural and tourism experience based on digital cultural and creative interaction. Background Technology

[0002] Existing immersive cultural tourism experiences based on digital cultural and creative interactions primarily rely on multimedia display methods such as virtual reality (VR), augmented reality (AR), and holographic projection to present digitized cultural and tourism resources to users in a visual way. Basic interaction between users and cultural and creative content is achieved through voice control, touch interaction, and motion capture. Simultaneously, some systems introduce digital human narration, panoramic tours, and scripted guidance to enhance user participation, allowing users to experience history, culture, natural landscapes, and local customs in an immersive space, thus shifting the experience from passive viewing to active participation.

[0003] However, existing immersive cultural tourism experience technologies based on digital cultural and creative interactions, while achieving visualization and basic interaction of cultural resources, still have shortcomings in terms of personalized user perception, accurate matching of cultural content, and depth of multi-dimensional experience. They lack a deep understanding and mapping mechanism of user interests and behaviors, making it difficult to dynamically adjust the key areas and expression methods of content display, resulting in limited immersion and cultural engagement. Therefore, how to combine user interests and preferences to enhance user immersion and achieve personalized dissemination of cultural tourism content is a challenge facing the industry. Summary of the Invention

[0004] This application provides a system for constructing an immersive cultural and tourism experience based on digital cultural and creative interaction, which can enhance the user's sense of immersion by combining the user's interest characteristics and realize the personalized presentation of cultural and tourism content.

[0005] This application provides a system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction, the system comprising:

[0006] The data acquisition module is used to collect virtual reality image information of the target cultural tourism, and generate a digital cultural and creative information database based on the virtual reality image information;

[0007] The mask generation module is used to collect the interaction data of the target user, extract the meaning sensitivity of the digital cultural and creative information database based on the interaction data, obtain the meaning sensitivity values ​​of each unit of the target user in the cultural and tourism immersive experience, and then determine the personalized meaning sensitivity mask of the target user in the cultural and tourism immersive experience based on all the unit meaning sensitivity values.

[0008] The image determination module is used to acquire environmental information of the target cultural and tourism scene, target the virtual reality image information of the target cultural and tourism scene with the personalized sensitivity mask and the environmental information of the target cultural and tourism scene, obtain the personalized sequence image of the target user in the cultural and tourism immersive experience, and then determine the virtual interactive image of the target user in the cultural and tourism immersive experience based on the personalized sequence image.

[0009] The image output module is used to input the virtual interactive image into a preset virtual reality terminal, and then output the cultural and tourism immersive experience image to the target user.

[0010] In this embodiment, collecting virtual reality image information of the target cultural tourism site specifically includes:

[0011] The target cultural and tourism scene is scanned and photographed using LiDAR and high-definition cameras to obtain 3D point cloud data and high-definition images of the target cultural and tourism scene.

[0012] A three-dimensional mesh model of the target cultural and tourism scene is generated based on a multi-view image reconstruction algorithm, thereby obtaining a cultural and tourism virtual reality image of the target cultural and tourism scene;

[0013] The virtual reality image information of the target cultural tourism destination is determined by using the three-dimensional point cloud data, the three-dimensional mesh model, the cultural tourism virtual reality image, and the high-definition image.

[0014] In this embodiment, generating a digital cultural and creative information database based on the virtual reality image information specifically includes:

[0015] Semantic segmentation and cultural attribute labeling are performed on the virtual reality images of cultural tourism in the target cultural tourism information to obtain various cultural and creative units;

[0016] All cultural and creative units are transformed into feature vectors to obtain multi-dimensional unit vectors, thereby generating a digital cultural and creative information database.

[0017] In this embodiment, the target user's interaction data includes: the target user's body movements, gestures, and gaze area.

[0018] In this embodiment, the intention sensitivity extraction of the digital cultural and creative information database based on the interaction data to obtain the intention sensitivity values ​​of the target user in each unit of the immersive cultural and tourism experience specifically includes:

[0019] The target user's various interest vectors are encoded through the interactive data;

[0020] Based on the target user's various interest vectors, the virtual reality image information of the target cultural tourism is filtered to obtain the target user's various interest-sensitive images;

[0021] Based on the target user's various sensory images and digital cultural and creative information database, determine the sensory sensitivity values ​​of the target user in each unit of the immersive cultural and tourism experience.

[0022] In this embodiment, determining the personalized sensitivity mask for the virtual reality image information of the target cultural tourism based on all unit sensitivity values ​​specifically includes:

[0023] Obtain the cultural and tourism image units corresponding to the sensitivity values ​​of each unit;

[0024] Based on the cultural and tourism image weight map corresponding to all unit sensitivity values, determine the personalized sensitivity mask of the target user in the process of immersive cultural and tourism experience;

[0025] Based on the cultural and tourism image weight map corresponding to all unit sensitivity values, determine the personalized sensitivity mask of the target user during the immersive cultural and tourism experience.

[0026] In this embodiment, the personalized sequence of images of the target cultural tourism virtual reality image information is region-targeted using the personalized sensitivity mask to obtain the target user's personalized sequence of images during the immersive cultural tourism experience. Specifically, this includes:

[0027] The personalized sensitivity mask is used to perform mask mapping on the virtual reality images of cultural tourism in the virtual reality image information of the target cultural tourism, to obtain the sensitivity label mapping map;

[0028] The environmental weights are determined based on the environmental information of the target cultural and tourism scenario.

[0029] By targeting the cultural and tourism virtual reality images using the aforementioned mind-sensitive label mapping map and the aforementioned environmental weights, personalized sequence images of the target user during the immersive cultural and tourism experience are obtained.

[0030] In this embodiment, determining the virtual interactive images of the target user during the immersive cultural and tourism experience based on the personalized sequence images specifically includes:

[0031] The rendering sequence of cultural and tourism virtual reality images in the virtual reality image information is determined based on the personalized sequence images;

[0032] The virtual interactive images of the target user during the immersive cultural and tourism experience are determined based on the rendering sequence.

[0033] In this embodiment, inputting the virtual interactive image into a preset virtual reality terminal involves encoding the virtual interactive image to obtain a rendered image that supports the preset virtual reality terminal. The rendered image is then transmitted to the virtual reality terminal to output an immersive cultural and tourism experience image to the target user.

[0034] In this embodiment, the immersive cultural and tourism experience image refers to a rendered, personalized, immersive virtual interactive image for the target user.

[0035] The technical solutions provided by the embodiments disclosed in this application have the following beneficial effects:

[0036] The system employs a data acquisition module to collect virtual reality image information of the target cultural tourism destination and generates a digital cultural and creative information database based on this information. A mask generation module collects interaction data from the target user and performs sensitivity extraction on the digital cultural and creative information database based on this data. This yields the sensitivity values ​​of each unit of the target user during the immersive cultural tourism experience, and then determines a personalized sensitivity mask for the target user based on all the sensitivity values. An image determination module acquires environmental information of the target cultural tourism scene and uses the personalized sensitivity mask and the environmental information of the target cultural tourism scene to target the virtual reality image information of the target cultural tourism destination, obtaining a personalized sequence of images for the target user during the immersive cultural tourism experience. Based on these personalized sequence images, the system determines the virtual interactive images for the target user during the immersive cultural tourism experience. An image output module inputs the virtual interactive images into a preset virtual reality terminal and then outputs the immersive cultural tourism experience images to the target user.

[0037] Therefore, this application firstly, by collecting virtual reality image information of the target cultural tourism resources, a highly realistic 3D visual scene is constructed. Combined with semantic segmentation and cultural annotation technologies, a structured digital cultural and creative information database is generated. This not only achieves high-precision digital modeling of cultural tourism resources but also provides fundamental support for subsequent personalized rendering and cultural semantic interaction. Secondly, by collecting interaction data of target users during the immersive experience and matching user interests with content in the digital cultural and creative information database based on a semantic sensitivity extraction mechanism, the semantic sensitivity value of each unit is calculated. This generates a personalized semantic sensitivity mask reflecting user interest hotspots, achieving personalized identification of the target user's attention area in the virtual reality image. This effectively enhances the targeting of image rendering and the accuracy of cultural content presentation, significantly improving the user's immersive participation. Then… By acquiring environmental information of the target cultural and tourism scene and combining it with personalized sensory masks to target virtual reality image information, a personalized sequence of images that match the user's interests and preferences is generated. Furthermore, semantic features are integrated for dynamic content adaptation, accurately generating virtual interactive images with cultural perception depth, thereby effectively enhancing the user's immersion in the immersive cultural and tourism experience. Finally, after encoding the generated virtual interactive images, they are adapted and transmitted to a preset virtual reality terminal, where image decoding and rendering are completed. The immersive cultural and tourism experience images are presented to the target user in real time, ensuring the smoothness and synchronization of image content during transmission and display. This effectively improves the immersive interaction quality of the cultural and tourism scene and the stability of system operation, allowing users to obtain a more immersive, interactive, and culturally expressive visual experience.

[0038] In summary, the technical solution adopted in this application can combine user interests and preferences to enhance the user's immersive experience and realize personalized dissemination of cultural and tourism content. Attached Figure Description

[0039] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only for this embodiment of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 This is a modular structure diagram of the cultural tourism immersive experience construction system based on digital cultural and creative interaction provided in this application;

[0041] Figure 2 This is an exemplary flowchart provided in this application for obtaining the sensitivity values ​​of target users in each unit of the immersive cultural and tourism experience process;

[0042] Figure 3 This is an exemplary flowchart provided in this application for obtaining personalized sequence images of target users during an immersive cultural and tourism experience. Detailed Implementation

[0043] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0044] This application provides a system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction. Its core is a data acquisition module that collects virtual reality image information of the target cultural tourism site and generates a digital cultural and creative information database based on this image information. A mask generation module collects interaction data from the target user and performs intention-sensitivity extraction on the digital cultural and creative information database based on this data to obtain the intention-sensitivity values ​​of each unit during the immersive cultural tourism experience. Then, based on all the unit intention-sensitivity values, a personalized intention-sensitivity mask for the target user during the immersive cultural tourism experience is determined. An image determination module acquires environmental information of the target cultural tourism scene and uses the personalized intention-sensitivity mask and the environmental information of the target cultural tourism scene to target the virtual reality image information of the target cultural tourism site, obtaining a personalized sequence of images for the target user during the immersive cultural tourism experience. Then, based on the personalized sequence of images, virtual interactive images for the target user during the immersive cultural tourism experience are determined. An image output module inputs the virtual interactive images into a preset virtual reality terminal and then outputs the immersive cultural tourism experience images to the target user. This solution can combine user interests and preferences to enhance the user's immersive experience and achieve personalized dissemination of cultural tourism content.

[0045] To better understand the above technical solutions, a detailed description of the technical solutions will be provided below in conjunction with the accompanying drawings and specific embodiments. (Refer to...) Figure 1 As shown in the figure, this is a modular structure diagram of a cultural tourism immersive experience construction system based on digital cultural and creative interaction according to this embodiment of the application. The experience construction system includes: a data acquisition module 100, a mask generation module 200, an image determination module 300, and an image output module 400, which are described below:

[0046] The data acquisition module 100 is used to acquire virtual reality image information of the target cultural tourism and generate a digital cultural and creative information database based on the virtual reality image information.

[0047] In this embodiment, the acquisition of virtual reality image information of the target cultural tourism site can be achieved through the following steps:

[0048] The target cultural and tourism scene is scanned and photographed using LiDAR and high-definition cameras to obtain 3D point cloud data and high-definition images of the target cultural and tourism scene.

[0049] A three-dimensional mesh model of the target cultural and tourism scene is generated based on a multi-view image reconstruction algorithm, thereby obtaining a cultural and tourism virtual reality image of the target cultural and tourism scene;

[0050] The virtual reality image information of the target cultural tourism destination is determined by using the three-dimensional point cloud data, the three-dimensional mesh model, the cultural tourism virtual reality image, and the high-definition image.

[0051] In practical implementation, firstly, the target cultural and tourism scene can be scanned and photographed using LiDAR and high-definition cameras to obtain 3D point cloud data and high-definition images of the scene. Specifically, LiDAR can scan the scene to obtain 3D point cloud data, which includes the scene's 3D coordinates and reflection intensity. High-definition cameras are used to capture images of the scene from multiple angles to obtain high-definition images. Then, a 3D mesh model of the scene can be generated using a multi-view image reconstruction algorithm, resulting in a virtual reality image of the scene. Specifically, the high-definition image can be used to generate sparse point cloud data using the SfM algorithm, and then dense point cloud data can be generated using MVS (Multi-View Stereo). The 3D and dense point cloud data are then combined and fused to obtain a high-precision 3D point cloud model, which is then used for Poisson reconstruction. The Reconstruction method generates a 3D mesh model of the target cultural tourism scene, then projects a high-resolution image of the target cultural tourism scene onto the surface of the 3D mesh model, generates a texture map on the surface of the 3D model to form a textured 3D cultural tourism model, and outputs the 3D cultural tourism model as a virtual reality image format to obtain a virtual reality image of the target cultural tourism scene. Finally, the virtual reality image information of the target cultural tourism scene can be determined by the 3D point cloud data, the 3D mesh model, the virtual reality image of the cultural tourism scene, and the high-resolution image. That is, the 3D point cloud data, the 3D mesh model, the virtual reality image of the cultural tourism scene, and the high-resolution image can be merged into a dataset, and the obtained dataset can be used as the virtual reality image information of the target cultural tourism scene.

[0052] In this embodiment, generating a digital cultural and creative information database based on the virtual reality image information can be achieved through the following steps:

[0053] Semantic segmentation and cultural attribute labeling are performed on the virtual reality images of cultural tourism in the target cultural tourism information to obtain various cultural and creative units;

[0054] All cultural and creative units are transformed into feature vectors to obtain multi-dimensional unit vectors, thereby generating a digital cultural and creative information database.

[0055] In practical implementation, the virtual reality images of cultural tourism in the target cultural tourism information can be semantically segmented and labeled with cultural attributes to obtain various cultural and creative units. Specifically, the virtual reality images of cultural tourism in the target cultural tourism information can be input into a semantic segmentation model (DeepLab) to segment objects in the images into independent regions, such as buildings, sculptures, murals, vegetation, roads, and portraits. Based on a pre-defined cultural tourism knowledge base, each segmented independent region is labeled with cultural attributes, such as historical period, art category, material, and cultural level. The labeled results are then mapped and associated with each independent region in the form of tags. The resulting associations are used as various cultural and creative units. It should be noted that a cultural and creative unit refers to a cultural element in the virtual reality scene that can be independently identified and invoked. Finally, all cultural and creative units can be converted into feature vectors to obtain various multi-dimensional unit vectors. This process generates a digital cultural and creative information database. Specifically, for each cultural and creative unit, its multimodal features are extracted, such as geometric features (area, curvature distribution), texture features (color histogram, local texture pattern), semantic features (cultural attribute tag encoding), and location features (spatial coordinates and azimuth in a 3D scene). In other words, geometric and location features of the cultural and creative unit can be extracted from the 3D point cloud data of the target cultural and tourism scene, texture features can be extracted from the high-definition image of the target cultural and tourism scene, and semantic features can be obtained by encoding and converting the cultural attribute tags of the cultural and creative unit. These geometric, texture, semantic, and location features are then used as vector elements to form a vector, which is then used as the multidimensional unit vector of the cultural and creative unit. All multidimensional unit vectors are stored in a database, which serves as the digital cultural and creative information database.

[0056] It should be noted that by collecting virtual reality image information of the target cultural and tourism resources, constructing a highly realistic three-dimensional visual scene, and combining semantic segmentation and cultural annotation technologies to generate a structured digital cultural and creative information database, not only is high-precision digital modeling of cultural and tourism resources achieved, but also basic support is provided for subsequent personalized rendering and cultural semantic interaction.

[0057] The mask generation module 200 is used to collect the interaction data of the target user, extract the meaning sensitivity of the digital cultural and creative information database based on the interaction data, obtain the meaning sensitivity values ​​of each unit of the target user in the cultural and tourism immersive experience process, and then determine the personalized meaning sensitivity mask of the target user in the cultural and tourism immersive experience process based on all the unit meaning sensitivity values.

[0058] In practice, the interaction data of the target user is collected. The interaction data of the target user includes the target user's body movements, gestures and gaze area. That is, the target user's gaze area can be collected through the eye tracking built into the virtual reality headset, and the target user's body movements and gestures can be collected through the motion tracking camera embedded in the virtual reality headset. Thus, the target user's body movements, gestures and gaze area are used as the target user's interaction data.

[0059] Preferably, in this embodiment, reference Figure 2 As shown, this diagram is an exemplary flowchart for obtaining the intention sensitivity values ​​of the target user in each unit of the immersive cultural and tourism experience in this embodiment of the application. In this embodiment, the intention sensitivity extraction of the digital cultural and creative information database based on the interaction data to obtain the intention sensitivity values ​​of the target user in each unit of the immersive cultural and tourism experience can be achieved through the following steps:

[0060] In step S21, the target user's interest vectors are encoded using the interactive data;

[0061] In step S22, the virtual reality image information of the target cultural tourism is filtered according to the target user's interest vectors to obtain the target user's interest-sensitive images.

[0062] In step S23, the sensitivity values ​​of each unit of the target user in the immersive cultural and tourism experience are determined based on the target user's various sensitivity images and digital cultural and creative information database.

[0063] In specific implementation, firstly, the target user's various interest vectors can be encoded through the interaction data. That is, quantifiable features can be extracted from the interaction data, namely, gaze area, gaze duration, and gesture type (click, swipe). The coordinates of the center pixel of the gaze area are then used as the gaze area coordinates. The gaze duration is normalized according to a preset gaze limit of 5 seconds to obtain a normalized gaze duration. The gesture type is numerically encoded, with click as 1 and swipe as 0, to obtain the gesture code. The gaze area coordinates, normalized gaze duration, and gesture code at the same time are then used as vector elements to form a vector, which is then used as the target user's... The user's interest vector is obtained, thus yielding individual interest vectors for each time point. Then, based on these interest vectors, virtual reality image information of the target cultural and tourism sector can be filtered to obtain individual attention-sensitive images for the target user. Specifically, for each interest vector, the gaze region coordinates within the interest vector are mapped and extracted to the cultural and tourism virtual reality image at the same time. This involves extracting virtual reality images within a 0.5m range of the gaze region coordinates from the cultural and tourism virtual reality image, and using these extracted virtual reality images as the attention-sensitive images corresponding to the interest vector, thereby obtaining the individual attention-sensitive images for the target user.

[0064] Furthermore, in practical implementation, the unit sensitivity values ​​of the target user during the immersive cultural tourism experience can be determined based on the target user's various sensitivity images and the digital cultural and creative information database. The unit sensitivity value refers to the target user's level of attention to the cultural tourism scene. Specifically, for each sensitivity image of the target user, all positional features within the range of that sensitivity image can be extracted from the digital cultural and creative information database. The multi-dimensional unit vectors corresponding to each positional feature are then used as the multi-dimensional unit vectors within the sensitivity image region. The unit sensitivity value can be calculated using the positional features of each multi-dimensional unit vector and the regional coordinates of the sensitivity image. The regional coordinates of the sensitivity image are the gaze region coordinates of the interest vector corresponding to that sensitivity image. Therefore, for each multi-dimensional unit vector, the sensitivity of the sensitivity image to that multi-dimensional unit vector can be calculated using the following formula:

[0065]

[0066] in, This represents the sensitivity of the meaning-sensitive image to the i-th multidimensional unit vector; Represents the x-coordinate of the i-th multidimensional unit vector; Represents the ordinate of the i-th multidimensional unit vector; The x-coordinate of the image is represented; The vertical axis represents the intention-sensitive image. It should be noted that intention sensitivity refers to the similarity between the target user's interest vector and the multidimensional unit vector. Thus, the intention sensitivity of the intention-sensitive image is obtained. The maximum value among the various intention sensitivity values ​​is selected as the unit intention sensitivity value corresponding to the intention-sensitive image. Based on the above steps, the unit intention sensitivity values ​​corresponding to all intention-sensitive images can be obtained, that is, the unit intention sensitivity values ​​of the target user in the process of immersive cultural and tourism experience.

[0067] In this embodiment, determining the personalized sensitivity mask for the virtual reality image information of the target cultural tourism based on all unit sensitivity values ​​can be achieved through the following steps:

[0068] Obtain the cultural and tourism image units corresponding to the sensitivity values ​​of each unit;

[0069] Based on the corresponding cultural and tourism image units, generate cultural and tourism image weight maps corresponding to the sensitivity values ​​of each unit;

[0070] Based on the cultural and tourism image weight map corresponding to all unit sensitivity values, determine the personalized sensitivity mask of the target user during the immersive cultural and tourism experience.

[0071] In specific implementation, firstly, the cultural and tourism image units corresponding to each unit's sensitivity value can be obtained. That is, for all unit sensitivity values, the multi-dimensional unit vector corresponding to the unit's sensitivity value can be obtained, and the cultural and tourism virtual reality image region corresponding to the multi-dimensional unit vector can be taken as the cultural and tourism image unit, thus obtaining the cultural and tourism image units corresponding to all unit sensitivity values. Then, a cultural and tourism image weight map corresponding to each unit's sensitivity value can be generated based on the corresponding cultural and tourism image units. That is, the unit sensitivity value of the corresponding cultural and tourism image unit can be normalized, and the result of the normalization process can be used as the weight of each pixel in the cultural and tourism image unit corresponding to the unit's sensitivity value, thus obtaining the cultural and tourism image weight map corresponding to the unit's sensitivity value, thus obtaining the cultural and tourism image weight map corresponding to each unit's sensitivity value.

[0072] In addition, in specific implementation, the personalized sensitivity mask of the target user in the immersive cultural tourism experience can be determined based on the cultural tourism image weight map corresponding to all unit sensitivity values. That is, all cultural tourism image weight maps can be stitched together, that is, all cultural tourism image weight maps can be aligned and stitched according to the coordinates of the cultural tourism virtual reality image. For areas not covered by the cultural tourism image weight map, a value of 0 is assigned. The weights corresponding to each pixel in the obtained image are normalized, and the processed image is used as the sensitivity response map. Then, a sensitivity level threshold is preset, such as: threshold T1 is one-third of the maximum weight value in the sensitivity response map, threshold T2 is two-thirds of the maximum weight value in the sensitivity response map, thereby normalizing the weights of each pixel in the sensitivity response map. The system divides each pixel into several parts. For all pixels, pixels with weight values ​​less than the sensitivity threshold T1 are marked as low sensitivity level; pixels with weight values ​​between the sensitivity thresholds T1 and T2 are marked as medium sensitivity level; and pixels with weight values ​​greater than the sensitivity threshold T2 are marked as high sensitivity level. This process yields the sensitivity levels of all pixels. The sensitivity levels of all pixels are then aligned with their corresponding pixels to obtain a personalized sensitivity mask for the virtual reality image information of the target cultural tourism area. It should be noted that the personalized sensitivity mask refers to a two-dimensional image that reflects the user's sensitivity level in each area.

[0073] It should be noted that by collecting interaction data of target users during the immersive experience, and matching user interests with content in the digital cultural and creative information database based on the intention-sensitivity extraction mechanism, the intention-sensitivity value of each unit is calculated, thereby generating a personalized intention-sensitivity mask that reflects the hot spots of user interests. This achieves personalized recognition of the target user's attention area in the virtual reality image, effectively enhancing the targeting of image rendering and the accuracy of cultural content presentation, and significantly improving the user's sense of immersion and participation.

[0074] The image determination module 300 is used to acquire environmental information of the target cultural and tourism scene, target the virtual reality image information of the target cultural and tourism scene with the personalized sensitivity mask and the environmental information of the target cultural and tourism scene, obtain the personalized sequence image of the target user in the process of cultural and tourism immersion, and then determine the virtual interactive image of the target user in the process of cultural and tourism immersion based on the personalized sequence image.

[0075] In practical implementation, the environmental information of the target cultural and tourism scene can be obtained by extracting the environmental information of the target cultural and tourism scene from historical environmental data. The environmental information includes: light intensity and weather.

[0076] Preferably, in this embodiment, reference Figure 3 As shown, this figure is an exemplary flowchart of obtaining a personalized sequence of images of a target user during an immersive cultural and tourism experience in this embodiment of the application. In this embodiment, the virtual reality image information of the target cultural and tourism scene is targeted by the personalized sensitivity mask and the environmental information of the target cultural and tourism scene to obtain a personalized sequence of images of the target user during an immersive cultural and tourism experience. This can be achieved by the following steps:

[0077] In step S31, the personalized meaning-sensitive mask is used to perform mask mapping on the virtual reality images of cultural tourism in the virtual reality image information of the target cultural tourism, so as to obtain the meaning-sensitive label mapping map;

[0078] In step S32, environmental weights are determined based on the environmental information of the target cultural and tourism scene;

[0079] In step S33, the cultural and tourism virtual reality images are targeted using the intention-sensitive label mapping map and the environmental weights to obtain personalized sequence images of the target user during the immersive cultural and tourism experience.

[0080] In specific implementation, firstly, the personalized sensitivity mask can be used to mask and map the virtual reality images of cultural tourism in the target cultural tourism virtual reality image information to obtain a sensitivity label mapping map. That is, the personalized sensitivity mask can be mapped onto the virtual reality images of cultural tourism in the target cultural tourism virtual reality image information, and each pixel has a sensitivity level. The resulting virtual display image is used as the sensitivity label mapping map. Then, environmental weights can be constructed based on the environmental information of the target cultural tourism scene. That is, the light intensity in the environmental information can be used to determine the light factor weight. The light intensity in the environmental information is standardized, and the result is used as the light factor weight. The weather factor weight is determined based on the weather in the environmental information, such as: sunny day, weather factor weight is 1; cloudy day, weather factor weight is 0.6; rainy day, weather factor weight is 0. 4) The obtained weather factor weights and illumination factor weights are multiplied together, and the result is used as the environmental weight of the target cultural tourism scene. Finally, the cultural tourism virtual reality image can be targeted using the aforementioned sensitivity label mapping map and the environmental weight to obtain the personalized sequence image of the target user during the immersive cultural tourism experience. That is, all pixels with high sensitivity levels can be connected and analyzed to extract pixel regions with high sensitivity levels. The environmental weight is multiplied by the weight of all pixels in each extracted pixel region to obtain the comprehensive weight of all pixels. The extracted pixel regions are then targeted, such as by color highlighting and border description. The pixel regions of each target are then arranged according to the target user's gaze time, with the longer the gaze time, the last in the order. This yields the personalized sequence image of the target user during the immersive cultural tourism experience.

[0081] In this embodiment, determining the virtual interactive images of the target user during the immersive cultural and tourism experience based on the personalized sequence images can be achieved in the following way:

[0082] The rendering sequence of cultural and tourism virtual reality images in the virtual reality image information is determined based on the personalized sequence images;

[0083] The virtual interactive images of the target user during the immersive cultural and tourism experience are determined based on the rendering sequence.

[0084] In specific implementation, firstly, the rendering sequence of cultural and tourism virtual reality images in the virtual reality image information can be determined based on the personalized sequence images. That is, the sum of the comprehensive weights corresponding to each pixel region in the personalized sequence images can be calculated, and then the sum of the comprehensive weights corresponding to each pixel region can be divided by the sum of the pixels in the corresponding pixel region to obtain the average weight value of each pixel region. Then, the average weight values ​​of each pixel region are sorted according to the average weight values ​​from high to low, and the sorting result is used as the rendering sequence of cultural and tourism virtual reality images. Then, the virtual interactive images of the target user in the cultural and tourism immersive experience process are determined based on the rendering sequence. That is, the rendering sequence can be supplemented with content, that is, the semantic features in the multi-dimensional unit vectors corresponding to each pixel region in the rendering sequence are extracted, and each semantic feature is attached as a click tag to the corresponding pixel region to obtain the virtual image sequence of the target user in the cultural and tourism immersive experience process. The virtual image sequence is mapped back to the cultural and tourism virtual reality images to obtain the virtual interactive images of the target user in the cultural and tourism immersive experience process. It should be noted that the virtual interactive images include the target user's personalized cultural and tourism virtual images and the semantic feature tags corresponding to the cultural and tourism virtual images.

[0085] It should be noted that by acquiring environmental information of the target cultural and tourism scene, and combining it with personalized sensory masks to target virtual reality image information in different regions, personalized sequence images that match user interests and preferences are generated. Furthermore, semantic features are integrated for dynamic content adaptation, accurately generating virtual interactive images with cultural perception depth, thereby effectively enhancing the user's sense of immersion in the immersive cultural and tourism experience.

[0086] The image output module 400 is used to input the virtual interactive image into a preset virtual reality terminal, and then output the cultural and tourism immersive experience image to the target user.

[0087] In this embodiment, inputting the virtual interactive image into a preset virtual reality terminal involves encoding the virtual interactive image to obtain a rendered image that supports the preset virtual reality terminal. The rendered image is then transmitted to the virtual reality terminal to output an immersive cultural and tourism experience image to the target user. Specifically, the virtual interactive image can be encoded to generate a rendered image that supports the virtual reality terminal, which is then transmitted wirelessly to the preset virtual reality terminal. It should be noted that the virtual reality terminal is a VR headset. The rendered image transmitted to the virtual reality terminal is then mapped and loaded into a local rendering buffer and output to the display module built into the virtual reality terminal, thereby outputting an immersive cultural and tourism experience image to the target user. This immersive cultural and tourism experience image refers to a personalized immersive virtual interactive image for the target user after rendering.

[0088] It should be noted that by encoding the generated virtual interactive images and then transmitting them to a preset virtual reality terminal, the terminal completes image decoding and rendering output, presenting immersive cultural and tourism experience images to the target user in real time. This ensures the smoothness and synchronization of image content during transmission and display, effectively improving the immersive interactive quality of cultural and tourism scenes and the stability of system operation, allowing users to obtain a more immersive, interactive, and culturally expressive visual experience.

[0089] Therefore, this application firstly, by collecting virtual reality image information of the target cultural tourism resources, a highly realistic 3D visual scene is constructed. Combined with semantic segmentation and cultural annotation technologies, a structured digital cultural and creative information database is generated. This not only achieves high-precision digital modeling of cultural tourism resources but also provides fundamental support for subsequent personalized rendering and cultural semantic interaction. Secondly, by collecting interaction data of target users during the immersive experience and matching user interests with content in the digital cultural and creative information database based on a semantic sensitivity extraction mechanism, the semantic sensitivity value of each unit is calculated. This generates a personalized semantic sensitivity mask reflecting user interest hotspots, achieving personalized identification of the target user's attention area in the virtual reality image. This effectively enhances the targeting of image rendering and the accuracy of cultural content presentation, significantly improving the user's immersive participation. Then… By acquiring environmental information of the target cultural and tourism scene and combining it with personalized sensory masks to target virtual reality image information, a personalized sequence of images that match the user's interests and preferences is generated. Furthermore, semantic features are integrated for dynamic content adaptation, accurately generating virtual interactive images with cultural perception depth, thereby effectively enhancing the user's immersion in the immersive cultural and tourism experience. Finally, after encoding the generated virtual interactive images, they are adapted and transmitted to a preset virtual reality terminal, where image decoding and rendering are completed. The immersive cultural and tourism experience images are presented to the target user in real time, ensuring the smoothness and synchronization of image content during transmission and display. This effectively improves the immersive interaction quality of the cultural and tourism scene and the stability of system operation, allowing users to obtain a more immersive, interactive, and culturally expressive visual experience.

[0090] In summary, the technical solution adopted in this application can combine user interests and preferences to enhance the user's immersive experience and realize personalized dissemination of cultural and tourism content.

[0091] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0092] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compactdisc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

[0093] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

Claims

1. A system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction, characterized in that, The construction system includes: The data acquisition module is used to collect virtual reality image information of the target cultural tourism, and generate a digital cultural and creative information database based on the virtual reality image information; A mask generation module is used to collect interaction data from target users, extract the sensitivity of the digital cultural and creative information database based on the interaction data, obtain the sensitivity values ​​of each unit of the target user during the immersive cultural and tourism experience, and then determine the personalized sensitivity mask of the target user during the immersive cultural and tourism experience based on all the unit sensitivity values. The personalized sensitivity mask refers to a two-dimensional image reflecting the user's sensitivity level in each area. Specifically, determining the personalized sensitivity mask of the target user during the immersive cultural and tourism experience based on all the unit sensitivity values ​​includes: Obtain the cultural and tourism image units corresponding to the sensitivity values ​​of each unit; Based on the corresponding cultural and tourism image units, generate cultural and tourism image weight maps corresponding to the sensitivity values ​​of each unit; Based on the cultural and tourism image weight map corresponding to all unit sensitivity values, determine the personalized sensitivity mask of the target user in the process of immersive cultural and tourism experience; The image determination module is used to acquire environmental information of the target cultural and tourism scene, and to target the virtual reality image information of the target cultural and tourism scene using the personalized sensitivity mask and the environmental information of the target cultural and tourism scene to obtain a personalized sequence of images of the target user during the immersive cultural and tourism experience. Specifically, the process of targeting the virtual reality image information of the target cultural and tourism scene using the personalized sensitivity mask and the environmental information of the target cultural and tourism scene to obtain a personalized sequence of images of the target user during the immersive cultural and tourism experience includes: The personalized sensitivity mask is used to perform mask mapping on the virtual reality images of cultural tourism in the virtual reality image information of the target cultural tourism, to obtain the sensitivity label mapping map; The environmental weights are determined based on the environmental information of the target cultural and tourism scenario. By targeting the cultural and tourism virtual reality images using the aforementioned mind-sensitive label mapping map and the aforementioned environmental weights, a personalized sequence of images of the target user during the immersive cultural and tourism experience is obtained, and then the virtual interactive images of the target user during the immersive cultural and tourism experience are determined based on the personalized sequence images. The image output module is used to input the virtual interactive image into a preset virtual reality terminal, and then output the cultural and tourism immersive experience image to the target user.

2. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, The collection of virtual reality image information of the target cultural and tourism sites specifically includes: The target cultural and tourism scene is scanned and photographed using LiDAR and high-definition cameras to obtain 3D point cloud data and high-definition images of the target cultural and tourism scene. A three-dimensional mesh model of the target cultural and tourism scene is generated based on a multi-view image reconstruction algorithm, thereby obtaining a cultural and tourism virtual reality image of the target cultural and tourism scene; The virtual reality image information of the target cultural tourism destination is determined by using the three-dimensional point cloud data, the three-dimensional mesh model, the cultural tourism virtual reality image, and the high-definition image.

3. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, Generating a digital cultural and creative information database based on the virtual reality image information specifically includes: Semantic segmentation and cultural attribute labeling are performed on the virtual reality images of cultural tourism in the target cultural tourism information to obtain various cultural and creative units; All cultural and creative units are transformed into feature vectors to obtain multi-dimensional unit vectors, thereby generating a digital cultural and creative information database.

4. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, The target user's interaction data includes: the target user's body movements, gestures, and gaze area.

5. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, Based on the interaction data, the digital cultural and creative information database is subjected to intention sensitivity extraction to obtain the intention sensitivity values ​​of the target user in each unit of the immersive cultural and tourism experience process. Specifically, these values ​​include: The target user's various interest vectors are encoded through the interactive data; Based on the target user's various interest vectors, the virtual reality image information of the target cultural tourism is filtered to obtain the target user's various interest-sensitive images; Based on the target user's various sensory images and digital cultural and creative information database, determine the sensory sensitivity values ​​of the target user in each unit during the immersive cultural and tourism experience.

6. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, Determining the virtual interactive images of the target user during the immersive cultural and tourism experience based on the personalized sequence images specifically includes: The rendering sequence of cultural and tourism virtual reality images in the virtual reality image information is determined based on the personalized sequence images; The virtual interactive images of the target user during the immersive cultural and tourism experience are determined based on the rendering sequence.

7. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, Inputting the virtual interactive image into a preset virtual reality terminal involves encoding the virtual interactive image to obtain a rendered image that supports the preset virtual reality terminal. The rendered image is then transmitted to the virtual reality terminal to output an immersive cultural and tourism experience image to the target user.

8. The system for constructing an immersive cultural tourism experience based on digital cultural and creative interaction as described in claim 1, characterized in that, The immersive cultural and tourism experience images refer to personalized, immersive virtual interactive images for target users after rendering.

Images