Cultural communication interaction method and device

Abstract

The invention relates to the field of culture communication interaction, and particularly discloses a culture communication interaction method and device, which are characterized in that a virtual culture exhibition is designed and built, so that a user can enjoy an exhibit at a short distance in a virtual culture exhibition space and obtain immersive culture experience; the instruction information of the user in the moving process in the virtual culture exhibition space is recognized and processed, navigation and browsing services are provided for the user, and the experience feeling is improved; the hand action and voice content of the user in the process of visiting the exhibit in the virtual culture exhibition space are recognized and processed, so that the user can interact with the exhibit through gesture or voice control, and the experience feeling of the user is enhanced; according to the method, the browsing duration and the interaction frequency of the user browsing the virtual culture exhibition are obtained, hot culture themes, chunks and exhibits of the virtual culture exhibition are analyzed, the exhibition content and the interaction function can be optimized in a targeted mode, and the satisfaction degree and the loyalty degree of the user are better improved.

Description

Technical Field

[0001] The present invention relates to the field of cultural communication interaction, and more particularly to a cultural communication interaction method and device. Background Art

[0002] With the continuous progress of society and the improvement of people's living standards, people's demand for spiritual culture is growing. As an important way of cultural dissemination and communication, cultural exhibitions can meet people's needs for understanding and appreciation of different cultures and art forms, and also provide a platform for displaying precious cultural resources, so that more people can understand and recognize their value, thereby promoting cultural inheritance and protection.

[0003] With the continuous advancement of information technology, the increase in network bandwidth, the maturity of virtual reality technology, and the development of 3D modeling technology, technical guarantees have been provided for the realization of virtual cultural exhibitions. The application of these technologies has made the display effect of virtual exhibitions more and more realistic, and the user experience has become better and better.

[0004] However, existing virtual cultural exhibitions still have some limitations and shortcomings in practical applications.

[0005] For example, the existing Chinese patent with publication number CN114758597A discloses a cultural communication and promotion system, including: a control module for receiving and transmitting signals and processing data information; a storage module for storing data of cultural content; an infrared detection module for detecting whether there are people moving within the infrared detection range, and sending the detected signal to the control module; a human-computer interaction module for human-computer interaction and inputting instructions; a display module for selecting and playing image data stored in the data in the storage module as needed; a voice module for playing corresponding voice data according to the image data; and a VR experience module for selecting and building a simulation scene as needed, and playing the simulation scene. The invention enables users to experience cultural content in an immersive way through the VR experience module, enhances the user's feelings and impressions, and thus brings an immersive and interactive experience to users.

[0006] However, the above patent has the following problems: 1. The interaction between users and exhibits is not strong, and no more interactive elements such as gestures, body movements and voice are set in the virtual cultural exhibition to enhance the audience's sense of participation, resulting in a low cultural experience for users; 2. The behavioral data of users browsing the virtual cultural exhibition, such as browsing time, interaction frequency, etc., are not fully utilized, and the user's interest preferences are not further analyzed, which is not conducive to the subsequent optimization of the virtual cultural exhibition content and interactive functions, and cannot better improve the audience's satisfaction and loyalty. Summary of the invention

[0007] In view of this, in order to solve the problems raised in the above background technology, a cultural communication interaction method and device are now proposed.

[0008] The technical solution adopted by the present invention to solve its technical problems is: in the first aspect, the present invention provides a cultural communication interaction method, comprising the following steps: Step 1, virtual cultural exhibition theme and content acquisition: acquiring each cultural theme of the virtual cultural exhibition, each block of each cultural theme, and content information of each block of each cultural theme, wherein the content information includes pictures, videos and text materials of each exhibit.

[0009] Step 2: Design and build a virtual cultural exhibition: Based on the cultural theme, components and content information of the virtual cultural exhibition, use VR tools to build a virtual cultural exhibition space, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space to build a virtual cultural exhibition.

[0010] Step 3: User navigation and browsing analysis and processing: When the user wears the VR device and is placed in the virtual cultural exhibition space, the command information of the user during the movement in the virtual cultural exhibition space is obtained, where the command information includes head movements, hand movements, leg movements and voice content, and is recognized and processed to analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and the virtual cultural exhibition space responds accordingly.

[0011] Step 4: Analysis and processing of user-exhibit interaction: Obtain the user's hand movements and voice content during the virtual cultural exhibition space's visit to the exhibits, perform recognition processing, analyze the exhibits selected by the user and the operations performed on the selected exhibits during the user's visit to the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0012] Step 5: Analysis of user browsing interest preferences: Obtain the total number of users who browse each cultural theme, each block, and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks, and popular exhibits of the virtual cultural exhibition, and provide feedback.

[0013] In a second aspect, the present invention also provides a cultural communication interaction device, including: a virtual cultural exhibition theme and content acquisition module: used to obtain each cultural theme of the virtual cultural exhibition, each block of each cultural theme, and content information of each block of each cultural theme, wherein the content information includes pictures, videos and text materials of each exhibit.

[0014] Virtual cultural exhibition design and construction module: used to build a virtual cultural exhibition space using VR tools according to the cultural theme, blocks and content information of the virtual cultural exhibition, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space, and build a virtual cultural exhibition.

[0015] User navigation and browsing analysis and processing module: When a user wears a VR device and is placed in a virtual cultural exhibition space, it obtains the user's command information during the movement in the virtual cultural exhibition space, where the command information includes head movements, hand movements, leg movements and voice content, and performs recognition and processing to analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0016] User and exhibit interaction analysis and processing module: used to obtain the hand movements and voice content of users in the process of visiting exhibits in the virtual cultural exhibition space, perform recognition processing, analyze the exhibits selected by users and the operations performed on the selected exhibits in the process of visiting exhibits in the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0017] User browsing interest preference analysis module: used to obtain the total number of users who browse each cultural theme, each block and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks and popular exhibits of the virtual cultural exhibition, and provide feedback.

[0018] Database: used to store the style type and layout type of the exhibition hall corresponding to each cultural theme, and store the directional hand movement library, directional leg movement library, orientation vocabulary library, the iconic hand movement library corresponding to the selected exhibits, and store the characteristic vocabulary library of each exhibit in each block of each cultural theme of the virtual cultural exhibition, and store the specific gesture library and specific description vocabulary library for operating the exhibits.

[0019] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. The present invention obtains the theme and content of the virtual cultural exhibition, and uses VR tools to design and build the virtual cultural exhibition, so that users can put themselves in the virtual cultural exhibition space by wearing VR equipment, and then appreciate cultural relics, artworks, etc. at close range, thereby obtaining an immersive cultural experience.

[0020] 2. The present invention identifies and processes the command information of the user during the movement of the virtual cultural exhibition space, analyzes the user's movement route and viewing angle of the exhibits, and provides navigation and browsing services to the user, so that the user can easily move and browse exhibits in the virtual cultural exhibition space, thereby enhancing the experience.

[0021] 3. The present invention recognizes and processes the hand movements and voice contents of users when visiting exhibits in a virtual cultural exhibition space, analyzes the exhibits selected by users and the operations performed on the selected exhibits, and can set more interactive elements in the virtual cultural exhibition, so that users can interact with the exhibits through gestures or voice control. Instead of passively viewing the exhibition content, users can actively participate in it, which greatly enhances the user experience.

[0022] 4. The present invention obtains the browsing time and number of interactions of users browsing the virtual cultural exhibition, analyzes the popular cultural themes, blocks, and exhibits of the virtual cultural exhibition, and is conducive to targeted optimization of the exhibition content and interactive functions, creating a colorful and interactive virtual cultural exhibition, bringing a new cultural experience to users, and better improving user satisfaction and loyalty. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0024] Figure 1 It is a schematic diagram of the method flow of the present invention.

[0025] Figure 2 It is a flow chart of step 2 of the present invention.

[0026] Figure 3 This is a connection diagram of the device modules of the present invention. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0028] See also Figure 1 and Figure 2 As shown, the first aspect of the present invention provides a cultural communication interaction method, comprising the following steps: Step 1, virtual cultural exhibition theme and content acquisition: acquiring each cultural theme of the virtual cultural exhibition, each block of each cultural theme, and content information of each block of each cultural theme, wherein the content information includes pictures, videos and text materials of each exhibit.

[0029] It should be noted that the various cultural themes of the virtual cultural exhibition include but are not limited to: historical periods, historical culture, regional culture, art schools, folk culture, art culture, etc., among which the various blocks of historical periods include ancient civilizations, medieval culture, etc., the various blocks of historical culture include ancient civilizations, culture of a specific historical period, local historical culture, etc., the various blocks of regional culture include Eastern culture, Western culture, African culture, etc.; the various blocks of art schools include Impressionism, Cubism, etc.; the various blocks of folk culture include traditional festivals, national customs, folk crafts, etc.; the various blocks of art culture include painting art, sculpture art, and comprehensive art, etc.

[0030] In a specific embodiment, a cultural theme of the virtual cultural exhibition is ancient Chinese ceramic culture, and various components of the cultural theme include dynasties, kilns, production techniques, historical development, cultural connotations, and the like.

[0031] It should be noted that the exhibits of each cultural theme and each component of the virtual cultural exhibition can be cultural relics, artworks or photos, etc.

[0032] It should be noted that the various cultural themes of the virtual cultural exhibition and the various components of each cultural theme are determined by the curator or project leader, and the content information of each cultural theme and each component of the virtual cultural exhibition can be provided by the curator or project leader or supplemented by searching from a third-party information sharing platform.

[0033] It should be noted that the curators or project leaders of virtual cultural exhibitions cooperate with museums, art galleries, collectors, etc. to obtain relevant cultural relics, artwork pictures, videos, text introductions and other materials.

[0034] Step 2: Design and build a virtual cultural exhibition: Based on the cultural theme, components and content information of the virtual cultural exhibition, use VR tools to build a virtual cultural exhibition space, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space to build a virtual cultural exhibition.

[0035] Exemplarily, the specific analysis process of step 2 is as follows: S1: selecting a VR tool for designing a virtual cultural exhibition.

[0036] It should be noted that the VR tools for designing virtual cultural exhibitions are professional VR development software, such as Unity, UnrealEngine, etc.

[0037] In another specific embodiment, the existing VR exhibition platform can also be used for secondary development to design a virtual cultural exhibition, while taking into account factors such as the compatibility, usability, and interactivity of the existing VR exhibition platform.

[0038] S2: Constructing a virtual cultural exhibition space: extracting the style type and layout type of the exhibition hall corresponding to each cultural theme stored in the database, screening out the style type and layout type corresponding to each cultural theme of the virtual cultural exhibition, and constructing a virtual cultural exhibition space.

[0039] It should be noted that, after the user selects and determines the cultural theme of the virtual cultural exhibition, the style and layout of the virtual cultural exhibition are unique.

[0040] It should be noted that the style and layout types of the exhibition halls corresponding to the cultural themes stored in the database are obtained based on the practical experience and results of the exhibition halls of existing museums, art galleries, etc.

[0041] In a specific embodiment, a cultural theme of the virtual cultural exhibition is ancient Chinese ceramic culture. The virtual cultural exhibition space can be designed as an antique Chinese exhibition hall with display facilities such as display cabinets and display racks. The decorative elements such as the walls and floors of the exhibition hall reflect the characteristics of traditional Chinese culture.

[0042] S3: Digital processing of exhibits: Digital processing of pictures, videos and text materials of each exhibit in each cultural theme and each block of the virtual cultural exhibition. Digital processing includes data collection, data processing, data modeling and integration, and displaying them in the virtual cultural exhibition space to build a virtual cultural exhibition.

[0043] It should be noted that data acquisition in the digital processing includes image acquisition and audio acquisition, data processing includes image optimization and audio processing, and data modeling and integration includes 3D modeling and rendering, data integration and annotation.

[0044] It should be noted that the image acquisition methods include but are not limited to multi-angle shooting, macro shooting, 3D scanning, etc.

[0045] It should be noted that the methods of audio collection include but are not limited to ambient sound recording, explanation audio recording, etc.

[0046] It should be noted that the image optimization methods include but are not limited to color correction, resolution adjustment, image stitching and restoration, etc.

[0047] It should be noted that the audio processing methods include but are not limited to noise reduction, volume adjustment and equalization.

[0048] It should be noted that the 3D modeling and rendering methods include but are not limited to model construction, material and lighting rendering, etc.

[0049] It should be noted that the methods of data integration and annotation include but are not limited to creating an exhibit database, data annotation, etc.

[0050] It should be noted that the pictures, videos and text materials of the exhibits are digitized to make them suitable for display in a VR environment.

[0051] In a specific embodiment, one of the cultural themes of the virtual cultural exhibition is ancient Chinese ceramic culture. When the pictures, videos and text materials of the exhibits are digitized, 3D modeling is performed on the pictures of the ceramic works to create panoramic pictures and videos to facilitate all-round appreciation of the exhibits. At the same time, interactive elements such as text descriptions and audio explanations are added to the exhibits.

[0052] It should be noted that the construction of virtual cultural exhibitions uses virtual reality and augmented reality technologies, and is equipped with corresponding VR equipment.

[0053] In this embodiment, the present invention obtains the theme and content of the virtual cultural exhibition and uses VR tools to design and build the virtual cultural exhibition, so that users can put themselves in the virtual cultural exhibition space by wearing VR equipment, and then appreciate cultural relics, artworks, etc. at close range, thereby obtaining an immersive cultural experience.

[0054] Step 3: User navigation and browsing analysis and processing: When the user wears the VR device and is placed in the virtual cultural exhibition space, the command information of the user during the movement in the virtual cultural exhibition space is obtained, where the command information includes head movements, hand movements, leg movements and voice content, and is recognized and processed to analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and the virtual cultural exhibition space responds accordingly.

[0055] Exemplarily, the specific analysis process of step three includes: obtaining the user's head movements during the movement in the virtual cultural exhibition space, further obtaining the angle and direction of the user's head rotation during the movement in the virtual cultural exhibition space, substituting them into the relationship between the preset head rotation angle and direction and the orientation, and obtaining the orientation corresponding to the user's head movements during the movement in the virtual cultural exhibition space.

[0056] It should be noted that the wearable VR devices that are used in virtual cultural exhibitions are equipped with a variety of sensors, such as handles with built-in accelerometers, gyroscopes and other sensors. By detecting the changes in acceleration of the handle in three axes, they can sense the movement state of the handle, such as rapid swinging and slow translation.

[0057] In a specific embodiment, the virtual cultural exhibition is equipped with an advanced full-body tracking system, which installs sensors on key parts of the user's body, such as the waist, knees, and wrists, and detects the relative position and movement between body parts to capture the user's full-body movements. For example, by installing small sensors on the user's joints, the system can accurately record the user's arm extension, leg kicking, and other movements.

[0058] In another specific embodiment, the virtual cultural exhibition is equipped with an external optical tracking system. In this system, multiple cameras are arranged around the VR device. The cameras emit infrared and other light rays. When the user wears reflective markers or special light-emitting devices, the cameras can capture the position changes of these reflective markers or light-emitting devices, and then obtain the user's body movements.

[0059] In a specific embodiment, the relationship between the angle and direction of the head rotation and the direction is presented in the form of a table. For example, if the head rotates 0°, the direction is straight ahead, if the head rotates 45° clockwise, the direction is right ahead, and if the head rotates 45° counterclockwise, the direction is left ahead.

[0060] It should be noted that the directions include but are not limited to: up, down, left, right, upper left, lower left, upper right, lower right, etc.

[0061] In another specific embodiment, the user can use an AR application on a mobile terminal such as a mobile phone to be in a virtual cultural exhibition space and obtain an immersive cultural experience.

[0062] In a specific embodiment, obvious signs and guides are also provided in the virtual cultural exhibition space so that users can quickly find exhibits of interest.

[0063] Exemplarily, the specific analysis process of step three also includes: obtaining the hand movements of the user during movement in the virtual cultural exhibition space, extracting the directional hand movement library stored in the database, and obtaining the direction corresponding to each hand movement in the directional hand movement library.

[0064] The hand movements of the user during the movement in the virtual cultural exhibition space are compared with the hand movements in the directional hand movement library, and the directions corresponding to the hand movements of the user during the movement in the virtual cultural exhibition space are analyzed.

[0065] Similarly, the directions corresponding to the leg movements of the user when moving in the virtual cultural exhibition space are obtained.

[0066] It should be noted that if the similarity between the hand movements of the user during the movement of the virtual cultural exhibition space and a hand movement in the directional hand movement library is greater than the set similarity threshold, then the hand movements of the user during the movement of the virtual cultural exhibition space belong to directional hand movements, and the direction corresponding to the hand movement in the directional hand movement library is used as the direction corresponding to the hand movement of the user during the movement of the virtual cultural exhibition space.

[0067] Exemplarily, the specific analysis process of step three also includes: obtaining the voice content of the user in the process of moving in the virtual cultural exhibition space, obtaining the keywords of the text corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space through voice recognition technology and keyword recognition technology, extracting the directional vocabulary stored in the database, comparing the keywords of the text corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space with the directional words in the directional vocabulary, and analyzing the direction corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space.

[0068] It should be noted that if a keyword in the text corresponding to the user's voice content during the movement of the virtual cultural exhibition space is the same as or a synonym of a directional word in the directional vocabulary, then the keyword in the text corresponding to the user's voice content during the movement of the virtual cultural exhibition space is a directional word, and the direction corresponding to the directional word is used as the direction corresponding to the user's voice content during the movement of the virtual cultural exhibition space.

[0069] Exemplarily, the specific analysis process of step three also includes: comparing the directions corresponding to the user's head movements, hand movements, leg movements and voice content during the movement of the virtual cultural exhibition space; if there are inconsistencies, setting the priorities of the directions corresponding to the head movements, hand movements, leg movements and voice content according to preset principles, and taking the direction corresponding to the highest priority as the user's intended direction during the movement of the virtual cultural exhibition space.

[0070] In a specific embodiment, the priority of the direction corresponding to the hand movement of the user in the process of moving in the virtual cultural exhibition space is higher than the priority of the direction corresponding to the head movement, leg movement and voice content.

[0071] It should be noted that not all of the user's head movements, hand movements, leg movements and voice content when moving in the virtual cultural exhibition space have directions. In practice, one or more of the head movements, hand movements, leg movements and voice content have directions.

[0072] The route from the user's current position in the virtual cultural exhibition space to the location of the exhibit corresponding to the intended direction is recorded as the user's movement route in the virtual cultural exhibition space, and the exhibit perspective corresponding to the user's intended direction during the user's movement in the virtual cultural exhibition space is recorded as the user's browsing exhibit perspective in the virtual cultural exhibition space.

[0073] It should be noted that the analysis of the user's intention direction during the movement of the virtual cultural exhibition space can be performed multiple times. If the result of the analysis of the user's intention direction during the movement of the virtual cultural exhibition space is incorrect, the user's instruction information during the movement of the virtual cultural exhibition space is obtained and analyzed a second time.

[0074] In this embodiment, the present invention identifies and processes the command information of the user during the movement of the virtual cultural exhibition space, analyzes the user's movement route and browsing perspective of the exhibits, and provides navigation and browsing services to the user, so that the user can easily move and browse exhibits in the virtual cultural exhibition space, thereby enhancing the experience.

[0075] Step 4: Analysis and processing of user-exhibit interaction: Obtain the user's hand movements and voice content during the virtual cultural exhibition space's visit to the exhibits, perform recognition processing, analyze the exhibits selected by the user and the operations performed on the selected exhibits during the user's visit to the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0076] Exemplarily, the specific analysis process of step four includes: D1: obtaining the hand movements of the user during the visit to the exhibits in the virtual cultural exhibition space, and comparing them with the hand movements in the iconic hand movement library corresponding to the selected exhibits stored in the database; if the hand movements of the user during the visit to the exhibits in the virtual cultural exhibition space are consistent with a hand movement in the iconic hand movement library corresponding to the selected exhibit, then the exhibits visited by the user in the virtual cultural exhibition space are the exhibits selected by the user.

[0077] In a specific embodiment, the iconic hand motion corresponding to selecting an exhibit includes but is not limited to a click motion, a touch motion, and the like.

[0078] D2: Extract the characteristic word library of each exhibit in each cultural theme and each block of the virtual cultural exhibition stored in the database, filter the characteristic word library of each exhibit in the area where the user is located during the process of visiting the exhibits in the virtual cultural exhibition space, and record it as the characteristic word library of each designated exhibit.

[0079] It should be noted that the characteristic words of the exhibits include but are not limited to words related to names, shapes, colors, patterns, and designs.

[0080] The keywords of the user's voice content during the visit to the exhibits in the virtual cultural exhibition space are obtained, and compared with the characteristic words in the characteristic word library of each designated exhibit to analyze the exhibits selected by the user.

[0081] It should be noted that if a keyword in the user's voice content during the process of visiting exhibits in the virtual cultural exhibition space is the same as or a synonym of a feature word in the feature vocabulary of a designated exhibit, then the keyword will be recorded as a matching keyword for the designated exhibit, and the number of matching keywords between the user's voice content and each designated exhibit during the process of visiting exhibits in the virtual cultural exhibition space will be counted, and the exhibit corresponding to the largest number of matching keywords will be selected as the exhibit selected by the user.

[0082] D3: Compare the selected exhibits corresponding to the hand movements and voice contents of the user during the process of visiting exhibits in the virtual cultural exhibition space. If there is any inconsistency, set the priority of the exhibits selected by the hand movements and voice contents, and use the selected exhibits corresponding to the highest priority as the exhibits selected by the user during the process of visiting exhibits in the virtual cultural exhibition space, and display pictures, videos and text materials of the selected exhibits.

[0083] In a specific embodiment, when a user clicks on a ceramic exhibit in a virtual cultural exhibition space, a detailed text introduction, audio explanation or video demonstration will pop up to introduce the historical background, production process, etc. of the exhibit, and even play a video about the ceramic production process.

[0084] Exemplarily, the specific analysis process of step 4 further includes: extracting a specific gesture library for operating exhibits and a specific descriptive word library for operating exhibits stored in a database.

[0085] The hand movements of the user during the visit of exhibits in the virtual cultural exhibition space are compared with the gestures corresponding to the various operations in the specific gesture library for operating the exhibits. If the hand movements of the user are consistent with the gesture corresponding to a certain operation in the specific gesture library for operating the exhibits, the operation is regarded as the operation performed by the user on the selected exhibit.

[0086] The keywords of the user's voice content during the visit to the exhibits in the virtual cultural exhibition space are compared with the descriptive words corresponding to the operations in the specific description word library of the operating exhibits. If a keyword in the user's voice content is the same as or synonymous with a descriptive word corresponding to an operation in the specific description word library of the operating exhibits, the operation is regarded as the operation performed by the user on the selected exhibit.

[0087] The operations on the selected exhibits corresponding to the hand movements and voice contents of the user during the process of visiting the exhibits in the virtual cultural exhibition space are compared. If there is any inconsistency, the priorities of the operations on the selected exhibits corresponding to the hand movements and voice contents are set, and the operations on the selected exhibits corresponding to the highest priority are used as the operations performed on the selected exhibits by the user during the process of visiting the exhibits in the virtual cultural exhibition space.

[0088] It should be noted that the operations performed on the selected exhibits include but are not limited to zooming in, zooming out, rotating, etc.

[0089] It should be noted that before entering the virtual cultural exhibition, users can read the instructions to standardize their operation of the exhibits so that they can be better detected and identified.

[0090] In this embodiment, the present invention recognizes and processes the hand movements and voice content of the user in the process of visiting exhibits in the virtual cultural exhibition space, analyzes the exhibits selected by the user and the operations performed on the selected exhibits, and can set more interactive elements in the virtual cultural exhibition, so that the user can interact with the exhibits through gestures or voice control. Instead of passively viewing the exhibition content, the user can actively participate in it, which greatly enhances the user experience.

[0091] Step 5: Analysis of user browsing interest preferences: Obtain the total number of users who browse each cultural theme, each block, and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks, and popular exhibits of the virtual cultural exhibition, and provide feedback.

[0092] Exemplarily, the specific analysis process of step five is: obtaining the total number of users who browse each exhibit of each cultural theme in each block in the virtual cultural exhibition and the browsing time and interaction times of each user, and analyzing the popularity coefficient of each exhibit of each cultural theme in each block in the virtual cultural exhibition.

[0093] Exhibits whose popularity coefficients are greater than a set popularity coefficient threshold are recorded as popular exhibits, and popular exhibits of the virtual cultural exhibition are counted.

[0094] The cumulative number of hot exhibits in each block of each cultural theme in the virtual cultural exhibition is obtained, and the block corresponding to the cumulative number of hot exhibits greater than the set value is recorded as a hot block, and the hot blocks of the virtual cultural exhibition are counted.

[0095] The cumulative number of hot blocks of each cultural theme in the virtual cultural exhibition is obtained, and the cultural theme corresponding to the hot block cumulative number greater than the set value is recorded as a hot cultural theme, and the hot cultural themes of the virtual cultural exhibition are counted.

[0096] It should be noted that the popularity coefficient of each exhibit in each cultural theme and each block in the virtual cultural exhibition is analyzed by recording the total number of users who browsed each exhibit in each cultural theme and each block in the virtual cultural exhibition and the browsing time and interaction times of each user as and , Indicates The user's ID, , Indicates The number of the cultural theme, , Indicates The number of the block, , Indicates The number of the exhibit, .

[0097] By analyzing the formula Get the popularity coefficient of each exhibit in each cultural theme and each block in the virtual cultural exhibition ,in Indicates the preset threshold of the number of browsing users. represents a natural constant, Indicates the number of users, , They represent the impact factors corresponding to the preset unit browsing time and unit interaction times, respectively. They represent the weights of the preset browsing time and number of interactions respectively. .

[0098] In this embodiment, the present invention obtains the browsing time and number of interactions of users browsing the virtual cultural exhibition, and analyzes the popular cultural themes, blocks, and exhibits of the virtual cultural exhibition, which is conducive to targeted optimization of exhibition content and interactive functions, creating a colorful and interactive virtual cultural exhibition, bringing users a new cultural experience, and better improving user satisfaction and loyalty.

[0099] See also Figure 3 As shown, the second aspect of the present invention provides a cultural communication interaction device, including a virtual cultural exhibition theme and content acquisition module, a virtual cultural exhibition design and construction module, a user navigation and browsing analysis and processing module, a user and exhibit interaction analysis and processing module, a user browsing interest preference analysis module, and a database.

[0100] The virtual cultural exhibition design and construction module is respectively connected to the virtual cultural exhibition theme and content acquisition module and the user navigation and browsing analysis processing module; the user and exhibits interaction analysis processing module is respectively connected to the user navigation and browsing analysis processing module and the user browsing interest preference analysis module; the database is respectively connected to the virtual cultural exhibition design and construction module, the user navigation and browsing analysis processing module and the user and exhibits interaction analysis processing module.

[0101] The virtual cultural exhibition theme and content acquisition module is used to obtain each cultural theme of the virtual cultural exhibition, each block of each cultural theme, and content information of each block of each cultural theme, wherein the content information includes pictures, videos and text materials of each exhibit.

[0102] The virtual cultural exhibition design and construction module is used to construct a virtual cultural exhibition space using VR tools according to the cultural theme, blocks and content information of the virtual cultural exhibition, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space, and build a virtual cultural exhibition.

[0103] The user navigation and browsing analysis and processing module is used to obtain the user's command information during the movement of the virtual cultural exhibition space when the user wears the VR device and is placed in the virtual cultural exhibition space, where the command information includes head movements, hand movements, leg movements and voice content, and perform recognition processing to analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0104] The user-exhibit interaction analysis and processing module is used to obtain the hand movements and voice content of the user in the process of visiting exhibits in the virtual cultural exhibition space, perform recognition processing, analyze the exhibits selected by the user and the operations performed on the selected exhibits in the process of visiting exhibits in the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly.

[0105] The user browsing interest preference analysis module is used to obtain the total number of users who browse each cultural theme, each block, and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks, and popular exhibits of the virtual cultural exhibition, and provide feedback.

[0106] The database is used to store the style type and layout type of the exhibition hall corresponding to each cultural theme, and to store a directional hand movement library, a directional leg movement library, a direction word library, a landmark hand movement library corresponding to the selected exhibits, and to store a feature word library of each exhibit in each block of each cultural theme of the virtual cultural exhibition, and to store a specific gesture library for operating the exhibits and a specific description word library for operating the exhibits.

[0107] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined by the present invention, they shall all fall within the protection scope of the present invention.

Claims

1. A cultural communication interaction method, characterized in that: The steps include: Step 1: Acquiring the theme and content of the virtual cultural exhibition: acquiring the cultural themes of the virtual cultural exhibition, the blocks of the cultural themes, and the content information of the blocks of the cultural themes, wherein the content information includes pictures, videos, and text materials of each exhibit; Step 2: Design and build a virtual cultural exhibition: Based on the cultural theme, blocks and content information of the virtual cultural exhibition, use VR tools to build a virtual cultural exhibition space, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space to build a virtual cultural exhibition; Step 3: User navigation and browsing analysis and processing: When the user wears the VR device and is placed in the virtual cultural exhibition space, the command information of the user in the process of moving in the virtual cultural exhibition space is obtained, where the command information includes head movements, hand movements, leg movements and voice content, and is recognized and processed to analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and the virtual cultural exhibition space responds accordingly; Step 4: Analysis and processing of user-exhibit interaction: obtaining the hand movements and voice content of the user in the process of visiting the exhibits in the virtual cultural exhibition space, performing recognition processing, analyzing the exhibits selected by the user and the operations performed on the selected exhibits in the process of visiting the exhibits in the virtual cultural exhibition space, and making the virtual cultural exhibition space respond accordingly; Step 5: Analysis of user browsing interest preferences: Obtain the total number of users who browse each cultural theme, each block, and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks, and popular exhibits of the virtual cultural exhibition, and provide feedback.

2. A cultural communication interaction method according to claim 1, characterized in that: The specific analysis process of step 2 is as follows: S1: Select VR tools for designing virtual cultural exhibitions; S2: Constructing a virtual cultural exhibition space: extracting the style type and layout type of the exhibition hall corresponding to each cultural theme stored in the database, screening out the style type and layout type corresponding to each cultural theme of the virtual cultural exhibition, and constructing a virtual cultural exhibition space; S3: Digital processing of exhibits: Digital processing of pictures, videos and text materials of each exhibit in each cultural theme and each block of the virtual cultural exhibition. Digital processing includes data collection, data processing, data modeling and integration, and displaying them in the virtual cultural exhibition space to build a virtual cultural exhibition.

3. A cultural communication interaction method according to claim 1, characterized in that: The specific analysis process of step three includes: The head movement of the user during the movement in the virtual cultural exhibition space is obtained, and the angle and direction of the head rotation of the user during the movement in the virtual cultural exhibition space are further obtained, and the angle and direction of the head rotation are substituted into the relationship between the preset head rotation angle and direction and the orientation, so as to obtain the orientation corresponding to the head movement of the user during the movement in the virtual cultural exhibition space.

4. A cultural communication interaction method according to claim 3, characterized in that: The specific analysis process of step three also includes: Acquire the hand movements of the user during the movement in the virtual cultural exhibition space, extract the directional hand movement library stored in the database, and obtain the direction corresponding to each hand movement in the directional hand movement library; Compare the hand movements of the user in the process of moving in the virtual cultural exhibition space with the hand movements in the directional hand movement library, and analyze the directions corresponding to the hand movements of the user in the process of moving in the virtual cultural exhibition space; Similarly, the directions corresponding to the leg movements of the user when moving in the virtual cultural exhibition space are obtained.

5. A cultural communication interaction method according to claim 4, characterized in that: The specific analysis process of step three also includes: The voice content of the user in the process of moving in the virtual cultural exhibition space is obtained, and the keywords of the text corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space are obtained through voice recognition technology and keyword recognition technology, and the directional vocabulary stored in the database is extracted, and the keywords of the text corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space are compared with the directional words in the directional vocabulary, and the direction corresponding to the voice content of the user in the process of moving in the virtual cultural exhibition space is analyzed.

6. A cultural communication interaction method according to claim 5, characterized in that: The specific analysis process of step three also includes: Compare the directions corresponding to the head movements, hand movements, leg movements and voice content of the user during the movement in the virtual cultural exhibition space. If they are inconsistent, set the priorities of the directions corresponding to the head movements, hand movements, leg movements and voice content according to a preset principle, and use the direction corresponding to the highest priority as the intended direction of the user during the movement in the virtual cultural exhibition space; The route from the user's current position in the virtual cultural exhibition space to the location of the exhibit corresponding to the intended direction is recorded as the user's movement route in the virtual cultural exhibition space, and the exhibit perspective corresponding to the user's intended direction during the user's movement in the virtual cultural exhibition space is recorded as the user's browsing exhibit perspective in the virtual cultural exhibition space.

7. A cultural communication interaction method according to claim 1, characterized in that: The specific analysis process of step 4 includes: D1: obtaining the hand movements of the user during the process of visiting the exhibits in the virtual cultural exhibition space, and comparing them with the hand movements in the iconic hand movement library corresponding to the selected exhibits stored in the database; if the hand movements of the user during the process of visiting the exhibits in the virtual cultural exhibition space are consistent with a hand movement in the iconic hand movement library corresponding to the selected exhibits, then the exhibits visited by the user in the virtual cultural exhibition space are the exhibits selected by the user; D2: extracting the characteristic word library of each exhibit in each block of each cultural theme of the virtual cultural exhibition stored in the database, screening the characteristic word library of each exhibit in the area where the user is located during the process of visiting the exhibits in the virtual cultural exhibition space, and recording it as the characteristic word library of each designated exhibit; Obtaining keywords of the user's voice content during the process of visiting exhibits in the virtual cultural exhibition space, and comparing them with the characteristic words in the characteristic word library of each designated exhibit, and analyzing the exhibits selected by the user; D3: Compare the selected exhibits corresponding to the hand movements and voice contents of the user during the process of visiting exhibits in the virtual cultural exhibition space. If there is any inconsistency, set the priority of the exhibits selected by the hand movements and voice contents, and use the selected exhibits corresponding to the highest priority as the exhibits selected by the user during the process of visiting exhibits in the virtual cultural exhibition space, and display pictures, videos and text materials of the selected exhibits.

8. A cultural communication interaction method according to claim 7, characterized in that: The specific analysis process of step 4 also includes: Extracting a specific gesture library for operating exhibits and a specific descriptive word library for operating exhibits stored in a database; Compare the hand movements of the user during the visit of the exhibits in the virtual cultural exhibition space with the gestures corresponding to the various operations in the specific gesture library for operating the exhibits. If the hand movement of the user is consistent with the gesture corresponding to a certain operation in the specific gesture library for operating the exhibits, then the operation is regarded as the operation performed by the user on the selected exhibit; Compare the keywords of the user's voice content during the visit of the exhibits in the virtual cultural exhibition space with the descriptive words corresponding to the operations in the specific descriptive word library of the operating exhibits. If a keyword of the user's voice content is the same as or a synonym of a descriptive word corresponding to an operation in the specific descriptive word library of the operating exhibits, then the operation is regarded as the operation performed by the user on the selected exhibits; The operations on the selected exhibits corresponding to the hand movements and voice contents of the user during the process of visiting the exhibits in the virtual cultural exhibition space are compared. If there is any inconsistency, the priorities of the operations on the selected exhibits corresponding to the hand movements and voice contents are set, and the operations on the selected exhibits corresponding to the highest priority are used as the operations performed on the selected exhibits by the user during the process of visiting the exhibits in the virtual cultural exhibition space.

9. A cultural communication interaction method according to claim 1, characterized in that: The specific analysis process of step five is as follows: Obtain the total number of users who browse each exhibit of each cultural theme and each block in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, and analyze the popularity coefficient of each exhibit of each cultural theme and each block in the virtual cultural exhibition; Exhibits with a popularity coefficient greater than a set popularity coefficient threshold are recorded as popular exhibits, and popular exhibits of the virtual cultural exhibition are counted; Obtain the cumulative number of popular exhibits in each block of each cultural theme in the virtual cultural exhibition, record the block corresponding to the cumulative number of popular exhibits greater than the set value as a popular block, and count the popular blocks of the virtual cultural exhibition; The cumulative number of hot blocks of each cultural theme in the virtual cultural exhibition is obtained, and the cultural theme corresponding to the hot block cumulative number greater than the set value is recorded as a hot cultural theme, and the hot cultural themes of the virtual cultural exhibition are counted.

10. A cultural communication interactive device, characterized in that: include: Virtual cultural exhibition theme and content acquisition module: used to obtain each cultural theme of the virtual cultural exhibition, each block of each cultural theme, and content information of each block of each cultural theme, wherein the content information includes pictures, videos and text materials of each exhibit; Virtual cultural exhibition design and construction module: used to build a virtual cultural exhibition space using VR tools according to the cultural theme, blocks and content information of the virtual cultural exhibition, digitize the pictures, videos and text materials of the exhibits and display them in the virtual cultural exhibition space, and build a virtual cultural exhibition; User navigation and browsing analysis and processing module: used to obtain the user's command information during the movement of the virtual cultural exhibition space when the user wears the VR device and is placed in the virtual cultural exhibition space, where the command information includes head movements, hand movements, leg movements and voice content, and perform recognition processing, analyze the user's movement route and browsing perspective of exhibits in the virtual cultural exhibition space, and make the virtual cultural exhibition space respond accordingly; User and exhibits interaction analysis and processing module: used to obtain the hand movements and voice content of the user in the process of visiting exhibits in the virtual cultural exhibition space, perform recognition processing, analyze the exhibits selected by the user in the process of visiting exhibits in the virtual cultural exhibition space and the operations performed on the selected exhibits, and make the virtual cultural exhibition space respond accordingly; User browsing interest preference analysis module: used to obtain the total number of users who browsed each cultural theme, each block, and each exhibit in the virtual cultural exhibition, as well as the browsing time and interaction times of each user, analyze the popular cultural themes, popular blocks, and popular exhibits of the virtual cultural exhibition, and provide feedback; Database: used to store the style type and layout type of the exhibition hall corresponding to each cultural theme, and store the directional hand movement library, directional leg movement library, orientation vocabulary library, the iconic hand movement library corresponding to the selected exhibits, and store the characteristic vocabulary library of each exhibit in each block of each cultural theme of the virtual cultural exhibition, and store the specific gesture library and specific description vocabulary library for operating the exhibits.

Images