A virtual tour guide regional cultural VR display system

Abstract

The present invention discloses a virtual tour guide regional characteristic culture VR display system, which relates to the field of VR display technology. The cultural VR display system comprises a data module, a cultural classification module, a cultural storage module, a three-dimensional modeling module, a voice synchronization module, a user login module, a VR transmission module and a virtual interaction module. The data module is mainly used to collect and store cultural characteristic data, and the cultural classification module is mainly used to retrieve the cultural content in the data module. The present invention has the advantages of combining voice with a virtual model, so that when people experience the characteristic VR culture, they use the voice synchronization module to read the text information in a storage unit recognized by AI and broadcast it. The VR display platform calculates the positions of the current observation point and the reading point, and plans the amount of text information that needs to be broadcast, thereby improving the experience personnel's understanding of the characteristic culture on the VR display platform.

Description

Technical Field

[0001] The present invention relates to the field of VR display technology, and in particular to a virtual tour guide regional characteristic culture VR display system. Background Art

[0002] Using VR technology to promote and display culture, tourism, cultural relics, exhibition creativity, etc. can achieve twice the result with half the effort. With the help of VR cultural creation, you can easily experience magnificent scenery, cultural relics, famous paintings, and innovative exhibition experiences. Culture and cultural creation are not only static objects, but more through interpretation, language, customs, etc., and these cultures are limited by the most traditional static display. Therefore, the emergence of VR technology is a new form of cultural tourism. Through VR's interactive experience of scenes and the reproduction of virtual and real scenes, a kind of spiritual interaction is achieved;

[0003] However, when users log in to the VR exhibit platform, they are willing to learn about different cultures at different times. As a result, some users may choose to learn about another characteristic culture before the VR characteristic culture has fully explained the important culture in the current culture, making it difficult for users to understand the culture better. For this reason, we propose a virtual tour guide regional characteristic culture VR display system. Summary of the invention

[0004] The purpose of the present invention is to provide a virtual tour guide regional characteristic culture VR display system.

[0005] In order to solve the problems raised in the above background technology, the present invention provides the following technical solutions: a virtual tour guide regional characteristic culture VR display system, the cultural VR display system includes a data module, a cultural classification module, a cultural storage module, a three-dimensional modeling module, a voice synchronization module, a user login module, a VR transmission module and a virtual interaction module;

[0006] The data module mainly collects and stores cultural characteristic data;

[0007] The cultural classification module mainly retrieves cultural content from the data module and classifies the culture by cultural content and region;

[0008] The culture storage module includes a first-class storage unit and a second-class storage unit. According to the number of categories in the culture classification module, a classification space is established in the culture storage module, and the cultural data in the culture classification module is stored in the first-class storage unit. The first-class storage unit is mainly used to store the cultural data in the culture classification module, and the second-class storage unit is used to store the cultural data model and the cultural data scene;

[0009] The three-dimensional modeling module includes a 3D modeling engine and a 2D modeling engine. The 3D modeling engine retrieves picture information from a type of storage unit, scans features in the picture information, and establishes a three-dimensional virtual model according to the features in the picture information. The 2D modeling engine establishes a 2D virtual model according to the picture information and sets a browsing route.

[0010] The speech synchronization module mainly records the speech of personnel reading characteristic culture, and performs speech synchronization reading according to the three-dimensional virtual model or the 2D virtual model;

[0011] The user login module is used for the experiencer to log in to the VR display platform. In the VR display platform, the experiencer login interface is retrieved. After the experiencer logs in, the data in the cultural storage module is retrieved, and then the corresponding cultural interface is generated according to the cultural data of a type of storage unit in the cultural storage module, and the cultural interface is provided to the person for selection;

[0012] The VR transmission module mainly observes the virtual model, sets observation points in the virtual model, and transmits the observation point data to the VR interface;

[0013] The virtual interaction module mainly moves the observation point through personnel input commands;

[0014] The second type of storage unit is mainly used to store the virtual models generated by the 3D modeling engine and the 2D modeling engine. The voice synchronization module sets a reading point in the three-dimensional virtual model and the 2D virtual model. When the observation point passes through the reading point, the voice synchronization module will retrieve the text information in the first type of storage unit and the voice read by the person, and at the same time, when the observation point does not pass through the observation point, the text audio in the first type of storage unit is played;

[0015] After the 2D modeling engine establishes the 2D virtual model, the personnel sets a browsing route according to the 2D virtual model, and sets a reading point in the browsing route, sets a reading point in the 3D virtual model, and the virtual point in the 3D virtual model is triggered by a fixed area;

[0016] When a person logs in to the VR display platform, the user login module interface retrieves the cultural data in the cultural classification module, and the user can choose to play the characteristic culture in series to construct a cultural playback channel. This channel is constructed by the cultural data model selected by the experiencer in the second storage unit, and a browsing route is generated in the channel;

[0017] The VR transmission module is mainly used to transmit information in the virtual model. The experiencer inserts the input end of the VR device into the output end of the VR interface to transmit the characteristic cultural data of the observation point to the VR device.

[0018] As a further solution of the present invention: the data module records the cultural data uploaded by personnel and the cultural data searched through the network engine, and integrates the cultural data searched by the network engine.

[0019] As a further solution of the present invention: the cultural classification module identifies through cultural data and classifies the cultural data according to regions, and the classified cultural data is transmitted to a type of storage unit of the cultural storage module.

[0020] As a further solution of the present invention: the first type of storage unit is mainly used to store text information and picture information in the characteristic culture. After the three-dimensional modeling module establishes the virtual model, the cultural characteristics are analyzed, and the text information is retrieved from the first type of storage unit. The text information is converted into audio through AI recognition and played by the player.

[0021] As a further solution of the present invention: the virtual interaction module is mainly used for personnel to determine the moving direction of the observation point in the three-dimensional virtual model and the forward and backward moving direction in the 2D virtual model through control instructions.

[0022] By adopting the above technical solution, compared with the prior art, the beneficial effects of the present invention are:

[0023] The present invention records characteristic culture through a first-class storage unit and a second-class storage unit respectively, so that the voice synchronization module can retrieve characteristic cultural information from the cultural storage module and combine the voice with the virtual model, so that when people experience characteristic VR culture, they can use the voice synchronization module to identify the text information in the first-class storage unit through AI and broadcast it. The VR display platform will calculate the position of the current observation point to the reading point and plan the number of text information to be broadcasted. When the preset reading point is reached, the VR display platform will play the reading information uploaded by the personnel, thereby improving the experience personnel's understanding of the characteristic culture on the VR display platform;

[0024] The present invention records the cultural information uploaded by personnel through a data module, screens the uploaded culture, and searches for cultural characteristics on a search engine to determine the regional affiliation of the culture and find out the incomplete parts of the culture uploaded by personnel, so as to facilitate the improvement of the cultural information uploaded by personnel. At the same time, AI recognition technology is used to read the uploaded cultural information, so that the cultural storage module can improve and supplement the culture of different regions, so that the VR display platform can better display the regional characteristic culture;

[0025] By logging into the VR display platform, the present invention allows the experiencer to check the virtual models in the second storage unit and establish virtual channels in the three-dimensional virtual model and the 2D virtual model. In this way, the corresponding virtual channels will be generated according to the entrances and exits of the models, so that the personnel can control the movement of the observation point in the virtual channel. This helps to establish connections between multiple characteristic cultures, so that the personnel can understand the characteristic cultures of different regions. Such experience can help the personnel better understand the characteristic cultures of different regions. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a system flow chart in an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The specific embodiments of the present invention are further described below in conjunction with the accompanying drawings. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0028] Example 1, please refer to the attached Figure 1 ,The virtual tour guide regional characteristic cultural VR display system ,The cultural VR display system includes data module, cultural classification module, cultural storage module, ,three-dimensional modeling module, voice synchronization module, user login module, VR transmission module and virtual interaction module;

[0029] The data module mainly collects and stores cultural characteristic data;

[0030] The cultural classification module mainly retrieves cultural content from the data module and classifies the culture by cultural content and region;

[0031] The cultural storage module includes a first-class storage unit and a second-class storage unit. According to the number of categories in the cultural classification module, a classification space is established in the cultural storage module, and the cultural data in the cultural classification module is stored in the first-class storage unit. The first-class storage unit is mainly used to store the cultural data in the cultural classification module, while the second-class storage unit is used to store cultural data models and cultural data scenarios.

[0032] The three-dimensional modeling module includes a 3D modeling engine and a 2D modeling engine. The 3D modeling engine retrieves image information from a type of storage unit, scans features in the image information, and establishes a three-dimensional virtual model according to the features in the image information. The 2D modeling engine establishes a 2D virtual model according to the image information and sets a browsing route.

[0033] The voice synchronization module mainly records the voice of personnel reading characteristic culture, and performs voice synchronization reading according to the 3D virtual model or 2D virtual model;

[0034] The user login module is used for the experiencer to log in to the VR display platform. In the VR display platform, the experiencer login interface is retrieved. After the experiencer logs in, the data in the cultural storage module is retrieved, and then the corresponding cultural interface is generated according to the cultural data of a type of storage unit in the cultural storage module, and the cultural interface is provided to the personnel for selection;

[0035] The VR transmission module mainly observes the virtual model, sets observation points in the virtual model, and transmits the observation point data to the VR interface;

[0036] The virtual interactive module mainly moves the observation point through personnel input commands.

[0037] Please refer to the attached Figure 1 The data module records the cultural data uploaded by personnel and the cultural data searched through the network engine, and integrates the cultural data searched by the network engine. The cultural classification module identifies through cultural data and classifies the cultural data according to the region. The classified cultural data is transmitted to a type of storage unit in the cultural storage module. The type of storage unit is mainly used to store text information and picture information in the characteristic culture. After the three-dimensional modeling module establishes the virtual model, the cultural characteristics are analyzed, and the text information is retrieved from the type of storage unit. The text information is converted into audio through AI recognition and played by the player.

[0038] In this embodiment, personnel upload cultural data to the data module, and then the data module screens the cultural features in the cultural data through a neural network, and the search engine retrieves the area of ​​the culture, and establishes a regional characteristic culture in the cultural classification module. The areas in the cultural classification module are respectively set as Xa, Xb...Xzz, and the cultural features in the area are extracted, and the summary of different cultures in the area is extracted through a formula. The specific formula is as follows: (Y1+Y2+...+Yn) / n∈Xa, wherein Y1, Y2...Yn respectively represent the cultural features in Xa, and the number of cultural features of n is greater than ten times the cultural features in the cultural area. The information of cultural features is screened to a certain extent, and then the cultural features in Xa are extracted into a summary for personnel to select.

[0039] When in use, the cultural information uploaded by personnel is recorded through the data module, and the uploaded culture is screened. At the same time, the cultural characteristics are searched on the search engine to determine the regional affiliation of the culture and find out the incomplete parts of the culture uploaded by personnel. This can facilitate the improvement of the cultural information uploaded by personnel. At the same time, AI recognition technology is used to read the uploaded cultural information, so that the cultural storage module can improve and supplement the culture of different regions, so that the VR display platform can better display the regional cultural characteristics.

[0040] Example 2, please refer to the attached Figure 1 ,The virtual tour guide regional characteristic cultural VR display system ,The cultural VR display system includes data module, cultural classification module, cultural storage module, ,three-dimensional modeling module, voice synchronization module, user login module, VR transmission module and virtual interaction module;

[0041] The data module mainly collects and stores cultural characteristic data;

[0042] The cultural classification module mainly retrieves cultural content from the data module and classifies the culture by cultural content and region;

[0043] The cultural storage module includes a first-class storage unit and a second-class storage unit. According to the number of categories in the cultural classification module, a classification space is established in the cultural storage module, and the cultural data in the cultural classification module is stored in the first-class storage unit. The first-class storage unit is mainly used to store the cultural data in the cultural classification module, while the second-class storage unit is used to store cultural data models and cultural data scenarios.

[0044] The three-dimensional modeling module includes a 3D modeling engine and a 2D modeling engine. The 3D modeling engine retrieves image information from a type of storage unit, scans features in the image information, and establishes a three-dimensional virtual model according to the features in the image information. The 2D modeling engine establishes a 2D virtual model according to the image information and sets a browsing route.

[0045] The voice synchronization module mainly records the voice of personnel reading characteristic culture, and performs voice synchronization reading according to the 3D virtual model or 2D virtual model;

[0046] The user login module is used for the experiencer to log in to the VR display platform. In the VR display platform, the experiencer login interface is retrieved. After the experiencer logs in, the data in the cultural storage module is retrieved, and then the corresponding cultural interface is generated according to the cultural data of a type of storage unit in the cultural storage module, and the cultural interface is provided to the personnel for selection;

[0047] The VR transmission module mainly observes the virtual model, sets observation points in the virtual model, and transmits the observation point data to the VR interface;

[0048] The virtual interactive module mainly moves the observation point through personnel input commands.

[0049] Please refer to the attached Figure 1The second type of storage unit is mainly used to store the virtual models generated by the 3D modeling engine and the 2D modeling engine. The voice synchronization module sets reading points in the three-dimensional virtual model and the 2D virtual model. When the observation point passes through the reading point, the voice synchronization module will call the text information in the first type of storage unit and the voice read by the person, and at the same time, when the observation point does not pass through the observation point, the text audio in the first type of storage unit is played. After the 2D modeling engine establishes the 2D virtual model, the person sets the browsing route according to the 2D virtual model, and sets reading points in the browsing route. The reading points are set in the three-dimensional virtual model, and the virtual points in the three-dimensional virtual model are triggered by fixed areas.

[0050] In this embodiment, a formula is used to determine whether the system requires the player to read the data or AI to recognize text. The specific formula is as follows: St=LSa, where St represents the speed at which the current observation point reaches the reading point, L represents the distance from the observation point to the reading point, and Sa represents the distance moved per second. This formula is used to predict the duration of the voice playback, thereby extracting important text information from the text audio for broadcast, so that people can have a more accurate understanding of the characteristic culture in the virtual scene when experiencing VR culture.

[0051] When in use, the characteristic culture is recorded respectively through the first-class storage unit and the second-class storage unit, so that the voice synchronization module can retrieve the characteristic cultural information from the cultural storage module and combine the voice with the virtual model, so that when people experience the characteristic VR culture, they can use the voice synchronization module to identify the text information in the first-class storage unit through AI and broadcast it. The VR display platform will calculate the position of the current observation point to the reading point, and plan the amount of text information that needs to be broadcast. When it reaches the preset reading point, the VR display platform will play the reading information uploaded by the personnel, thereby improving the experience personnel's understanding of the characteristic culture on the VR display platform.

[0052] Example 3, please refer to the attached Figure 1 ,The virtual tour guide regional characteristic cultural VR display system ,The cultural VR display system includes data module, cultural classification module, cultural storage module, ,three-dimensional modeling module, voice synchronization module, user login module, VR transmission module and virtual interaction module;

[0053] The data module mainly collects and stores cultural characteristic data;

[0054] The cultural classification module mainly retrieves cultural content from the data module and classifies the culture by cultural content and region;

[0055] The cultural storage module includes a first-class storage unit and a second-class storage unit. According to the number of categories in the cultural classification module, a classification space is established in the cultural storage module, and the cultural data in the cultural classification module is stored in the first-class storage unit. The first-class storage unit is mainly used to store the cultural data in the cultural classification module, while the second-class storage unit is used to store cultural data models and cultural data scenarios.

[0056] The three-dimensional modeling module includes a 3D modeling engine and a 2D modeling engine. The 3D modeling engine retrieves image information from a type of storage unit, scans features in the image information, and establishes a three-dimensional virtual model according to the features in the image information. The 2D modeling engine establishes a 2D virtual model according to the image information and sets a browsing route.

[0057] The voice synchronization module mainly records the voice of personnel reading characteristic culture, and performs voice synchronization reading according to the 3D virtual model or 2D virtual model;

[0058] The user login module is used for the experiencer to log in to the VR display platform. In the VR display platform, the experiencer login interface is retrieved. After the experiencer logs in, the data in the cultural storage module is retrieved, and then the corresponding cultural interface is generated according to the cultural data of a type of storage unit in the cultural storage module, and the cultural interface is provided to the personnel for selection;

[0059] The VR transmission module mainly observes the virtual model, sets observation points in the virtual model, and transmits the observation point data to the VR interface;

[0060] The virtual interactive module mainly moves the observation point through personnel input commands.

[0061] Please refer to the attached Figure 1 When the personnel log in to the VR display platform, the user login module interface retrieves the cultural data in the cultural classification module. At the same time, the user can choose to play the characteristic culture in series to build a cultural playback channel. This channel is constructed by the cultural data model selected by the experience personnel in the second-class storage unit, and a browsing route is generated in the channel. The VR transmission module is mainly used to transmit information in the virtual model. The experience personnel insert the input end of the VR device into the output end of the VR interface to transmit the characteristic cultural data of the observation point to the VR device. The virtual interaction module is mainly used for personnel to determine the moving direction of the observation point in the three-dimensional virtual model and the moving direction forward and backward in the 2D virtual model through control instructions.

[0062] When in use, by logging into the VR display platform, the experiencer can check the virtual model in the second-class storage unit and establish a virtual channel in the three-dimensional virtual model and the 2D virtual model. In this way, the corresponding virtual channel will be generated according to the entrance and exit of the model, so that the personnel can control the movement of the observation point in the virtual channel. This will help to establish connections between multiple characteristic cultures, so that personnel can understand the characteristic culture of different regions. Such experience can help personnel better understand the characteristic culture of different regions.

[0063] Working principle:

[0064] First, the regional cultural characteristics are obtained through the data module, and then the cultural classification module is used to classify the cultural characteristics of different regions. The storage units in the cultural storage module are used to store the text information and picture information of the cultural characteristics of different regions. The second type of storage unit stores the virtual models of the cultural characteristics of different regions. The three-dimensional modeling module constructs the virtual models of the cultural characteristics of different regions. Finally, the voice synchronization module is used to combine the text information in the first type of storage unit with the virtual model for playback to improve the experiencer's understanding of the virtual culture. At this point, the entire workflow is completed.

[0065] Those skilled in the art should understand that the modules or steps of the present invention described above can be implemented by a general-purpose computer device, or alternatively, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. The present invention is not limited to any specific combination of hardware and software.

[0066] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

[0067] Although the above describes the specific implementation mode of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without creative work are still within the scope of protection of the present invention.

Claims

1. A virtual tour guide regional cultural VR display system, characterized by: The cultural VR display system includes a data module, a cultural classification module, a cultural storage module, a three-dimensional modeling module, a voice synchronization module, a user login module, a VR transmission module and a virtual interaction module; The data module is used to collect and store cultural characteristic data; The cultural classification module is used to retrieve the cultural content in the data module and perform cultural classification according to the cultural content and region; The culture storage module includes a first-class storage unit and a second-class storage unit. A classification space is established in the culture storage module according to the number of classifications in the culture classification module, and the cultural data in the culture classification module is stored in the first-class storage unit. The first-class storage unit is used to store the cultural data in the culture classification module, and the second-class storage unit is used to store the cultural virtual model. The three-dimensional modeling module includes a 3D modeling engine and a 2D modeling engine. The 3D modeling engine retrieves picture information from a type of storage unit, scans features in the picture information, and establishes a three-dimensional virtual model according to the features in the picture information. The 2D modeling engine establishes a 2D virtual model according to the picture information in the type of storage unit and sets a tour route. The speech synchronization module records the speech of the personnel reading the characteristic culture, and performs speech synchronization reading according to the 2D virtual model; The user login module is used for the experiencer to log in to the VR display platform. In the VR display platform, the VR display platform calls the experiencer login interface. After the experiencer logs in, the data in the cultural storage module is called, and then the corresponding cultural interface is generated according to the cultural data of a type of storage unit in the cultural storage module, and the cultural interface is provided to the person for selection; The VR transmission module is used to observe the virtual model, set observation points in the virtual model, and transmit observation point data to the VR interface; The virtual interaction module is used for personnel to input instructions to move the observation point; The data module records the cultural data uploaded by the personnel and the cultural data searched by the network engine, and integrates the cultural data searched by the network engine; The cultural classification module is used to identify cultural data and classify the cultural data according to regions, and the classified cultural data is transmitted to a type of storage unit of the cultural storage module; The first type of storage unit is used to store text information and picture information in the characteristic culture. After the three-dimensional modeling module establishes the virtual model, the cultural characteristics are analyzed, and the text information is retrieved from the first type of storage unit, and the text is recognized by AI, and the text information is converted into audio, which is played by the player; The second type of storage unit is used to store the virtual models generated by the 3D modeling engine and the 2D modeling engine. The voice synchronization module sets a reading point in the three-dimensional virtual model and the 2D virtual model. When the observation point passes through the reading point, the voice synchronization module will retrieve the text information in the first type of storage unit and the voice read by the person. If the observation point does not pass through the reading point, the text audio in the first type of storage unit is played; The cultural data is uploaded to the data module by personnel, and then the data module screens the cultural features in the cultural data through the neural network, and the search engine retrieves the area of ​​the culture, and establishes the regional characteristic culture in the cultural classification module. The areas in the cultural classification module are respectively set as Xa, Xb... Xzz, and the cultural features in the area are extracted, and the summary of different cultures in the area is extracted through the formula. The specific formula is as follows: (Y1+Y2+…+Yn) / n∈ Xa, where Y1, Y2…Yn represent the cultural features in Xa, respectively, and the number of cultural features in n is greater than the number of cultural features in the cultural region, and the minimum value of n is ten, to filter the information of cultural features; The formula is used to determine whether the system requires a human player to read the data or AI to recognize text. The specific formula is as follows: St=LSa; Among them, St represents the number of remaining words when the current observation point reaches the reading point, L represents the distance from the observation point to the reading point, and Sa represents the speed of reading words per meter of movement; This formula is used to predict the duration of voice playback, thereby extracting important text information from the text audio for broadcast.

2. A virtual tour guide regional culture VR display system according to claim 1, characterized in that: After the 2D modeling engine establishes the 2D virtual model, the personnel set the tour route according to the 2D virtual model, and set up reading points in the tour route, set up reading points in the 3D virtual model, and the virtual points in the 3D virtual model are triggered in fixed areas.

3. A virtual tour guide regional culture VR display system according to claim 1, characterized in that: When a person logs in to the VR display platform, the user login module interface retrieves the cultural data in the cultural classification module. At the same time, the user plays the characteristic culture in series to construct a cultural playback channel. This channel is constructed by the cultural data model selected by the experiencer in the second storage unit, and a tour route is generated in the channel.

4. A virtual tour guide regional culture VR display system according to claim 1, characterized in that: The VR transmission module is used to transmit information in the virtual model. The experiencer inserts the input end of the VR device into the output end of the VR interface to transmit the characteristic cultural data of the observation point to the VR device.

5. A virtual tour guide regional culture VR display system according to claim 1, characterized in that: The virtual interaction module is used to receive control instructions input by personnel, and control the moving direction of the observation point in the three-dimensional virtual model, as well as the forward and backward moving direction in the 2D virtual model.

Images