Tourism system and method based on virtual reality

Abstract

The invention discloses a tourism system and method based on virtual reality, and the system comprises an image collection module which is used for collecting image data in a tourism scene; the environment acquisition module is used for acquiring data such as sound and weather in a tourism scene; the 3D scene reconstruction module is used for receiving data such as images and sounds and reconstructing a 3D scene through three-dimensional audio and video software; the server is used for receiving the 3D scene data packet and storing the 3D scene data packet in the storage module; and the virtual reality equipment is used for reading the 3D scene data packet stored in the server and displaying the 3D scene comprising the image and the sound to the user. According to the invention, the user can access the server by means of the virtual reality equipment represented by the VR glasses and select the visiting position and the viewing angle according to own needs, so that the tourism experience which is convenient and fast, saves time and labor and is extremely close to field tourism is obtained.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a tourism system and method based on virtual reality. Background Art

[0002] With the popularization of high-speed Internet and the booming development of virtual reality, a large number of activities that previously required on-site visits to experience can now be participated in through the Internet and VR, including many tourism products, but these products often only use fixed camera positions to display in a similar "live broadcast" manner, or use artificial modeling to build 3D phase fields. These methods are very different from the experience of on-site visits, as follows: the "live broadcast" method has a fixed picture, and the audience can only see the scene shot by the fixed camera position provided by the service provider. The perspective is passive and single, the picture quality is poor, and the sound cannot be restored; in addition, although the artificially modeled 3D phase field can provide the audience with a flexible VR perspective, the content it presents is a virtual construction, which is not only not real enough, but also not rich enough in picture changes, and can only provide an experience similar to 3D games.

[0003] Based on this, the present invention discloses a tourism system based on virtual reality, which uses high-speed Internet, virtual reality and artificial intelligence technology to provide tourists with a convenient, fast, time-saving and labor-saving tourism experience that is extremely close to on-site tourism. Summary of the invention

[0004] In view of the above technical problems, the present invention provides a tourism system and method based on virtual reality, which can provide tourists with a convenient, fast, time-saving and labor-saving tourism experience that is extremely close to on-site tourism.

[0005] The first embodiment of the present invention provides a tourism system based on virtual reality, which includes: an image acquisition module, which is used to collect image data in a tourism scene in real time; an environment acquisition module, which is used to collect sound and weather data in the tourism scene in real time; a 3D scene reconstruction module, which is used to receive image, sound and weather data and reconstruct a 3D scene through three-dimensional audio and video software; a server, which is used to receive a 3D scene data packet and store the 3D scene data packet in a storage module; a virtual reality device, which is used to read the 3D scene data packet in the storage module and display the 3D scene including images and sounds to the user.

[0006] Optionally, the image acquisition module includes a plurality of high-resolution cameras arranged in a real tourism scene, each camera being capable of capturing and uploading a high-resolution image including shooting position and shooting angle information.

[0007] Optionally, the system also includes an AI module, which acquires data collected by the image acquisition module and the environment acquisition module, and the 3D scene generated by the 3D scene reconstruction module for learning. When the real-time data received by the tourism system is incomplete, the AI ​​module repairs it through the learning results.

[0008] Optionally, the environment collection module further includes a microphone group consisting of a plurality of microphones for collecting sound data in a tourist scene, wherein the sound data includes location information, and the sound data is uploaded to a server.

[0009] Optionally, the environment acquisition module also includes a meteorological database for storing meteorological condition data, and the meteorological data is updated in real time.

[0010] The second embodiment of the present invention provides a tourism method based on virtual reality, which includes: real-time collection of image data in the tourism scene; real-time collection of sound and weather data in the tourism scene; real-time reception of image, sound and antenna data and reconstruction of 3D scene through three-dimensional audio and video software; real-time reception of 3D scene data packets and storage in a storage module; reading the 3D scene data packets in the storage module through a virtual reality device and displaying the 3D scene including images and sounds to the user.

[0011] Optionally, the image acquisition module includes a plurality of high-resolution cameras arranged in a real tourism scene, each camera being capable of capturing and uploading a high-resolution image including shooting position and shooting angle information.

[0012] Optionally, the method includes: collecting sound data in the tourism scene by means of multiple microphones with position information.

[0013] Optionally, the method includes: storing meteorological data with the help of a meteorological database, and the meteorological data is updated in real time; users can check the weather in advance through the meteorological database, and choose to visit the same scenic spot in different seasons, different weather and different time periods according to their needs.

[0014] Optionally, the method includes: using an AI module to parse photos or videos uploaded by the user, and then synthesizing travel photos based on the scenes selected by the user and the uploaded photos or videos.

[0015] Optionally, the method includes: the online tour guide collects image and sound data in the tourism scene in real time according to a preset route as supplementary data.

[0016] Optionally, the method includes: collecting image data and sound data during the game process as supplementary data through a collection device, combining the image data collected by the image collection module and the sound data collected by the environment collection module to reconstruct the real game scene, and providing the user with a preset game plan.

[0017] The present invention uses a camera to collect image data in a tourist scene, an environment collection module to collect surrounding environment data, a 3D scene reconstruction module to receive image data and reconstruct a 3D scene through a three-dimensional audio and video software, a server to receive a 3D scene data packet and store the 3D scene data packet in a storage module; a virtual reality device represented by VR glasses is used to read the 3D scene data packet in the storage module and display it to tourists in a form including images and sounds. Compared with the prior art, the user of the present invention can flexibly select the tour location and viewing angle according to his or her needs with the help of a head-mounted device, thereby obtaining a convenient, fast, time-saving, labor-saving and yet extremely close to on-site tourism experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 The figure is a structural schematic diagram of a tourism system based on virtual reality of the present invention.

[0019] Figure 2 The figure is a flow chart of a tourism method based on virtual reality of the present invention. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0021] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be directly connected, indirectly connected through an intermediate medium, or internally connected between two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention should be understood according to actual conditions. In addition, as long as the technical features involved in the different embodiments of the present invention described below do not conflict with each other, they can be combined with each other.

[0022] VR technology, or virtual reality technology, uses computers to generate real-time dynamic three-dimensional realistic images, which are displayed by VR headgear display devices. Combined with sound, temperature, touch and other data, it simulates the real environment and the user's vision, hearing and body sensation in the real environment with a very high degree of restoration. Compared with traditional three-dimensional display technology, the outstanding advantage of VR technology is that it can help users achieve a completely immersive experience.

[0023] AI technology, or artificial intelligence technology, is a technology that enables computers and machines to simulate human intelligence and problem-solving capabilities, and has the ability of self-learning and iterative evolution.

[0024] Please refer to Figure 1 As shown, the present invention provides a tourism system based on virtual reality, the system includes an image acquisition module 100, an environment acquisition module 200, a 3D scene reconstruction module 300, an AI module 400, a server 500 and a virtual reality device 600, the image acquisition module 100 is used to collect image data in the tourism scene. The environment acquisition module 200 is used to collect sound, weather and other data in the tourism scene; the 3D scene reconstruction module 300 is used to receive image data and reconstruct the 3D scene through three-dimensional audio and video software; the AI ​​module 400 obtains the data collected by the image acquisition module 100 and the environment acquisition module 200, and the 3D scene generated by the 3D scene reconstruction module 300 for learning. When the real-time data received by the tourism system is incomplete, the AI ​​module 400 repairs it through the learning results; the server 500 is used to receive the 3D scene data packet and store it in the storage module; the virtual reality device 600 represented by VR glasses is used to read the 3D scene data packet in the storage module and display it to the user.

[0025] In one embodiment of the present invention, the image acquisition module 100 includes a plurality of high-resolution camera modules arranged in a real tourist scene, each camera module is equipped with a plurality of cameras capable of acquiring and uploading high-resolution images with shooting positions and shooting angles. These cameras can be mounted on a fixed bracket or on a rotatable pan-tilt platform, but no matter which method is adopted, it should cover the 360° viewing angle of its location and provide shooting position and shooting angle information, so as to ensure that the 3D scene reconstruction module can calculate the phase difference between different images.

[0026] In one embodiment of the present invention, the environment acquisition module 200 further includes a microphone group consisting of a plurality of microphones for collecting sound data in the tourism scene. The environment acquisition module 200 further includes a plurality of sensors of various types arranged in the real tourism scene, including a temperature sensor, a humidity sensor, a wind sensor, a vibration sensor, and a light intensity sensor, etc., for sensing and acquiring environmental parameters such as temperature, humidity, wind, light, and vibration experienced by the sensor carrier in the real tourism scene, and generating uplink environmental data.

[0027] Most tourist scenes give tourists completely different experiences in different seasons, different weather and different time periods of a day, but most tourists cannot visit the same scenic spot repeatedly, and the weather conditions on the day of the trip are unpredictable, so they can only choose passively. The travel method based on real-time virtual reality can not only save a lot of time, energy and money for the audience, but also make repeated visits to the same scenic spot feasible and easy to operate. Tourists can choose their desired season, weather and time period to visit, so as to obtain a more comprehensive travel experience. Based on this, in one embodiment of the present invention, the environment acquisition module also includes a meteorological database, which is used to store meteorological data corresponding to each tourist scene, and the meteorological data is updated in real time. Tourists can check the weather in advance, so as to choose different seasons, different weather and different time periods to visit the same scenic spot according to their needs, and even enter the scenic spot outside the service time period to obtain a full range of experience.

[0028] The present invention installs a high-resolution camera group at a tourist attraction to form an image matrix. The density, viewing angle and focal length of the camera group can cover a predetermined tourist range. The camera group collects images, sounds and environmental data in the scenic area in real time. In view of the limited propagation range of sound and the speed far below the speed of light, the present invention sets a plurality of microphones at appropriate positions to form a sound source matrix to ensure that sufficient sound source data can be collected for restoring the sound field. The image screen, sound and its physical position, shooting angle, lens focal length and other information provided by all cameras and microphones are uploaded to the server 500 together. The server 500 will reconstruct the 3D scene through the three-dimensional audio and video software of the 3D scene reconstruction module 300 according to the multi-angle images, sounds and collection orientation information provided by the camera group and the microphone group. The server 500 is used to receive a 3D scene data packet and store it in a storage module. The virtual device 600 represented by VR glasses reads the 3D scene data packet in the storage module and displays it to tourists.

[0029] The data and image data in the 3D scene data packet described in the present invention are in a new data format, namely, a three-dimensional scene data stream, which is similar to the "frame stream" of a video but is not exactly the same. Specifically, the videos we usually come into contact with are actually picture streams, that is, a certain number of pictures flash continuously and quickly to form a moving picture, and a single photo is what we usually call a "frame". Due to the limitations of two-dimensional pictures, the picture displayed by the video is fixed, and no matter how the audience changes the viewing angle, the picture presented will not change. Three-dimensional games can provide a three-dimensional viewing angle, and players can see completely different pictures by changing their positions and viewing angles, but the "frames" provided by the game are obtained through calculation, and they use a predetermined 3D scene (i.e., a map). The game development team sets motion rules and trigger conditions for the objects therein, and the system renders the game screen according to the conditions, so it is essentially still based on the calculation and rendering results of the existing 3D map file.

[0030] Therefore, although there are many video formats on the market, they are essentially all using "frames" to display moving pictures. The 3D scene described in the present invention comes from real-time collection on site, and the stereoscopic scene is restored according to the actual situation and displayed to the audience. Therefore, the stereoscopic scene data stream described in the present invention has the characteristics of the above two situations, as follows:

[0031] 1. Stream files are restored and generated according to the actual situation, similar to surveillance videos;

[0032] 2. Three-dimensional scene, tourists can be in it and appreciate the surrounding scenery from all directions.

[0033] However, it is different from the above two situations. The specific differences are as follows: the images in the present invention are collected on the spot rather than generated by map calculation and rendering, so they can only be pushed to the audience after information collection and restoration. Since the scene of the scenic spot is constantly changing, similar to the picture of the video, the system needs to continuously generate, store and push it to the audience to form a "3D scene data stream", which is different from the existing picture that uses "frames" to show movement.

[0034] In summary, the data in the 3D scene data packet and the image data collected by the image acquisition module of the present invention are in a new data format, namely, a three-dimensional scene data stream. Different from the video data stream formed by picture frames, the data stream in this format is composed of three-dimensional scene frames, thereby providing the audience with an immersive experience.

[0035] In the present invention, the images and sounds provided by the camera group and the microphone are collected on-site and in real time. Except for the delay caused by force majeure factors such as the algorithm processing process and the network, the scene provided by the server is exactly the same as the scene.

[0036] The virtual reality tourism system of the present invention can be presented to tourists through a web page or an APP. For tourists, preferably, they can access it through VR glasses to obtain an experience that is almost the same as on-site tourism.

[0037] In the present invention, tourists can provide photos or videos as required by the system and upload them to the server. The 3D scene reconstruction module and the AI ​​module will synthesize the required photos or videos according to the scenes selected by the tourists. These synthesized photos and videos can adjust the light and dark relationship of the portrait according to the weather, lighting and the shooting angle selected by the tourists, so that it is more coordinated after being integrated into the picture; the system may require tourists to provide photos and videos under specific backgrounds, or even different lighting angles.

[0038] If tourists provide photos or videos with differences, the 3D scene reconstruction module and AI module can convert the uploaded characters into 3D models and embed them into the scenes selected by tourists, thereby generating photos or videos that are more in line with the actual photography effects.

[0039] The present invention also provides a tourism method based on virtual reality, please refer to Figure 2 As shown, the method comprises the following steps:

[0040] Step S10, real-time collection of image data in the tourism scene. The present invention collects image data in the real tourism scene through a video acquisition module, and the video acquisition module includes multiple cameras, which are several high-resolution cameras arranged in the real tourism scene, and can collect and upload images with position information and shooting angle information, so as to ensure that the 3D scene reconstruction module can calculate the phase difference between different pictures.

[0041] Step S20, real-time collection of weather and sound data in the tourism scene. The present invention collects environmental data in the real tourism scene through the environment collection module, and the environment collection module also includes a plurality of types of sensors arranged in the real tourism scene, and the plurality of sensors include temperature sensors, humidity sensors, wind sensors, vibration sensors, and light intensity sensors, etc., which are used to obtain environmental parameter data such as temperature, humidity, wind, light, and vibration experienced by the sensor carrier in the real tourism scene, and generate uplink environmental data.

[0042] In one embodiment of the present invention, the environment acquisition module further includes a meteorological database, which is used to store meteorological data corresponding to each tourist scene, and the meteorological data is updated in real time. Tourists can check the weather in advance, and thus choose to visit the same scenic spot in different seasons, weather conditions and time periods according to their needs, and can even visit the scenic spot outside the service time period, so as to obtain a full range of experience.

[0043] In step S30, the server receives the image, sound and environment data and reconstructs the 3D scene through 3D audio and video software.

[0044] Step S40, receiving a 3D scene data packet and storing the 3D scene data packet in a storage module. The present invention stores the data packet in the storage module so that the hardware used for access by the user can read it.

[0045] Step S50, read the 3D scene data packet in the storage module and display the 3D scene including the picture and the sound to the user. The present invention reads the 3D scene data packet and conducts the tour through a virtual reality device represented by a VR device. The virtual reality tourism system of the present invention can provide services to tourists through a web page or an APP; for tourists, preferably, they can access and visit through VR glasses, so as to obtain an experience almost the same as on-site tourism.

[0046] In the present invention, tourists can upload photos or videos according to the system requirements, and the system can synthesize the required photos according to the scene selected by the tourists. These synthesized photos and videos can adjust the light and dark relationship of the portrait according to the weather, lighting and shooting angle selected by the tourists at that time, so that it is more coordinated after being integrated into the picture; the system may require tourists to provide photos and videos under specific backgrounds, or even different lighting angles.

[0047] In one embodiment of the present invention, the virtual reality-based tourism system can also customize travel plans for tourists that are difficult to achieve in conventional ways, such as low-altitude crossing, high-altitude overlooking, water speed skating and other projects. The acquisition equipment installed on the amusement facilities or carried by the "online tour guide" can collect images and sounds during the play process, and reconstruct the real play scene by combining the data collected by the image acquisition module and the environment acquisition module, so that visitors can obtain various experiences such as vision, hearing and even touch during the above play process. Here, the image and sound data collected by the acquisition equipment carried by the amusement facilities or online tour guides are used as supplementary data to supplement the image data collected by the image acquisition module and the sound data collected by the environment acquisition module, mainly because the play equipment is fast and the experience is more exciting. Conventional data is not enough to provide such a special scene, so additional data is needed to ensure service quality.

[0048] Since the system has already established a 3D model for the scenic spot and stored it in the server, the system only needs to open a "seat" (fixed or mobile), similar to building a virtual observation deck or aircraft, and tourists can "take" this virtual "seat". If it is a fixed "seat" (such as a high-altitude overlooking), tourists can experience a perspective that is not available under normal circumstances, and the entire scenic spot is in full view; if it is a moving "seat" (such as a low-altitude crossing), you can pass over the scenic spot and appreciate every detail of the scenic spot in more detail. Throughout the process, tourists can choose their own viewing angles as needed. Tourists can choose a set route or plan a route within a limited range.

[0049] In one embodiment of the present invention, in order to obtain a more realistic travel experience, visitors can also hire an "online tour guide". The online tour guide will follow the set route, and the collection equipment and environmental collection equipment such as the full-view camera and microphone carried by the online tour guide can provide more detailed image data, sound data and environmental data. The server will generate more targeted scenes based on these data to provide tourists who hire the tour guide with a deeply customized travel experience; the online tour guide can be a staff member, a robot or a drone; in addition to providing specific visual supplements, the "online tour guide" can also provide tourists with real-time explanations free from external interference.

[0050] In the present invention, users can access through virtual devices represented by VR glasses and flexibly select visiting locations and viewing angles according to their needs, thereby obtaining a convenient, fast, time-saving and labor-saving travel experience that is extremely close to on-site travel.

[0051] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents, and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A tourism system based on virtual reality, characterized in that: The system comprises: Image acquisition module, used to collect image data in tourism scenes in real time; Environmental collection module, used to collect sound and weather data in tourism scenes in real time; 3D scene reconstruction module, used to receive image, sound and weather data and reconstruct 3D scene through 3D audio and video software; The server is used to receive the 3D scene data packet and store the 3D scene data packet in the storage module; The virtual reality device is used to read the 3D scene data packet in the storage module and show the 3D scene including images and sounds to the user.

2. The virtual reality-based tourism system according to claim 1, characterized in that: The image acquisition module includes a plurality of high-resolution cameras arranged in a real tourist scene, each of which can capture and upload a high-resolution image including shooting position and shooting angle information.

3. The virtual reality based tourism system according to claim 2, characterized in that: The system also includes an AI module, which acquires data collected by the image acquisition module and the environment acquisition module, and learns the 3D scene generated by the 3D scene reconstruction module. When the real-time data received by the tourism system is incomplete, the AI ​​module repairs it through the learning results.

4. The virtual reality based tourism system according to claim 2, characterized in that: The environment collection module also includes a microphone group consisting of a plurality of microphones, which is used to collect sound data in the tourism scene, wherein the sound data includes location information, and the sound data is uploaded to the server.

5. The virtual reality based tourism system according to claim 1, characterized in that: The environment acquisition module also includes a meteorological database for storing meteorological condition data, and the meteorological data is updated in real time.

6. A tourism method based on virtual reality, characterized in that: The method comprises: Collect image data in tourism scenes in real time; Collect sound and weather data in travel scenarios in real time; Receive images, sounds and antenna data in real time and reconstruct 3D scenes through 3D audio and video software; Receive 3D scene data packets in real time and store them in a storage module; The 3D scene data packet in the storage module is read through the virtual reality device and the 3D scene including images and sounds is displayed to the user.

7. The virtual reality based tourism method according to claim 6, characterized in that: The image acquisition module includes a plurality of high-resolution cameras arranged in a real tourist scene, each of which can capture and upload a high-resolution image including shooting position and shooting angle information.

8. The virtual reality based tourism method according to claim 7, characterized in that: The method comprises: The sound data in the tourism scene is collected with the help of multiple microphones with position information.

9. The virtual reality based tourism method according to claim 6, characterized in that: The method comprises: Using a meteorological database to store meteorological condition data, the meteorological data is updated in real time; Users can check the weather in advance through the meteorological database and choose to visit the same attraction in different seasons, weather conditions and time periods according to their needs.

10. The virtual reality based tourism method according to claim 6, characterized in that: The method comprises: The AI ​​module is used to analyze the photos or videos uploaded by users, and then travel photos are synthesized based on the scenes selected by the users and the photos or videos uploaded.

11. The virtual reality based tourism method according to claim 6, characterized in that: The method comprises: Online tour guides collect image and sound data in travel scenes in real time according to the preset route as supplementary data.

12. The virtual reality based tourism method according to claim 6, characterized in that: The method comprises: The image data and sound data collected during the game process are collected by the acquisition device as supplementary data, and the real game scene is reconstructed by combining the image data collected by the image acquisition module and the sound data collected by the environment acquisition module to provide users with a preset game plan.

Images