Online browsing method, device, equipment and storage medium
Patent Information
- Application Number
- CN202410943223.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-07-15
AI Technical Summary
The existing online travel platform cannot achieve a true three-dimensional spatial sense and immersive tour experience. The user operation is complex, the three-dimensional digital human body movements are insufficient, and the target position is not truly directed, and the interactivity is poor.
By obtaining a three-dimensional model stored in the cloud, configuring personalized model data packets, establishing a walkable area and navigation grid, planning the optimal tour path, combining voice recognition and line-of-sight control, the dynamic navigation of the digital tour guide and user perspective follow-up.
Realization of the real restoration of three-dimensional scenes, deep integration between digital tour guides and tourists, optimized the accuracy and experience of tour paths, reduced user operation costs, and improved immersive tour experience.
Smart Images

Figure CN118505944B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of three-dimensional digital technology, and in particular to an online browsing method, device, equipment and storage medium. Background Art
[0002] Existing online travel platforms and websites are all implemented through virtual reality (VR) equipment + panoramic images (panoramic pictures, panoramic videos) + floating broadcast digital human technology; path planning based on three-dimensional scenes relies on path-finding algorithms to achieve the optimal route planning technology from one point to another, and selects the starting and end points in the three-dimensional scene: two-dimensional (Two Dimensions, 2D) broadcast digital human technology is generated through pictures or video materials; three-dimensional (Three Dimensions, 3D) digital human voice-driven technology, including voice-driven lip and facial expressions, and body movements driven by recognizing audio keywords.
[0003] Among them, the existing panorama or panoramic video is a picture taken at a fixed point or fixed route with a 360-degree perspective, which cannot achieve a true three-dimensional sense of space and depth. It is impossible to truly feel the scale and spatial layout of the scenic spot or exhibition hall: the content of the scene that tourists can see depends on the actual situation when the picture is taken, and dynamic change effects cannot be added, and it is impossible to feel the weather, season, and light changes. In the current online tourism system, changing the perspective, switching the destination, and controlling the explanation all need to be realized through manual operation by the user, which is complicated for children or the elderly who have no computer foundation to use, and reality and tourism are intertwined, which is not a truly immersive tour experience: the current application of flat digital people in online tourism can only achieve the effect of using human images to assist voice broadcasting, and there is no fusion of human images and scenes. The interaction between them is essentially independent of each other: the path-finding algorithm realizes the planning of the path, and finally presents the result of the path, that is, a path composed of multiple coordinate points. It is impossible to guide the specific details of the guide in the process of leading the way: the technology of 3D digital people driving mouth and facial movements through voice is relatively mature, but the simulation of explanation through voice-driven body movements only has one form of reaching out, and the movement range is relatively fixed, and it cannot correctly point to the target location. Summary of the invention
[0004] The present disclosure provides an online browsing method, device, equipment and storage medium to at least solve the above technical problems existing in the prior art.
[0005] According to a first aspect of the present disclosure, there is provided an online tour method, comprising: obtaining a three-dimensional model of a scenic spot stored in a cloud, configuring a corresponding model data package based on the three-dimensional model of the scenic spot, encapsulating at least one data interface in the model data package, and performing personalized settings on the three-dimensional model of the scenic spot based on the encapsulated at least one data interface;
[0006] Establishing at least one character image model, and selecting a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot;
[0007] Selecting a walkable area in the three-dimensional model of the scenic spot based on a setter tool, establishing a navigation grid based on the walkable area, establishing a corresponding scenic spot content data table based on the scenic spot content included in the three-dimensional model of the scenic spot, and planning an optimal tour path for the user based on the scenic spot content data table;
[0008] Based on a Cartesian coordinate system, the optimal sightseeing angle of the user is calculated using the optimal sightseeing path, the scenic spot content data table and the voice content.
[0009] In one possible implementation, planning the user's optimal tour route based on the scenic spot content data table includes:
[0010] The scenic spot content data table includes: scenic spot name, scenic spot coordinates, scenic spot stay time, fixed explanation content, best viewing angle and scenic spot type;
[0011] Obtain the total tour time set by the user and the first attraction type and the first attraction name set selected from the attraction content, and determine the first attraction stay time corresponding to the first attraction name based on the first attraction name set and the attraction content data table;
[0012] Obtain a second attraction name set corresponding to the first attraction type in the attraction content data table, where the second attraction name does not include the first attraction name, and determine a second attraction stay time corresponding to the second attraction name set based on the second attraction name set and the attraction content data table;
[0013] Based on the navigation grid, an optimal tour path passing through all scenic spots in the first scenic spot name set and the second scenic spot name set and the required optimal tour path time are calculated.
[0014] In one embodiment, the method further comprises:
[0015] Adding the first scenic spot stay time, the second scenic spot stay time and the optimal tour path time to obtain a first estimated time, comparing the first estimated time with the total tour time, and if the first estimated time exceeds the total tour time, reducing the first estimated time based on a first algorithm so that the first estimated time does not exceed the total tour time;
[0016] Taking the shortest path as the center line, generating a buffer surface based on the first radius, retrieving the scenic spot names in the buffer surface except the first scenic spot name set and the second scenic spot name set as a third scenic spot name set, obtaining the third set of fixed explanation contents corresponding to the third scenic spot name set, and using the third set of fixed explanation contents as the explanation contents when walking between the points.
[0017] In one possible implementation manner, calculating the optimal viewing angle of the user includes:
[0018] The optimal viewing angle includes a walking viewing angle and a fixed viewing angle;
[0019] Monitoring the voice content of the online guide and obtaining scenic spot feature information in the voice content;
[0020] When the scenic spot feature information includes a passing scenic spot in the third scenic spot name set, first coordinate information of the passing scenic spot and second coordinate information of the current user perspective are obtained based on the optimal tour path, a first direction vector is calculated based on the first coordinate information and the second coordinate information, and a horizontal offset value and a height offset value of the first coordinate compared to the second coordinate are obtained;
[0021] Based on the Cartesian coordinate system, the horizontal offset value and the height offset value, the walking and sightseeing angle of the user when walking in the optimal sightseeing path is calculated, so that the user's perspective follows the movement of the online guide and moves toward the passing scenic spot based on the walking and sightseeing angle;
[0022] Obtaining fixed viewing angles of must-go attractions in the first attraction name set and the second attraction name set stored in the attraction content data table;
[0023] Calculating a fixed horizontal offset value and a fixed height offset value of the online guide when facing the user's perspective based on the fixed visiting angle, and rotating the orientation of the online guide based on the fixed horizontal offset value and the fixed height offset value, so that the user's perspective can see the online guide's facial expressions and body movements;
[0024] Based on the walking visiting angle, the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value, the walking visiting angle is naturally converted to the fixed visiting angle.
[0025] In one embodiment, the method further comprises:
[0026] Obtaining a command library stored in the cloud, wherein the command library stores control instructions for changing the user's viewing angle and drive instructions for changing the position of the arm model of the online lecturer;
[0027] Obtaining microphone permissions of a device, collecting audio information of the user based on the microphone permissions, and identifying keywords of command features contained in the audio information;
[0028] Matching the keyword with the control instruction, if the match is successful, adjusting the user viewing angle based on the Cartesian coordinate system in response to the control instruction;
[0029] Or the keyword is matched with the driving instruction. If the match is successful, the arm model is controlled to move to the position corresponding to the driving instruction based on the blueprint function in response to the driving instruction.
[0030] In one embodiment, the method further comprises:
[0031] Obtaining camera permissions of a device, and collecting the user's gaze angle based on the camera permissions, and when the gaze angle exceeds a first angle and the dwell time exceeds a first duration, determining that the user needs to change the current viewing angle;
[0032] Taking the gaze angle as a parameter, the current viewing angle is modified to be smaller than the first angle based on the Cartesian coordinate system.
[0033] In one possible implementation, encapsulating at least one data interface in the model data packet includes:
[0034] The model data package includes at least one layer type data, and the three-dimensional model of the scenic spot is constructed based on the layer type data;
[0035] After the construction is completed, at least one corresponding layer type interface is obtained based on the at least one layer type data, and the at least one layer type interface is encapsulated.
[0036] In one possible implementation, the step of selecting a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot includes:
[0037] configuring at least one necessary character feature based on the at least one character image model;
[0038] Combining the at least one character feature with the at least one character image model to obtain at least one personalized character image model;
[0039] The user's preference characteristics are obtained, and one of the at least one personalized character image models is selected as the online commentator based on the preference characteristics.
[0040] According to a second aspect of the present disclosure, there is provided an online browsing device, comprising:
[0041] A scenic area environment configuration module, used to obtain a scenic area three-dimensional model stored in the cloud, configure a model data package corresponding to the scenic area three-dimensional model, encapsulate at least one data interface in the model data package, and perform personalized settings on the scenic area three-dimensional model based on the encapsulated at least one data interface;
[0042] A guide configuration module, used to establish at least one character image model, and select a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot;
[0043] A path planning module, for selecting a walkable area in the three-dimensional model of the scenic spot based on a setter tool, establishing a navigation grid based on the walkable area, establishing a corresponding scenic spot content data table based on the scenic spot content contained in the three-dimensional model of the scenic spot, and planning an optimal tour path for the user based on the scenic spot content data table;
[0044] The sightseeing angle following module is used to calculate the best sightseeing angle of the user based on the Cartesian coordinate system by using the optimal sightseeing path, the scenic spot content data table and the voice content.
[0045] According to a third aspect of the present disclosure, there is provided an electronic device, including:
[0046] at least one processor; and
[0047] a memory communicatively connected to the at least one processor; wherein,
[0048] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the present disclosure.
[0049] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the present disclosure.
[0050] The disclosed online tour method, device, equipment and storage medium restore the real tour destination in 1:1 by building a three-dimensional scene, and combine with a 3D digital tour guide, which is completely different from the form of panoramic map + two-dimensional floating digital people in the existing online tourism technical solutions. Through this technical means, tourists, scenic spots and digital tour guides are deeply integrated, and immersive online tourism is truly realized; the scene and digital tour guides are customized to select configuration modules and path planning modules before the formal tour to meet the preferences and needs of different tourist groups. Compared with other existing technical routes, the tour experience of a system is completely the same. Although it is online, a customized tour experience is also achieved; the existing three-dimensional scene is optimized and transformed through the implementation technology of the path finding algorithm through the navigation grid. In addition to using the path finding algorithm to directly calculate the optimal route between the passing coordinate positions, the stay time at each point is increased, and the stay points are increased along the way, and the route arrangement is adjusted according to the time consumption. The accuracy and reliability of the tour route are greatly improved, and the tour experience is enhanced. Compared with the existing technology, the third-person roaming is realized by changing the position of the camera according to the coordinate points on the path. When following the digital tour guide for a tour, the current position is calculated in real time relative to the walking and target tour position in the three-dimensional space scene, and the camera's own angle is changed, so as to always maintain the best viewing angle. Compared with the existing 3D digital human body movement driving method (triggering an action through keywords, or generating random actions through large models), the direction and angle of the arm are accurately controlled by calculating the relative position and angle of the explanation target position and the current digital human, so as to match the action direction with the explanation content. Compared with the technical solution of using contact to adjust the three-dimensional scene, it is replaced by non-contact interaction through integrated voice recognition and line of sight control, which no longer requires users to learn the operating habits of the three-dimensional scene, reduces the cost of use, improves the user experience and helps to promote the system.
[0051] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, in which:
[0053] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts.
[0054] Figure 1 The following is a schematic diagram showing the implementation process of an online browsing method according to an embodiment of the present disclosure. Figure 1 ;
[0055] Figure 2 The following is a schematic diagram showing the implementation process of an online browsing method according to an embodiment of the present disclosure. Figure 2 ;
[0056] Figure 3 A schematic diagram of an online browsing device according to an embodiment of the present disclosure is shown;
[0057] Figure 4 A schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0058] In order to make the purpose, features, and advantages of the present disclosure more obvious and easy to understand, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.
[0059] Figure 1 The following is a schematic diagram showing the implementation process of an online browsing method according to an embodiment of the present disclosure. Figure 1 ;like Figure 1 As shown, an online browsing method according to an embodiment of the present disclosure includes the following steps:
[0060] Step 101, obtain a three-dimensional model of a scenic spot stored in the cloud, configure a corresponding model data package based on the three-dimensional model of the scenic spot, encapsulate at least one data interface in the model data package, and personalize the three-dimensional model of the scenic spot based on the at least one encapsulated data interface.
[0061] In the disclosed embodiment, the three-dimensional model of the scenic spot can be a three-dimensional model pre-existing in the cloud, or a new three-dimensional model of the scenic spot can be built as needed, wherein the model data package includes at least one layer type data, and the three-dimensional model of the scenic spot is built based on the layer type data; the layer type data can be a material layer, a light layer, a weather layer, a vegetation layer, etc. of the three-dimensional scenic spot model. After the construction is completed, at least one corresponding layer type interface is obtained based on the at least one layer type data, and the at least one layer type interface is encapsulated. The user can select the corresponding layer type data based on at least one data interface corresponding to the encapsulated layer type interface, and realize personalized definition of the scenic spot environment through the combination of different layers.
[0062] Step 102, establishing at least one character image model, and selecting a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot.
[0063] In the disclosed embodiment, at least one necessary character feature is configured based on the at least one character image model, and the character image model includes but is not limited to boys, girls, cartoons, two-dimensional images, etc. The character features are but not limited to: voice features, appearance features, personality features, etc. The at least one character feature is combined with the at least one character image model to obtain at least one personalized character image model; the user's preference features are obtained, and one of them is selected from the at least one personalized character image model as the online commentator based on the preference features.
[0064] Step 103, based on the extraction tool, select the walkable area in the three-dimensional model of the scenic area, establish a navigation grid based on the walkable area, establish a corresponding scenic spot content data table based on the scenic spot content contained in the three-dimensional model of the scenic area, and plan the user's optimal tour path based on the scenic spot content data table.
[0065] In the disclosed embodiment, the scenic spot content data table includes: scenic spot name, scenic spot coordinates, scenic spot stay time, fixed explanation content, optimal viewing angle and scenic spot type; obtain the total tour time set by the user and the first scenic spot type and the first scenic spot name set selected in the scenic spot content, and determine the first scenic spot stay time corresponding to the first scenic spot name based on the first scenic spot name set and the scenic spot content data table; obtain the second scenic spot name set corresponding to the first scenic spot type in the scenic spot content data table, the second scenic spot name does not contain the first scenic spot name, and determine the second scenic spot stay time corresponding to the second scenic spot name set based on the second scenic spot name set and the scenic spot content data table; wherein the scenic spots corresponding to the first scenic spot name and the second scenic spot name both belong to the scenic spots of the first scenic spot type. Based on the above navigation grid, calculate the optimal tour path and the required optimal tour path time passing through all scenic spot locations in the first scenic spot name set and the second scenic spot name set.
[0066] In an embodiment of the present disclosure, the dwell time at the first scenic spot, the dwell time at the second scenic spot and the optimal tour path time are added to obtain a first estimated time, and the first estimated time is compared with the total tour time. If the first estimated time exceeds the total tour time, the first estimated time is reduced based on a first algorithm so that the first estimated time does not exceed the total tour time; wherein the first algorithm can be an automatic calculation using artificial intelligence (AI) to reduce the tour time.
[0067] The shortest path is used as the center line, a buffer surface is generated based on the first radius, the scenic spot names other than the first scenic spot name set and the second scenic spot name set in the buffer surface are retrieved as a third scenic spot name set, the third set of fixed explanation content corresponding to the third scenic spot name set is obtained, and the third set of fixed explanation content is used as the explanation content when walking between the points. The first radius can be set according to experience, and preferably, the first radius is set to 10 meters.
[0068] Step 104, based on a Cartesian coordinate system, using the optimal tour path, the scenic spot content data table and the voice content to calculate the user's best viewing angle.
[0069] In the disclosed embodiment, the optimal visiting angle includes a walking visiting angle and a fixed visiting angle; the specific method for calculating the walking visiting angle is: monitoring the voice content of the online tour guide, and obtaining the scenic spot feature information in the voice content; the scenic spot feature information may be the scenic spot name, scenic spot content, scenic spot type, etc. When the scenic spot feature information includes the passing scenic spot in the third scenic spot name set, the first coordinate information of the passing scenic spot and the second coordinate information of the current user's perspective are obtained based on the optimal tour path, the first direction vector is calculated based on the first coordinate information and the second coordinate information, and the horizontal offset value and the height offset value of the first coordinate compared to the second coordinate are obtained; the first direction vector is a vector from the scenic spot to the user's perspective, and the walking visiting angle of the user when walking in the optimal tour path is calculated based on the Cartesian coordinate system, the horizontal offset value and the height offset value, so that the user's perspective follows the movement of the online tour guide based on the walking visiting angle while heading toward the passing scenic spot.
[0070] In the disclosed embodiment, the calculation method of the fixed visiting angle is specifically as follows: obtaining the fixed visiting angles of the must-go attractions in the first scenic spot name set and the second scenic spot name set stored in the scenic spot content data table; calculating the fixed horizontal offset value and the fixed height offset value of the online tour guide when facing the user's perspective based on the fixed visiting angle, rotating the orientation of the online tour guide based on the fixed horizontal offset value and the fixed height offset value so that the user's perspective can see the facial expressions and body movements of the online tour guide; and naturally converting the walking visiting angle to the fixed visiting angle based on the walking visiting angle, the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value.
[0071] In the disclosed embodiment, by obtaining the instruction library stored in the cloud, the instruction library stores control instructions for changing the user's perspective and driving instructions for changing the position of the arm model of the online lecturer; by obtaining the microphone permission of the device, the audio information of the user is collected based on the microphone permission, and the keywords of the instruction features contained are identified based on the audio information; wherein the keywords can be similar to the keywords about the distance of the position in "I want to be closer", which are used to control the user's perspective to zoom out, zoom in or other operations to change the perspective, or can be keywords indicating directional content in "Please look at the upper left 45 degrees", which are used to change the user's perspective and adjust the arm angle of the online lecturer. The keywords are matched with the control instructions. If the match is successful, the user's perspective is adjusted based on the Cartesian coordinate system in response to the control instructions; or the keywords are matched with the driving instructions. If the match is successful, the arm model is controlled to move to the position corresponding to the driving instruction based on the blueprint function in response to the driving instruction.
[0072] In the embodiment of the present disclosure, the camera authority of the device is obtained, and the user's eye gaze angle is collected based on the camera authority. When the gaze angle exceeds the first angle and the stay time exceeds the first duration, it is determined that the user needs to change the current viewing angle; wherein the first angle and the first duration can be set based on experience, preferably, the first angle is 20°, and the first duration is set to 2 seconds. The gaze angle is used as a parameter, and the current viewing angle is modified to be less than the first angle based on the Cartesian coordinate system, that is, the control is achieved by correspondingly offsetting the orientation and pitch position relative to the current user's viewing angle around the X-axis or Y-axis.
[0073] Figure 2 The following is a schematic diagram showing the implementation process of an online browsing method according to an embodiment of the present disclosure. Figure 2 ;like Figure 2 As shown, an online browsing method in an embodiment of the present disclosure includes the following steps:
[0074] Step 201, customizing the scenic area environment.
[0075] In the disclosed embodiment, taking the park where the target scenic spot is a combination of architecture, water system, landscape, and historical and cultural sites as an example, a 1:1 three-dimensional scene restoration is completed by manual modeling to establish a three-dimensional model of the scenic area, wherein the three-dimensional model of the scenic area can be a three-dimensional model downloaded from a cloud database. The modeling process of the ground, road, water system, and building shell in the three-dimensional model of the scenic area should follow the principle of separating the spatial structure and material texture of parametric modeling. The material and texture maps are stored by path according to the season (spring, summer, ball, winter), and are used to switch the model map according to the parameters. Vegetation exists as a separate layer in the three-dimensional model of the scenic area, which is divided into 4 layers according to the season. The corresponding vegetation types are added by the vegetation adding tool, and the visibility of each layer is controlled by parameters to simulate the corresponding season. A light source layer is added to the three-dimensional model of the scenic area, and a point light source and a surface light source are added to the corresponding position. The switch of the light source is controlled by parameters, turned on at night and turned off during the day to complete the night scene construction. A particle system is created in the three-dimensional model of the scenic area, and parameters such as speed, size, shape, etc. are set and stored for rain, snow, fog, and weather, respectively, for quick call during weather simulation.
[0076] In the disclosed embodiment, after each layer of the above-mentioned three-dimensional model of the scenic spot is built, the interface is encapsulated respectively, and the corresponding interface is exposed for parameterized dynamic configuration. After the tourist enters the online tour system, he selects the three-dimensional model of the scenic spot to be visited, and first completes the setting according to the parameters such as season and weather. The scene is configured and rendered on the server side, and the user browser side can display the target scenic spot. Preferably, before the tourist enters the tour, the scene of the current scenic spot is configured according to his own preferences, including selecting the season (spring, summer, autumn, winter), the tour time (early morning, morning, afternoon, evening, night view), and the weather (sunny, rainy, snowy, foggy). After completing these configurations, the target tour three-dimensional scene is generated.
[0077] Step 202, 3D digital tour guide configuration.
[0078] In the disclosed embodiment, a modeling software such as 3D animation software (Maya) and 3D graphics software (Blender) is used to make digital character models of various images, including but not limited to boys, girls, cartoons, and two-dimensional images; the model needs to include the skeleton of the body part, and the face has a skeleton mesh and 52 facial expression control bindings to meet the ability of the model of the application tool (Arkit) to be synchronously bound and driven. A speech synthesis module is built, and with the ability of the speech synthesis large model, different types of speech data samples are uploaded to form a speech data set, exposing parameters such as personality, timbre, and speed of sound for customizing the effect of speech generation, and the built speech synthesis module is used for the above-mentioned digital character model. According to the above-mentioned speech synthesis module, a speech generation facial animation module is built, and the input parameter is the synthesized speech data. Through plug-in tools such as Audio2Face, the facial expression animation parameters of the human face are output and passed into the pre-built digital human model. In the compiled state, the facial movements of the digital human can be kept consistent with the audio data. Based on the above steps, tourists can enter the system and customize their favorite 3D digital tour guide image by selecting the parameters of the character model. The customized 3D digital tour guide image, including image, personality, voice, etc., can meet the personalized needs of tourists.
[0079] Step 203: Plan a personalized route.
[0080] In the disclosed embodiment, the three-dimensional model of the scenic spot built in the above step 201 is used as the basis to draw the walkable area, and then the navigation grid is generated using the currently more mature navigation system. A data table of the visiting and stopping points of the new three-dimensional model of the scenic spot is created, and the coordinate positions are extracted. The table contains the following required fields: point name, coordinate position, stop time, fixed explanation content, best visiting angle, point type; the visiting direction refers to the best visiting direction at the current stop point, starting from the north in a clockwise direction, with a difference of 30 degrees, and filled in from 0-11; point types include: water systems, monuments, buildings, sculptures, natural landscapes, cultural attractions, etc.
[0081] In the disclosed embodiment, the route is planned according to the preferences of tourists. Different from the conventional path-finding algorithm, the optimal route is calculated directly according to the starting point and the end point. This solution needs to optimize the existing path-finding algorithm, as follows: (1) Tourists choose the tour time (Total time); (2) The "intended waypoints" selected by tourists are set as "must-pass places" and saved as "Set A", and the explanation time of the waypoints is accumulated to obtain the time consumption (Time1); (3) According to the tour style selected by tourists, the "point type" is matched in the data table, the corresponding point "Set B" is selected, and the total stay time of the points is calculated (Time2); (4) Relying on the navigation grid and the optimal path in the path-finding algorithm, the shortest route connecting these points once is calculated (Route1), and the time spent is calculated (Time3); (5) If the time of Time1+Time2+Time3 exceeds the above-mentioned tour time Total time, the explanation content of non-essential points is slimmed down by AI, thus achieving the purpose of reducing the explanation time and ensuring that the total tour time meets the tourists' expectations; (6) With Route1 as the center line, a buffer surface with a radius of 10 meters is generated, and the attractions within the surface but not in the passing points "Set A" and "Set B" are retrieved as "Set C". The fixed explanation content of the passing attractions in "Set C" is extracted to form the explanation content when walking between the points.
[0082] Step 204: the tour perspective follows the configuration.
[0083] In the disclosed embodiment, in order to enable the user to follow the digital tour guide from a third-person perspective to tour a predetermined route without any operation, that is, to ensure the best viewing angle during the tour and to ensure that the tourists' perspective is at the best position when giving explanations at a fixed position after stopping, and to ensure that the tour guide's face is facing the tourists, the following configuration is performed.
[0084] In the disclosed embodiment, the best viewing angle is ensured during the tour. The specific implementation method is as follows: the route Route1 in the previous module and the passing points "set A", "set B" and "set C" are obtained. The eyes of the tourists are the camera angles in the three-dimensional model of the scenic spot. Through voice recognition, the current 3D digital tour guide's broadcast content is monitored. When the name of the first point D in "set C" is recognized, the coordinates (Coor1) of the first point D are queried in the database, and the coordinates (Coor2) of the current camera position point E are obtained. By calculating the vector DE, the unit vector of the vector DE is calculated to obtain the direction vector, and the direction of the point D relative to the point E is calculated. The horizontal offset is the "orientation value", and the height offset is recorded as the "pitch value"; following the Cartesian coordinates in the three-dimensional scene, the direction around the Y axis is replaced by Yaw, and the pitch around the X axis is replaced by Pitch. While the 3D digital tour guide moves along the route, the Yaw value and Pitch value of the camera are set synchronously in real time, so that tourists can keep their field of vision facing the direction of the landscape while following the 3D digital tour guide.
[0085] In the disclosed embodiment, after stopping walking, in the case of explaining at a fixed position, the tourist's perspective is guaranteed to be in the best position, and the guide's face is facing the tourist. The specific implementation method is as follows: after the 3D digital guide arrives at the designated explanation position, the "best viewing angle" is obtained from the explanation point in the visit and stop point data table of the above-mentioned three-dimensional model of the scenic spot according to the name of the scenic spot at the position, and the pre-stored orientation and pitch value are obtained; the Yaw and Pitch values of the camera perspective are set in a natural over-reading manner to achieve the best tourist visiting range; according to the orientation value Yaw, 360°-Yaw is used to calculate the value Pyaw in the opposite direction, and the digital guide's face orientation is set to Pyaw in a way of rotating in situ, so that the guide's face is facing the tourist, and the guide's facial expressions and body movements can be seen.
[0086] Step 205, 3D digital tour guide driver configuration.
[0087] In the disclosed embodiment, when making the character model of the above-mentioned 3D digital tour guide, the arm bone action is set as a parameterized trigger, such as in the Unreal Engine UE, creating a blueprint function to drive the animation of the limb bones, including but not limited to the arm number (left, right), moving height, moving direction, etc.; during the tour guide's voice explanation, when a phrase such as "please look at the upper left 45 degrees" appears to indicate a specific position, the execution of the blueprint function is triggered, and the left arm is raised to the left front and pointed at a 45-degree direction. The tour guide's actions and words can be matched. It can be achieved that the arm points to the correct position during the 3D digital tour guide's explanation.
[0088] Step 206, voice interaction configuration.
[0089] In the disclosed embodiment, with the help of the ability of the large voice recognition model, the relevant software development kit (SDK) is accessed to obtain the microphone permission of the user's device for the collection and recognition of the user's audio information; an instruction library is established to store trigger key values and execution functions in the form of lightweight data exchange format (JavaScript Object Notation, JSON) key-value pairs, such as: perspective zooming in, and encode and encapsulate all instruction functions; the instruction library is uploaded to the voice recognition model for training; it can realize automatic matching of keywords according to the natural language description of tourists, such as "I want to get closer" matches "perspective zooming in", thereby triggering the corresponding function and changing the perspective of the scene seen by tourists. It realizes natural communication between simulated real people with 3D digital tour guides, and intervenes in the tour through voice interaction without the need for mouse or touch operation.
[0090] Step 207: User sight tracking configuration.
[0091] In the disclosed embodiment, with the help of the currently disclosed eye tracking technology, a request is first made to obtain the user's camera permission; the angle between the user's eye gaze direction and the vertical angle of the screen (including the horizontal and vertical directions of the two-dimensional screen surface) is monitored in real time. When it is recognized that the angle direction exceeds 20 degrees and the dwell time exceeds two seconds, it is determined that the user needs to change the current viewing angle; the current angle is used as a parameter, and the corresponding offset is performed around the X-axis or Y-axis relative to the current camera's orientation and pitch position to complete the control.
[0092] In the disclosed embodiment, through the user's line of sight tracking configuration, it is also possible to determine whether the current tourist is in a normal tour state. For example, if the line of sight angle is greater than 45 degrees for 5 seconds, or if the effective eyeball cannot be tracked for more than 10 seconds, it can be determined that the current tourist is in offline mode. The 3D digital tour guide's explanation and the tour can be automatically paused and resumed when a valid value is recognized.
[0093] Figure 3 A schematic diagram of an online browsing device according to an embodiment of the present disclosure is shown. Figure 3 As shown, an online browsing device according to an embodiment of the present disclosure includes:
[0094] The scenic area environment configuration module 301 is used to obtain the three-dimensional model of the scenic area stored in the cloud, configure the corresponding model data package based on the three-dimensional model of the scenic area, encapsulate at least one data interface in the model data package, and personalize the three-dimensional model of the scenic area based on the at least one encapsulated data interface.
[0095] The scenic area environment configuration module 301 is also used to build the scenic area three-dimensional model based on the layer type data included in the model data packet; after the building is completed, obtain at least one corresponding layer type interface based on the at least one layer type data, and encapsulate the at least one layer type interface.
[0096] The guide configuration module 302 is used to establish at least one character image model, and select a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot.
[0097] The tour guide configuration module 302 is also used to configure at least one necessary character feature based on the at least one character image model; combine the at least one character feature with the at least one character image model to obtain at least one personalized character image model; obtain the user's preference features, and select one of the at least one personalized character image models as the online tour guide based on the preference features.
[0098] The path planning module 303 is used to select the walkable area in the three-dimensional model of the scenic area based on the extraction tool, establish a navigation grid based on the walkable area, establish a corresponding scenic spot content data table based on the scenic spot content contained in the three-dimensional model of the scenic area, and plan the user's optimal tour path based on the scenic spot content data table.
[0099] The path planning module 303 is also used for the scenic spot content data table to contain: scenic spot name, scenic spot coordinates, scenic spot stay time, fixed explanation content, optimal visiting angle and scenic spot type; obtaining the total tour time set by the user and the first scenic spot type and the first scenic spot name set selected in the scenic spot content, and determining the first scenic spot stay time corresponding to the first scenic spot name based on the first scenic spot name set and the scenic spot content data table; obtaining the second scenic spot name set corresponding to the first scenic spot type in the scenic spot content data table, the second scenic spot name does not contain the first scenic spot name, and determining the second scenic spot stay time corresponding to the second scenic spot name set based on the second scenic spot name set and the scenic spot content data table; based on the navigation grid, calculating the optimal tour path and the required optimal tour path time passing through all scenic spot locations in the first scenic spot name set and the second scenic spot name set. The first scenic spot residence time, the second scenic spot residence time and the optimal tour path time are added to obtain a first estimated time, and the first estimated time is compared with the total tour time. If the first estimated time exceeds the total tour time, the first estimated time is reduced based on a first algorithm so that the first estimated time does not exceed the total tour time; the shortest path is used as the center line, a buffer surface is generated based on a first radius, and the scenic spot names in the buffer surface except the first scenic spot name set and the second scenic spot name set are retrieved as a third scenic spot name set, and a third set of fixed explanation content corresponding to the third scenic spot name set is obtained, and the third set of fixed explanation content is used as the explanation content when walking between points.
[0100] The sightseeing angle following module 304 is used to calculate the best sightseeing angle of the user based on the Cartesian coordinate system using the optimal sightseeing path, the scenic spot content data table and the voice content.
[0101] The tour perspective following module 304 is also used for: the optimal tour angle includes a walking tour angle and a fixed tour angle; monitoring the voice content of the online tour guide to obtain the scenic spot feature information in the voice content; when the scenic spot feature information includes the passing scenic spots in the third scenic spot name set, obtaining the first coordinate information of the passing scenic spots and the second coordinate information of the current user's perspective based on the optimal tour path, calculating the first direction vector based on the first coordinate information and the second coordinate information, and obtaining the horizontal offset value and the height offset value of the first coordinate compared to the second coordinate; calculating the walking tour angle of the user when walking in the optimal tour path based on the Cartesian coordinate system, the horizontal offset value and the height offset value, so that the user's perspective Based on the walking and visiting angle, the online tour guide moves toward the passing scenic spots while following the movement; the fixed visiting angles of the must-go scenic spots in the first scenic spot name set and the second scenic spot name set stored in the scenic spot content data table are obtained; based on the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value of the online tour guide when facing the user's perspective are calculated, and the direction of the online tour guide is rotated based on the fixed horizontal offset value and the fixed height offset value so that the user's perspective can see the facial expressions and body movements of the online tour guide; based on the walking and visiting angle, the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value, the walking and visiting angle is naturally converted to the fixed visiting angle.
[0102] The instruction driving module 305 is used to obtain an instruction library stored in the cloud, in which control instructions for changing the user's viewing angle and driving instructions for changing the position of the arm model of the online tour guide are stored; obtain the microphone permission of the device, collect the audio information of the user based on the microphone permission, and identify the keywords of the instruction features contained in the audio information; match the keywords with the control instructions, and if the match is successful, then in response to the control instructions, adjust the user's viewing angle based on the Cartesian coordinate system; or match the keywords with the driving instructions, and if the match is successful, then in response to the driving instructions, control the arm model to move to the position corresponding to the driving instruction based on the blueprint function.
[0103] The sight line control module 306 is used to obtain the camera authority of the device, and collect the user's eye gaze angle based on the camera authority. When the gaze angle exceeds a first angle and the stay time exceeds a first duration, it is determined that the user needs to change the current viewing angle; the gaze angle is used as a parameter, and the current viewing angle is modified to be smaller than the first angle based on the Cartesian coordinate system.
[0104] In an exemplary embodiment, the scenic environment configuration module 301, the tour guide configuration module 302, the path planning module 303, the tour perspective following module 304, the instruction driving module 305 and the sight line control module 306 can be implemented by one or more central processing units (CPU), graphics processing units (GPU), application specific integrated circuits (ASIC), DSP, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.
[0105] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0106] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.
[0107] Figure 4 A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0108] like Figure 4As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 to a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0109] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0110] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as an online tour method. For example, in some embodiments, an online tour method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps in the online tour method described above may be executed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform an online tour method in any other appropriate manner (e.g., by means of firmware).
[0111] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0112] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0113] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0114] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0115] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0116] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.
[0117] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.
[0118] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0119] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. An online browsing method, It is characterized in that The method comprises: Acquire a three-dimensional model of a scenic spot stored in a cloud, configure a model data package corresponding to the three-dimensional model of the scenic spot, encapsulate at least one data interface in the model data package, and perform personalized settings on the three-dimensional model of the scenic spot based on the at least one encapsulated data interface; Establishing at least one character image model, and selecting a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot; Selecting a walkable area in the three-dimensional model of the scenic spot based on a setter tool, establishing a navigation grid based on the walkable area, establishing a corresponding scenic spot content data table based on the scenic spot content included in the three-dimensional model of the scenic spot, and planning an optimal tour path for the user based on the scenic spot content data table; Based on a Cartesian coordinate system, the optimal sightseeing angle of the user is calculated using the optimal sightseeing path, the scenic spot content data table and the voice content; The scenic spot content data table includes: scenic spot name, scenic spot coordinates, scenic spot stay time, fixed explanation content, best viewing angle and scenic spot type; Obtain the total tour time set by the user and the first attraction type and the first attraction name set selected from the attraction content, and determine the first attraction stay time corresponding to the first attraction name based on the first attraction name set and the attraction content data table; Obtain a second attraction name set corresponding to the first attraction type in the attraction content data table, where the second attraction name does not include the first attraction name, and determine a second attraction stay time corresponding to the second attraction name set based on the second attraction name set and the attraction content data table; Based on the navigation grid, calculating an optimal tour path passing through all scenic spots in the first scenic spot name set and the second scenic spot name set and the required optimal tour path time; Taking the shortest path as the center line, generating a buffer surface based on the first radius, and retrieving the scenic spot names other than the first scenic spot name set and the second scenic spot name set in the buffer surface as a third scenic spot name set; Wherein, the optimal viewing angle includes a walking viewing angle and a fixed viewing angle; Monitoring the voice content of the online guide and acquiring scenic spot feature information in the voice content; When the scenic spot feature information includes a passing scenic spot in the third scenic spot name set, first coordinate information of the passing scenic spot and second coordinate information of the current user perspective are obtained based on the optimal tour path, a first direction vector is calculated based on the first coordinate information and the second coordinate information, and a horizontal offset value and a height offset value of the first coordinate compared to the second coordinate are obtained; Based on the Cartesian coordinate system, the horizontal offset value and the height offset value, the walking and sightseeing angle of the user when walking in the optimal sightseeing path is calculated, so that the user's perspective follows the movement of the online guide and moves toward the passing scenic spot based on the walking and sightseeing angle; Obtaining fixed viewing angles of must-go attractions in the first attraction name set and the second attraction name set stored in the attraction content data table; Calculating a fixed horizontal offset value and a fixed height offset value of the online guide when facing the user's perspective based on the fixed visiting angle, and rotating the orientation of the online guide based on the fixed horizontal offset value and the fixed height offset value, so that the user's perspective can see the online guide's facial expressions and body movements; Based on the walking visiting angle, the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value, naturally transitioning the walking visiting angle to the fixed visiting angle; wherein, obtaining a command library stored in the cloud, wherein the command library stores control commands for changing the user's viewing angle and drive commands for changing the position of the arm model of the online lecturer; Obtaining microphone permissions of a device, collecting audio information of the user based on the microphone permissions, and identifying keywords of command features contained in the audio information; Matching the keyword with the control instruction, if the match is successful, adjusting the user viewing angle based on the Cartesian coordinate system in response to the control instruction; Or the keyword is matched with the driving instruction. If the match is successful, the arm model is controlled to move to the position corresponding to the driving instruction based on the blueprint function in response to the driving instruction.
2. The method according to claim 1, It is characterized in that The method further comprises: Adding the first scenic spot stay time, the second scenic spot stay time and the optimal tour path time to obtain a first estimated time, comparing the first estimated time with the total tour time, and if the first estimated time exceeds the total tour time, reducing the first estimated time based on a first algorithm so that the first estimated time does not exceed the total tour time; The third set of fixed explanation contents corresponding to the third set of scenic spot names is obtained, and the third set of fixed explanation contents is used as the explanation contents when walking between the points.
3. The method according to claim 1, It is characterized in that The method further comprises: Obtaining camera permissions of a device, and collecting the user's gaze angle based on the camera permissions, and when the gaze angle exceeds a first angle and the dwell time exceeds a first duration, determining that the user needs to change the current viewing angle; Taking the gaze angle as a parameter, the current viewing angle is modified to be smaller than the first angle based on the Cartesian coordinate system.
4. The method according to claim 1, It is characterized in that The encapsulating at least one data interface in the model data package comprises: The model data package includes at least one layer type data, and the three-dimensional model of the scenic spot is constructed based on the layer type data; After the construction is completed, at least one corresponding layer type interface is obtained based on the at least one layer type data, and the at least one layer type interface is encapsulated.
5. The method according to claim 1, It is characterized in that The step of selecting a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot includes: configuring at least one character feature based on the at least one character image model; Combining the at least one character feature with the at least one character image model to obtain at least one personalized character image model; The user's preference characteristics are obtained, and one of the at least one personalized character image models is selected as the online commentator based on the preference characteristics.
6. An online browsing device, It is characterized in that The device comprises: A scenic area environment configuration module, used to obtain a scenic area three-dimensional model stored in the cloud, configure a model data package corresponding to the scenic area three-dimensional model, encapsulate at least one data interface in the model data package, and perform personalized settings on the scenic area three-dimensional model based on the encapsulated at least one data interface; A guide configuration module, used to establish at least one character image model, and select a personalized character image model from the at least one character image model as an online guide in the three-dimensional model of the scenic spot; A path planning module, for selecting a walkable area in the three-dimensional model of the scenic spot based on a setter tool, establishing a navigation grid based on the walkable area, establishing a corresponding scenic spot content data table based on the scenic spot content contained in the three-dimensional model of the scenic spot, and planning an optimal tour path for the user based on the scenic spot content data table; A sightseeing angle following module, for calculating the user's best sightseeing angle based on a Cartesian coordinate system using the optimal sightseeing path, the scenic spot content data table and the voice content; The path planning module is also used for, wherein the scenic spot content data table contains: scenic spot name, scenic spot coordinates, scenic spot stay time, fixed explanation content, optimal visiting angle and scenic spot type; obtaining the total tour time set by the user and the first scenic spot type and the first scenic spot name set selected in the scenic spot content, and determining the first scenic spot stay time corresponding to the first scenic spot name based on the first scenic spot name set and the scenic spot content data table; obtaining the second scenic spot name set corresponding to the first scenic spot type in the scenic spot content data table, the second scenic spot name does not contain the first scenic spot name, and determining the second scenic spot stay time corresponding to the second scenic spot name set based on the second scenic spot name set and the scenic spot content data table; based on the navigation grid, calculating the optimal tour path and the required optimal tour path time passing through all scenic spot locations in the first scenic spot name set and the second scenic spot name set; using the shortest path as the center line, generating a buffer surface based on the first radius, and retrieving the scenic spot names in the buffer surface except the first scenic spot name set and the second scenic spot name set as the third scenic spot name set; The tour perspective following module is also used for, wherein the optimal tour angle includes a walking tour angle and a fixed tour angle; monitoring the voice content of the online tour guide to obtain scenic spot feature information in the voice content; when the scenic spot feature information includes the passing scenic spots in the third scenic spot name set, obtaining the first coordinate information of the passing scenic spots and the second coordinate information of the current user's perspective based on the optimal tour path, calculating the first direction vector based on the first coordinate information and the second coordinate information, and obtaining the horizontal offset value and the height offset value of the first coordinate compared to the second coordinate; calculating the walking tour angle of the user when walking in the optimal tour path based on the Cartesian coordinate system, the horizontal offset value and the height offset value, so that the user The viewing angle follows the online guide's movement based on the walking and visiting angle while facing the passing scenic spots; the fixed visiting angles of the must-go scenic spots in the first scenic spot name set and the second scenic spot name set stored in the scenic spot content data table are obtained; the fixed horizontal offset value and the fixed height offset value of the online guide facing the user's viewing angle are calculated based on the fixed visiting angle, and the orientation of the online guide is rotated based on the fixed horizontal offset value and the fixed height offset value, so that the user's viewing angle can see the facial expressions and body movements of the online guide; based on the walking and visiting angle, the fixed visiting angle, the fixed horizontal offset value and the fixed height offset value, the walking and visiting angle is naturally transitioned to the fixed visiting angle; An instruction driving module is used to obtain an instruction library stored in the cloud, wherein the instruction library stores control instructions for changing the user's viewing angle and driving instructions for changing the position of the arm model of the online lecturer; obtain microphone permissions of the device, collect audio information of the user based on the microphone permissions, identify keywords of instruction features contained in the audio information, match the keywords with the control instructions, and if the match is successful, respond to the control instructions to adjust the user's viewing angle based on the Cartesian coordinate system; or match the keywords with the driving instructions, and if the match is successful, respond to the driving instructions to control the arm model to move to the position corresponding to the driving instructions based on the blueprint function.
7. An electronic device, It is characterized in that include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 5.
8. A non-transitory computer-readable storage medium storing computer instructions, It is characterized in that The computer instructions are used to make a computer execute the method according to any one of claims 1-5.
Citation Information
Patent Citations
Network museum visiting system and realization method thereof
CN104462686A
Scenic spot touring route planning method and device and computer equipment
CN113626636A
Guide interaction method, device and equipment applied to online virtual exhibition hall
CN117590986A
Data presentation method and apparatus, computer device, storage medium, computer program product, and computer program
WO2022262521A1
