Scene analysis method and system based on virtual reality technology
By introducing scene analysis methods and systems in virtual reality technology, customized navigation strategies and explanation data are generated according to user needs, the problem of insufficient personalization of navigation in the existing technology is solved, and users can achieve more detailed user experience in VR. Visit the destination.
Patent Information
- Application Number
- CN202411215199.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-09-02
AI Technical Summary
In existing virtual reality technology, when users visit their destinations through VR, they cannot guide them according to their personal needs, resulting in the inability to personalize the guides.
By introducing scene analysis methods and systems in virtual reality technology, customized navigation strategies and explanation data are generated and sent based on users' roaming requests and needs, including separate navigation strategies and global navigation strategies, providing detailed scenario elements Layout and explanation, combining the user's selection order and needs.
It realizes personalized guides and guidance based on user needs, allowing users to understand the layout and specific areas of the target location in more detail, and improves the pertinence and efficiency of the user experience.
Smart Images

Figure CN118732900B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to virtual reality technology, and in particular to a scene analysis method and system based on virtual reality technology. Background Art
[0002] Virtual Reality technology can create and experience a simulated virtual environment, generate images and sounds through computers, and allow users to experience the scenes and feelings in an immersive way.
[0003] At present, users can visit destinations through VR without going there, which provides great convenience for users' lives. However, in the prior art, when users visit destinations through VR, they are generally guided by configured explanation data, which cannot provide corresponding guidance according to user needs.
[0004] Therefore, how to provide users with corresponding navigation guidance based on their needs has become an urgent problem that needs to be solved today. Summary of the invention
[0005] The present invention provides a scene analysis method and system based on virtual reality technology, which can provide corresponding navigation guidance for users in accordance with their needs.
[0006] A first aspect of the present invention provides a scene analysis method based on virtual reality technology, comprising:
[0007] Determining, according to a roaming request of an access terminal, a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces;
[0008] Acquire a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy;
[0009] According to the explanation requirements of the access terminal for the guided tour display data, the corresponding scene elements are arranged to obtain a guided tour explanation sequence;
[0010] Generate customized explanation data corresponding to the guided explanation sequence and send it to the access terminal;
[0011] Acquire a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy, including:
[0012] Acquire multiple scene elements in the display space, and determine the element category corresponding to each of the scene elements;
[0013] Generate a navigation table according to the element category and send it to the access terminal, and obtain a navigation strategy selected by the access terminal based on the navigation table, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy;
[0014] Determine the target category selected by the access terminal based on the separate navigation strategy, generate a separate navigation map corresponding to the scene elements of the target category and send it to the access terminal, wherein the navigation display data includes the separate navigation map; or,
[0015] Distribute the overhead display map of the display space according to the global navigation strategy to obtain a global navigation map and send it to the access terminal, wherein the navigation display data includes the global navigation map;
[0016] Determine the target category selected by the access terminal based on the separate navigation strategy, generate a separate navigation map corresponding to the scene elements of the target category and send it to the access terminal, wherein the navigation display data includes the separate navigation map, including:
[0017] Determine that the element category selected by the access terminal based on the navigation table is a target category, and obtain the element area corresponding to the target category as the target area;
[0018] Acquire a top view display image corresponding to the display space, and delete element areas other than the target area in the top view display image to obtain a target display image;
[0019] Retrieving an initial adjustment interface, and filling the target display image into a reference area of the initial adjustment interface, wherein the initial adjustment interface includes a reference area in the middle and an adjustment area around the reference area;
[0020] Determine a pre-set edge area in the target display image, and obtain a target area located in the edge area as a processing area;
[0021] Acquire the interval distances between the processing areas, and determine the processing area whose interval distance is greater than the interval distance threshold as the adjustment area;
[0022] The layout of the initial adjustment interface is updated according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface, an image area in the separate navigation interface is intercepted to obtain a separate navigation map, and the separate navigation map is adjusted based on the specification of the display window of the access terminal and then displayed in the display window;
[0023] The overhead display image of the display space is distributed according to the global navigation strategy to obtain a global navigation image and send it to the access terminal, including:
[0024] Acquire a bird's-eye view display image of the display space, and determine an element area corresponding to each of the scene elements in the bird's-eye view display image;
[0025] Classifying the element regions with the same element category into the same set to obtain multiple element region sets;
[0026] Determine a reference point corresponding to each element area set according to the central position points corresponding to all element areas in each element area set;
[0027] Generate a layout line from the reference point to the center point of each element area in the element area set, and construct a batch control corresponding to each reference point;
[0028] The preset pixel values corresponding to the element categories are retrieved to update the corresponding layout lines, and a global navigation map is obtained and sent to the access terminal.
[0029] Optionally, in a possible implementation manner of the first aspect, the initial adjustment interface is updated in layout according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface, including:
[0030] Counting the number of adjustment areas corresponding to each edge in the edge area, obtaining the adjustment area corresponding to the edge with the largest number of adjustment areas as the positioning area, and the adjustment areas other than the positioning area as the first moving area;
[0031] When the number of the positioning areas is greater than the reference number, generating a joint outer frame corresponding to all the positioning areas;
[0032] Obtain the shortest distance from the combined outer frame to each of the edge edges, and determine the edge edge whose shortest distance is less than a shortest distance threshold as a positioning edge;
[0033] When the number of the positioning edges is equal to the reference number, a unilateral layout adjustment is performed on each of the first moving areas to obtain a first separate navigation interface;
[0034] When the number of the positioning edges is greater than the reference number, a polygonal layout adjustment is performed on each of the first moving areas to obtain a second separate navigation interface.
[0035] Optionally, in a possible implementation manner of the first aspect, when the number of the positioning edges is equal to the reference number, performing unilateral layout adjustment on each of the first moving areas to obtain a first separate navigation interface includes:
[0036] When the number of the positioning edges is equal to the reference number, a first positioning line perpendicular to the positioning edges is generated with the first center point of the combined outer frame as a reference;
[0037] Copying each of the first mobile areas to obtain a plurality of second mobile areas, and arranging each of the second mobile areas from large to small according to area specifications to obtain a first sequence;
[0038] The first second moving area in the first sequence is obtained as the first selected area, the center point of the first selected area is located according to the first positioning line, and the first selected area is filled in the position in the adjustment area that contacts the positioning edge;
[0039] Taking the center point of the first selected area as a reference, generating a second positioning line parallel to the positioning edge, and sequentially acquiring the next second moving area in the moving area sequence as the next first selected area;
[0040] Locating the center point of the next first selected area based on the second positioning line, and sequentially filling the next first selected area on both sides of the first first selected area according to a preset interval distance to obtain a first separate navigation interface;
[0041] The first moving area and the second moving area in the first separate navigation interface are displayed in association with each other according to the corresponding adjusted pixel values.
[0042] Optionally, in a possible implementation manner of the first aspect, when the number of the positioning edges is greater than the reference number, performing a multi-edge layout adjustment on each of the first moving areas to obtain a second separate navigation interface includes:
[0043] When the number of the positioning edges is greater than the reference number, a direction perpendicular to each of the positioning edges is obtained as a positioning direction;
[0044] Acquire the area length of each of the first moving areas in each of the positioning directions, and determine the positioning side perpendicular to the positioning direction with a shorter area length as the target side corresponding to the corresponding first moving area;
[0045] The first moving area is copied to obtain a plurality of second moving areas, and the second moving areas corresponding to the positioning edges are arranged from large to small according to the area specification to obtain a second sequence;
[0046] Taking the center point of the combined outer frame as a reference, respectively generating second positioning lines perpendicular to each of the positioning edges;
[0047] The first second moving area in the second sequence is obtained as the second selected area, a center point of the second selected area is located based on the corresponding second positioning line, and the second selected area is filled in the position in the adjustment area that contacts the target edge;
[0048] Taking the center point of the second selected area as a reference, generating a second positioning line parallel to the target edge, and sequentially acquiring the next second moving area in the second sequence as the next second selected area;
[0049] Locating the center point of the next second selected area according to the second positioning line, and filling the next second selected area into the adjustment area according to a preset interval distance to obtain a second separate navigation interface;
[0050] The first moving area and the second moving area in the second separate navigation interface are displayed in association with each other according to the corresponding adjusted pixel values.
[0051] Optionally, in a possible implementation of the first aspect, according to the explanation requirement of the access terminal for the guided tour display data, arranging the corresponding scene elements to obtain a guided tour explanation sequence includes:
[0052] receiving the explanation requirement of the access terminal for the selection of the guide display data, wherein the explanation requirement includes a customized explanation requirement and an overall explanation requirement;
[0053] Based on the customized explanation requirement, obtaining an element area selected by the access terminal in the navigation display data as an explanation area;
[0054] Arranging the explanation areas according to the selection order of the access terminal to obtain the guided explanation sequence; or,
[0055] Based on the overall explanation requirement, the total area corresponding to the virtual model is acquired, and the total number of elements corresponding to the scene elements of the virtual model is counted;
[0056] According to the ratio of the total area to the total number of elements, an average floor area corresponding to the virtual model is obtained;
[0057] Determine the sub-floor area corresponding to each element area in the navigation display data, and obtain the element area whose sub-floor area is smaller than the average floor area as the to-be-merged area, and the element area whose sub-floor area is larger than the average floor area as the optional area;
[0058] Acquire the optional area closest to the area to be merged as the matching area corresponding to the area to be merged, and determine that the matching area and the area to be merged are the same integration area;
[0059] Determine the element number corresponding to the matching area in the integrated area as the arrangement number, arrange each integrated area according to a preset element order and the arrangement number, and obtain the guided explanation sequence, wherein the preset element order includes the arrangement numbers corresponding to multiple scene elements.
[0060] Optionally, in a possible implementation manner of the first aspect, generating customized explanation data corresponding to the guided explanation sequence and sending it to the access terminal includes:
[0061] The first explanation area or integration area in the guided explanation sequence is obtained as a customized area, and a shooting device is controlled to obtain a current captured image corresponding to the display space;
[0062] The customized area in the current collected image is highlighted to obtain a customized explanation image, and the sub-customized speech corresponding to the customized area is obtained;
[0063] Retrieving an initial explanation interface, the initial explanation interface including an explanation digital person and an explanation display area, updating the explanation display area according to the explanation customized image, updating the explanation digital person according to the sub-customized speech, and obtaining a sub-explanation video;
[0064] Continue to obtain the next explanation area or integrated area in the guided explanation sequence as the next customized area, and repeat the above steps of obtaining the sub-explanation video until the guided explanation sequence is traversed completely;
[0065] The sub-explanation videos are spliced according to the guided explanation sequence to obtain customized explanation data which is sent to the access terminal.
[0066] A second aspect of the present invention provides a scene analysis system based on virtual reality technology, comprising:
[0067] A roaming module, used to determine, according to a roaming request of an access terminal, a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces;
[0068] A navigation module, used to obtain a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy;
[0069] An explanation module, used for arranging the corresponding scene elements to obtain a guide explanation sequence according to the explanation requirements of the access terminal for the guide display data;
[0070] The customization module is used to generate customized explanation data corresponding to the guided explanation sequence and send it to the access terminal.
[0071] The beneficial effects of the present invention are as follows:
[0072] The present invention can provide corresponding navigation guidance for users in accordance with their needs. The present invention can enable users to roam around the target location in an immersive way, and can display the layout of the corresponding space for users in accordance with their needs, so that users can select the corresponding area for understanding in accordance with the layout and their own needs. After the user selects the area they want to understand, the present invention will explain the corresponding area in detail, so that the user can understand the corresponding space in more detail.
[0073] When displaying the layout of the corresponding space to the user, the present invention will display the layout of the corresponding type of element area or the overall layout of the entire space in combination with the user's needs. When displaying the layout of the corresponding type of element area, the present invention will focus on the area located at the edge, so that the user can quickly select the corresponding area for explanation. When displaying the overall layout of the entire space, the present invention will associate the element areas of the same type for display, so that the user can distinguish between different types of element areas, and can quickly explain and select the element areas of the same type, thereby improving the user's selection efficiency.
[0074] When explaining an area in detail, the present invention will not only provide a detailed introduction to the corresponding area, but also display the actual situation of the corresponding area accordingly, so that the user can understand the details of the corresponding area while also being able to view the actual situation of the corresponding area. BRIEF DESCRIPTION OF THE DRAWINGS
[0075] Figure 1 It is a flowchart of a scene analysis method based on virtual reality technology provided by an embodiment of the present invention;
[0076] Figure 2 is a schematic diagram of a first separate navigation interface provided by an embodiment of the present invention;
[0077] Figure 3 is a schematic diagram of a second separate navigation interface provided by an embodiment of the present invention;
[0078] Figure 4 It is a structural schematic diagram of a scene analysis system based on virtual reality technology provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0079] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0080] See also Figure 1 , is a flow chart of a scene analysis method based on virtual reality technology provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows:
[0081] S1, according to a roaming request of an access terminal, determining a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces.
[0082] The access terminal refers to a terminal held by a user, such as a VR terminal, through which the user can visit the destination in an immersive way. The destination point can be a place that the user wants to visit, such as an office building of a company, so that the user can view the actual situation of the corresponding place without going there.
[0083] A virtual model refers to a virtual three-dimensional model constructed in combination with the actual conditions of the destination, which can enhance the user's sense of reality during the experience and provide an immersive experience for the user. A display space refers to the space corresponding to each area in the virtual model. For example, when the virtual model is a virtual model corresponding to an office building, it may have multiple areas, such as an office area, a reception area, a leisure area, etc. The display space can be the space corresponding to the office area, the reception area, the leisure area, etc. In actual applications, users can select the corresponding display space for visiting based on the current roaming request.
[0084] S2, obtaining a navigation strategy selected by the access terminal based on scene elements in the display space, generating navigation display data according to the navigation strategy and sending it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy.
[0085] It is understandable that there may be many components in the exhibition space. For example, there may be desks and chairs, lockers, green plants and other components in the office area. Scene elements refer to the components of the exhibition space, such as the desks and chairs mentioned above.
[0086] In actual applications, the layouts of different exhibition spaces may be different, and users may not be able to see the overall layout of the exhibition space during their visit. When users need to view the layout, this solution will display the corresponding layout according to the user's needs, so that users can view the areas of interest in detail based on the layout. Subsequently, the corresponding areas can be explained in detail to users according to their needs, so that users can have a detailed understanding of the corresponding areas while visiting.
[0087] Specifically, this solution will display the layout of the scene elements selected by the user in combination with the individual navigation strategy selected by the user, and will display the overall layout of all scene elements in the display space in combination with the global navigation strategy selected by the user.
[0088] Among them, the navigation strategy refers to the strategy for displaying the layout of the exhibition space, the individual navigation strategy refers to the strategy for displaying the layout of a single scene element, the global navigation strategy refers to the strategy for displaying the layout of all scene elements in the exhibition space, and the navigation display data refers to the layout display data generated in combination with user needs.
[0089] Based on the above embodiment, the specific implementation of step S2 may be:
[0090] S21, obtaining a plurality of scene elements in the display space, and determining an element category corresponding to each of the scene elements.
[0091] It is understandable that the categories corresponding to the components in the display space may be different. For example, office desks and chairs may belong to the office supplies category, while green plants may belong to the decoration category. Therefore, in order to display the layout of components of different categories, the element category to which each scene element belongs can be determined.
[0092] S22, generating a navigation table according to the element category and sending it to the access terminal, obtaining a navigation strategy selected by the access terminal based on the navigation table, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy.
[0093] The navigation table is a list of multiple element categories. It is understandable that in some cases, the user may want to view the layout of a single category of objects, for example, the user may want to view the layout of desks and chairs in the office area to understand the office layout in the office area. In other cases, the user may want to view the layout of all objects in the office area to understand the overall layout of the office area.
[0094] Therefore, after sending the navigation table to the access terminal, the user can select a navigation strategy that suits him / her according to his / her needs. In actual applications, the navigation table can include trigger buttons corresponding to individual navigation strategies and global navigation strategies, and the user can click the corresponding button to select the corresponding strategy.
[0095] S23, determining the target category selected by the access terminal based on the separate navigation strategy, generating a separate navigation map corresponding to the scene elements of the target category and sending it to the access terminal, wherein the navigation display data includes the separate navigation map.
[0096] When the user selects a separate navigation strategy, the element category selected by the access terminal in the navigation table can be obtained as the category that the user wants to view the layout, that is, the above-mentioned target category, and then the area location of the element corresponding to the target category in the display space is obtained to generate a corresponding separate navigation map and send it to the access terminal for viewing. Among them, the separate navigation map refers to the layout display map corresponding to the target element.
[0097] In some embodiments, step S23 includes steps S231 to S236, which are specifically as follows:
[0098] S231, determining that the element category selected by the access terminal based on the navigation table is a target category, and obtaining an element area corresponding to the target category as a target area.
[0099] The above-mentioned element area refers to the spatial area corresponding to the scene element in the display space. It can be understood that the spatial area corresponding to each scene element may be different. Therefore, in order to display the layout corresponding to the target category, the corresponding element area can be determined as the target area for layout display.
[0100] S232, obtaining a top view display image corresponding to the display space, and deleting element areas other than the target area in the top view display image to obtain a target display image.
[0101] It can be understood that in order to eliminate the interference of element areas of other element categories in the overhead display diagram, element areas other than the target area can be deleted, so that the target display diagram can only contain element areas corresponding to the target category, thereby clearly and concisely displaying the layout corresponding to the target category.
[0102] S233, calling an initial adjustment interface, and filling the target display image into a reference area of the initial adjustment interface, wherein the initial adjustment interface includes a reference area in the middle and an adjustment area around the reference area.
[0103] The above initial adjustment interface is an interface for layout adjustment. It is understandable that this solution will subsequently provide a tour guide for the corresponding area in combination with the specific area selected by the user, so that the user can have a more detailed understanding of the corresponding area. In order to allow users to quickly select an area, this solution will display the relatively scattered areas at the edge together. Since the areas in the middle are generally more concentrated, this solution will adjust the areas at the edge in a centralized manner.
[0104] Specifically, this solution will adjust the corresponding area to the outer edge area of the target display image through the adjustment area in the initial adjustment interface, and then take a screenshot of the adjusted interface to form a new display image, and display the new image in the display window of the access terminal for users to view.
[0105] Among them, the reference area refers to the interface area filled with the target display image, and the specifications of this area can be consistent with the specifications of the display window of the access terminal. The adjustment area refers to the interface area for centralized adjustment of the element area of the edge part.
[0106] See also Figure 2 , which is a schematic diagram of a first separate navigation interface provided by an embodiment of the present invention, see Figure 3 , is a schematic diagram of a second separate navigation interface provided by an embodiment of the present invention, wherein the separate navigation interface is an interface after the initial adjustment interface is updated in layout, the first separate navigation interface is an interface after the initial adjustment interface is updated in unilateral layout, and the second separate navigation interface is an interface after the initial adjustment interface is updated in multilateral layout, such as Figure 2 and Figure 3 As shown, the reference area can be used to fill the target display diagram, and the adjustment area can be used to centrally adjust the target area located at the edge, wherein the dotted and bold displayed areas are the areas to be adjusted. Specifically, this solution will copy the target area that needs to be moved and adjusted, move it to the corresponding position in the adjustment area that connects with the reference area, and then display the copied area and the adjusted area in a corresponding associated manner, so that on the basis of the layout display of the target elements, the scene elements that are relatively scattered in the edge area can be centrally displayed.
[0107] S234, determining a pre-set edge area in the target display image, and acquiring a target area located in the edge area as a processing area.
[0108] In practical applications, in order to determine the target area located at the edge, a judgment area located at the edge can be pre-set in the top view display image, so that the target area located in the area can be determined as the processing area waiting to be processed.
[0109] In some embodiments, the four edge sides of the target display image can be used as a reference, and dividing lines parallel to the corresponding edge sides can be generated by extending inward by a preset distance, and then a dividing frame is generated based on the four dividing lines, and the area between the dividing frame and the outer frame composed of the four edge sides is used as the above-mentioned edge area.
[0110] S235, obtaining the interval distances between the processing areas, and determining the processing area whose interval distance is greater than the interval distance threshold as the adjustment area.
[0111] The interval distance threshold refers to the threshold for judging the regional interval distance. If it exceeds the threshold, it means that the interval distances between the corresponding processing areas may differ greatly. Therefore, the corresponding processing areas can be used as adjustment areas for subsequent centralized adjustments.
[0112] S236, updating the layout of the initial adjustment interface according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface, cropping the image area in the separate navigation interface to obtain a separate navigation map, adjusting the separate navigation map based on the specifications of the display window of the access terminal and then displaying it in the display window.
[0113] Understandably, see Figure 2 and Figure 3 ,After the layout is updated, there may be blank areas in the interface, for example Figure 2 The left adjustment area, the right adjustment area and the bottom adjustment area have no area images, so the corresponding parts can be removed when intercepting.
[0114] In some embodiments, when an image area in a separate navigation interface is captured, the adjustment area can be divided into four sub-areas: up, down, left and right. If there is no regional image in the corresponding sub-area, the corresponding regional edge in the base area can be extended to obtain a dividing line. If there is a regional image in the corresponding sub-area, the regional edge in the base area corresponding to the sub-area can be determined as the interception edge, and the direction perpendicular to the interception edge can be determined as the interception direction. Then, the maximum coordinate value of the regional image in the interception direction is obtained, and a dividing line parallel to the interception edge is generated based on the coordinate value. Finally, the image area in the interface is captured according to the four dividing lines to obtain a separate navigation map.
[0115] For example, take Figure 2For example, when intercepting, the area edges on the left, right and bottom sides of the reference area can be extended respectively to obtain three dividing lines. Since there is a regional image in the upper sub-area, when obtaining the upper horizontal dividing line, the maximum vertical coordinate value of the regional image in the sub-area can be obtained, and then the horizontal dividing line is generated according to the coordinate value. Finally, the corresponding image area is intercepted according to the obtained four dividing lines, so that the image after the centralized layout update can be obtained.
[0116] It is worth mentioning that the copied area image can be placed in the adjustment area, so there may be blank parts in the adjustment area. Therefore, in order to maximize the display of the obtained image in the display window, corresponding capture can be performed.
[0117] When a separate navigation map is adjusted based on the specifications of the display window of the access terminal and then displayed in the display window, in order to prevent the image from being deformed, the ratio of proportional scaling of the separate navigation map can be determined based on the specifications of the display window and the specifications of the separate navigation map, and then the specifications of the separate navigation map can be adjusted based on the ratio.
[0118] For example, when the specifications of the reference area are consistent with those of the display window, the display window can initially display the layout map that has not been centrally adjusted. When the user has a need for a guided tour, the layout map can be adjusted to obtain the above-mentioned separate navigation map. The ratio of proportional reduction can then be determined based on the specifications of the separate navigation map and the display window. For example, if the specifications of the display window are 600*800 and the specifications of the separate navigation map are 700*800, the reduction ratio of the separate navigation map is 0.85. The proportionally reduced separate navigation map is then sent to the display window for display, so that the user can select the corresponding explanation area based on the separate navigation map.
[0119] Based on the above embodiment, the specific implementation of "updating the layout of the initial adjustment interface according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface" in step S236 may be:
[0120] S2361, counting the number of adjustment areas corresponding to each edge in the edge area, obtaining the adjustment area corresponding to the edge with the largest number of adjustment areas as the positioning area, and the adjustment areas other than the positioning area as the first moving area.
[0121] It is understandable that if Figure 2 and Figure 3As shown, there may be more than one adjustment area, so in order to adjust the adjustment area as little as possible, the adjustment area located at the same edge and with the largest number may not be adjusted, that is, the positioning area, and the remaining adjustment areas may be adjusted, that is, the first moving area. In practical applications, the image edge closest to the adjustment area may be determined as the edge corresponding to the corresponding adjustment area.
[0122] S2362: When the number of the positioning areas is greater than the reference number, a joint outer frame corresponding to all the positioning areas is generated.
[0123] It is worth mentioning that the reference number can be 1. When the number of positioning areas is greater than 1, it means that there may be multiple positioning areas, for example Figure 2 and Figure 3 In the two cases shown in FIG. 1 , a joint outer frame corresponding to all positioning areas can be generated in this case, so that the specific positioning edge that can be adjusted in the first movable area can be determined later through the joint outer frame.
[0124] The combined outer frame refers to the outer frame that includes all positioning areas, for example Figure 2 and Figure 3 The dashed rectangular frame shown.
[0125] S2363: Obtain the shortest distance from the combined outer frame to each of the edge edges, and determine the edge edge whose shortest distance is less than the shortest distance threshold as the positioning edge.
[0126] It is understandable that if the shortest distance is less than the shortest distance threshold, it means that the positioning area is relatively close to the corresponding edge, so the corresponding edge can be used as the positioning edge, so that the area copied from the first moving area can be positioned by the positioning edge later, and the area corresponding to the edge can be displayed centrally. Among them, the shortest distance threshold is the distance threshold for judging the positioning edge, and the threshold can be set in advance.
[0127] For example Figure 2 As shown in , when the positioning area is located in the middle of the upper edge, the upper edge can be used as the positioning edge. Figure 3 As shown in , when the positioning area is located at the corner position of the upper edge and the right edge, both the upper edge and the right edge can be used as positioning edges.
[0128] S2364: When the number of the positioning edges is equal to the reference number, a unilateral layout adjustment is performed on each of the first movable areas to obtain a first separate navigation interface.
[0129] When the number of the positioning edges is equal to the reference number, it means that there is only one positioning edge. Therefore, when making adjustments, the first moving area can be unilaterally adjusted to obtain a first separate navigation interface, for example Figure 2as shown in .
[0130] In some embodiments, step S2364 may be implemented through steps S23641 to S23646, as follows:
[0131] S23641: When the number of the positioning edges is equal to the reference number, a first positioning line perpendicular to the positioning edges is generated with the first center point of the combined outer frame as a reference.
[0132] In practical applications, the first center point can be determined by obtaining the intersection of the diagonals of the combined outer frame. It can be understood that since the combined outer frame is a rectangular outer frame corresponding to all positioning areas, the first positioning line generated based on its center point is located at the center of multiple positioning areas, so that when the area after the copy of the first moving area is subsequently positioned, the copied area and the positioning area can be arranged together.
[0133] S23642, copy each of the first mobile areas to obtain a plurality of second mobile areas, and arrange each of the second mobile areas from large to small according to area specifications to obtain a first sequence.
[0134] It can be understood that in order to enable users to view the layout of the target category and to select the area centrally, the first moving area can be copied, and the area located at the edge can be centrally laid out through the second moving area. When the user subsequently clicks on the corresponding second moving area, it can be assumed that the corresponding first moving area has been selected.
[0135] In order to arrange the plurality of second moving areas, they may be arranged from large to small according to the area specifications, and then the plurality of second moving areas may be arranged according to the obtained first sequence.
[0136] S23643, obtaining the first second moving area in the first sequence as the first selected area, locating the center point of the first selected area according to the first positioning line, and filling the first selected area at a position in the adjustment area that contacts the positioning edge.
[0137] See also Figure 2 In order to arrange the first selected area in a position close to the positioning area in the adjustment area, the center of the first selected area can be positioned by the first positioning line, so that the first selected area can be moved in the adjustment area based on the first positioning line. When the first selected area contacts the positioning edge, the movement of the first selected area can be stopped, and the position when the movement stops is determined as the position where the first selected area is finally filled.
[0138] S23644: Taking the center point of the first selected area as a reference, generate a second positioning line parallel to the positioning edge, and sequentially obtain the next second moving area in the moving area sequence as the next first selected area.
[0139] It is understandable that since there may be more than one second moving area, when filling the remaining second moving areas, the first filled second moving area can be used as a reference to fill the remaining second moving areas on both sides thereof, so that the second moving areas can be filled from the middle to both sides, thereby enabling the adjusted areas to be concentrated together.
[0140] Specifically, when filling the remaining second moving area, the center point of the first first selected area may be used as a reference to generate a second positioning line parallel to the positioning edge, and then the remaining second moving area may be positioned and filled using the second positioning line.
[0141] S23645: Locate the center point of the next first selected area based on the second positioning line, and fill the next first selected area in sequence on both sides of the first first selected area according to a preset spacing distance to obtain a first separate navigation interface.
[0142] Specifically, when filling the remaining second moving areas, the two sides of the first second moving area can be filled in sequence, and when filling the two sides, the right side can be filled first and then the left side can be filled.
[0143] For example, Figure 2 As shown, after the first second moving area 1 is filled, the second second moving area 2 can be filled on the right side of the second moving area 1 at a preset spacing distance.
[0144] S23646, displaying the first movable area and the second movable area in the first separate navigation interface in association with each other according to corresponding adjusted pixel values.
[0145] It can be understood that in order to enable the user to intuitively view the adjusted area, the first moving area and the second moving area to be adjusted can also be displayed in association. Specifically, the corresponding first moving area and the second moving area can be displayed according to the same adjustment pixel value. The adjustment pixel value refers to the pixel value for displaying the first moving area and the second moving area in association. The adjustment pixel values corresponding to each pair of the first moving area and the second moving area are different.
[0146] For example, Figure 2 As shown, the adjusted pixel values corresponding to the first moving area 1 and the second moving area 1 may be red, and the adjusted pixel values corresponding to the first moving area 2 and the second moving area 2 may be blue.
[0147] In addition, in order to allow the user to distinguish the first movable area from the second movable area, that is, to distinguish the original area from the copied area, different display methods can be used for each of them, for example, Figure 2 As shown in the figure, the first moving area is displayed in bold, and the second moving area is displayed in dotted lines.
[0148] S2365: When the number of the positioning edges is greater than the reference number, a polygonal layout adjustment is performed on each of the first movable areas to obtain a second separate navigation interface.
[0149] When the number of the positioning edges is greater than the reference number, it means that there are two positioning edges. Therefore, when making adjustments, the first moving area can be adjusted in a multi-edge layout to obtain a second separate navigation interface, for example Figure 3 as shown in .
[0150] In some embodiments, step S2365 may be implemented through steps S23651 to S23658, as follows:
[0151] S23651: When the number of the positioning edges is greater than the reference number, a direction perpendicular to each of the positioning edges is obtained as a positioning direction.
[0152] It can be understood that when there are two positioning edges, it means that the positioning area is located at a corner position, for example Figure 3 In the case shown in , when adjusting the first moving area, the corresponding adjusted positioning edge can be determined first, and then the area after the first moving area is copied can be filled to the corresponding positioning edge.
[0153] S23652, obtaining the area length of each of the first moving areas in each of the positioning directions, and determining that the positioning edge perpendicular to the positioning direction with a shorter area length is the target edge corresponding to the corresponding first moving area.
[0154] It is understandable that the shorter the length of the first moving area in the positioning direction, the smaller the blank portion of the adjustment area in the captured image will be after the copied area is filled to the corresponding positioning edge, and the image space can be better utilized.
[0155] For example Figure 3 As shown in the figure, when the area length of the first moving zone 1 in the direction perpendicular to the positioning edge corresponding to the upper side is shorter, the positioning edge corresponding to the upper side can be used as the target edge corresponding to the first moving zone 1; when the area length of the first moving zone 2 in the direction perpendicular to the positioning edge corresponding to the right side is shorter, the positioning edge corresponding to the right side can be used as the target edge corresponding to the first moving zone 2.
[0156] S23653, copy the first moving area to obtain a plurality of second moving areas, and arrange the second moving areas corresponding to the positioning edges from large to small according to the area specification to obtain a second sequence.
[0157] Similarly, in order to arrange the plurality of second moving areas, they may be arranged from large to small according to area specifications, and then the plurality of second moving areas may be arranged according to the obtained second sequence.
[0158] S23654: Taking the center point of the combined outer frame as a reference, respectively generate second positioning lines perpendicular to each of the positioning edges.
[0159] It can be understood that, since there are multiple positioning edges, there can also be multiple second positioning lines generated, for example Figure 3 As shown, a second positioning line in the vertical direction and a second positioning line in the transverse direction may be generated respectively.
[0160] S23655, obtaining the first second moving area in the second sequence as the second selected area, locating the center point of the second selected area based on the corresponding second positioning line, and filling the second selected area at a position in the adjustment area that contacts the target edge.
[0161] For example, when positioning the second moving area 1, the center point of the second moving area 1 can be positioned by the second positioning line in the vertical direction, and filled to a position that contacts the upper target edge. When positioning the second moving area 2, the second moving area 2 can be positioned by the second positioning line in the horizontal direction, and filled to a position that contacts the right target edge.
[0162] S23656: Taking the center point of the second selected area as a reference, generate a second positioning line parallel to the target edge, and sequentially obtain the next second moving area in the second sequence as the next second selected area.
[0163] When filling the remaining second moving areas corresponding to the target edge, the filling can be based on the first filled second moving area. Specifically, a second positioning line can be generated that passes through the center point of the first second selected area and is parallel to the target edge. The remaining second positioning areas are subsequently positioned using the second positioning line.
[0164] S23657: locate the center point of the next second selected area according to the second positioning line, and fill the next second selected area into the adjustment area according to a preset interval distance to obtain a second separate navigation interface.
[0165] It is worth mentioning that, unlike the case of single-sided filling, when performing multi-sided filling, the filling direction can be from the side where the first second moving area is located to the other side of the target side, while single-sided filling is filled in the opposite direction on both sides.
[0166] For example Figure 3 As described in, when filling the second moving area corresponding to the target edge on the upper side, the remaining second moving area of the target edge can be filled from right to left. When filling the second moving area corresponding to the target edge on the right side, the remaining second moving area of the target edge can be filled from top to bottom.
[0167] S23658, displaying the first moving area and the second moving area in the second separate navigation interface in association with each other according to corresponding adjusted pixel values.
[0168] The above-mentioned method of associating and displaying the first movable area and the second movable area is similar to the display method in the unilateral layout, and will not be described in detail here.
[0169] The above method not only allows the user to view the overall layout of the corresponding scene elements, but also allows the user to quickly select the area corresponding to the scene elements.
[0170] S24, or, performing distribution processing on the bird's-eye view display map of the display space according to the global navigation strategy, obtaining a global navigation map and sending it to the access terminal, wherein the navigation display data includes the global navigation map.
[0171] When the user selects the global navigation strategy, it can be assumed that the access terminal has selected all element categories in the navigation table, so the corresponding global navigation map can be directly generated based on the overhead display map of the exhibition space and sent to the access terminal for viewing. Among them, the global navigation map refers to the overall layout map corresponding to all scene elements of the exhibition space.
[0172] In some embodiments, step S24 includes steps S241 to S245, which are specifically as follows:
[0173] S241, obtaining a bird's-eye view display image of the display space, and determining an element area corresponding to each of the scene elements in the bird's-eye view display image.
[0174] In practical applications, the bird's-eye view display image may be a display image of the display space from a bird's-eye view.
[0175] S242, classifying the element regions with the same element category into the same set to obtain a plurality of element region sets.
[0176] It is understandable that, since there are multiple element areas in the top view display, in order to facilitate the user to distinguish element areas of different categories, element areas with the same element category can be classified into the same set to obtain multiple element area sets.
[0177] S243, determining a reference point corresponding to the corresponding element area set according to the central position points corresponding to all element areas in each element area set.
[0178] The reference point refers to the central position point corresponding to all element areas in the element area set, through which element areas of the same category can be associated and displayed in the subsequent process.
[0179] S244, generating a layout line from the reference point to the center point of each element area in the element area set, and constructing a batch of controls corresponding to each reference point.
[0180] It can be understood that element areas of the same category can be connected and displayed through layout lines, and batch controls can be used by users to batch select element areas of the same category. When the user clicks the corresponding batch control, it can be determined that the user has selected the element areas of the corresponding category together, thereby improving the user's selection efficiency.
[0181] S245, retrieving the preset pixel value corresponding to each element category to update the corresponding layout line, and obtaining a global navigation map to send to the access terminal.
[0182] It is understandable that, since there are element areas corresponding to different categories, in order to facilitate distinction, the corresponding layout lines can be updated by the preset pixel values corresponding to each element category, so that the pixel values of the layout lines corresponding to the same type of element areas are the same.
[0183] Through the above method, the layout display can be combined with user needs.
[0184] S3, according to the explanation requirements of the access terminal for the guided tour display data, the corresponding scene elements are arranged to obtain a guided tour explanation sequence.
[0185] After obtaining the navigation display data, the corresponding area can be explained in combination with user needs. Specifically, the element areas corresponding to the corresponding scene elements can be arranged according to user needs, and then the corresponding digital people can be generated later to explain the corresponding areas, so that users can have a more detailed understanding of the corresponding areas.
[0186] Based on the above embodiment, the specific implementation of step S3 may be:
[0187] S31, receiving the explanation requirement of the access terminal for the selection of the guide display data, wherein the explanation requirement includes a customized explanation requirement and an overall explanation requirement.
[0188] Among them, the customized explanation demand refers to the demand for explaining the element area selected by the user according to the explanation order customized by the user, and the overall explanation demand refers to the demand for explaining all element areas.
[0189] It is understandable that when users want to learn about regional details, they may only want to learn about a part of the area, or they may want to learn about the details of all areas. Therefore, appropriate strategies can be selected based on user needs to customize explanations for users.
[0190] S32: Based on the customized explanation requirement, obtaining an element area selected by the access terminal in the navigation display data as an explanation area.
[0191] If the user selects a customized explanation requirement, the element area selected by the user can be obtained as the explanation area, and then the corresponding detailed explanation is given for the corresponding area.
[0192] S33, arranging the explanation areas according to the selection order of the access terminal to obtain the guided explanation sequence.
[0193] It is worth mentioning that if the user uses batch controls to select element areas of corresponding categories at the same time, the elements can be arranged according to the preset element arrangement order of the corresponding category when arranging.
[0194] S34, or, based on the overall explanation requirement, obtaining the total area corresponding to the virtual model, and counting the total number of elements corresponding to the scene elements of the virtual model.
[0195] If the user selects the overall explanation requirement, then all element areas in the display space can be explained in detail. In this case, since there are many element areas, this solution will merge the corresponding element areas and explain them together.
[0196] The specific plan will first obtain the total area and total number of elements mentioned above, and then determine the average area based on the total area and the total number of elements, and merge the element areas smaller than this area with other areas, and then explain the merged areas together.
[0197] S35, obtaining an average occupied area corresponding to the virtual model according to the ratio of the total area to the total number of elements.
[0198] It can be understood that by determining the average occupied area, element areas with smaller occupied areas can be obtained. Such element areas can be explained together with other areas during the explanation.
[0199] S36, determining the sub-floor area corresponding to each element area in the navigation display data, obtaining the element area whose sub-floor area is smaller than the average floor area as the area to be merged, and the element area whose sub-floor area is larger than the average floor area as the optional area.
[0200] It is understandable that the element area whose sub-floor area is smaller than the average floor area may be an area with a relatively small area. When explaining, combining the area with a smaller area with other areas for explanation can improve the explanation efficiency to a certain extent.
[0201] S37, obtaining the optional area closest to the area to be merged as the matching area corresponding to the area to be merged, and determining that the matching area and the area to be merged are the same integration area.
[0202] When merging, the optional area closest to the area to be merged can be merged with it, so that they can be explained together.
[0203] S38, determining the element serial number corresponding to the matching area in the integrated area as the arrangement serial number, arranging each of the integrated areas according to a preset element sorting and the arrangement serial number to obtain the guided explanation sequence, wherein the preset element sorting includes the arrangement serial numbers corresponding to a plurality of scene elements.
[0204] In actual applications, the staff can pre-configure the corresponding explanation order for each scene element, that is, the above-mentioned preset element sorting, and then arrange the various element areas according to the preset element sorting. Among them, for the integrated area, it can be arranged according to the arrangement sequence number corresponding to the element area with a larger area, that is, the matching area. The arrangement sequence number is the sequence number for arrangement pre-configured for each element area.
[0205] Through the above method, the corresponding explanation order can be configured for the corresponding element area according to user needs.
[0206] S4, generating customized explanation data corresponding to the guided explanation sequence and sending it to the access terminal.
[0207] The customized explanation data refers to data for detailed explanation of an area of the exhibition space, through which the user can understand the situation in the exhibition space in detail.
[0208] Based on the above embodiment, the specific implementation of step S4 may be:
[0209] S41, obtaining the first explanation area or integration area in the guided explanation sequence as a customized area, and controlling a shooting device to obtain a current captured image corresponding to the display space.
[0210] It is understandable that in order to enable the user to understand the actual situation of the target location when roaming, the image data corresponding to the actual display space can be obtained during the explanation, and the actual situation of the corresponding area in the display space can be displayed accordingly through the image data. In actual applications, the shooting device can be a camera.
[0211] S42, highlighting the customized area in the current collected image to obtain an explanation customized image, and obtaining the sub-customized speech corresponding to the customized area.
[0212] It is understandable that since the explanation is carried out in a certain order, when explaining each customized area, the customized area can be highlighted by updating pixel values or other methods, and then explained according to the sub-customized words.
[0213] In actual applications, each element area can be pre-configured with corresponding explanation words, that is, the above-mentioned sub-customized words. If the customized area includes multiple element areas, the words of multiple element areas can be merged.
[0214] In some embodiments, in order to ensure the privacy of people in the target location, if there is a person's outline in the current captured image, the person's outline can be hidden by using mosaic or other methods.
[0215] S43, calling up an initial explanation interface, wherein the initial explanation interface includes an explanation digital person and an explanation display area, updating the explanation display area according to the explanation customized image, and updating the explanation digital person according to the sub-customized speech to obtain a sub-explanation video.
[0216] Among them, the initial explanation interface refers to the interface where the explanation data has not been updated yet, the explanation digital person is a digital person used to explain the area, and the image of the explanation digital person can be configured accordingly in advance, and the explanation display area refers to the area where the actual image is displayed.
[0217] In actual applications, the explanation display area can be located in the upper right corner of the initial explanation interface, and the explanation digital person can be located in the middle of the initial explanation interface, so that the explanation data person can be updated with voice through the sub-customized speech to form a video segment explaining the corresponding area. Specifically, a video segment can be generated from the image data in the interface, and then the video segment is merged with the voice segment corresponding to the sub-customized speech to obtain the above-mentioned sub-explanation video.
[0218] S44, continue to obtain the next explanation area or integrated area in the guided explanation sequence as the next customized area, and repeat the above step of obtaining the sub-explanation video until the guided explanation sequence is traversed.
[0219] It is understandable that since the guided tour sequence includes multiple areas, in order to provide detailed explanations for each area, the image of the display space can be re-captured when the next customized area is acquired, and the next sub-explanation video can be generated based on the acquired image data and customized words, so that the explanation videos corresponding to all areas in the guided tour sequence can be obtained.
[0220] S45, splicing the sub-explanation videos according to the guided explanation sequence to obtain customized explanation data and sending it to the access terminal.
[0221] By splicing multiple sub-explanatory videos, users can not only learn the detailed information corresponding to the exhibition space, but also view the actual situation corresponding to the exhibition space.
[0222] See also Figure 4 , is a structural diagram of a scene analysis system based on virtual reality technology provided by an embodiment of the present invention, the scene analysis system based on virtual reality technology includes:
[0223] A roaming module, used to determine, according to a roaming request of an access terminal, a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces;
[0224] A navigation module, used to obtain a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy;
[0225] An explanation module, used for arranging the corresponding scene elements to obtain a guide explanation sequence according to the explanation requirements of the access terminal for the guide display data;
[0226] The customization module is used to generate customized explanation data corresponding to the guided explanation sequence and send it to the access terminal.
[0227] Figure 4 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.
[0228] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A scene analysis method based on virtual reality technology, characterized in that: include: Determining, according to a roaming request of an access terminal, a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces; Acquire a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy; According to the explanation requirements of the access terminal for the guided tour display data, the corresponding scene elements are arranged to obtain a guided tour explanation sequence; Generate customized explanation data corresponding to the guided explanation sequence and send it to the access terminal; Acquire a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy, including: Acquire multiple scene elements in the display space, and determine the element category corresponding to each of the scene elements; Generate a navigation table according to the element category and send it to the access terminal, and obtain a navigation strategy selected by the access terminal based on the navigation table, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy; Determine the target category selected by the access terminal based on the separate navigation strategy, generate a separate navigation map corresponding to the scene elements of the target category and send it to the access terminal, wherein the navigation display data includes the separate navigation map; or Distribute the overhead display map of the display space according to the global navigation strategy to obtain a global navigation map and send it to the access terminal, wherein the navigation display data includes the global navigation map; Determine the target category selected by the access terminal based on the separate navigation strategy, generate a separate navigation map corresponding to the scene elements of the target category and send it to the access terminal, wherein the navigation display data includes the separate navigation map, including: Determine that the element category selected by the access terminal based on the navigation table is a target category, and obtain the element area corresponding to the target category as the target area; Acquire a top view display image corresponding to the display space, and delete element areas other than the target area in the top view display image to obtain a target display image; Retrieving an initial adjustment interface, and filling the target display image into a reference area of the initial adjustment interface, wherein the initial adjustment interface includes a reference area in the middle and an adjustment area around the reference area; Determine a pre-set edge area in the target display image, and obtain a target area located in the edge area as a processing area; Acquire the interval distances between the processing areas, and determine the processing area whose interval distance is greater than the interval distance threshold as the adjustment area; The layout of the initial adjustment interface is updated according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface, an image area in the separate navigation interface is intercepted to obtain a separate navigation map, and the separate navigation map is adjusted based on the specification of the display window of the access terminal and then displayed in the display window; The overhead display image of the display space is distributed according to the global navigation strategy to obtain a global navigation image and send it to the access terminal, including: Acquire a bird's-eye view display image of the display space, and determine an element area corresponding to each of the scene elements in the bird's-eye view display image; Classifying the element regions with the same element category into the same set to obtain multiple element region sets; Determine a reference point corresponding to each element area set according to the central position points corresponding to all element areas in each element area set; Generate a layout line from the reference point to the center point of each element area in the element area set, and construct a batch control corresponding to each reference point; The preset pixel values corresponding to the element categories are retrieved to update the corresponding layout lines, and a global navigation map is obtained and sent to the access terminal.
2. The method according to claim 1, characterized in that: The initial adjustment interface is updated in layout according to the adjustment area to obtain a separate navigation interface, wherein the separate navigation interface includes a first separate navigation interface and a second separate navigation interface, including: Counting the number of adjustment areas corresponding to each edge in the edge area, obtaining the adjustment area corresponding to the edge with the largest number of adjustment areas as the positioning area, and the adjustment areas other than the positioning area as the first moving area; When the number of the positioning areas is greater than the reference number, generating a joint outer frame corresponding to all the positioning areas; Obtain the shortest distance from the combined outer frame to each of the edge edges, and determine the edge edge whose shortest distance is less than a shortest distance threshold as a positioning edge; When the number of the positioning edges is equal to the reference number, a unilateral layout adjustment is performed on each of the first moving areas to obtain a first separate navigation interface; When the number of the positioning edges is greater than the reference number, a polygonal layout adjustment is performed on each of the first moving areas to obtain a second separate navigation interface.
3. The method according to claim 2, characterized in that When the number of the positioning edges is equal to the reference number, a unilateral layout adjustment is performed on each of the first moving areas to obtain a first separate navigation interface, including: When the number of the positioning edges is equal to the reference number, taking the first center point of the combined outer frame as a reference, generating a first positioning line perpendicular to the positioning edges; Copying each of the first mobile areas to obtain a plurality of second mobile areas, and arranging each of the second mobile areas from large to small according to area specifications to obtain a first sequence; The first second moving area in the first sequence is obtained as the first selected area, the center point of the first selected area is located according to the first positioning line, and the first selected area is filled in the position in the adjustment area that contacts the positioning edge; Taking the center point of the first selected area as a reference, generating a second positioning line parallel to the positioning edge, and sequentially acquiring the next second moving area in the moving area sequence as the next first selected area; Locating the center point of the next first selected area based on the second positioning line, and sequentially filling the next first selected area on both sides of the first first selected area according to a preset interval distance to obtain a first separate navigation interface; The first moving area and the second moving area in the first separate navigation interface are displayed in association with each other according to the corresponding adjusted pixel values.
4. The method according to claim 2, characterized in that: When the number of the positioning edges is greater than the reference number, a multi-edge layout adjustment is performed on each of the first moving areas to obtain a second separate navigation interface, including: When the number of the positioning edges is greater than the reference number, a direction perpendicular to each of the positioning edges is obtained as a positioning direction; Acquire the area length of each of the first moving areas in each of the positioning directions, and determine the positioning side perpendicular to the positioning direction with a shorter area length as the target side corresponding to the corresponding first moving area; The first moving area is copied to obtain a plurality of second moving areas, and the second moving areas corresponding to the positioning edges are arranged from large to small according to the area specification to obtain a second sequence; Taking the center point of the combined outer frame as a reference, respectively generating second positioning lines perpendicular to each positioning edge; The first second moving area in the second sequence is obtained as the second selected area, a center point of the second selected area is located based on the corresponding second positioning line, and the second selected area is filled in the position in the adjustment area that contacts the target edge; Taking the center point of the second selected area as a reference, generating a second positioning line parallel to the target edge, and sequentially acquiring the next second moving area in the second sequence as the next second selected area; Locating the center point of the next second selected area according to the second positioning line, and filling the next second selected area into the adjustment area according to a preset interval distance to obtain a second separate navigation interface; The first moving area and the second moving area in the second separate navigation interface are displayed in association with each other according to the corresponding adjusted pixel values.
5. The method according to claim 1, characterized in that According to the explanation requirements of the access terminal for the navigation display data, the corresponding scene elements are arranged to obtain a navigation explanation sequence, including: Receiving the explanation requirement of the access terminal for the selection of the guided display data, wherein the explanation requirement includes a customized explanation requirement and an overall explanation requirement; Based on the customized explanation requirement, obtaining an element area selected by the access terminal in the guide display data as an explanation area; Arranging the explanation areas according to the selection order of the access terminal to obtain the guided explanation sequence; or, Based on the overall explanation requirement, a total area corresponding to the virtual model is obtained, and a total number of elements corresponding to the scene elements of the virtual model is counted; According to the ratio of the total area to the total number of elements, an average floor area corresponding to the virtual model is obtained; Determine the sub-floor area corresponding to each element area in the navigation display data, and obtain the element area whose sub-floor area is smaller than the average floor area as the to-be-merged area, and the element area whose sub-floor area is larger than the average floor area as the optional area; Acquire the optional area closest to the area to be merged as the matching area corresponding to the area to be merged, and determine that the matching area and the area to be merged are the same integration area; Determine the element number corresponding to the matching area in the integrated area as the arrangement number, arrange each integrated area according to a preset element order and the arrangement number, and obtain the guided explanation sequence, wherein the preset element order includes the arrangement numbers corresponding to multiple scene elements.
6. The method according to claim 5, characterized in that Generating customized explanation data corresponding to the guided explanation sequence and sending it to the access terminal includes: The first explanation area or integration area in the guided explanation sequence is obtained as a customized area, and a shooting device is controlled to obtain a current captured image corresponding to the exhibition space; The customized area in the current collected image is highlighted to obtain a customized explanation image, and the sub-customized speech corresponding to the customized area is obtained; Retrieving an initial explanation interface, the initial explanation interface including an explanation digital person and an explanation display area, updating the explanation display area according to the explanation customized image, updating the explanation digital person according to the sub-customized speech, and obtaining a sub-explanation video; Continue to obtain the next explanation area or integrated area in the guided explanation sequence as the next customized area, and repeat the step of obtaining the sub-explanation video until the guided explanation sequence is traversed completely; The sub-explanation videos are spliced according to the guided explanation sequence to obtain customized explanation data which is sent to the access terminal.
7. A scene analysis system based on virtual reality technology used in the method of claim 1, characterized in that: include: A roaming module, used to determine, according to a roaming request of an access terminal, a display space selected by the access terminal in a virtual model corresponding to a target location, wherein the virtual model includes a plurality of display spaces; A navigation module, used to obtain a navigation strategy selected by the access terminal based on scene elements in the display space, generate navigation display data according to the navigation strategy and send it to the access terminal, wherein the navigation strategy includes a separate navigation strategy and a global navigation strategy; An explanation module, used for arranging the corresponding scene elements to obtain a guide explanation sequence according to the explanation requirements of the access terminal for the guide display data; The customization module is used to generate customized explanation data corresponding to the guided explanation sequence and send it to the access terminal.
Citation Information
Patent Citations
Three-dimensional scene interaction platform-based guide map amplification method and apparatus
CN107066182A
Spatial navigation data generation method, system and device and storage medium
CN115499478A
Guide map zoom-in method and apparatus based on three-dimensional scenario interaction platform
WO2018098653A1
