AI exhibition method and system based on digital twin space

Abstract

The present invention provides an AI exhibition method and system based on a digital twin space, wherein the method includes: creating a virtual exhibition hall corresponding to a tour hall; obtaining the tour location of a physical tour terminal in real time, and determining whether the physical tour terminal is in any tour exhibition area based on the tour location, and sending the corresponding virtual exhibition area to the virtual tour terminal for display; in response to the physical tour terminal performing a primary positioning operation on any tour exhibit, determining the virtual exhibit corresponding to the tour exhibit; performing a screen judgment on the virtual display screen corresponding to the virtual tour terminal, and performing a primary update operation based on the judgment result to obtain a primary updated screen; in response to the physical tour terminal performing a secondary positioning operation on any exhibit area, determining the virtual area corresponding to the exhibit area; performing a screen judgment on the primary updated screen, and performing a primary update operation based on the judgment result to obtain a secondary updated screen. The present invention at least improves the interactivity of the tour.

Description

Technical Field

[0001] The present invention relates to data processing technology, and in particular to an AI display and system based on digital twin space. Background Art

[0002] In modern society, exhibitions, as an important means of cultural exchange and information dissemination, have penetrated into various fields, including art, science and technology, education, and commerce. With the rapid development of information technology and people's increasing demand for exhibition experience, the form and content of exhibitions are constantly innovating and enriching.

[0003] Early exhibitions in museums relied primarily on traditional static display methods, such as images, text, and physical objects. Visitors primarily acquired information through visuals and reading. However, this single display method often failed to fully capture the audience's attention and failed to meet their needs for interactivity and participation.

[0004] With the continuous development of advanced technologies such as multimedia, virtual reality (VR), and augmented reality (AR), exhibition formats are gradually shifting from static to dynamic, and from single to multiple. These advanced technologies have brought richer and more diverse display methods to exhibitions, such as 3D animation, holographic projection, and interactive experiences, greatly enhancing the visitor experience.

[0005] At the same time, with the popularization of the internet and the application of digital technology, the dissemination methods and coverage of exhibitions at exhibition halls have also been greatly expanded. New formats such as online and virtual exhibitions are constantly emerging, allowing visitors to browse exhibition content anytime and anywhere through mobile phones, computers and other terminal devices, greatly broadening the audience group and dissemination scope of exhibitions.

[0006] Against this backdrop, the design, planning, and implementation of exhibitions are facing higher requirements and challenges. Making full use of advanced technologies to enhance the interactivity and participation of exhibitions has become a pressing issue in the current exhibition industry. Summary of the Invention

[0007] Based on the above problems, the present invention is proposed to provide an AI display and system based on digital twin space to overcome the above problems or at least partially solve the above problems.

[0008] According to one aspect of the present invention, there is provided an AI exhibition method based on a digital twin space, comprising the following steps:

[0009] Creating a virtual exhibition hall corresponding to the tourist exhibition hall, wherein the virtual exhibition hall includes virtual exhibition areas having a virtual-real correspondence relationship with tourist exhibition areas located in the tourist exhibition hall;

[0010] Acquiring a tour position of the physical tour terminal in the tour pavilion in real time, and in response to determining that the physical tour terminal is located in any tour exhibition area based on the tour position, sending a virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for display;

[0011] In response to the physical tour terminal performing a primary positioning operation on any tourist exhibit located in the tourist exhibition area, determining a virtual exhibit corresponding to the tourist exhibit in the virtual exhibition area;

[0012] Invoking an exhibit display judgment strategy to judge whether the virtual exhibit is displayed on the virtual display screen corresponding to the virtual tour terminal, and performing a first-level update operation on the virtual display screen based on the judgment result to obtain a first-level updated screen;

[0013] In response to the on-site browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determining a virtual area corresponding to the exhibit area in the virtual exhibit;

[0014] The area display judgment strategy is called to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and a first-level update operation is performed on the first-level update screen based on the judgment result to obtain a second-level update screen.

[0015] Optionally, in the method according to the present invention, creating a virtual exhibition hall corresponding to the exhibition hall includes:

[0016] Creating an initial pavilion model corresponding to the tourist pavilion, and determining, based on the initial pavilion model, virtual exhibition areas having virtual-real correspondences with the tourist exhibition areas located in the tourist pavilion, and virtual channels having virtual correspondences with the connecting channels connecting the tourist exhibition areas;

[0017] Determine virtual exhibition areas connected based on the same virtual channel as a connected exhibition area group corresponding to the virtual channel, and obtain connected exhibition area groups corresponding to each virtual channel;

[0018] Determine the exhibition area connection surfaces that connect each virtual exhibition area in the same connected exhibition area group with the corresponding virtual channel, perform model segmentation on the initial exhibition hall model based on the exhibition area connection surfaces, and remove each virtual channel from the initial exhibition hall model to obtain a blank area corresponding to each virtual channel in the initial exhibition hall model;

[0019] Determine the number of exhibition areas of each virtual exhibition area in the same connected exhibition area group, and based on the number of exhibition areas, form a connectivity indicator model connecting the virtual exhibition areas in the same connected exhibition area group in the corresponding blank area to obtain a current exhibition hall model;

[0020] The current exhibition hall model is uploaded to the digital twin space to obtain a virtual exhibition hall corresponding to the visited exhibition hall.

[0021] Optionally, in the method according to the present invention, a connection indication model is formed in the corresponding blank area based on the number of exhibition areas, which connects the virtual exhibition areas in the same connected exhibition area group, to obtain the current exhibition hall model, including:

[0022] Acquiring the connected contours of each exhibition area of ​​the connected surfaces corresponding to each virtual exhibition area in the same connected exhibition area group, and determining the size of each exhibition area connected contour to obtain the size of each exhibition area contour corresponding to each exhibition area connected contour;

[0023] Determine the smallest exhibition area outline size among the exhibition area outline sizes as the target exhibition area size, and compare the target exhibition area size with the retrieved reference exhibition area size to determine a size comparison value;

[0024] Calculating the product of the size comparison value and the number of reference points corresponding to the reference size to obtain the number of target points corresponding to the target exhibition area size, and generating target exhibition area points having the same number as the target point number in the connected contours of each exhibition area;

[0025] Generate a summary sub-model in the blank area, and form, on the summary sub-model, a same number of summary connected surfaces corresponding to the connected surfaces of the exhibition areas based on the number of exhibition areas, wherein the first surface shape directions of the connecting surfaces of the exhibition areas are respectively parallel to the second surface shape directions of the summary connected surfaces;

[0026] Acquire each summary connected contour corresponding to each summary connected surface, and generate target summary points having the same number as the target points in each summary connected contour;

[0027] Connecting each target exhibition area point included in any exhibition area connected contour with each target summary point included in the corresponding summary connected contour in sequence to obtain each contour connection line connecting the exhibition area connected contour and the summary connected contour;

[0028] Based on the combination of the summary sub-model and each contour connection line, a connectivity indication model is formed that connects each virtual exhibition area in the same connected exhibition area group to obtain the current exhibition hall model.

[0029] Optionally, in the method according to the present invention, obtaining the tour position of the physical tour terminal in the tour pavilion in real time, and in response to determining that the physical tour terminal is in any tour exhibition area based on the tour position, sending the virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for display, includes:

[0030] Acquire a top view of the exhibition hall corresponding to the virtual exhibition hall, and establish a virtual coordinate system with the center point of the image of the top view of the exhibition hall as the origin;

[0031] Determining, in the exhibition hall top view, exhibition area images corresponding to the virtual exhibition areas, and determining, based on the virtual coordinate system, image coordinate points constituting the same exhibition area image as an exhibition area coordinate group;

[0032] Establishing a real coordinate system with the center point of the tourist exhibition hall as the origin, and obtaining a coordinate conversion relationship between the real coordinate system and the virtual coordinate system;

[0033] Acquiring the real positioning coordinates of the on-site tour terminal in real time, and performing coordinate conversion on the real positioning coordinates based on the coordinate conversion relationship to obtain virtual positioning coordinates corresponding to the on-site tour terminal;

[0034] comparing the virtual positioning coordinates with the exhibition area coordinate groups corresponding to the exhibition area images, and in response to determining that the virtual positioning coordinates are included in any exhibition area coordinate group based on the comparison result, determining the exhibition area coordinate group as a target coordinate group;

[0035] Determining the touring exhibition area where the physical touring terminal is located based on the target coordinate group, and obtaining an exhibition area display screen corresponding to the virtual touring terminal;

[0036] In response to the exhibition area display screen not including the virtual exhibition area corresponding to the tour exhibition area, the virtual exhibition area is sent to the virtual tour terminal for display.

[0037] Optionally, in the method according to the present invention, in response to determining based on the comparison result that the virtual positioning coordinates are included in any exhibition area coordinate group, determining the exhibition area coordinate group as the target coordinate group includes:

[0038] In response to determining, based on the comparison result, that the virtual positioning coordinates are included in any exhibition area coordinate group, determining the tour exhibition area corresponding to the exhibition area coordinate group as a pending exhibition area;

[0039] Determine a current positioning moment, obtain a historical positioning period that lasts for a preset first time period and is located before the current positioning moment, and determine each historical positioning coordinate of the on-site tour terminal in the historical positioning period;

[0040] In response to determining based on the historical positioning coordinates that the on-site tour terminal is not in the undetermined exhibition area during the historical positioning period, establishing a timing determination task;

[0041] Based on the timing determination task, the location of the on-site tour terminal is acquired for a future positioning period that lasts for a preset second time period and is located after the current positioning moment, to obtain each future positioning coordinate of the on-site tour terminal in the future positioning period;

[0042] In response to determining, based on each future positioning coordinate, that the on-site tour terminal is always in the undetermined exhibition area during the future positioning period, the exhibition area coordinate group is determined as the target coordinate group.

[0043] Optionally, in the method according to the present invention, in response to the physical tour terminal performing a primary positioning operation on any touring exhibit located in the touring exhibition area, determining a virtual exhibit corresponding to the touring exhibit in the virtual exhibition area includes:

[0044] In response to triggering a voice collection plug-in pre-installed in the on-site tour terminal to perform voice collection, obtaining the exhibit voice output by the voice collection plug-in;

[0045] Performing voice recognition on the exhibit voice, and obtaining a voice text segment corresponding to the exhibit voice based on the recognition result;

[0046] Retrieving an exhibit summary form corresponding to the tourist exhibition area, wherein the exhibit summary form includes exhibit numbers corresponding to respective tourist exhibits located in the tourist exhibition area;

[0047] The exhibit summary form is traversed, and in response to the presence of an exhibit number corresponding to any touring exhibit in the voice text segment, a virtual exhibit corresponding to the touring exhibit is determined in the virtual exhibition area.

[0048] Optionally, in the method according to the present invention, calling an exhibit display judgment strategy to judge whether the virtual exhibit is displayed on the virtual display screen corresponding to the virtual tour terminal, and performing a first-level update operation on the virtual display screen based on the judgment result to obtain a first-level updated screen, including:

[0049] Performing image recognition on the virtual display screen, and determining the image completeness of the virtual display screen displaying the virtual exhibit based on the recognition result;

[0050] In response to the picture completeness being less than the retrieved preset completeness, obtaining a picture center point corresponding to the virtual display picture and an exhibit center point corresponding to the virtual exhibit, and performing a first-level update operation on the virtual display picture in a manner such that the exhibit center point coincides with the picture center point, thereby obtaining a first-level updated picture;

[0051] In response to the image completeness being greater than or equal to the preset completeness, forming a circumscribed rectangular outline circumscribing the virtual exhibit, and copying the circumscribed rectangular outline to obtain a copied rectangular outline;

[0052] Determining a center point of an outline corresponding to the copied rectangular outline, and adding the copied rectangular outline to the virtual display screen in a manner such that the center point of the outline coincides with a center point of the screen;

[0053] A degree of outline overlap between the circumscribed rectangular outline and the copied rectangular outline is obtained. In response to the degree of outline overlap being less than a preset overlap, a first-level update operation is performed on the virtual display screen in such a manner that the center point of the exhibit coincides with the center point of the screen, thereby obtaining a first-level updated screen.

[0054] Optionally, in the method according to the present invention, in response to the physical browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determining a virtual area corresponding to the exhibit area in the virtual exhibit includes:

[0055] In response to triggering an image acquisition plug-in pre-installed in the on-site tour terminal to perform image acquisition, an area image output by the image acquisition plug-in is acquired;

[0056] forming an interactive layer on the regional image, and performing grid processing on the interactive layer to obtain points of each layer with the same point spacing between adjacent points;

[0057] In response to the on-site tour terminal interacting with any layer point, the layer point is determined as a first target point, and each layer point in the interactive layer that has a parallel relationship or a perpendicular relationship with the first target point is determined as a first secondary point group;

[0058] In response to the on-site tour terminal interacting with any layer point in the first secondary point group, determining the layer point as a second target point, and connecting the first target point with the second target point to obtain a first connection frame line;

[0059] Determine a direction perpendicular to the first connection frame line as a secondary interaction direction, and determine layer points that are parallel to the first target point and the second target point along the secondary interaction direction as a second secondary point group;

[0060] In response to the on-site tour terminal interacting with any layer point in the second secondary point group, the layer point is determined as a third target point, and a target point parallel to the third target point is connected to the third target point to obtain a second connection frame line;

[0061] generating a positioning rectangular outline in the interactive layer based on the first connection frame line and the second connection frame line, and performing image segmentation on the regional image based on the positioning rectangular outline to obtain a positioning image corresponding to the positioning rectangular outline;

[0062] Image recognition is performed on the positioning image, and based on the recognition result, an exhibit area corresponding to the positioning image is determined in the tour exhibit, and a virtual area corresponding to the exhibit area is determined in the virtual exhibit corresponding to the tour exhibit.

[0063] Optionally, in the method according to the present invention, calling the area display judgment strategy to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and performing a first-level update operation on the first-level update screen based on the judgment result to obtain the second-level update screen, including:

[0064] Determining, in the first-level update screen, a region screen corresponding to the virtual region and a screen ratio occupied by the region screen, and comparing the screen ratio with a retrieved preset ratio;

[0065] In response to the screen proportion being less than the preset proportion, obtaining a center point of a region corresponding to the virtual region, and moving the region screen in such a manner that the center point of the region coincides with a center point of the screen;

[0066] The regional screen is enlarged until the screen proportion is greater than or equal to a preset proportion, to obtain a secondary update screen.

[0067] According to another aspect of the present invention, an AI exhibition system based on a digital twin space is provided, comprising:

[0068] A virtual creation module is configured to create a virtual pavilion corresponding to the tourist pavilion, wherein the virtual pavilion includes virtual exhibition areas having a virtual-real correspondence relationship with tourist exhibition areas located in the tourist pavilion;

[0069] a virtual and real tour module configured to obtain in real time the tour position of the physical tour terminal in the tour pavilion, and in response to determining that the physical tour terminal is located in any tour exhibition area based on the tour position, send a virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for display;

[0070] a primary positioning module configured to, in response to the physical tour terminal performing a primary positioning operation on any tourist exhibit located in the tourist exhibition area, determine a virtual exhibit corresponding to the tourist exhibit in the virtual exhibition area;

[0071] a first-level update module configured to invoke an exhibit display judgment strategy to determine whether the virtual exhibit is displayed on a virtual display screen corresponding to the virtual tour terminal, and to perform a first-level update operation on the virtual display screen based on the judgment result to obtain a first-level updated screen;

[0072] a secondary positioning module configured to, in response to the on-site browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determine a virtual area corresponding to the exhibit area in the virtual exhibit;

[0073] The secondary update module is configured to call the area display judgment strategy to perform a screen judgment on the primary update screen based on whether the virtual area is displayed, and perform a primary update operation on the primary update screen based on the judgment result to obtain a secondary update screen.

[0074] In the present invention, by creating a virtual exhibition hall corresponding to the tourist exhibition hall, the scene of virtual and real co-existence can be built, so that when the actual tourist terminal is determined to be located in any tourist exhibition area in the tourist exhibition hall based on the touring position of the actual tourist terminal, the virtual exhibition area corresponding to the tourist exhibition area can be synchronously sent to the virtual tourist terminal for display, so that the user using the virtual tourist terminal can conduct an online tour of the virtual exhibition area in the virtual environment, which can enable some users who are not convenient to conduct offline tours to achieve the effect of virtual and real co-existence, thereby improving the convenience of touring; at the same time, when the user using the actual tourist terminal has a recommendation interest in the tourist exhibits located in a certain tourist exhibition area, he can also use the first-level positioning operation to The user terminal of the real-world tour terminal has a recommendation interest in any exhibit area of ​​a certain tour exhibit, then positioning can also be performed through a secondary positioning operation to determine the virtual area corresponding to the exhibit area in the virtual exhibit, and further call the area display judgment strategy to perform a secondary update operation on the first-level update screen corresponding to the virtual tour terminal to obtain the corresponding second-level update screen, thereby increasing the interactivity and participation of the tour. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] Figure 1 A flowchart of an AI exhibition method based on a digital twin space according to one embodiment of the present invention is shown;

[0076] Figure 2 A schematic diagram of the communication connection between the real tour terminal and the virtual tour terminal in this embodiment is shown;

[0077] Figure 3A structural block diagram of an AI exhibition system based on a digital twin space according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0078] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0079] To address the problems in the aforementioned background technology, the inventors propose a solution of the present invention. One embodiment of the present invention provides an AI exhibition method based on a digital twin space, which can be executed in a computing device.

[0080] Figure 1 A flowchart of an AI display method based on digital twin space proposed in this embodiment is shown as follows: Figure 1 As shown, the method starts at step S101, wherein S101 includes the following contents:

[0081] A virtual exhibition hall corresponding to the tourist exhibition hall is created, wherein the virtual exhibition hall includes virtual exhibition areas having virtual-real correspondence relationships with tourist exhibition areas located in the tourist exhibition hall.

[0082] For example, in this embodiment, the creation of a virtual exhibition hall can be achieved based on a digital twin space. That is, by pre-acquiring digital twin data corresponding to the exhibition hall, a virtual exhibition hall corresponding to the exhibition hall can be created online, allowing users to view the virtual exhibition hall through corresponding display devices. Here, exhibition halls refer to the activities of visitors sightseeing, learning, and experiencing within the exhibition hall. Exhibition halls, especially exhibition halls, are usually public buildings that display temporary or permanent exhibits, providing a platform for the public to learn about history, culture, science, and other aspects of knowledge.

[0083] It should be noted that, in this embodiment, since the tourist exhibition hall generally includes various tourist exhibition areas corresponding to different exhibition themes, after completing the creation of the virtual exhibition hall corresponding to the tourist exhibition hall, there will also be various virtual exhibition areas in the virtual exhibition hall that have virtual-real correspondences with the various tourist exhibition areas located in the tourist exhibition hall; that is, users can use corresponding display devices to view each virtual exhibition area located in the virtual exhibition hall separately, thereby completing the online viewing of the virtual exhibition hall.

[0084] Furthermore, in this embodiment, the above-mentioned "creating a virtual exhibition hall corresponding to the exhibition hall" may also include the following contents:

[0085] Creating an initial pavilion model corresponding to the tourist pavilion, and determining, based on the initial pavilion model, virtual exhibition areas having virtual-real correspondences with the tourist exhibition areas located in the tourist pavilion, and virtual channels having virtual correspondences with the connecting channels connecting the tourist exhibition areas;

[0086] Determine virtual exhibition areas connected based on the same virtual channel as a connected exhibition area group corresponding to the virtual channel, and obtain connected exhibition area groups corresponding to each virtual channel;

[0087] Determine the exhibition area connection surfaces that connect each virtual exhibition area in the same connected exhibition area group with the corresponding virtual channel, perform model segmentation on the initial exhibition hall model based on the exhibition area connection surfaces, and remove each virtual channel from the initial exhibition hall model to obtain a blank area corresponding to each virtual channel in the initial exhibition hall model;

[0088] Determine the number of exhibition areas of each virtual exhibition area in the same connected exhibition area group, and based on the number of exhibition areas, form a connectivity indicator model connecting the virtual exhibition areas in the same connected exhibition area group in the corresponding blank area to obtain a current exhibition hall model;

[0089] The current exhibition hall model is uploaded to the digital twin space to obtain a virtual exhibition hall corresponding to the visited exhibition hall.

[0090] For example, in this embodiment, based on the above content, it can be known that a tourist exhibition hall in a real environment generally includes multiple tourist exhibition areas, and multiple tourist exhibition areas generally exist in the form of independent buildings, thereby realizing independent display of multiple tourist exhibition areas. In order to enable users to visit multiple tourist exhibition areas in sequence in a real environment, each tourist exhibition area is generally connected through a corresponding connecting channel, that is, the user can move from the current tourist exhibition area to other tourist exhibition areas through the connecting channel; in a virtual environment, since the user does not need to move through the connecting channel when viewing the virtual exhibition hall online, in order to reduce the corresponding data processing volume and ensure that the user does not need to display non-exhibition hall content when viewing the virtual exhibition hall online, the virtual channel corresponding to the connecting channel can be removed, and the corresponding method steps can be described as follows:

[0091] First, an initial pavilion model corresponding to the tourist pavilion can be created based on the digital twin data corresponding to the tourist pavilion. It can be understood that the specific structure of the initial pavilion model in the virtual environment should be the same as the specific structure of the tourist pavilion in the real environment. Based on this, each virtual exhibition area having a virtual-real correspondence relationship with each tourist exhibition area located in the tourist pavilion, and each virtual channel having a virtual correspondence relationship with each connecting channel connected to each tourist exhibition area can be determined in the initial pavilion model;

[0092] Next, after the corresponding virtual channels and virtual exhibition areas are determined, since the same virtual channel may connect multiple virtual exhibition areas, the virtual exhibition areas connected based on the same virtual channel can be determined as the connected exhibition area group corresponding to the virtual channel, thereby obtaining the connected exhibition area groups corresponding to the virtual channels.

[0093] Next, in order to be able to remove each virtual channel, it is necessary to determine the connecting surfaces of each exhibition area that connect each virtual channel with the corresponding virtual exhibition area, so that the initial exhibition hall model can be further cut accordingly based on the connecting surfaces of each exhibition area, so as to remove the corresponding virtual channels based on the model cutting. It can be explained that after removing each virtual channel in the initial exhibition hall model, blank areas corresponding to each virtual channel will appear in the corresponding initial exhibition hall model, that is, areas where no model parts exist;

[0094] Then, the number of exhibition areas of each virtual exhibition area in the same connected exhibition area group can be further determined, so as to form a connectivity indication model connecting each virtual exhibition area corresponding to the same connected exhibition area group in the corresponding blank area based on the corresponding number of exhibition areas, so as to obtain the corresponding current exhibition hall model;

[0095] Finally, after obtaining the corresponding current exhibition hall model, the current exhibition hall model can be uploaded to the corresponding digital twin space to obtain a virtual exhibition hall corresponding to the visited exhibition hall.

[0096] For example, in this embodiment, based on the above content, it can be known that the virtual channel corresponding to the connecting channel in the real environment generally does not need to be obtained by users who view the virtual exhibition hall online. However, since the virtual channel can also display the connection relationship and sequence relationship between each virtual exhibition area, in order to be able to display the connection relationship and sequence relationship between each virtual exhibition area while reducing the amount of data processing, a corresponding connectivity indication model can be established based on each virtual exhibition area corresponding to the same virtual channel, thereby improving the viewing experience of each user who views online.

[0097] Furthermore, in this embodiment, the above-mentioned "forming a connectivity indication model connecting the virtual exhibition areas in the same connected exhibition area group in the corresponding blank areas based on the number of exhibition areas to obtain the current exhibition hall model" may further include the following steps:

[0098] Acquiring the connected contours of each exhibition area of ​​the connected surfaces corresponding to each virtual exhibition area in the same connected exhibition area group, and determining the size of each exhibition area connected contour to obtain the size of each exhibition area contour corresponding to each exhibition area connected contour;

[0099] Determine the smallest exhibition area outline size among the exhibition area outline sizes as the target exhibition area size, and compare the target exhibition area size with the retrieved reference exhibition area size to determine a size comparison value;

[0100] Calculating the product of the size comparison value and the number of reference points corresponding to the reference size to obtain the number of target points corresponding to the target exhibition area size, and generating target exhibition area points having the same number as the target point number in the connected contours of each exhibition area;

[0101] Generate a summary sub-model in the blank area, and form, on the summary sub-model, a same number of summary connected surfaces corresponding to the connected surfaces of the exhibition areas based on the number of exhibition areas, wherein the first surface shape directions of the connecting surfaces of the exhibition areas are respectively parallel to the second surface shape directions of the summary connected surfaces;

[0102] Acquire each summary connected contour corresponding to each summary connected surface, and generate target summary points having the same number as the target points in each summary connected contour;

[0103] Connecting each target exhibition area point included in any exhibition area connected contour with each target summary point included in the corresponding summary connected contour in sequence to obtain each contour connection line connecting the exhibition area connected contour and the summary connected contour;

[0104] Based on the combination of the summary sub-model and each contour connection line, a connectivity indication model is formed that connects each virtual exhibition area in the same connected exhibition area group to obtain the current exhibition hall model.

[0105] For example, in this embodiment, when establishing a connectivity indication model for corresponding indications of each virtual exhibition area in the same connected display area, the connectivity contours of each exhibition area corresponding to each virtual exhibition area in the same connected display group can be first obtained, and the corresponding size of each exhibition area connectivity contour can be further determined to obtain the corresponding display contour size; after determining the exhibition area contour size with the smallest corresponding size among the exhibition area contour sizes as the corresponding target display size, the target exhibition area size can be compared with the retrieved benchmark exhibition area size to determine the size comparison value. Here, the benchmark exhibition area size can be understood as being pre-set by the management personnel and stored in the server, and the acquisition of the size comparison value is The target exhibition area size can be obtained by calculating the ratio of the target exhibition area size to the corresponding reference exhibition area size; after the corresponding size comparison value is obtained, the size comparison value can be further multiplied by the number of reference points of the corresponding reference size to obtain the target point number corresponding to the target exhibition area size, and the target exhibition area points with the same number as the target point number are generated in the connected contours of each exhibition area; here, the acquisition of points can be obtained based on the reference size, that is, the reference size corresponds to the corresponding number of reference points, and the number of target points corresponding to the target exhibition area size can be obtained by multiplying the size comparison value by the number of reference points, thereby realizing the determination of the corresponding number of points based on the size, thereby realizing The same number of target exhibition area points of the connected contours of different exhibition areas is determined to achieve quantitative unification; further, after completing the acquisition of the corresponding target exhibition area points, the generation of the corresponding connected indication model can be started. Specifically, the corresponding summary sub-models can be generated in the formed blank areas respectively, wherein one summary sub-model corresponds to one connected display area, that is, one summary sub-model is used to display the corresponding connection relationship and sequence relationship of each virtual exhibition area located in the same connected display area; after generating the corresponding summary sub-model, the summary connected surfaces having the same number corresponding to the connected surfaces of each exhibition area can be formed on the summary sub-model based on the number of exhibition areas corresponding to the connected display area. Here, each exhibition area corresponding to each virtual exhibition area The first surface directions of the connected surfaces are respectively parallel to the second surface directions of the summarized connected surfaces; further, after obtaining the corresponding summarized connected contours corresponding to the summarized connected surfaces, the same number of target summary points as the number of target points can be generated in the corresponding summarized connected contours, so that the target exhibition area points included in any exhibition area connected contour can be connected in sequence with the target summary points included in the summarized connected contour, and then the contour connection lines connecting the exhibition area connected contour and the summarized connected contour can be obtained; finally, by combining the summary sub-model and the contour connection lines, a connectivity indication model connecting the virtual exhibition areas corresponding to the same connected display group can be formed to obtain the corresponding current exhibition hall model.

[0106] For example, in this embodiment, after completing the removal of each virtual channel that has a virtual-real correspondence with the connecting channel, the virtual exhibition areas corresponding to the same connected exhibition area group can be indirectly connected based on the creation of a corresponding summary sub-model, so as to realize the display of the connection relationship and sequence relationship of each virtual exhibition area. Moreover, since the basic structure and shape of each summary sub-module corresponding to different connected exhibition area groups are roughly the same, the corresponding data processing amount is also reduced accordingly.

[0107] In step S102, the following contents are included:

[0108] The tour position of the physical tour terminal in the tour exhibition hall is obtained in real time, and in response to determining that the physical tour terminal is in any tour exhibition area based on the tour position, the virtual exhibition area corresponding to the tour exhibition area is sent to the virtual tour terminal for display.

[0109] For example, in this embodiment, Figure 2 As shown, the on-site tour terminal can be understood as the terminal device used by user A to tour the tour pavilion in the real environment, such as a mobile phone or a computer, and the corresponding virtual tour terminal can be understood as the terminal device used by user B to tour the virtual pavilion corresponding to the tour pavilion in the virtual environment, such as a mobile phone or a computer; here, the on-site tour terminal and the virtual tour terminal can establish a corresponding communication connection relationship in advance, so that when user A conducts an offline on-site tour of the tour pavilion in the real environment, user B can also conduct an online virtual tour of the virtual pavilion corresponding to the tour pavilion. Moreover, in order to further improve the tour correlation between the real tour terminal and the virtual tour terminal, the tour position of the real tour terminal in the tour exhibition hall can be obtained in real time, and the tour exhibition area where the real tour terminal is located can be determined in response to the obtained tour position, so that the virtual exhibition area corresponding to the tour exhibition area can be sent to the virtual tour terminal for corresponding display. At this time, the virtual and real interconnection between the real tour terminal and the virtual tour terminal can be realized, so that user A and user B can respectively conduct corresponding different forms of tours of the tour exhibition hall and the virtual exhibition hall corresponding to the tour exhibition hall in the real environment and the virtual environment at the same time, thereby improving the corresponding user experience.

[0110] Furthermore, in this embodiment, the above-mentioned "obtaining in real time the touring position of the physical touring terminal in the touring exhibition hall, and in response to determining that the physical touring terminal is in any touring exhibition area based on the touring position, sending the virtual exhibition area corresponding to the touring exhibition area to the virtual touring terminal for display" may further include the following steps:

[0111] Acquire a top view of the exhibition hall corresponding to the virtual exhibition hall, and establish a virtual coordinate system with the center point of the image of the top view of the exhibition hall as the origin;

[0112] Determining, in the exhibition hall top view, exhibition area images corresponding to the virtual exhibition areas, and determining, based on the virtual coordinate system, image coordinate points constituting the same exhibition area image as an exhibition area coordinate group;

[0113] Establishing a real coordinate system with the center point of the tourist exhibition hall as the origin, and obtaining a coordinate conversion relationship between the real coordinate system and the virtual coordinate system;

[0114] Acquiring the real positioning coordinates of the on-site tour terminal in real time, and performing coordinate conversion on the real positioning coordinates based on the coordinate conversion relationship to obtain virtual positioning coordinates corresponding to the on-site tour terminal;

[0115] comparing the virtual positioning coordinates with the exhibition area coordinate groups corresponding to the exhibition area images, and in response to determining that the virtual positioning coordinates are included in any exhibition area coordinate group based on the comparison result, determining the exhibition area coordinate group as a target coordinate group;

[0116] Determining the touring exhibition area where the physical touring terminal is located based on the target coordinate group, and obtaining an exhibition area display screen corresponding to the virtual touring terminal;

[0117] In response to the exhibition area display screen not including the virtual exhibition area corresponding to the tour exhibition area, the virtual exhibition area is sent to the virtual tour terminal for display.

[0118] For example, in this embodiment, in order to obtain the real-time location of the on-site tour terminal in the tour hall, it can be achieved based on the following specific method steps:

[0119] First, the upper view of the exhibition hall corresponding to the virtual exhibition hall can be obtained, and a virtual coordinate point with the center point of the image of the upper view of the exhibition hall as the origin can be established;

[0120] Next, the exhibition area images corresponding to the virtual exhibition areas can be determined in the obtained exhibition hall top view, and the image coordinate points constituting the same exhibition area image can be determined as corresponding exhibition area coordinate groups based on the virtual coordinate system. That is, based on the virtual coordinate system, the exhibition hall top view can be understood as being composed of a plurality of image coordinate points. Therefore, the image coordinate points constituting the same exhibition area image can be further grouped into exhibition area coordinate groups corresponding to the exhibition area images based on the virtual group coordinate system, thereby obtaining the exhibition area coordinate systems corresponding to the exhibition area images.

[0121] Then, after the virtual coordinate system is established, a corresponding real coordinate system can be further established with the center point of the exhibition hall in the real environment as the origin, and the coordinate conversion relationship between the real coordinate system and the virtual coordinate system can be obtained at the same time;

[0122] Then, the real-world positioning coordinates of the real-world tour terminal can be obtained in real time. Here, the method of obtaining the coordinates can be, for example, by pre-installing the corresponding GPS positioning software in the real-world tour terminal. After the real-world positioning coordinates are obtained, the real-world positioning coordinates corresponding to the real environment can be converted into virtual positioning coordinates corresponding to the virtual environment based on the aforementioned coordinate conversion relationship.

[0123] Then, after obtaining the virtual positioning coordinates corresponding to the actual tour terminal, the virtual positioning coordinates can be compared with the respective exhibition area coordinate groups corresponding to the respective exhibition area images. When it is determined based on the comparison result that the virtual positioning coordinates are included in any exhibition area coordinate group, it means that the position of the actual tour terminal in the real environment should correspond to the exhibition area image corresponding to the exhibition area coordinate group in the virtual environment, and thus the exhibition area coordinate group can be determined as the target coordinate group.

[0124] Then, through the corresponding coordinate conversion relationship, the touring exhibition area where the physical touring terminal is located can be determined based on the target coordinate group, and the exhibition area display screen corresponding to the virtual touring terminal can be obtained at the same time. It should be noted that when user B uses the virtual touring terminal to tour the virtual exhibition hall in the virtual environment, he or she can freely view the various virtual exhibition areas that make up the virtual exhibition hall. In order to achieve virtual-reality interconnection between the physical touring terminal and the virtual touring terminal, it is necessary to determine whether the exhibition area display screen displayed by the virtual touring terminal in the current situation corresponds to the same exhibition area as the touring exhibition area where the physical touring terminal is located.

[0125] Finally, if the exhibition area display screen does not include the virtual exhibition area corresponding to the tour exhibition area, it indicates that user B is conducting an online tour of other exhibition areas in a virtual environment except the virtual exhibition area corresponding to the tour exhibition area based on the virtual tour terminal. At this time, the server will send the virtual exhibition area corresponding to the tour exhibition area where the actual tour terminal is located to the virtual tour terminal for corresponding screen display; and if the exhibition area display screen includes the virtual exhibition area corresponding to the tour exhibition area, it also indicates that user B is conducting an online tour of the virtual exhibition area corresponding to the tour exhibition area in a virtual environment based on the virtual tour terminal. At this time, there is no need to send the virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for screen display again.

[0126] Furthermore, in this embodiment, the above-mentioned “in response to determining based on the comparison result that the virtual positioning coordinates are included in any exhibition area coordinate group, determining the exhibition area coordinate group as the target coordinate group” may further include the following steps:

[0127] In response to determining, based on the comparison result, that the virtual positioning coordinates are included in any exhibition area coordinate group, determining the tour exhibition area corresponding to the exhibition area coordinate group as a pending exhibition area;

[0128] Determine a current positioning moment, obtain a historical positioning period that lasts for a preset first time period and is located before the current positioning moment, and determine each historical positioning coordinate of the on-site tour terminal in the historical positioning period;

[0129] In response to determining based on the historical positioning coordinates that the on-site tour terminal is not in the undetermined exhibition area during the historical positioning period, establishing a timing determination task;

[0130] Based on the timing determination task, the location of the on-site tour terminal is acquired for a future positioning period that lasts for a preset second time period and is located after the current positioning moment, to obtain each future positioning coordinate of the on-site tour terminal in the future positioning period;

[0131] In response to determining, based on each future positioning coordinate, that the on-site tour terminal is always in the undetermined exhibition area during the future positioning period, the exhibition area coordinate group is determined as the target coordinate group.

[0132] For example, in this embodiment, when user A is touring a tourist exhibition hall in a real environment, user A may freely tour the various tourist exhibition areas of the tourist exhibition hall according to his own wishes, that is, he may not tour according to a fixed tour order. When user A enters a tourist exhibition area that he is not interested in or enters a tourist exhibition area that he has visited before, user A may exit from it as soon as possible and enter another exhibition area. Therefore, in this case, it is not necessary to send the virtual exhibition area corresponding to the tourist exhibition area to user B for synchronous touring. Based on this, the real-time touring situation of user A can be determined, and based on the determination result, it can be determined whether the corresponding virtual exhibition area needs to be sent to user B for synchronous touring. Specifically, the corresponding judgment process can be described as follows:

[0133] First, in response to determining based on the above comparison result that the virtual positioning coordinates are included in any exhibition area coordinate group, it is indicated that user A using the on-site tour terminal is currently located in the tour exhibition area corresponding to the exhibition area coordinate group. In this case, the tour exhibition area can be determined as a pending exhibition area.

[0134] Next, the current positioning moment is determined, and a historical positioning period of a preset first duration preceding the current positioning moment is acquired. Here, the preset first duration may be, for example, 10 seconds. After acquiring the corresponding historical positioning period, it is necessary to synchronously acquire the historical positioning coordinates within the historical positioning period.

[0135] Next, based on each historical positioning coordinate, it is determined whether the corresponding on-site tour terminal has been continuously in the pending exhibition area during the historical positioning period. If not, it can be indicated that the on-site tour terminal has just entered the pending exhibition area. In this case, a corresponding timed determination task can be established based on the pending exhibition area to determine whether user A using the on-site tour terminal will conduct a corresponding offline tour of the tour exhibition area based on the timed determination task.

[0136] Then, based on the established timing determination task, the location of the on-site tour terminal can be acquired for a future positioning period corresponding to a preset second time period after the current positioning moment, thereby obtaining the future positioning coordinates of the on-site tour terminal in the future positioning period. Here, the preset second time period can be the same as or different from the preset first time period.

[0137] Finally, based on the obtained future positioning coordinates of the corresponding on-site tour terminal in the future positioning period, it can be further determined whether the on-site tour terminal will continue to tour in the undetermined exhibition area. If so, the exhibition area coordinate group can be determined as the corresponding target coordinate group, and based on the target coordinate group, the corresponding virtual exhibition area can be sent to the virtual tour terminal for viewing.

[0138] In step S103, the following contents are included:

[0139] In response to the physical tour terminal performing a primary positioning operation on any tour exhibit located in the tour exhibition area, a virtual exhibit corresponding to the tour exhibit is determined in the virtual exhibition area.

[0140] For example, in this embodiment, when user A uses a physical tour terminal to conduct an offline tour of any tour exhibition area located in a tour exhibition hall, when user A believes that the tour exhibits located in the tour exhibition area have recommendation value and wants to recommend them to user B who uses a virtual tour terminal to conduct an offline tour of the virtual exhibition hall corresponding to the tour exhibition hall for a synchronous tour, then the corresponding first-level positioning operation can be performed on the tour exhibits, so that the virtual exhibits corresponding to the tour exhibits can be determined in the virtual exhibition area, so as to further recommend them to user B for a synchronous tour in the virtual environment.

[0141] Furthermore, in this embodiment, the above-mentioned “in response to the physical tour terminal performing a primary positioning operation on any tour exhibit located in the tour exhibition area, determining a virtual exhibit corresponding to the tour exhibit in the virtual exhibition area” may further include the following steps:

[0142] In response to triggering a voice collection plug-in pre-installed in the on-site tour terminal to perform voice collection, obtaining the exhibit voice output by the voice collection plug-in;

[0143] Performing voice recognition on the exhibit voice, and obtaining a voice text segment corresponding to the exhibit voice based on the recognition result;

[0144] Retrieving an exhibit summary form corresponding to the tourist exhibition area, wherein the exhibit summary form includes exhibit numbers corresponding to respective tourist exhibits located in the tourist exhibition area;

[0145] The exhibit summary form is traversed, and in response to the presence of an exhibit number corresponding to any touring exhibit in the voice text segment, a virtual exhibit corresponding to the touring exhibit is determined in the virtual exhibition area.

[0146] For example, in this embodiment, it should be noted that each tourist exhibition area displays different tourist exhibits, and in a real environment, in order to manage each tourist exhibit, the staff of the tourist exhibition hall generally set a corresponding exhibit number for each tourist exhibit to mark it; based on this, when user A is taking an offline tour of any tourist exhibition area, if he has a high recommendation interest in a certain tourist exhibit and wants to recommend it to user B for a synchronous tour, user A can trigger the voice collection plug-in pre-installed in the on-site tour terminal to perform corresponding voice collection, and obtain the exhibit voice output by the voice collection plug-in based on the voice collection. Here, the exhibit voice can be understood as the real-time voice output by user A. Since each tourist exhibit has a corresponding exhibit number, user A can output the real-time voice based on the exhibit number; after obtaining the exhibit voice output by the voice collection plug-in, the server can perform corresponding voice collection on the exhibit voice. Voice recognition is performed, thereby obtaining a voice text paragraph corresponding to the exhibit voice based on the recognition result, and simultaneously retrieving a summary form of exhibits corresponding to the tour exhibition area, wherein the exhibit summary form can be created in advance and uploaded to the server for storage, and the exhibit summary form includes each exhibit number corresponding to each tour exhibit located in the tour exhibition area. By traversing the exhibit summary form accordingly, when the output exhibit voice determined based on the voice text paragraph contains an exhibit number corresponding to any tour exhibit, it indicates that user A has a corresponding recommendation interest in the tour exhibit. At this time, the virtual exhibit corresponding to the tour exhibit can be further determined in the virtual exhibition area. That is, in this embodiment, the first-level positioning operation of the tour exhibit can be completed by voice input, so as to quickly locate the tour exhibits that user A has a recommended interest in, so as to perform corresponding synchronous tour operations based on the located tour exhibits in subsequent steps, thereby improving the corresponding user experience.

[0147] In step S104, the following contents are included:

[0148] The exhibit display judgment strategy is called to judge whether the virtual exhibit is displayed on the virtual display screen corresponding to the virtual tour terminal, and a first-level update operation is performed on the virtual display screen based on the judgment result to obtain a first-level updated screen.

[0149] For example, in this embodiment, after completing the first-level positioning operation of the touring exhibits that are of recommended interest to user A, the corresponding exhibit display judgment strategy can be called from the server to perform the corresponding first-level update operation on the virtual display screen corresponding to the virtual tour terminal, thereby obtaining the first-level updated screen displayed to the virtual tour terminal; it should be noted that since user B uses the virtual tour terminal to tour the virtual exhibition area in the virtual environment, and the virtual tour terminal is generally a terminal device with a display screen, the corresponding virtual display screen can be understood as a real-time screen displayed on the display screen; after obtaining the virtual display screen corresponding to the virtual tour terminal, it is necessary to perform a screen judgment on the display of the virtual exhibit, and further perform a first-level update operation on the virtual display screen based on the judgment result, thereby obtaining the first-level updated screen corresponding to the virtual exhibit.

[0150] Furthermore, in this embodiment, the above-mentioned "calling the exhibit display judgment strategy to perform a screen judgment on the virtual display screen corresponding to the virtual tour terminal as to whether the virtual exhibit is to be displayed, and performing a first-level update operation on the virtual display screen based on the judgment result to obtain a first-level updated screen" may further include the following steps:

[0151] Performing image recognition on the virtual display screen, and determining the image completeness of the virtual display screen displaying the virtual exhibit based on the recognition result;

[0152] In response to the picture completeness being less than the retrieved preset completeness, obtaining a picture center point corresponding to the virtual display picture and an exhibit center point corresponding to the virtual exhibit, and performing a first-level update operation on the virtual display picture in a manner such that the exhibit center point coincides with the picture center point, thereby obtaining a first-level updated picture;

[0153] In response to the image completeness being greater than or equal to the preset completeness, forming a circumscribed rectangular outline circumscribing the virtual exhibit, and copying the circumscribed rectangular outline to obtain a copied rectangular outline;

[0154] Determining a center point of an outline corresponding to the copied rectangular outline, and adding the copied rectangular outline to the virtual display screen in a manner such that the center point of the outline coincides with a center point of the screen;

[0155] A degree of outline overlap between the circumscribed rectangular outline and the copied rectangular outline is obtained. In response to the degree of outline overlap being less than a preset overlap, a first-level update operation is performed on the virtual display screen in such a manner that the center point of the exhibit coincides with the center point of the screen, thereby obtaining a first-level updated screen.

[0156] For example, in this embodiment, after obtaining the virtual display screen of the corresponding virtual tour terminal, the virtual display screen can be subjected to corresponding screen recognition, and the screen completeness of the virtual display screen for the corresponding display of the virtual exhibits can be determined based on the recognition result; wherein, on the one hand, when the screen completeness is less than the preset completeness retrieved (the preset completeness is, for example, 30%), it indicates that there is a small portion of the corresponding virtual exhibit in the current virtual display screen or there is no virtual exhibit, then it is necessary to perform a screen update on the current virtual display screen, and the specific update process may include: obtaining the screen center point corresponding to the virtual display screen and the exhibit center point corresponding to the virtual exhibit, and performing a corresponding first-level update operation on the virtual display screen in a manner that the exhibit center point coincides with the screen center point, thereby obtaining the corresponding first-level updated screen; on the other hand, when the screen completeness is greater than or equal to the preset completeness retrieved, it indicates that the current If there are more or all parts of the corresponding virtual exhibits in the virtual display screen, then a circumscribed rectangular outline with a circumscribed relationship with the virtual exhibit can be formed in the virtual display screen, and the circumscribed rectangular outline can be copied to obtain a copied rectangular outline; by determining the outline center point corresponding to the copied rectangular outline, and further adding the copied rectangular outline to the virtual display screen in a manner that the outline center point coincides with the center point of the screen; after completing the addition of the copied rectangular outline, the outline coincidence degree between the circumscribed rectangular outline and the copied rectangular outline can be obtained to determine the degree of deviation between the virtual exhibit in the virtual display screen and the center point of the screen. When the outline coincidence degree is less than the preset coincidence degree, it indicates that the degree of deviation between the two groups is relatively high. At this time, it is necessary to perform a corresponding first-level update operation on the virtual display screen in a manner that the center point of the exhibit coincides with the center point of the screen to obtain the corresponding first-level updated screen.

[0157] In step S105, the following contents are included:

[0158] In response to the on-site browsing terminal performing a secondary positioning operation on any exhibit area in the touring exhibit, a virtual area corresponding to the exhibit area is determined in the virtual exhibit.

[0159] For example, in this embodiment, similar to the above-mentioned step S103, when user A has a corresponding recommendation interest in a certain exhibit area located in the exhibit during an offline tour of a certain exhibit, user A can perform a secondary positioning operation on the exhibit area through the actual tour terminal, and determine the virtual area corresponding to the exhibit area in the virtual exhibit, so as to perform a corresponding recommendation operation on user B who uses the virtual tour terminal for online tour in the subsequent process.

[0160] Furthermore, in this embodiment, the above-mentioned “in response to the physical browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determining a virtual area corresponding to the exhibit area in the virtual exhibit” may further include the following steps:

[0161] In response to triggering an image acquisition plug-in pre-installed in the on-site tour terminal to perform image acquisition, an area image output by the image acquisition plug-in is obtained;

[0162] forming an interactive layer on the regional image, and performing grid processing on the interactive layer to obtain points of each layer with the same point spacing between adjacent points;

[0163] In response to the on-site tour terminal interacting with any layer point, the layer point is determined as a first target point, and each layer point in the interactive layer that has a parallel relationship or a perpendicular relationship with the first target point is determined as a first secondary point group;

[0164] In response to the on-site tour terminal interacting with any layer point in the first secondary point group, determining the layer point as a second target point, and connecting the first target point with the second target point to obtain a first connection frame line;

[0165] Determine a direction perpendicular to the first connection frame line as a secondary interaction direction, and determine layer points that are parallel to the first target point and the second target point along the secondary interaction direction as a second secondary point group;

[0166] In response to the on-site tour terminal interacting with any layer point in the second secondary point group, the layer point is determined as a third target point, and a target point parallel to the third target point is connected to the third target point to obtain a second connection frame line;

[0167] generating a positioning rectangular outline in the interactive layer based on the first connection frame line and the second connection frame line, and performing image segmentation on the regional image based on the positioning rectangular outline to obtain a positioning image corresponding to the positioning rectangular outline;

[0168] Image recognition is performed on the positioning image, and based on the recognition result, an exhibit area corresponding to the positioning image is determined in the tour exhibit, and a virtual area corresponding to the exhibit area is determined in the virtual exhibit corresponding to the tour exhibit.

[0169] For example, in this embodiment, it can be explained that since the exhibits have corresponding exhibit number identifications, the positioning operation of the exhibits can be performed by voice input. However, since the exhibit areas corresponding to the exhibits generally do not have corresponding number identifications, the positioning operation of the exhibit areas can be performed by corresponding image acquisition. The specific method steps can be described as follows:

[0170] First, the image acquisition plug-in pre-installed in the on-site tour terminal can be triggered based on the operation of user A to perform image acquisition, so that the server obtains the regional image output by the image acquisition plug-in;

[0171] Next, an interactive layer is formed on top of the regional image, and the interactive layer is further gridded to obtain points of each layer with the same point spacing between adjacent points;

[0172] Next, in response to the on-site tour terminal interacting with any layer point, the layer point can be determined as a first target point, and then each layer point having a parallel relationship or a perpendicular relationship with the first target point can be determined as a first secondary point group in the interactive layer;

[0173] Then, after the first secondary point group is determined, the on-site tour terminal can interact with any layer point in the first secondary point group, determine the layer point as the second target point, and connect the first target point with the second target point accordingly, thereby obtaining a corresponding first connection frame line;

[0174] Next, after obtaining the first connection frame line, the direction perpendicular to the first connection frame line can be determined as the secondary interaction direction, and the layer points that are parallel to the first target point and the second target point along the secondary interaction direction are determined as a second secondary point group;

[0175] Next, after the second secondary point group is determined, the on-site tour terminal can interact with any layer point in the second secondary point group to determine the layer point as the third target point, and further connect the target point parallel to the third target point with the third target point, thereby obtaining the corresponding second connection frame line;

[0176] Next, a corresponding positioning rectangular outline can be generated in the interactive layer based on the first connection frame line and the second connection frame line, and the regional image is segmented based on the positioning rectangular outline, thereby obtaining a positioning image corresponding to the positioning rectangular outline;

[0177] Finally, after obtaining the corresponding positioning image, image recognition is performed on the positioning image, and based on the corresponding recognition results, the exhibit area corresponding to the positioning image is determined in the tour exhibit, and the virtual area corresponding to the exhibit area is determined in the virtual exhibit corresponding to the tour exhibit, thereby realizing the secondary positioning operation of the exhibit area.

[0178] In step S106, the following contents are included:

[0179] The area display judgment strategy is called to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and a first-level update operation is performed on the first-level update screen based on the judgment result to obtain a second-level update screen.

[0180] For example, in this embodiment, after obtaining the positioning of the exhibit area corresponding to the tour exhibit at the on-site tour end based on the above-mentioned secondary positioning operation, the corresponding area display judgment strategy can be called from the server to judge whether the aforementioned first-level update screen needs to display the virtual area, and based on the judgment result, the corresponding first-level update operation is performed on the first-level update screen to obtain the corresponding second-level update screen; here, when the tour exhibit is a portrait sculpture, the exhibit area can correspond to the nose, eyes, mouth, ears and other areas of the portrait sculpture.

[0181] Furthermore, in this embodiment, the above-mentioned "calling the area display judgment strategy to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and performing a first-level update operation on the first-level update screen based on the judgment result to obtain a second-level update screen" may also include the following steps:

[0182] Determining, in the first-level update screen, a region screen corresponding to the virtual region and a screen ratio occupied by the region screen, and comparing the screen ratio with a retrieved preset ratio;

[0183] In response to the screen proportion being less than the preset proportion, obtaining a center point of a region corresponding to the virtual region, and moving the region screen in such a manner that the center point of the region coincides with a center point of the screen;

[0184] The regional screen is enlarged until the screen proportion is greater than or equal to a preset proportion, to obtain a secondary update screen.

[0185] For example, in this embodiment, since the first-level update screen obtained above is obtained based on the virtual exhibits, there must be a regional screen corresponding to the virtual area in the first-level update screen. Based on this, the screen ratio of the regional screen in the first-level update screen can be further obtained, and the screen ratio can be compared with the preset ratio. When the screen ratio is less than the preset ratio, it indicates that the proportion of the virtual exhibition area in the current first-level update screen is small. At this time, it is necessary to perform the corresponding second-level update operation on the first-level update screen. The specific process is to obtain the regional center point corresponding to the virtual area, move the regional screen in a way that the regional center point coincides with the screen center point, and further enlarge the size of the regional screen to a screen ratio greater than or equal to the preset ratio, thereby obtaining the corresponding second-level update screen.

[0186] In summary, in this embodiment, by creating a virtual exhibition hall corresponding to the tourist exhibition hall, the scene of virtual and real co-existence can be built, so that when the actual tourist terminal is determined to be located in any tourist exhibition area in the tourist exhibition hall based on the touring position of the actual tourist terminal, the virtual exhibition area corresponding to the tourist exhibition area can be synchronously sent to the virtual tourist terminal for display, so that users using the virtual tourist terminal can conduct online touring of the virtual exhibition area in the virtual environment, which can enable some users who are not convenient to conduct offline touring to achieve the effect of virtual and real co-existence, thereby improving the convenience of touring; at the same time, when users using the actual touring terminal have a recommendation interest in tourist exhibits located in a certain tourist exhibition area, they can also recommend the exhibits to the real terminal through the first level. The positioning operation is used to locate the virtual exhibit corresponding to the tour exhibit in the virtual exhibition area, and the exhibit display judgment strategy is further called to perform a first-level update operation on the virtual display screen corresponding to the virtual tour end to obtain the corresponding first-level updated screen; further, when the user end using the actual tour end has a recommended interest in any exhibit area of ​​a tour exhibit, the positioning can also be performed through a second-level positioning operation to determine the virtual area corresponding to the exhibit area in the virtual exhibit, and the area display judgment strategy is further called to perform a second-level update operation on the first-level updated screen corresponding to the virtual tour end to obtain the corresponding second-level updated screen, thereby increasing the interactivity and participation of the tour.

[0187] Another embodiment of the present invention proposes an AI exhibition system based on digital twin space, wherein: Figure 3 The system block diagram of the system is shown as Figure 3 As shown, the system includes:

[0188] A virtual creation module is configured to create a virtual pavilion corresponding to the tourist pavilion, wherein the virtual pavilion includes virtual exhibition areas having a virtual-real correspondence relationship with tourist exhibition areas located in the tourist pavilion;

[0189] a virtual and real tour module configured to obtain in real time the tour position of the physical tour terminal in the tour pavilion, and in response to determining that the physical tour terminal is located in any tour exhibition area based on the tour position, send a virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for display;

[0190] a primary positioning module configured to, in response to the physical tour terminal performing a primary positioning operation on any tourist exhibit located in the tourist exhibition area, determine a virtual exhibit corresponding to the tourist exhibit in the virtual exhibition area;

[0191] a first-level update module configured to invoke an exhibit display judgment strategy to determine whether the virtual exhibit is displayed on a virtual display screen corresponding to the virtual tour terminal, and to perform a first-level update operation on the virtual display screen based on the judgment result to obtain a first-level updated screen;

[0192] a secondary positioning module configured to, in response to the on-site browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determine a virtual area corresponding to the exhibit area in the virtual exhibit;

[0193] The secondary update module is configured to call the area display judgment strategy to perform a screen judgment on the primary update screen based on whether the virtual area is displayed, and perform a primary update operation on the primary update screen based on the judgment result to obtain a secondary update screen.

[0194] In the description provided herein, the algorithms and displays are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems may also be used in conjunction with the examples of the present invention. Based on the above description, it is apparent that the structure required for constructing such systems is well understood. In addition, the present invention is not directed to any specific programming language. It should be understood that various programming languages ​​may be utilized to implement the present invention described herein, and the description of specific languages ​​above is provided for the purpose of disclosing preferred embodiments of the present invention.

[0195] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0196] Similarly, it should be understood that in order to streamline the disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together into a single embodiment, figure, or description thereof.

[0197] Those skilled in the art will appreciate that the modules, units, or components of the devices in the examples disclosed herein may be arranged in the device described in the embodiment, or alternatively may be located in one or more devices different from the devices in the examples. The modules in the foregoing examples may be combined into one module or further divided into multiple submodules.

[0198] Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and installed in one or more devices different from the embodiments. The modules, units, or components in the embodiments can be combined into one module, unit, or component, and furthermore, they can be divided into multiple submodules, subunits, or subcomponents.

[0199] Furthermore, those skilled in the art will appreciate that although some embodiments described herein include certain features and not other features included in other embodiments, the combination of features from different embodiments is intended to be within the scope of the invention and to form different embodiments.

[0200] In addition, some of the embodiments are described herein as methods or combinations of method elements that can be implemented by a processor of a computer system or by other devices that perform the functions described. Thus, a processor having the necessary instructions for implementing the method or method element forms a device for implementing the method or method element. Furthermore, the elements described herein of the device embodiments are examples of devices for implementing the functions performed by the elements for the purpose of implementing the invention.

[0201] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved and are not intended to imply that the objects so described must have a given order in time, space, ranking, or in any other manner.

[0202] Although the present invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of the foregoing description, will appreciate that other embodiments are contemplated within the scope of the invention thus described. Furthermore, it should be noted that the language used in this specification has been selected primarily for readability and instructional purposes and is not selected to explain or limit the subject matter of the present invention.

Claims

1. An AI exhibition method based on digital twin space, characterized in that: include: Creating a virtual exhibition hall corresponding to the tourist exhibition hall, wherein the virtual exhibition areas have a virtual-real correspondence relationship with the tourist exhibition areas located in the tourist exhibition hall; Acquire the tour position of the physical tour terminal in the tour exhibition hall in real time, and in response to determining that the physical tour terminal is in any tour exhibition area based on the tour position, send the virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal; In response to the physical tour terminal performing a primary positioning operation on any tour exhibit located in the tour exhibition area, determining a virtual exhibit corresponding to the tour exhibit in the virtual exhibition area; Performing image recognition on the virtual display screen corresponding to the virtual tour terminal to determine the completeness of the image of the virtual display screen displaying the virtual exhibits; In response to the completeness being less than a preset degree, obtaining a center point of the virtual display image and a center point of the virtual exhibit, and performing a first-level update operation on the virtual display image in such a manner that the center point of the exhibit coincides with the center point of the image, thereby obtaining a first-level updated image. In response to the degree of completeness being greater than or equal to a preset degree, forming a circumscribed rectangular outline having a circumscribed relationship with the virtual exhibit, and copying the circumscribed rectangular outline to obtain a copied rectangular outline; Determine a center point of the outline corresponding to the copied rectangular outline, and add the copied rectangular outline to the virtual display screen in a manner such that the center point of the outline coincides with the center point of the screen; Obtaining a degree of overlap between the circumscribed rectangular outline and the copied rectangular outline, and in response to the overlap being less than a preset degree, performing a first-level update operation on the virtual display screen in such a manner that the center point of the exhibit coincides with the center point of the screen, thereby obtaining a first-level updated screen; In response to the physical browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determining a virtual area corresponding to the exhibit area in the virtual exhibit; The area display judgment strategy is called to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and a first-level update operation is performed on the first-level update screen based on the judgment result to obtain a second-level update screen.

2. The AI ​​exhibition method based on digital twin space according to claim 1, characterized in that: Create a virtual exhibition hall corresponding to the exhibition hall you are visiting, including: Creating an initial pavilion model corresponding to the tourist pavilion, and determining, based on the initial pavilion model, virtual exhibition areas having virtual-real correspondences with the tourist exhibition areas located in the tourist pavilion, and virtual channels having virtual correspondences with the connecting channels connecting the tourist exhibition areas; Determine virtual exhibition areas connected based on the same virtual channel as a connected exhibition area group corresponding to the virtual channel, and obtain connected exhibition area groups corresponding to each virtual channel; Determine the exhibition area connection surfaces that connect each virtual exhibition area in the same connected exhibition area group with the corresponding virtual channel, perform model segmentation on the initial exhibition hall model based on the exhibition area connection surfaces, and remove each virtual channel from the initial exhibition hall model to obtain a blank area corresponding to each virtual channel in the initial exhibition hall model; Determine the number of exhibition areas of each virtual exhibition area in the same connected exhibition area group, and based on the number of exhibition areas, form a connectivity indicator model connecting the virtual exhibition areas in the same connected exhibition area group in the corresponding blank area to obtain a current exhibition hall model; The current exhibition hall model is uploaded to the digital twin space to obtain a virtual exhibition hall corresponding to the visited exhibition hall.

3. The AI ​​exhibition method based on digital twin space according to claim 2, characterized in that: Based on the number of exhibition areas, a connectivity indication model is formed in the corresponding blank area to connect the virtual exhibition areas in the same connected exhibition area group, to obtain a current exhibition hall model, including: Acquiring the connected contours of each exhibition area of ​​the connected surfaces corresponding to each virtual exhibition area in the same connected exhibition area group, and determining the size of each exhibition area connected contour to obtain the size of each exhibition area contour corresponding to each exhibition area connected contour; Determine the smallest exhibition area outline size among the exhibition area outline sizes as the target exhibition area size, and compare the target exhibition area size with the retrieved reference exhibition area size to determine a size comparison value; Calculating the product of the size comparison value and the number of reference points corresponding to the reference exhibition area size, obtaining the number of target points corresponding to the target exhibition area size, and generating target exhibition area points having the same number as the target point number in the connected contours of each exhibition area; Generate a summary sub-model in the blank area, and form, on the summary sub-model, a same number of summary connected surfaces corresponding to the connected surfaces of the exhibition areas based on the number of exhibition areas, wherein the first surface shape directions of the connecting surfaces of the exhibition areas are respectively parallel to the second surface shape directions of the summary connected surfaces; Acquire each summary connected contour corresponding to each summary connected surface, and generate target summary points having the same number as the target points in each summary connected contour; Connecting each target exhibition area point included in any exhibition area connected contour with each target summary point included in the corresponding summary connected contour in sequence to obtain each contour connection line connecting the exhibition area connected contour and the summary connected contour; Based on the combination of the summary sub-model and each contour connection line, a connectivity indication model is formed that connects each virtual exhibition area in the same connected exhibition area group to obtain the current exhibition hall model.

4. The AI ​​exhibition method based on digital twin space according to claim 3 is characterized in that: Acquiring a tour position of a physical tour terminal in the tour pavilion in real time, and in response to determining that the physical tour terminal is located in any tour exhibition area based on the tour position, sending a virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal for display, including: Acquire a top view of the exhibition hall corresponding to the virtual exhibition hall, and establish a virtual coordinate system with the center point of the image of the top view of the exhibition hall as the origin; Determining, in the exhibition hall top view, exhibition area images corresponding to the virtual exhibition areas, and determining, based on the virtual coordinate system, image coordinate points constituting the same exhibition area image as an exhibition area coordinate group; Establishing a real coordinate system with the center point of the tourist exhibition hall as the origin, and obtaining a coordinate conversion relationship between the real coordinate system and the virtual coordinate system; Acquiring the real positioning coordinates of the on-site tour terminal in real time, and performing coordinate conversion on the real positioning coordinates based on the coordinate conversion relationship to obtain virtual positioning coordinates corresponding to the on-site tour terminal; comparing the virtual positioning coordinates with the exhibition area coordinate groups corresponding to the exhibition area images, and in response to determining that the virtual positioning coordinates are included in any exhibition area coordinate group based on the comparison result, determining the exhibition area coordinate group as a target coordinate group; Determining the touring exhibition area where the physical touring terminal is located based on the target coordinate group, and obtaining an exhibition area display screen corresponding to the virtual touring terminal; In response to the exhibition area display screen not including the virtual exhibition area corresponding to the tour exhibition area, the virtual exhibition area is sent to the virtual tour terminal for display.

5. The AI ​​exhibition method based on digital twin space according to claim 4 is characterized in that: In response to determining that the virtual positioning coordinates are included in any exhibition area coordinate group based on the comparison result, determining the exhibition area coordinate group as the target coordinate group includes: In response to determining, based on the comparison result, that the virtual positioning coordinates are included in any exhibition area coordinate group, determining the tour exhibition area corresponding to the exhibition area coordinate group as a pending exhibition area; Determine a current positioning moment, obtain a historical positioning period that lasts for a preset first time period and is located before the current positioning moment, and determine each historical positioning coordinate of the on-site tour terminal in the historical positioning period; In response to determining based on the historical positioning coordinates that the on-site tour terminal is not in the undetermined exhibition area during the historical positioning period, establishing a timing determination task; Based on the timing determination task, the location of the on-site tour terminal is acquired for a future positioning period that lasts for a preset second time period and is located after the current positioning moment, to obtain each future positioning coordinate of the on-site tour terminal in the future positioning period; In response to determining, based on each future positioning coordinate, that the on-site tour terminal is always in the undetermined exhibition area during the future positioning period, the exhibition area coordinate group is determined as the target coordinate group.

6. The AI ​​exhibition method based on digital twin space according to claim 1, characterized in that: In response to the physical tour terminal performing a primary positioning operation on any touring exhibit located in the touring exhibition area, determining a virtual exhibit corresponding to the touring exhibit in the virtual exhibition area includes: In response to triggering a voice collection plug-in pre-installed in the on-site tour terminal to perform voice collection, obtaining the exhibit voice output by the voice collection plug-in; Performing voice recognition on the exhibit voice, and obtaining a voice text segment corresponding to the exhibit voice based on the recognition result; Retrieving an exhibit summary form corresponding to the tourist exhibition area, wherein the exhibit summary form includes exhibit numbers corresponding to respective tourist exhibits located in the tourist exhibition area; The exhibit summary form is traversed, and in response to the presence of an exhibit number corresponding to any touring exhibit in the voice text segment, a virtual exhibit corresponding to the touring exhibit is determined in the virtual exhibition area.

7. The AI ​​exhibition method based on digital twin space according to claim 1, characterized in that: In response to the on-site browsing terminal performing a secondary positioning operation on any exhibit area in the tour exhibit, determining a virtual area corresponding to the exhibit area in the virtual exhibit includes: In response to triggering an image acquisition plug-in pre-installed in the on-site tour terminal to perform image acquisition, an area image output by the image acquisition plug-in is obtained; forming an interactive layer on the regional image, and performing grid processing on the interactive layer to obtain points of each layer with the same point spacing between adjacent points; In response to the on-site tour terminal interacting with any layer point, the layer point is determined as a first target point, and each layer point in the interactive layer that has a parallel relationship or a perpendicular relationship with the first target point is determined as a first secondary point group; In response to the on-site tour terminal interacting with any layer point in the first secondary point group, determining the layer point as a second target point, and connecting the first target point with the second target point to obtain a first connection frame line; Determine a direction perpendicular to the first connection frame line as a secondary interaction direction, and determine layer points that are parallel to the first target point and the second target point along the secondary interaction direction as a second secondary point group; In response to the on-site tour terminal interacting with any layer point in the second secondary point group, the layer point is determined as a third target point, and a target point parallel to the third target point is connected to the third target point to obtain a second connection frame line; generating a positioning rectangular outline in the interactive layer based on the first connection frame line and the second connection frame line, and performing image segmentation on the regional image based on the positioning rectangular outline to obtain a positioning image corresponding to the positioning rectangular outline; Image recognition is performed on the positioning image, and based on the recognition result, an exhibit area corresponding to the positioning image is determined in the tour exhibit, and a virtual area corresponding to the exhibit area is determined in the virtual exhibit corresponding to the tour exhibit.

8. The AI ​​exhibition method based on digital twin space according to claim 7, characterized in that: Calling the area display judgment strategy to perform a screen judgment on the first-level update screen based on whether the virtual area is displayed, and performing a first-level update operation on the first-level update screen based on the judgment result to obtain a second-level update screen, including: Determining, in the first-level update screen, a region screen corresponding to the virtual region and a screen ratio occupied by the region screen, and comparing the screen ratio with a retrieved preset ratio; In response to the screen proportion being less than the preset proportion, obtaining a center point of a region corresponding to the virtual region, and moving the region screen in such a manner that the center point of the region coincides with a center point of the screen; The regional screen is enlarged until the screen proportion is greater than or equal to a preset proportion, to obtain a secondary update screen.

9. An AI exhibition system based on digital twin space, characterized by: include: A virtual creation module is configured to create a virtual pavilion corresponding to the tourist pavilion, wherein the virtual pavilion includes virtual exhibition areas having a virtual-real correspondence relationship with the tourist exhibition areas located in the tourist pavilion; a virtual and real tour module configured to obtain in real time the tour position of the physical tour terminal in the tour exhibition hall, and in response to determining that the physical tour terminal is in any tour exhibition area based on the tour position, send a virtual exhibition area corresponding to the tour exhibition area to the virtual tour terminal; The primary positioning module is configured to determine a virtual exhibit corresponding to the touring exhibit in the virtual exhibition area in response to the physical touring terminal performing a primary positioning operation on any touring exhibit located in the touring exhibition area; a first-level updating module configured to perform image recognition on a virtual display screen corresponding to the virtual tour terminal and determine the image completeness of the virtual display screen displaying the virtual exhibits; In response to the completeness being less than a preset degree, obtaining a center point of the virtual display image and a center point of the virtual exhibit, and performing a first-level update operation on the virtual display image in such a manner that the center point of the exhibit coincides with the center point of the image, thereby obtaining a first-level updated image. In response to the degree of completeness being greater than or equal to a preset degree, forming a circumscribed rectangular outline having a circumscribed relationship with the virtual exhibit, and copying the circumscribed rectangular outline to obtain a copied rectangular outline; Determine a center point of the outline corresponding to the copied rectangular outline, and add the copied rectangular outline to the virtual display screen in a manner such that the center point of the outline coincides with the center point of the screen; Obtaining a degree of overlap between the circumscribed rectangular outline and the copied rectangular outline, and in response to the overlap being less than a preset degree, performing a first-level update operation on the virtual display screen in such a manner that the center point of the exhibit coincides with the center point of the screen, thereby obtaining a first-level updated screen; The secondary positioning module is configured to perform a secondary positioning operation on any exhibit area in the to-be-visited exhibit in response to the on-site browsing terminal, and determine a virtual area corresponding to the exhibit area in the virtual exhibit; The secondary update module is configured to call the area display judgment strategy to judge whether the virtual area is displayed on the primary update screen, and perform a primary update operation on the primary update screen based on the judgment result to obtain a secondary update screen.

Images