A mixed reality-based virtual component display method, device and equipment

Abstract

The application discloses a virtual component display method, device and equipment based on mixed reality, and the method comprises the following steps: acquiring a first position corresponding to a first locator; acquiring a first collection time at which each sensor in a plurality of sensors of a first terminal device collects a first signal, a second collection time at which each sensor collects a second signal, and a third collection time at which each sensor collects a third signal when the first locator successively sends out the first signal, the second signal and the third signal; acquiring an angular velocity corresponding to a scanning signal and a distance from each sensor to the first locator; determining a second position of the first terminal device based on the first position, all the first collection times, all the second collection times, all the third collection times, the angular velocity and the distance from each sensor to the first locator; and acquiring all virtual components contained in a preset range of the second position and rendering and displaying all the virtual components.

Description

Technical Field

[0001] This invention relates to the fields of computer technology and surveying, and specifically to a method, apparatus, and device for displaying virtual components based on mixed reality. Background Technology

[0002] In on-site construction processes such as building construction, shipbuilding, and large machinery assembly, two-dimensional construction drawings are crucial references. Workers typically use measuring instruments to conduct on-site measurements to ensure the construction location and building dimensions match the drawings. However, this process is cumbersome, fails to provide a WYSIWYG (what you see is what you get) experience, and makes it difficult to accurately determine the positional relationship between points and actual objects. This leads to reduced construction efficiency and prevents accurate assessments based on pre-demonstration on-site conditions.

[0003] Therefore, how to achieve a WYSIWYG pre-demonstration effect, improve construction efficiency, and provide operators with a quick and accurate basis for judgment has become a problem that needs to be solved. Summary of the Invention

[0004] Therefore, the technical problem to be solved by the present invention is to overcome the shortcomings of low construction efficiency in the prior art, thereby providing a virtual component display method, device and equipment based on mixed reality.

[0005] In a first aspect, the present invention provides a method for displaying virtual components based on mixed reality, the method being executed by a first terminal device, comprising:

[0006] Obtain the first position corresponding to the first locator; after the first locator sequentially emits the first signal, the second signal, and the third signal, obtain the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device, where the first signal is a synchronization signal, and the second and third signals are scanning signals emitted by the first locator along different axes; obtain the angular velocity corresponding to the scanning signal and the distance from each sensor to the first locator; based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator, determine the second position of the first terminal device; obtain all virtual components contained within a preset range of the second position, and render and display all virtual components.

[0007] In conjunction with the first aspect, in the first embodiment of the first aspect, the first position is obtained by the second locator positioning the first locator.

[0008] In conjunction with the first aspect, in the second embodiment of the first aspect, based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator, the second position of the first terminal device is determined, including:

[0009] Based on the first acquisition time, the second acquisition time, and the third acquisition time corresponding to the first sensor, and the angular velocity, the offset angle of the first sensor relative to the first locator is determined, wherein the first sensor is any one of the multiple sensors included in the first terminal device; based on the first position, the offset angle of the first sensor relative to the first locator, and the distance from the first sensor to the first locator, the position corresponding to the first sensor is determined; and the second position of the first terminal device is determined according to the position corresponding to each sensor.

[0010] In conjunction with the first aspect, in the third embodiment of the first aspect, after rendering and displaying all virtual components, the method further includes:

[0011] The system obtains the third location sent by the second terminal device and the display mode selected by the second terminal device. The third location is the location corresponding to the target object indicated by the second terminal device. The system obtains the virtual component corresponding to the third location and displays the virtual component corresponding to the third location according to the selected display mode.

[0012] Secondly, the present invention provides a virtual component display method based on mixed reality, the method being executed by a second terminal device, comprising:

[0013] The system acquires the first position corresponding to the first locator; after the first locator sequentially emits a first signal, a second signal, and a third signal, it acquires the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device, where the first signal is a synchronization signal, and the second and third signals are scanning signals emitted by the first locator along different axes; it acquires the angular velocity corresponding to the scanning signal and the distance from each sensor to the first locator; based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator, it determines the second position of the second terminal device; it acquires the offset angle of the second terminal device relative to the horizontal plane and the distance from the target object indicated by the second terminal device to the second terminal device; based on the second position, the offset angle, and the distance from the target object to the second terminal device, it determines the third position corresponding to the target object; it sends the third position and the pre-selected display mode to the first terminal device so that the first terminal device displays the virtual component corresponding to the third position according to the display mode.

[0014] In conjunction with the second aspect, in the first embodiment of the second aspect, the offset angle of the second terminal device relative to the horizontal plane is measured by the first locator.

[0015] In conjunction with the second aspect, in the second embodiment of the second aspect, the distance from the target object to the second terminal device is measured by a ranging component in the second terminal device.

[0016] Thirdly, the present invention provides a virtual component display device based on mixed reality, the device being applied to a first terminal device, comprising:

[0017] The first acquisition module is used to acquire the first position corresponding to the first locator; the second acquisition module is used to acquire the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device when the first locator sequentially emits the first signal, the second signal, and the third signal, wherein the first signal is a synchronization signal, and the second and third signals are scanning signals emitted by the first locator along different axes; the third acquisition module is used to acquire the angular velocity corresponding to the scanning signal and the distance from each sensor to the first locator; the determination module is used to determine the second position of the first terminal device based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator; the processing module is used to acquire all virtual components contained within a preset range of the second position and render and display all the virtual components.

[0018] Fourthly, the present invention provides a virtual component display device based on mixed reality, the device being applied to a second terminal device, comprising:

[0019] The first acquisition module is used to acquire the first position corresponding to the first locator; the second acquisition module is used to acquire the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device when the first locator sequentially emits the first signal, the second signal, and the third signal, respectively, wherein the first signal is a synchronization signal, and the second and third signals are scanning signals emitted by the first locator along different axes; the third acquisition module is used to acquire the angular velocity corresponding to the scanning signal and the distance from each sensor to the first locator; the first determination module is used to determine the second position of the second terminal device based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator; the fourth acquisition module is used to acquire the offset angle of the second terminal device relative to the horizontal plane and the distance from the target object indicated by the second terminal device to the second terminal device; the second determination module is used to determine the third position corresponding to the target object based on the second position, the offset angle, and the distance from the target object to the second terminal device; the sending module is used to send the third position and the pre-selected display mode to the first terminal device so that the first terminal device displays the virtual component corresponding to the third position according to the display mode.

[0020] Fifthly, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory being used to store a computer program, wherein when the computer program is executed by the processor of a first terminal device, the processor executes any of the mixed reality-based virtual component display methods executed by the first terminal device as described in the present invention, or, when the computer program is executed by the processor of a second terminal device, the processor executes any of the mixed reality-based virtual component display methods executed by the second terminal device as described in the present invention. Attached Figure Description

[0021] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0022] Figure 1 A flowchart illustrating a virtual component display method based on mixed reality, executed by a first terminal device, as provided in an embodiment of the present invention.

[0023] Figure 2 A flowchart for determining the second position of a first terminal device provided in an embodiment of the present invention;

[0024] Figure 3 This is a flowchart illustrating the display of a virtual component corresponding to a third position, provided in an embodiment of the present invention.

[0025] Figure 4 A flowchart illustrating a virtual component display method based on mixed reality, executed by a second terminal device, as provided in an embodiment of the present invention.

[0026] Figure 5 A connection diagram of a virtual component display device based on mixed reality applied to a first terminal device, provided in an embodiment of the present invention;

[0027] Figure 6 A connection diagram of a virtual component display device based on mixed reality applied to a second terminal device, provided in an embodiment of the present invention;

[0028] Figure 7 This is a computer device connection diagram provided for an embodiment of the present invention. Detailed Implementation

[0029] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0030] This invention discloses a virtual component display method based on mixed reality, the method being executed by a first terminal device, such as... Figure 1 As shown, the method specifically includes the following steps:

[0031] S11: Obtain the first position corresponding to the first locator.

[0032] For example, when the application scenario is a construction site, the first locator can be a lighthouse laser locator or other instruments that can be used for positioning.

[0033] S12: After the first locator sends out the first signal, the second signal, and the third signal in sequence, the first acquisition time of the first signal, the second acquisition time of the second signal, and the third acquisition time of the third signal are obtained by each of the multiple sensors of the first terminal device.

[0034] Specifically, the first signal is a synchronization signal, while the second and third signals are scanning signals from different axes emitted by the first positioner.

[0035] For example, the first terminal device can be any display device, such as mixed reality glasses, on which multiple sensors are installed, and the sensor type can be a photosensitive sensor.

[0036] For example, in this embodiment, the first locator is a lighthouse laser locator. The lighthouse laser locator has an infrared LED array and two mutually perpendicular rotating shafts, with infrared laser emitters on each shaft capable of rotating around them. When the lighthouse laser locator enters its working state, the infrared LEDs flash, and the infrared LED light is the first signal (the first signal is a synchronization signal). After the infrared LEDs flash, the infrared laser emitter in the X-axis direction begins to rotate around the rotating shaft, scanning the entire space (the laser emitted in the X-axis direction is the second signal, which is a scanning signal). At this time, the infrared laser emitter in the Y-axis direction does not emit light. When the infrared laser emitter in the X-axis direction finishes scanning, the infrared laser emitter in the Y-axis direction begins to rotate around the Y-axis, scanning the entire space (the laser emitted in the Y-axis direction is the third signal, which is a scanning signal). At this time, the infrared laser emitter in the X-axis direction does not emit light.

[0037] After the lighthouse laser locator sequentially emits the first, second, and third signals, each photosensitive sensor located at different positions on the mixed reality glasses will successively receive infrared LED light, infrared laser light along the X-axis, and infrared laser light along the Y-axis. The first acquisition time of each sensor's infrared LED light acquisition, the second acquisition time of its infrared laser light acquisition along the X-axis, and the third acquisition time of its infrared laser light acquisition along the Y-axis are recorded.

[0038] S13: Obtain the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator.

[0039] Specifically, the angular velocities corresponding to the scanning signals (i.e., the second and third signals) can be directly obtained from the first positioner. The angular velocities corresponding to the second and third signals are the same.

[0040] Specifically, after the first terminal device acquires the first acquisition time of the first signal, the second acquisition time of the second signal, and the third acquisition time of the third signal from each sensor, it sends the corresponding acquisition times for each sensor to the spatial ranging component of the first terminal device. Then, the spatial ranging component determines the distance from each sensor to the first locator based on the first, second, and third acquisition times and the angular velocity corresponding to the scan signal. Finally, the first terminal device can directly obtain the distance from each sensor to the first locator from the spatial ranging component. Since the ranging principle of the spatial ranging component is existing technology, it will not be elaborated further.

[0041] S14: Based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator, determine the second position of the first terminal device.

[0042] Specifically, when determining the second position of the first terminal device, firstly, the offset angle of each sensor relative to the first locator is determined based on the first acquisition time, the second acquisition time, the third acquisition time, and the angular velocity corresponding to all signals collected by each sensor. Then, the second position of the first terminal device is determined based on the first position, the offset angle of each sensor relative to the first locator, and the distance of each sensor to the first locator.

[0043] S15: Obtain all virtual components contained within the preset range of the second position, and render and display all virtual components.

[0044] For example, in this embodiment, the first terminal device is mixed reality glasses. After obtaining the second location of the first terminal device, the mixed reality glasses use WebGL (Web Graphics Library, 3D drawing) technology to access the BIM (Building Information Modeling) lightweight engine server based on the first location to retrieve all virtual components contained within a preset range of the second location, render the virtual components, and display all rendered virtual components on the first terminal device. When displaying virtual components, not only can the renderings of the virtual components be displayed, but also specific information such as the size and position of the virtual components can be shown. The information displayed on the first terminal device will serve as a construction reference to guide construction personnel in their operations. In this embodiment, the preset range of the second location is the range of vision of a normal human eye.

[0045] In this invention, firstly, the second position of the first terminal device is determined by acquiring the first position of the first locator, the first acquisition time of the first signal acquired by each sensor, the second acquisition time of the second signal acquired, the third acquisition time of the third signal acquired, the angular velocity, and the distance from each sensor to the first locator. This process achieves precise positioning of the first terminal device, resulting in highly accurate positioning of the virtual components ultimately presented based on the second position. Then, all virtual components within a preset range of the second position are acquired, and all virtual components are rendered and displayed. This process can recreate the 3D construction renderings one-to-one on the actual construction site, directly presenting the final product of a construction project on the first terminal device. This allows construction personnel to directly obtain the desired construction information and perform operations from the displayed information, avoiding the cumbersome operation of referring to construction drawings and conducting on-site measurements in existing technologies. This improves construction efficiency. Simultaneously, the overlap between the virtual components displayed on the first terminal device and the completed buildings in the actual construction scene can be used to verify whether the completed buildings are qualified, thus ensuring construction quality at the accuracy level.

[0046] In an alternative embodiment, the first position is obtained by the second locator positioning the first locator.

[0047] For example, the first locator is a lighthouse laser locator, and the second locator is a total station. In this embodiment, the lighthouse laser locator and the positioning prism together form a single component. First, the total station positions the positioning prism to obtain its location. Then, the relative position of the lighthouse laser locator with respect to the positioning prism is obtained. Finally, based on the position of the positioning prism, the relative position of the lighthouse laser locator with respect to the positioning prism determines the first position of the lighthouse laser locator, and the total station sends the first position of the lighthouse laser locator to the first terminal device.

[0048] Since the positioning accuracy of the total station is at the millimeter level, the accuracy of the first position of the lighthouse laser locator determined by the total station is also at the millimeter level, thereby improving the positioning accuracy of the lighthouse laser locator and indirectly ensuring the accuracy of the position of the virtual component finally presented on the first terminal device.

[0049] In one optional embodiment, based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator, the second position of the first terminal device is determined, such as... Figure 2 As shown, it includes the following steps:

[0050] S21: Based on the first acquisition time corresponding to the first sensor, the second acquisition time corresponding to the first sensor, the third acquisition time corresponding to the first sensor, and the angular velocity, determine the offset angle of the first sensor relative to the first positioner.

[0051] Specifically, the first sensor is any one of a plurality of sensors included in the first terminal device. In a particular example, the first sensor includes at least three sensors.

[0052] For example, firstly, based on the first acquisition time corresponding to the first sensor, the second acquisition time corresponding to the first sensor, and the acquired angular velocity, a first offset angle of the first sensor relative to the first locator in the first direction is determined; based on the second acquisition time corresponding to the first sensor, the third acquisition time corresponding to the first sensor, and the acquired angular velocity, a second offset angle of the first sensor relative to the first locator in the second direction is determined; based on the first offset angle and the second offset angle, the offset angle of the first sensor relative to the first locator is determined.

[0053] S22: Determine the position corresponding to the first sensor based on the first position, the offset angle of the first sensor relative to the first locator, and the distance from the first sensor to the first locator.

[0054] For example, firstly, the relative position of the first sensor with respect to the first locator is determined based on the offset angle of the first sensor with respect to the first locator and the distance from the first sensor to the first locator; then, the position of the first sensor is determined based on the first position of the first locator and the relative position of the first sensor with respect to the first locator.

[0055] S23: Determine the second position of the first terminal device based on the position corresponding to each sensor.

[0056] For example, in this embodiment, the first terminal device has five sensors, and the position of the center of the pattern formed by the five sensors can be used as the position of the first terminal device. Thus, the second position of the first terminal device can be obtained.

[0057] In an alternative embodiment, after all virtual components have been rendered and displayed, such as Figure 3 As shown, it also includes the following steps:

[0058] S31: Obtain the third location sent by the second terminal device and the display mode selected by the second terminal device.

[0059] Specifically, the third position is the position corresponding to the target object indicated by the second terminal device. The display mode is the final presentation method on the first terminal device, and the specific display mode can be selected according to actual needs.

[0060] For example, the second terminal device can be a handheld device, and the display mode can be an information display mode, an effect display mode, a target display mode, etc.

[0061] S32: Obtain the virtual component corresponding to the third position, and display the virtual component corresponding to the third position according to the selected display mode.

[0062] For example, in this embodiment, the second terminal device is a controller, and the position corresponding to the target object pointed to by the controller is the third position. Based on the position information of the third position, the virtual component corresponding to the third position is obtained, and then the virtual component corresponding to the third position is displayed according to the selected display mode.

[0063] When the selected display mode is information display mode, only the building information of the virtual component corresponding to the third position needs to be displayed, and the building information of the other virtual components does not need to be displayed.

[0064] When the selected display mode is effect display mode, only the rendered virtual component corresponding to the third position needs to be displayed. The other virtual components do not need to be rendered; only the building frame needs to be displayed.

[0065] When the selected display mode is the target display mode, only the selected virtual component corresponding to the third position and the building information corresponding to the virtual component need to be displayed, and the other virtual components do not need to be displayed in any form.

[0066] Secondly, the present invention provides a virtual component display method based on mixed reality, the method being executed by a second terminal device, such as... Figure 4 As shown, the method specifically includes:

[0067] S41: Obtain the first position corresponding to the first locator.

[0068] S42: After the first locator sequentially sends out the first signal, the second signal, and the third signal, the first acquisition time of the first signal, the second acquisition time of the second signal, and the third acquisition time of the third signal are obtained by each of the multiple sensors of the first terminal device. The first signal is a synchronization signal, and the second and third signals are scanning signals of different axes sent by the first locator.

[0069] S43: Obtain the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator.

[0070] S44: Based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator, determine the second position of the second terminal device.

[0071] Specifically, the method for determining the second position corresponding to the second terminal device is the same as the method for determining the second position corresponding to the first terminal device, and the steps S41-S44 executed by the second terminal device are also the same as the steps S11-S14 executed by the first terminal device. Therefore, they will not be described again here.

[0072] S45: Obtain the offset angle of the second terminal device relative to the horizontal plane, and the distance from the target object indicated by the second terminal device to the second terminal device.

[0073] For example, the offset angle can be measured by the first positioner. The specific measurement method is existing technology and will not be described in detail here.

[0074] For example, the distance from the target object to the second terminal device can be measured by a ranging component in the second terminal device.

[0075] S46: Based on the second position, the offset angle, and the distance from the target object to the second terminal device, determine the third position corresponding to the target object.

[0076] Specifically, the relative position of the target object with respect to the second terminal device is determined based on the offset angle and the distance from the target object to the second terminal device; then, the third position corresponding to the target is determined based on the second position and the relative position.

[0077] S47: Send the third position and the pre-selected display mode to the first terminal device so that the first terminal device can display the virtual component corresponding to the third position according to the display mode.

[0078] This invention discloses a virtual component display device based on mixed reality, which is applied to a first terminal device, such as... Figure 5 As shown, it specifically includes the following modules:

[0079] The first acquisition module 51 is used to acquire the first position corresponding to the first locator.

[0080] The second acquisition module 52 is used to acquire the first acquisition time of the first acquisition signal, the second acquisition time of the second acquisition signal, and the third acquisition time of the third acquisition signal of each of the multiple sensors of the first terminal device after the first locator sequentially sends out the first signal, the second signal, and the third signal. The first signal is a synchronization signal, and the second and third signals are scanning signals of different axes sent by the first locator.

[0081] The third acquisition module 53 is used to acquire the angular velocity corresponding to the scanning signal, as well as the distance from each sensor to the first locator.

[0082] The determination module 54 is used to determine the second position of the first terminal device based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator.

[0083] The processing module 55 is used to obtain all virtual components contained within the preset range of the second position, and to render and display all virtual components.

[0084] This invention discloses a virtual component display device based on mixed reality, which is applied to a second terminal device, such as... Figure 6 As shown, it specifically includes the following modules:

[0085] The first acquisition module 61 is used to acquire the first position corresponding to the first locator.

[0086] The second acquisition module 62 is used to acquire the first acquisition time of the first signal, the second acquisition time of the second signal, and the third acquisition time of the third signal of each of the multiple sensors of the first terminal device after the first locator sequentially sends out the first signal, the second signal, and the third signal. The first signal is a synchronization signal, and the second and third signals are scanning signals of different axes sent by the first locator.

[0087] The third acquisition module 63 is used to acquire the angular velocity corresponding to the scanning signal, as well as the distance from each sensor to the first locator.

[0088] The first determining module 64 is used to determine the second position of the second terminal device based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, angular velocity, and the distance from each sensor to the first locator.

[0089] The fourth acquisition module 65 is used to acquire the offset angle of the second terminal device relative to the horizontal plane and the distance from the target object indicated by the second terminal device to the second terminal device.

[0090] The second determining module 66 is used to determine the third position corresponding to the target object based on the second position, the offset angle, and the distance from the target object to the second terminal device.

[0091] The sending module 67 is used to send the third position and the pre-selected display mode to the first terminal device, so that the first terminal device can display the virtual component corresponding to the third position according to the display mode.

[0092] This embodiment provides a computer device, such as... Figure 7 As shown, this computer device is used in an application system and may include at least one processor 71, at least one communication interface 72, at least one communication bus 73, and at least one memory 74. The communication interface 72 may include a display screen and a keyboard; optionally, the communication interface 72 may also include a standard wired interface or a wireless interface. The memory 74 may be high-speed RAM (Random Access Memory) or non-volatile memory, such as at least one disk drive. Optionally, the memory 74 may also be at least one storage device located remotely from the aforementioned processor 71. The processor 71 may be combined with... Figure 7 The described apparatus has an application program stored in memory 74, and a processor 71 calls the program code stored in memory 74 to execute the steps of the virtual component display method based on mixed reality in any of the embodiments of the first terminal device or the second terminal device described above.

[0093] The communication bus 73 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The communication bus 73 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0094] The memory 74 may include volatile memory, such as random-access memory (RAM); the memory may also include non-volatile memory, such as flash memory, hard disk drive (HDD) or solid-state drive (SSD); the memory 74 may also include a combination of the above types of memory.

[0095] The processor 71 can be a central processing unit (CPU), a network processor (NP), or a combination of CPU and NP.

[0096] The processor 71 may further include a hardware chip. This hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. Optionally, the memory 74 is also used to store program instructions. The processor 71 can invoke the program instructions to implement the virtual component display method based on mixed reality in any embodiment of the first or second terminal device of the present invention.

[0097] Obviously, the above embodiments are merely illustrative examples for clear explanation and are not intended to limit the implementation. Those skilled in the art will recognize that other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all possible implementations here. However, obvious variations or modifications derived therefrom are still within the scope of protection of this invention.

Claims

1. A method for displaying virtual components based on mixed reality, characterized in that, The method is executed by a first terminal device and includes: Obtain the first position corresponding to the first locator; the first locator is a lighthouse laser locator; the first position is obtained by locating the first locator with a second locator; the second locator is a total station; After the first locator sequentially sends out the first signal, the second signal, and the third signal, the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device are obtained respectively. The first signal is a synchronization signal, and the second signal and the third signal are scanning signals of different axes sent by the first locator. Obtain the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator; Based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator, the second position of the first terminal device is determined; Determining the second position of the first terminal device based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator includes: determining the offset angle of the first sensor relative to the first locator based on the first acquisition time corresponding to the first sensor, the second acquisition time corresponding to the first sensor, the third acquisition time corresponding to the first sensor, and the angular velocity, wherein the first sensor is any one of a plurality of sensors included in the first terminal device; determining the position corresponding to the first sensor based on the first position, the offset angle of the first sensor relative to the first locator, and the distance from the first sensor to the first locator; and determining the second position of the first terminal device based on the position corresponding to each sensor. Obtain all virtual components contained within a preset range of the second location, and render and display all the virtual components; access the BIM lightweight engine server according to the first location to retrieve all virtual components contained within the preset range of the second location, render the virtual components, and display all the rendered virtual components on the first terminal device.

2. The virtual component display method based on mixed reality according to claim 1, characterized in that, After rendering and displaying all the virtual components, the process further includes: The third location sent by the second terminal device and the display mode selected by the second terminal device are obtained, wherein the third location is the location corresponding to the target object indicated by the second terminal device; Obtain the virtual component corresponding to the third position, and display the virtual component corresponding to the third position according to the selected display mode.

3. A method for displaying virtual components based on mixed reality, characterized in that, The method is executed by a second terminal device and includes: Obtain the first position corresponding to the first locator; the first locator is a lighthouse laser locator; the first position is obtained by locating the first locator with a second locator; the second locator is a total station; After the first locator sequentially sends out the first signal, the second signal, and the third signal, the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device are obtained respectively. The first signal is a synchronization signal, and the second signal and the third signal are scanning signals of different axes sent by the first locator. Obtain the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator; Based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator, the second position of the second terminal device is determined; Obtain the offset angle of the second terminal device relative to the horizontal plane, and the distance from the target object indicated by the second terminal device to the second terminal device; Based on the second position, the offset angle, and the distance from the target object to the second terminal device, a third position corresponding to the target object is determined; The third position and the pre-selected display mode are sent to the first terminal device so that the first terminal device displays the virtual component corresponding to the third position according to the display mode.

4. The virtual component display method based on mixed reality according to claim 3, characterized in that, The offset angle of the second terminal device relative to the horizontal plane is measured by the first locator.

5. The virtual component display method based on mixed reality according to claim 3 or 4, characterized in that, The distance from the target object to the second terminal device is measured by the ranging component in the second terminal device.

6. A virtual component display device based on mixed reality, characterized in that, The device is applied to a first terminal device and includes: The first acquisition module is used to acquire the first position corresponding to the first locator; the first locator is a lighthouse laser locator; the first position is obtained by locating the first locator with a second locator; the second locator is a total station. The second acquisition module is used to acquire, when the first locator sequentially sends out the first signal, the second signal, and the third signal, the first acquisition time when each of the multiple sensors of the first terminal device acquires the first acquisition time of the first signal, the second acquisition time when the second signal is acquired, and the third acquisition time when the third signal is acquired, respectively. The first signal is a synchronization signal, and the second signal and the third signal are scanning signals of different axes sent out by the first locator. The third acquisition module is used to acquire the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator; A determining module is configured to determine a second position of the first terminal device based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, the angular velocity, and the distance from each sensor to the first locator; the determination of the second position of the first terminal device based on the first position, all first acquisition times, all second acquisition times, all third acquisition times, the angular velocity, and the distance from each sensor to the first locator includes: determining the offset angle of the first sensor relative to the first locator based on the first acquisition time corresponding to the first sensor, the second acquisition time corresponding to the first sensor, the third acquisition time corresponding to the first sensor, and the angular velocity, wherein the first sensor is any one of a plurality of sensors included in the first terminal device; determining the position corresponding to the first sensor based on the first position, the offset angle of the first sensor relative to the first locator, and the distance from the first sensor to the first locator; and determining the second position of the first terminal device based on the position corresponding to each sensor. The processing module is used to obtain all virtual components contained within a preset range of the second location, and to render and display all the virtual components; according to the first location, it accesses the BIM lightweight engine server to retrieve all virtual components contained within the preset range of the second location, renders the virtual components, and displays all the rendered virtual components on the first terminal device.

7. A virtual component display device based on mixed reality, characterized in that, The device is applied to a second terminal device and includes: The first acquisition module is used to acquire the first position corresponding to the first locator; the first locator is a lighthouse laser locator; the first position is obtained by locating the first locator with a second locator; the second locator is a total station. The second acquisition module is used to acquire the first acquisition time, the second acquisition time, and the third acquisition time of each of the multiple sensors of the first terminal device when the first locator sequentially sends out the first signal, the second signal, and the third signal, respectively. The first signal is a synchronization signal, and the second signal and the third signal are scanning signals of different axes sent by the first locator. The third acquisition module is used to acquire the angular velocity corresponding to the scanning signal, and the distance from each sensor to the first locator; The first determining module is used to determine the second position of the second terminal device based on the first position, all the first acquisition times, all the second acquisition times, all the third acquisition times, the angular velocity, and the distance from each sensor to the first locator. The fourth acquisition module is used to acquire the offset angle of the second terminal device relative to the horizontal plane and the distance from the target object indicated by the second terminal device to the second terminal device; The second determining module is used to determine a third position corresponding to the target object based on the second position, the offset angle, and the distance from the target object to the second terminal device; The sending module is used to send the third position and the pre-selected display mode to the first terminal device, so that the first terminal device displays the virtual component corresponding to the third position according to the display mode.

8. A computer device, characterized in that, include: The system includes a memory and a processor, which are communicatively connected to each other. The memory is used to store a computer program. When the computer program is executed by the processor of a first terminal device, the processor performs the virtual component display method based on mixed reality as described in any one of claims 1-3. Alternatively, when the computer program is executed by the processor of a second terminal device, the processor performs the virtual component display method based on mixed reality as described in any one of claims 3-5.

Images