Screen projection method and system, three-dimensional scanning device and storage medium

Abstract

The present disclosure provides a screen projection method and system, a three-dimensional scanning device and a storage medium. The method is applied to the three-dimensional scanning device, the three-dimensional scanning device comprising a plurality of modules; the plurality of modules at least comprise a main control module and at least one functional sub-module, different modules being corresponding to different display content, and each module having at least one piece of display content. The method comprises: receiving configuration information input by a user for a three-dimensional scanning device; in response to the configuration information, splicing at least two pieces of display content to obtain spliced display content; and sending the spliced display content to a display device. The screen projection method in the embodiments of the present application can flexibly customize display content output by the main control module and the functional sub-modules, splice the customized display content, and display the spliced display content on the display device, such that a plurality of pieces of display content can be displayed more visually, and there is no need for users to switch between display content, thus significantly improving three-dimensional reconstruction efficiency.

Description

Screen projection method and system, three-dimensional scanning device and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411337854.9, filed on September 24, 2024 in the China Patent Office and entitled "Screen projection method and system, three-dimensional scanning device and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of data screen projection, in particular to a screen projection method, system, three-dimensional scanning device and storage medium. BACKGROUND

[0003] Currently, portable three-dimensional scanning devices adopt integrated design, and scanning, reconstruction, rendering, display and post-processing are integrated. The scanning device has an intuitive scanning interface, and the whole scanning process can be completed without the need for external devices such as computers or mobile phones and tablets. The user can operate the scanning software on the touch display screen of the scanning device to realize model scanning, complete model fusion, meshing and editing operations, and export scanning data.

[0004] In addition, the portable three-dimensional scanning device supports screen projection display, and the display content of the display screen can be transmitted to the screen projection end (i.e. the display device), and the screen projection end displays the display content after receiving the screen projection signal.

[0005] Currently, the main interface display content of the master module (including a three-dimensional reconstruction result presentation area and an operation panel area) is displayed by default on the screen of the portable three-dimensional scanning device, so the main interface display content of the master module is also displayed synchronously on the large screen of the screen projection end. It is very inconvenient for the user to view other interface display content. TECHNICAL PROBLEM

[0006] In order to solve the problem that the three-dimensional scanning device can only display the main interface display content of the master module after screen projection, and the user needs to switch to view other interface display content, resulting in inconvenient operation, the present application provides a screen projection method, system, three-dimensional scanning device and storage medium. TECHNICAL SOLUTION

[0007] A first aspect of the present application provides a screen projection method applied to a three-dimensional scanning device, the three-dimensional scanning device comprising a plurality of modules, the plurality of modules comprising at least a master module and at least one function sub-module, different function sub-modules corresponding to different display content, each of the master module and the function sub-module having at least one display content; the method comprising:

[0008] receive configuration information input by a user for the three-dimensional scanning device, the configuration information indicating that at least two display contents are to be projected to a display device, the at least two display contents being display contents corresponding to a same module or one display content corresponding to different modules respectively;

[0009] in response to the configuration information, splice the at least two display contents to obtain spliced display contents;

[0010] send the spliced display contents to the display device.

[0011] In a possible implementation manner of the first aspect, the response to the configuration information and the splicing of the at least two display contents to obtain spliced display contents includes:

[0012] in response to the configuration information, encode the display contents by the modules corresponding to the at least two display contents respectively to obtain at least two encoded streams;

[0013] decode, by the master module, the at least two encoded streams to obtain each frame of image of the at least two display contents;

[0014] splice, by the master module, each frame of image of the at least two display contents to obtain spliced display contents;

[0015] the sending of the spliced display contents to the display device includes:

[0016] the master module encodes the spliced display contents and sends the encoded spliced display contents to the display device.

[0017] In a possible implementation manner of the first aspect, the configuration information further includes sizes and positions or offsets of the at least two display contents.

[0018] the splicing of the at least two display contents to obtain spliced display contents includes:

[0019] in accordance with the sizes and positions or offsets of the at least two display contents, splice each frame of image of the at least two display contents to obtain spliced display contents.

[0020] In a possible implementation manner of the first aspect, before the sending of the spliced display contents to the display device, the method further includes:

[0021] perform first processing on the spliced display contents, the first processing including at least one of adding a layer, adding a watermark, and dividing a region of interest.

[0022] In a possible implementation manner of the first aspect, the three-dimensional scanning device and the display device are located in the same local area network, and the three-dimensional scanning device and the display device are connected through a wireless connection or a wired connection.

[0023] In a possible implementation manner of the first aspect, the master module and the at least one functional submodule are in a star topology.

[0024] In a possible implementation manner of the first aspect, the at least two display contents are two or more of original image acquisition result presentation content, point cloud generation result presentation content, three-dimensional reconstruction result presentation content, program running log presentation content, parameter setting content, preprocessing content, material mapping presentation content, post-processing and optimization content, and user guide and help content.

[0025] The second aspect of the embodiments of the present disclosure provides a three-dimensional scanning device, comprising a receiving module, a master module, at least one functional submodule, and a communication module; different master modules and functional submodules correspond to different display contents, and each master module and functional submodule has at least one display content;

[0026] The receiving module is configured to receive configuration information input by a user for the three-dimensional scanning device, the configuration information indicating that at least two display contents are projected to a display device, the at least two display contents being display contents corresponding to a same master module or functional submodule, or the at least two display contents being one display content corresponding to different master modules and / or functional submodules respectively;

[0027] The master module is configured to splice the at least two display contents to obtain spliced display contents in response to the configuration information.

[0028] The communication module is configured to send the spliced display contents to the display device.

[0029] The third aspect of the embodiments of the present disclosure provides a projection system, comprising a display device and a three-dimensional scanning device as described in the second aspect.

[0030] The fourth aspect of the embodiments of the present disclosure provides a projection device, comprising:

[0031] The receiving module is configured to receive configuration information input by a user for a three-dimensional scanning device, the configuration information indicating that at least two display contents are projected to a display device, the at least two display contents being the display contents corresponding to a same master module or functional submodule, or the at least two display contents being one display content corresponding to different master modules and / or functional submodules respectively, different master modules and functional submodules corresponding to different display contents, each of the master modules and functional submodules having at least one display content;

[0032] The master module is configured to splice the at least two display contents to obtain spliced display contents in response to the configuration information.

[0033] The communication module is configured to send the spliced display contents to the display device.

[0034] A fifth aspect of the embodiments of the present disclosure provides a computer readable storage medium, the computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the screen projection method in any one of the first aspect.

[0035] A sixth aspect of the embodiments of the present disclosure provides a computer program product, when the computer program product runs on a three-dimensional scanning device, the computer program product causes the three-dimensional scanning device to perform the screen projection method in any one of the first aspect. Advantages

[0036] Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have the following advantages:

[0037] The screen projection method provided by the embodiments of the present disclosure can flexibly customize the display contents output by the master module and the functional submodule, splice the customized display contents, and display the spliced display contents on the display device, so that multiple display contents can be displayed more intuitively, and the user does not need to switch between the display contents, thereby significantly improving the three-dimensional reconstruction efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments or exemplary technical descriptions. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0039] FIG. 1 is a flowchart of a screen projection method according to an embodiment of the present application;

[0040] FIG. 2 is a schematic diagram of a three-dimensional scanning device according to an embodiment of the present application;

[0041] FIG. 3 is a schematic diagram of a display device displaying spliced display content according to an embodiment of the present application;

[0042] FIG. 4 is a structural schematic diagram of a three-dimensional scanning device according to an embodiment of the present application;

[0043] FIG. 5 is a structural schematic diagram of a screen projection system according to an embodiment of the present application;

[0044] FIG. 6 is a structural schematic diagram of a screen projection device according to an embodiment of the present application. Embodiments of the present application

[0045] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the schemes of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0046] In the following description, many specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure can also be implemented in other different manners than those described herein; obviously, the embodiments described in the specification are only a part of the embodiments of the present disclosure, and not all the embodiments.

[0047] FIG. 1 shows a schematic flowchart of a screen projection method according to an embodiment of the present application, which can be applied to a three-dimensional scanning device including a plurality of modules, at least including a master module and at least one functional sub-module, different modules corresponding to different display content, and each module having at least one display content.

[0048] FIG. 2 is a schematic diagram of the working principle of a three-dimensional scanning device according to an embodiment of the present application. A structured light projector 220 projects structured light onto the surface of a measured object to form a sinusoidal grating fringe image 230. A plurality of cameras 210 simultaneously collect the sinusoidal grating fringe image 230 of the surface of the measured object and send the sinusoidal grating fringe image 230 as input data to an algorithm module. The algorithm goes through steps such as depth calculation, single-point cloud generation, point cloud splicing and fusion optimization, texture information processing, post-processing, and finally displays a three-dimensional model. In the process of three-dimensional reconstruction, many display contents will be involved. Projecting the plurality of display contents of interest onto a display device will help to visually display the three-dimensional reconstruction process and timely detect errors in the three-dimensional reconstruction process, thereby improving the efficiency of three-dimensional reconstruction. It should be noted that in the present embodiment, the structured light projector 220 projects sinusoidal grating fringes, but in actual use, other projectors can be selected as needed, such as a laser line projector, a speckle projector, etc., which are not limited in the present embodiment.

[0049] The main control module refers to a main control SoC (System on Chips) and peripheral circuit running an embedded Linux or Android system, responsible for completing data processing and transmission, system control and management, scanning control and optimization, and other functions of the three-dimensional scanning device; the main control module is directly connected with a communication module (such as a WiFi module) and a display screen (preferably a touch display screen), and is directly or indirectly connected with a functional sub-module.

[0050] The functional sub-module refers to a functional module in the three-dimensional scanning device that can view its working state in a text, image or video manner during data input, intermediate data processing and data output, such as an image acquisition module, a point cloud processing module, a parameter configuration module, a data preprocessing module, a material mapping module, a post-processing and optimization module, a user guide and help module, and the like. The three-dimensional scanning device can be expanded according to needs. Other modules that do not appear on the interface, such as a motor motion control module that does not involve data input and output, are not discussed in the embodiments of the present application.

[0051] The display content refers to content used by the main control module and the functional sub-module to show itself in the process of data input, intermediate data processing or data output, which can be viewed in a text, image or video manner, and can be display content of a main interface, display content of an extended interface or display content of a virtual interface. The main interface can be understood as a default display interface; the extended interface can be understood as an interface in which the main control module or the functional sub-module displays different display content on different extended displays; and the virtual interface can be understood as a technology in which the main control module or the functional sub-module hosts display content on a remote server, and the user can view the interface through the Internet or a local area network.

[0052] Different function sub-modules correspond to different display contents, that is, there is a mapping relationship between the function sub-modules and the display contents. Each function sub-module has at least one display content, for example: the image acquisition module is used to output the original image acquisition result presentation content, specifically through the camera or laser sensor in the three-dimensional scanning device, the original image or point cloud data of the measured object is photographed. The point cloud processing module is used to output the point cloud generation result presentation content, specifically the depth image can be calculated as point cloud data after point cloud transformation. The parameter configuration module is used to output the parameter setting content, specifically to provide the display content of the user setting the required parameters in the scanning and reconstruction process, the user can adjust the scanning speed, resolution, lighting conditions and other parameters according to the characteristics and needs of the measured object, to obtain the best scanning and reconstruction effect. The data preprocessing module is used to output the preprocessing content, specifically to perform denoising, filtering, registration and other preprocessing operations on the original scanning data to improve the accuracy and efficiency of subsequent three-dimensional reconstruction; this display content provides a series of preprocessing tools, which can be selected and used by the user as needed. The material mapping module is used to output the material mapping presentation content, specifically the three-dimensional scanning device captures the surface color or texture information of the measured object, and this module will be responsible for mapping these information to the three-dimensional model, making the model more realistic; this display content provides material mapping, texture mapping and other tools, which can be set and adjusted by the user as needed. The post-processing and optimization module is used to output the post-processing and optimization content, specifically to perform further optimization processing on the three-dimensional reconstruction result, such as smoothing processing, mesh optimization, hole filling, etc., to improve the quality and visual effect of the model; this display content provides a series of post-processing tools, which can be selected and used by the user as needed. The user guide and help module is used to output the user guide and help content, specifically to provide operation instructions, frequently asked questions, video tutorials and other resources to help users quickly get started and solve problems encountered in the use process; this display content is an important way for users to obtain help and support.

[0053] The main control module has at least one display content. The main control module in the embodiment of the application can output point cloud generation result presentation content, the main control module performs three-dimensional reconstruction based on point cloud data through an algorithm to generate a three-dimensional model of the measured object; this display content shows the final three-dimensional reconstruction result, and the user can view the shape, details, etc. of the model from it. The main control module in the embodiment of the application can also output program running log presentation content, the main control module records and displays various operation, parameter setting, error prompt, etc. log information in the scanning and reconstruction process; this display content helps the user to understand the running state of the program, diagnose problems and debug.

[0054] The screen projection method of the embodiment of the application specifically includes the following steps:

[0055] S110: receive configuration information input by a user for the three-dimensional scanning device, the configuration information indicating that at least two display contents are to be projected to the display device, the at least two display contents being display contents corresponding to a same module or the at least two display contents being one display content corresponding to different modules respectively.

[0056] The configuration information refers to options corresponding to the at least two display contents that need to be projected, which are selected in advance on the three-dimensional scanning device according to the needs of the user, i.e., a combination of display content options that the user is interested in.

[0057] For example, the user wants to display three-dimensional reconstruction result presentation content, original image acquisition result presentation content, point cloud generation result presentation content, and program running log presentation content in the display device at the same time, and the user can select options corresponding to the display content of interest through physical keys or a touch display screen in the three-dimensional scanning device, and can select a combination of display content options of interest by sliding and clicking the touch display screen. It should be noted that the three-dimensional reconstruction result presentation content exists in the form of a video, and the option corresponding to the three-dimensional reconstruction result presentation content can exist in the form of an icon or the following text: "three-dimensional reconstruction result presentation".

[0058] S120: in response to the configuration information, splice the at least two display contents to obtain spliced display content.

[0059] For example, the configuration information includes options corresponding to three-dimensional reconstruction result presentation content, original image acquisition result presentation content, point cloud generation result presentation content, and program running log presentation content, and the main control module splices the four display contents to obtain spliced display content that can simultaneously display the four display contents.

[0060] S130: send the spliced display content to the display device.

[0061] The spliced display content is sent to the display device to make the display device display the spliced display content. The display device can be a television, a computer, or other large display screen device.

[0062] It should be noted that the display device and the display screen of the three-dimensional scanning device can display the same content, i.e., if the spliced display content displayed on the display device has four display contents, the display screen of the three-dimensional scanning device also displays four display contents. However, considering that the display screen of the three-dimensional scanning device is small, the display screen of the display device can display the spliced display content, and the display screen of the three-dimensional scanning device still displays the main interface of the main control module, which includes a three-dimensional reconstruction result presentation content area and an operation panel area.

[0063] Fig. 3 shows a schematic diagram of a display device displaying spliced display content, in which the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content can be simultaneously observed.

[0064] In Fig. 3, the original image acquisition result presentation content displays the original image of the measured object, which helps the user to confirm whether the scanning object is correctly and completely captured, and to check whether there are problems such as occlusion, reflection, and the like that may affect the scanning quality. Thus, the transparency of the reconstruction process is improved.

[0065] In Fig. 3, the point cloud generation result presentation content shows the point cloud data, which is the basis of three-dimensional reconstruction and directly reflects the density, accuracy, and completeness of the scanning data. Real-time viewing of the point cloud generation can timely discover data missing or noise problems in the scanning process, providing an important reference for subsequent three-dimensional reconstruction.

[0066] In Fig. 3, the three-dimensional reconstruction result presentation content directly displays the final three-dimensional model, allowing the user to intuitively evaluate the reconstruction effect. At the same time, in combination with the results of original image acquisition and point cloud generation, it can be easier to locate and diagnose possible problems in three-dimensional reconstruction, such as surface smoothing and geometric deformation.

[0067] In Fig. 3, the program running log presentation content records every step of operation, parameter setting, and possible error or warning information in the scanning and reconstruction process, which is crucial for problem tracing, solving, and performance optimization, especially when dealing with complex or large objects. Thus, the problem diagnosis and solving capability is enhanced.

[0068] As can be seen from the above, Fig. 3 can simultaneously display the original image acquisition, point cloud generation, three-dimensional reconstruction, and program running log, thereby improving the transparency of the reconstruction process, enhancing the problem diagnosis and solving capability, and improving the three-dimensional reconstruction efficiency.

[0069] It is easy to understand that when the user selects other combinations of display content options of interest, similar effects such as improving the three-dimensional reconstruction efficiency can also be achieved. For example, the combination of display content options of interest of the user also includes options corresponding to user guide and help content. Since the user guide and help content allow the user to view the user guide and help manual while scanning for the first time, the user does not need to frequently switch display content, thereby achieving the effect of improving the three-dimensional reconstruction efficiency.

[0070] The screen projection method of the embodiments of the present application can flexibly customize the display content output by the master module and the functional sub-modules, splice the customized display content, and display the spliced display content on the display device, thereby more intuitively displaying multiple display content, and the user no longer needs to switch between display content, significantly improving the three-dimensional reconstruction efficiency.

[0071] As an optional implementation, the three-dimensional scanning device and the display device are connected in a wireless manner. In the wireless connection manner, S120: in response to the configuration information, splicing at least two display contents to obtain spliced display contents, specifically including the following steps:

[0072] S121: in response to the configuration information, encoding the display contents through the modules corresponding to the at least two display contents to obtain at least two encoded streams.

[0073] According to the configuration information, the options corresponding to the at least two display contents selected by the user (i.e., the display content option combination of interest of the user) can be obtained. Since there is a mapping relationship between the master module and the display content, and between the function sub-module and the display content, the master module and / or the function sub-module corresponding to the display content option combination of interest can be determined. The display content option combination of interest can be the options corresponding to all the display contents output from the master module, the options corresponding to all the display contents output from the function sub-module, or the options corresponding to the display contents output from the master module and the function sub-module.

[0074] For example, according to the configuration information, it is known that the display content option combination of interest includes the options corresponding to the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content. Since the three-dimensional reconstruction result presentation content and the program running log presentation content are output from the master module, the original image acquisition result presentation content is output from the image acquisition module, and the point cloud generation result presentation content is output from the point cloud processing module, the master module and the function sub-module corresponding to the display content option combination of interest are obtained. The master module continuously encodes the three-dimensional reconstruction result presentation content and the program running log presentation content output, the point cloud processing module continuously encodes the point cloud generation result presentation content output, the image acquisition module continuously encodes the original image acquisition result presentation content output, and four encoded streams are formed and sent to the master module.

[0075] S122: decoding the at least two encoded streams through the master module to obtain each frame of image of the at least two display contents.

[0076] For example, the master module obtains the above-mentioned four encoded streams, decodes the four encoded streams, and obtains each frame of image of the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content.

[0077] S123: splicing each frame of image of the at least two display contents through the master module to obtain spliced display contents.

[0078] The master module splices each frame of image of the four display contents to obtain the spliced display content.

[0079] Meanwhile, S130: sending the spliced display content to the display device, including:

[0080] S131: the master module encodes the spliced display content and sends the encoded spliced display content to the display device.

[0081] The master module encodes the spliced display content and sends it to the display device, the display device receives the screen projection data and decodes the spliced display content, so that the interface of the display device synchronously displays the four display contents.

[0082] The master module and / or the functional sub-module are encoded respectively, then the master module decodes and splices, and then the spliced display content is encoded again and sent to the display device, so as to realize the wireless screen projection between the three-dimensional projection device and the display device.

[0083] Optionally, the three-dimensional projection device and the display device are connected through WiFi and located in the same local area network. The screen projection device and the display device support WiFi Display technology to realize screen projection.

[0084] WiFi Display mode: the connection process is divided into two parts: P2P stage and RTSP (Real Time Streaming Protocol, Real-time Streaming Protocol) stage. P2P stage: the screen projection device (i.e. three-dimensional scanning device) sends WiFi Display broadcast, and the P2P device (i.e. display device) actively scans to discover other devices nearby, so that the P2P device can be in the same channel to discover each other and exchange device information. RTSP stage: WiFi Display exchanges the capabilities of both sides through RTSP protocol to establish RTSP session and transmit image data between the two ends of the connection.

[0085] As an optional implementation, S130: before sending the spliced display content to the display device, further includes:

[0086] S140: detecting whether the three-dimensional scanning device and the display device are located in the same local area network; the sending of the spliced display content to the display device is performed when the three-dimensional scanning device and the display device are located in the same local area network.

[0087] When the three-dimensional projection device and the display device are wirelessly screen projected, it is necessary to ensure that they are located in the same local area network, so it is necessary to detect whether they are in the same local area network.

[0088] As an optional implementation, the three-dimensional scanning device and the display device are connected by a wired connection. In the wired connection, the three-dimensional scanning device and the display device support the same video format and transmission protocol, and the video stream does not need to be transmitted through a network (such as a wired connection through an HDMI (High Definition Multimedia Interface), a VGA (Video Graphics Array) interface, etc.).

[0089] As an optional implementation, the configuration information further includes sizes and positions or offsets of the at least two display contents. In S120, the at least two display contents are spliced to obtain the spliced display content, including:

[0090] S125: Splice each frame of image of the at least two display contents according to the sizes and positions or offsets of the at least two display contents to obtain the spliced display content.

[0091] Specifically, according to the sizes or positions of the at least two display contents, each frame of image of the at least two display contents can be spliced to obtain the spliced display content; or, according to the sizes and offsets of the at least two display contents, each frame of image of the at least two display contents can be spliced to obtain the spliced display content.

[0092] For example, as shown in FIG. 3, the positions of the display contents are that the three-dimensional reconstruction result presentation content is located at the lower left corner, the original image acquisition result presentation content is located at the upper left corner, the point cloud generation result presentation content is located at the upper right corner, and the program running log presentation content is located at the lower right corner. The sizes of the display contents are that the display screen of the display device is divided into four regions of equal or unequal sizes according to user preferences. The offsets of the display contents are that the upper left corner of the display screen of the display device is taken as the origin coordinate, and assuming that the region of the original image acquisition result presentation content has a width w and a height h, the offset of the point cloud generation result presentation content is (w, 0), the offset of the three-dimensional reconstruction result presentation content is (0, h), and the offset of the program running log presentation content is (w, h). It should be noted that the lower left corner of each display content in each region in FIG. 3 is only illustrative, and in practice, each display content should cover the respective region as much as possible.

[0093] As an optional implementation, S130: before the spliced display content is sent to the display device, further includes:

[0094] S150: performing first processing on the spliced display content, the first processing including at least one of adding a layer, adding a watermark, and dividing a region of interest.

[0095] By performing the first processing on the spliced display content, more information can be displayed.

[0096] As an optional implementation, the master module and the at least one functional submodule are in a star topology. The star topology has one center and multiple branches. The star topology is simple in structure, convenient in connection, relatively easy in management and maintenance, and strong in scalability.

[0097] It should be understood that the size of the serial number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0098] FIG. 4 shows a structural schematic diagram of a three-dimensional scanning device disclosed by an embodiment of the present application, which includes a receiving module 410, a master module 420, at least one functional submodule 430, and a communication module 440. Different functional submodules 430 correspond to different display contents, and each master module 420 and functional submodule 430 has at least one display content.

[0099] The receiving module 410 is configured to receive configuration information input by a user for the three-dimensional scanning device, and the configuration information indicates that at least two display contents are projected into a display device. The at least two display contents are display contents corresponding to the same master module 420 or functional submodule 430, or the at least two display contents are one display content corresponding to different master modules 420 and / or functional submodules 430 respectively.

[0100] The master module 420 is configured to splice the at least two display contents to obtain spliced display contents in response to the configuration information.

[0101] The communication module 440 is configured to send the spliced display contents to the display device.

[0102] Further, the three-dimensional scanning device further includes a display screen 450, and preferably, the display screen 450 is a touch display screen.

[0103] The functional submodules and the master module of the three-dimensional scanning device are connected in a network communication mode, and the network connection between the master module and the functional submodules is in a star topology, so that the functional submodules are conveniently expanded.

[0104] FIG. 5 shows a projection system disclosed by an embodiment of the present application, which includes a display device 510 and the three-dimensional scanning device 520 of the above embodiment. The display device 510 has a larger display screen than the three-dimensional scanning device 520, so as to dynamically configure the display contents according to the configuration information.

[0105] Corresponding to the screen projection method described in the above embodiments, FIG. 6 shows a structural block diagram of a screen projection device provided by the embodiments of the present application. For ease of illustration, only the parts related to the embodiments of the present application are shown.

[0106] Referring to FIG. 6, the device includes:

[0107] The receiving module 610 is configured to receive configuration information input by a user for a three-dimensional scanning device, the configuration information indicating that at least two display contents are projected into a display device, the at least two display contents being display contents corresponding to a same master module or functional submodule, or the at least two display contents being one display content corresponding to a different master module 620 and / or functional submodule respectively; the different master modules and functional submodules correspond to different display contents, and each master module 620 and functional submodule has at least one display content.

[0108] The master module 620 is configured to splice the at least two display contents to obtain spliced display contents in response to the configuration information.

[0109] The communication module 630 is configured to send the spliced display contents to the display device.

[0110] It should be noted that the information interaction, execution process, and the like between the above devices / units are based on the same concept as the method embodiments of the present application, and the specific functions and the technical effects brought by the same can be referred to the method embodiments part for details, which will not be described herein again.

[0111] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is exemplified, and in actual applications, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of software functional unit. In addition, the specific names of the functional units and modules are only for easy distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the system can be referred to the corresponding process in the foregoing method embodiments, which will not be described herein again.

[0112] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps in each of the above method embodiments.

[0113] The embodiment of the present application provides a computer program product, when the computer program product runs on the three-dimensional scanning device, so that the mobile terminal executes the steps in the above-mentioned various method embodiments.

[0114] The integrated unit, if in the form of a software function unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on such understanding, the present application can implement all or part of the processes in the above-mentioned embodiment methods, which can be completed by instructing related hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps in the above-mentioned various method embodiments when executed by a processor. The computer program includes computer program code, which can be in the form of source code, object code, an executable file, or some intermediate form. The computer-readable medium at least includes any entity or device capable of carrying the computer program code to the three-dimensional scanning device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. For example, a U disk, a mobile hard disk, a magnetic disk or an optical disk, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium cannot be an electrical carrier signal and a telecommunications signal.

[0115] The program code contained in the computer-readable medium can be transmitted by any appropriate medium, including but not limited to wireless, wire, optical cable, RF, etc., or any appropriate combination of the above.

[0116] The computer program code for executing the operation of the embodiment of the present application can be written in one or more programming languages or combinations thereof, including object-oriented programming languages such as Python, Java, Smalltalk, C++, and conventional procedural programming languages such as "C" language or similar programming languages. The program code can be completely executed on a user computer, partially executed on a user computer, executed as an independent software package, partially executed on a user computer and partially executed on a remote computer, or completely executed on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, connected through the Internet by using an Internet service provider).

[0117] In the above embodiments, the description of each embodiment focuses on different aspects, and the parts not described or recorded in a certain embodiment can be referred to the relevant description of other embodiments.

[0118] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solutions. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0119] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / three-dimensional scanning device and method can be implemented in other ways. For example, the apparatus / three-dimensional scanning device embodiments described above are merely schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed units can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0120] The units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0121] The above-described embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalents; and these modifications or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Industrial applicability

[0122] The scheme provided by the embodiment of the application can be applied to a three-dimensional scanning device. The three-dimensional scanning device comprises a plurality of modules. The plurality of modules comprise at least a master control module and at least one functional sub-module. Different modules correspond to different display contents, and each module has at least one display content. The method comprises: receiving configuration information input by a user for the three-dimensional scanning device; in response to the configuration information, splicing at least two display contents to obtain spliced display contents; and sending the spliced display contents to a display device. The screen projection method of the embodiment of the application can flexibly customize the display contents output by the master control module and the functional sub-module, splice the customized display contents, and display the spliced display contents on the display device, so that the plurality of display contents can be displayed more intuitively, the user does not need to switch between the display contents, and the three-dimensional reconstruction efficiency is significantly improved.

Claims

1. A screen projection method, comprising: The application is applied to a three-dimensional scanning device, the three-dimensional scanning device comprises a plurality of modules, the plurality of modules at least comprise a master module and at least one functional sub-module, different modules correspond to different display contents, and each module has at least one display content; the method comprises: Receiving configuration information input by a user for the three-dimensional scanning device, the configuration information indicating that at least two display contents are projected into a display device, the at least two display contents are display contents corresponding to the same module, or at least two display contents are one display content corresponding to different modules respectively; In response to the configuration information, splicing the at least two display contents to obtain spliced display contents; Sending the spliced display contents to the display device. 2.The screen projection method of claim 1, wherein, The response to the configuration information, splicing the at least two display contents to obtain spliced display contents, comprises: In response to the configuration information, encoding the display contents through the modules corresponding to the at least two display contents to obtain at least two encoding streams; Decoding the at least two encoding streams through the master module to obtain each frame of image of the at least two display contents; Splicing each frame of image of the at least two display contents through the master module to obtain spliced display contents; The sending of the spliced display contents to the display device comprises: The master module encodes the spliced display contents, and sends the encoded spliced display contents to the display device. 3.The screen projection method of claim 2, wherein, The configuration information further comprises sizes and positions or offsets of the at least two display contents; Splicing the at least two display contents to obtain spliced display contents comprises: According to the sizes and positions or offsets of the at least two display contents, splicing each frame of image of the at least two display contents to obtain spliced display contents. 4.The screen projection method of claim 1, wherein, Before the sending of the spliced display contents to the display device, further comprising: Performing first processing on the spliced display contents, the first processing comprising at least one of adding a layer, adding a watermark, and dividing a region of interest. 5.The method of claim 1, wherein, The three-dimensional scanning device and the display device are located in the same local area network, and the three-dimensional scanning device and the display device are connected through wireless connection or wired connection. 6.The method of claim 1, wherein, The master module and the at least one functional sub-module are in a star topology.

7. The screen projection method of any one of claims 1-6, wherein, The at least two display contents are at least two of original image acquisition result presentation content, point cloud generation result presentation content, three-dimensional reconstruction result presentation content, program running log presentation content, parameter setting content, preprocessing content, material mapping presentation content, post-processing and optimization content, and user guide and help content.

8. A three-dimensional scanning device, wherein, Comprise a receiving module, a master module, at least one functional sub-module, and a communication module; different master modules and functional sub-modules correspond to different display contents, and each master module and functional sub-module has at least one display content; The receiving module is configured to receive configuration information input by a user for the three-dimensional scanning device, the configuration information indicating that at least two display contents are projected to a display device, the at least two display contents being display contents corresponding to the same master module or functional sub-module, or the at least two display contents being one display content corresponding to different master modules and / or functional sub-modules respectively; The master module is configured to splice the at least two display contents to obtain spliced display contents in response to the configuration information. The communication module is configured to send the spliced display contents to the display device.

9. A screen projection system, wherein, The three-dimensional scanning device comprises: The display device and the three-dimensional scanning device of claim 8.

10. A computer-readable storage medium storing a computer program, wherein, The computer program is executed by a processor to implement the method of any one of claims 1 to 7.

Images