Screen projection method and system, three-dimensional scanning equipment and storage medium

Abstract

The invention provides a screen projection method and system, a three-dimensional scanning device and a storage medium, the method is applied to the three-dimensional scanning device, the three-dimensional scanning device comprises a plurality of modules, the plurality of modules at least comprise a main control module and at least one function sub-module, different modules correspond to different display contents, and each module has at least one display content; the method comprises the following steps: receiving configuration information input by a user for the three-dimensional scanning equipment; in response to the configuration information, splicing the at least two display contents to obtain a spliced display content; and sending the tiled display content to a display device. According to the screen projection method provided by the embodiment of the invention, the display contents output by the main control module and the function sub-module can be flexibly customized, the customized display contents are spliced, and the spliced display contents are displayed on the display equipment, so that a plurality of display contents can be displayed more intuitively, a user does not need to switch among the display contents, and the user experience is improved. And the three-dimensional reconstruction efficiency is obviously improved.

Description

Technical Field

[0001] The present application belongs to the field of data screen projection technology, and in particular, relates to a screen projection method, system, three-dimensional scanning device and storage medium. Background Art

[0002] At present, portable 3D scanning equipment adopts an integrated design, integrating scanning, reconstruction, rendering, display and post-processing. It has an intuitive scanning interface, and can complete the entire scanning process without external devices such as computers or mobile phones and tablets. What you see is what you get. Users can operate the scanning software on the touch screen of the scanning device to scan the model, complete the fusion, meshing and editing of the model, and export the scanning data.

[0003] In addition, the portable three-dimensional scanning device supports screen projection display, and can transmit the display content of the display screen to the projected end (ie, the display device), and the projected end displays the display content after receiving the projection signal.

[0004] Currently, the main interface display content of the main control module (including the 3D reconstruction result presentation area, the operation panel area, etc.) is displayed on the screen of the portable 3D scanning device by default. Therefore, the large screen on the projected end only displays the main interface display content of the main control module synchronously. If the user wants to view other interface content, it is very inconvenient. Summary of the invention

[0005] The embodiments of the present application provide a screen projection method, system, three-dimensional scanning device and storage medium, which can solve the problem that the current three-dimensional scanning device can only display the main interface display content of the main control module after screen projection. If the user wants to see the display content of other interfaces, he needs to switch, which makes the operation very inconvenient.

[0006] In a first aspect, an embodiment of the present application provides a screen projection method, which is applied to a three-dimensional scanning device, wherein the three-dimensional scanning device includes multiple modules, wherein the multiple modules include at least a main control module and at least one functional sub-module, and different functional sub-modules correspond to different display contents, and each of the main control module and the functional sub-module has at least one display content; the method includes:

[0007] receiving configuration information input by a user for the three-dimensional scanning device, wherein the configuration information indicates that at least two display contents are projected onto a display device, wherein the at least two display contents are display contents corresponding to the same module, or the at least two display contents are display contents corresponding to different modules respectively;

[0008] In response to the configuration information, splicing the at least two display contents to obtain spliced ​​display content;

[0009] The spliced ​​display content is sent to a display device.

[0010] In a possible implementation manner of the first aspect, in response to the configuration information, splicing the at least two display contents to obtain spliced ​​display content includes:

[0011] In response to the configuration information, encoding the display content by the modules respectively corresponding to the at least two display contents to obtain at least two coded streams;

[0012] Decoding the at least two coded streams by the main control module to obtain each frame image of the at least two display contents;

[0013] splicing each frame image of the at least two display contents through the main control module to obtain spliced ​​display contents;

[0014] The sending the spliced ​​display content to a display device includes:

[0015] The main control module encodes the spliced ​​display content, and sends the encoded spliced ​​display content to a display device.

[0016] In a possible implementation manner of the first aspect, the configuration information further includes sizes and positions or offsets of the at least two display contents;

[0017] The at least two display contents are spliced ​​to obtain spliced ​​display content, comprising:

[0018] Each frame image of the at least two display contents is spliced ​​according to the size and position or offset of the at least two display contents to obtain the spliced ​​display content.

[0019] In a possible implementation manner of the first aspect, before sending the spliced ​​display content to a display device, the method further includes:

[0020] The spliced ​​display content is subjected to a first processing, wherein the first processing includes at least one of adding a layer, adding a watermark, and dividing an area of ​​interest.

[0021] In a possible implementation manner of the first aspect, the three-dimensional scanning device and the display device are located in the same local area network, and the three-dimensional scanning device and the display device are connected wirelessly or by wire.

[0022] In a possible implementation manner of the first aspect, the main control module and at least one functional sub-module are in a star topology structure.

[0023] In a possible implementation of the first aspect, the at least two display contents are two or more of the original image acquisition result presentation content, the point cloud generation result presentation content, the three-dimensional reconstruction result presentation content, the program running log presentation content, the parameter setting content, the preprocessing content, the material mapping presentation content, the post-processing and optimization content, and the user guide and help content.

[0024] In a second aspect, an embodiment of the present application provides a three-dimensional scanning device, including a receiving module, a main control module, at least one functional sub-module and a communication module; different main control modules and functional sub-modules correspond to different display contents, and each of the main control module and the functional sub-module has at least one display content;

[0025] The receiving module is used to receive configuration information input by a user for the three-dimensional scanning device, wherein the configuration information indicates that at least two display contents are projected onto the display device, and the at least two display contents are display contents corresponding to the same main control module or functional submodule, or at least two display contents are display contents corresponding to different main control modules and / or functional submodules respectively;

[0026] The main control module is used to splice the at least two display contents in response to the configuration information to obtain spliced ​​display content;

[0027] The communication module is used to send the spliced ​​display content to a display device.

[0028] In a third aspect, an embodiment of the present application provides a screen projection system, comprising: a display device and a three-dimensional scanning device as described in the second aspect.

[0029] In a fourth aspect, an embodiment of the present application provides a screen projection device, including:

[0030] A receiving module, used to receive configuration information input by a user for a three-dimensional scanning device, wherein the configuration information indicates that at least two display contents are projected onto a display device, wherein the at least two display contents are display contents corresponding to the same main control module or functional submodule, or the at least two display contents are display contents corresponding to different main control modules and / or functional submodules; different main control modules and functional submodules correspond to different display contents, and each main control module and functional submodule has at least one display content;

[0031] The main control module is used to splice the at least two display contents in response to the configuration information to obtain spliced ​​display content;

[0032] The communication module is used to send the spliced ​​display content to a display device.

[0033] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the screen projection method described in any one of the first aspects above is implemented.

[0034] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on a three-dimensional scanning device, the three-dimensional scanning device executes the screen projection method described in any one of the first aspects above.

[0035] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0036] The beneficial effect of the embodiment of the present application compared with the prior art is that the screen projection method of the embodiment of the present application can flexibly customize the display content output by the main control module and the functional sub-module, and splice the customized display content, and display the spliced ​​display content on the display device, so that multiple display contents can be displayed more intuitively, and users no longer need to switch between display contents, which significantly improves the efficiency of three-dimensional reconstruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0038] Figure 1 It is a flowchart of a screen projection method provided in an embodiment of the present application;

[0039] Figure 2 It is a schematic diagram of the principle of a three-dimensional scanning device provided in one embodiment of the present application;

[0040] Figure 3 is a schematic diagram of a display device displaying spliced ​​display content provided by an embodiment of the present application;

[0041] Figure 4 is a structural schematic diagram of a three-dimensional scanning device provided in one embodiment of the present application;

[0042] Figure 5 It is a structural schematic diagram of a screen projection system provided in one embodiment of the present application;

[0043] Figure 6 It is a structural schematic diagram of a screen projection device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0044] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0045] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0046] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0047] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0048] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0049] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0050] Figure 1A schematic flow chart of the screen projection method provided in the present application is shown. As an example but not limitation, the method can be applied to a three-dimensional scanning device, which includes multiple modules. The multiple modules include at least a main control module and at least one functional sub-module. Different modules correspond to different display contents, and each module has at least one display content.

[0051] Figure 2 The schematic diagram of the working principle of the three-dimensional scanning device of the embodiment of the present application is as follows: the structured light projector 220 projects the structured light onto the surface of the object to be measured to form a sinusoidal grating fringe image 230; multiple cameras 210 simultaneously collect the sinusoidal grating fringe image 230 of the surface of the object to be measured, and send the sinusoidal grating fringe image 230 as input data to the algorithm module; the algorithm finally displays the three-dimensional model after the steps of depth calculation, single point cloud generation, point cloud splicing fusion optimization, texture information processing, post-processing, etc. In the process of three-dimensional reconstruction, a lot of display content will be involved. Projecting multiple display contents of interest to the display device together will help to intuitively display the three-dimensional reconstruction process and timely discover errors in the three-dimensional reconstruction process, thereby improving the efficiency of three-dimensional reconstruction. It should be noted that in the embodiment of the present application, the sinusoidal grating fringes are projected by the structured light projector 220, but in actual use, other projectors can be selected as needed, such as laser line projectors, speckle projectors, etc., and the embodiment of the present application is not limited here.

[0052] The main control module refers to the main control SoC (System on Chips) and peripheral circuits running the embedded Linux or Android system, which is responsible for completing the data processing and transmission, system control and management, scanning control and optimization and other functions of the 3D scanning equipment; the main control module is directly connected to the communication module (such as WiFi module) and the display screen (preferably a touch display screen), and is directly or indirectly connected to the functional sub-module.

[0053] Functional submodules refer to functional modules in the 3D scanning device whose working status can be viewed through text, images or videos during the process of data input, data intermediate processing and data output, such as image acquisition module, point cloud processing module, parameter configuration module, data preprocessing module, material mapping module, post-processing and optimization module, user guide and help module, etc. The 3D scanning device can expand the functional submodules as needed. Other modules that will not be presented on the interface, such as the motor motion control module that does not involve data input and output, are not within the scope of discussion of the embodiments of this application.

[0054] Display content refers to the content that the main control module and functional sub-module use to display themselves during data input, intermediate data processing or data output, which can be viewed in the form of text, images or videos. It can be the display content of the main interface, the display content of the extended interface or the display content of the virtual interface, among which the main interface can be understood as the default display interface; the extended interface can be understood as the interface in which the main control module or functional sub-module displays different display content on different extended displays; the virtual interface can be understood as the technology in which the main control module or functional sub-module hosts the display content on a remote server, and the user can view it through the Internet or a local area network.

[0055] Different functional submodules correspond to different display contents, that is, there is a mapping relationship between the functional submodule and the display content. Each functional submodule has at least one display content, for example: the image acquisition module is used to output the original image acquisition result presentation content, specifically, the original image or point cloud data of the object to be measured is captured by hardware devices such as cameras or laser sensors in the three-dimensional scanning device. The point cloud processing module is used to output the point cloud generation result presentation content, specifically, the depth image can be calculated as point cloud data after point cloud transformation. The parameter configuration module is used to output parameter setting content, specifically, it provides the user with display content for setting the parameters required in the scanning and reconstruction process. The user can adjust the scanning speed, resolution, lighting conditions and other parameters according to the characteristics and requirements of the object to be measured to obtain the best scanning and reconstruction effect. The data preprocessing module is used to output preprocessing content, specifically, it performs preprocessing operations such as denoising, filtering, and registration on the original scanning data to improve the accuracy and efficiency of subsequent three-dimensional reconstruction; this display content provides a series of preprocessing tools, and users can select and use them as needed. The material mapping module is used to output material mapping presentation content, specifically, the surface color or texture information of the object being measured is captured by the 3D scanning device. This module will be responsible for mapping this information to the 3D model to make the model more realistic; this display content provides tools such as material mapping and texture mapping, and users can set and adjust them as needed. The post-processing and optimization module is used to output post-processing and optimization content, specifically, further optimization of the 3D reconstruction results, such as smoothing, mesh optimization, hole filling, etc., to improve the quality and visual effect of the model; this display content provides a series of post-processing tools, and users can select and use them as needed. The user guide and help module is used to output user guides and help content, specifically, it provides operating instructions, FAQs, video tutorials and other resources to help users quickly get started and solve problems encountered during use; this display content is an important way for users to obtain help and support.

[0056] The main control module has at least one display content. The main control module in the embodiment of the present application can output the point cloud generation result presentation content. The main control module performs three-dimensional reconstruction based on the point cloud data through an algorithm to generate a three-dimensional model of the object being measured; this display content shows the final three-dimensional reconstruction result, from which the user can view the shape, details, etc. of the model. The main control module in the embodiment of the present application can also output the program running log presentation content. The main control module records and displays various operations, parameter settings, error prompts and other log information during the scanning and reconstruction process; this display content helps the user understand the running status of the program, diagnose problems and debug.

[0057] The screen projection method of the embodiment of the present application specifically includes the following steps:

[0058] S110: receiving configuration information input by a user for a three-dimensional scanning device, where the configuration information indicates projecting at least two display contents onto a display device, wherein at least two display contents are display contents corresponding to the same module, or at least two display contents are display contents corresponding to different modules respectively.

[0059] Configuration information refers to the options corresponding to at least two display contents that need to be projected, which are selected in advance on the three-dimensional scanning device according to the needs of the user. The options corresponding to the at least two display contents are the combination of display content options that the user is interested in.

[0060] For example, if the user wants to display the 3D reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content on the display device at the same time, the user can select the options corresponding to the above-mentioned display content of interest through the physical buttons in the 3D scanning device or by touching the display screen, and can select the display content option combination that the user is interested in by sliding and clicking the touch display screen. It should be noted that the 3D reconstruction result presentation content exists in the form of video, and the options corresponding to the 3D reconstruction result presentation content can exist in the form of icons, or in the form of the following text: "3D reconstruction result presentation".

[0061] S120: In response to the configuration information, splice at least two display contents to obtain spliced ​​display content.

[0062] Exemplarily, the configuration information includes options corresponding to the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content. The main control module splices these four display contents to obtain spliced ​​display content that can simultaneously display four display contents.

[0063] S130: Send the spliced ​​display content to a display device.

[0064] The spliced ​​display content is sent to a display device so that the display device displays the spliced ​​display content. The display device can be a large display device such as a television or a computer.

[0065] It should be noted that the display screen of the display device and the 3D scanning device can display the same content, that is, if the spliced ​​display content displayed on the display device has four display contents, the display screen of the 3D scanning device also displays four display contents. However, considering that the display screen of the 3D scanning device is relatively small, the display screen of the display device can display the spliced ​​display content, and the display screen of the 3D scanning device still displays the main interface of the main control module, which includes the 3D reconstruction result presentation content area, the operation panel area, etc.

[0066] Figure 3 A schematic diagram of the display device displaying the spliced ​​display content is shown, in which the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content and the program running log presentation content can be seen at the same time.

[0067] Figure 3 In the original image acquisition result presentation, the original image of the measured object is displayed, which helps users confirm whether the scanned object is correctly and completely captured, and check whether there are any problems such as occlusion and reflection that may affect the scan quality. This improves the transparency of the reconstruction process.

[0068] Figure 3 In the point cloud generation results presentation, the point cloud data is displayed. Point cloud data is the basis of 3D reconstruction and directly reflects the density, accuracy and completeness of the scanned data. Real-time viewing of the point cloud generation status can promptly detect data missing or noise problems in the scanning process, providing an important reference for subsequent 3D reconstruction.

[0069] Figure 3 In the 3D reconstruction results presentation, the final 3D model is directly displayed, allowing users to intuitively evaluate the reconstruction effect. At the same time, combined with the results of original image acquisition and point cloud generation, it is easier to locate and diagnose possible problems in 3D reconstruction, such as uneven surface and geometric deformation.

[0070] Figure 3 In the program operation log presentation, every operation, parameter setting, and possible error or warning information during the scanning and reconstruction process are recorded, which is essential for problem tracing, solving, and performance optimization, especially when dealing with complex or large objects. This enhances the ability to diagnose and solve problems.

[0071] From the above, we can see that Figure 3Since the four display contents of original image acquisition, point cloud generation, 3D reconstruction and program running log can be displayed simultaneously, the transparency of the reconstruction process is improved, the problem diagnosis and solution capabilities are enhanced, and the efficiency of 3D reconstruction is improved.

[0072] It is easy to understand that when the user selects other combinations of display content options that the user is interested in, similar effects such as improving the 3D reconstruction efficiency can also be achieved. For example, the combination of display content options that the user is interested in also includes options corresponding to the user guide and help content. Since the user guide and help content allow users who are using the 3D scanning device for the first time to read the user guide and help manual while scanning, they do not need to frequently switch the display content, thus achieving the effect of improving the 3D reconstruction efficiency.

[0073] The screen projection method of the embodiment of the present application can flexibly customize the display content output by the main control module and the functional sub-module, and splice the customized display content, and display the spliced ​​display content on the display device, so that multiple display contents can be displayed more intuitively. Users no longer need to switch between display contents, which significantly improves the efficiency of three-dimensional reconstruction.

[0074] As an optional implementation, a wireless connection is used between the three-dimensional scanning device and the display device. In the wireless connection, S120: in response to the configuration information, splicing at least two display contents to obtain spliced ​​display contents, specifically including the following steps:

[0075] S121: In response to the configuration information, the display content is encoded by at least two modules corresponding to the display content to obtain at least two encoded streams.

[0076] According to the configuration information, the options corresponding to at least two display contents selected by the user (i.e., the display content option combination that the user is interested in) can be known. Since there is a mapping relationship between the main control module and the display content, and between the functional submodule and the display content, the main control module and / or functional submodule corresponding to the display content option combination of interest can be determined. The display content option combination of interest can be all options corresponding to the display content output by the main control module, all options corresponding to the display content output by the functional submodule, or options corresponding to the display content output by the main control module and the display content output by the functional submodule.

[0077] Exemplarily, according to the configuration information, the display content option combination of interest includes the options corresponding to the three-dimensional reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content. Since the three-dimensional reconstruction result presentation content and the program running log presentation content are output by the main control module, the original image acquisition result presentation content is output by the image acquisition module, and the point cloud generation result presentation content is output by the point cloud processing module, the main control module and the functional submodule corresponding to the display content option combination of interest are obtained. The main control module continuously encodes the output three-dimensional reconstruction result presentation content and program running log presentation content, the point cloud processing module continuously encodes the output point cloud generation result presentation content, and the image acquisition module continuously encodes the output original image acquisition result presentation content, and a total of 4 encoding streams are formed and sent to the main control module.

[0078] S122: Decode at least two coded streams through a main control module to obtain at least two frames of images of display contents.

[0079] Exemplarily, the main control module obtains the above four coded streams, decodes the four coded streams, and obtains each frame image of the 3D reconstruction result presentation content, the original image acquisition result presentation content, the point cloud generation result presentation content, and the program running log presentation content.

[0080] S123: splicing each frame image of at least two display contents through the main control module to obtain spliced ​​display content.

[0081] Exemplarily, the main control module splices each frame of the above four display contents to obtain spliced ​​display content.

[0082] At the same time, S130: sending the spliced ​​display content to the display device, including:

[0083] S131: The main control module encodes the spliced ​​display content, and sends the encoded spliced ​​display content to the display device.

[0084] Exemplarily, the main control module encodes the spliced ​​display content and sends it to the display device. The display device receives the projection data and decodes and displays the spliced ​​display content. Thus, four display contents are synchronously displayed on the interface of the display device.

[0085] This embodiment realizes wireless screen projection between a three-dimensional projection device and a display device by respectively encoding the main control module and / or functional sub-modules that need to be projected, then decoding and splicing them by the main control module, and then re-encoding the spliced ​​display content and sending it to the display device.

[0086] Optionally, the 3D projection device and the display device are connected via WiFi and are located in the same local area network. The projection device and the display device support WiFi Display technology to achieve projection.

[0087] WiFi Display mode: The connection process is divided into two parts: P2P stage and RTSP (Real Time Streaming Protocol) stage. P2P stage: The projection device (i.e. 3D scanning device) sends out WiFi Display broadcast, and the P2P device (i.e. display device) actively scans to find other nearby devices, so that P2P devices can find each other in the same channel and exchange device information. RTSP stage: WiFi Display uses the RTSP protocol to exchange the capabilities of both sides, establish an RTSP session, and transmit image data at both ends of the connection.

[0088] As an optional implementation manner, before S130: sending the spliced ​​display content to the display device, the method further includes:

[0089] S140: Detect whether the three-dimensional scanning device and the display device are located in the same local area network; sending the spliced ​​display content to the display device is performed when the three-dimensional scanning device and the display device are located in the same local area network.

[0090] When wireless projection is used between the 3D projection device and the display device, it is necessary to ensure that the two are in the same local area network, so it is necessary to detect whether the two are in the same local area network.

[0091] As an optional implementation, a wired connection is used between the 3D scanning device and the display device. In the wired connection, both the 3D scanning device and the display device support the same video format and transmission protocol, and the video stream does not need to be transmitted through a network (such as through a wired connection such as an HDMI High Definition Multimedia Interface or a VGA interface).

[0092] As an optional implementation, the configuration information further includes the size and position or offset of at least two display contents. In S120, the at least two display contents are spliced ​​to obtain spliced ​​display content, including:

[0093] S125: splicing each frame image of the at least two display contents according to the size and position or offset of the at least two display contents to obtain spliced ​​display contents.

[0094] Specifically, according to the size or position of at least two display contents, each frame image of at least two display contents can be spliced ​​to obtain spliced ​​display content; or, according to the size and offset of at least two display contents, each frame image of at least two display contents can be spliced ​​to obtain spliced ​​display content.

[0095] For example, Figure 3 As shown, the position of the displayed content means: the 3D reconstruction result presentation content is located in the lower left corner, the original image acquisition result presentation content is located in the upper left corner, the point cloud generation result presentation content is located in the upper right corner, and the program running log presentation content is located in the lower right corner. The size of the displayed content means that the display screen of the display device is divided into four areas of equal or unequal size according to user preferences. The offset of the displayed content means: the upper left corner of the display screen of the display device can be used as the origin coordinate. Assuming that the original image acquisition result presentation content area is w wide and h high, the offset of the point cloud generation result presentation content is (w, 0), the offset of the 3D reconstruction result presentation content is (0, h), and the offset of the program running log presentation content is (w, h). It should be noted that Figure 3 The location of each display content in the lower left corner of its respective area is only for reference. In practice, each display content should fill its respective area as much as possible.

[0096] As an optional implementation manner, before S130: sending the spliced ​​display content to the display device, the method further includes:

[0097] S150: performing a first processing on the spliced ​​display content, the first processing comprising at least one of adding a layer, adding a watermark, and dividing an area of ​​interest.

[0098] By performing the first processing on the spliced ​​display content, more information can be displayed.

[0099] As an optional implementation, the main control module and at least one functional submodule are in a star topology. The star topology is a center with multiple nodes. It has a simple structure, convenient connection, relatively easy management and maintenance, and strong scalability.

[0100] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0101] Figure 4 A schematic structural diagram of a three-dimensional scanning device disclosed in an embodiment of the present application is shown, including a receiving module 410, a main control module 420, at least one functional sub-module 430 and a communication module 440; different functional sub-modules 430 correspond to different display contents, and each main control module 420 and functional sub-module 430 has at least one display content.

[0102] The receiving module 410 is used to receive configuration information input by the user for the three-dimensional scanning device, where the configuration information indicates that at least two display contents are projected onto the display device, where at least two display contents are display contents corresponding to the same main control module 420 or functional sub-module 430, or at least two display contents are display contents corresponding to different main control modules 420 and / or functional sub-modules 430.

[0103] The main control module 420 is used to splice at least two display contents in response to the configuration information to obtain spliced ​​display content.

[0104] The communication module 440 is used to send the spliced ​​display content to the display device.

[0105] Furthermore, the three-dimensional scanning device also includes a display screen 450. Preferably, the display screen 450 is a touch display screen.

[0106] The functional submodules of the three-dimensional scanning device are connected to the main control module by means of network communication. The network connection between the main control module and the functional submodules is a star topology structure, thereby facilitating the expansion of the functional submodules.

[0107] Figure 5 A screen projection system disclosed in an embodiment of the present application is shown, which includes a display device 510 and a three-dimensional scanning device 520 of the above embodiment. The display device 510 has a larger display screen than the three-dimensional scanning device 520, so that the display content is dynamically configured according to the configuration information.

[0108] Corresponding to the screen projection method described in the above embodiment, Figure 6 A structural block diagram of the screen projection device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0109] Reference Figure 6 , the device comprises:

[0110] The receiving module 610 is used to receive configuration information input by the user for the three-dimensional scanning device, where the configuration information indicates that at least two display contents are projected onto the display device, where at least two display contents are display contents corresponding to the same main control module or functional sub-module, or at least two display contents are display contents corresponding to different main control modules 620 and / or functional sub-modules respectively; different main control modules and functional sub-modules correspond to different display contents, and each main control module 620 and functional sub-module has at least one display content.

[0111] The main control module 620 is used to splice at least two display contents in response to the configuration information to obtain spliced ​​display content.

[0112] The communication module 630 is used to send the spliced ​​display content to the display device.

[0113] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0114] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0115] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0116] An embodiment of the present application provides a computer program product. When the computer program product is run on a three-dimensional scanning device, a mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0117] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the three-dimensional scanning device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0118] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0119] The computer program code for performing the operation of the embodiment of the application can be written with one or more programming languages ​​or their combination, and the programming language includes object-oriented programming languages, such as python, Java, Smalltalk, C++, and also includes conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed completely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on the remote computer, or executed completely on the remote computer or server. In the case of a remote computer, the remote computer can include a local area network (LAN) or a wide area network (WAN)--connected to the user's computer through any type of network, or, can be connected to an external computer (for example, utilizing an Internet service provider to connect through the Internet).

[0120] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0121] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0122] In the embodiments provided in the present application, it should be understood that the disclosed device / three-dimensional scanning equipment and method can be implemented in other ways. For example, the device / three-dimensional scanning equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0123] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0124] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A screen projection method, characterized in that: Applied to a three-dimensional scanning device, the three-dimensional scanning device includes multiple modules, the multiple modules include at least a main control module and at least one functional sub-module, different modules correspond to different display contents, and each module has at least one display content; the method includes: receiving configuration information input by a user for the three-dimensional scanning device, wherein the configuration information indicates that at least two display contents are projected onto a display device, wherein the at least two display contents are display contents corresponding to the same module, or the at least two display contents are display contents corresponding to different modules respectively; In response to the configuration information, splicing the at least two display contents to obtain spliced ​​display content; The spliced ​​display content is sent to a display device.

2. The screen projection method according to claim 1, characterized in that: The step of splicing the at least two display contents in response to the configuration information to obtain spliced ​​display content includes: In response to the configuration information, encoding the display content by the modules respectively corresponding to the at least two display contents to obtain at least two coded streams; Decoding the at least two coded streams by the main control module to obtain each frame image of the at least two display contents; splicing each frame image of the at least two display contents through the main control module to obtain spliced ​​display contents; The sending the spliced ​​display content to a display device includes: The main control module encodes the spliced ​​display content, and sends the encoded spliced ​​display content to a display device.

3. The screen projection method according to claim 2, wherein: The configuration information also includes the size and position or offset of the at least two display contents; The at least two display contents are spliced ​​to obtain spliced ​​display content, comprising: Each frame image of the at least two display contents is spliced ​​according to the size and position or offset of the at least two display contents to obtain the spliced ​​display content.

4. The screen projection method according to claim 1, characterized in that: Before sending the spliced ​​display content to the display device, the method further includes: The spliced ​​display content is subjected to a first processing, wherein the first processing includes at least one of adding a layer, adding a watermark, and dividing an area of ​​interest.

5. The screen projection method according to claim 1, wherein: The three-dimensional scanning device and the display device are located in the same local area network, and the three-dimensional scanning device and the display device are connected wirelessly or by wire.

6. The screen projection method according to claim 1, characterized in that: The main control module and at least one functional submodule are in a star topology structure.

7. The screen projection method according to any one of claims 1 to 6, characterized in that: The at least two display contents are at least two of the original image acquisition result presentation content, point cloud generation result presentation content, three-dimensional reconstruction result presentation content, program running log presentation content, parameter setting content, preprocessing content, material mapping presentation content, post-processing and optimization content, and user guide and help content.

8. A three-dimensional scanning device, characterized in that: It includes a receiving module, a main control module, at least one functional sub-module and a communication module; different main control modules and functional sub-modules correspond to different display contents, and each of the main control module and the functional sub-module has at least one display content; The receiving module is used to receive configuration information input by a user for the three-dimensional scanning device, wherein the configuration information indicates that at least two display contents are projected onto the display device, and the at least two display contents are display contents corresponding to the same main control module or functional submodule, or at least two display contents are display contents corresponding to different main control modules and / or functional submodules respectively; The main control module is used to splice the at least two display contents in response to the configuration information to obtain spliced ​​display content; The communication module is used to send the spliced ​​display content to a display device.

9. A screen projection system, characterized in that: include: A display device and a three-dimensional scanning device as claimed in claim 8.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images