A method and system for automatically repairing and positioning defective stone

By constructing virtual site to be repaired and infrared scanning technology, accurate positioning and automatic repair of stone defects are achieved, the problem of low manual positioning and repair efficiency in the existing technology is solved, and the stone repair efficiency is improved.

CN118351099BActive Publication Date: 2024-12-03CHINA CONSTR ENG DESIGN GROUP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410536145.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-30
Publication Date
2024-12-03
Estimated Expiration
2044-04-30

AI Technical Summary

Technical Problem

The existing stone repair methods are mostly done manually, and existing equipment cannot clearly scan out defective areas and accurately position them, resulting in waste of manpower and time.

Method used

Using an automated method, by building a virtual site to be repaired, using infrared scanning technology to initially locate defective stones, deep infrared scanning determines the depth and location of defects, generates a virtual stone model, and performs automatic repair processing.

Benefits of technology

Accurate positioning and efficient repair of defective stones has been achieved, significantly improving the repair efficiency and saving manpower and time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118351099B_ABST
    Figure CN118351099B_ABST
Patent Text Reader

Abstract

The present invention provides an automatic repair and positioning method and system for defective stone. The method includes: constructing a virtual site to be repaired corresponding to the actual site to be repaired; controlling the scanning end to perform a preliminary infrared scan, and in response to the scanning end determining the actual stone as the actual stone to be repaired, triggering image acquisition to obtain the image to be repaired; determining the defect contour based on the image to be repaired, controlling the scanning end to perform a deep infrared scan, determining the defect depth, and obtaining the actual position; determining the virtual position based on the actual position, and generating the virtual stone to be repaired at the virtual position based on the defect depth and defect contour; in response to the interaction of the management end with the virtual site to be repaired, controlling the repair end to perform repair processing, determining the actual stone to be repaired as the repaired actual stone, and triggering image acquisition to obtain the repaired image; updating the virtual stone to be repaired to obtain the repaired virtual stone. The present invention at least improves the repair efficiency of stone.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to data processing technology, and in particular to an automatic repair and positioning method and system for defective stone. Background Art

[0002] Everything has a lifespan, and hard stone is no exception. For example, the tiles on the floor of a shopping mall may have some defects due to long-term trampling, such as grooves or cracks, which will affect the load-bearing capacity of the stone and easily cause accidental injuries such as tripping and falling. Grooves or cracks on the stone will also affect the image of the business and customer experience, reduce the image of the business and economic benefits, so after the tiles are cracked, they should be repaired in time.

[0003] The inventors found in their research that existing stone repair methods are still relatively traditional, mostly performed manually, or existing equipment cannot clearly scan the defective areas on the stone and accurately locate the position of the defective stone, wasting a certain amount of manpower and time. Summary of the invention

[0004] Based on the above problems, the present invention is proposed to provide an automatic repair and positioning method and system for defective stone materials that overcomes the above problems or at least partially solves the above problems.

[0005] According to one aspect of the present invention, there is provided a method for automatically repairing and positioning a defective stone, comprising the following steps:

[0006] Construct a virtual site to be restored that corresponds to the actual site to be restored;

[0007] Controlling the scanning end to perform a preliminary infrared scan on the real site to be restored, and in response to the scanning end determining any real stone located in the real site to be restored as the real stone to be restored, triggering the scanning end to capture an image of the real stone to be restored, and obtaining an image to be restored;

[0008] Determine the defect outline based on the image to be repaired, control the scanning end to perform deep infrared scanning based on the defect outline, determine the defect depth, and obtain the actual position of the actual stone to be repaired;

[0009] Determine a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generate a corresponding virtual stone to be repaired at the virtual position based on the defect depth and defect contour;

[0010] In response to the interaction of the management end with the virtual site to be repaired, the repair end is controlled to perform repair processing on the real stone to be repaired, after the repair processing is completed, the real stone to be repaired is determined as the repaired real stone, and the repair end is triggered to collect an image of the repaired stone to obtain a repaired image;

[0011] The virtual stone to be repaired is updated based on the repaired image to obtain a repaired virtual stone.

[0012] Optionally, in the method according to the present invention, the real site to be restored includes real floor areas located on different real floors and real stair areas between adjacent real floors, and the virtual site to be restored includes virtual floor areas corresponding to the real floor areas, and virtual stair areas corresponding to the real stair areas;

[0013] The scanning end includes a manual scanning end and a machine scanning end, and the repairing end includes a manual repairing end and a machine repairing end;

[0014] In response to the scanning end determining any real stone located in the real site to be repaired as the real stone to be repaired, the scanning end is triggered to collect an image of the real stone to be repaired to obtain the image to be repaired, including:

[0015] In response to the result of the infrared scanning performed by the manual scanning end on any stone in each real staircase area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the manual scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired; and / or

[0016] In response to the result of the infrared scanning performed by the machine scanning end on any real stone in each real layer area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the machine scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired;

[0017] The repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired, including:

[0018] The artificial repair end performs repair processing on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual staircase area; and / or

[0019] The machine repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual plane area.

[0020] Optionally, in the method according to the present invention, controlling the scanning end to perform a preliminary infrared scan on the real site to be repaired, and in response to the scanning end determining any real stone located in the real site to be repaired as the real stone to be repaired, triggering the scanning end to collect an image of the real stone to be repaired to obtain the image to be repaired, including:

[0021] Based on the scanning signal, the scanning end is controlled to perform a preliminary infrared scan based on the infrared scanning points on the actual site to be repaired, and the infrared scanning distance corresponding to the infrared scanning points is obtained in real time;

[0022] When the infrared scanning distance is greater than the preset distance, the positioning information of the infrared scanning point is determined, and a real site coordinate system is established based on the real site to be repaired;

[0023] Determine the scanning coordinate point corresponding to the positioning information in the real site coordinate system based on the positioning information, and determine the coordinate intervals occupied by all the real stones located in the real site to be repaired in the real site coordinate system;

[0024] The real stone corresponding to the coordinate interval containing the scanning coordinate point is determined as the real stone to be repaired, the scanning end is triggered to illuminate the infrared scanning point, and the image of the real stone to be repaired is collected to obtain the image to be repaired.

[0025] Optionally, in the method according to the present invention, the stone size of the actual stone is smaller than the image acquisition size of the scanning end;

[0026] The scanning end is triggered to illuminate the infrared scanning point, and an image of the real stone to be repaired is collected to obtain the image to be repaired, including:

[0027] Triggering a lighting unit pre-installed on the scanning end to illuminate the infrared scanning point, and performing image acquisition with the infrared scanning point as the image center point to obtain an initial image;

[0028] Identify the initial image, determine each stone edge line in the initial image, and determine each enclosed area based on each stone edge line;

[0029] Based on the relative positional relationship between each enclosed area and the infrared scanning point, the enclosed area including the infrared scanning point is determined as the target area, and the stone edge line constituting the target area is determined as the target edge line;

[0030] When the target edge line is a closed line segment, the region center point of the target region is determined, and the scanning end is controlled to perform image acquisition with the region center point as the image center point to obtain the image to be repaired.

[0031] Optionally, in the method according to the present invention, when the target edge line is a non-closed line segment, a first edge line and a second edge line constituting the target edge line and having a preset angle are determined;

[0032] Based on the preset angle, the center line of the angle is determined, and the scanning end is controlled to move in the extension direction of the center line of the angle. When the target edge line is moved to the point where the target edge line and other edge lines are combined into a closed line segment, the center point of the area surrounded by the closed line segment is determined, and the scanning end is controlled to perform image acquisition with the center point of the area as the center point of the image to obtain the image to be repaired.

[0033] Optionally, in the method according to the present invention, determining the defect contour based on the image to be repaired, controlling the scanning end to perform a deep infrared scan based on the defect contour to determine the defect depth, and obtaining the actual position of the actual stone to be repaired, comprises:

[0034] Performing image recognition on the image to be repaired based on a pre-trained image recognition model to determine a defect contour including the infrared scanning point;

[0035] Adding an external regular pattern based on the defect contour;

[0036] Controlling the scanning end to perform a deep infrared scan based on the external regular image, determining a graphic depth of the external regular graphic based on a result of the deep scanning, and determining a defect depth of the defect contour based on the graphic depth;

[0037] The position of the center point of the area is determined as the actual position of the actual stone to be repaired.

[0038] Optionally, in the method according to the present invention, a virtual position corresponding to the real position is determined in the virtual site to be repaired based on the real position, and a corresponding virtual stone to be repaired is generated at the virtual position based on the defect depth and defect contour, including:

[0039] Acquire the real center coordinate point of the center point of the area based on the real site coordinate system;

[0040] Establishing a virtual site coordinate system based on the virtual site to be restored;

[0041] Based on the correspondence between the real site coordinate system and the virtual site coordinate system, determining a virtual center coordinate point corresponding to the real center coordinate point in the virtual site coordinate system, and determining the virtual center coordinate point as the virtual position;

[0042] Generate a virtual stone outline corresponding to the stone size of the real stone based on the virtual position;

[0043] The virtual stone contour is updated based on the defect contour and the defect depth to obtain a virtual stone to be repaired corresponding to the real stone to be repaired.

[0044] Optionally, in the method according to the present invention, updating the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone includes:

[0045] In response to a repair completion signal sent by the repair end, the terminal number of the repair end is obtained, and based on the repaired image, the defect contour in the virtual stone to be repaired is virtually filled based on the defect depth to obtain a repaired virtual stone;

[0046] Retrieving a color comparison table, wherein the color comparison table includes different terminal numbers and preset colors corresponding to the different terminal numbers;

[0047] Traversing the color comparison table to determine a preset color corresponding to the terminal number;

[0048] The repaired virtual stone is filled with color based on the preset color, and a historical repair record entry is generated based on the repaired virtual stone.

[0049] Optionally, in the method according to the present invention, generating a historical restoration record entry based on the restored virtual stone comprises:

[0050] Establishing an initial recording layer based on the repaired virtual stone, and generating a repair time area and a repair image area in the initial recording layer;

[0051] Obtaining a signal sending time of a repair completion signal sent by the repair end, and filling the signal sending time into the repair time area;

[0052] Filling the to-be-repaired image into a first sub-region of the repaired image region, and filling the repaired image into a second sub-region of the repaired image region, to generate a historical repair record entry;

[0053] A link relationship between the repaired virtual stone and the historical repair record entry is established, so that in response to any terminal's interaction with the repaired virtual stone, the historical repair record entry having a link relationship with the repaired virtual stone is retrieved and sent to any terminal for viewing.

[0054] According to another aspect of the present invention, there is provided an automatic repair and positioning system for defective stone, comprising:

[0055] A construction module is configured to construct a virtual site to be restored corresponding to the actual site to be restored;

[0056] The preliminary scanning module is configured to control the scanning end to perform a preliminary infrared scan on the real site to be restored, and in response to the scanning end determining any real stone located in the real site to be restored as the real stone to be restored, trigger the scanning end to capture an image of the real stone to be restored, and obtain an image to be restored;

[0057] A depth scanning module is configured to determine the defect contour based on the image to be repaired, control the scanning end to perform a deep infrared scan based on the defect contour, determine the defect depth, and obtain the actual position of the actual stone to be repaired;

[0058] A generating module is configured to determine a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generate a corresponding virtual stone to be repaired at the virtual position based on the defect depth and defect contour;

[0059] The repair module is configured to control the repair end to perform repair processing on the real stone to be repaired in response to the interaction of the management end with the virtual site to be repaired, and after completing the repair processing, determine the real stone to be repaired as the repaired real stone, and trigger the repair end to collect an image of the repaired stone to obtain a repaired image;

[0060] The updating module is configured to update the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone.

[0061] According to the solution of the present invention, firstly, a virtual site to be repaired corresponding to the actual site to be repaired can be constructed based on the digital twin data; and the scanning end can be controlled to perform a preliminary infrared scan on the actual site to be repaired, and then any real stone can be determined as the real stone to be repaired according to the preliminary scanning result, and the scanning end can be triggered to perform image acquisition on the real stone to be repaired to obtain the image to be repaired; then, the defect outline of the real stone to be repaired is determined based on the image to be repaired, and the scanning end is controlled to perform a deep infrared scan on the stone to be repaired based on the defect outline, so as to determine the defect depth of the real stone to be repaired, and then determine the real depth of the real stone to be repaired. Position; then, based on the real position, determine the virtual position corresponding to it in the virtual site to be repaired, and generate the virtual stone to be repaired corresponding to the real stone to be repaired at the virtual position in the virtual site to be repaired based on the defect depth and defect outline; when the management end interacts with the virtual site to be repaired, it will control the scanning end to perform repair processing on the real stone to be repaired, and after the repair processing is completed, it will determine the real stone to be repaired as the repaired real stone, and trigger the repair end to collect the image of the repaired stone to obtain the repaired image; finally, based on the repaired image, update the virtual stone to be repaired to obtain the repaired virtual stone. The present invention can accurately locate the specific position of the defective stone and repair it, which greatly improves the repair efficiency of the defective stone. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 A flow chart showing an automatic repair and positioning method for defective stone according to an embodiment of the present invention is shown;

[0063] Figure 2 A schematic diagram showing the structure of the scanning end and / or the repair end in this embodiment;

[0064] Figure 3 A structural block diagram of an automatic repair and positioning system for defective stone according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0065] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0066] Everything has a lifespan, and hard stone is no exception. For example, the tiles on the floor of a shopping mall may have some defects due to long-term trampling, such as grooves or cracks, which will affect the load-bearing capacity of the stone and easily cause accidental injuries such as tripping and falling. Grooves or cracks on the stone will also affect the image of the business and customer experience, reduce the image of the business and economic benefits, so after the tiles are cracked, they should be repaired in time.

[0067] The inventors found in their research that existing stone repair methods are still relatively traditional, mostly performed manually, or existing equipment cannot clearly scan the defective areas on the stone and accurately locate the position of the defective stone, wasting a certain amount of manpower and time.

[0068] In order to solve the above problems in the prior art, the inventor proposes the solution of the present invention. An embodiment of the present invention provides an automatic repair and positioning method for defective stone, which can be executed in a computing device.

[0069] Figure 1 A flow chart of an automatic repair and positioning method for defective stone material proposed according to an embodiment of the present invention is shown. The method is suitable for execution in a computing device.

[0070] like Figure 1 As shown, an automatic repair and positioning method for defective stone in this embodiment starts at step S102. In step S102, the following steps are included:

[0071] Based on the digital twin data, a virtual site to be restored is constructed corresponding to the actual site to be restored.

[0072] For example, in this embodiment, the actual site to be repaired can be understood as a site in real life where defective stones need to be automatically repaired and positioned, such as a shopping mall or factory with many floor tiles, which may have cracks that need to be repaired; based on this, the server will construct a corresponding virtual site to be repaired based on the pre-acquired digital twin data of the actual site to be repaired.

[0073] In step S104, the following contents are included:

[0074] The control scanning end performs a preliminary infrared scan on the actual site to be repaired, and in response to the scanning end determining any actual stone located in the actual site to be repaired as the actual stone to be repaired based on the preliminary scanning result, the scanning end is triggered to capture an image of the actual stone to be repaired to obtain an image to be repaired.

[0075] For example, in this embodiment, the scanning end can be understood as a machine with an infrared scanning function, and the server can send corresponding control signals to control the scanning end to perform a preliminary infrared scan on all the stones in the site to be repaired, such as scanning floor tiles in a shopping mall. The scanning end with an infrared scanning function can measure the distance between the ground and the sensor in real time, and when the preliminary infrared scanning result of the scanning end is that the distance between the ground and the sensor exceeds the normal distance, it means that the scanning end has scanned a real stone with defects such as grooves or cracks, and thus the real stone will be determined as the real stone to be repaired, and the scanning end will be triggered to collect images of the real stone to be repaired, thereby obtaining the image to be repaired.

[0076] It can be explained that the scanning method in this embodiment is different from the manual scanning method in the prior art. Instead, the server sends a corresponding control signal to control the scanning end to scan, which can save a certain amount of manpower and improve work efficiency.

[0077] Because existing shopping malls or office buildings are often multi-story structures, they will have staircase areas and floor areas. In this case, the robot may not be able to walk well in the staircase area and then perform infrared scanning and repair on the staircase area. Based on this, in this embodiment, the following corresponding different technical solutions can be adopted for these two different building areas:

[0078] When the staircase area needs to be scanned, a staff member may carry a scanning device to scan, that is, a manual scanning end, and then a manual repair end may be used to repair the stone to be repaired in the staircase area.

[0079] When it is necessary to scan the layer area, it can be scanned by a scanning device, that is, a machine scanning end, and then the server will control the machine repair end to repair the stone to be repaired in the layer area.

[0080] It should be noted that the manual scanning end can be understood as a machine that needs to be held by humans. The machine can respond to the control signal sent by the server to perform the corresponding scanning task. Since the actual stair area includes multiple steps and the regional environment is relatively complex, if a fully automatic machine is used for scanning, it may be inconvenient to move on multiple steps. Therefore, using a manual handheld machine for scanning can avoid this situation and thus improve the corresponding scanning efficiency.

[0081] At the same time, the machine scanning end can be understood as a fully automatic machine, that is, a machine that can move autonomously and does not require human intervention. Since the regional environment in the actual area is relatively simple and mostly flat, a fully automatic machine can be used to move and scan autonomously, thereby saving certain human resources and improving the corresponding scanning efficiency.

[0082] Furthermore, the above-mentioned “in response to the scanning end determining any real stone located in the real site to be repaired as the real stone to be repaired, triggering the scanning end to collect an image of the real stone to be repaired to obtain the image to be repaired” also includes the following steps:

[0083] In response to the result of the infrared scanning performed by the manual scanning end on any stone in each real staircase area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the manual scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired; and / or

[0084] In response to the result of the infrared scanning performed by the machine scanning end on any real stone in each real layer area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the machine scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired;

[0085] The repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired, including:

[0086] The artificial repair end performs repair processing on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual staircase area; and / or

[0087] The machine repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual plane area.

[0088] For example, in this embodiment, when the manual scanning end performs infrared scanning on the stones in each real staircase area, a stone with defects such as grooves or cracks is scanned, that is, when the scanning result of the manual scanning end on the stone is a confirmed defect, the stone will be determined as the real stone to be repaired, and the manual scanning end will be controlled to collect images of the real stone to be repaired to obtain the image to be repaired, and the corresponding virtual stone to be repaired will be generated in the virtual staircase area, and then the manual repair end will repair the real stone to be repaired.

[0089] When the machine scanning end performs infrared scanning on the stones in each real layer area, it scans a stone with defects such as grooves or cracks, that is, when the scanning result of the machine scanning end on the stone is a confirmed defect, the stone will be determined as the real stone to be repaired, and the machine scanning end will be controlled to collect images of the real stone to be repaired to obtain the image to be repaired, and the corresponding virtual stone to be repaired will be generated in the virtual layer area, and then the machine repair end will repair the real stone to be repaired.

[0090] For example, Figure 2A schematic diagram showing the structure of the scanning end and / or the repair end in this embodiment is shown. Figure 2 As shown, the scanning end and / or the repairing end includes a machine body 201 and a moving pulley 202, wherein the moving pulley 202 can drive the machine body 201 to move, thereby completing the corresponding scanning work and repairing work.

[0091] Furthermore, the above-mentioned "controlling the scanning end to perform a preliminary infrared scan on the actual site to be repaired, and in response to the scanning end determining any actual stone located in the actual site to be repaired as the actual stone to be repaired based on the scanning result, triggering the scanning end to collect an image of the actual stone to be repaired to obtain an image to be repaired", further includes the following steps:

[0092] Based on the scanning signal, the scanning end is controlled to perform a preliminary infrared scan based on the infrared scanning points on the actual site to be repaired, and the infrared scanning distance corresponding to the infrared scanning points is obtained in real time;

[0093] When the infrared scanning distance is greater than the preset distance, the positioning information of the infrared scanning point is determined, and a real site coordinate system is established based on the real site to be repaired;

[0094] Determine the scanning coordinate point corresponding to the positioning information in the real site coordinate system based on the positioning information, and determine the coordinate intervals occupied by all the real stones located in the real site to be repaired in the real site coordinate system;

[0095] The real stone corresponding to the coordinate interval containing the scanning coordinate point is determined as the real stone to be repaired, the scanning end is triggered to illuminate the infrared scanning point, and the image of the real stone to be repaired is collected to obtain the image to be repaired.

[0096] For example, in this embodiment, when performing a preliminary infrared scan, the server will send a scanning signal to the scanning end. After receiving the scanning signal, the scanning end will perform a preliminary infrared scan based on the infrared scanning point in the actual site to be repaired, which can ensure that all stones in the actual site to be repaired are scanned clearly and completely. During the preliminary infrared scanning process, the server can obtain the infrared scanning distance between the infrared sensor pre-installed on the scanning end and the infrared scanning point in real time; at the same time, the server can also set a corresponding preset distance according to the actual situation. Here, the preset distance can be understood as the scanning distance between the scanning end and a normal stone without defects, that is, when the infrared scanning distance is greater than the preset distance, it indicates that the stone scanned at the current infrared scanning point may have defects such as dents or cracks. At this time, the positioning information of the infrared scanning point can be obtained based on the GPS signal of the scanning end. The server establishes a real site coordinate system based on the actual site to be repaired, and then determines the corresponding scanning coordinate point in the real site coordinate system according to the positioning information of the infrared scanning point, and determines each coordinate interval composed of all coordinate points in the area covered by each stone in the real site to be repaired in the real site coordinate system. At this time, the server determines the real stone corresponding to the coordinate interval containing the scanning coordinate point as the real stone to be repaired, and triggers the scanning end to illuminate the infrared scanning point to increase the brightness during image acquisition, thereby acquiring an image of the real stone to be repaired and obtaining the image to be repaired.

[0097] Here, this embodiment can determine whether there is a stone to be repaired in the actual site to be repaired based on the infrared scanning distance of all the stones in the actual site to be repaired. If there is a stone to be repaired, the position of the stone to be repaired can be accurately located, saving a certain amount of time. When collecting images of the stone to be repaired, the scanning end will illuminate the current infrared scanning point to increase the brightness during image collection, making the image to be repaired clearer.

[0098] It should be noted that, in this embodiment, the image acquisition size of the scanning end needs to be larger than the stone size of the actual stone, that is, after the scanning end acquires an image of a certain actual stone, the acquired image needs to completely include the actual stone, so as to ensure that the image of the actual stone acquired by the scanning end is valid.

[0099] Furthermore, the above-mentioned “triggering the scanning end to illuminate the infrared scanning point, and collecting images of the actual stone to be repaired to obtain the image to be repaired” also includes the following steps:

[0100] Triggering a lighting unit pre-installed on the scanning end to illuminate the infrared scanning point, and performing image acquisition with the infrared scanning point as the image center point to obtain an initial image;

[0101] Identify the initial image, determine each stone edge line in the initial image, and determine each enclosed area based on each stone edge line;

[0102] Based on the relative positional relationship between each enclosed area and the infrared scanning point, the enclosed area including the infrared scanning point is determined as the target area, and the stone edge line constituting the target area is determined as the target edge line;

[0103] When the target edge line is a closed line segment, the region center point of the target region is determined, and the scanning end is controlled to perform image acquisition with the region center point as the image center point to obtain the image to be repaired.

[0104] When the target edge line is a non-closed line segment, determining a first edge line and a second edge line constituting the target edge line and forming a preset angle;

[0105] Based on the preset angle, the center line of the angle is determined, and the scanning end is controlled to move in the extension direction of the center line of the angle. When the target edge line is moved to the point where the target edge line and other edge lines are combined into a closed line segment, the center point of the area surrounded by the closed line segment is determined, and the scanning end is controlled to perform image acquisition with the center point of the area as the center point of the image to obtain the image to be repaired.

[0106] For example, in this embodiment, before image acquisition, the server will first trigger the lighting unit pre-installed on the scanning end to illuminate the infrared scanning point. The center point of the image during image acquisition is the infrared scanning point, and the initial image is obtained after image acquisition. Since the stone to be repaired included in the initial image may be partial, rather than complete, after obtaining the initial image, the server will identify the initial image, thereby determining each stone edge line of the stone in the initial image. For example, if a stone is rectangular in shape, the four sides of the stone in the acquired image are all stone edge lines, and the area surrounded by these four stone edge lines is an enclosed area, that is, the composition of each enclosed area can be determined based on each stone edge line. Because the image acquisition of the scanning end includes images of other stones in addition to the image of the actual stone to be repaired, the server will determine which enclosed area the infrared scanning point is located in, that is, according to the relative position relationship between each enclosed area and the infrared scanning point, the enclosed area containing the infrared scanning point is determined, and the enclosed area is determined as the target area, and the stone edge lines constituting the target area are determined as the target edge lines.

[0107] When the target edge line can form an enclosing area, that is, when the target edge line is a closed line segment, the server will determine the center point of the target area and control the scanning end to collect the image with the center point of the area as the image center point to obtain the image to be repaired.

[0108] When the target edge line cannot form an enclosed area, that is, the target edge line is a non-closed line segment, then the image of the stone to be repaired in the initial image is not complete. In order to ensure that the scanning end can collect the complete image of the real stone to be repaired, the server will determine the two target edge lines with the angle between the two target edge lines being the preset angle. For example, if the shape of the stone is rectangular, the degree of the preset angle can be 90 degrees. When the angle between the two target edge lines is the preset angle, one of the target edge lines is the first edge line, and the other target edge line is the second edge line, that is, the first edge line and the second edge line that constitute the target edge line and are at the preset angle are determined. Then the server will determine the center line of the angle according to the preset angle, so as to control the scanning end to move in the extension direction of the center line of the angle. When the target edge line and other edge lines are combined into a closed line segment, that is, the current position can collect the complete image of the real stone to be repaired, and then determine the center point of the area surrounded by the closed line segment, and control the scanning end to collect the image with the center point of the area as the center point of the image, so as to obtain the image to be repaired.

[0109] In step S106, the following contents are included:

[0110] The defect contour of the real stone to be repaired is determined based on the image to be repaired, and the scanning end is controlled to perform a deep infrared scan on the stone to be repaired based on the defect contour to determine the defect depth of the real stone to be repaired, and obtain the real position of the real stone to be repaired.

[0111] For example, in this embodiment, after obtaining the image of the real stone to be repaired, the server can determine the defect outline of the real stone to be repaired, thereby controlling the scanning end to perform a more detailed scan of the defect outline of the real stone to be repaired, that is, a deep infrared scan. After the scan, the specific depth of the defect area of ​​the real stone to be repaired, that is, the defect depth, is obtained, and the specific position of the real stone to be repaired in the actual site to be repaired, that is, the actual position, is determined.

[0112] Furthermore, the above-mentioned “determining the defect contour of the real stone to be repaired based on the image to be repaired, controlling the scanning end to perform a deep infrared scan on the stone to be repaired based on the defect contour, determining the defect depth of the real stone to be repaired based on the deep scanning result, and obtaining the real position of the real stone to be repaired” also includes the following steps:

[0113] Performing image recognition on the image to be repaired based on a pre-trained image recognition model to determine a defect contour including the infrared scanning point;

[0114] Adding an external regular pattern based on the defect contour;

[0115] Controlling the scanning end to perform a deep infrared scan based on the external regular image, determining a graphic depth of the external regular graphic based on a result of the deep scanning, and determining a defect depth of the defect contour based on the graphic depth;

[0116] The position of the center point of the area is determined as the actual position of the actual stone to be repaired.

[0117] For example, in this embodiment, the image recognition model can be obtained by performing corresponding model training on the pre-built image recognition model. Before the model training, the corresponding image training sample set can be obtained in advance, and the image training sample set can include multiple training images corresponding to different stone images. After obtaining the corresponding image training sample set, the pre-built image recognition model can be trained by the image training sample set to obtain the image recognition model. The server will perform image recognition on the image to be repaired based on the pre-trained image recognition model, and after image recognition, the defect contour including the infrared scanning point can be determined.

[0118] After determining the defect outline of the real stone to be repaired, the server will control the scanning end to perform a deep infrared scan with the defect outline as the trajectory. When the defect outline is an irregular shape, the scanning trajectory of the scanning end will be more complicated. At this time, the server will add an external regular graphic based on the defect outline. For example, the external graphic can be a rectangle, so that the scanning trajectory of the scanning end is simpler, reducing a certain amount of workload and working time. Then the server controls the scanning end to perform a deep infrared scan based on the external regular image, and obtains the deep scanning result after the deep infrared scan, and obtains the graphic depth of the external regular graphic, thereby determining the defect depth of the defect outline, and determining the location of the center point of the area as the actual location of the real stone to be repaired.

[0119] In step S108, the following contents are included:

[0120] Based on the real position, a virtual position corresponding to the real position is determined in the virtual site to be repaired, and based on the defect depth and defect contour, a virtual stone to be repaired corresponding to the real stone to be repaired is generated at the virtual position in the virtual site to be repaired.

[0121] For example, in this embodiment, after determining the actual position of the real stone to be repaired in the actual site to be repaired, the corresponding virtual position can be determined in the virtual site to be repaired; then the server can generate a virtual stone to be repaired corresponding to the real stone to be repaired at this virtual position according to the obtained defect depth and defect contour. The generated virtual stone to be repaired can realize online real-time monitoring, thereby improving work efficiency.

[0122] Furthermore, the above-mentioned “determining a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generating a virtual stone to be repaired corresponding to the real stone to be repaired at the virtual position in the virtual site to be repaired based on the defect depth and defect contour” also includes the following steps:

[0123] Acquire the real center coordinate point of the center point of the area based on the real site coordinate system;

[0124] Establishing a virtual site coordinate system based on the virtual site to be restored;

[0125] Based on the correspondence between the real site coordinate system and the virtual site coordinate system, determining a virtual center coordinate point corresponding to the real center coordinate point in the virtual site coordinate system, and determining the virtual center coordinate point as the virtual position;

[0126] Generate a virtual stone outline corresponding to the stone size of the real stone based on the virtual position;

[0127] The virtual stone contour is updated based on the defect contour and the defect depth to obtain a virtual stone to be repaired corresponding to the real stone to be repaired.

[0128] For example, in this embodiment, the server will obtain the real center coordinate point of the center point of the area in the real site coordinate system, and establish a virtual site coordinate system according to the virtual site to be repaired. Then, according to the position correspondence between the real site coordinate system and the virtual site coordinate system, the virtual center coordinate point can be determined in the virtual site coordinate system, the position of the virtual center coordinate point corresponds to the real center coordinate point, and the virtual center coordinate point is determined as the virtual position, and then a virtual stone contour corresponding to the stone size of the real stone is generated according to the virtual position, and the virtual stone contour is updated based on the defect contour and defect depth, and the virtual stone to be repaired corresponding to the real stone to be repaired is obtained after the update.

[0129] In step S110, the following contents are included:

[0130] In response to the interaction of the management end with the virtual site to be repaired, the scanning end is controlled to perform repair processing on the real stone to be repaired. After the repair processing is completed, the real stone to be repaired is determined as the repaired real stone, and the repair end is triggered to capture an image of the repaired stone to obtain a repaired image.

[0131] For example, in this embodiment, after the management end interacts with the virtual site to be repaired in the digital twin space, the server will control the scanning end to perform repair processing on the real stone to be repaired. After completing the repair processing of the real stone to be repaired, the server will update the real stone to be repaired as the repaired real stone, and at the same time control the repair end to collect images of the repaired stone to obtain a repaired image.

[0132] In step S112, the following contents are included:

[0133] The virtual stone to be repaired is updated based on the repaired image to obtain a repaired virtual stone.

[0134] For example, in this embodiment, after the restored image is obtained, the virtual stone to be restored is synchronously updated, and the restored virtual stone is obtained after the update.

[0135] Furthermore, the above-mentioned “updating the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone” further includes the following steps:

[0136] In response to a repair completion signal sent by the repair end, the terminal number of the repair end is obtained, and based on the repaired image, the defect contour in the virtual stone to be repaired is virtually filled based on the defect depth to obtain a repaired virtual stone;

[0137] Retrieving a color comparison table, wherein the color comparison table includes different terminal numbers and preset colors corresponding to the different terminal numbers;

[0138] Traversing the color comparison table to determine a preset color corresponding to the terminal number;

[0139] The repaired virtual stone is filled with color based on the preset color, and a historical repair record entry is generated based on the repaired virtual stone.

[0140] For example, in this embodiment, each repair end has a number. When the repair end completes the repair of the real stone to be repaired, it will send a repair completion signal. When the server receives the repair completion signal, it will obtain the terminal number of the repair end, and perform virtual filling based on the defect depth of the defect outline in the virtual stone to be repaired according to the repaired image, and obtain the repaired virtual stone after virtual filling. At this time, the server will call the color comparison table, which can be pre-set in the server. The content in the color comparison table is different terminal numbers and preset colors corresponding to different terminal numbers. The preset color corresponding to the terminal number is determined in the color comparison table, and then the repaired virtual stone is filled with the preset color. In this way, it can be clearly seen which repair end has completed the repair of each repaired virtual stone, and a historical repair record entry is generated according to the repaired virtual stone for subsequent administrator viewing.

[0141] Furthermore, the above-mentioned “generating a historical restoration record entry based on the restored virtual stone” further includes the following steps:

[0142] Establishing an initial recording layer based on the repaired virtual stone, and generating a repair time area and a repair image area in the initial recording layer;

[0143] Obtaining a signal sending time of a repair completion signal sent by the repair end, and filling the signal sending time into the repair time area;

[0144] Filling the to-be-repaired image into a first sub-region of the repaired image region, and filling the repaired image into a second sub-region of the repaired image region, to generate a historical repair record entry;

[0145] A link relationship between the repaired virtual stone and the historical repair record entry is established, so that in response to any terminal's interaction with the repaired virtual stone, the historical repair record entry having a link relationship with the repaired virtual stone is retrieved and sent to any terminal for viewing.

[0146] For example, in this embodiment, when generating a historical repair record entry, the server first establishes an initial record layer based on the repaired virtual stone, and generates a repair time area and a repair image area in the initial record layer. At this time, the server obtains the signal sending time when the repair end sends a repair completion signal, and fills the signal sending time into the repair time area, fills the image to be repaired into the first sub-area of ​​the repair image area, and fills the repaired image into the second sub-area of ​​the repair image area, thereby generating a historical repair record entry.

[0147] After generating the historical repair record entry, the server will establish a link relationship between the repaired virtual stone and the historical repair record entry, so that when any terminal wants to view the historical repair record entry of the repaired virtual stone in the future, the server can retrieve the historical repair record entry with a link relationship with the repaired virtual stone after any terminal interacts with the repaired virtual stone, and send it to the terminal for viewing. This embodiment can facilitate the management end to view the historical repair record entry of the repaired virtual stone.

[0148] According to the solution of the present invention, firstly, a virtual site to be repaired corresponding to the actual site to be repaired can be constructed based on the digital twin data; and the scanning end can be controlled to perform a preliminary infrared scan on the actual site to be repaired, and then any real stone can be determined as the real stone to be repaired according to the preliminary scanning result, and the scanning end can be triggered to perform image acquisition on the real stone to be repaired to obtain the image to be repaired; then, the defect outline of the real stone to be repaired is determined based on the image to be repaired, and the scanning end is controlled to perform a deep infrared scan on the stone to be repaired based on the defect outline, so as to determine the defect depth of the real stone to be repaired, and then determine the real depth of the real stone to be repaired. Position; then, based on the real position, determine the virtual position corresponding to it in the virtual site to be repaired, and generate the virtual stone to be repaired corresponding to the real stone to be repaired at the virtual position in the virtual site to be repaired based on the defect depth and defect outline; when the management end interacts with the virtual site to be repaired, it will control the scanning end to perform repair processing on the real stone to be repaired, and after the repair processing is completed, it will determine the real stone to be repaired as the repaired real stone, and trigger the repair end to collect the image of the repaired stone to obtain the repaired image; finally, based on the repaired image, update the virtual stone to be repaired to obtain the repaired virtual stone. The present invention can accurately locate the specific position of the defective stone and repair it, which greatly improves the repair efficiency of the defective stone.

[0149] Another embodiment of the present invention provides an automatic repair and positioning system for defective stone. Figure 3 As the corresponding system block diagram, the system includes:

[0150] A preliminary scanning module is configured to control the scanning end to perform a preliminary infrared scan on the real site to be repaired, and in response to the scanning end determining any real stone located in the real site to be repaired as the real stone to be repaired based on the preliminary scanning result, trigger the scanning end to capture an image of the real stone to be repaired, so as to obtain an image to be repaired;

[0151] A depth scanning module is configured to determine the defect contour of the real stone to be repaired based on the image to be repaired, control the scanning end to perform a deep infrared scan on the stone to be repaired based on the defect contour, determine the defect depth of the real stone to be repaired, and obtain the real position of the real stone to be repaired;

[0152] A generating module is configured to determine a virtual position corresponding to the real position in the virtual site to be restored based on the real position, and generate a virtual stone to be restored corresponding to the real stone to be restored at the virtual position in the virtual site to be restored based on the defect depth and defect contour;

[0153] A repair module is configured to control the repair end to perform repair processing on the real stone to be repaired in response to the interaction of the management end with the virtual site to be repaired, and after completing the repair processing, determine the real stone to be repaired as the repaired real stone, and trigger the repair end to collect an image of the repaired stone to obtain a repaired image;

[0154] The updating module is configured to update the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone.

[0155] In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the examples of the present invention. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to implement the content of the present invention described herein, and the above description of specific languages ​​is for the purpose of disclosing the preferred embodiment of the present invention.

[0156] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0157] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: that the claimed invention requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0158] Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in the devices described in the embodiment, or alternatively may be located in one or more devices different from the devices in the examples. The modules in the foregoing examples may be combined into one module or may be divided into multiple submodules.

[0159] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and further may be divided into a plurality of submodules or subunits or subcomponents. All features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device so disclosed may be combined in any combination, except that at least some of such features and / or processes or units are mutually exclusive. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0160] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0161] In addition, some of the embodiments are described herein as methods or combinations of method elements that can be implemented by a processor of a computer system or by other devices that perform the functions. Therefore, a processor with necessary instructions for implementing the method or method elements forms a device for implementing the method or method elements. In addition, the elements described herein of the device embodiments are examples of devices for implementing the functions performed by the elements for the purpose of implementing the invention.

[0162] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved, and is not intended to imply that the objects so described must have a given order in time, space, order, or in any other manner.

[0163] Although the present invention has been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or defining the subject matter of the present invention. Therefore, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is illustrative and not restrictive with respect to the scope of the present invention, and the scope of the present invention is defined by the appended claims.

Claims

1. A method for automatically repairing and positioning defective stone, characterized in that: The following steps are involved: Construct a virtual site to be restored that corresponds to the actual site to be restored; Controlling the scanning end to perform a preliminary infrared scan on the real site to be restored, and in response to the scanning end determining any real stone located in the real site to be restored as the real stone to be restored, triggering the scanning end to capture an image of the real stone to be restored, and obtaining an image to be restored; Determine the defect outline based on the image to be repaired, control the scanning end to perform deep infrared scanning based on the defect outline, determine the defect depth, and obtain the actual position of the actual stone to be repaired; Determine a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generate a corresponding virtual stone to be repaired at the virtual position based on the defect depth and defect contour; In response to the interaction of the management end with the virtual site to be repaired, the repair end is controlled to perform a repair process on the real stone to be repaired, after the repair process is completed, the real stone to be repaired is determined as a repaired real stone, and the repair end is triggered to collect an image of the repaired real stone to obtain a repaired image; The virtual stone to be repaired is updated based on the repaired image to obtain a repaired virtual stone; The method of updating the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone includes: In response to a repair completion signal sent by the repair end, the terminal number of the repair end is obtained, and based on the repaired image, the defect contour in the virtual stone to be repaired is virtually filled based on the defect depth to obtain a repaired virtual stone; Retrieving a color comparison table, wherein the color comparison table includes different terminal numbers and preset colors corresponding to the different terminal numbers; Traversing the color comparison table to determine a preset color corresponding to the terminal number; Filling the restored virtual stone with color based on the preset color, and generating a historical restoration record entry based on the restored virtual stone; The step of generating a historical restoration record entry based on the restored virtual stone comprises: Establishing an initial recording layer based on the repaired virtual stone, and generating a repair time area and a repair image area in the initial recording layer; Obtaining a signal sending time of a repair completion signal sent by the repair end, and filling the signal sending time into the repair time area; Filling the to-be-repaired image into a first sub-region of the repaired image region, and filling the repaired image into a second sub-region of the repaired image region, to generate a historical repair record entry; A link relationship between the repaired virtual stone and the historical repair record entry is established, so that in response to any terminal's interaction with the repaired virtual stone, the historical repair record entry having a link relationship with the repaired virtual stone is retrieved and sent to any terminal for viewing.

2. The automatic repair and positioning method for defective stone according to claim 1 is characterized in that: The real site to be repaired includes real floor areas located on different real floors and real stair areas between adjacent real floors, and the virtual site to be repaired includes virtual floor areas corresponding to the real floor areas and virtual stair areas corresponding to the real stair areas. The scanning end includes a manual scanning end and a machine scanning end, and the repairing end includes a manual repairing end and a machine repairing end; In response to the scanning end determining any real stone located in the real site to be repaired as the real stone to be repaired, the scanning end is triggered to collect an image of the real stone to be repaired to obtain the image to be repaired, including: In response to the result of the infrared scanning performed by the manual scanning end on any stone in each real staircase area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the manual scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired; and / or In response to the result of the infrared scanning performed by the machine scanning end on any real stone in each real layer area being confirmed as a defect, the real stone is determined as the real stone to be repaired, and the machine scanning end is triggered to collect an image of the real stone to be repaired to obtain an image to be repaired; The repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired, including: The artificial repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual staircase area; and / or The machine repair end performs a repair process on the real stone to be repaired in response to the generation of the virtual stone to be repaired in the virtual plane area.

3. The automatic repair and positioning method for defective stone according to claim 1, characterized in that: Controlling the scanning end to perform a preliminary infrared scan on the actual site to be repaired, and in response to the scanning end determining any actual stone located in the actual site to be repaired as the actual stone to be repaired, triggering the scanning end to collect an image of the actual stone to be repaired to obtain an image to be repaired, including: Based on the scanning signal, the scanning end is controlled to perform a preliminary infrared scan based on the infrared scanning points on the actual site to be repaired, and the infrared scanning distance corresponding to the infrared scanning points is obtained in real time; When the infrared scanning distance is greater than the preset distance, the positioning information of the infrared scanning point is determined, and a real site coordinate system is established based on the real site to be repaired; Determine the scanning coordinate point corresponding to the positioning information in the real site coordinate system based on the positioning information, and determine the coordinate intervals occupied by all the real stones located in the real site to be repaired in the real site coordinate system; The real stone corresponding to the coordinate interval containing the scanning coordinate point is determined as the real stone to be repaired, the scanning end is triggered to illuminate the infrared scanning point, and the image of the real stone to be repaired is collected to obtain the image to be repaired.

4. The automatic repair and positioning method for defective stone according to claim 3 is characterized in that: The size of the actual stone is smaller than the image acquisition size of the scanning end; The scanning end is triggered to illuminate the infrared scanning point, and an image of the real stone to be repaired is collected to obtain the image to be repaired, including: Triggering a lighting unit pre-installed on the scanning end to illuminate the infrared scanning point, and performing image acquisition with the infrared scanning point as the image center point to obtain an initial image; Identify the initial image, determine each stone edge line in the initial image, and determine each enclosed area based on each stone edge line; Based on the relative positional relationship between each enclosed area and the infrared scanning point, the enclosed area including the infrared scanning point is determined as the target area, and the stone edge line constituting the target area is determined as the target edge line; When the target edge line is a closed line segment, the region center point of the target region is determined, and the scanning end is controlled to perform image acquisition with the region center point as the image center point to obtain the image to be repaired.

5. The automatic repair and positioning method for defective stone according to claim 4, characterized in that: When the target edge line is a non-closed line segment, determining a first edge line and a second edge line constituting the target edge line and forming a preset angle; Based on the preset angle, the center line of the angle is determined, and the scanning end is controlled to move in the extension direction of the center line of the angle. When the target edge line is moved to the point where the target edge line and other edge lines are combined into a closed line segment, the center point of the area surrounded by the closed line segment is determined, and the scanning end is controlled to perform image acquisition with the center point of the area as the center point of the image to obtain the image to be repaired.

6. The automatic repair and positioning method for defective stone according to claim 5, characterized in that: Determining the defect outline based on the image to be repaired, controlling the scanning end to perform deep infrared scanning based on the defect outline to determine the defect depth, and obtaining the actual position of the actual stone to be repaired, including: Performing image recognition on the image to be repaired based on a pre-trained image recognition model to determine a defect contour including the infrared scanning point; Adding an external regular pattern based on the defect contour; Controlling the scanning end to perform a deep infrared scan based on the external regular image, determining a graphic depth of the external regular graphic based on a result of the deep scanning, and determining a defect depth of the defect contour based on the graphic depth; The position of the center point of the area is determined as the actual position of the actual stone to be repaired.

7. The automatic repair and positioning method for defective stone according to claim 6, characterized in that: Determining a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generating a corresponding virtual stone to be repaired at the virtual position based on the defect depth and defect contour, including: Acquire the real center coordinate point of the center point of the area based on the real site coordinate system; Establishing a virtual site coordinate system based on the virtual site to be restored; Based on the correspondence between the real site coordinate system and the virtual site coordinate system, determining a virtual center coordinate point corresponding to the real center coordinate point in the virtual site coordinate system, and determining the virtual center coordinate point as the virtual position; Generate a virtual stone outline corresponding to the stone size of the real stone based on the virtual position; The virtual stone contour is updated based on the defect contour and the defect depth to obtain a virtual stone to be repaired corresponding to the real stone to be repaired.

8. An automatic repair and positioning system for defective stone, characterized in that: include: A construction module is configured to construct a virtual site to be restored corresponding to the actual site to be restored; The preliminary scanning module is configured to control the scanning end to perform a preliminary infrared scan on the real site to be restored, and in response to the scanning end determining any real stone located in the real site to be restored as the real stone to be restored, trigger the scanning end to capture an image of the real stone to be restored, and obtain an image to be restored; A depth scanning module is configured to determine the defect contour based on the image to be repaired, control the scanning end to perform a deep infrared scan based on the defect contour, determine the defect depth, and obtain the actual position of the actual stone to be repaired; A generating module is configured to determine a virtual position corresponding to the real position in the virtual site to be repaired based on the real position, and generate a corresponding virtual stone to be repaired at the virtual position based on the defect depth and defect contour; The repair module is configured to control the repair end to perform repair processing on the real stone to be repaired in response to the interaction of the management end with the virtual site to be repaired, determine the real stone to be repaired as the repaired real stone after completing the repair processing, and trigger the repair end to collect an image of the repaired real stone to obtain a repaired image; An updating module is configured to update the virtual stone to be repaired based on the repaired image to obtain a repaired virtual stone; The method of updating the virtual stone to be repaired based on the repaired image to obtain the repaired virtual stone includes: In response to a repair completion signal sent by the repair end, the terminal number of the repair end is obtained, and based on the repaired image, the defect contour in the virtual stone to be repaired is virtually filled based on the defect depth to obtain a repaired virtual stone; Retrieving a color comparison table, wherein the color comparison table includes different terminal numbers and preset colors corresponding to the different terminal numbers; Traversing the color comparison table to determine a preset color corresponding to the terminal number; Filling the restored virtual stone with color based on the preset color, and generating a historical restoration record entry based on the restored virtual stone; The step of generating a historical restoration record entry based on the restored virtual stone comprises: Establishing an initial recording layer based on the repaired virtual stone, and generating a repair time area and a repair image area in the initial recording layer; Obtaining a signal sending time of a repair completion signal sent by the repair end, and filling the signal sending time into the repair time area; Filling the to-be-repaired image into a first sub-region of the repaired image region, and filling the repaired image into a second sub-region of the repaired image region, to generate a historical repair record entry; A link relationship between the repaired virtual stone and the historical repair record entry is established, so that in response to any terminal's interaction with the repaired virtual stone, the historical repair record entry having a link relationship with the repaired virtual stone is retrieved and sent to any terminal for viewing.