Work order auditing method, device and equipment and computer readable storage medium

Abstract

The application relates to the field of human-computer interaction, and provides a work order auditing method and device, equipment and a computer readable storage medium. The work order auditing method comprises the following steps: acquiring a global positioning information sequence, an indoor positioning information sequence and an augmented reality picture corresponding to a to-be-processed work order; determining an offset value of the global positioning information sequence and the indoor positioning information sequence; determining a position auditing result of the to-be-processed work order based on the augmented reality picture and the offset value; determining an image auditing result of the to-be-processed work order according to a field image and an indoor coordinate sequence corresponding to the to-be-processed work order; determining a signature auditing result of the to-be-processed work order according to a signature coordinate sequence corresponding to the to-be-processed work order; and determining an auditing result of the to-be-processed work order based on the position auditing result, the image auditing result and the signature auditing result. The application solves the problem that the work order processing information may be forged, and improves the accuracy of work order processing information auditing.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction, specifically to a work order auditing method, apparatus, equipment, and computer-readable storage medium. Background Technology

[0002] Currently, the processing status of installation and maintenance work orders cannot be monitored in real time. Work order auditors can only conduct manual audits after staff submit on-site photos, equipment photos, and customer signatures. However, auditors can only perform basic information comparisons based on the customer's application materials and the work order information submitted by staff, and cannot determine the authenticity of the work order processing status. The work order information provided by staff may contain false home visits, photoshopped images, forged signatures, etc., and lacks real-time geographic information, posing a risk of providing fraudulent services. Summary of the Invention

[0003] This application provides a work order auditing method, apparatus, equipment, and computer-readable storage medium to solve the technical problem of inaccurate work order auditing in existing systems.

[0004] In a first aspect, embodiments of this application provide a work order auditing method, including:

[0005] Acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality imagery corresponding to the work orders to be processed;

[0006] Determine the offset values ​​of the global positioning information sequence and the indoor positioning information sequence, and determine the location audit result of the work order to be processed based on the augmented reality image and the offset values;

[0007] Based on the on-site images and indoor coordinate sequences corresponding to the work order to be processed, determine the image audit results of the work order to be processed;

[0008] Based on the signature coordinate sequence corresponding to the work order to be processed, determine the signature audit result of the work order to be processed;

[0009] Based on the location audit results, the image audit results, and the signature audit results, the audit results of the work order to be processed are determined.

[0010] In one embodiment, determining the offset values ​​between the global positioning information sequence and the indoor positioning information sequence includes:

[0011] Determine the distance between the coordinate points of the global positioning information sequence and the indoor positioning information sequence;

[0012] Based on the distance between the coordinate points, determine the average correlation distance between the global positioning information sequence and the indoor positioning information sequence;

[0013] The offset values ​​of the global positioning information sequence and the indoor positioning information sequence are determined based on the average correlation distance.

[0014] In one embodiment, determining the coordinate distance between the global positioning information sequence and the indoor positioning information sequence includes:

[0015] Determine the first coordinate in the global positioning information sequence and the second coordinate in the indoor positioning information sequence;

[0016] Based on the preset distance parameter, the first coordinate, and the second coordinate, the distance between the coordinate points of the first coordinate and the second coordinate is determined.

[0017] In one embodiment, determining the location audit result of the work order to be processed based on the augmented reality image and the offset value includes:

[0018] Determine the average pixel distance of the target straight line in the augmented reality image, and convert the average pixel distance into the actual physical distance;

[0019] The location audit result of the work order to be processed is determined based on the actual physical distance and the offset value.

[0020] In one embodiment, determining the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed includes:

[0021] Based on the indoor coordinate sequence corresponding to the work order to be processed, determine the average coordinate difference.

[0022] Based on the on-site image corresponding to the work order to be processed, determine the parameter difference values ​​of the overlapping area;

[0023] Based on the mean coordinate difference and the parameter difference value of the overlapping area, the image audit result of the work order to be processed is determined.

[0024] In one embodiment, determining the signature verification result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed includes:

[0025] Based on the signature coordinate sequence corresponding to the work order to be processed, determine the maximum difference value of the coordinate vector;

[0026] Based on the maximum difference value of the coordinate vector and the preset straight-line distance of the return order's field of view, the signature verification result of the work order to be processed is determined.

[0027] In one embodiment, after determining the location audit result of the work order to be processed based on the augmented reality image and the offset value, the process includes:

[0028] If the location audit result is passed, the image audit result of the work order to be processed is determined based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed;

[0029] If the image audit result is passed, the signature audit result of the work order to be processed is determined according to the signature coordinate sequence corresponding to the work order to be processed;

[0030] If the signed audit result is approved, the audit result of the pending work order is determined to be approved.

[0031] Secondly, embodiments of this application provide a work order auditing device, comprising:

[0032] The acquisition module is used to acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality imagery corresponding to the work order to be processed.

[0033] The location audit result determination module is used to determine the offset value between the global positioning information sequence and the indoor positioning information sequence, and to determine the location audit result of the work order to be processed based on the augmented reality image and the offset value.

[0034] The image audit result determination module is used to determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed;

[0035] The signature audit result determination module is used to determine the signature audit result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed;

[0036] The audit result determination module is used to determine the audit result of the work order to be processed based on the location audit result, the image audit result, and the signature audit result.

[0037] Thirdly, embodiments of this application provide an apparatus including a processor and a memory storing a computer program, wherein the processor executes the computer program to implement the work order auditing method described in the first aspect.

[0038] Fourthly, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the work order auditing method as described above.

[0039] The work order auditing method, apparatus, equipment, and computer-readable storage medium provided in this application embodiment acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality image corresponding to the work order to be processed. It determines the offset values ​​of the global positioning information sequence and the indoor positioning information sequence. Based on the augmented reality image and the determined offset values, it determines the location auditing result of the work order to be processed. Based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed, it determines the image auditing result of the work order to be processed. Based on the signature coordinate sequence corresponding to the work order to be processed, it determines the signature auditing result of the work order to be processed. Finally, based on the location auditing result, image auditing result, and signature auditing result, it determines the auditing result of the work order to be processed. This solves the problem of potential forgery of work order processing information and improves the accuracy of work order processing information auditing. Attached Figure Description

[0040] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] Figure 1 This is one of the flowcharts illustrating the work order auditing method provided in the embodiments of this application;

[0042] Figure 2 This is the second flowchart illustrating the work order auditing method provided in the embodiments of this application;

[0043] Figure 3 This is a schematic diagram of the work order auditing device provided in the embodiments of this application;

[0044] Figure 4 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0045] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0046] Reference Figure 1 , Figure 1 This is one of the flowcharts illustrating the work order auditing method in this application. The work order auditing method provided in this application may include:

[0047] Step 100: Obtain the global positioning information sequence, indoor positioning information sequence, and augmented reality image corresponding to the work order to be processed;

[0048] Specifically, the GPS (Global Positioning System) information sequence of the personnel processing the installation and maintenance work orders (i.e., the work orders to be processed in this embodiment) is collected in real time, which is the global positioning information sequence in this embodiment. The UWB (Ultra Wide Band) indoor spatial positioning information sequence is collected in real time, which is the indoor positioning information sequence in this embodiment. The corresponding AR (Augmented Reality) images of the work orders to be processed are obtained in real time, which is the augmented reality images in this embodiment.

[0049] Step 200: Determine the offset values ​​of the global positioning information sequence and the indoor positioning information sequence; based on the augmented reality image and the offset values, determine the location audit result of the work order to be processed.

[0050] Specifically, the global positioning information sequence Loc corresponding to the work order to be processed is collected in real time, and the Loc coordinate sequence {(lat1, lon1), (lat2, lon2), (lat1, lon1)} is collected. i lon i ), ..., (lat N lon N)}, where N is the total number of coordinates collected, for example, 60. To ensure sufficient data collection, the time interval between collections should not be too long, for example, once every 5 seconds; real-time collection of indoor positioning information sequence Pos corresponding to the work order to be processed, where Pos coordinate sequence {(lat'1, lon'1), (lat'2, lon'2), (lat'... j ,lon' j ), ..., (lat' N ,lon' N )}.

[0051] The distance between a coordinate point in the global positioning information sequence and a coordinate point in the indoor positioning information sequence is calculated. After defining a method for measuring the distance between the two coordinate points, the data correlation between the Loc and Pos sequences is calculated. Dynamic Time Warping (DTW) distance is used to measure the data correlation; the smaller the DTW distance, the more similar the two sequences are. The offset is calculated by averaging the correlation distances between the Loc and Pos sequences.

[0052] Next, calculate the straight-line distance within the AR screen, and draw a horizontal straight line H in real time, using the center point of the AR screen as the dividing line. line H line These are three coordinate points: left, center, and right. These three coordinate points are the endpoints of a straight line drawn from top to bottom on the AR screen. line and put the straight line V line It is placed in real-time at the very bottom of the AR screen, meaning it has only one bottom coordinate, which is the origin of the straight line. (Using H...) line and V line Based on the coordinates of the AR image and its width and height, the pixel distances of the three lines are calculated using the Euclidean distance formula in two dimensions. The average value of the three lines is then calculated, and finally, the actual physical distance (AP) is converted from the actual distances corresponding to the pixels. avg LP offset These are two coordinate offset values, Loc and Pos, where LP... offset As the diameter of the circle, construct an actual circle LP. circle The center of the circle represents the actual location of the person corresponding to the work order to be processed. If AP avg In LP circle If the location of the work order to be processed is determined, the audit result is "audit passed".

[0053] Step 300: Determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed;

[0054] Specifically, UWB indoor spatial coordinates are overlaid on the background of the on-site equipment photograph corresponding to the work order to be processed. The indoor spatial coordinate sequence information is {(x1, y1), (x2, y2), x i y i ), ..., (x N y N The sequence is defined as follows: N = 10 intervals, with UWB indoor spatial coordinates collected every 2 seconds. A two-dimensional array S2 is formed by calculating the difference between consecutive coordinate points in the indoor spatial coordinate sequence. The maximum value S in S2 is then determined. max and minimum value S min By calculating S max and S min average difference S mod The difference in parameters of the overlapping area is calculated by overlaying two coordinateless images. This is because the coordinates do not change significantly when the equipment is being photographed on-site. mod If the mean distance between two coordinateless site images is relatively small, then the SSIM (Structural Similarity) exponential algorithm is used to calculate the difference value S between them. diffThe value of SSIM ranges from [-1, 1]. A value of 1 indicates perfect similarity, while a smaller value indicates a lower similarity. diff ≤S mod If so, the image audit result of the work order to be processed is determined to be audit passed.

[0055] Step 400: Determine the signature audit result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed;

[0056] Specifically, AR visuals are used to track the handwriting pen grip actions corresponding to the work orders to be processed in real time. A two-dimensional coordinate system is constructed synchronously through the AR visuals. This two-dimensional coordinate system is distinct from that of the stylus and screen touch points, which are vertically sensed. In this embodiment, the two-dimensional coordinate system is constructed through horizontal projection of the AR visuals, a horizontal projection method suitable for constructing non-touchpoint two-dimensional coordinate systems. By tracking the specific position of the pen grip action in real time and synchronously recording the position information in the coordinate system, the two-dimensional coordinate system of the pen grip action is represented as Hos. In this embodiment, Chebyshev distance is used to calculate the maximum difference between two vectors in the coordinate dimension. If this difference is less than the straight-line distance of the work order's view, the signature verification result of the work order to be processed is determined to be verified as approved.

[0057] Step 500: Based on the location audit result, the image audit result, and the signature audit result, determine the audit result of the work order to be processed.

[0058] If the location audit, image audit, and signature audit all pass, the audit result of the work order to be processed is determined to be passed. That is, if any one of these audits fails, the audit result of the work order to be processed is determined to be failed. This resolves the potential for forgery of work order processing information and improves the accuracy of work order processing information audits.

[0059] This embodiment obtains the global positioning information sequence, indoor positioning information sequence, and augmented reality image corresponding to the work order to be processed, determines the offset value of the global positioning information sequence and the indoor positioning information sequence, determines the location verification result of the work order to be processed based on the augmented reality image and the determined offset value, determines the image verification result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed, determines the signature verification result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed, and finally determines the verification result of the work order to be processed based on the location verification result, image verification result, and signature verification result. This solves the problem of possible forgery of work order processing information and improves the accuracy of work order processing information verification.

[0060] In one embodiment, the work order auditing method provided in this application may further include:

[0061] Step 210: Determine the coordinate distance between the global positioning information sequence and the indoor positioning information sequence;

[0062] Step 220: Based on the distance between the coordinate points, determine the average correlation distance between the global positioning information sequence and the indoor positioning information sequence;

[0063] Step 230: Determine the offset value between the global positioning information sequence and the indoor positioning information sequence based on the average correlation distance.

[0064] Specifically, the distance DIS between coordinate point i in the global positioning information sequence and coordinate point j in the indoor positioning information sequence is calculated using Formula 1. i,j Where R is the Earth's radius; after defining the distance metric between two coordinate points, the data correlation between the Loc and Pos sequences is calculated. Dynamic Time Warping (DTW) distance is used to measure the data correlation; the smaller the DTW distance, the more similar the two sequences are. The DTW distance is calculated using Formula 2, where i∈Loc, j∈Pos. The offset is calculated based on the average correlation distance between the Loc and Pos sequences, and then the average correlation distance between the two Loc and Pos sequences.

[0065]

[0066]

[0067] This embodiment solves the problem of potential location forgery in work order processing information by determining the offset values ​​of the global positioning information sequence and the indoor positioning information sequence, and then determining the location audit result of the work order to be processed based on the offset values, thereby improving the accuracy of location audit of work order processing information.

[0068] In one embodiment, the work order auditing method provided in this application may further include:

[0069] Step 211: Determine the first coordinate in the global positioning information sequence and the second coordinate in the indoor positioning information sequence;

[0070] Step 212: Based on the preset distance parameter, the first coordinate and the second coordinate, determine the distance between the coordinate points of the first coordinate and the second coordinate.

[0071] Specifically, the distance DIS between coordinate point i (i.e., the first coordinate in this embodiment) in the global positioning information sequence and coordinate point j (i.e., the second coordinate in this embodiment) in the indoor positioning information sequence is calculated using Formula 1. i,j Where R is the Earth's radius, i.e., the preset distance parameter in this embodiment.

[0072] This embodiment solves the problem of potential location falsification in work order processing information by determining the distance between coordinate points of the global positioning information sequence and the indoor positioning information sequence, and then determining the location audit result of the work order to be processed based on the distance between coordinate points, thereby improving the accuracy of location audit of work order processing information.

[0073] In one embodiment, the work order auditing method provided in this application may further include:

[0074] Step 240: Determine the average pixel distance of the target straight line in the augmented reality image, and convert the average pixel distance into the actual physical distance;

[0075] Step 250: Determine the location audit result of the work order to be processed based on the actual physical distance and the offset value.

[0076] Specifically, the straight-line distance within the AR image is calculated by drawing a horizontal straight line H in real time, using the center point of the AR image as the dividing line. line H line These are three coordinate points: left, center, and right. These three coordinate points are the endpoints of a straight line drawn from top to bottom on the AR screen. line and put the straight line V line It is placed in real-time at the very bottom of the AR screen, meaning it has only one bottom coordinate, which is the origin of the straight line. (Using H...) line and V line Based on the coordinates of the AR image and its width and height, the pixel distances of the three straight lines (i.e., the target straight lines in this embodiment) are calculated using the Euclidean distance two-dimensional formula. The average value of the three straight lines (i.e., the average pixel distance in this embodiment) is then calculated. Finally, the actual physical distance (AP) is converted from the actual distances corresponding to the pixels. avg LP, that is, the actual physical distance in this embodiment. offset These are two coordinate offset values, Loc and Pos, where LP... offset As the diameter of the circle, construct an actual circle LP. circle The center of the circle represents the actual location of the person corresponding to the work order to be processed. If AP avg In LP circle If the location of the work order to be processed is determined, the audit result is "audit passed".

[0077] This embodiment uses augmented reality visuals and offset values ​​to determine the location verification result of the work order to be processed, thus solving the problem of potential location forgery in work order processing information and improving the accuracy of location verification of work order processing information.

[0078] Reference Figure 2 , Figure 2 This is a second flowchart illustrating the work order auditing method in this application. In one embodiment, the work order auditing method provided in this application may further include:

[0079] Step 310: Determine the average coordinate difference based on the indoor coordinate sequence corresponding to the work order to be processed;

[0080] Step 320: Determine the parameter difference values ​​of the overlapping area based on the on-site image corresponding to the work order to be processed;

[0081] Step 330: Based on the mean coordinate difference and the parameter difference value of the overlapping area, determine the image audit result of the work order to be processed.

[0082] Specifically, the background of the on-site equipment photograph corresponding to the work order is overlaid with UWB indoor spatial coordinates, resulting in an indoor spatial coordinate sequence information of {(x1, y1), (x2, y2), x i y i ), ..., (x N y N By calculating the difference between consecutive coordinate points in the indoor spatial coordinate sequence, a two-dimensional array S2 is formed, and the maximum value S in S2 is found. max and minimum value S mi By calculating S max and S min average difference S mod The difference between the two coordinate points is calculated using Formula 3.

[0083]

[0084]

[0085] The two-dimensional array S2 = (S) represents the difference between consecutive coordinate points in the indoor spatial coordinate sequence information. i S i-1 ,...,S N S N-1 S is calculated using Formula 4. mod .

[0086] The on-site equipment photos are transmitted back to the cloud via signals from nearby base stations, with the first and last background images transmitted back. UWB coordinate (x, y) data is synchronized five times at 2-second intervals. The cloud uses the background images and the five coordinate data transmitted from the edge to determine the coordinate positions. The first and last images have UWB coordinate (x, y) data superimposed on the background. A YOLOv5 object detection method is used to identify the coordinate positions, and a background forgery model is used to remove the UWB coordinate (x, y) region data, resulting in two on-site equipment photos without superimposed coordinates. The difference in parameters of the overlapping area is calculated by superimposing the two coordinate-free images. Because the coordinates do not change significantly when photographing the on-site equipment, S... mod If the mean distance between the two coordinate-free site images is relatively small, then the SSIM exponent algorithm is used to calculate the difference value S between them. diff The value of SSIM ranges from [-1, 1]. A value of 1 indicates perfect similarity, while a smaller value indicates a lower similarity. diff ≤S mod If so, the image audit result of the work order to be processed is determined to be audit passed.

[0087] This embodiment determines the image audit result of the work order to be processed by using the mean of coordinate difference and the parameter difference value of the overlapping area, which solves the problem of image forgery that may exist in the work order processing information and improves the accuracy of image audit of work order processing information.

[0088] In one embodiment, the work order auditing method provided in this application may further include:

[0089] Step 410: Determine the maximum difference value of the coordinate vector based on the signature coordinate sequence corresponding to the work order to be processed;

[0090] Step 420: Based on the maximum difference value of the coordinate vector and the preset straight-line distance of the return receipt view, determine the signature verification result of the work order to be processed.

[0091] Specifically, AR images are used to track the handwriting pen grip actions corresponding to the work orders to be processed in real time. A two-dimensional coordinate system is constructed synchronously through the AR images. This two-dimensional coordinate system is different from that of the stylus and screen touch points. The stylus and screen touch points are vertically sensed, while this embodiment constructs a two-dimensional coordinate system through horizontal projection of the AR images. This is a horizontal projection method, which is suitable for constructing non-touchpoint two-dimensional coordinate systems. By tracking the specific position of the pen grip action in real time, the real-time tracked pen grip action position information is synchronously recorded in the coordinate system. The two-dimensional coordinate system of the pen grip action is represented as Hos, and the coordinate sequence information of Hos is as follows: Hos={(x1,y1),(x2,y2),(x i ,y i ),...,(x N ,y N )}.

[0092] Hos(x,y)=max(|x1-x2|,|y1-y2|) Formula 5

[0093] This embodiment uses Chebyshev distance to calculate the maximum difference between two vectors in the coordinate dimension. This maximum difference is calculated using Formula 5. If the maximum difference is less than the straight-line distance of the receipt's field of view, the signature verification result of the work order is determined to be verified as passed. After the handwritten receipt verification is passed with a genuine signature, the handwritten receipt needs to be photographed perpendicular to the AR screen. At this point, the system will automatically send all the verification data to the cloud AI terminal. After the cloud AI terminal automatically verifies this data, it returns the work order result. The end-to-end interconnection verification of the work order's authenticity between the AR terminal and the cloud AI terminal is now complete.

[0094] This embodiment determines the signature verification result of the work order to be processed by using the maximum difference value of the coordinate vector and the preset straight-line distance of the return receipt view. This solves the problem of possible signature forgery in work order processing information and improves the accuracy of signature verification of work order processing information.

[0095] In one embodiment, the work order auditing method provided in this application may further include:

[0096] Step 301: If the location audit result is passed, determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed;

[0097] Step 401: If the image audit result passes, determine the signature audit result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed.

[0098] Step 501: If the signed audit result is approved, determine that the audit result of the pending work order is approved.

[0099] If the location audit, image audit, and signature audit all pass, the audit result of the pending work order is determined to be passed. That is, if any one of these audits fails, the audit result of the pending work order is determined to be failed. If the location audit passes, the image audit of the pending work order is checked; if the image audit passes, the signature audit of the pending work order is checked; and if the signature audit passes, the audit result of the pending work order is determined to be passed. This resolves the potential forgery problem of work order processing information and improves the accuracy of work order processing information auditing.

[0100] This embodiment solves the problem of potential forgery of work order processing information by using location verification, image verification, and signature verification, thereby improving the accuracy of work order processing information verification.

[0101] refer to Figure 3 , Figure 3 This is a schematic diagram of the work order auditing device in the embodiments of this application. The work order auditing device provided in the embodiments of this application is described below. The work order auditing device described below and the work order auditing method described above can be referred to in correspondence.

[0102] The acquisition module 301 is used to acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality image corresponding to the work order to be processed;

[0103] The location audit result determination module 302 is used to determine the offset value of the global positioning information sequence and the indoor positioning information sequence, and to determine the location audit result of the work order to be processed based on the augmented reality image and the offset value.

[0104] The image audit result determination module 303 is used to determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed;

[0105] The signature audit result determination module 304 is used to determine the signature audit result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed;

[0106] The audit result determination module 305 is used to determine the audit result of the work order to be processed based on the location audit result, the image audit result, and the signature audit result.

[0107] In one embodiment, the location audit result determination module includes:

[0108] A coordinate point distance determination unit is used to determine the coordinate point distance between the global positioning information sequence and the indoor positioning information sequence;

[0109] The correlation distance average determination unit is used to determine the correlation distance average between the global positioning information sequence and the indoor positioning information sequence based on the coordinate point distance;

[0110] The offset value determination unit is used to determine the offset value of the global positioning information sequence and the indoor positioning information sequence based on the average correlation distance.

[0111] In one embodiment, the coordinate point distance determination unit includes:

[0112] A coordinate determination unit is used to determine a first coordinate in the global positioning information sequence and a second coordinate in the indoor positioning information sequence;

[0113] The coordinate point distance determination unit is used to determine the coordinate point distance between the first coordinate and the second coordinate based on a preset distance parameter, the first coordinate, and the second coordinate.

[0114] In one embodiment, the location audit result determination module includes:

[0115] A distance conversion unit is used to determine the average pixel distance of a target line in the augmented reality image and convert the average pixel distance into the actual physical distance.

[0116] The location audit result determination unit is used to determine the location audit result of the work order to be processed based on the actual physical distance and the offset value.

[0117] In one embodiment, the image audit result determination module includes:

[0118] The coordinate difference mean determination unit is used to determine the coordinate difference mean based on the indoor coordinate sequence corresponding to the work order to be processed;

[0119] The overlapping area parameter difference value determination unit is used to determine the overlapping area parameter difference value based on the on-site image corresponding to the work order to be processed.

[0120] The image audit result determination unit is used to determine the image audit result of the work order to be processed based on the mean coordinate difference and the parameter difference value of the overlapping area.

[0121] In one embodiment, the signature verification result determination module includes:

[0122] The coordinate vector maximum difference value determination unit is used to determine the maximum difference value of the coordinate vector based on the signature coordinate sequence corresponding to the work order to be processed;

[0123] The signature audit result determination unit is used to determine the signature audit result of the work order to be processed based on the maximum difference value of the coordinate vector and the preset straight-line distance of the return receipt view.

[0124] In one embodiment, the work order auditing device includes:

[0125] The first determining module is used to determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed, if the location audit result is passed;

[0126] The second determining module is used to determine the signature verification result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed, if the image verification result is passed.

[0127] The third determining module is used to determine that the audit result of the pending work order is approved if the signed audit result is approved.

[0128] Figure 4 An example is a schematic diagram of the physical structure of a device, such as... Figure 4 As shown, the device may include a processor 410, a communication interface 420, a memory 430, and a communication bus 440. The processor 410, communication interface 420, and memory 430 communicate with each other via the communication bus 440. The processor 410 can call the computer program in the memory 430 to execute the work order auditing method.

[0129] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0130] On the other hand, embodiments of this application also provide a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the computer can execute the work order auditing method provided in the above embodiments.

[0131] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0132] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the work order auditing method described in various embodiments or some parts of embodiments.

[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A work order auditing method, characterized in that, include: Acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality imagery corresponding to the work orders to be processed; Determine the offset values ​​of the global positioning information sequence and the indoor positioning information sequence, and determine the location audit result of the work order to be processed based on the augmented reality image and the offset values; Based on the on-site images and indoor coordinate sequences corresponding to the work order to be processed, determine the image audit results of the work order to be processed; Based on the signature coordinate sequence corresponding to the work order to be processed, determine the signature audit result of the work order to be processed; Based on the location audit result, the image audit result, and the signature audit result, the audit result of the work order to be processed is determined; The step of determining the offset values ​​of the global positioning information sequence and the indoor positioning information sequence, and determining the location audit result of the work order to be processed based on the augmented reality image and the offset values, includes: Determine the distance between the coordinate points of the global positioning information sequence and the indoor positioning information sequence; Based on the distance between the coordinate points, determine the average correlation distance between the global positioning information sequence and the indoor positioning information sequence; Based on the average correlation distance, the offset values ​​of the global positioning information sequence and the indoor positioning information sequence are determined; Determine the average pixel distance of the target straight line in the augmented reality image, and convert the average pixel distance into the actual physical distance; The location audit result of the work order to be processed is determined based on the actual physical distance and the offset value.

2. The work order auditing method according to claim 1, characterized in that, Determining the coordinate distance between the global positioning information sequence and the indoor positioning information sequence includes: Determine the first coordinate in the global positioning information sequence and the second coordinate in the indoor positioning information sequence; Based on the preset distance parameter, the first coordinate, and the second coordinate, the distance between the coordinate points of the first coordinate and the second coordinate is determined.

3. The work order auditing method according to claim 1, characterized in that, The step of determining the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed includes: Based on the indoor coordinate sequence corresponding to the work order to be processed, determine the average coordinate difference. Based on the on-site image corresponding to the work order to be processed, determine the parameter difference values ​​of the overlapping area; Based on the mean coordinate difference and the parameter difference value of the overlapping area, the image audit result of the work order to be processed is determined.

4. The work order auditing method according to claim 1, characterized in that, The step of determining the signature verification result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed includes: Based on the signature coordinate sequence corresponding to the work order to be processed, determine the maximum difference value of the coordinate vector; Based on the maximum difference value of the coordinate vector and the preset straight-line distance of the return order's field of view, the signature verification result of the work order to be processed is determined.

5. The work order auditing method according to claim 1, characterized in that, After determining the location audit result of the work order to be processed based on the augmented reality image and the offset value, the process includes: If the location audit result is passed, the image audit result of the work order to be processed is determined based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed; If the image audit result is passed, the signature audit result of the work order to be processed is determined according to the signature coordinate sequence corresponding to the work order to be processed; If the signed audit result is approved, the audit result of the pending work order is determined to be approved.

6. A work order auditing device, characterized in that, include: The acquisition module is used to acquire the global positioning information sequence, indoor positioning information sequence, and augmented reality imagery corresponding to the work order to be processed. The location audit result determination module is used to determine the offset value between the global positioning information sequence and the indoor positioning information sequence, and to determine the location audit result of the work order to be processed based on the augmented reality image and the offset value. The image audit result determination module is used to determine the image audit result of the work order to be processed based on the on-site image and indoor coordinate sequence corresponding to the work order to be processed; The signature audit result determination module is used to determine the signature audit result of the work order to be processed based on the signature coordinate sequence corresponding to the work order to be processed; The audit result determination module is used to determine the audit result of the work order to be processed based on the location audit result, the image audit result, and the signature audit result. The step of determining the offset values ​​of the global positioning information sequence and the indoor positioning information sequence, and determining the location audit result of the work order to be processed based on the augmented reality image and the offset values, includes: Determine the distance between the coordinate points of the global positioning information sequence and the indoor positioning information sequence; Based on the distance between the coordinate points, determine the average correlation distance between the global positioning information sequence and the indoor positioning information sequence; Based on the average correlation distance, the offset values ​​of the global positioning information sequence and the indoor positioning information sequence are determined; Determine the average pixel distance of the target straight line in the augmented reality image, and convert the average pixel distance into the actual physical distance; The location audit result of the work order to be processed is determined based on the actual physical distance and the offset value.

7. An electronic device comprising a processor and a memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the work order auditing method according to any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the work order auditing method as described in any one of claims 1 to 5.

Images