Augmented reality data tagging tool

Abstract

The invention provides an augmented reality data labeling tool, and relates to the field of data analysis and computation.According to the augmented reality data labeling tool, the urban three-dimensional model road environment color needing to be labeled is converted from RGB to HSV through a computing module, then the computing module computes the hue most obviously compared with the hue value of Ha in a color circle through Hb = (Ha + 180 degrees) mod360 degrees, and the hue is compared with the hue value of Ha through the Hb = (Ha + 180 degrees) mod360 degrees; the method comprises the following steps: acquiring a hue value with the strongest contrast with the environment color of a road needing to be marked in a city three-dimensional model through a GUI (Graphical User Interface) module, calculating E = Hb / Ha by a calculation module, judging that E is more than 1.5 and less than or equal to 3, judging that the color difference is obvious if the judgment is passed, then converting the hue value with the strongest contrast into RGB (Red, Green, Blue) from HSV (Hue, Saturation and Value) by the calculation module, and transmitting the RGB value with the strongest contrast to the GUI module by a control center, the GUI module modifies the corresponding marking line color object, the color of the marking line is automatically adjusted through the algorithm so as to improve the visibility and the identification degree, and meanwhile it can be ensured that the calculated line color is obviously different from the environment color of the road needing to be marked in the urban three-dimensional model.

Description

Technical Field

[0001] The present invention relates to the field of data analysis and computing, and in particular to an augmented reality data annotation tool. Background Art

[0002] Augmented reality, or AR for short, is a technology that overlays digital information and virtual objects onto real-world views, thereby enhancing users’ perception and interaction with the real world. By using AR technology to combine real-time data with three-dimensional urban models, augmented reality technology can provide intuitive data visualization effects, enabling city managers and decision makers to more easily understand complex data sets and make more informed decisions based on them.

[0003] When conducting data analysis on a city's three-dimensional model, in order to facilitate data analysis, staff will use annotation tools, also known as GUI modules, to annotate each road. These annotations become clearer and more intuitive with the help of augmented reality technology. Road annotation is not only an important part of the city's three-dimensional model, but also a key link in data analysis. By combining real-time data with the city's three-dimensional model, augmented reality technology can provide intuitive data visualization effects, enabling city managers and decision makers to understand data sets more easily and make better decisions based on them. When annotating roads in the existing three-dimensional city model, the color of some annotated lines is similar to the environmental color of the road. Color confusion makes it difficult to distinguish the annotated lines. Insufficient visual contrast reduces the visibility of the annotated lines, affecting staff observations, thereby affecting the accuracy of data analysis, leading to misjudgment of road conditions or deviations in data analysis results, reducing the efficiency and accuracy of data collection, and hindering accurate data analysis.

[0004] Therefore, it is necessary to provide new augmented reality data annotation tools to solve the above technical problems. Summary of the invention

[0005] In order to solve the above technical problems, the present invention provides an augmented reality data annotation tool.

[0006] The augmented reality data annotation tool provided by the present invention includes a three-dimensional city model: an AR model for displaying pedestrian flow data on various roads in the city;

[0007] GUI module: used to label each road in the 3D city model;

[0008] Calculation module: The color of the road environment of the urban 3D model to be annotated is converted from RGB to HSV, and then the calculation module is b =(H a +180°)mod360°, calculate the value of H aThe hue with the most obvious contrast with the hue value in the color wheel is used to obtain the hue value with the strongest contrast with the environmental color of the road to be marked in the three-dimensional urban model. The calculation module calculates E=H b / H a , it is determined that 1.5<E≤3, if the determination is passed, the color difference is obvious, and then the calculation module converts the hue value with the strongest contrast from HSV to RGB, where Ha is the hue, Hb is the complementary hue of Ha, and E is the ratio of Hb to Ha;

[0009] Control center: used to control the operation of DBMS module and computing module;

[0010] DBMS module: used to store the data for establishing the urban three-dimensional model and the technical results of the calculation module.

[0011] Preferably, the three-dimensional city model is used to show the flow of people on each road to the staff, and the staff conducts data analysis.

[0012] Preferably, the control center calls out the environmental color of the road that needs to be marked in the three-dimensional urban model from the DBMS module, and transmits the environmental color to the calculation module.

[0013] Preferably, after receiving the ambient color transmitted by the DBMS module, the calculation module converts the RGB value of the ambient color of the road to be marked in the urban three-dimensional model into an HSV value through V=max(R, G, B), C=V-min(R, G, B) and S=C / V.

[0014] Preferably, when the calculation module converts the RGB value into the HSV value, if V=R, then H a =60°×((GB) / C)mod360°, if V=G, then H a =60°×((BR) / C)+120°, if V=B, then H a =60°×((RG) / C)+240°, if C=0, then H a =0.

[0015] Preferably, the calculation module is implemented by H b =(H a +180°)mod360°, calculate the hue value with the strongest contrast with the environmental color of the road to be marked in the urban 3D model, H a is the original hue value, H b H a The calculation module calculates E = H b / H a, and judge that 1.5<E≤3, if the judgment is passed, the color difference is obvious. If the judgment condition of 1.5<E≤3 is not passed, the calculation module will H b =(H a +180°) mod 360° is deleted, and then the calculation module performs H again. b =(H a +180°)mod360°, and the result of the second calculation is again subjected to the conditional judgment of 1.5<E≤3, and it is determined that the RGB value is converted by continuing to execute the HSV value conversion.

[0016] Preferably, the determination is made by the calculation module after H b The numerical values ​​of S and V establish the algorithm formula of C = V × S, X = C × (1-|(H / 60°) mod2-1|) and m = VC. If 0°≤H b <60°, then (R', G', B') = (C, X, 0), if 60° ≤ H b <120°, then (R', G', B') = (X, C, 0), if 120° ≤ H b <180°, then (R', G', B') = (0, C, X), if 180° ≤ H b <240°, then (R', G', B') = (0, X, C), if 240° ≤ H b <300°, then (R', G', B') = (X, 0, C), if 300° ≤ H b <360°, then (R', G', B') = (C, 0, X), and the HSV value is converted into the RGB value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model through R, G, B = R'+m, G'+m, B'+m. The calculation module transmits the calculated RGB value with the strongest contrast to the DBMS module.

[0017] Preferably, the control center is used to issue a color correction instruction to the GUI module according to the calculation result of the calculation module, and transmit the RGB value with the strongest contrast in the DBMS module to the GUI module.

[0018] Preferably, after receiving the RGB value with the strongest contrast called out by the control center from the DBMS module, the GUI module modifies the corresponding annotation line color object according to the received RGB data, thereby completing the automatic adjustment of the road marking line color of the urban three-dimensional model.

[0019] Compared with related technologies, the augmented reality data annotation tool provided by the present invention has the following beneficial effects:

[0020] 1. The present invention converts the color of the road environment of the urban three-dimensional model to be annotated from RGB to HSV through a calculation module, and then the calculation module converts the color of the road environment of the urban three-dimensional model to be annotated from RGB to HSV. b =(H a +180°)mod360°, calculate the value of H a The hue with the most obvious contrast with the hue value in the color wheel is used to obtain the hue value with the strongest contrast with the environmental color of the road to be marked in the three-dimensional urban model. The calculation module calculates E=H b / H a , it is determined that 1.5<E≤3, and if the determination is passed, the color difference is obvious. Then the calculation module converts the hue value with the strongest contrast from HSV to RGB, and then the control center transmits the RGB value with the strongest contrast to the GUI module, so that the GUI module modifies the corresponding annotation line color object to complete the automatic adjustment of the road marking line color of the urban three-dimensional model. The algorithm is used to automatically adjust the color of the annotation lines to improve visibility and recognition. At the same time, it can ensure that the calculated line color is significantly different from the environmental color of the road that needs to be annotated in the urban three-dimensional model. It not only significantly improves the intuitiveness and clarity of the annotation information, but also greatly promotes data analysis based on the urban three-dimensional model. Clearly visible annotation lines help improve the efficiency and accuracy of data collection, support accurate data analysis, and enhance the reliability of data analysis, providing strong support for decision-making in areas such as transportation planning and urban management.

[0021] 2. The present invention converts the RGB value of the environmental color of the road to be marked in the urban three-dimensional model into the HSV value through V=max(R, G, B), C=V-min(R, G, B) and S=C / V to obtain H, S and V. The calculation module calculates the H hue value through multiple judgment conditions such as V=R, then H=60°×((GB) / C)mod360°. Subsequently, the calculation module calculates the hue value through H b =(H a+180°)mod360° to calculate the hue value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model. The calculation module uses the algorithm formulas of C=V×S, X=C×(1-|(H / 60°)mod2-1|) and m=VC and multiple judgment conditions such as 0°≤H<60°, then (R', G', B')=(C, X, 0) or 60°≤H<120°, then (R', G', B')=(X, C, 0). At the same time, the calculation module converts the hue value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model into the RGB value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model through R, G, B=R'+m, G'+m, B'+m. Through the automated color adjustment process, the manual adjustment burden of the staff is significantly reduced, and the overall user experience is improved. By reducing the workload, improving work efficiency and enhancing work satisfaction, the operation process of the staff is optimized. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A system block diagram of the augmented reality data annotation tool provided by the present invention;

[0023] Figure 2 A flowchart of the augmented reality data annotation tool provided by the present invention;

[0024] Figure 3 This is a diagram of the operating principle of the augmented reality data annotation tool provided by the present invention. DETAILED DESCRIPTION

[0025] The present invention will be further described below in conjunction with the accompanying drawings and implementation modes.

[0026] Please refer to Figure 1 , Figure 2 as well as Figure 3 ,in, Figure 1 A system block diagram of the augmented reality data annotation tool provided by the present invention; Figure 2 A flowchart of the augmented reality data annotation tool provided by the present invention; Figure 3 This is a diagram of the operating principle of the augmented reality data annotation tool provided by the present invention.

[0027] In the specific implementation process, Figure 1 , Figure 2 as well as Figure 3 As shown, the augmented reality data annotation tool includes a three-dimensional city model: an AR model for displaying the pedestrian flow data of each road in the city;

[0028] GUI module: used to label each road in the 3D city model;

[0029] Calculation module: The color of the road environment of the urban 3D model to be annotated is converted from RGB to HSV, and then the calculation module is b =(H a +180°)mod360°, calculate the value of H a The hue with the most obvious contrast with the hue value in the color wheel is used to obtain the hue value with the strongest contrast with the environmental color of the road to be marked in the three-dimensional urban model. The calculation module calculates E=H b / H a , it is determined that 1.5<E≤3, if the determination is passed, the color difference is obvious, and then the calculation module converts the hue value with the strongest contrast from HSV to RGB, where Ha is the hue, Hb is the complementary hue of Ha, and E is the ratio of Hb to Ha;

[0030] Control center: used to control the operation of DBMS module and computing module;

[0031] DBMS module: used to store the data for establishing the urban three-dimensional model and the technical results of the calculation module.

[0032] The 3D model of the city is used to show the staff the flow of people on each road, and the staff conducts data analysis;

[0033] The control center calls out the environmental color of the road that needs to be marked in the city 3D model from the DBMS module, and transmits the environmental color to the calculation module;

[0034] After receiving the environmental color transmitted by the DBMS module, the calculation module converts the RGB value of the environmental color of the road to be marked in the urban three-dimensional model into an HSV value through V=max(R, G, B), C=V-min(R, G, B) and S=C / V;

[0035] When the calculation module converts RGB values ​​into HSV values, if V = R, then H a =60°×((GB) / C)mod360°, if V=G, then H a =60°×((BR) / C)+120°, if V=B, then H a =60°×((RG) / C)+240°, if C=0, then H a =0;

[0036] The calculation module is through H b =(H a +180°)mod360°, calculate the hue value with the strongest contrast with the environmental color of the road to be marked in the urban 3D model, H a is the original hue value, H b H a The calculation module calculates E = Hb / H a , and judge that 1.5<E≤3, if it is judged to be passed, the color difference is obvious;

[0037] If the judgment condition of 1.5<E≤3 is not passed, the calculation module will b =(H a +180°) mod 360° is deleted, and then the calculation module performs H again. b =(H a +180°)mod360°, and the result of the second calculation is again subjected to the condition judgment of 1.5<E≤3. If it is judged to pass, the HSV value conversion to RGB value is continued. If it is judged to fail again, a message is sent to the control center. After receiving the information that the calculation module fails the second judgment, the control center prompts the staff to perform maintenance on the calculation module.

[0038] After the judgment is passed, the calculation module passes H b The numerical values ​​of S and V establish the algorithm formula of C = V × S, X = C × (1-|(H / 60°) mod2-1|) and m = VC. If 0°≤H b <60°, then (R', G', B') = (C, X, 0), if 60° ≤ H b <120°, then (R', G', B') = (X, C, 0), if 120° ≤ H b <180°, then (R', G', B') = (0, C, X), if 180° ≤ H b <240°, then (R', G', B') = (0, X, C), if 240° ≤ H b <300°, then (R', G', B') = (X, 0, C), if 300° ≤ H b <360°, then (R', G', B') = (C, 0, X), and the HSV value is converted into the RGB value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model through R, G, B = R'+m, G'+m, B'+m, and the calculation module transmits the calculated RGB value with the strongest contrast to the DBMS module. 1 After receiving the environmental color transmitted by the DBMS module, the calculation module converts the RGB value of the environmental color of the road to be marked in the urban three-dimensional model into the HSV value through V = max(R, G, B), C = V-min(R, G, B) and S = C / V;

[0039] When the calculation module converts RGB values ​​into HSV values, if V = R, then H a =60°×((GB) / C)mod360°, if V=G, then H a=60°×((BR) / C)+120°, if V=B, then H a =60°×((RG) / C)+240°, if C=0, then H a =0;

[0040] If in H a =0, E = H b / H a If E is also equal to zero, skip this judgment condition and proceed directly to H b =(H a +180°)mod360° calculation;

[0041] The calculation module is through H b =(H a +180°)mod360°, calculate the hue value with the strongest contrast with the environmental color of the road to be marked in the urban 3D model, H a is the original hue value, H b H a The calculation module calculates E = H b / H a , and judge that 1.5<E≤3, if it is judged to be passed, the color difference is obvious;

[0042] If the judgment condition of 1.5<E≤3 is not passed, the calculation module will b =(H a +180°) mod 360° is deleted, and then the calculation module performs H again. b =(H a +180°)mod360°, and the result of the second calculation is again subjected to the condition judgment of 1.5<E≤3. If it is judged to pass, the HSV value conversion to RGB value is continued. If it is judged to fail again, a message is sent to the control center. After receiving the information that the calculation module fails the second judgment, the control center prompts the staff to perform maintenance on the calculation module.

[0043] After the judgment is passed, the calculation module establishes the algorithm formulas of C=V×S, X=C×(1-|(H / 60°)mod2-1|) and m=VC through the values ​​of Hb, S and V. If 0°≤Hb<60°, then (R', G', B')=(C, X, 0); if 60°≤Hb<120°, then (R', G', B')=(X, C, 0); if 120°≤Hb<180°, then (R', G', B')=(0, C, X); if 180°≤Hb<240°, Then (R', G', B') = (0, X, C), if 240°≤Hb<300°, then (R', G', B') = (X, 0, C), if 300°≤Hb<360°, then (R', G', B') = (C, 0, X), the HSV value is converted into the RGB value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model through R, G, B = R'+m, G'+m, B'+m, and the calculation module transmits the calculated RGB value with the strongest contrast to the DBMS module;

[0044] V represents the maximum brightness value, which is equal to the maximum value of the RGB three channels. C represents the color intensity or purity, which is equal to V minus the minimum value of the RGB three channels. S represents the saturation, which is equal to C divided by V. Ha is the hue, Hb is the complementary hue of Ha, E is the ratio of Hb to Ha, C here represents the color difference, which is equal to V multiplied by S, X is the auxiliary color difference, which is equal to C multiplied by 1-|(H / 60°mod2)-1|, and m is the minimum brightness value, which is equal to V minus C.

[0045] The control center is used to issue color correction instructions to the GUI module according to the calculation results of the calculation module, and transmit the RGB value with the strongest contrast in the DBMS module to the GUI module;

[0046] After receiving the RGB value with the strongest contrast from the DBMS module, the GUI module modifies the corresponding annotation line color object according to the received RGB data, and completes the automatic adjustment of the road marking line color of the urban three-dimensional model.

[0047] Comparison table of line colors of this application algorithm and manual line colors of prior art:

[0048]

[0049]

[0050] According to the above table, it can be concluded that the line color E marked by the algorithm of this application is greater than the line color E manually marked by the technology. According to the relationship table between the NBS unit color difference value and vision in the prior art, it can be known that the larger the value, the more obvious the color difference felt by the viewer, and the difference between the line color generated by the algorithm and the environmental color is more significant, so that the viewer can more clearly and quickly identify and distinguish the lines in any environment, greatly improving the readability and usability of the information. More importantly, the algorithm of this application can systematically ensure that the selection of line color not only meets the requirements of visual contrast, but also fully considers the perceptual characteristics of the human eye, avoiding the subjective deviation and inconsistency that may occur during manual adjustment, thereby improving the overall user experience and visual comfort.

[0051] The working principle provided by the present invention is as follows: when a staff member marks a road in a three-dimensional urban model, the control center calls out the environmental data of the road from the DBMS module, and transmits the RGB value of the environmental data to the calculation module. After receiving the RGB value of the environmental data transmitted by the DBMS module, the calculation module converts the RGB value of the environmental color of the road to be marked in the three-dimensional urban model into the HSV value through V=max(R, G, B), C=V-min(R, G, B) and S=C / V, and obtains HSV value. a , S and V, the calculation module passes V = R, then H a =60°×((GB) / C)mod360° or V=G, then H a =60°×((BR) / C)+120° or V=B, then H a =60°×((RG) / C)+240°, or C=0, then H a = 0 to calculate H a Calculate the hue value. The calculation module uses H b =(H a +180°)mod360°, calculate the value of H a The hue that contrasts most with the hue value in the color wheel, and E=H b / H a , and judge that 1.5<E≤3, if the judgment is passed, the color difference is obvious, and then the calculation module is calculated through C=V×S, X=C×(1-|(H a / 60°)mod2-1|) and the algorithm formula of m=VC and 0°≤H b <60°, then (R', G', B') = (C, X, 0) or 60° ≤ H b <120°, then (R', G', B') = (X, C, 0) or 120° ≤ H b<180°, then (R', G', B') = (0, C, X) or 180° ≤ H <240°, then (R', G', B') = (0, X, C) or 240° ≤ H b <300°, then (R', G', B') = (X, 0, C) or 300° ≤ H b <360°, then (R', G', B') = (C, 0, X) is used for calculation, and then the calculation module converts the hue value with the strongest contrast of the environmental color of the road to be marked in the urban three-dimensional model into the RGB value with the strongest contrast of the environmental color of the road to be marked in the urban three-dimensional model through R, G, B = R'+m, G'+m, B'+m, and the calculation module transmits the RGB value with the strongest contrast to the DBMS module. The control center calls the RGB value with the strongest contrast in the DBMS module into the GUI module. After receiving the RGB value with the strongest contrast transmitted by the DBMS module, the GUI module modifies the corresponding annotation line color object to complete the automatic adjustment of the road marking line color of the urban three-dimensional model.

[0052] The circuits and controls involved in the present invention are all prior art and will not be described in detail here.

[0053] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. Augmented reality data annotation tool, characterized by: include 3D city model: an AR model used to display traffic data on various roads in the city; GUI module: used to label each road in the 3D city model; Calculation module: The color of the road environment of the urban 3D model to be annotated is converted from RGB to HSV, and then the calculation module is b =(H a +180°)mod360°, calculate the value of H a The hue with the most obvious contrast with the hue value in the color wheel is used to obtain the hue value with the strongest contrast with the environmental color of the road to be marked in the three-dimensional urban model. The calculation module calculates E=H b / H a , it is determined that 1.5<E≤3, if the determination is passed, the color difference is obvious, and then the calculation module converts the hue value with the strongest contrast from HSV to RGB, where Ha is the hue, Hb is the complementary hue of Ha, and E is the ratio of Hb to Ha; Control center: used to control the operation of DBMS module and computing module; DBMS module: used to store the data for establishing the urban three-dimensional model and the technical results of the calculation module.

2. The augmented reality data annotation tool according to claim 1, characterized in that: The three-dimensional urban model is used to show the staff the flow of people on each road, and the staff conducts data analysis.

3. The augmented reality data annotation tool according to claim 2, characterized in that: The control center calls out the environmental colors of the roads that need to be marked in the three-dimensional urban model from the DBMS module, and transmits the environmental colors to the calculation module.

4. The augmented reality data annotation tool according to claim 3, characterized in that: After receiving the ambient color transmitted by the DBMS module, the calculation module converts the RGB value of the ambient color of the road to be marked in the urban three-dimensional model into an HSV value through V=max(R, G, B), C=V-min(R, G, B) and S=C / V.

5. The augmented reality data annotation tool according to claim 4, characterized in that: When the calculation module converts the RGB value into the HSV value, if V=R, then H a =60°×((GB) / C)mod360°, if V=G, then H a =60°×((BR) / C)+120°, if V=B, then H a =60°×((RG) / C)+240°, if C=0, then H a =0.

6. The augmented reality data annotation tool according to claim 5, characterized in that: The calculation module is implemented by H b =(H a +180°)mod360°, calculate the hue value with the strongest contrast with the environmental color of the road to be marked in the urban 3D model, H a is the original hue value, H b H a The calculation module calculates E = H b / H a , and judge that 1.5<E≤3, if the judgment is passed, the color difference is obvious. If the judgment condition of 1.5<E≤3 is not passed, the calculation module will H b =(H a +180°) mod 360° is deleted, and then the calculation module performs H again. b =(H a +180°)mod360°, and the result of the second calculation is again subjected to the conditional judgment of 1.5<E≤3, and it is determined that the RGB value is converted by continuing to execute the HSV value conversion.

7. The augmented reality data annotation tool according to claim 6, characterized in that: After the determination is passed, the calculation module calculates H b The numerical values ​​of S and V establish the algorithm formula of C = V × S, X = C × (1-|(H / 60°) mod2-1|) and m = VC. If 0°≤H b <60°, then (R', G', B') = (C, X, 0), if 60° ≤ H b <120°, then (R', G', B') = (X, C, 0), if 120° ≤ H b <180°, then (R', G', B') = (0, C, X), if 180° ≤ H b <240°, then (R', G', B') = (0, X, C), if 240° ≤ H b <300°, then (R', G', B') = (X, 0, C), if 300° ≤ H b <360°, then (R', G', B') = (C, 0, X), and the HSV value is converted into the RGB value with the strongest contrast with the environmental color of the road to be marked in the urban three-dimensional model through R, G, B = R'+m, G'+m, B'+m. The calculation module transmits the calculated RGB value with the strongest contrast to the DBMS module.

8. The augmented reality data annotation tool according to claim 7, characterized in that: The control center is used to issue a color correction instruction to the GUI module according to the calculation result of the calculation module, and transmit the RGB value with the strongest contrast in the DBMS module to the GUI module.

9. The augmented reality data annotation tool according to claim 8, characterized in that: After receiving the RGB value with the strongest contrast called out by the control center from the DBMS module, the GUI module modifies the corresponding annotation line color object according to the received RGB data, thereby completing the automatic adjustment of the road marking line color of the urban three-dimensional model.

Images