Highway alarm blocking method and system based on unmanned holographic technology

Abstract

The invention relates to the technical field of highway emergency, and discloses a highway alarm blocking method and system based on an unmanned holographic technology, and the method comprises the steps: receiving a real-time monitoring video of a to-be-detected road segment, and generating a safety road segment identifier or a suspected accident identifier or a highway accident identifier of the to-be-detected road segment; when the suspected accident identifier is generated, carrying out secondary analysis on the real-time monitoring video, and calculating a road accident coefficient of the road section to be detected; judging whether a road accident exists in the to-be-detected road section according to the road accident coefficient; when it is judged that the road accident exists in the to-be-detected road section, a holographic projection operation instruction is obtained, and a holographic projection area of the current environment is displayed; according to the method, the to-be-holographic-projected content is determined, the to-be-holographic-projected content is projected to the holographic projection area based on the analysis result, and the warning information light curtain is obtained, so that the warning information light curtain can be generated in time after an accident occurs on the expressway, the expressway is blocked, the emergency response efficiency and the intelligent level are improved, and the traffic continuity and safety are guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of highway emergency technology, and in particular to a highway alarm blocking method and system based on unmanned holographic technology. Background Art

[0002] Unmanned holographic technology is a new type of traffic management solution that combines advanced holographic imaging technology with unmanned driving technology. Holographic technology can reproduce three-dimensional images in a specific space without the existence of a physical entity through the interference and diffraction principles of light, and realize the display of virtual warning signs or blocking information. This technology can be displayed clearly under different weather and lighting conditions, with less visual impact on the driver, which helps to improve the warning effect.

[0003] After a traffic accident or a catastrophic accident such as a landslide, mountain torrent, or mudslide occurs on a highway, the accident is often expanded due to untimely warnings, and the following vehicles slow down or fail to avoid the accident. Especially at night, low visibility and bad weather conditions can easily further expand the scope of the accident. After the accident, emergency lane occupation, vehicle congestion, and other reasons can also hinder the rescue forces from arriving in the first place. The lessons learned from real accidents highlight the importance of highway early warning and blocking systems. Traditional traffic monitoring and accident response mechanisms can no longer fully meet the needs of quickly and efficiently handling traffic accidents. Especially in the event of a major traffic accident or emergency, how to quickly and effectively protect the scene, collect information, and block traffic has become an urgent problem to be solved. Summary of the invention

[0004] The embodiment of the present invention provides a highway alarm blocking method and system based on unmanned holographic technology, which can promptly activate the early warning mechanism and block the highway after an accident occurs on the highway, effectively preventing the occurrence of secondary accidents.

[0005] In order to achieve the above object, the present invention provides a highway alarm blocking method based on unmanned holographic technology, comprising:

[0006] Receiving a real-time monitoring video of a road section to be detected, analyzing the real-time monitoring video, and generating a safe road section mark or a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result;

[0007] When a suspected accident mark is generated, a secondary analysis is performed on the real-time monitoring video, and a highway accident coefficient of the road section to be detected is calculated based on the analysis result;

[0008] Determining whether there is a highway accident on the road section to be detected according to the highway accident coefficient;

[0009] When it is determined that there is a road accident on the road section to be detected, obtaining a holographic projection operation instruction, and displaying a holographic projection area of ​​the current environment in response to the holographic operation instruction;

[0010] The content to be holographically projected is determined, and the content to be holographically projected is analyzed, and based on the analysis result, the content to be holographically projected is projected to the holographic projection area to obtain a warning information light curtain.

[0011] Furthermore, when receiving the real-time monitoring video of the road section to be detected, it includes:

[0012] Control the video acquisition device to obtain video data files;

[0013] Receiving the video data files acquired by the video acquisition device in real time, and packaging the video data files into real-time monitoring videos;

[0014] Processing the real-time surveillance video, wherein the processing includes generating additional information for the real-time surveillance video, wherein the additional information includes date, time and geographic location;

[0015] The real-time monitoring video is transmitted to the video analysis module according to a preset transmission mode, wherein the transmission mode includes: transmission time and transmission path, and the transmission time includes real-time transmission or delayed transmission.

[0016] Furthermore, when analyzing the real-time monitoring video and generating a safe road section mark and a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result, it includes:

[0017] Performing a preliminary analysis on the real-time monitoring video to determine whether there is a moving vehicle in the real-time monitoring video;

[0018] If it does not exist, randomly extract a video frame of the real-time monitoring video and obtain a grayscale image corresponding to the video frame;

[0019] Determine the grayscale value of each pixel in the grayscale image and the grayscale values ​​of pixels around the pixel as real-time marking points;

[0020] Determine a standard grayscale image corresponding to the grayscale image, and determine the grayscale value of each pixel in the standard grayscale image and the grayscale values ​​of pixels around the pixel as standard marking points;

[0021] Calculate the grayscale value difference between each real-time marking point and the corresponding standard marking point, extract all real-time marking points with grayscale value difference greater than the preset value, and count the number of corresponding real-time marking points;

[0022] When the number of real-time marking points is greater than a preset number, a highway accident mark is generated;

[0023] If so, generating a timestamp for each video frame of the real-time surveillance video based on the acquisition time;

[0024] Determine a first video frame, obtain a corresponding plurality of moving vehicles, and generate first label information for each moving vehicle;

[0025] Determine an nth second video frame adjacent to the first video frame, obtain a corresponding plurality of moving vehicles, and generate second label information for each moving vehicle;

[0026] Determine whether there is repeated label information based on the first label information and the second label information, and if so, extract the repeated identification information to generate a specific mark;

[0027] Dividing the vehicle with the specific mark into regions to obtain a plurality of first vehicle regions;

[0028] Divide the moving vehicles carrying specific marks in the e-th video frame into position regions respectively to obtain a plurality of second vehicle regions, where 1<e<n;

[0029] respectively determining the area overlap between each second vehicle area and the first vehicle area, and constructing an area overlap set;

[0030] Determine whether the region overlap degrees in the region overlap set are all 0;

[0031] If yes, a safe road section mark is generated for the road section to be detected, and it is determined that there is no highway accident on the road section to be detected;

[0032] If not, the suspected accident mark is generated for the road section to be detected.

[0033] Furthermore, when performing a secondary analysis on the real-time monitoring video and calculating the highway accident coefficient of the road section to be detected based on the analysis result, it includes:

[0034] Extract all area overlaps that are not 0, and construct a second area overlap set;

[0035] Calculate a first calculated value and a second calculated value of the overlap degree of the second area;

[0036] Extracting all regional coincidences greater than the first calculated value, and constructing a third regional coincidence set;

[0037] Extracting all regional coincidences greater than the second calculated value, and constructing a fourth regional coincidence set;

[0038] Determine whether there is an intersection between the third region overlap degree set and the fourth region overlap degree set, and if so, extract and obtain a set to be processed;

[0039] If not, merging the third region overlap degree set and the fourth region overlap degree set to obtain a set to be processed;

[0040] Determine the maximum area overlap and the minimum area overlap in the set to be processed;

[0041] Configure the corresponding calculation weight for each area overlap;

[0042] The highway accident coefficient of the road section to be detected is calculated according to the following formula:

[0043]

[0044] Among them, p is the highway accident coefficient, n is the number of regional overlaps in the set to be processed, Δf i is the calculation weight corresponding to the overlap degree of the ith region in the set to be processed, f i is the overlap degree of the ith region in the set to be processed, f min is the minimum area overlap, f max is the maximum area overlap, For all The maximum value in .

[0045] Further, when judging whether there is a highway accident in the road section to be detected according to the highway accident coefficient, it includes:

[0046] Obtaining a preset highway accident coefficient, and judging whether there is a highway accident on the road section to be detected according to the relationship between the highway accident coefficient and the preset highway accident coefficient;

[0047] When the highway accident coefficient is less than the preset highway accident coefficient, it is determined that there is no highway accident on the road section to be detected;

[0048] When the highway accident coefficient is greater than or equal to the preset highway accident coefficient, it is determined that a highway accident exists in the road section to be detected.

[0049] Further, when the content to be holographically projected is parsed and the content to be holographically projected is projected onto the holographic projection area based on the parsing result, it includes:

[0050] Analyzing the content to be holographically projected, determining a projection rule, and projecting the content to be holographically projected to a comparison projection area based on the projection rule;

[0051] Analyze the projection data to obtain the light wave temporal coherence value and the light wave spatial coherence value of each frame of the content to be holographically projected in the projection data;

[0052] Determine the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determine the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table;

[0053] Adjusting the lightwave time coherence value based on the lightwave time evaluation value of each frame of the content to be holographically projected, and adjusting the space-time coherence value based on the space-time evaluation value of each frame of the content to be holographically projected;

[0054] Based on the adjusted light wave temporal coherence value and the adjusted space-time evaluation value, the content to be holographically projected is projected into the holographic projection area.

[0055] Further, when determining the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determining the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table, it includes:

[0056] Determine the first calculation coefficient and the second calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave time evaluation value table;

[0057] Determine the third calculation coefficient and the fourth calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave space evaluation value table;

[0058] The light wave time evaluation value of each frame of the content to be holographically projected is calculated according to the following formula:

[0059]

[0060] Among them, K1 is the light wave time evaluation value, m1 is the number of frames of the content to be holographically projected, d1 is the first calculation coefficient, d2 is the second calculation coefficient, R j is the temporal coherence value of the light wave of the j-th frame of the content to be holographically projected, R max is the maximum value of light wave temporal coherence;

[0061] The light wave space evaluation value of each frame of the content to be holographically projected is calculated according to the following formula:

[0062]

[0063] Among them, K2 is the light wave space evaluation value, d3 is the third calculation coefficient, d4 is the fourth calculation coefficient, W h is the spatial coherence value of the light wave of the h-th frame of the content to be holographically projected, W max is the maximum value of the spatial coherence of light waves.

[0064] Further, when the lightwave time coherence value is adjusted based on the lightwave time evaluation value of each frame of the content to be holographically projected, and the space-time coherence value is adjusted based on the space-time evaluation value of each frame of the content to be holographically projected, it includes:

[0065] If the lightwave time evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset lightwave time evaluation value, then the lightwave time coherence value of each frame of the content to be holographically projected is lowered so that the adjusted lightwave time coherence value of each frame is greater than the first preset lightwave time coherence value and less than the second preset lightwave time coherence value;

[0066] If the light wave time evaluation value of each frame of the content to be holographically projected is less than the preset light wave time evaluation value, then the light wave time coherence value of each frame of the content to be holographically projected is increased so that the adjusted light wave time coherence value of each frame is greater than the second preset light wave time coherence value;

[0067] If the light wave space evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset light wave space evaluation value, then the light wave space coherence value of each frame of the content to be holographically projected is lowered so that the adjusted light wave space coherence value of each frame is greater than the first preset light wave space coherence value and less than the second preset light wave space coherence value;

[0068] If the lightwave spatial evaluation value of each frame of the content to be holographically projected is less than the preset lightwave spatial evaluation value, the lightwave spatial coherence value of each frame of the content to be holographically projected is increased so that the adjusted lightwave spatial coherence value of each frame is greater than the second preset lightwave spatial coherence value.

[0069] In order to achieve the above object, the present invention also provides a highway alarm blocking system based on unmanned holographic technology, comprising:

[0070] The first module is used to receive the real-time monitoring video of the road section to be detected, analyze the real-time monitoring video, and generate a safe road section mark or a suspected accident mark for the road section to be detected based on the analysis result;

[0071] The second module is used to perform a secondary analysis on the real-time monitoring video when a suspected accident mark is generated, and calculate the highway accident coefficient of the road section to be detected based on the analysis result;

[0072] The third module is used to determine whether there is a highway accident in the road section to be detected according to the highway accident coefficient;

[0073] The fourth module is used to obtain a holographic projection operation instruction when it is determined that there is a highway accident in the road section to be detected, and display a holographic projection area of ​​the current environment in response to the holographic operation instruction;

[0074] The fifth module is used to determine the content to be holographically projected, and analyze the content to be holographically projected, and project the content to be holographically projected to the holographic projection area based on the analysis result to obtain a warning information light curtain.

[0075] Compared with the prior art, the present invention has the following beneficial effects:

[0076] Receive real-time monitoring video of the road section to be detected, and generate a safe section sign or a suspected accident sign or a highway accident sign for the road section to be detected based on the analysis results; when a suspected accident sign is generated, conduct a secondary analysis of the real-time monitoring video to calculate the highway accident coefficient of the road section to be detected; determine whether there is a highway accident on the road section to be detected based on the highway accident coefficient; when it is determined that there is a highway accident on the road section to be detected, obtain holographic projection operation instructions, and display the holographic projection area of ​​the current environment; determine the content to be holographically projected, and project the content to be holographically projected onto the holographic projection area based on the analysis results to obtain a warning information light curtain, which can generate a warning information light curtain in time after an accident occurs on the highway, and block the highway, thereby improving the efficiency and intelligence level of emergency response and ensuring the continuity and safety of traffic. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0078] Figure 1 A schematic flow chart of a highway alarm blocking method based on unmanned holographic technology in an embodiment of the present invention is shown;

[0079] Figure 2 A schematic diagram of the structure of a highway alarm blocking system based on unmanned holographic technology in an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0080] The specific implementation of the present invention is further described in detail below in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0081] In the description of the present application, it should be understood that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0082] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0083] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0084] The following is a description of preferred embodiments of the present invention with reference to the accompanying drawings.

[0085] like Figure 1 As shown, the embodiment of the present invention discloses a highway alarm blocking method based on unmanned holographic technology, comprising:

[0086] S110: receiving a real-time monitoring video of a road section to be detected, analyzing the real-time monitoring video, and generating a safe road section mark or a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result;

[0087] In some embodiments of the present application, when receiving a real-time monitoring video of a road section to be detected, the process includes:

[0088] Control the video acquisition device to obtain video data files;

[0089] Receiving the video data files acquired by the video acquisition device in real time, and packaging the video data files into real-time monitoring videos;

[0090] Processing the real-time surveillance video, wherein the processing includes generating additional information for the real-time surveillance video, wherein the additional information includes date, time and geographic location;

[0091] The real-time monitoring video is transmitted to the video analysis module according to a preset transmission mode, wherein the transmission mode includes: transmission time and transmission path, and the transmission time includes real-time transmission or delayed transmission.

[0092] In this embodiment, the video acquisition device is a camera.

[0093] The beneficial effect of the above technical solution is that the present invention generates additional information for the real-time monitoring video, which can ensure the accuracy of the real-time monitoring video and avoid transmission errors. At the same time, based on the set transmission method, the transmission efficiency and transmission diversification of the real-time monitoring video can be further ensured.

[0094] In some embodiments of the present application, when analyzing the real-time monitoring video and generating a safe road section mark and a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result, it includes:

[0095] Performing a preliminary analysis on the real-time monitoring video to determine whether there is a moving vehicle in the real-time monitoring video;

[0096] If it does not exist, randomly extract a video frame of the real-time monitoring video and obtain a grayscale image corresponding to the video frame;

[0097] Determine the grayscale value of each pixel in the grayscale image and the grayscale values ​​of pixels around the pixel as real-time marking points;

[0098] Determine a standard grayscale image corresponding to the grayscale image, and determine the grayscale value of each pixel in the standard grayscale image and the grayscale values ​​of pixels around the pixel as standard marking points;

[0099] Calculate the grayscale value difference between each real-time marking point and the corresponding standard marking point, extract all real-time marking points with grayscale value difference greater than the preset value, and count the number of corresponding real-time marking points;

[0100] When the number of real-time marking points is greater than a preset number, a highway accident mark is generated;

[0101] If so, generating a timestamp for each video frame of the real-time surveillance video based on the acquisition time;

[0102] Determine a first video frame, obtain a corresponding plurality of moving vehicles, and generate first label information for each moving vehicle;

[0103] Determine an nth second video frame adjacent to the first video frame, obtain a corresponding plurality of moving vehicles, and generate second label information for each moving vehicle;

[0104] Determine whether there is repeated label information based on the first label information and the second label information, and if so, extract the repeated identification information to generate a specific mark;

[0105] Dividing the vehicle with the specific mark into regions to obtain a plurality of first vehicle regions;

[0106] Divide the moving vehicles carrying specific marks in the e-th video frame into position regions respectively to obtain a plurality of second vehicle regions, where 1<e<n;

[0107] respectively determining the area overlap between each second vehicle area and the first vehicle area, and constructing an area overlap set;

[0108] Determine whether the region overlap degrees in the region overlap set are all 0;

[0109] If yes, a safe road section mark is generated for the road section to be detected, and it is determined that there is no highway accident on the road section to be detected;

[0110] If not, the suspected accident mark is generated for the road section to be detected.

[0111] In this embodiment, when the highway accident mark is generated, it is determined that a highway accident exists.

[0112] In this embodiment, the real-time monitoring video includes a plurality of video frames.

[0113] In this embodiment, the first video frame corresponds to the first timestamp.

[0114] In this embodiment, the first label information may be numbers or letters, which are mainly used for distinction and may be selected according to actual conditions.

[0115] In this embodiment, n can be set according to the speed limit of the road section to be detected, and can be set to 5, 8, 9, etc.

[0116] In this embodiment, the number information of the same moving vehicle is the same, and whether it is the same moving vehicle can be determined based on the license plate number.

[0117] In this embodiment, the vehicles generating the specific mark are divided into regions, that is, position regions are divided, the vehicle outline is detected for each moving vehicle, and the corresponding road section is used as the first vehicle region.

[0118] In this embodiment, the region overlap refers to the degree of common coverage or similarity measure between the two regions. The Jaccard coefficient is used to calculate the overlap.

[0119] In this embodiment, if the vehicle travels a certain distance, there will be regional overlap.

[0120] In this embodiment, when the two vehicle regions do not overlap at all, the region overlap degree is 0.

[0121] The beneficial effect of the above technical solution is that the present invention generates safe road section signs and suspected accident signs according to the regional overlap set, which can accurately determine whether there is a vehicle accident or natural disaster accident on the road section to be detected, laying the foundation for holographic projection.

[0122] S120: When a suspected accident mark is generated, a secondary analysis is performed on the real-time monitoring video, and a highway accident coefficient of the road section to be detected is calculated based on the analysis result;

[0123] In some embodiments of the present application, when performing a secondary analysis on the real-time monitoring video and calculating the highway accident coefficient of the road section to be detected based on the analysis result, it includes:

[0124] Extract all area overlaps that are not 0, and construct a second area overlap set;

[0125] Calculate a first calculated value and a second calculated value of the overlap degree of the second area;

[0126] Extracting all regional coincidences greater than the first calculated value, and constructing a third regional coincidence set;

[0127] Extracting all regional coincidences greater than the second calculated value, and constructing a fourth regional coincidence set;

[0128] Determine whether there is an intersection between the third region overlap degree set and the fourth region overlap degree set, and if so, extract and obtain a set to be processed;

[0129] If not, merging the third region overlap degree set and the fourth region overlap degree set to obtain a set to be processed;

[0130] Determine the maximum area overlap and the minimum area overlap in the set to be processed;

[0131] Configure the corresponding calculation weight for each area overlap;

[0132] The highway accident coefficient of the road section to be detected is calculated according to the following formula:

[0133]

[0134] Among them, p is the highway accident coefficient, n is the number of regional overlaps in the set to be processed, Δf i is the calculation weight corresponding to the overlap degree of the ith region in the set to be processed, f i is the overlap degree of the ith region in the set to be processed, fmin is the minimum area overlap, f max is the maximum area overlap, For all The maximum value in .

[0135] In this embodiment, the first calculated value is the mean, and the second calculated value is the standard deviation.

[0136] In this embodiment, if the third region overlap set is 2, 4, 5, 6, 8 and the fourth region overlap set is 3, 5, 6, 8, then the intersection is 5, 6, 8. If the third region overlap set and the fourth region overlap set are merged, 2, 3, 4, 5, 6, 8 are obtained.

[0137] The beneficial effect of the above technical solution is: the present invention determines the maximum area overlap and the minimum area overlap in the set to be processed, configures the corresponding calculation weight for each area overlap, and then calculates the highway accident coefficient of the section to be detected, which can provide a reliable judgment basis for whether a highway accident occurs in the section to be detected, ensure the judgment accuracy, avoid errors, and affect normal driving.

[0138] S130: judging whether there is a highway accident in the road section to be detected according to the highway accident coefficient;

[0139] In some embodiments of the present application, when judging whether there is a highway accident in the road section to be detected according to the highway accident coefficient, it includes:

[0140] Obtaining a preset highway accident coefficient, and judging whether there is a highway accident on the road section to be detected according to the relationship between the highway accident coefficient and the preset highway accident coefficient;

[0141] When the highway accident coefficient is less than the preset highway accident coefficient, it is determined that there is no highway accident on the road section to be detected;

[0142] When the highway accident coefficient is greater than or equal to the preset highway accident coefficient, it is determined that a highway accident exists in the road section to be detected.

[0143] S140: when it is determined that there is a road accident in the road section to be detected, obtaining a holographic projection operation instruction, and displaying a holographic projection area of ​​the current environment in response to the holographic operation instruction;

[0144] In this embodiment, the holographic projection area is the area corresponding to the road section to be detected.

[0145] S150: determining the content to be holographically projected, analyzing the content to be holographically projected, and projecting the content to be holographically projected to the holographic projection area based on the analysis result to obtain a warning information light curtain.

[0146] In some embodiments of the present application, when parsing the content to be holographically projected and projecting the content to be holographically projected onto the holographic projection area based on the parsing result, the method includes:

[0147] Analyzing the content to be holographically projected, determining a projection rule, and projecting the content to be holographically projected to a comparison projection area based on the projection rule;

[0148] Analyze the projection data to obtain the light wave temporal coherence value and the light wave spatial coherence value of each frame of the content to be holographically projected in the projection data;

[0149] Determine the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determine the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table;

[0150] Adjusting the lightwave time coherence value based on the lightwave time evaluation value of each frame of the content to be holographically projected, and adjusting the space-time coherence value based on the space-time evaluation value of each frame of the content to be holographically projected;

[0151] Based on the adjusted light wave temporal coherence value and the adjusted space-time evaluation value, the content to be holographically projected is projected into the holographic projection area.

[0152] In this embodiment, the content to be holographically projected includes but is not limited to "landscape ahead, stop immediately" and "accident ahead, slow down."

[0153] In this embodiment, the projection rules include projection direction, projection area, projection color, etc.

[0154] In this embodiment, the comparison projection area refers to a simulation area that is the same as the holographic projection area.

[0155] In this embodiment, the coherence of light waves is a measure of the phase consistency of light waves in time and space, including: temporal coherence and spatial coherence. Temporal coherence describes the coherence between light waves emitted by a light source at different times at the same point. This mainly depends on the spectral characteristics of the light source, that is, the monochromaticity of the light source. Ideally, the light waves emitted by a monochromatic light source have infinite temporal coherence, but in reality, since the light source is not completely monochromatic, the wavelength of the light waves it emits always has a certain range Δλ, which leads to the limited temporal coherence. Temporal coherence is usually quantified by coherence time or coherence length, which respectively represent the ability of light waves to interfere with themselves after delay and the maximum optical path difference of such interference. Spatial coherence describes the coherence between light waves emitted by different points of the light source at the same time. This is related to the physical size of the light source, because the size of the light source determines the coherence range of the light waves in space. Specifically, the smaller the size of the light source, the better the spatial coherence of the light waves it emits. Spatial coherence can be quantified by spatial coherence length, which is a measure of how large a spatial range the light waves emitted by the light source can produce interference.

[0156] In this embodiment, when the content to be holographically projected is projected into the holographic projection area, it is implemented in groups by a group of drones distributed along the highway. When visibility is low at night, lighting drones provide lighting over key areas.

[0157] The beneficial effect of the above technical solution is that the present invention can generate a warning information light curtain in time after an accident occurs on a highway, and block the highway, thereby improving the efficiency and intelligence level of emergency response and ensuring the continuity and safety of traffic.

[0158] In some embodiments of the present application, when determining the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determining the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table, it includes:

[0159] Determine the first calculation coefficient and the second calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave time evaluation value table;

[0160] Determine the third calculation coefficient and the fourth calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave space evaluation value table;

[0161] The light wave time evaluation value of each frame of the content to be holographically projected is calculated according to the following formula:

[0162]

[0163] Among them, K1 is the light wave time evaluation value, m1 is the number of frames of the content to be holographically projected, d1 is the first calculation coefficient, d2 is the second calculation coefficient, R jis the temporal coherence value of the light wave of the j-th frame of the content to be holographically projected, R max is the maximum value of light wave temporal coherence;

[0164] The light wave space evaluation value of each frame of the content to be holographically projected is calculated according to the following formula:

[0165]

[0166] Among them, K2 is the light wave space evaluation value, d3 is the third calculation coefficient, d4 is the fourth calculation coefficient, W h is the spatial coherence value of the light wave of the h-th frame of the content to be holographically projected, W max is the maximum value of the spatial coherence of light waves.

[0167] In some embodiments of the present application, when adjusting the lightwave time coherence value based on the lightwave time evaluation value of each frame of the content to be holographically projected, and adjusting the space-time coherence value based on the space-time evaluation value of each frame of the content to be holographically projected, it includes:

[0168] If the lightwave time evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset lightwave time evaluation value, then the lightwave time coherence value of each frame of the content to be holographically projected is lowered so that the adjusted lightwave time coherence value of each frame is greater than the first preset lightwave time coherence value and less than the second preset lightwave time coherence value;

[0169] If the light wave time evaluation value of each frame of the content to be holographically projected is less than the preset light wave time evaluation value, then the light wave time coherence value of each frame of the content to be holographically projected is increased so that the adjusted light wave time coherence value of each frame is greater than the second preset light wave time coherence value;

[0170] If the light wave space evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset light wave space evaluation value, then the light wave space coherence value of each frame of the content to be holographically projected is lowered so that the adjusted light wave space coherence value of each frame is greater than the first preset light wave space coherence value and less than the second preset light wave space coherence value;

[0171] If the lightwave spatial evaluation value of each frame of the content to be holographically projected is less than the preset lightwave spatial evaluation value, the lightwave spatial coherence value of each frame of the content to be holographically projected is increased so that the adjusted lightwave spatial coherence value of each frame is greater than the second preset lightwave spatial coherence value.

[0172] In this embodiment, the first preset lightwave temporal coherence value is smaller than the second preset lightwave temporal coherence value.

[0173] In this embodiment, the first preset light wave spatial coherence value is smaller than the second preset light wave spatial coherence value.

[0174] In this embodiment, the adjustment-down coefficient is set to 0.88, and the adjustment-up coefficient is set to 1.15, and the light wave temporal coherence value and the light wave spatial coherence value are adjusted based on the adjustment-down coefficient and the adjustment-up coefficient.

[0175] The beneficial effect of the above technical solution is that the present invention can further ensure the quality and clarity of the holographic projection by adaptively lowering or raising the light wave temporal coherence value and the light wave spatial coherence value, so that the driver of each moving vehicle can clearly see the holographic projection content, laying the foundation for the evacuation of moving vehicles.

[0176] In order to further explain the technical idea of ​​the present invention, the technical solution of the present invention is now described in combination with specific application scenarios.

[0177] Correspondingly, such as Figure 2 As shown, the present application also provides a highway alarm blocking system based on unmanned holographic technology, including:

[0178] The first module is used to receive the real-time monitoring video of the road section to be detected, analyze the real-time monitoring video, and generate a safe road section mark or a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result;

[0179] The second module is used to perform a secondary analysis on the real-time monitoring video when a suspected accident mark is generated, and calculate the highway accident coefficient of the road section to be detected based on the analysis result;

[0180] The third module is used to determine whether there is a highway accident in the road section to be detected according to the highway accident coefficient;

[0181] The fourth module is used to obtain a holographic projection operation instruction when it is determined that there is a highway accident in the road section to be detected, and display a holographic projection area of ​​the current environment in response to the holographic operation instruction;

[0182] The fifth module is used to determine the content to be holographically projected, and analyze the content to be holographically projected, and project the content to be holographically projected to the holographic projection area based on the analysis result to obtain a warning information light curtain.

[0183] In the description of the above embodiments, specific features, structures, materials or characteristics may be combined in a suitable manner in any one or more embodiments or examples.

[0184] Although the present invention has been described above with reference to the embodiments, various modifications may be made thereto and parts thereof may be replaced with equivalents without departing from the scope of the present invention. In particular, as long as there is no structural conflict, the various features in the embodiments disclosed by the present invention may be used in combination with each other in any manner, and the fact that these combinations are not fully described in this specification is only for the sake of omitting space and saving resources.

[0185] Those skilled in the art can understand that the above are only preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions recorded in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A highway alarm blocking method based on unmanned holographic technology, characterized in that: include: Receiving a real-time monitoring video of a road section to be detected, analyzing the real-time monitoring video, and generating a safe road section mark or a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result; When a suspected accident mark is generated, a secondary analysis is performed on the real-time monitoring video, and a highway accident coefficient of the road section to be detected is calculated based on the analysis result; Determining whether there is a highway accident on the road section to be detected according to the highway accident coefficient; When it is determined that there is a road accident on the road section to be detected, obtaining a holographic projection operation instruction, and displaying a holographic projection area of ​​the current environment in response to the holographic operation instruction; The content to be holographically projected is determined, and the content to be holographically projected is analyzed, and based on the analysis result, the content to be holographically projected is projected to the holographic projection area to obtain a warning information light curtain.

2. The highway alarm blocking method based on unmanned holographic technology according to claim 1 is characterized in that: When receiving the real-time monitoring video of the road section to be detected, it includes: Control the video acquisition device to obtain video data files; Receiving the video data files acquired by the video acquisition device in real time, and packaging the video data files into real-time monitoring videos; Processing the real-time surveillance video, wherein the processing includes generating additional information for the real-time surveillance video, wherein the additional information includes date, time and geographic location; The real-time monitoring video is transmitted to the video analysis module according to a preset transmission mode, wherein the transmission mode includes: transmission time and transmission path, and the transmission time includes real-time transmission or delayed transmission.

3. The highway alarm blocking method based on unmanned holographic technology according to claim 1 is characterized in that: When analyzing the real-time monitoring video and generating a safe road section mark and a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result, it includes: Performing a preliminary analysis on the real-time monitoring video to determine whether there is a moving vehicle in the real-time monitoring video; If it does not exist, randomly extract a video frame of the real-time monitoring video and obtain a grayscale image corresponding to the video frame; Determine the grayscale value of each pixel in the grayscale image and the grayscale values ​​of pixels around the pixel as real-time marking points; Determine a standard grayscale image corresponding to the grayscale image, and determine the grayscale value of each pixel in the standard grayscale image and the grayscale values ​​of pixels around the pixel as standard marking points; Calculate the grayscale value difference between each real-time marking point and the corresponding standard marking point, extract all real-time marking points with grayscale value difference greater than the preset value, and count the number of corresponding real-time marking points; When the number of real-time marking points is greater than a preset number, a highway accident mark is generated; If so, generating a timestamp for each video frame of the real-time surveillance video based on the acquisition time; Determine a first video frame, obtain a corresponding plurality of moving vehicles, and generate first label information for each moving vehicle; Determine an nth second video frame adjacent to the first video frame, obtain a corresponding plurality of moving vehicles, and generate second label information for each moving vehicle; Based on the first label information and the second label information, determine whether there is repeated label information, and if so, extract the repeated identification information to generate a specific mark; Dividing the vehicle with the specific mark into regions to obtain a plurality of first vehicle regions; Divide the moving vehicles carrying specific marks in the e-th video frame into position regions respectively to obtain a plurality of second vehicle regions, where 1<e<n; respectively determining the area overlap between each second vehicle area and the first vehicle area, and constructing an area overlap set; Determine whether the region overlap degrees in the region overlap set are all 0; If yes, a safe road section mark is generated for the road section to be detected, and it is determined that there is no highway accident on the road section to be detected; If not, the suspected accident mark is generated for the road section to be detected.

4. The highway alarm blocking method based on unmanned holographic technology according to claim 3 is characterized in that: When the real-time monitoring video is subjected to secondary analysis and the highway accident coefficient of the road section to be detected is calculated based on the analysis result, it includes: Extract all area overlaps that are not 0, and construct a second area overlap set; Calculate a first calculated value and a second calculated value of the overlap degree of the second area; Extracting all regional coincidences greater than the first calculated value, and constructing a third regional coincidence set; Extracting all regional coincidences greater than the second calculated value, and constructing a fourth regional coincidence set; Determine whether there is an intersection between the third region overlap degree set and the fourth region overlap degree set, and if so, extract and obtain a set to be processed; If not, merging the third region overlap degree set and the fourth region overlap degree set to obtain a set to be processed; Determine the maximum area overlap and the minimum area overlap in the set to be processed; Configure the corresponding calculation weight for each area overlap; The highway accident coefficient of the road section to be detected is calculated according to the following formula: Among them, p is the highway accident coefficient, n is the number of regional overlaps in the set to be processed, Δf i is the calculation weight corresponding to the overlap degree of the ith region in the set to be processed, f i is the overlap degree of the ith region in the set to be processed, f min is the minimum area overlap, f max is the maximum area overlap, For all The maximum value in .

5. The highway alarm blocking method based on unmanned holographic technology according to claim 1 is characterized in that: When judging whether there is a highway accident in the road section to be detected according to the highway accident coefficient, it includes: Obtaining a preset highway accident coefficient, and judging whether there is a highway accident on the road section to be detected according to the relationship between the highway accident coefficient and the preset highway accident coefficient; When the highway accident coefficient is less than the preset highway accident coefficient, it is determined that there is no highway accident on the road section to be detected; When the highway accident coefficient is greater than or equal to the preset highway accident coefficient, it is determined that a highway accident exists in the road section to be detected.

6. The highway alarm blocking method based on unmanned holographic technology according to claim 1 is characterized in that: When the content to be holographically projected is parsed and the content to be holographically projected is projected onto the holographic projection area based on the parsing result, the method includes: Analyzing the content to be holographically projected, determining a projection rule, and projecting the content to be holographically projected to a comparison projection area based on the projection rule; Analyze the projection data to obtain the light wave temporal coherence value and the light wave spatial coherence value of each frame of the content to be holographically projected in the projection data; Determine the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determine the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table; Adjusting the lightwave time coherence value based on the lightwave time evaluation value of each frame of the content to be holographically projected, and adjusting the space-time coherence value based on the space-time evaluation value of each frame of the content to be holographically projected; Based on the adjusted light wave temporal coherence value and the adjusted space-time evaluation value, the content to be holographically projected is projected into the holographic projection area.

7. The highway alarm blocking method based on unmanned holographic technology according to claim 1 is characterized in that: When determining the light wave time evaluation value of each frame of content to be holographically projected according to the light wave time evaluation value table, and determining the light wave space evaluation value of each frame of content to be holographically projected according to the light wave space evaluation value table, it includes: Determine the first calculation coefficient and the second calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave time evaluation value table; Determine the third calculation coefficient and the fourth calculation coefficient corresponding to each frame of the content to be holographically projected based on the light wave space evaluation value table; The light wave time evaluation value of each frame of the content to be holographically projected is calculated according to the following formula: Among them, K1 is the light wave time evaluation value, m1 is the number of frames of the content to be holographically projected, d1 is the first calculation coefficient, d2 is the second calculation coefficient, R j is the temporal coherence value of the light wave of the j-th frame of the content to be holographically projected, R max is the maximum value of light wave temporal coherence; The light wave space evaluation value of each frame of the content to be holographically projected is calculated according to the following formula: Among them, K2 is the light wave space evaluation value, d3 is the third calculation coefficient, d4 is the fourth calculation coefficient, W h is the spatial coherence value of the light wave of the h-th frame of the content to be holographically projected, W max is the maximum value of the spatial coherence of light waves.

8. The highway alarm blocking method based on unmanned holographic technology according to claim 7 is characterized in that: When the lightwave time coherence value is adjusted based on the lightwave time evaluation value of each frame of the content to be holographically projected, and the space-time coherence value is adjusted based on the space-time evaluation value of each frame of the content to be holographically projected, it includes: If the lightwave time evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset lightwave time evaluation value, then the lightwave time coherence value of each frame of the content to be holographically projected is lowered so that the adjusted lightwave time coherence value of each frame is greater than the first preset lightwave time coherence value and less than the second preset lightwave time coherence value; If the light wave time evaluation value of each frame of the content to be holographically projected is less than the preset light wave time evaluation value, then the light wave time coherence value of each frame of the content to be holographically projected is increased so that the adjusted light wave time coherence value of each frame is greater than the second preset light wave time coherence value; If the light wave space evaluation value of each frame of the content to be holographically projected is greater than or equal to the preset light wave space evaluation value, then the light wave space coherence value of each frame of the content to be holographically projected is lowered so that the adjusted light wave space coherence value of each frame is greater than the first preset light wave space coherence value and less than the second preset light wave space coherence value; If the lightwave spatial evaluation value of each frame of the content to be holographically projected is less than the preset lightwave spatial evaluation value, the lightwave spatial coherence value of each frame of the content to be holographically projected is increased so that the adjusted lightwave spatial coherence value of each frame is greater than the second preset lightwave spatial coherence value.

9. A highway alarm blocking system based on unmanned holographic technology, characterized in that: include: The first module is used to receive the real-time monitoring video of the road section to be detected, analyze the real-time monitoring video, and generate a safe road section mark or a suspected accident mark or a highway accident mark for the road section to be detected based on the analysis result; The second module is used to perform a secondary analysis on the real-time monitoring video when a suspected accident mark is generated, and calculate the highway accident coefficient of the road section to be detected based on the analysis result; The third module is used to determine whether there is a highway accident in the road section to be detected according to the highway accident coefficient; The fourth module is used to obtain a holographic projection operation instruction when it is determined that there is a highway accident in the road section to be detected, and display a holographic projection area of ​​the current environment in response to the holographic operation instruction; The fifth module is used to determine the content to be holographically projected, and analyze the content to be holographically projected, and project the content to be holographically projected to the holographic projection area based on the analysis result to obtain a warning information light curtain.

Images