Road picture display method, picture transmission method, device, and electronic equipment

By using the locally stored previous frame of road screen to repair the current frame screen in an unstable environment of the target scanner and control center, the real-time problem of road screen transmission is solved, and high-quality road screens under an unstable network are achieved exhibit.

CN117014559BActive Publication Date: 2024-11-15SHENZHEN INTELLIFUSION TECHNOLOGIES CO LTD +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202310798132.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-30
Publication Date
2024-11-15
Estimated Expiration
2043-06-30

AI Technical Summary

Technical Problem

During the road patrol, the performance of the network transmission channel between the target scanning vehicle and the control center is unstable, resulting in the real-time nature of road screen transmission that cannot be guaranteed, especially the large amount of data that high-quality road screen images need to be transmitted, which affects the real-time nature of transmission.

Method used

When the network is unstable, only target images are transmitted that are different from the previous road screen, and the previous road screen and the received target screen are used locally stored in the control center to repair the current road screen to ensure the repaired screen Quality and real-time. The specific steps include obtaining the current frame road screen, finding the previous frame road screen with a higher resolution as a reference, and performing repair processing until the repaired screen is displayed.

Benefits of technology

Through this method, the real-time performance of road screen display is improved, and the repaired picture quality is ensured, so that high-quality road screen display can be maintained when the network environment is poor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117014559B_ABST
    Figure CN117014559B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides a road picture display method and a picture transmission method, which aims to solve the problem that the real-time performance of road picture transmission cannot be guaranteed due to the inability to guarantee the performance of the network transmission channel between the target scanning vehicle and the control center after the existing road scanning and shooting. By only transmitting the target picture that is different from the previous frame of road picture when the network is unstable, and using the previous frame of road picture stored locally in the control center and the received target picture to repair the current frame of road picture, and then displaying the repaired current frame of road picture, the real-time performance of road picture display is improved. Since the target picture and the previous frame of road picture stored locally in the control center can retain all the features of the current frame of road picture, the quality of the repaired road picture can also be guaranteed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent transportation technology, and in particular to a road picture display method, device, electronic equipment and storage medium. Background Art

[0002] During the road inspection process, the control center has certain requirements for the real-time display of road images, and the real-time display of road images depends on the performance of the network transmission channel between the target scanning vehicle and the control center. Since the target scanning vehicle is operated outdoors and the network environment is unstable, the performance of the network transmission channel is difficult to guarantee, which will affect the real-time transmission of road images. At the same time, since the road images collected by the target scanning vehicle are used for disease detection, the image quality of the road images is relatively high, and the amount of data required to be transmitted will also affect the real-time transmission of the road images. Summary of the invention

[0003] The embodiment of the present invention provides a road picture display method and a picture transmission method, which aims to solve the problem that the real-time performance of road picture transmission cannot be guaranteed due to the inability to guarantee the performance of the network transmission channel between the target scanning vehicle and the control center after the existing road scanning and shooting. By only transmitting the target picture that is different from the previous frame of road picture when the network is unstable, and using the previous frame of road picture stored locally in the control center and the received target picture to repair the current frame of road picture, and then displaying the repaired current frame of road picture, the real-time performance of road picture display is improved. Since the target picture and the previous frame of road picture stored locally in the control center can retain all the features of the current frame of road picture, the quality of the repaired road picture can also be guaranteed.

[0004] In a first aspect, an embodiment of the present invention provides a method for displaying a road picture, the method comprising:

[0005] Obtain the current frame road picture uploaded by the target scanning vehicle in fast transmission mode;

[0006] According to the current frame road picture, searching locally for a previous frame road picture as a reference road picture, wherein the resolution of the current frame road picture is smaller than the resolution of the reference road picture;

[0007] According to the reference road picture, the current frame road picture is repaired to obtain a repaired road picture to be displayed, wherein the road picture to be displayed has the same resolution as the reference road picture;

[0008] The road image to be displayed is displayed.

[0009] Optionally, the current frame road picture includes a road area and a roadside area, the pixel points in the roadside area include coding bits, the coding bits correspond to the current driving speed of the target scanning vehicle and the coding data of the current picture frame rate, and the current frame road picture is repaired according to the reference road picture to obtain the repaired road picture to be displayed, including:

[0010] Extracting the coded data of the roadside area in the road picture of the current frame;

[0011] Determine the current speed and frame rate of the target scanning vehicle according to the coded data;

[0012] Performing a first restoration process on the coded bits in the roadside area in the current frame road picture to obtain a first restoration picture corresponding to the current frame road picture;

[0013] Based on the current driving speed, the current picture frame rate and the first repaired picture, a second repair process is performed on the current frame road picture to obtain a repaired road picture to be displayed.

[0014] Optionally, performing a first restoration process on the coded bits in the roadside area in the current frame road picture to obtain a first restoration picture corresponding to the current frame road picture includes:

[0015] Determining the coding bit in a roadside area in the road picture of the current frame;

[0016] The coded bits are filtered to obtain a first repaired picture corresponding to the current frame road picture.

[0017] Optionally, performing a second restoration process on the current frame road picture based on the current driving speed, the current picture frame rate and the first restoration picture to obtain a restored road picture to be displayed includes:

[0018] Determine a reference area in the reference road picture based on the current driving speed and the current picture frame rate;

[0019] Performing a second restoration process on the first restoration picture based on the reference area to obtain a second restoration picture;

[0020] A restored road picture to be displayed is determined based on the second restored picture.

[0021] In a second aspect, an embodiment of the present invention further provides a picture transmission method, the method comprising:

[0022] When it is detected that the current network environment does not meet the preset conditions, it enters the fast transmission mode;

[0023] In the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, and the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment;

[0024] The current frame road picture is uploaded to a control center, so that the control center repairs the current frame road picture, obtains a repaired road picture to be displayed, and displays the road picture to be displayed.

[0025] Optionally, in the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, including:

[0026] In the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is obtained;

[0027] Segment the road picture corresponding to the current shooting moment according to the current driving speed and the current picture frame rate to obtain a target segmented image corresponding to the road picture corresponding to the current shooting moment;

[0028] Performing semantic segmentation processing on the target segmented image to obtain a road area with road semantics and a roadside area with roadside semantics;

[0029] Encoding the current driving speed and the current picture frame rate into pixel point coding bits in the roadside area to obtain an encoded target segmentation image;

[0030] The current frame road picture corresponding to the current moment is determined according to the encoded target segmented image.

[0031] In a third aspect, an embodiment of the present invention further provides a road picture display device, the road picture display device comprising:

[0032] The first acquisition module is used to acquire the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode;

[0033] A first search module is used to search for a previous frame of road picture locally as a reference road picture according to the current frame of road picture, wherein the resolution of the current frame of road picture is smaller than the resolution of the reference road picture;

[0034] A first repairing module is used to repair the current frame road picture according to the reference road picture to obtain a repaired road picture to be displayed, wherein the road picture to be displayed has the same resolution as the reference road picture;

[0035] The first display module is used to display the road picture to be displayed.

[0036] In a fourth aspect, an embodiment of the present invention further provides a picture transmission device, the picture transmission device comprising:

[0037] The first detection module is used to enter the fast transmission mode when it detects that the current network environment does not meet the preset conditions;

[0038] A first segmentation module is used to segment the road picture corresponding to the current moment according to the current driving speed and the current picture frame rate during the process of collecting the image of the target road in the fast transmission mode, so as to obtain the current frame road picture corresponding to the current moment, wherein the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment;

[0039] The first uploading module is used to upload the current frame road picture to the control center, so that the control center can repair the current frame road picture, obtain the repaired road picture to be displayed, and display the road picture to be displayed.

[0040] In a fifth aspect, an embodiment of the present invention further provides a road picture display system, which includes a road picture display device and a picture transmission device.

[0041] In a sixth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps in the road picture display method and the picture transmission method provided in the embodiment of the present invention are implemented.

[0042] In an embodiment of the present invention, when it is detected that the current network environment does not meet the preset conditions, the fast transmission mode is entered; in the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, and the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment; the current frame road picture is uploaded to the control center, and the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode is obtained; according to the current frame road picture, the previous frame road picture is searched locally as a reference road picture, and the resolution of the current frame road picture is smaller than the resolution of the reference road picture; according to the reference road picture, the current frame road picture is repaired to obtain a repaired road picture to be displayed, and the resolution of the road picture to be displayed is the same as that of the reference road picture; the road picture to be displayed is displayed. By only transmitting the target picture that is different from the previous frame of road picture when the network is unstable, and using the previous frame of road picture stored locally in the control center and the received target picture to repair the current frame of road picture, and then displaying the repaired current frame of road picture, the real-time performance of road picture display is improved. Since the target picture and the previous frame of road picture stored locally in the control center can retain all the features of the current frame of road picture, the quality of the repaired road picture can also be guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 is an architecture diagram of a road picture display system provided in an embodiment of the present invention;

[0045] Figure 2 is a flow chart of a road picture display method provided by an embodiment of the present invention;

[0046] Figure 3 is a flow chart of a picture transmission method provided by an embodiment of the present invention;

[0047] Figure 4 is a schematic structural diagram of a road picture display device provided in an embodiment of the present invention;

[0048] Figure 5 is a structural schematic diagram of a picture transmission device provided in an embodiment of the present invention;

[0049] Figure 6It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention.

[0050] Figure 7 is a schematic diagram of the structure of another electronic device provided by an embodiment of the present invention DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] like Figure 1 As shown, Figure 1 It is an architecture diagram of a road picture display system provided by an embodiment of the present invention, wherein the road picture display system comprises a road picture display device 102 and a picture transmission device 101, wherein the picture transmission device 101 enters a fast transmission mode when it detects that the current network environment does not meet the preset conditions; in the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment; and the current frame road picture is uploaded to the road picture display device 102, wherein the road picture display device 102 is used to obtain the current frame road picture uploaded by the picture transmission device 101 in the fast transmission mode; and according to the current frame road picture, search for the previous frame road picture locally as a reference road picture; according to the reference road picture, repair the current frame road picture to obtain the repaired road picture to be displayed; and display the road picture to be displayed.

[0053] The above-mentioned picture transmission device 101 can be deployed on a target scanning vehicle with an image acquisition function, and the above-mentioned road picture display device 102 can be deployed on any electronic device with image processing, image analysis and processing functions. The above-mentioned road picture is segmented and processed by the picture transmission device 101, and the above-mentioned current frame road picture after segmentation is uploaded to the above-mentioned road picture display device 102. After the above-mentioned road picture display device 102 receives the above-mentioned current frame road picture, it searches for the previous frame road picture of the current frame road picture as a reference picture, and repairs the current frame road picture according to the reference road picture, and displays the repaired road picture to be displayed. The entire road picture display process realizes that when the network environment does not meet the requirements for transmitting high-quality images, the road picture is automatically segmented and uploaded, and the road picture after segmentation and upload is repaired and displayed. Therefore, the real-time display of the road picture and the display quality of the above-mentioned road picture can be guaranteed.

[0054] like Figure 2 As shown, Figure 2 : is a method flow chart of a road picture display method provided by an embodiment of the present invention. The road picture display method comprises the steps of:

[0055] 201. Obtain a current frame of road image uploaded by a target scanning vehicle in a fast transmission mode.

[0056] In an embodiment of the present invention, the road image display method can be deployed on a road inspection platform. The road inspection platform can store historical road images, and the historical road images include the shooting time and the shooting location of the historical road images. Specifically, each frame of the historical road images includes the corresponding shooting time and the shooting location of the historical road images. The road inspection platform can be any electronic device with image storage, image processing and analysis functions, for example, it can be a server or server cluster with image storage, image processing and analysis functions, and a road inspection control center built based on the server or server cluster. The target scanning vehicle can communicate with the road inspection platform through the SSL / TLS (Secure Sockets Layer / Transport Layer Security) encrypted communication protocol. The encrypted communication protocol is used to protect the security of network communication, and can be used for image transmission between the server and the target scanning vehicle, and can ensure that the data is not tampered with or stolen during the transmission process. The target scanning vehicle can be a vehicle with integrated functions such as image acquisition, image processing, data transmission and road driving, for example, it can be a remote scanning unmanned vehicle with integrated functions such as image acquisition, image processing, data transmission and road driving. The current frame road picture may include the shooting time of the current frame road picture and the shooting location of the current frame road picture. The shooting location of the historical road picture and the shooting location of the current frame road picture may be longitude and latitude information determined based on GPS or Beidou satellite navigation, and the shooting location of the historical road picture and the shooting location of the current frame road picture are determined according to the longitude and latitude information. The shooting time of the historical road picture and the shooting time of the current frame road picture may be determined based on time information of different time zones.

[0057] The image transmission between the target scanning vehicle and the server can be performed through a preset transmission mode, which may include a fast transmission mode and a full-speed transmission mode. The full-speed transmission mode can upload the image acquired by the image acquisition function to the server in real time without changing the resolution. The full-speed transmission mode can be used when the network status of the target scanning vehicle is good. The fast transmission mode can segment the image acquired by the image acquisition function frame by frame, and upload the current frame road picture after the frame-by-frame segmentation to the server. The fast transmission mode can be used when the network status of the target scanning vehicle is poor.

[0058] In a possible embodiment, when the target scanning vehicle changes from a good network state to a poor network state, the image cannot be uploaded to the server in full and clear form through the full-speed transmission mode, so it is necessary to convert the full-speed transmission mode to a fast transmission mode, and perform frame-by-frame segmentation processing on the image through the fast transmission mode, and upload the current frame road picture obtained after the frame-by-frame segmentation processing to the server. It should be noted that the resolution of the current frame road picture obtained after the frame-by-frame segmentation processing of the image will become smaller, and a smaller resolution is conducive to image transmission when the network state is poor.

[0059] 202. According to the current frame of the road picture, search locally for the previous frame of the road picture as a reference road picture.

[0060] In an embodiment of the present invention, the local may be a historical road picture stored in the road inspection platform. The current road picture includes the shooting time of the current road picture and the shooting location of the current road picture. After the current road picture is acquired, the shooting location of the previous road picture of the current road picture is determined by the shooting location of the current road picture, and the shooting time of the previous road picture of the current road picture is determined by the shooting time of the current road picture. According to the shooting location and shooting time of the previous road picture, the historical road picture is searched in the historical road picture to obtain a historical road picture frame whose shooting time is consistent with the shooting time of the previous road picture and whose shooting location is consistent with the shooting location of the previous road picture. The historical road picture frame is used as a reference road picture. The above-mentioned search can be performed by the built-in processor of the server belonging to the above-mentioned road patrol platform to execute the above-mentioned image search function. The built-in processor of the above-mentioned server can be an application-specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC), a digital signal processor (Digital Signal Processor), a digital signal processing device (Digital Signal Processing Device), a programmable logic device (Programmable Logic Device), a field programmable gate array (Field Programmable Gate Array), a controller, a microcontroller, a microprocessor or other electronic components to implement the above-mentioned image search function.

[0061] In a possible embodiment, when the network status of the target scanning vehicle is poor, the full-speed transmission mode is converted to a fast transmission mode, the image is segmented frame by frame by the fast transmission mode, and the current frame road picture obtained after the frame-by-frame segmentation is uploaded to the server of the road patrol platform. The server of the road patrol platform determines the shooting location of the previous frame road picture of the current frame road picture according to the shooting location of the current frame road picture, determines the shooting time of the previous frame road picture of the current frame road picture according to the shooting time of the current frame road picture, and searches the historical road picture according to the shooting location and shooting time of the previous frame road picture through the processor to obtain the historical road picture frame whose shooting time is consistent with the shooting time of the previous frame road picture and the shooting location of the historical road picture is consistent with the shooting location of the previous frame road picture, and uses the historical road picture frame as the reference road picture. It should be noted that the resolution of the current frame road picture is smaller than the resolution of the reference road picture.

[0062] 203. Repair the road picture of the current frame according to the reference road picture to obtain a repaired road picture to be displayed.

[0063] In an embodiment of the present invention, the above-mentioned restoration may be performed by referencing the road picture through image interpolation technology or image restoration algorithm to restore the current frame road picture to obtain the restored road picture with display. The above-mentioned interpolation technology may be an image interpolation technology based on optical flow, an image interpolation technology based on sparse coding, or an image interpolation technology based on deep learning. The above-mentioned image interpolation technology based on optical flow may be a Horn-Schunck optical flow algorithm or a Lucas-Kanade optical flow algorithm. The above-mentioned image interpolation technology based on sparse coding may be a K-SVD algorithm or a BM3D algorithm. The above-mentioned image interpolation technology based on deep learning may be a Super SloMo interpolation algorithm. The above-mentioned Super SloMo interpolation algorithm uses a convolutional neural network to learn the mapping relationship between the current frame road picture and the reference road picture frame, and restores the current frame road picture according to the learned rules. The above-mentioned image interpolation technology based on deep learning may also be a SepConv interpolation algorithm. The above-mentioned SepConv algorithm may be a convolutional neural network using a separation convolution to independently process the time and space information of the current frame road picture and the reference road picture, and combine them together to achieve high-precision image restoration. The above image restoration algorithm may be a bilateral filtering, mean iteration or other algorithms. Based on the above image restoration algorithm, the current frame road picture is restored according to the reference road picture to obtain a restored road picture to be displayed.

[0064] In a possible embodiment, after searching and determining the reference road picture according to the current frame road picture, the reference road picture has an overlapping part compared with the current frame road picture and the actual road, the upper half of the road in the reference road picture is determined according to the adjacent part of the road in the reference road picture and the road in the current frame road picture, the upper half of the road in the reference road picture is used as the lower half of the road in the current frame road picture, and the rest of the road except the lower half of the road in the current frame road picture is repaired by the image interpolation technology or the image repair algorithm, and the lower half of the road in the current frame road picture and the rest of the lower half of the road in the current frame road lake are spliced ​​and perspective processed to obtain the road picture to be displayed.

[0065] 204. Display the road image to be displayed.

[0066] In an embodiment of the present invention, the road picture to be displayed can be sent to the user interaction interface through the road patrol platform. The user interaction interface can be any electronic device that performs picture display function. The road patrol platform and the user interaction interface can be connected point-to-point. The road picture with display can be encrypted by encoding and other encryption means to encrypt the road picture to be displayed. Then, the encrypted road picture sequence to be displayed is sent to the user interaction interface through the point-to-point connection. The built-in processor of the user interaction interface performs decryption and display processing to achieve data security.

[0067] In a possible embodiment, the road inspection platform may send the road image to be displayed to the user interaction interface via the Remote Desktop Protocol (RDP) or the Virtual Network Computing (VNC), and display the road image to be displayed via the user interaction interface.

[0068] In an embodiment of the present invention, when it is detected that the current network environment does not meet the preset conditions, the fast transmission mode is entered; in the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, and the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment; the current frame road picture is uploaded to the control center, and the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode is obtained; according to the current frame road picture, the previous frame road picture is searched locally as a reference road picture, and the resolution of the current frame road picture is smaller than the resolution of the reference road picture; according to the reference road picture, the current frame road picture is repaired to obtain a repaired road picture to be displayed, and the resolution of the road picture to be displayed is the same as that of the reference road picture; the road picture to be displayed is displayed. By only transmitting the target picture that is different from the previous frame of road picture when the network is unstable, and using the previous frame of road picture stored locally in the control center and the received target picture to repair the current frame of road picture, and then displaying the repaired current frame of road picture, the real-time performance of road picture display is improved. Since the target picture and the previous frame of road picture stored locally in the control center can retain all the features of the current frame of road picture, the quality of the repaired road picture can also be guaranteed.

[0069] Optionally, the current frame road picture includes a road area and a roadside area, the pixel points in the roadside area include coding bits, the coding bits correspond to the current driving speed of the target scanning vehicle and the coding data of the current picture frame rate, and the current frame road picture is repaired according to the reference road picture to obtain a repaired road picture to be displayed, including: extracting the coding data of the roadside area in the current frame road picture; determining the current driving speed and the current picture frame rate of the target scanning vehicle according to the coding data; performing a first repair processing on the coding bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture; based on the current driving speed, the current picture frame rate and the first repaired picture, performing a second repair processing on the current frame road picture to obtain a repaired road picture to be displayed.

[0070] In an embodiment of the present invention, the road area may be an area with a road included in the current frame of the road picture photographed by the target scanning vehicle, the roadside area may be an area without a road in the current frame of the road picture photographed by the target scanning vehicle, the pixel points in the roadside area correspond to the pixel points in the roadless area in the current frame of the road picture photographed by the target scanning vehicle, the coding bits of the pixel points in the roadside area correspond to the coding bits of the pixel points in the roadless area in the current frame of the road picture photographed by the target scanning vehicle, the coding data may be a current picture frame rate obtained after the target scanning vehicle analyzes and processes the image through the image analysis function, and the current driving speed of the target scanning vehicle is detected by a speed sensor, and the coding data is written into the coding bits, the driving speed may be the driving speed of the target scanning vehicle, the first repair processing may be based on the image interpolation technology or the image repair algorithm, and the repair processing is performed through the coding in the roadside area in the current frame of the road picture, and the second repair processing may be based on the image interpolation technology or the image repair algorithm, and the second repair processing is performed through the current driving speed, the current picture frame rate and the first repair picture.

[0071] Each pixel can be represented by a binary data, each binary data has 8 bits, and the last bit is used as the coding bit. The number of coding bits is equal to the number of pixels in the roadside area. The coding bits are sorted from left to right and from top to bottom to obtain the corresponding coding data. The above coding data is decoded to obtain the corresponding current driving speed and current picture frame rate.

[0072] In a possible embodiment, after searching the previous frame of road picture locally as a reference road picture based on the current frame road picture, the coding data of the roadside area in the current frame road picture is extracted through the above-mentioned road patrol platform, and the current driving speed of the target scanning vehicle and the current picture frame rate are determined according to the above-mentioned coding data, and the coding in the roadside area in the current frame road picture is first repaired by the above-mentioned image interpolation technology or image restoration algorithm to obtain the first restored picture corresponding to the current frame road picture, and based on the current driving speed corresponding to the current road picture, the current picture frame rate and the above-mentioned first restored picture, the current frame road picture is secondly repaired by the above-mentioned image interpolation technology or the above-mentioned image restoration algorithm to obtain the restored road picture to be displayed.

[0073] Optionally, a first repair process is performed on the coded bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture, including: determining the coded bits in the roadside area in the current frame road picture; and filtering the coded bits to obtain a first repaired picture corresponding to the current frame road picture.

[0074] In the embodiment of the present invention, the filtering process may be a filtering method such as a median filtering method, a limiting filtering method, a median average filtering method, etc. After searching the previous frame of road picture locally as a reference road picture according to the current frame of road picture, the coding bits are determined based on the roadside area in the current frame of road picture, and the coding bits are filtered by the filtering method to obtain the first repaired picture corresponding to the current frame of road picture.

[0075] Optionally, based on the current driving speed, the current picture frame rate and the first repaired picture, a second repair process is performed on the current frame road picture to obtain a repaired road picture to be displayed, including: determining a reference area in the reference road picture based on the current driving speed and the current picture frame rate; performing a second repair process on the first repaired picture based on the reference area to obtain a second repaired picture; and determining the repaired road picture to be displayed based on the second repaired picture.

[0076] In an embodiment of the present invention, the reference area may be an overlapping area between the current frame road picture and the reference picture, the current frame road picture may include a current frame road pixel point sequence, the current frame road pixel point sequence includes current frame road pixels, the current frame road pixels correspond to current frame road pixel point coding bits, the current frame road pixels may include current frame road pixel point distances, the current frame road pixel point distances correspond to actual longitude and latitude distances, the reference picture includes a reference picture pixel point sequence, the reference picture pixel point sequence includes reference picture pixels, the reference picture pixels correspond to reference picture pixel point coding bits, the reference picture pixels may include reference picture pixel point distances, and the reference picture pixel point distances correspond to actual longitude and latitude distances.

[0077] Specifically, after obtaining the first repaired picture corresponding to the current frame road picture, the pixel point distance required for the reference picture to move to the current frame road picture is determined based on the current driving speed and the current picture frame rate, the actual longitude and latitude distance corresponding to the reference picture to move to the current frame road picture is determined based on the pixel point distance, the distance between the overlapping area between the reference picture and the current frame road picture in the actual longitude and latitude coordinates is determined based on the actual longitude and latitude distance, the distance between the overlapping area between the reference picture and the current frame road picture in the actual longitude and latitude coordinates is determined based on the distance between the overlapping area between the reference picture and the current frame road picture in the actual longitude and latitude coordinates, the required pixel point distance between the overlapping area between the reference picture and the current frame road picture is determined based on the pixel point distance, and based on the image interpolation technology or the image repair algorithm, the first repaired picture is subjected to a second repair processing through the reference area to obtain a second repaired picture, and the second repaired picture is determined as the repaired road picture to be displayed.

[0078] It should be noted that the road image display method provided in the embodiment of the present invention can be applied to devices such as shooting equipment, smart phones, computers, servers, etc. that can display road images.

[0079] like Figure 3 As shown, Figure 3 1 is a method flow chart of a screen transmission method provided by an embodiment of the present invention. The screen transmission method comprises the steps of:

[0080] 301. When it is detected that the current network environment does not meet the preset conditions, enter the fast transmission mode.

[0081] In an embodiment of the present invention, the above-mentioned network environment may be a network environment in which the target scanning vehicle communicates using a wireless communication protocol. The above-mentioned preset condition may be set according to a transmission rate. When the transmission rate of the network environment in which the above-mentioned target scanning vehicle is located is unable to upload the image scanned by the above-mentioned target scanning vehicle to the above-mentioned control center in real time, the network environment in which the above-mentioned target scanning vehicle is located is judged as not satisfying the preset condition. Otherwise, the preset condition is satisfied. The above-mentioned fast transmission mode may be a mode in which the above-mentioned target scanning vehicle performs adaptive adjustment based on the above-mentioned network environment being unable to meet the preset condition. When the above-mentioned network environment does not meet the preset condition, the above-mentioned target scanning vehicle may streamline the image collected by the above-mentioned target scanning vehicle through the above-mentioned fast transmission mode to achieve the purpose of fast transmission. The above-mentioned target scanning vehicle may also include a full-speed transmission mode. The above-mentioned full-speed transmission mode may be a mode in which the above-mentioned image collected by the above-mentioned target scanning vehicle is completely and real-time uploaded to the above-mentioned control center when the network environment in which the above-mentioned target scanning vehicle is located meets the above-mentioned preset condition.

[0082] In a possible embodiment, after the target scanning vehicle collects the image, it will determine whether it is necessary to enter the fast transmission mode based on the network environment. If the network environment in which the target scanning vehicle is located does not meet the preset conditions, the image cannot be uploaded to the control center in full and in real time. The target scanning vehicle switches the transmission mode from the full-speed transmission mode to the fast transmission mode, simplifies the image collected by the target scanning vehicle, and uploads the simplified image to the control center.

[0083] 302. During the process of collecting images of the target road in the fast transmission mode, the road image corresponding to the current moment is segmented according to the current driving speed and the current frame rate to obtain the current frame road image corresponding to the current moment.

[0084] In an embodiment of the present invention, the target road may be any road, and any of the roads may be highways, national roads, provincial roads, urban roads, township roads, rural roads and other roads. The target scanning vehicle may be deployed with integrated functions such as a collection camera and an image transmission device. The image collection may be that the target scanning vehicle collects images through the collection camera. The segmentation process may be frame segmentation based on the image. The frame segmentation may be one frame or multiple frames. The frame segmentation may be determined based on the network environment. Specifically, if the network environment status supports the image to be transmitted one frame within one second, the frame segmentation may segment the image to obtain one frame of image, and determine the current frame road picture based on the one frame of image. If the network environment status supports the image to be transmitted three frames within one second, the frame segmentation may segment the image into three frames of image, and determine the current frame road picture based on the three frames of image. The above-mentioned segmentation processing can also segment the road picture corresponding to the current moment according to the above-mentioned driving speed and the above-mentioned current picture frame rate. The above-mentioned driving speed can be the driving speed of the above-mentioned target scanning vehicle when it is running, and the above-mentioned current picture frame rate can be the image frame rate collected by the acquisition camera when the above-mentioned target scanning vehicle is running. The road picture corresponding to the above-mentioned current moment is segmented according to the driving speed of the above-mentioned target scanning vehicle when it is running and the image frame rate collected by the acquisition camera when the above-mentioned target scanning vehicle is running to obtain the above-mentioned current frame road picture corresponding to the above-mentioned current moment.

[0085] 303. Upload the current frame road picture to the control center, so that the control center repairs the current frame road picture, obtains the repaired road picture to be displayed, and displays the road picture to be displayed.

[0086] In an embodiment of the present invention, the above-mentioned control center may be a server or server cluster having functions such as image processing, image analysis, image storage, and image transmission, and the above-mentioned server or server cluster may be a road patrol platform having functions such as image processing, image analysis, image storage, and image transmission.

[0087] In a possible embodiment, when the network environment of the target scanning vehicle does not meet the preset conditions, the target scanning vehicle segments the road picture corresponding to the current moment according to the driving speed of the target scanning vehicle and the image frame rate collected by the camera when the target scanning vehicle is running, and obtains the current frame road picture corresponding to the current moment, and uploads the current frame road picture to the control center, so that the control center repairs the current frame road picture, obtains the repaired road picture to be displayed, and displays the road picture to be displayed.

[0088] In an embodiment of the present invention, when it is detected that the current network environment does not meet the preset conditions, the fast transmission mode is entered; in the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, and the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment; the current frame road picture is uploaded to the control center, and the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode is obtained; according to the current frame road picture, the previous frame road picture is searched locally as a reference road picture, and the resolution of the current frame road picture is smaller than the resolution of the reference road picture; according to the reference road picture, the current frame road picture is repaired to obtain a repaired road picture to be displayed, and the resolution of the road picture to be displayed is the same as that of the reference road picture; the road picture to be displayed is displayed. By only transmitting the target picture that is different from the previous frame of road picture when the network is unstable, and using the previous frame of road picture stored locally in the control center and the received target picture to repair the current frame of road picture, and then displaying the repaired current frame of road picture, the real-time performance of road picture display is improved. Since the target picture and the previous frame of road picture stored locally in the control center can retain all the features of the current frame of road picture, the quality of the repaired road picture can also be guaranteed.

[0089] Optionally, during image acquisition of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, including: during image acquisition of the target road in the fast transmission mode, the road picture corresponding to the current moment is acquired; the road picture corresponding to the current shooting moment is segmented according to the current driving speed and the current picture frame rate to obtain a target segmented image corresponding to the road picture corresponding to the current shooting moment; semantic segmentation is performed on the target segmented image to obtain a road area with road semantics and a roadside area with roadside semantics; the current driving speed and the current picture frame rate are encoded into the pixel point coding bits in the roadside area to obtain the encoded target segmented image; and the current frame road picture corresponding to the current moment is determined according to the encoded target segmented image.

[0090] In an embodiment of the present invention, the above-mentioned semantic segmentation processing can be based on the segmentation of the roadside area and the road area in the above-mentioned road picture, the above-mentioned road picture corresponds to the road picture semantics, and the above-mentioned roadside area corresponds to the roadside picture semantics. The above-mentioned semantic segmentation processing can be based on the FCN (Fully Convolutional Networks) algorithm and the Mask R-CNN algorithm to segment the road picture corresponding to the above-mentioned current shooting moment, and the above-mentioned target segmentation image can be the target segmentation image obtained after the above-mentioned image is segmented.

[0091] Specifically, when the target scanning vehicle is in the fast transmission mode, in the process of collecting images of the target road, the road picture corresponding to the current moment is obtained, and the road picture corresponding to the current shooting moment is segmented according to the current driving speed of the target scanning vehicle and the current picture frame rate of the target scanning vehicle to obtain a target segmentation image corresponding to the road picture corresponding to the current shooting moment, and semantic segmentation is performed on the target segmentation image through the FCN algorithm or the Mask R-CNN algorithm to obtain the road area with road semantics and the roadside area with roadside semantics, and the current driving speed of the target scanning vehicle and the current picture frame rate of the target scanning vehicle are encoded into the pixel coding bits corresponding to the pixels in the roadside area to obtain the encoded target segmentation image, and the current frame road picture corresponding to the current moment is determined according to the encoded target segmentation image.

[0092] It should be noted that the image transmission method provided in the embodiment of the present invention can be applied to devices such as shooting equipment, smart phones, computers, servers, etc. that can perform image transmission.

[0093] like Figure 4 As shown, an embodiment of the present invention provides a road picture display device, the road picture display device comprising:

[0094] The first acquisition module 401 is used to acquire the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode;

[0095] A first search module 402 is used to search for a previous frame of road picture locally as a reference road picture according to the current frame of road picture, wherein the resolution of the current frame of road picture is smaller than the resolution of the reference road picture;

[0096] A first repairing module 403 is used to repair the current frame road picture according to the reference road picture to obtain a repaired road picture to be displayed, wherein the road picture to be displayed has the same resolution as the reference road picture;

[0097] The first display module 404 is used to display the road picture to be displayed.

[0098] Optionally, the first repair module 403 includes:

[0099] A first extraction module, used to extract the coded data of the roadside area in the current frame road picture;

[0100] A first determination module, used to determine the current driving speed and current picture frame rate of the target scanning vehicle according to the coded data;

[0101] A second repairing module is used to perform a first repairing process on the coded bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture;

[0102] The third repairing module is used to perform a second repairing process on the current frame road picture based on the current driving speed, the current picture frame rate and the first repaired picture to obtain a repaired road picture to be displayed.

[0103] Optionally, the second repair module includes:

[0104] A first determining unit, configured to determine the coding bit in a roadside area in the road picture of the current frame;

[0105] The first filtering unit is used to filter the coded bits to obtain a first repaired picture corresponding to the current frame road picture.

[0106] Optionally, the third repair module includes:

[0107] A second determining unit, configured to determine a reference area in the reference road picture based on the current driving speed and the current picture frame rate;

[0108] A first restoration unit, configured to perform a second restoration process on the first restoration picture based on the reference area to obtain a second restoration picture;

[0109] The third determining unit is configured to determine a restored road picture to be displayed based on the second restored picture.

[0110] It should be noted that the road image display device provided in the embodiment of the present invention can be applied to devices such as shooting equipment, smart phones, computers, servers, etc. that can display road images.

[0111] The road picture display device provided in the embodiment of the present invention can implement each process implemented by the road picture display method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0112] like Figure 5 As shown, an embodiment of the present invention provides a picture transmission device, the picture transmission device comprising:

[0113] The first detection module 501 is used to enter the fast transmission mode when it is detected that the current network environment does not meet the preset conditions;

[0114] The first segmentation module 502 is used to segment the road picture corresponding to the current moment according to the current driving speed and the current picture frame rate during the process of collecting the image of the target road in the fast transmission mode, so as to obtain the current frame road picture corresponding to the current moment, wherein the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment;

[0115] The first uploading module 503 is used to upload the current frame road picture to the control center, so that the control center can repair the current frame road picture, obtain the repaired road picture to be displayed, and display the road picture to be displayed.

[0116] Optionally, the first segmentation module 502 includes:

[0117] The second acquisition module is used to acquire the road picture corresponding to the current moment during the process of acquiring the image of the target road in the fast transmission mode;

[0118] A second segmentation module is used to segment the road picture corresponding to the current shooting moment according to the current driving speed and the current picture frame rate to obtain a target segmentation image corresponding to the road picture corresponding to the current shooting moment;

[0119] A first semantic segmentation module is used to perform semantic segmentation processing on the target segmented image to obtain a road area with road semantics and a roadside area with roadside semantics;

[0120] A first encoding module, used for encoding the current driving speed and the current picture frame rate into pixel point encoding bits in the roadside area to obtain an encoded target segmentation image;

[0121] The second determination module is used to determine the current frame road picture corresponding to the current moment according to the encoded target segmented image.

[0122] It should be noted that the image transmission device provided in the embodiment of the present invention can be applied to devices such as shooting equipment, smart phones, computers, servers, etc. that can perform image transmission.

[0123] The picture transmission device provided in the embodiment of the present invention can implement each process implemented by the picture transmission method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0124] See also Figure 6 , Figure 6 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, such as Figure 6 As shown, it includes: a memory 602, a processor 601, and a computer program of a road picture display method stored in the memory 602 and executable on the processor 601, wherein:

[0125] The processor 601 is used to call the computer program stored in the memory 602 to perform the following steps:

[0126] Obtain the current frame road picture uploaded by the target scanning vehicle in fast transmission mode;

[0127] According to the current frame road picture, searching locally for a previous frame road picture as a reference road picture, wherein the resolution of the current frame road picture is smaller than the resolution of the reference road picture;

[0128] According to the reference road picture, the current frame road picture is repaired to obtain a repaired road picture to be displayed, wherein the road picture to be displayed has the same resolution as the reference road picture;

[0129] The road image to be displayed is displayed.

[0130] Optionally, the current frame road picture executed by the processor 601 includes a road area and a roadside area, the pixel points in the roadside area include coding bits, and the coding bits correspond to the current driving speed of the target scanning vehicle and the coding data of the current picture frame rate, and the current frame road picture is repaired according to the reference road picture to obtain the repaired road picture to be displayed, including:

[0131] Extracting the coded data of the roadside area in the road picture of the current frame;

[0132] Determine the current speed and frame rate of the target scanning vehicle according to the coded data;

[0133] Performing a first restoration process on the coded bits in the roadside area in the current frame road picture to obtain a first restoration picture corresponding to the current frame road picture;

[0134] Based on the current driving speed, the current picture frame rate and the first repaired picture, a second repair process is performed on the current frame road picture to obtain a repaired road picture to be displayed.

[0135] Optionally, the processor 601 performs a first repair process on the coded bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture, including:

[0136] Determining the coding bit in a roadside area in the road picture of the current frame;

[0137] The coded bits are filtered to obtain a first repaired picture corresponding to the current frame road picture.

[0138] Optionally, the processor 601 performs the second repairing process on the current frame road picture based on the current driving speed, the current picture frame rate and the first repaired picture to obtain a repaired road picture to be displayed, including:

[0139] Determine a reference area in the reference road picture based on the current driving speed and the current picture frame rate;

[0140] Performing a second restoration process on the first restoration picture based on the reference area to obtain a second restoration picture;

[0141] A restored road picture to be displayed is determined based on the second restored picture.

[0142] It should be noted that the electronic device provided in the embodiment of the present invention can be applied to devices such as smart phones, computers, servers, etc. that can perform the road picture display method.

[0143] The electronic device provided by the embodiment of the present invention can implement each process implemented by the road picture display method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0144] See also Figure 7 , Figure 7 is a schematic diagram of the structure of another electronic device provided by an embodiment of the present invention, such as Figure 7 As shown, it includes: a memory 702, a processor 701, and a computer program of a picture transmission method stored in the memory 702 and capable of running on the processor 701, wherein:

[0145] The processor 701 is used to call the computer program stored in the memory 702 to perform the following steps:

[0146] When it is detected that the current network environment does not meet the preset conditions, it enters the fast transmission mode;

[0147] In the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment, and the resolution of the current frame road picture is smaller than the resolution of the road picture corresponding to the current shooting moment;

[0148] The current frame road picture is uploaded to a control center, so that the control center repairs the current frame road picture, obtains a repaired road picture to be displayed, and displays the road picture to be displayed.

[0149] Optionally, in the process of collecting images of the target road in the fast transmission mode executed by the processor 701, segmenting the road picture corresponding to the current moment according to the current driving speed and the current picture frame rate to obtain the current frame road picture corresponding to the current moment includes:

[0150] In the process of collecting images of the target road in the fast transmission mode, the road picture corresponding to the current moment is obtained;

[0151] Segment the road picture corresponding to the current shooting moment according to the current driving speed and the current picture frame rate to obtain a target segmented image corresponding to the road picture corresponding to the current shooting moment;

[0152] Performing semantic segmentation processing on the target segmented image to obtain a road area with road semantics and a roadside area with roadside semantics;

[0153] Encoding the current driving speed and the current picture frame rate into pixel point coding bits in the roadside area to obtain an encoded target segmentation image;

[0154] The current frame road picture corresponding to the current moment is determined according to the encoded target segmented image.

[0155] It should be noted that the electronic device provided by the embodiment of the present invention can be applied to devices such as smart phones, computers, servers, etc. that can perform the image transmission method.

[0156] The electronic device provided by the embodiment of the present invention can implement each process implemented by the picture transmission method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0157] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the road picture display method, the application-side road picture display method, the picture transmission method, or the application-side picture transmission method provided in the embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0158] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0159] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A road picture display method, characterized in that: The road picture display method for controlling the road picture display in the center comprises the following steps: Acquire a current frame road picture uploaded by the target scanning vehicle in a fast transmission mode; the current frame road picture includes a road area and a roadside area, the pixel points in the roadside area include coding bits, and the coding bits correspond to the current driving speed of the target scanning vehicle and the coding data of the current picture frame rate; the fast transmission mode is a picture transmission mode adopted by the target scanning vehicle when it is detected that the current network environment does not meet the preset conditions; According to the current frame road picture, searching locally for a previous frame road picture as a reference road picture, wherein the resolution of the current frame road picture is smaller than the resolution of the reference road picture; Extracting the coded data of the roadside area in the road picture of the current frame; Determine the current speed and frame rate of the target scanning vehicle according to the coded data; Performing a first restoration process on the coded bits in the roadside area in the current frame road picture to obtain a first restoration picture corresponding to the current frame road picture; Based on the current driving speed, the current frame rate and the first restored frame, a second restoration process is performed on the current frame road frame to obtain a restored road frame to be displayed, wherein the road frame to be displayed has the same resolution as the reference road frame; The road image to be displayed is displayed.

2. The road picture display method according to claim 1, characterized in that: The performing a first repair process on the coded bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture includes: Determining the coding bit in a roadside area in the road picture of the current frame; The coded bits are filtered to obtain a first repaired picture corresponding to the current frame road picture.

3. The road picture display method according to claim 2, characterized in that: The step of performing a second restoration process on the current frame road picture based on the current driving speed, the current picture frame rate and the first restoration picture to obtain a restored road picture to be displayed includes: Determining a reference area in the reference road picture based on the current driving speed and the current picture frame rate; Performing a second restoration process on the first restoration picture based on the reference area to obtain a second restoration picture; A restored road picture to be displayed is determined based on the second restored picture.

4. A picture transmission method, characterized in that: The image transmission method for the target scanning vehicle comprises the following steps: When it is detected that the current network environment does not meet the preset conditions, it enters the fast transmission mode; In the process of collecting images of the target road in the fast transmission mode, a road picture corresponding to the current moment is obtained; the road picture corresponding to the current moment is segmented according to the current driving speed and the current picture frame rate to obtain a target segmented image corresponding to the road picture corresponding to the current moment; semantic segmentation is performed on the target segmented image to obtain a road area with road semantics and a roadside area with roadside semantics; the current driving speed and the current picture frame rate are encoded into pixel point encoding bits in the roadside area to obtain an encoded target segmented image; the current frame road picture corresponding to the current moment is determined according to the encoded target segmented image, and the resolution of the current frame road picture is less than the resolution of the road picture corresponding to the current moment; The current frame road picture is uploaded to a control center so that the control center repairs the current frame road picture to obtain a repaired road picture to be displayed, and then displays the road picture to be displayed.

5. A road picture display device, characterized in that: Used for road picture display in a control center, the road picture display device comprises: The first acquisition module is used to acquire the current frame road picture uploaded by the target scanning vehicle in the fast transmission mode; the current frame road picture includes a road area and a roadside area, and the pixel points in the roadside area include coding bits, and the coding bits correspond to the current driving speed of the target scanning vehicle and the coding data of the current picture frame rate; the fast transmission mode is the picture transmission mode adopted by the target scanning vehicle when it is detected that the current network environment does not meet the preset conditions; A first search module is used to search for a previous frame of road picture locally as a reference road picture according to the current frame of road picture, wherein the resolution of the current frame of road picture is smaller than the resolution of the reference road picture; A first repair module is used to extract the coded data of the roadside area in the current frame road picture; determine the current driving speed and the current picture frame rate of the target scanning vehicle according to the coded data; perform a first repair process on the coded bits in the roadside area in the current frame road picture to obtain a first repaired picture corresponding to the current frame road picture; perform a second repair process on the current frame road picture based on the current driving speed, the current picture frame rate and the first repaired picture to obtain a repaired road picture to be displayed, wherein the resolution of the road picture to be displayed is the same as that of the reference road picture; The first display module is used to display the road picture to be displayed.

6. A picture transmission device, characterized in that: The image transmission device is used for the target scanning vehicle, and the image transmission device includes: The first detection module is used to enter the fast transmission mode when it detects that the current network environment does not meet the preset conditions; The first segmentation module is used to obtain the road picture corresponding to the current moment during the image acquisition of the target road in the fast transmission mode; segment the road picture corresponding to the current moment according to the current driving speed and the current picture frame rate to obtain the target segmentation image corresponding to the road picture corresponding to the current moment; perform semantic segmentation on the target segmentation image to obtain a road area with road semantics and a roadside area with roadside semantics; encode the current driving speed and the current picture frame rate into the pixel point encoding bits in the roadside area to obtain the encoded target segmentation image; determine the current frame road picture corresponding to the current moment according to the encoded target segmentation image, and the resolution of the current frame road picture is less than the resolution of the road picture corresponding to the current moment; The first uploading module is used to upload the current frame road picture to the control center, so that the control center can repair the current frame road picture, obtain the repaired road picture to be displayed, and display the road picture to be displayed.

7. A road picture display system, characterized in that: The road picture display system comprises the road picture display device as claimed in claim 5 and the picture transmission device as claimed in claim 6.

8. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the road picture display method as described in any one of claims 1 to 3 when executing the computer program, or implements the steps of the picture transmission method as described in claim 4 when executing the computer program.

Citation Information

Patent Citations

  • Image processing method, apparatus, image pickup apparatus, and storage medium

    CN109034136A

  • Road reconstruction method and device, computer equipment and storage medium

    CN113450457A

  • Road condition information display system and method, vehicle, computer equipment and storage medium

    CN113808418A

  • Monitoring system for realizing automatic transmission of field monitoring image

    CN114500934A

  • Video processing method, device, system, equipment and medium

    CN116229337A