Method, device, electronic device and readable medium for generating real-time dynamic video of road

Abstract

The embodiments of the present disclosure provide a method, device, electronic device, and computer-readable medium for generating real-time dynamic video of roads. The method includes: receiving real-time video and camera position information sent by a roadside unit; receiving vehicle information and vehicle position information sent by at least one vehicle; generating real-time dynamic video according to a GIS base map, the vehicle information, the vehicle position information, the real-time video, and the camera position information of the real-time video; and sending the real-time dynamic video to at least one terminal device. The method, device, electronic device, and computer-readable medium for generating real-time dynamic video of roads provided by the embodiments of the present disclosure can generate real-time dynamic video reflecting the real-time status of roads and vehicles, so that users can conveniently understand the real-time status of each road through a terminal device.

Description

Technical Field

[0001] The present disclosure relates to the field of smart cities, and in particular to a method, device, electronic device and computer-readable medium for generating real-time dynamic video of roads. Background Art

[0002] Currently, navigation maps can only use colors to indicate the status of a general area, such as red for congestion, but cannot display the specific conditions of the road.

[0003] Under the conditions of C-V2X cross-domain collaboration, although users can view the scene through shared roadside monitoring cameras, for many cameras, it takes multiple calls to check the congestion status to grasp the preliminary status.

[0004] Therefore, a new method, device, electronic device and computer-readable medium for generating real-time dynamic road video are needed.

[0005] The above information disclosed in this Background section is only for enhancement of understanding of the background of the present disclosure. Summary of the invention

[0006] In view of this, the embodiments of the present disclosure provide a method, device, electronic device and computer-readable medium for generating real-time dynamic video of roads, which can generate real-time dynamic video reflecting the real-time status of roads and vehicles, so that users can easily understand the real-time status of each road through terminal devices.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0008] According to the first aspect of an embodiment of the present disclosure, a method for generating real-time dynamic video of a road is proposed, the method comprising: receiving real-time video and camera position information sent by a roadside unit; receiving vehicle information and vehicle position information sent by at least one vehicle; generating real-time dynamic video according to a GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; and sending the real-time dynamic video to at least one terminal device.

[0009] In an exemplary embodiment of the present disclosure, generating a real-time dynamic video based on a GIS base map, the vehicle information, the vehicle position information, the real-time video and the shooting position information of the real-time video includes: obtaining a three-dimensional model of the at least one vehicle based on the vehicle information; generating an intermediate layer based on the three-dimensional model of the at least one vehicle and the vehicle position information; splicing the real-time video based on the shooting position information of the real-time video to obtain an upper layer; and synthesizing the real-time dynamic video based on the GIS base map, the intermediate layer and the upper layer.

[0010] In an exemplary embodiment of the present disclosure, the shooting camera position information of the real-time video includes multiple shooting angles of a bird's-eye view, and the real-time video also includes shooting time information; wherein, splicing the real-time video according to the shooting camera position information of the real-time video to obtain the upper layer includes: splicing the real-time video according to the shooting angle and shooting time information of the real-time video to obtain the upper layer.

[0011] In an exemplary embodiment of the present disclosure, receiving real-time video and camera position information sent by a roadside unit includes: receiving real-time video and camera position information of the roadside unit sent by an edge server; wherein the real-time video and camera position information are collected by the roadside unit and sent to the edge server.

[0012] In an exemplary embodiment of the present disclosure, synthesizing the real-time dynamic video according to the GIS base map, the intermediate layer and the upper layer includes: sending the intermediate layer and the upper layer to an edge server, so that the edge server synthesizes the real-time dynamic video according to the intermediate layer, the upper layer and the pre-received GIS base map.

[0013] In an exemplary embodiment of the present disclosure, sending the real-time dynamic video to the at least one terminal device includes: receiving a video demand sent by the terminal device, the video demand including a target range; generating a local dynamic video according to the target range and the real-time dynamic video; and sending the local dynamic video to the terminal device according to the video demand.

[0014] In an exemplary embodiment of the present disclosure, receiving vehicle information and vehicle location information sent by at least one vehicle includes: receiving vehicle information and vehicle location information sent by at least one vehicle sent by an edge server, wherein the vehicle information and vehicle location information sent by at least one vehicle are sent by the at least one vehicle to a roadside unit and uploaded by the roadside unit to the edge server.

[0015] According to the second aspect of an embodiment of the present disclosure, a device for generating real-time dynamic video of a road is proposed, and the device includes: a video acquisition module, used to receive real-time video and shooting camera position information sent by a roadside unit; a vehicle information module, used to receive vehicle information and vehicle position information sent by at least one vehicle; a video generation module, used to generate real-time dynamic video based on a GIS base map, the vehicle information, the vehicle position information, the real-time video and the shooting camera position information of the real-time video; a video sending module, used to send the real-time dynamic video to at least one terminal device.

[0016] According to the third aspect of an embodiment of the present disclosure, an electronic device is proposed, which includes: one or more processors; a storage device for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the real-time dynamic video generation method of the road described in any one of the above items.

[0017] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for generating real-time dynamic video of a road as described in any one of the above items is implemented.

[0018] According to the method, device, electronic device and computer-readable medium for generating real-time dynamic video of roads provided by certain embodiments of the present disclosure, real-time information of roads is obtained by using real-time video and camera position information sent by roadside units, and real-time information of vehicles is obtained based on vehicle information and vehicle position information sent by at least one vehicle. Then, real-time dynamic video that can reflect the real-time status of roads and vehicles is generated based on the GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; and the real-time dynamic video is sent to at least one terminal device so that users can easily understand the real-time status of each road through the terminal device.

[0019] It is to be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. The drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can also be obtained based on these drawings without creative work.

[0021] Figure 1 The present invention is a system block diagram of a method and device for generating real-time dynamic video of a road according to an exemplary embodiment.

[0022] Figure 2 The present invention is a flowchart of a method for generating real-time dynamic video of a road according to an exemplary embodiment.

[0023] Figure 3 The figure is a flowchart of a method for generating real-time dynamic video of a road according to another exemplary embodiment.

[0024] Figure 4 It is a system and architecture diagram of a method for generating real-time dynamic video of a road according to an exemplary embodiment.

[0025] Figure 5 The present invention is a block diagram of a device for generating real-time dynamic video of a road according to an exemplary embodiment.

[0026] Figure 6 A block diagram schematically shows an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that the present invention will be comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0028] The described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present invention. However, those skilled in the art will appreciate that the technical solution of the present invention may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring various aspects of the present invention.

[0029] The accompanying drawings are only schematic illustrations of the present invention, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some block diagrams shown in the accompanying drawings do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0030] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and steps, nor must they be executed in the order described. For example, some steps can be decomposed, and some steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0031] Exemplary embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0032] Figure 1 The present invention is a system block diagram of a method and device for generating real-time dynamic video of a road according to an exemplary embodiment.

[0033] In the system 100 of the method and device for generating real-time dynamic video of a road, the server 105 may be a server that provides various services, such as a background management server (only for example) that provides support for the real-time dynamic video generation system of a road operated by a user using terminal devices 101, 102, and 103 through the network 104. The background management server may analyze and process the received data such as the real-time dynamic video generation request of the road, and feed back the processing result (such as real-time dynamic video - only for example) to the terminal device.

[0034] The server 105 may be a physical server, or may be composed of a plurality of servers, a portion of the server 105 may be used as a task submission system for real-time dynamic video generation of roads in the present disclosure, for obtaining tasks to be executed for real-time dynamic video generation of roads; and a portion of the server 105 may be used as a real-time dynamic video generation system for roads in the present disclosure, for receiving real-time video and camera position information sent by a roadside unit; receiving vehicle information and vehicle position information sent by at least one vehicle; generating real-time dynamic video according to a GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; and sending the real-time dynamic video to at least one terminal device.

[0035] Figure 2 1 is a flowchart of a method for generating a real-time dynamic video of a road according to an exemplary embodiment. The method for generating a real-time dynamic video of a road provided in the embodiment of the present disclosure can be executed by any electronic device with computing and processing capabilities, such as terminal devices 101, 102, 103 and / or server 105. In the following embodiments, the method is illustrated by taking the server executing the method as an example, but the present disclosure is not limited thereto. The method for generating a real-time dynamic video of a road provided in the embodiment of the present disclosure can include steps S202 to S208.

[0036] like Figure 2 As shown, in step S202, the real-time video and camera position information sent by the roadside unit are received.

[0037] In the embodiment of the present disclosure, the road side unit (RSU) may have a camera device for collecting real-time video and transmitting it to the server 105. For example, there may be multiple cameras for collecting real-time videos from different camera positions.

[0038] Furthermore, the real-time video and camera position information of the roadside unit sent by the edge server can be received; wherein the real-time video and camera position information are collected by the roadside unit and sent to the edge server.

[0039] In step S204, vehicle information and vehicle location information sent by at least one vehicle are received.

[0040] Among them, the vehicle can be a vehicle in C-V2X, and the vehicle can send its vehicle information and vehicle location information to a roadside unit with which the vehicle can communicate, and the roadside unit sends the vehicle information and vehicle location information sent by the vehicle to the execution entity of the method of this embodiment, such as a C-V2X edge server or a cross-domain collaborative cloud.

[0041] Furthermore, the edge server may receive vehicle information and vehicle location information sent by at least one vehicle, wherein the vehicle information and vehicle location information sent by at least one vehicle are sent by the at least one vehicle to a roadside unit and uploaded by the roadside unit to the edge server.

[0042] In step S206, a real-time dynamic video is generated according to the GIS base map, the vehicle information, the vehicle location information, the real-time video and the camera position information of the real-time video.

[0043] In the disclosed embodiment, a Geographic Information System (GIS) can be used to form a GIS base map. The real-time video information and the camera position information of the real-time video are used to change the viewing angle to generate a layer in the form of a top view, and the vehicle information and vehicle position information are used to generate a layer of dynamically drivable objects, and the GIS base map, the layer in the form of a top view and the layer of dynamically drivable objects are synthesized to obtain a real-time dynamic video.

[0044] After the intermediate layer is formed, the intermediate layer and the upper layer can be sent to the edge server so that the edge server can synthesize the real-time dynamic video according to the intermediate layer, the upper layer and the pre-received GIS base map. In this embodiment, the GIS base map only needs to be sent once, and the distribution by the edge can reduce the pressure on the backbone network.

[0045] In step S208, the real-time dynamic video is sent to at least one terminal device.

[0046] The terminal device is, for example, a device held by a user driving a vehicle or mounted on the vehicle.

[0047] Furthermore, a video requirement sent by a terminal device may be received, the video requirement including a target range; a local dynamic video is generated according to the target range and the real-time dynamic video; and the local dynamic video is sent to the terminal device according to the video requirement. The video requirement may include a required location and a required angle. Then, the real-time dynamic video is intercepted according to the required location and the required angle to obtain a local dynamic video. Furthermore, the video requirement may also include a required resolution, and then, according to the required resolution, a real-time dynamic video corresponding to the required resolution is synthesized to obtain a local dynamic video.

[0048] According to the method for generating real-time dynamic video of roads provided by the embodiments of the present disclosure, real-time information of the road is obtained by utilizing the real-time video and camera position information sent by the roadside unit, and real-time information of the vehicle is obtained based on the vehicle information and vehicle position information sent by at least one vehicle. Then, a real-time dynamic video that can reflect the real-time status of the road and the real-time status of the vehicle is generated based on the GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; and the real-time dynamic video is sent to at least one terminal device so that the user can conveniently understand the real-time status of each road through the terminal device.

[0049] Figure 3 The flowchart of a method for generating a real-time dynamic video of a road according to another exemplary embodiment is shown. The method for generating a real-time dynamic video of a road provided by the embodiment of the present disclosure may include steps S302 to S308.

[0050] like Figure 3 As shown, in step S302, a three-dimensional model of the at least one vehicle is obtained according to the vehicle information.

[0051] The vehicle information may include the model and color of the vehicle, etc. Modeling may be performed according to the model and color in the vehicle information to obtain a three-dimensional model of at least one vehicle.

[0052] In step S304, an intermediate layer is generated according to the three-dimensional model of the at least one vehicle and the vehicle position information.

[0053] In the disclosed embodiment, the vehicle position information may be, for example, real-time information. A layer of dynamically drivable objects may be generated as an intermediate layer based on the three-dimensional model of at least one vehicle and the vehicle position information.

[0054] In step S306, the real-time videos are spliced ​​according to the shooting camera position information of the real-time videos to obtain an upper layer.

[0055] Among them, the real-time video can be spliced ​​according to the shooting position information of the real-time video, and the viewing angle can be changed to generate a layer in the form of a bird's-eye view as the upper layer.

[0056] Furthermore, the camera position information of the real-time video includes multiple shooting angles of a bird's-eye view, and the real-time video also includes shooting time information. The real-time video can be spliced ​​according to the shooting angle and shooting time information of the real-time video to obtain the upper layer.

[0057] In step S308, the real-time dynamic video is synthesized according to the GIS base map, the middle layer and the upper layer.

[0058] Figure 4 1 is a system and architecture diagram of a method for generating real-time dynamic video of a road according to an exemplary embodiment. Figure 4 As shown, the real-time dynamic video generation system of a road provided by the embodiment of the present disclosure may include a cross-domain collaborative cloud 410, a C-V2X edge server 420, a roadside unit 430 and a C-V2X vehicle 440.

[0059] exist Figure 4 In the embodiment of the present disclosure, the method for generating a real-time dynamic video of a road may include steps S401 to S413. The method for generating a real-time dynamic video of a road of the present embodiment may be applied to Figure 4 The road real-time dynamic video generation system shown.

[0060] On the roadside unit 430: upload the real-time video and the shooting position information of the real-time video (surveillance camera position information) to the cross-domain collaborative cloud 410 through the C-V2X edge server 420.

[0061] C-V2X vehicle 440: provides vehicle information, vehicle location information, etc. to the cross-domain collaborative cloud 410 through the C-V2X edge server 420, obtains the synthesized dynamic video from the C-V2X edge server 420, and can customize the required local dynamic video according to the video requirements of the device terminal.

[0062] Cross-domain collaborative cloud 410: Use GIS to form a base map, use the video uploaded by the surveillance camera and the camera position information to change the perspective, generate a bird's-eye view, and synthesize the upper layer; according to the vehicle information uploaded by the C-V2X vehicle, load the preset 3D model, drive it on the GIS map according to the vehicle location information, and form the middle layer. Finally, send the synthesized three layers to the C-V2X edge server 420. Since the GIS layer does not change, it only needs to be sent once and is distributed by the C-V2X edge server 420 to reduce the pressure on the backbone network and meet the different needs of users.

[0063] C-V2X edge server 420: uploads the real-time video, camera position information, vehicle information, and vehicle location information received from the roadside unit 420, receives the three layers sent down, synthesizes the real-time dynamic video of the dynamic panorama, and generates the local dynamic video required by the user in the scene according to the video requirements.

[0064] like Figure 4 As shown, in step S401, the C-V2X vehicle 440 communicates with the roadside unit 430 and uploads vehicle information and vehicle location information.

[0065] In step S403 , the roadside unit 430 uploads real-time video, vehicle information, and vehicle location information to the C-V2X edge server 420 .

[0066] In step S405 , the C-V2X edge server 420 uploads the real-time video, vehicle information, and vehicle location information to the cross-domain collaborative cloud 410 .

[0067] In step S407, the cross-domain collaborative cloud 410 generates three dynamic layers. The three dynamic layers may include Figure 4 Middle GIS bottom Figure 1 , middle layer 2 (i.e. the layer where the three-dimensional model of the vehicle is located) and upper layer 3 (the uploaded surveillance video is switched to a bird's-eye view, and the bird's-eye view video layer is spliced ​​and synthesized).

[0068] In step S409 , the cross-domain collaborative cloud 410 sends the synthesized three layers to the C-V2X edge server 420 .

[0069] In step S411, the C-V2X edge server 420 synthesizes real-time dynamic video.

[0070] In step S413, the C-V2X edge server 420 sends real-time dynamic videos of scenes with different resolutions according to the video requirements sent by the user through the terminal device.

[0071] According to the method for generating real-time dynamic video of roads provided by the embodiments of the present disclosure, based on the C-V2X network, the monitoring video is combined with the 3D model to fully display the state of the road surface, which is intuitive and clear. The use of a bird's-eye view reduces the difference between the real scene and the model, and solves the defect that vehicles in the blind spot of the current video fusion solution suddenly disappear from the road surface. At the same time, cloud-edge collaboration and distributed computing are adopted to optimize resource allocation and improve network utilization efficiency.

[0072] It should be clearly understood that the present disclosure describes how to form and use specific examples, but the principles of the present disclosure are not limited to any details of these examples. On the contrary, based on the teachings of the contents disclosed in the present disclosure, these principles can be applied to many other embodiments.

[0073] Those skilled in the art will appreciate that all or part of the steps for implementing the above embodiments are implemented as a computer program executed by a central processing unit (CPU). When the computer program is executed by the central processing unit (CPU), the above functions defined by the above method provided by the present disclosure are executed. The program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0074] In addition, it should be noted that the above figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0075] The following are embodiments of the device disclosed herein, which can be used to execute the method embodiments disclosed herein. For details not disclosed in the device embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0076] Figure 5 is a block diagram of a device for generating real-time dynamic video of a road according to an exemplary embodiment. Figure 5 The road real-time dynamic video generation device 50 provided in the embodiment of the present disclosure may include: a video acquisition module 502, a vehicle information module 504, a video generation module 506 and a video sending module 508.

[0077] In the road real-time dynamic video generation device 50, the video acquisition module 502 can be used to receive the real-time video and camera position information sent by the roadside unit.

[0078] The vehicle information module 504 may be configured to receive vehicle information and vehicle location information sent by at least one vehicle.

[0079] The video generation module 506 may be used to generate a real-time dynamic video according to the GIS base map, the vehicle information, the vehicle location information, the real-time video and the camera position information of the real-time video.

[0080] The video sending module 508 may be configured to send the real-time dynamic video to at least one terminal device.

[0081] According to the device for generating real-time dynamic video of roads provided by the embodiment of the present disclosure, real-time information of roads is obtained by utilizing real-time video and camera position information sent by roadside units, and real-time information of vehicles is obtained according to vehicle information and vehicle position information sent by at least one vehicle. Then, real-time dynamic video that can reflect the real-time status of roads and vehicles is generated according to the GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; and the real-time dynamic video is sent to at least one terminal device so that users can conveniently understand the real-time status of each road through the terminal device.

[0082] In an exemplary embodiment, the video generation module 506 may include: a vehicle model unit, used to obtain a three-dimensional model of the at least one vehicle based on the vehicle information; an intermediate layer unit, used to generate an intermediate layer based on the three-dimensional model of the at least one vehicle and the vehicle position information; an upper layer unit, used to splice the real-time video according to the shooting camera information of the real-time video to obtain an upper layer; and a video generation unit, used to synthesize the real-time dynamic video based on the GIS base map, the intermediate layer and the upper layer.

[0083] In an exemplary embodiment, the shooting camera position information of the real-time video includes multiple shooting angles of a bird's-eye view, and the real-time video also includes shooting time information; wherein the upper layer unit can be used to: splice the real-time video according to the shooting angle and shooting time information of the real-time video to obtain the upper layer.

[0084] In an exemplary embodiment, the video acquisition module 502 may be used to receive the real-time video and camera position information of the roadside unit sent by the edge server; wherein the real-time video and camera position information are collected by the roadside unit and sent to the edge server.

[0085] In an exemplary embodiment, the video generation unit can be used to: send the intermediate layer and the upper layer to the edge server, so that the edge server synthesizes the real-time dynamic video according to the intermediate layer, the upper layer and the pre-received GIS base map.

[0086] In an exemplary embodiment, the video sending module 508 may include: a demand receiving unit, which can be used to receive a video demand sent by a terminal device, and the video demand includes a target range; a local video generating unit, which can be used to generate a local dynamic video according to the target range and the real-time dynamic video; a video sending unit, which can be used to send the local dynamic video to the terminal device according to the video demand.

[0087] In an exemplary embodiment, the vehicle information module 504 can be used to: receive vehicle information and vehicle location information sent by at least one vehicle sent by an edge server, wherein the vehicle information and vehicle location information sent by at least one vehicle are sent by the at least one vehicle to a roadside unit and uploaded by the roadside unit to the edge server.

[0088] Refer to the following Figure 6 The electronic device 600 according to this embodiment of the present invention is described. Figure 6 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0089] like Figure 6 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include but are not limited to: at least one processing unit 610, at least one storage unit 620, and a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610).

[0090] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 610 can perform the following steps: Figure 2 or Figure 3 or Figure 4 Follow the steps shown in .

[0091] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0092] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0093] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0094] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 660. As shown, the network adapter 660 communicates with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0095] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0096] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0097] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0098] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0099] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0100] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0101] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0102] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and concept of the present disclosure are indicated by the claims.

Claims

1. A method for generating real-time dynamic video of a road, characterized in that: include: Receive real-time video and camera position information sent by the roadside unit; Receiving vehicle information and vehicle location information sent by at least one vehicle; Generate a real-time dynamic video according to the GIS base map, the vehicle information, the vehicle location information, the real-time video and the camera position information of the real-time video; Sending the real-time dynamic video to at least one terminal device; The generating of the real-time dynamic video according to the GIS base map, the vehicle information, the vehicle location information, the real-time video and the camera position information of the real-time video includes: Obtaining a three-dimensional model of the at least one vehicle according to the vehicle information; generating an intermediate layer according to the three-dimensional model of the at least one vehicle and the vehicle position information; splicing the real-time videos according to the shooting position information of the real-time videos to obtain an upper layer; The real-time dynamic video is synthesized according to the GIS base map, the middle layer and the upper layer.

2. The method according to claim 1, characterized in that The camera position information of the real-time video includes multiple shooting angles of a bird's-eye view, and the real-time video also includes shooting time information; wherein the real-time video is spliced ​​according to the camera position information of the real-time video to obtain the upper layer, including: The real-time video is spliced ​​according to the shooting angle and shooting time information of the real-time video to obtain the upper layer.

3. The method according to claim 1, characterized in that Synthesizing the real-time dynamic video according to the GIS base map, the middle layer and the upper layer includes: The middle layer and the upper layer are sent to the edge server so that the edge server synthesizes the real-time dynamic video according to the middle layer, the upper layer and the pre-received GIS base map.

4. The method according to claim 1, characterized in that The real-time video and camera position information received from the roadside unit include: Receiving real-time video and camera position information of the roadside unit sent by the edge server; The real-time video and camera position information are collected by the roadside unit and then sent to the edge server.

5. The method according to claim 1, characterized in that Sending the real-time dynamic video to at least one terminal device includes: Receiving a video requirement sent by a terminal device, wherein the video requirement includes a target range; Generate a local dynamic video according to the target range and the real-time dynamic video; The local dynamic video is sent to the terminal device according to the video demand.

6. The method according to claim 1, characterized in that Receiving vehicle information and vehicle position information sent by at least one vehicle includes: Receive vehicle information and vehicle location information sent by at least one vehicle from an edge server, where the vehicle information and vehicle location information sent by at least one vehicle are sent by the at least one vehicle to a roadside unit and uploaded by the roadside unit to the edge server.

7. A device for generating real-time dynamic video of a road, characterized in that: include: The video acquisition module is used to receive the real-time video and camera position information sent by the roadside unit; A vehicle information module, used to receive vehicle information and vehicle location information sent by at least one vehicle; The video generation module is used to generate a real-time dynamic video according to the GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video; wherein, generating a real-time dynamic video according to the GIS base map, the vehicle information, the vehicle position information, the real-time video and the camera position information of the real-time video includes: obtaining a three-dimensional model of at least one vehicle according to the vehicle information; generating an intermediate layer according to the three-dimensional model of at least one vehicle and the vehicle position information; splicing the real-time video according to the camera position information of the real-time video to obtain an upper layer; synthesizing the real-time dynamic video according to the GIS base map, the intermediate layer and the upper layer; The video sending module is used to send the real-time dynamic video to at least one terminal device.

8. An electronic device, characterized in that: include: at least one processor; A storage device for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 6.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images