A method for supervising intelligent connected public transportation based on digital twins

Abstract

The present invention relates to a method for supervising intelligent networked public transportation based on digital twins, which comprises the following steps: Step 1: periodically obtaining the operation data of vehicle equipment, the operation data of roadside equipment, high-precision map data and positioning data by wireless transmission; Step 2: constructing a basic model of a digital twin system, including a map model, a bus model, a road traffic model along the bus line and a roadside equipment model; Step 3: according to the operation data of vehicle equipment and roadside equipment, the operation status of the bus is mapped in real time in a bus supervision platform based on digital twins; Step 4: making accurate dispatching decisions for different road conditions through the bus supervision platform. Compared with the prior art, the present invention has the advantages of improving the efficiency of managing the operation of public transportation vehicles.

Description

Technical Field

[0001] The present invention relates to the field of public transportation supervision, and in particular to a method for supervising intelligent networked public transportation based on digital twins. Background Art

[0002] The existing bus supervision platform mainly displays the route and equipment status in two-dimensional plane diagrams (electronic data tables). However, there are many defects:

[0003] 1. The traditional page display format is monotonous and boring, and the question display is not intuitive enough;

[0004] 2. When a line is congested, it only displays the congestion in a certain section, and cannot accurately display the congestion in real time in a three-dimensional manner. It is difficult for dispatchers in the control center to make the most accurate dispatching decisions based on the actual situation.

[0005] 3. The existing public transportation supervision platform is difficult to provide an intuitive three-dimensional display of complex intersections, stations and intersection and station conditions. It mostly uses multi-point cameras for switching observation and does not have the continuity of observation at intersections or stations;

[0006] 4. Regarding equipment supervision, when a device fails, the platform will provide eye-catching prompts in the form of text / numbers on the supervision interface (red mark and sound prompts), and the existing text alarm information is limited in expression. Summary of the invention

[0007] The purpose of the present invention is to overcome the defects of the above-mentioned prior art and provide a smart connected bus supervision method based on digital twins.

[0008] The purpose of the present invention can be achieved by the following technical solutions:

[0009] A method for supervising intelligent networked public transportation based on digital twins, the method comprising the following steps:

[0010] Step 1: Periodically obtain real-time data through wireless transmission;

[0011] Step 2: Build the basic model of the digital twin system, including the map model, bus vehicle model, road traffic model along the bus route, and roadside equipment model;

[0012] Step 3: Based on the basic model of the digital twin system and the acquired real-time data, the operation status of the bus is mapped in real time in the bus supervision platform based on the digital twin;

[0013] Step 4: Make accurate road traffic diagnosis and traffic management decisions for different road conditions through the multi-dimensional display of bus operation conditions on the bus supervision platform.

[0014] The real-time data includes the operating data of vehicle equipment, the operating data of roadside equipment, high-precision map data and positioning data. The operating data of vehicle equipment includes the sensor data of various components of the bus and the operating data of the bus. The operating data of the roadside equipment includes the roadside intelligent perception fusion system data. The positioning data is the longitude and latitude coordinates provided by the vehicle.

[0015] The bus model is specifically a 3D model containing an internal component structure, that is, the component modules at various positions in the bus can be seen through perspective, so as to quickly realize visual positioning in case of failure.

[0016] The road traffic model along the bus line includes an intersection model, a station environment model and a road model generated by video fusion technology.

[0017] The road model includes lanes, lane markings, flexible lanes, bus lanes and channelized lanes.

[0018] In step 3, based on the basic model of the digital twin system and the acquired real-time data, the operation status of the bus is mapped in real time in the bus supervision platform based on the digital twin, specifically:

[0019] By combining the road model with the positioning data, the buses on the digital twin-based bus supervision platform are kept consistent with the real world.

[0020] The overall interface of the bus supervision platform based on digital twins includes indicator display areas on both sides, a three-dimensional visualization display area in the middle area, and a menu switching area on the upper side of the three-dimensional visualization display area, that is, the specific bus line operation status is displayed in macro and micro three-dimensional form through a large screen as a carrier, and displayed from different perspectives. The different perspectives include the perspective above the roof, the driver's perspective, the in-vehicle perspective, the fleet travel perspective, and the line roaming perspective, so as to grasp the real-time status inside the vehicle, in front of the vehicle, at the driver's seat, and in all directions, and then standardize the operation status of the bus and the driver. In the picture of the three-dimensional visualization display area of ​​the bus supervision platform based on digital twins, by clicking on any vehicle on the line, it is connected to the bus operation platform interface to obtain the matching information of the vehicle and the driver. The bus supervision platform based on digital twins is equipped with a microphone or microphone hardware device. By clicking on the vehicle, the corresponding vehicle is called with a hand-held radio, so as to realize the dialogue between the operation manager of the bus supervision platform and the driver. The operation manager remotely commands the driver by combining the in-vehicle monitoring video, the road monitoring video and the three-dimensional picture on the large screen of the bus supervision platform generated by the video fusion technology.

[0021] In step 4, when faced with complex intersections or platforms with heavy passenger flow at specific times, the bus supervision platform based on digital twins obtains the overall picture of the intersection or station through mouse dragging and scroll wheel operations, so that bus management personnel can clearly and intuitively understand the bus operation situation.

[0022] In step 4, when road congestion occurs, the bus supervision platform based on digital twins displays the real-time congestion level of each lane through lane-level colors, and maps the vehicle models of each lane in real time to obtain the number of vehicles, thereby intuitively reflecting the road congestion situation.

[0023] In the above step 4, when a device fails, a warning button accompanied by an alarm sound and a flashing prompt appears on the large screen of the bus supervision platform. After clicking the alarm button, the camera angle of the main interface of the bus supervision platform automatically turns to the faulty device in the digital twin system. If it is a roadside equipment failure, the three-dimensional world lens of the digital twin moves to the roadside equipment, and the fault problem is displayed in the prompt box next to the roadside equipment; if it is a vehicle equipment failure, the three-dimensional world lens of the digital twin system follows the vehicle, displays the internal structure diagram of the vehicle, and marks the faulty part of the vehicle in red, so that the bus equipment management personnel can quickly locate the fault, which is convenient for the bus line operation management party to make decisions.

[0024] Compared with the prior art, the present invention has the following beneficial effects:

[0025] 1. The present invention can improve passengers' public transportation travel experience. Based on the present invention, the public transportation operation management party can make decisions and deployment plans in advance in a three-dimensional and intuitive way to avoid the occurrence of potential congestion events;

[0026] 2. The present invention uses a large screen to display the bus operation status through an intuitive and clear road operation status, which is no longer a two-dimensional display or electronic report data. It can improve the decision-making ability of bus operation management, and through the creation of multi-dimensional operation monitoring visualization scenes, it solves the real-time monitoring blind spots of the road network operation status, line operation status and vehicle operation status;

[0027] 3. The present invention establishes a public transportation supervision platform based on digital twins, that is, the module functions that are more convenient for the public transportation operation management party are integrated on the platform, and the three-dimensional visualization effect brought by digital twins is combined to innovate functions that are more convenient for managers to apply to actual production; BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of the structure of the present invention.

[0029] Figure 2 This is the overall interface diagram of the bus supervision platform based on digital twins. DETAILED DESCRIPTION

[0030] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is implemented based on the technical solution of the present invention, and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to the following embodiments.

[0031] The present invention provides a method for supervising an intelligent networked public transportation based on digital twins, the method comprising the following steps:

[0032] Step 1: Obtain the operating data of vehicle equipment, operating data of roadside equipment, high-precision map data and positioning data;

[0033] Step 2: Build the basic model of the digital twin system, including the map model, bus model (3D model with internal components), road traffic model along the bus line (intersection model, station environment model and road model) and roadside equipment model;

[0034] Step 3: Based on the operating data of vehicle equipment and roadside equipment, the operation status of the bus is mapped in real time in the digital twin system;

[0035] Step 4: Make accurate dispatching decisions based on different road conditions through the bus supervision platform.

[0036] In step 1, the operating data of the vehicle equipment includes the sensor data of various components of the bus and the operating data of the bus. The operating data of the roadside equipment includes the roadside intelligent perception fusion system data. The operating status of the bus is mapped in real time in the digital twin system according to the operating data of the vehicle equipment and the roadside equipment. The location of the bus is specifically the longitude and latitude coordinates (positioning data) provided by the vehicle end. The operating data of the vehicle equipment and the roadside equipment are periodically obtained through wireless transmission to map the operating status of the bus more accurately and in real time in the bus supervision platform based on the digital twin. According to the road model combined with the longitude and latitude coordinates, the bus in the digital twin system is consistent with the real world, that is, they are all located in the same lane. For example: the bus in the physical world is in the leftmost turning lane, then in the digital twin system, the bus model is also located in the leftmost turning lane on the road model in the map.

[0037] In step 2, the bus vehicle model is specifically a 3D model containing an internal component structure. The 3D model containing an internal component structure refers to a component module (bus components such as batteries and wheels) at various positions in the bus that can be seen through, so as to facilitate rapid visual positioning in the event of a fault;

[0038] Based on video fusion technology, a road traffic model along the bus line is established. For the bus management party, the focus is on the operation of the line. The road traffic model along the bus line is specifically a separately modeled intersection model, station environment model and road model of the route. The road model includes lanes, lane signs, flexible lanes, bus lanes and channelized lanes. When the bus supervision platform wants to view a specific intersection or station, the three-dimensional mouse drag interface is used or the intersection name and station name are clicked to automatically jump the camera perspective to the corresponding position. After the camera perspective jumps, the trees and buildings in the distance of the intersection / station can be viewed. The overall visual effect is achieved by integrating the image of the roadside video surveillance with the intersection / station modeling.

[0039] Faced with complex intersections / platforms with heavy passenger flow at specific times, the present invention provides three-dimensional visualization of intersections / stations based on digital twins. Unlike ordinary video surveillance, there is no need to switch cameras at various points in the east, west, south and north to observe the overall picture of the intersection / station. The bus supervision platform based on digital twins obtains a full picture of the intersection / station through mouse dragging and scroll wheel operations (lens movement, zooming in and out and rotation), which is convenient for bus management personnel to clearly and intuitively understand the bus operation situation.

[0040] When road congestion occurs, the present invention can not only intuitively see the macro traffic congestion situation, but also display the road traffic situation from a micro perspective. From a macro perspective, the road congestion is accurate to the lane level color, and red, orange, yellow, and green represent the congestion level respectively. In addition to accurately displaying the real-time congestion level of each lane in a digital twin environment based on real-world mapping, the present invention can also map the vehicle model of each lane in real time (accurate to the number of vehicles), thereby intuitively feeding back the congestion situation of the bus line.

[0041] When a device fails, a warning button accompanied by an alarm sound and a flashing prompt will first appear on the large screen of the bus supervision platform. When the alarm button is clicked, the camera perspective of the main interface of the bus supervision platform will automatically turn to the faulty device in the digital twin world. If it is a roadside equipment failure, the three-dimensional world camera of the digital twin will move to the roadside equipment and display the fault problem in the prompt box next to the roadside equipment. If it is a vehicle equipment failure, the three-dimensional world camera of the digital twin will follow the vehicle and display the internal structure diagram of the vehicle, and mark the faulty part of the vehicle (battery pack, suspension, tire and motor, etc.) in red, so that bus equipment managers can quickly locate the fault and facilitate bus line operation managers to make decisions. In addition, the triggering of alarms also includes but is not limited to the following events: speeding, offline, accidents, traffic jams, detours, excessive / too short driving intervals and refueling / charging.

[0042] The present invention is applicable to bus operators. The bus supervision platform based on digital twins is displayed through a large screen as a carrier. It not only displays the specific bus line operation status in three dimensions from a macro and micro perspective, but also can be displayed from different perspectives: the perspective above the roof, the driver's perspective, the perspective inside the car, the perspective of the team's movement, and the perspective of line roaming. Some perspectives also use video fusion technology to grasp the real-time status inside the car, in front of the car, the driver's seat and all-round, so as to standardize the operation status of the bus and the driver. In the three-dimensional picture of the bus supervision platform based on digital twins, by clicking on any vehicle on the line and connecting with the bus operation platform interface, information including but not limited to driver information and vehicle equipment information can be displayed;

[0043] The bus supervision platform is equipped with a microphone / microphone hardware device. In case of emergency and ensuring that the driver will not have a secondary accident (when an emergency occurs, the operation and management personnel of the bus supervision platform need to call the driver of the vehicle. When calling, they should ensure that the driver is in a convenient and safe state to answer, so as to avoid secondary accidents, such as the driver being distracted by responding to the bus supervision personnel's operation and causing secondary accidents), by clicking on the vehicle to call the hand-held radio equipped with the vehicle, the operation and management personnel of the bus supervision platform can communicate with the driver. The operation and management personnel remotely command the driver by combining the in-vehicle monitoring video, road monitoring video and the three-dimensional picture generated by video fusion technology. For example: when encountering an emergency that can be directly commanded by the operation and management personnel, the operation and management personnel will directly command the rescue through the on-site situation displayed on the large screen of the bus supervision platform at the first time, which can not only save rescue time, but also minimize or reduce the adverse consequences of the emergency to the maximum extent; when a fault occurs that can be remotely commanded by the bus equipment professionals of the bus supervision platform, the bus equipment professionals remotely command the driver to perform preliminary troubleshooting operations, and then conduct road rescue, which can avoid the waste of rescue resources.

[0044] like Figure 2 As shown, the overall interface of the bus supervision platform based on digital twins includes indicator display areas on both sides, a three-dimensional visualization display area in the middle area, and a menu switching area on the upper side of the three-dimensional visualization display area.

[0045] The preferred specific embodiments of the present invention are described in detail above. It should be understood that a person skilled in the art can make many modifications and changes based on the concept of the present invention without creative work. Therefore, any technical solution that can be obtained by a person skilled in the art through logical analysis, reasoning or limited experiments based on the concept of the present invention on the basis of the prior art should be within the scope of protection determined by the claims.

Claims

1. A method for supervising intelligent networked public transportation based on digital twins, characterized in that: The method comprises the following steps: Step 1: Periodically obtain real-time data through wireless transmission; Step 2: Build the basic model of the digital twin system, including the map model, bus vehicle model, road traffic model along the bus route, and roadside equipment model; Step 3: Based on the basic model of the digital twin system and the acquired real-time data, the operation status of the bus is mapped in real time in the bus supervision platform based on the digital twin; Step 4: Make accurate road traffic diagnosis and traffic management decisions for different road conditions through the multi-dimensional display of bus operation conditions on the bus supervision platform; The overall interface of the bus supervision platform based on digital twins includes indicator display areas on both sides, a three-dimensional visualization display area in the middle area, and a menu switching area on the upper side of the three-dimensional visualization display area, that is, the specific bus line operation status is displayed in macro and micro three-dimensional form through a large screen as a carrier, and displayed from different perspectives, including the perspective above the roof, the driver's perspective, the in-vehicle perspective, the fleet travel perspective, and the line roaming perspective, so as to grasp the real-time status inside the vehicle, in front of the vehicle, the driving position and all-round, and then standardize the operation status of the bus and the driver. In the picture of the three-dimensional visualization display area of ​​the bus supervision platform based on digital twins, by clicking on any vehicle on the line, it is connected to the bus operation platform interface to obtain the matching information of the vehicle and the driver. The bus supervision platform based on digital twins is equipped with a microphone or microphone hardware device. By clicking on the vehicle, the corresponding vehicle is called with a hand-held radio, so as to realize the dialogue between the operation manager of the bus supervision platform and the driver. The operation manager remotely commands the driver by combining the in-vehicle monitoring video, the road monitoring video and the three-dimensional picture on the large screen of the bus supervision platform generated by the video fusion technology; In step 4, when faced with complex intersections or platforms with heavy passenger flow at specific times, the bus supervision platform based on digital twins obtains the overall picture of the intersection or station through mouse dragging and scroll wheel operations, so that bus managers can clearly and intuitively understand the bus operation situation; In the above step 4, when a device fails, a warning button accompanied by an alarm sound and a flashing prompt appears on the large screen of the bus supervision platform. After clicking the alarm button, the camera angle of the main interface of the bus supervision platform automatically turns to the faulty device in the digital twin system. If it is a roadside equipment failure, the three-dimensional world lens of the digital twin moves to the roadside equipment, and the fault problem is displayed in the prompt box next to the roadside equipment; if it is a vehicle equipment failure, the three-dimensional world lens of the digital twin system follows the vehicle, displays the internal structure diagram of the vehicle, and marks the faulty part of the vehicle in red, so that the bus equipment management personnel can quickly locate the fault, which is convenient for the bus line operation management party to make decisions.

2. According to claim 1, a method for supervising intelligent networked public transportation based on digital twins is characterized in that: The real-time data includes the operating data of vehicle equipment, the operating data of roadside equipment, high-precision map data and positioning data. The operating data of vehicle equipment includes the sensor data of various components of the bus and the operating data of the bus. The operating data of the roadside equipment includes the roadside intelligent perception fusion system data. The positioning data is the longitude and latitude coordinates provided by the vehicle.

3. According to claim 2, a method for supervising intelligent networked public transportation based on digital twins is characterized in that: The bus model is specifically a 3D model containing an internal component structure, that is, the component modules at various positions in the bus can be seen through perspective, so as to quickly realize visual positioning in case of failure.

4. According to claim 3, a method for supervising intelligent networked public transportation based on digital twins is characterized in that: The road traffic model along the bus line includes an intersection model, a station environment model and a road model generated by video fusion technology.

5. The method for supervising intelligent networked public transportation based on digital twin according to claim 4 is characterized in that: The road model includes lanes, lane markings, flexible lanes, bus lanes and channelized lanes.

6. The method for supervising intelligent networked public transportation based on digital twin according to claim 5, characterized in that: In step 3, based on the basic model of the digital twin system and the acquired real-time data, the operation status of the bus is mapped in real time in the bus supervision platform based on the digital twin, specifically: By combining the road model with the positioning data, the buses on the digital twin-based bus supervision platform are kept consistent with the real world.

7. The method for supervising intelligent networked public transportation based on digital twin according to claim 1, characterized in that: In step 4, when road congestion occurs, the bus supervision platform based on digital twins displays the real-time congestion level of each lane through lane-level colors, and maps the vehicle models of each lane in real time to obtain the number of vehicles, thereby intuitively reflecting the road congestion situation.

Images