Roadside display system adaptive to running vehicle and method for automatically taking over vehicle navigation
By setting up a display mechanism next to the lane, adjusting the display angle and position, and simulating the perspective effect, the problems of inconvenient acquisition of vehicle driving information and navigation failure are solved, and stable visual data display and automatic navigation are achieved.
Patent Information
- Application Number
- CN202410322750.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-20
- Publication Date
- 2025-09-23
AI Technical Summary
In the existing technology, it is inconvenient to obtain information while the vehicle is driving, resulting in low traffic efficiency and frequent accidents. In addition, when the vehicle navigation equipment fails, it cannot replace the navigation in time, resulting in navigation interruption.
A roadside display system adapted to moving vehicles is designed. By setting up a display mechanism next to the lane, using display components and a rotation mechanism, the display angle and position are adjusted according to the vehicle position and driving direction, simulating a perspective effect, providing stable visual data display, and automatically taking over navigation when the on-board navigation device fails.
It improves the visual convenience and visual experience of visual data, extends the viewing time, reduces the risk of traffic accidents, and achieves seamless switching to external navigation when navigation fails.
Smart Images

Figure CN120685120A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of display equipment, and more particularly to a roadside display system adapted to a moving vehicle and a method for automatically taking over vehicle navigation. Background Art
[0002] While driving, drivers primarily obtain information from the driving environment through various roadside and overhead signs, including various standard or non-standard, public or private signage or displays with variable or fixed information. The current approach is to display as complete information as possible on a single sign or display. If a vehicle is traveling at normal speeds on urban roads, the most effective way to ensure that the driver can fully read the information displayed on a sign or display is to reduce the information content and present it with symbols and text that are as concise and clear as possible. Furthermore, it is necessary to provide drivers with as much lead time as possible, or even further, to add multiple signs or displays along the road to ensure that the information can be fully read by the driver.
[0003] However, due to limited conditions, the distance from the time a driver sees a sign or display screen until it is out of sight is limited, and the time the sign or display screen is visible is negatively correlated with the driving speed, usually only a few seconds. Therefore, it is common for drivers to slow down in order to see the information clearly, which not only reduces traffic efficiency, but also causes frequent traffic accidents due to emergency braking, further exacerbating the tension of road traffic efficiency. In addition, drivers may stare at the information for too long and their attention may be diverted from the road, which can easily cause traffic accidents such as rear-end collisions and scratches.
[0004] It can be seen that conventional signs or displays provide a single-point information display function, which has shortcomings such as limited information volume, poor reading quality, and easy to cause traffic incidents. From the time the driver moves out of sight of the previous sign or display to the time the next sign or display becomes visible, the driver cannot obtain the corresponding information through the sign or display. Moreover, it is impossible to predict the position of the sign or display display displaying the information next time, whether it will be in the same sight position as the previous sign or display display, whether the information display style will be the same, or whether there will be another sign or display display displaying the same information. Therefore, even if multiple signs or displays are installed along the road, the number of single-point information displays can only be increased to a limited extent. Although it can increase the probability of the driver reading the information completely to a certain extent, it cannot solve the various problems that drivers encounter when encountering each sign or display display.
[0005] On the other hand, when a moving vehicle uses satellite positioning for navigation, the on-board navigation device and satellite positioning need to work effectively at the same time to perform real-time route navigation based on the real-time position of the vehicle. That is, if the on-board navigation device has a software or hardware failure, it will not display normally (such as no screen display, abnormal display), or, if the satellite positioning is invalid, it will not be able to locate normally or navigate normally. When navigating a moving vehicle, the on-board navigation device (such as a smart mobile terminal, a vehicle-mounted smart terminal, etc.) is actually equated with the vehicle, and the use of satellite positioning combined with map information for route planning and real-time navigation is the way the on-board navigation device guides itself. When the on-board navigation device or satellite positioning fails to work effectively, the on-board navigation device will not be able to guide itself.
[0006] Therefore, the technical solutions of the existing technology cannot be applied to the situation where a software or hardware failure occurs in a mobile terminal and satellite positioning is invalid, and a suitable navigation screen is selected for external navigation without actively sending auxiliary navigation instructions; the existing technology can only achieve the simple purpose of using the navigation screen as a display extension of the mobile terminal, and cannot achieve active navigation in the event of a failure. Summary of the Invention
[0007] The purpose of the present invention is to overcome the shortcomings of the existing technology and provide a roadside display system adapted to moving vehicles. The visual data displayed on the corresponding vehicle adapts to the forward movement of the moving vehicle and maintains the display at the end display position. By rotating the display angle, while improving the visual experience and extending the viewing time, it also enhances the visual convenience of the visual data, simulates the perspective effect, and improves the visual transparency of the vehicle. Based on the roadside display system adapted to moving vehicles, a method for automatically taking over vehicle navigation is also provided, which realizes that when the on-board navigation device cannot perform normal navigation, the external roadside display system is switched to display the next navigation information for the vehicle, and the vehicle is navigated step by step from the outside.
[0008] The technical solutions of the present invention are as follows:
[0009] A roadside display system adapted for moving vehicles includes a display mechanism disposed beside a lane, a display assembly disposed on an outer side of the display mechanism, the display assembly being visible in the direction of oncoming vehicles; the display assembly displays corresponding visual data for the vehicle via a display area of a certain size;
[0010] Identify and obtain the vehicle's position information, driving direction, and speed information, and determine whether the display mechanism is within the vehicle's effective visual range; when the display area displaying corresponding visual data enters the vehicle's effective visual range, the display area moves from the starting display position to the ending display position in the display component along the vehicle's driving direction at a moving speed adapted to the vehicle's speed information, and maintains display at the ending display position until the display area exits the vehicle's effective visual range.
[0011] Preferably, the display component includes a plurality of display modules arranged in a horizontal direction, and the number and position of the display modules for displaying the visual data are determined based on the size and position of the display area corresponding to the visual data, and correspondingly, each display module displays a portion of the visual data;
[0012] The display module is connected to a rotating mechanism, and the rotating mechanism drives the display area to rotate with the vertical direction as the axis to adjust the angle between the display module and the direction of the oncoming vehicle.
[0013] Preferably, the lateral distance between the vehicle and the display mechanism is determined in combination with the vehicle's position information and the display mechanism's position information. The optimal visual angle between the vehicle and the display module is determined in combination with the lateral distance between the vehicle and the display mechanism and the vehicle's field of view angle range. Based on the optimal visual angle, the angle between the display module and the direction of the oncoming vehicle is adjusted to the optimal rotation angle. When the lateral distance between the vehicle and the display mechanism changes, the optimal visual angle and the optimal rotation angle are determined in real time, and the angle between the display module and the direction of the oncoming vehicle is adjusted accordingly.
[0014] Preferably, when the visual data remains displayed at the end display position, the front and rear distance between the vehicle and the display module corresponding to the display area when the visual data is at the end display position is determined in combination with the vehicle's position information and the display mechanism's position information; the visual optimization angle between the vehicle and the display module is determined in real time in combination with the front and rear distance and the vehicle's field of view angle range; based on the real-time visual optimization angle, the angle between the display module and the direction of the oncoming vehicle is adjusted in real time until the display area exits the vehicle's effective viewing distance.
[0015] Preferably, the vehicle's position information, driving direction, and speed information are identified and obtained, and then one or more display mechanisms within the vehicle's current effective visual range, as well as the real-time positional relationship between all display mechanisms and the vehicle, are obtained; based on the real-time positional relationship between the display mechanism and the vehicle, the display mechanism is located on the other side of the vehicle opposite to the external area that is blocked by the display mechanism in real time, and the image of the external area that is blocked by the display mechanism in real time is displayed on other display modules of the display mechanism except for the display module used to display the corresponding visual data, to simulate a perspective effect.
[0016] Preferably, a certain distance range is defined in front of the display mechanism in the lane along the driving direction as a perspective area, and the perspective area is located within the effective visual range of the vehicle; based on the vehicle's position information, driving direction, and speed information, the display mechanism closest to the front within the current effective visual range of the vehicle and the real-time positional relationship between the display mechanism closest to the front and the vehicle are determined to determine whether the vehicle enters the perspective area; when the vehicle enters the perspective area, the display modules of the display mechanism closest to the front, except for the display module used to display the corresponding visual data, display the image of the external area blocked by the display mechanism in real time, to simulate the perspective effect.
[0017] Preferably, if there is no other vehicle in front of the current vehicle in the perspective area when the current vehicle enters the perspective area, then the display modules of the display mechanism closest to the front, except for the display module for displaying corresponding visual data, display the image of the external area blocked by the display mechanism in real time, corresponding to the current vehicle;
[0018] If there are other vehicles in front of the current vehicle within the perspective area when the current vehicle enters the perspective area, after the other vehicles in front leave the perspective area, the display modules of the display mechanism closest to the front, except for the display module used to display the corresponding visual data, will display the image of the external area that is blocked in real time by the display mechanism corresponding to the current vehicle.
[0019] A method for automatically taking over vehicle navigation comprises deploying a roadside display system beside a lane; an on-board navigation device performs real-time navigation based on a planned navigation route; monitoring whether the on-board navigation device fails to navigate; if so, obtaining the vehicle's position information and driving direction, and then obtaining a display mechanism within the vehicle's current visual range; planning a new navigation route based on the latest destination information before the navigation failure or a remaining navigation route corresponding to the remaining distance in the navigation route planned by the on-board navigation device, and displaying next-step navigation information corresponding to the vehicle's current position information and driving direction; and following the movement of the vehicle, continuously displaying the real-time next-step navigation information through the display mechanism within the vehicle's visual range until the navigation takeover is completed.
[0020] Preferably, based on the vehicle's position information, driving direction, and speed information, a prediction model pre-trained under preset conditions or through machine learning is used to predict the vehicle's next state, including the vehicle's position information, driving direction, and speed information, and the next navigation information is displayed in advance on a display mechanism that matches the predicted next state of the vehicle.
[0021] The beneficial effects of the present invention are as follows:
[0022] The roadside display system adapted to a moving vehicle described in the present invention includes two display stages for the visual data displayed for the vehicle: follow-up movement and position retention. During the follow-up movement display stage, the display position of the visual data is adapted to the vehicle's speed, position, and direction of travel. By moving forward and maintaining a stable positional relationship with the vehicle, the data can be read with a stable line of sight and viewing angle, achieving a stable visual effect. During the position retention display stage, the visual data stops moving at the end display position and remains displayed, following the vehicle's travel until it exits the vehicle's effective line of sight. The complete display process of the visual data, through the process of follow-up movement and position retention display, not only enhances the visual experience but also extends the viewing time.
[0023] The display assembly includes a plurality of display modules arranged in a horizontal direction. The number and position of the display modules used to display the visual data are determined based on the size and position of the display area corresponding to the visual data. Accordingly, each display module displays a portion of the visual data. The display module is connected to a rotation mechanism, which drives the display area to rotate about the vertical axis to adjust the angle between the display module and the direction of the oncoming vehicle. Furthermore, the display mechanism located on the roadside can adapt to the position and driving direction of the vehicle through the angle adjustment of the display module, so that the visible angle of the display assembly is within the comfortable range of the vehicle's line of sight and viewing angle. In the process of following the movement and positioning display, the visual convenience of the visual data can be enhanced, and the driver does not need to take his eyes off the road excessively to easily read the visual data. In the process of positioning display, the display module at the corresponding end display position continues to adjust its angle based on the speed information, position, and driving direction of the moving vehicle, further enhancing the visual convenience of the visual data.
[0024] In the present invention, a specially designed rotation mechanism is used to independently control the selective connection between each display module and different reciprocating motion plates, thereby enabling the display modules serving as different display areas to be driven by different reciprocating motion plates in different display stages and when the vehicle is located in different lanes, thereby achieving stable angle adjustment synchronization with a simple structure and low cost.
[0025] In the present invention, the display mechanism simulates a perspective effect by displaying images of the external area that is actually obscured by the display mechanism. This not only enhances the vehicle's visual clarity but also prevents the display mechanism from obstructing the view of vehicles in the lanes on either side of it, allowing vehicles to see the obscured area within a suitable range. This facilitates display in street shops and reduces blind spots at important traffic locations (such as corners at turning intersections), thereby reducing the incidence of accidents caused by blocked views. When performing simulated perspective, the utilization rate of the display components is maximized, particularly for several vehicles within the perspective area, while ensuring a perspective effect closer to reality.
[0026] In the present invention, for visual data that needs to be moved on multiple display mechanisms, a standard display height is determined based on the height difference between the display module of each display mechanism and the road surface, ensuring that the visual data maintains a certain height during the movement process, ensuring that the driver's line of sight of the visual data is stable, and avoiding the visual data jumping up and down during the movement due to changes in the height of different display mechanisms, which is not conducive to the driver's effective reading.
[0027] In the present invention, the display component is provided with display surfaces in different orientations corresponding to different visual scenes. The display modules adjacent in the horizontal direction on the display surface are visible in different directions, forming a continuous V-shaped structure. Therefore, the display component can meet the visual requirements of vehicles coming from opposite directions, vehicles coming from the same direction, and lanes located on the same side or different sides of the display component, including displaying corresponding visual data or simulating perspective effects.
[0028] The method for automatically taking over vehicle navigation described in the present invention is based on the roadside display system. When the navigation of the on-board navigation device fails, the navigation work is taken over externally. The display mechanism corresponding to the vehicle's location information and driving direction displays the next navigation information, thereby achieving navigation of the vehicle from the outside. After the external navigation is taken over, the present invention no longer requires the on-board navigation device to guide itself, that is, the on-board navigation device no longer needs to use satellite positioning combined with map information for path planning and real-time navigation. When the navigation of the on-board navigation device fails, it can still guide the vehicle. The present invention plans a new navigation route based on the latest destination information before the navigation fails, or the remaining navigation route corresponding to the remaining distance in the navigation route planned by the on-board navigation device, and provides the vehicle with the next navigation information in a manner similar to a road sign through an external display mechanism, thereby achieving guidance of the vehicle.
[0029] In the present invention, the selection of a display mechanism takes into account the relative position of the vehicle and the display mechanism, the relative visual angle between the display mechanism and the vehicle, the effective viewing distance between the vehicle and the display mechanism, and whether there is any visual obstruction between the vehicle and the display mechanism, thereby obtaining the optimal display mechanism for vehicle guidance. This determination of the "visual range" allows the present invention to utilize the display mechanism with the best visual effect to display the next navigation information corresponding to the vehicle's current position and driving direction, even when the display mechanism is passively selected (as opposed to the prior art, which actively selects an external display mechanism for navigation).
[0030] The present invention uses image recognition or a three-dimensional global model to determine the display mechanism within the "visible range". Among them, the method of using the three-dimensional global model to determine the display mechanism within the "visible range" is combined with the real scene and the virtual scene. First, a three-dimensional global model is constructed for the monitoring area covered by all cameras (that is, the real scene). Then, the relationship between the three-dimensional vehicle model corresponding to the vehicle and the three-dimensional display mechanism model corresponding to the display mechanism can be calculated in the three-dimensional global model, including the relative position of the three-dimensional vehicle model and the three-dimensional display mechanism model, the relative visual angle between the three-dimensional display mechanism model and the three-dimensional vehicle model, the effective viewing distance between the three-dimensional vehicle model and the three-dimensional display mechanism model, whether there is a line of sight obstruction between the three-dimensional vehicle model and the three-dimensional display mechanism model, etc.; and then, the display mechanism that forms the best visual effect for the vehicle can be determined in the real scene.
[0031] In the present invention, a heartbeat connection is used to monitor the working status of the vehicle-mounted navigation device based on the navigation software and / or hardware circuit, and then determine whether the navigation of the vehicle-mounted navigation device has failed, so that navigation can be taken over from the outside as soon as the navigation fails, while eliminating the necessity of manual operation. That is, there is no need to actively switch to external takeover, nor is there any need to actively select an external display mechanism, and seamless switching to external takeover is achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 It is a schematic diagram of the implementation of the roadside display system;
[0033] Figure 2 2 is a schematic diagram of the principle of the display mechanism, in which the visible image A of a vehicle with its head facing upward and the visible image B of a vehicle with its head facing downward are both shown as enlarged schematic diagrams;
[0034] Figures 3(a), 3(b), and 3(c) are schematic diagrams showing the effect of visual data moving from a start display position to an end display position in a display component (showing only the visual effect and not as a schematic diagram of the structure of the display module);
[0035] Figure 4 Schematic diagram of the display module arrangement on the display surface (front view);
[0036] Figure 5 Schematic diagram of the display module arrangement on the display surface (top view);
[0037] Figure 6(a), Figure 6(b), and Figure 6(c) are schematic structural diagrams of the rotating mechanism (top view);
[0038] Figure 7 It is a structural diagram of the transmission connection structure (front view);
[0039] Figure 8 Schematic diagram of the connection between the movable connecting part and the arc slot;
[0040] Figure 9 is a schematic diagram of the display surface of the straight display mechanism (top view);
[0041] Figure 10 is a schematic diagram of the display surface of the corner display mechanism (top view);
[0042] In the figure: 10 is a roadside display system, 101 is a straight display mechanism, 1011 is a main display surface, 1012 is a forward display surface, 1013 is a reverse display surface, 102 is a corner display mechanism, 1021 is a first display surface, 1022 is a second display surface, 11 is a display module, 111 is a rotation fulcrum, 12 is a telescopic drive device, 121 is a telescopic rod, 13 is a transmission connection structure, 131 is a yielding link, 132 is a movable connection part, 14 is a reciprocating plate, 141 is a first reciprocating plate, 142 is a second reciprocating plate, and 143 is an arc slot. DETAILED DESCRIPTION
[0043] The present invention is further described in detail below with reference to the accompanying drawings and embodiments.
[0044] The present invention aims to solve the deficiencies in the prior art, namely, that the visual data labels set at fixed points are difficult to read and easily lead to inefficient traffic, traffic accidents and other problems; and that the on-board navigation device has no other timely alternative means when navigation fails. The present invention provides a roadside display system adapted to a moving vehicle, and the visual data displayed corresponding to the vehicle adapts to the forward movement of the moving vehicle and maintains the display at the end display position. By rotating the display angle, the visual experience is improved and the viewing time is extended, while the visual convenience of the visual data is enhanced, and a perspective effect is simulated to improve the visual transparency of the vehicle. Based on the roadside display system, the present invention also provides a method for automatically taking over vehicle navigation, so that when the on-board navigation device cannot perform normal navigation, the external roadside display system is switched to display the next navigation information for the vehicle, and the vehicle is navigated step by step from the outside.
[0045] like Figures 1 to 5As shown, the roadside display system 10 adapted to moving vehicles of the present invention provides visual data display services to vehicles on the side of the lane. Unlike the traditional signboards or display screens placed horizontally above the lane, the roadside display system 10 includes a display mechanism arranged on the side of the lane, and the display mechanism can be set based on the walls of various buildings, tunnels, and culverts. A display component is provided on the outer side of the display mechanism, and the display component is visible toward the direction of the oncoming vehicle, that is, the display component has a visual effect corresponding to different oncoming directions, and vehicles from different oncoming directions obtain different visual data through different sight lines; or, the display component displays different visual data for different oncoming directions. The visual data is any form of visual information displayed by the display component, such as static images, dynamic images, text, symbols, etc. In the present invention, a display assembly displays corresponding visual data for a vehicle using a display area of a certain size. Furthermore, the display assembly can display corresponding visual data for different vehicles approaching from the same direction. The display assembly creates a space for visual data to move. That is, if the display assembly is not completely filled with a particular visual data, the visual data will not be incompletely displayed when it moves across the display assembly. Specifically, the vehicle's position, direction of travel, and speed information are identified and acquired, and a determination is made as to whether the display mechanism is within the vehicle's effective viewing distance (which can be determined by a set field of view combined with the distance between the vehicle and the display mechanism). When the display area displaying the corresponding visual data enters the vehicle's effective viewing distance, the display area moves from a starting display position to an ending display position within the display assembly along the vehicle's direction of travel at a speed adapted to the vehicle's speed information, and remains displayed at the ending display position until the display area exits the vehicle's effective viewing distance. Typically, the horizontal viewing angle of a single eye can reach a maximum of 156 degrees, and that of both eyes can reach a maximum of 188 degrees. The overlapping visual field of a human eye is 124 degrees, and the comfortable viewing field of a single eye is 60 degrees. During specific implementation, the set field of view can select a certain angle within the monocular comfortable visual range to determine the effective viewing distance; when the visual data stays at the end display position and remains displayed, the vehicle continues to travel, and the human eye still maintains visibility of the visual data within a certain angle range, and correspondingly, the visual data remains visible for a certain period of time. Therefore, in the present invention, the length of time that the visual data remains visible to the vehicle or driver includes the length of time it moves from the start display position to the end display position, and the length of time it stays at the end display position until the display area exits the effective viewing distance of the vehicle. The visual data moves from the start display position to the end display position, adapting to the vehicle's speed information, so that the visual data can be stably maintained within the comfortable visual range of the human eye, making it easier for the vehicle or driver to read.It can be seen that in the present invention, the visual data displayed corresponding to the vehicle includes two display stages: following movement and positioning and maintaining. In the display stage of following movement, the display position of the visual data is adapted to the speed information, position, and driving direction of the vehicle in the driving state. By moving forward and maintaining a stable position relationship with the vehicle, the vehicle can be read with a stable line of sight and perspective, achieving a stable visual effect. In the display stage of positioning and maintaining, the visual data stops moving at the end display position and maintains the display, and follows the vehicle's travel until it exits the vehicle's effective visual range. The complete display process of visual data, through the process of following movement and positioning display, not only improves the visual experience, but also extends the viewing time.
[0046] The display component includes a plurality of display modules 11 arranged in a horizontal direction. The number and position of the display modules 11 used to display the visual data are determined based on the size and position of the display area corresponding to the visual data. Correspondingly, each display module 11 displays a part of the visual data. The display module 11 is connected to a rotating mechanism, which drives the display area to rotate with the vertical direction as the axis to adjust the angle between the display module 11 and the direction of the oncoming vehicle. Furthermore, the display mechanism located on the roadside can adapt to the position and driving direction of the vehicle through the angle adjustment of the display module 11. Not only can it remain within the comfortable field of view of the vehicle or driver when the visual data moves, but it can also make the angle of the display module 11 closer to the vertical angle with the line of sight of the vehicle or driver, thereby making the visible angle of the display component within the comfortable range of the vehicle's line of sight and viewing angle. In the process of following the movement and positioning the display, the visual convenience of the visual data can be enhanced, and the driver can easily read the visual data without taking his eyes off the road excessively. In specific implementations, based on the angular relationship between the display components and the lane, there are two possible states: the arrangement direction of the display modules 11 is roughly parallel to the lane, and the arrangement direction of the display modules 11 is at a certain angle to the lane. When the arrangement direction of the display modules 11 is at a certain angle to the lane, the arrangement direction of the display modules 11 is tilted toward the direction of the oncoming vehicle, and the visible area is larger than when parallel. Alternatively, the arrangement direction of the display modules 11 is tilted toward the opposite direction, and the visible area is smaller than when parallel. Among them, the arrangement direction of the display modules 11 is roughly parallel to the lane, and the arrangement direction of the display modules 11 is tilted toward the direction of the oncoming vehicle, which is more conducive to the implementation effect of the present invention.
[0047] Specifically, as shown in Figures 6 to Figure 8As shown, the rotation mechanism includes a switching transmission assembly and a rotation drive assembly respectively connected to the display module 11; the switching transmission assembly includes a telescopic drive device 12 and a transmission connection structure 13, one end of the telescopic drive device 12 is rotationally connected to the display module 11, and the other end of the telescopic drive device 12 is a telescopic rod 121, which is connected to the transmission connection structure 13; the rotation drive assembly includes a reciprocating plate 14 and a reciprocating drive device, the reciprocating drive device is connected to the reciprocating plate 14, driving the reciprocating plate 14 to reciprocate in the horizontal direction. During operation, when the telescopic rod 121 of the telescopic drive device 12 drives the transmission connection structure 13 to connect with the reciprocating plate 14, the reciprocating drive device drives the reciprocating plate 14 to reciprocate in the horizontal direction, thereby driving the display module 11 to rotate around the provided rotation fulcrum 111 with the vertical direction as the axis. When the telescopic rod 121 of the telescopic drive device 12 drives the transmission connection structure 13 to separate from the reciprocating plate 14, the display module 11 is no longer driven by the rotation drive assembly and stops rotating. In the present invention, the display module 11 can be independently controlled by a specially designed rotation mechanism. When the display module 11 is connected to the reciprocating plate 14, it is driven by the rotation drive assembly. Conversely, the display module 11 is not driven by the rotation drive assembly. Furthermore, the rotation of each display module 11 can be controlled by controlling whether the transmission connection structure 13 is connected to the reciprocating plate 14.
[0048] Furthermore, to simultaneously control the rotation of display modules 11 at different positions at different angles, in this embodiment, two reciprocating plates 14 are provided for the same display module 11. Consequently, each display module 11 has three operational states: a state separated from both reciprocating plates 14 and a state connected to one of the reciprocating plates 14. Each display module 11 selectively connects to a different reciprocating plate 14, enabling display modules 11 serving different display areas to be driven by different reciprocating plates 14 during different display phases and when the vehicle is in different lanes. This achieves stable angular synchronization with a simple structure and low cost.
[0049] Specifically, when the transmission connection structure 13 is movably connected to the first reciprocating plate 141, the corresponding display module 11 is driven by the first reciprocating plate 141 to rotate about the vertical axis. When the transmission connection structure 13 is movably connected to the second reciprocating plate 142, the corresponding display module 11 is driven by the second reciprocating plate 142 to rotate about the vertical axis. When the transmission connection structure 13 is separated from the first reciprocating plate 141 and the second reciprocating plate 142, the display module 11 stops rotating. For example, for multiple display modules 11 in a row, multiple travel segments are set, each of which includes several display modules 11 and corresponds to a piece of visual data. When each travel segment corresponds to the vehicle angle adjustment, it can be connected or separated from the corresponding first reciprocating plate 141 and second reciprocating plate 142 respectively, and the angle can be controlled simultaneously.
[0050] In the present invention, during the positioning display process, the display modules 11 at the corresponding end display position continue to adjust their angles based on the speed information, position, and driving direction of the moving vehicle, further enhancing the visual convenience of the visual data. For example, for a plurality of display modules 11 in a row, several of the display modules 11 are used to display visual data, and the visual data is adapted to the driving of the vehicle, and the display modules 11 in this row are moved and displayed; wherein, to adapt to the position information of the vehicle, the transmission connection structure 13 of all the display modules 11 in this row is first connected to the first reciprocating plate 141, and all the display modules 11 are controlled by the first reciprocating drive device to rotate to a set angle, and real-time adjustment is performed; the transmission connection structure 13 of the display modules 11 at the corresponding end display position is separated from the first reciprocating plate 141 and connected to the second reciprocating plate 142, and when the visual data moves to the end display position, the corresponding display modules 11 are controlled by the second reciprocating drive device to adapt to the position and speed information of the vehicle and rotate in real time, so that the angles of the corresponding display modules 11 achieve a more comfortable sight and viewing angle.
[0051] Specifically, the lateral distance between the vehicle and the display mechanism is determined in combination with the vehicle's position information and the display mechanism's position information. The optimal visual angle between the vehicle and the display module 11 is determined in combination with the lateral distance between the vehicle and the display mechanism and the vehicle's field of view angle range (that is, when a specific implementation angle in the selected vehicle's field of view angle range is selected, the angle between the specific implementation angle and the display module 11) is determined. Based on the optimal visual angle, the angle between the display module 11 and the direction of the oncoming vehicle is adjusted to the optimal rotation angle (that is, when the optimal visual angle is determined, the angle between the display module 11 and the direction of the oncoming vehicle); when the lateral distance between the vehicle and the display mechanism changes, the optimal visual angle and the optimal rotation angle are determined in real time, and the angle between the display module 11 and the direction of the oncoming vehicle is adjusted accordingly. When the visual data remains displayed at the end display position, the front-to-back distance between the vehicle and the display module 11 corresponding to the display area when the visual data is at the end display position is determined in combination with the vehicle's position information and the display mechanism's position information, that is, the distance between the vehicle and the end display position; the visual optimization angle between the vehicle and the display module 11 is determined in real time in combination with the front-to-back distance and the vehicle's field of view angle range, and based on the real-time visual optimization angle, the angle between the display module 11 and the direction of the oncoming vehicle is adjusted in real time until the display area exits the effective line of sight of the vehicle. Since the visual data no longer moves after reaching the end display position, the visual optimization angle can be regarded as an angle optimization adjustment based on the optimal rotation angle determined in real time to achieve a comfortable line of sight and viewing angle. Compared with the fixed signboards or display screens in the prior art, it can provide better visual convenience to vehicles or drivers.
[0052] In the present invention, the rotation drive assembly includes a first reciprocating plate 141 and a second reciprocating plate 142, which are spaced apart and arranged in parallel. The first reciprocating plate 141 is connected to a first reciprocating drive device, which controls the reciprocating motion of the first reciprocating plate 141. The second reciprocating plate 142 is connected to a second reciprocating drive device, which controls the reciprocating motion of the second reciprocating plate 142. A transmission connection structure 13 is located between the first reciprocating plate 141 and the second reciprocating plate 142. The telescopic rod 121 of the telescopic drive device 12 drives the transmission connection structure 13 to be movably connected to the first reciprocating plate 141 and the second reciprocating plate 142, respectively, or to be separated from the first reciprocating plate 141 and the second reciprocating plate 142.
[0053] In this embodiment, the transmission connection structure 13 includes a yielding link 131 and a movable connection portion 132. One end of the yielding link 131 is connected to the telescopic rod 121, and the other end of the yielding link 131 is connected to the movable connection portion 132. The yielding link 131 has a bent structure, and the end of the yielding link 131 connected to the movable connection portion 132 is located between the first reciprocating plate 141 and the second reciprocating plate 142. The movable connection portion 132 is movably connected to or separated from the first reciprocating plate 141 and the second reciprocating plate 142 by the extension and retraction of the telescopic rod 121. The movable connection portion 132 is a spherical or cylindrical structure. A plurality of arcuate slots 143, such as U-shaped slots, are provided along the length direction of the first reciprocating plate 141 and the second reciprocating plate 142 on the side opposite to the movable connection portion 132. When the movable connection portion 132 of the spherical structure or the cylindrical structure is located in the arc groove 143, the movable connection portion 132 is movably connected to the first reciprocating plate 141 and the second reciprocating plate 142 through the arc groove 143. Specifically, when the movable connection portion 132 of the spherical structure or the cylindrical structure is located in the arc groove 143, the first reciprocating plate 141 or the second reciprocating plate 142 is driven by the first reciprocating drive device or the second reciprocating drive device respectively to move in a direction perpendicular to or intersecting with the yielding link 131. The movable connection portion 132 is limited by the groove wall of the arc groove 143 in this direction of movement and cannot be disengaged from the arc groove 143 in this direction of movement, thereby realizing the movable connection between the transmission connection structure 13 and the first reciprocating plate 141 or the second reciprocating plate 142.
[0054] In the present invention, in order to adapt to vehicles in different lanes on the display component, the display component is provided with multiple rows of multiple display modules 11 arranged in the horizontal direction along the height direction; corresponding to lanes with different lateral distances from the display mechanism, different rows of display modules 11 are designated, for example, the height of the designated display module 11 for the lane that is farther from the display mechanism is higher, and vice versa, it is lower, so as to facilitate the reading of visual data by vehicles or drivers in different lanes; when overtaking, when the vehicle overtakes from the left overtaking lane, the corresponding visual data can follow the lane change of the vehicle, and based on the calculation and judgment of the lateral distance, its corresponding display area is switched to a higher display module 11 for display; when the overtaking is completed and the lane is changed back to the original lane, based on the calculation and judgment of the lateral distance, its corresponding display area is switched to the display module 11 in the original row for display, and its corresponding visual data is located before the visual data corresponding to the vehicle being overtaken.
[0055] For different vehicles in the same lane, overtaking in the same lane is unlikely because the speed of the following vehicle is affected by the preceding vehicle. Therefore, the display areas corresponding to multiple vehicles in the same lane are placed in the same row of display modules 11. Effectively, the order of visual data corresponding to different vehicles in the same lane on the display mechanism is the same as the order of the vehicles in the lane. Furthermore, the lateral distance between vehicles in the same lane and the display mechanism can be considered the same, eliminating the need for frequent angle adjustments of the display module 11.
[0056] Alternatively, among all the vehicles in the same lane, the display areas corresponding to different parts of several vehicles are respectively set in different rows of display modules 11; among them, the display effect of the corresponding visual data of several vehicles assigned to the same row of display modules 11 is the same as mentioned above.
[0057] Alternatively, for multiple vehicles traveling in the same direction, whether in the same lane or different lanes, the visual data corresponding to each vehicle is allowed to be displayed simultaneously in different display areas to meet the needs of different vehicles or drivers.
[0058] For multiple vehicles traveling in the same direction, based on each vehicle's position and speed information, a display mechanism calculates and obtains the display area, position, and display duration for displaying visual data specific to each vehicle, and determines the corresponding start and end display positions. Furthermore, based on the vehicle's position information, it is determined when the vehicle's effective sight distance reaches the corresponding display area, and the corresponding visual data begins to be displayed. The display area corresponding to the leading vehicle stops displaying its corresponding visual data at least before the effective sight distance of the trailing vehicle reaches its corresponding display area, and resumes displaying its corresponding visual data no later than when the effective sight distance of the trailing vehicle reaches its corresponding display area. This ensures that the trailing vehicle is able to obtain the corresponding visual data immediately. In particular, in traffic jams or slow-moving situations, the leading vehicle sacrifices a certain amount of display duration, which generally provides sufficient viewing time for the leading vehicle. Furthermore, in traffic jams or slow-moving situations, if the display area corresponding to the leading vehicle overlaps with the display area corresponding to the trailing vehicle, the corresponding visual data are displayed sequentially and crosswise.
[0059] In the present invention, the display mechanism simulates a perspective effect by displaying images of the external area that is blocked by the display mechanism in real time. This not only improves the visual transparency of the vehicle, but also prevents the display mechanism from blocking the vision of vehicles on both sides of the lane, allowing vehicles to see the blocked area within a suitable position range. This is beneficial for the display of shops along the street, or reduces the blind spots of important traffic locations (such as the corners of turning intersections), reducing the frequent accidents caused by visual obstruction. When performing simulated perspective, the utilization rate of the display components during the simulated perspective is maximized for several vehicles within the perspective area, while ensuring a perspective effect that is closer to reality. Specifically, the vehicle's position information, driving direction, and speed information are identified and obtained, and then one or more display mechanisms within the vehicle's current effective visual range are obtained, as well as the real-time position relationship between all display mechanisms and the vehicle. Based on the real-time position relationship between the display mechanism and the vehicle, the external area of the display mechanism located on the other side of the vehicle that is blocked by the display mechanism in real time is determined, and the image of the external area blocked by the display mechanism in real time is displayed on the display module 11 other than the display module 11 used to display the corresponding visual data, simulating the perspective effect. That is, the entire display mechanism is used as a display area for displaying the external area that is blocked by the display mechanism in real time, and when the image of the external area that is blocked by the display mechanism in real time is displayed in real time, the visual effect of hiding the display mechanism can be achieved visually, realizing simulated perspective. Among them, the real-time positional relationship between the display mechanism and the vehicle includes the real-time distance relationship between the display mechanism and the vehicle (including the lateral distance relationship and the front-to-back distance relationship), the perspective relationship determined based on the effective viewing distance (including the perspective relationship jointly determined by the horizontal perspective and the vertical perspective, wherein, based on the field of view angle range of the vehicle (including the horizontal field of view angle range and the vertical field of view angle range), different effective viewing distances determine different perspective relationships), and combined with the vehicle's driving direction and speed information, the image of the external area that is blocked by the display mechanism in real time is determined. During specific implementation, a relatively fixed line of sight and perspective can be set, such as an angle within a comfortable field of view, including a horizontal field of view and a vertical field of view, so as to determine a relatively fixed shooting range, and can be quickly calculated based on the real-time positional relationship between the display mechanism and the vehicle.
[0060] Specifically, the method for acquiring the image of the external area blocked by the display mechanism in real time is as follows:
[0061] Real-time camera mode: A camera with an adjustable shooting angle is set to capture images of the external area that is blocked by the display mechanism in real time and is located on the other side of the vehicle. Based on the real-time positional relationship between the display mechanism and the vehicle, the camera's shooting angle is determined and controlled in real time, and the image of the external area that is blocked by the display mechanism in real time is acquired and displayed in real time.
[0062] Preset image model: set the default effective viewing distance and default viewing angle range, and pre-store the panoramic image or sequence image of the external area where the display mechanism is located on the other side of the vehicle and is blocked by the display mechanism in real time, corresponding to the default effective viewing distance and default viewing angle range. Based on the real-time positional relationship between the display mechanism and the vehicle obtained in real time, the display area in the panoramic image or the image sequence in the sequence image is determined in real time, and real-time dynamic switching display is performed.
[0063] During implementation, considering that multiple vehicles may utilize the same display mechanism for simulated transparency, and that vehicles or drivers farther or closer to the display mechanism may perceive the simulated perspective less effectively than vehicles or drivers in the intervening areas, this embodiment balances the perceived effectiveness of the simulated perspective with a reasonable and feasible implementation method, targeting the simulated perspective effect specifically for vehicles or drivers in a set area with a stronger perception of the simulated perspective. Specifically, a certain distance range is defined in the lane ahead of the display mechanism along the direction of travel, serving as the perspective area. For example, the perspective area is defined from where the bottom edge of the display mechanism roughly contacts the bottom edge of the vehicle's windshield to a certain angle before the distance between the display mechanism and the vehicle exceeds the comfortable visual range of the human eye. During implementation, this can be estimated and set based on the lateral distance and fore-aft distance between the lane and the display mechanism, eliminating the need for precise, individual determination. Furthermore, ensuring that the perspective area is within the vehicle's effective visual range is a prerequisite for ensuring the effectiveness of the simulated perspective.
[0064] Specifically, based on the vehicle's position information, driving direction, and speed information, the display mechanism closest to the front within the vehicle's current effective visual range and the real-time positional relationship between the display mechanism closest to the front and the vehicle are determined to determine whether the vehicle has entered the perspective area; when the vehicle enters the perspective area, the display modules 11 of the display mechanism closest to the front, except for the display module 11 used to display the corresponding visual data, display the image of the external area blocked by the display mechanism in real time to simulate the perspective effect.
[0065] When there are multiple vehicles in the perspective area, the front vehicle is prioritized for perspective simulation, and corresponding simulated perspective is performed on the following vehicles in sequence. That is, if there are no other vehicles in front of the current vehicle in the perspective area when the current vehicle enters the perspective area, then the display modules 11 of the display mechanism closest to the front, except for the display module 11 used to display the corresponding visual data, will display the image of the external area that is blocked by the display mechanism in real time, corresponding to the current vehicle. If there are other vehicles in front of the current vehicle in the perspective area when the current vehicle enters the perspective area, then after the other vehicles in front leave the perspective area, the display modules 11 of the display mechanism closest to the front, except for the display module 11 used to display the corresponding visual data, will display the image of the external area that is blocked by the display mechanism in real time, corresponding to the current vehicle.
[0066] Based on the perspective area settings, if traffic is smooth and vehicles are moving faster, the perception of subtle differences in the simulated perspective images between consecutive vehicles will be less pronounced, thus minimizing the impact on the simulated perspective effect. If traffic is congested, vehicles will be closer together, and within the shorter perspective area, the difference in the simulated perspective images between the preceding and following vehicles will be smaller, thus minimizing the impact on the simulated perspective effect. Therefore, the perspective area settings ensure that the simulated perspective effect and feasibility are both maintained in a balanced manner under different traffic conditions.
[0067] In the present invention, for visual data that needs to be moved on multiple display mechanisms, a standard display height is determined based on the height difference between the display module 11 of each display mechanism and the road surface to ensure that the visual data maintains a certain height during the movement process, thereby ensuring that the driver's line of sight of the visual data is stable and avoiding the visual data jumping up and down during the movement due to changes in the height of different display mechanisms, which is not conducive to the driver's effective reading. Specifically, if the starting display position and the ending display position of the corresponding visual data are located at different display mechanisms respectively, then the height distance between the display components of each display mechanism from the starting display position to the ending display position and the road surface is obtained. If the difference in the height distance between multiple consecutively set display components and the road surface exceeds the set height difference threshold, then the height overlapping range of the display module 11 of the shortest display component with the smallest height distance from the road surface and the tallest display component with the largest height distance from the road surface among the multiple consecutively set display components is determined as the standard display height of the display module 11, including the lower end position and the upper end position of the display height, that is, the continuous strip display area horizontal to the road surface is redefined; multiple consecutively set display components use the standard display height as the display height, and then determine the upper end position and the lower end position of the available display range, and the corresponding visual data determines the display area within the available display range, and the corresponding display module 11. Among them, the height difference threshold includes a height rise threshold and a height fall threshold; among multiple continuously arranged display components, if the height distance difference between several continuously arranged display components and the road surface exceeds the height rise threshold, it is an ascending section; if the height distance difference between several continuously arranged display components and the road surface exceeds the height fall threshold, it is a descending section. For adjacent ascending sections and descending sections, the multiple continuously arranged display components of the ascending section and the multiple continuously arranged display components of the descending section respectively determine the standard display height with the head and tail display components. In this embodiment, the available display range is determined for the ascending section or the descending section respectively to avoid the situation where the display module 11 cannot be determined or does not overlap in height between adjacent ascending sections and descending sections, or the display module 11 overlaps in height too small to meet the display requirements of the visual data. Furthermore, if the display components of adjacent display mechanisms cannot be determined in height or there is no overlapping range, the display components of the display mechanism with a larger height distance from the road surface use the display modules 11 in the bottom row to display the corresponding visual data, and the display components of the display mechanism with a smaller height distance from the road surface use the display modules 11 in the top row to display the corresponding visual data.
[0068] In the present invention, in order to meet the different visual scenes formed by different oncoming directions and lanes on different sides of the display mechanism with the same oncoming direction, that is, vehicles or drivers in different visual scenes can obtain different visual data on the same display mechanism without interfering with each other. Correspondingly, the display component sets display surfaces with different orientations corresponding to different visual scenes. Specifically, the display component includes one or several display surfaces with different orientations relative to the lanes, and the display modules 11 adjacent in the horizontal direction on the display surface are visible in different directions; correspondingly, the display surface is based on the display modules 11 visible in different directions and has a continuous V-shaped structure, that is, adjacent display modules 11 are in a V-shaped structure, and the display modules 11 on both sides of the V-shaped structure are continuously arranged to form a grating structure, and when the line of sight is incident from one side of the V-shaped structure, it is blocked by the display module 11 on that side, and the display module 11 on the other side of the V-shaped structure is invisible to the line of sight. Furthermore, the display modules 11 adjacent in the horizontal direction on the display surface are visible in different directions, and the display component can meet the visual requirements of lanes with opposite oncoming directions, the same oncoming direction, and on the same side or different sides of the display component, including displaying corresponding visual data or simulating perspective effects. In a specific implementation, when the display mechanism is set between two lanes with the same oncoming direction, that is, vehicles located in different lanes are located on both sides of the display mechanism, and then, one side of the adjacent display modules 11 of the V-shaped structure is visible to the vehicles on one side of the display mechanism, and the other side is invisible to the vehicles on the other side of the display mechanism, that is, the visual data displayed for vehicles in different lanes are mutually invisible and do not interfere with each other. Similarly, when the display mechanism is set on the same side of the opposite oncoming direction, that is, vehicles located in different lanes are located on the same side of the display mechanism, and then, one side of the adjacent display modules 11 of the V-shaped structure is visible to vehicles in one oncoming direction, and the other side is invisible to vehicles in the other oncoming direction, that is, the visual data displayed for vehicles in different oncoming directions are mutually invisible and do not interfere with each other.
[0069] During specific implementation, according to different setting positions and implementation requirements, the display mechanisms are set at intervals or in connection. Figure 9 、 Figure 10 As shown, the display mechanism includes a straight-line display mechanism 101 provided at a straight-line driving section, and a corner display mechanism 102 provided at a turning intersection.
[0070] When the display mechanisms are arranged at intervals, the display component of the straight-ahead display mechanism 101 is provided with three adjacent vertical display surfaces, namely a main display surface 1011 parallel to the lane, a forward display surface 1012 arranged perpendicularly at both ends of the main display surface 1011, and a reverse display surface 1013, wherein the forward display surface 1012 faces the direction of oncoming vehicles, and the reverse display surface 1013 faces the opposite direction; the forward display surface 1012 is used to display corresponding visual data or simulated perspective effects for vehicles in the oncoming direction; the reverse display surface 1013 is used to display corresponding visual data or simulated perspective effects for vehicles in the opposite direction. For vehicles on the same side of the display mechanism as the oncoming direction, the forward display surface 1012 and the main display surface 1011, which are based on the display module 11 with a continuous V-shaped structure, can both display corresponding visual data for vehicles in the oncoming direction; similarly, for vehicles on the same side of the display mechanism as the oncoming direction, which are based on the display module 11 with a continuous V-shaped structure, the forward display surface 1012 and the reverse display surface 1013, which are based on the display module 11 with a continuous V-shaped structure, can both display corresponding visual data for vehicles in the opposite direction; and the visual data are not visible to each other and do not interfere with each other. For vehicles on the coming direction that are located on both sides of the display mechanism, the forward display surface 1012 is based on the display module 11 with a continuous V-shaped structure, and can display corresponding visual data for vehicles on both sides of the display mechanism in the coming direction respectively. The main display surface 1011 is based on the display module 11 with a continuous V-shaped structure, and can also display corresponding visual data for vehicles on the side of the main display surface 1011 in the coming direction; and the visual data are invisible to each other and do not interfere with each other. Similarly, for vehicles on both sides of the display mechanism in the opposite direction, the reverse display surface 1013 is based on the display module 11 with a continuous V-shaped structure, and can display corresponding visual data for vehicles on both sides of the display mechanism in the opposite direction respectively. The main display surface 1011 is based on the display module 11 with a continuous V-shaped structure, and can also display corresponding visual data for vehicles on the side of the main display surface 1011 in the opposite direction; and the visual data are invisible to each other and do not interfere with each other.
[0071] The display assembly of the corner display mechanism 102 includes at least a first display surface 1021 and a second display surface 1022, each parallel to the intersecting lanes. These display surfaces display corresponding visual data or simulated perspective effects for oncoming and opposing vehicles in each of the intersecting lanes. Similar to the straight-line display mechanism 101, the first and second display surfaces 1021, 1022, based on a continuous V-shaped display module 11, display corresponding visual data for oncoming and opposing vehicles located on the same side of the display mechanism. These visual data are invisible and do not interfere with each other.
[0072] When the display mechanisms are arranged in a connected configuration, the display assembly of the straight-line display mechanism 101 includes a main display surface 1011 parallel to the lanes, with adjacent main display surfaces 1011 connected. The display assembly of the corner display mechanism 102 includes a first display surface 1021 and a second display surface 1022, respectively parallel to the intersecting lanes, to display corresponding visual data or simulated perspective effects for oncoming and opposing vehicles in each of the intersecting lanes. The first display surface 1021 and the second display surface 1022 are each connected to the main display surface 1011 of the adjacent straight-line display mechanism 101. The visual data display and simulated perspective effects of the connected display mechanisms are similar to those of the display mechanisms arranged at intervals.
[0073] The method for automatically taking over vehicle navigation described in the present invention is based on the roadside display system and is used to display the next navigation information corresponding to the vehicle's current position information and travel direction for the vehicle through an external display mechanism when the navigation of the on-board navigation device fails, thereby achieving external navigation of the vehicle. The present invention takes over navigation from the outside, which is different from the technical principle of the on-board navigation device combining satellite positioning and electronic maps. The vehicle's position information is obtained from the outside, and a corresponding display mechanism within the vehicle's visual range is obtained; and based on the navigation route, the display mechanism is used to display the next navigation information corresponding to the vehicle's current position information and travel direction until the navigation takeover is terminated, such as when the on-board navigation device returns to normal and continues navigation, the satellite positioning signal is restored and continues navigation, and the destination is reached (the guide route ends).
[0074] The main purpose of the present invention is to serve as a backup navigation method when the onboard navigation device is operating normally, and to take over the vehicle's navigation when the onboard navigation device is unable to perform normal navigation. That is, navigation information is displayed to the vehicle from the outside to enable external navigation of the vehicle. When the onboard navigation device is operating normally, that is, navigation is effective, the onboard navigation device performs real-time navigation based on the planned navigation route. At the same time, the onboard navigation device is monitored to see if navigation has failed. If so, the vehicle's position information and driving direction are obtained, and then the display device within the vehicle's current visual range is obtained. Based on the latest destination information before the navigation failed, a new navigation route is planned or the remaining navigation route corresponding to the remaining distance in the navigation route planned by the onboard navigation device is displayed, and the next navigation information corresponding to the vehicle's current position information and driving direction is displayed. The next navigation information is continuously displayed in real time using the display device within the vehicle's visual range as the vehicle moves. That is, the next navigation information is displayed using the display device at its set position along the vehicle's driving route one by one until navigation takeover is completed. In the present invention, the display of the next navigation information by the display mechanism is actually based on the location of the display mechanism as a node, and the display of the next navigation information is used as guidance information for the vehicle, similar to a road sign with guidance information. If the next navigation information displayed by each display mechanism and the path corresponding to the next navigation information are connected, a continuous path can be obtained.
[0075] In specific implementations, in some road sections with a small number of display units and an uneven distribution, to achieve better guidance using the display units, the navigation information between the display units used to display the next navigation information for adjacent steps in a planned navigation route, using the display units as nodes, preferably contains the least distance information. That is, the next navigation information displayed by the preceding display unit is preferably directed to the next display unit containing the least distance information. This prevents the preceding display unit from displaying too much next navigation information, i.e., an overly complex route between two display units, making it difficult for the vehicle to correctly follow the next navigation information displayed by the preceding display unit. Furthermore, if there are no display units in between, navigation may be lost. For example, the path between display mechanism a and display mechanism b is the shortest, but the navigation information between display mechanism a and display mechanism b is more complex, such as including multiple intersections and multiple turns; at the same time, there are display mechanism c, display mechanism d, and display mechanism e. In the navigation route formed by display mechanism a, display mechanism c, display mechanism d, display mechanism e, and display mechanism b, each of the two adjacent display mechanisms only contains one intersection and no more than one turn. In this embodiment, preferably, the path formed by display mechanism a, display mechanism c, display mechanism d, display mechanism e, and display mechanism b is planned as the navigation route. In the present invention, the display mechanism a, display mechanism b, display mechanism c, display mechanism d, display mechanism e, etc. are only for the sake of convenience of example, and each location is set with one display mechanism as an example. Based on the roadside display system described in the present invention, each location can be set with one or more display mechanisms according to implementation requirements.
[0076] In the present invention, a heartbeat connection is used to monitor the working status of the vehicle-mounted navigation device based on the navigation software and / or hardware circuit, and then determine whether the vehicle-mounted navigation device has navigation failure. Specifically, the present invention monitors the software and hardware of the vehicle-mounted navigation device at the same time. When a software failure or / and a hardware failure occurs in the vehicle-mounted navigation device, it is determined to be a navigation failure. The present invention uses a heartbeat connection to determine whether the vehicle-mounted navigation device has navigation failure, which can not only detect the failure of the vehicle-mounted navigation device in a relatively timely manner, but also save the resource overhead (including computing resource overhead, communication resource overhead) and energy consumption of the vehicle-mounted navigation device and the monitoring device. During specific implementation, the navigation software generates a software heartbeat signal, and the hardware circuit generates a hardware heartbeat signal. The software heartbeat signal and the hardware heartbeat signal are continuously monitored by a monitoring device or an external data conversion system or an external computing system that is independent of the vehicle-mounted navigation device. When the software heartbeat signal or the hardware heartbeat signal is interrupted for more than a preset number of times, it is determined that the navigation software or the hardware circuit has failed, and then it is determined that the navigation has failed. If the independently installed monitoring device determines that the navigation software or hardware circuit has failed, it triggers the data conversion system or computing system to take over navigation; if the data conversion system or computing system determines that the navigation software or hardware circuit has failed, the data conversion system or computing system immediately takes over navigation.
[0077] In addition to navigation failures caused by software or hardware failures of the on-board navigation device, invalid satellite positioning signals can also cause navigation failures. Specifically, the on-board navigation device, a monitoring device independently provided by the on-board navigation device, or an external data conversion system or an external computing system can be used to monitor whether the satellite positioning information is valid. When the satellite positioning signal is invalid, the data conversion system or computing system is triggered to take over navigation, and then, following the movement of the vehicle, the real-time next navigation information is continuously displayed on a display device within the vehicle's visual range until the satellite positioning signal is restored. Alternatively, the on-board navigation device determines whether the satellite positioning signal is valid, generates status information, and includes the status information of the satellite positioning signal in a software heartbeat signal. The software heartbeat signal is continuously monitored by a monitoring device independently provided by the on-board navigation device, or an external data conversion system or an external computing system. When the software heartbeat signal determines that the satellite positioning signal is invalid, the data conversion system or computing system is triggered to take over navigation, and then, following the movement of the vehicle, the real-time next navigation information is continuously displayed on a display device within the vehicle's visual range until the satellite positioning signal is restored.
[0078] The present invention can follow the movement of a vehicle and dynamically determine in real time whether a display mechanism displays the next navigation information. Specifically, the vehicle's real-time position information, driving direction, and speed information are obtained, and based on the vehicle's real-time position information, driving direction, and speed information, the driving direction and speed information of the following vehicle are determined. The display mechanism is kept within a visible range in the vehicle's driving direction and at a certain distance and visual angle from the vehicle to display the vehicle's next navigation information.
[0079] The present invention can also utilize a data conversion system to perform data conversion, determine the vehicle's next navigation information, and then determine a corresponding display mechanism. Following the vehicle's position changes, the vehicle's next navigation information and the corresponding display mechanism are gradually determined. Specifically, based on the vehicle's corresponding planned navigation route and the vehicle's real-time position information, the data conversion system is utilized to perform data conversion, determine a display mechanism for the vehicle's next location where the next navigation information needs to be displayed, and control the display mechanism to display the vehicle's next navigation information. The display mechanism for the vehicle's next location where the next navigation information needs to be displayed is a display mechanism that is maintained at a certain distance and a certain visual angle from the vehicle within the vehicle's visual range relative to the vehicle's real-time position information, driving direction, and speed information.
[0080] Acquiring the next navigation information can be achieved through different methods. Specifically, when the vehicle's destination can be directly acquired, that is, when an onboard navigation device associated with the vehicle is connected to a data acquisition device, the data acquisition device acquires the vehicle's destination information and / or planned navigation route through the onboard navigation device and uses this as perception data. The data acquisition device also uses the vehicle's current location information and driving direction as perception data. All of this perception data is input into a data conversion system, which, through data conversion, generates the next navigation information corresponding to the vehicle's current location information and driving direction. When the data acquisition device acquires the vehicle's planned navigation route (and may also acquire the vehicle's destination information simultaneously) through the onboard navigation device associated with the vehicle, it first senses the global navigation route and then generates the next navigation information corresponding to each display device. When the data acquisition device acquires the vehicle's planned destination information through the onboard navigation device associated with the vehicle, it does not acquire the global navigation route, but instead generates the next navigation information in real time based on the vehicle's real-time location and driving direction.
[0081] In the absence of direct access to the vehicle's destination, in this embodiment, the data acquisition device collects the driver's trip information as perception data. It also uses the vehicle's current location and direction as perception data. All of this perception data is input into a data conversion system, which, through data conversion, generates next-step navigation information corresponding to the vehicle's current location and direction. The trip information includes confirmed or estimated destination information. This data conversion generates next-step navigation information based on the driver's trip information. In specific implementations, the confirmed or estimated destination information corresponds to the final destination or the next of multiple consecutive destinations. The above-described method is then used to obtain the global navigation route and / or next-step navigation information.
[0082] Alternatively, the present invention may utilize a computing system to calculate and determine the vehicle's next navigation information, thereby determining a corresponding display mechanism, and gradually determining the vehicle's next navigation information and corresponding display mechanism as the vehicle's position changes. Specifically, based on the vehicle's navigation route and the vehicle's real-time location information, the computing system calculates and obtains a display mechanism that matches the location where each vehicle needs to display the next navigation information; and the display mechanism maintains a certain distance and viewing angle from the vehicle relative to the vehicle's real-time location information, driving direction, and driving speed, to display the vehicle's next navigation information.
[0083] Acquiring the next navigation information can be accomplished through various methods. Specifically, when the vehicle's destination can be directly acquired, the computing system obtains the vehicle's destination information and / or planned navigation route through an onboard navigation device associated with the vehicle. By parsing the navigation route, the next navigation information corresponding to the vehicle's current location and direction of travel can be acquired. Specifically, the global navigation route is first acquired, and then parsed to obtain the next navigation information corresponding to each display mechanism.
[0084] Alternatively, the computing system obtains the vehicle's destination information through an on-board navigation device associated with the vehicle, and calculates the vehicle's next navigation information based on the vehicle's position information and driving direction. That is, the computing system does not obtain the global navigation route, but calculates the next navigation information in real time based on the vehicle's real-time position and driving direction.
[0085] In the absence of direct access to the vehicle's destination, this embodiment obtains the driver's itinerary information, which includes confirmed or estimated destination information. The navigation route is then inferred from the driver's itinerary information, where the confirmed or estimated destination information corresponds to the final destination or the next of multiple consecutive destinations. The global navigation route and / or next navigation information are then obtained using the aforementioned method.
[0086] Unlike the prior art, which actively selects a display mechanism as an extended display for a mobile device, the present invention passively takes over navigation. That is, when navigation is disabled, the vehicle-mounted navigation device does not need to actively select a display mechanism to display the next navigation information. The present invention is primarily implemented in a vehicle while in motion. However, selecting an external display mechanism while in motion is practically difficult to implement. Furthermore, the present invention primarily enables automatic selection of the optimal display mechanism for displaying the next real-time navigation information while the vehicle is in motion. In the present invention, the selection or determination of the available display mechanism includes determining the relative position of the vehicle and the display mechanism (i.e., the vehicle's direction of travel and the set viewing angle range of the display mechanism), the relative visual angle between the display mechanism and the vehicle (i.e., the angle between the display module of the display mechanism and the vehicle's frontal orientation, which can be determined by the vehicle's direction of travel), the effective viewing distance between the vehicle and the display mechanism, and whether there is any visual obstruction between the vehicle and the display mechanism (which can be determined through image recognition or object recognition), thereby determining the optimal display mechanism for vehicle guidance. The determination of the "visual range" enables the present invention to use the display mechanism with the best visual effect to display the next navigation information corresponding to the vehicle's current position information and driving direction when the display mechanism is passively selected (as opposed to the prior art that actively selects an external display mechanism for navigation). Specifically, the visual range described in the present invention is within the effective visual range and without visual obstruction; when obtaining a display mechanism within the visual range, in addition to determining whether the display mechanism is located within a certain visual angle range in front of the vehicle, and the angle between the display module and the vehicle's front direction does not exceed the set angle range, it is further determined whether there is a display mechanism in front of the vehicle that is within the effective visual range corresponding to the vehicle and there are no obstacles between the vehicle and the display mechanism that form a visual obstruction. If so, it is determined to be a display mechanism within the current vehicle's visual range.
[0087] In a specific implementation, the present invention utilizes image recognition or a three-dimensional global model to determine whether a display mechanism is within a "visible range." Specifically, the method for determining a display mechanism within a "visible range" using image recognition includes: utilizing image data captured by a forward-facing vehicle-mounted camera, based on image recognition, determining whether the display mechanism is within the vehicle's corresponding effective viewing range (this can be determined by determining the size of the display mechanism in the image captured by the vehicle-mounted camera through image recognition), and determining whether there is an obstacle between the display mechanism and the vehicle that blocks the view (determined through image recognition).
[0088] The method for determining display mechanisms within the "visible range" using a three-dimensional global model combines real and virtual scenes. First, real objects (particularly vehicles, display mechanisms, and other objects on or near the road) within the monitoring area (i.e., the real scene) covered by all cameras are three-dimensionally modeled to construct a three-dimensional global model. Accordingly, the three-dimensional global model includes three-dimensional object models corresponding to real objects, including but not limited to display mechanisms, vehicles, and obstacles. The present invention utilizes the one-to-one correspondence between the three-dimensional global model and the real scene to calculate the relationships between all three-dimensional object models in the three-dimensional global model, and further, determine the relationships between corresponding real objects in the real scene. Specifically, based on the vehicle's position information and travel direction within the monitoring area, the position, orientation, and visual point of the three-dimensional vehicle model corresponding to the real vehicle in the three-dimensional global model are correspondingly obtained. In real time, the three-dimensional display mechanism models in the three-dimensional global model are calculated to obtain all those that are within the effective viewing range corresponding to the three-dimensional vehicle model and are not obstructed by three-dimensional obstacle models. The display mechanism corresponding to the real object of the three-dimensional display mechanism model is used to display the next navigation information corresponding to the vehicle's current position information and travel direction. In practice, the monitoring area may include buildings, fixed or mobile facilities or equipment, and all of these objects are 3D-modeled to form part of the 3D global model, known as the 3D object model. These 3D models, 3D global models, and 3D object models are generated by using a 3D engine to perform modeling and rendering, resulting in digitized 3D models.
[0089] It can be seen that the present invention first constructs a three-dimensional global model of the monitoring area covered by all cameras (i.e., the real scene), and then calculates the relationship between the three-dimensional vehicle model corresponding to the vehicle and the three-dimensional display mechanism model corresponding to the display mechanism in the three-dimensional global model, including the relative position of the three-dimensional vehicle model and the three-dimensional display mechanism model, the relative visual angle between the three-dimensional display mechanism model and the three-dimensional vehicle model, the effective viewing distance between the three-dimensional vehicle model and the three-dimensional display mechanism model, whether there is any line of sight obstruction between the three-dimensional vehicle model and the three-dimensional display mechanism model, etc.; and then, the display mechanism that best forms the visual effect for the vehicle can be determined in the real scene.
[0090] In specific implementation, real objects include fixed objects (especially fixed facilities such as display mechanisms and buildings) and active objects (including facilities or equipment in a mobile state, and vehicles within the monitoring range). Correspondingly, the three-dimensional object model includes a three-dimensional fixed model corresponding to the fixed object and a three-dimensional mobile model corresponding to the active object; the position of the three-dimensional mobile model in the three-dimensional global model is adjusted in real time following the real position of the active object within the monitoring range, and the visual information follows the display of the fixed objects and the active objects on the transparent display screen.
[0091] Because the present invention does not require the display of 3D object models, and thus does not require consideration of visual simulation effects, it saves the computing power required to model and render 3D object models (especially the computing power required to obtain highly realistic models), and can be implemented using only simple virtual objects. For example, fixed objects can be uniquely identified, with their position and orientation determined, while moving objects (such as people and vehicles) can be uniquely identified and their position recognized in real time.
[0092] In the present invention, when there are multiple display mechanisms within the visible range, the set priority principle is followed and based on the strategy of optimal distance, optimal visual angle, and optimal orientation angle, one or more optimal display mechanisms are selected to display the next navigation information corresponding to the vehicle's current position information and driving direction.
[0093] Since the display mechanism is used to guide the vehicle in the form of discrete guidance information, in order to enable the vehicle to obtain the next navigation information displayed by each display mechanism in a timely manner, in the present invention, the display mechanism behind it displays the next navigation information for the vehicle in advance, ensuring that the vehicle can obtain the next navigation information in the first time under a visual state. Specifically, based on the vehicle's position information, driving direction, and speed information, using preset conditions (such as the display mechanism corresponding to the next position pointed to by the current next navigation information, or the display mechanism corresponding to all the next positions that the vehicle may reach after passing the current display mechanism, the next navigation information is displayed in advance), or through a prediction model pre-trained by machine learning, the next state of the vehicle is predicted, including the vehicle's position information, driving direction, and speed information, and the next navigation information is displayed in advance on the display mechanism that matches the predicted next state of the vehicle. In the present invention, a prediction model for each vehicle is established, and after the vehicle is identified, the associated prediction model is used to predict the next state of the vehicle.
[0094] If the prediction of the vehicle's next state is inaccurate, the display mechanism that displays the vehicle's next navigation information will be corrected based on the vehicle's real-time position information, driving direction, and speed information, and the vehicle density, environmental information, and position information, driving direction, and speed information of other vehicles around the vehicle will be used as training samples and added to the sample library for further training and adjustment of the prediction model to improve the accuracy of the prediction model.
[0095] During implementation of the present invention, since the vehicle is in motion, when the display mechanisms are discretely distributed, the front and rear display mechanisms need to determine that the identities of the vehicles at the front and rear positions (the positions corresponding to the front and rear display mechanisms) are consistent when displaying matching next-step navigation information for the moving vehicle. In the present invention, various types of sensors are continuously deployed to obtain the corresponding physical properties of all vehicles, and the identity inheritance of all vehicles is determined at consecutive positions; the display mechanisms display corresponding next-step navigation information for vehicles with different identities. That is, regardless of whether the vehicle's identity is recognized (such as determining the vehicle's clear identity through license plates or other features), by determining that the vehicles at the front and rear positions are the same vehicle, it is determined that the vehicles form identity inheritance at consecutive positions (the identity inheritance does not actually have a clear identity, but only determines that the vehicles are the same vehicle at the front and rear positions). Furthermore, even if the vehicle's clear identity is not recognized, the display mechanism can still display the corresponding next-step navigation information for the vehicle. In specific implementation, pre-set marks, symbols, codes, etc. can be used as the matching relationship between the next-step navigation information displayed by the display mechanism and the vehicle.
[0096] When the present invention is implemented, it is also possible to match and display the next navigation information for the vehicle based on the determination of the vehicle's clear identity. Specifically, the vehicle's identity is identified by a connected and deployed image acquisition device, and the vehicle's position information is determined based on the position of the image acquisition device. The display mechanism behind the image acquisition device displays the corresponding next navigation information for the vehicle with the current identity.
[0097] When the present invention is implemented, it is usually the case that a display mechanism needs to display the corresponding next navigation information for multiple vehicles at the same time. To facilitate reading for all vehicles, the present invention allocates a special display style to the vehicle whose navigation fails, and displays the next navigation information of the corresponding vehicle on the display mechanism in the special display style. That is, a special display style for displaying the next navigation information is allocated to each vehicle that needs to take over navigation, and the next navigation information is displayed on the display mechanism in the special display style belonging to each vehicle. At the same time, in order to simplify the display complexity and facilitate reading, the present invention also sets a universal display style. When a display mechanism displays the next navigation information for multiple vehicles, the universal display style replaces the special display style assigned to the vehicle corresponding to the largest number of identical next navigation information among the next navigation information of all vehicles, and is used to display the largest number of identical next navigation information; other next navigation information is displayed in the special display style of the corresponding vehicle. Because each display unit corresponds to a single location, the possible driving directions of a vehicle at a given location are limited. When multiple vehicles navigate on the same display unit, the next navigation information for multiple vehicles may be identical. For example, n vehicles may have identical next navigation information, while the next navigation information for the other m vehicles may be partially identical or different. Using a common display style to display the majority of the identical next navigation information can greatly simplify the number of next navigation information displayed on the display unit. For example, if a display unit needs to display the next navigation information for ten vehicles, and five of the vehicles display the same next navigation information on the display unit, while the other five vehicles display partially identical next navigation information, the display unit will replace the dedicated display styles for these five vehicles with a common display style. The other five vehicles will continue to display their corresponding next navigation information in their assigned dedicated display styles. Although the next navigation information for the other five vehicles may be partially identical, to avoid confusion, only the majority of the identical next navigation information will be displayed in the common display style. For the driver, if the assigned dedicated display style is not found on the display mechanism, the driver will drive according to the next navigation information displayed in the general display style. For example, when the dedicated display style and the general display style are distinguished by text of different colors, assuming that the general display style is white text and the dedicated display style is text of other different colors, if ten vehicles display the next navigation information on the current display mechanism, and the next navigation information of five of the vehicles is the same (such as going straight), the next navigation information of the five vehicles will be displayed in white text, and the next navigation information of the other five vehicles (such as driving directions other than going straight) will still be displayed in the assigned color text.
[0098] For special cases, that is, when there are multiple groups of identical next navigation information, such as n vehicles among multiple vehicles have the same next navigation information, and another n vehicles have the same next navigation information, then one group will be randomly selected from the two groups of n vehicles with the same number, and the selected group of n vehicles will replace the dedicated display style with a universal display style. The other group of n vehicles that is not selected will not replace the dedicated display style with a universal display style, and the dedicated display style of all vehicles will still be maintained to display the corresponding next navigation information.
[0099] In order to ensure that there is no conflict between the dedicated display styles of different vehicles in the same display mechanism, that is, the dedicated display styles assigned to two or more vehicles are the same (which are display styles other than the general display style), the present invention globally coordinates all vehicles that need to take over navigation to determine that the dedicated display styles do not conflict. Specifically, when assigning dedicated display styles to vehicles with navigation failure, the navigation routes of all vehicles with navigation failure (i.e., the navigation routes planned by the on-board navigation devices) are analyzed. If the navigation routes of multiple vehicles (i.e., the navigation routes planned by the on-board navigation devices of all vehicles) overlap on a certain display mechanism, different dedicated display styles are assigned to the corresponding multiple vehicles. Since the navigation routes of all vehicles can roughly form multiple roughly the same directions when performing global coordination, that is, the navigation routes of some vehicles do not intersect with the navigation routes of some vehicles, when assigning dedicated display styles, it is allowed to assign the same dedicated display style to vehicles whose navigation routes do not intersect. For vehicles whose navigation routes do intersect, different dedicated display styles are assigned. Furthermore, if multiple vehicles have overlapping navigation routes on a particular display, the system estimates the arrival time of each vehicle at the overlapping display. If the difference in arrival time exceeds a predetermined threshold, the corresponding vehicles are allowed to be assigned the same dedicated display style. Specifically, if two or more vehicles share a navigation route, each display will display the corresponding next navigation step. However, the system estimates the arrival time of each vehicle at that display. If the estimated arrival time is greater than a predetermined threshold, such as half an hour or an hour, the corresponding vehicles will not arrive at the display at the same time, and the corresponding vehicles can be assigned the same dedicated display style.
[0100] To ensure that drivers clearly understand the assigned dedicated display style, the present invention allows for a dedicated display style to be assigned to a vehicle with a navigation failure. Initially, a predetermined number of display devices corresponding to the vehicle display the next navigation information in the dedicated display style, while also displaying a reminder message to remind the vehicle of the assigned dedicated display style. For example, when the three to five display devices that have taken over navigation display information display the next navigation information, they may also display the license plate or driver's name to remind the driver of the assigned dedicated display style. Additionally, the driver may also set or pre-determine the dedicated display style when using the in-vehicle navigation device.
[0101] In the present invention, the next navigation information is displayed in text, such as go straight, turn left, turn right, drive to the left front, drive to the right front, etc. The special display style and general display style of the text include one or more combinations of color (such as pure text, gradient, multi-color, etc.), font, and visual style (including one or more combinations of visual art styles such as stroke, shadow, outer glow, background, etc.).
[0102] During specific implementation, the traditional single-point identification method can be used to identify the vehicle at a set location to achieve the purpose of identity confirmation and associated location information; it can also be determined through data conversion through a data conversion system, and then, the data conversion based on the data conversion system is equivalent to achieving non-specific feature identity recognition; it can also be determined by calculation through the computing system, and the computing system is a peer computing system, which uses collaborative computing based on a peer computing system to perform non-specific feature identity recognition.
[0103] Example: Data Conversion System
[0104] The present invention is based on all types of perception data collected in real time within a ubiquitous range, and uses all data (i.e., various types of perception data collected, or received conversion results) as input to the data conversion system. Through data conversion, the data conversion system generates, for each vehicle, the next navigation information, display instructions for controlling the display component (including controlling each display module to display the part of the visual data that needs to be displayed), and rotation instructions for controlling the rotation mechanism (including controlling the telescopic drive device of the switching transmission component and the reciprocating drive device of the rotation drive component to perform the corresponding rotation and reciprocating motion). Based on the next navigation information, the display component is controlled to match the next navigation information to output visual data, and the rotation mechanism is controlled to match the vehicle to make corresponding angle adjustments, thereby achieving real-time navigation. Now, real-time decision-making is carried out in a ubiquitous manner across the entire region, that is, the display component is continuously controlled to output corresponding visual data, and the rotation mechanism is controlled to adjust the angle. Furthermore, by adapting each driving behavior (driving behavior corresponds to changes in the vehicle's position information, and thus changes in the real-time position relationship between the display mechanism and the vehicle), each event, and each environmental change, real-time decision-making (correspondingly, generating the latest next navigation information, visual data, and angle adjustment) can guide the vehicle to respond optimally to various precautions in real time. That is, under the guidance of the latest real-time next navigation information, the vehicle can naturally and unconsciously respond optimally to various precautions. For example, when taking over vehicle navigation, it can also avoid emergency events and areas.
[0105] In the present invention, after the data conversion system is trained with a large number of samples, it can be used to make real-time decisions in a ubiquitous and integrated manner across the entire region. That is, the output conversion results control the display component to output visual data and control the rotation mechanism to match the vehicle to make corresponding angle adjustments. Similar to a person, the events and education he has experienced since childhood can be regarded as training materials, and the formed way of thinking can be regarded as a data processing model, that is, what kind of things he will encounter in the future and what kind of reactions he will output. These reactions must be consistent with the world view, outlook on life, and values contained in the training materials used in the previous training process. The world view, outlook on life, and values contained in the training materials can be regarded as the result rules embodied by the training samples, that is, what kind of input corresponds to what kind of output.
[0106] Since the next navigation information, the display mechanism for displaying the current next navigation information, the optimal rotation angle of the display module, the visual optimization angle, etc. are obtained accordingly in the process of realizing real-time decision-making for the entire region in a ubiquitous range based on the data conversion system, each display mechanism may not be fixedly deployed to match the vehicle's next navigation information (including the next navigation information obtained initially and the latest next navigation information obtained later). Instead, the next navigation information of the current vehicle on the current display mechanism, as well as the display module used to display the current next navigation information and the optimal rotation angle or visual optimization angle of the display module are formulated based on the location information of each display mechanism in the ubiquitous range, the vehicle's destination information, the planned navigation route, the driver's travel information, various events occurring in the region, the vehicle's driving behavior, etc. For example, for vehicle a, the next navigation information of vehicle a is displayed on the display module in row a of display mechanism a (including following movement and positioning maintenance); for vehicle b, the next navigation information of vehicle b is displayed on the display module in row b of display mechanism a (including following movement and positioning maintenance). Vehicle a obtains the next navigation information and matches it to display mechanism a before vehicle b. There is no pre-defined limit on which row of display modules on display mechanism a corresponds to vehicle a displaying the next navigation information. Similarly, there is no pre-defined limit on which row of display modules on display mechanism a corresponds to other vehicles, including vehicle b, displaying the next navigation information. After vehicle b obtains the next navigation information, if the next navigation information of vehicle a and vehicle b overlaps in time and space, the display module on display mechanism a corresponding to the visual data corresponding to the next navigation information of vehicle a and vehicle b is determined based on the positional relationship between vehicles a and b, and the optimal rotation angle or visual optimization angle of the display module is determined. This is a real-time decision based on the next navigation information of all display mechanisms, all vehicles within the ubiquitous range, and all vehicles that have already been generated.
[0107] In the present invention, a data conversion system is deployed within a range covering all display mechanisms, all vehicles, and all lanes. The data conversion system includes multiple data converters, and the data converters are ubiquitous in display mechanisms and vehicles. The data converters are connected to at least one type of data acquisition device, and the data acquisition device connected to the data converters collects different types of perception data in real time. The vehicle's navigation route (i.e., the navigation route planned by the on-board navigation device), position information, driving direction, speed information, and position information of the display mechanism are obtained as perception data; the perception data also includes at least the position information of the display mechanism, the position information of the display module on the display component, and the angle information of the display module. The data converter deploys a data processing model, and the data converter inputs the various types of perception data collected into the data processing model deployed by itself, outputs the conversion results, and propagates the conversion results to other data converters.
[0108] Furthermore, other data converters that receive the conversion result use the conversion result as a kind of perception data, and influence the conversion results of other data converters through the conversion result.
[0109] In the data conversion system, all data converters have no primary or secondary relationship or fixed connection paths, forming a decentralized network and computing architecture. There is no fixed, pre-set path relationship for the direction of transmission of conversion results between data converters. One of the aforementioned impacts is that, for a particular data converter, when the current data converter transmits the conversion result to the subsequent data converter, the conversion result obtained by the subsequent data converter is not entirely determined by the sensory data collected by the current data converter, but is instead determined jointly by the conversion result output by the current data converter. The conversion result output by the current data converter may change the data processing model and model parameters used by the subsequent data converter for data conversion, thereby affecting the conversion result of the subsequent data converter. For example, if the conversion result output by the current data converter is correlated with the perception data collected by the subsequent data converter, it is necessary to consider the impact of the conversion result output by the current data converter on the accuracy of the conversion result of the subsequent data converter; specifically, for the perception of a specific target, if the conversion result obtained by data conversion is only based on the perception data collected by the subsequent data converter, it can only reflect the real-time (including real-time location and time) single-point result judgment of the target within the perception range of the subsequent data converter; and the conversion result output by the current data converter reflects the direct perception data and result judgment about the target at other locations and other times, or other indirectly related perception data and result judgment, which helps to improve the accuracy and comprehensiveness of the conversion results of the subsequent data converter, including superposition calculations of the same dimension and correlation references of different dimensions.
[0110] Since there is no master-slave relationship between the data converters in the data conversion system, point-to-point transmission can be performed between the data converters. Therefore, for the conversion result corresponding to a certain perception data of a certain target reflected in the conversion result output by a certain data converter, the information is relatively symmetrical in other data converters that receive the conversion result. Other data converters use the received conversion result as input, combine it with the perception data collected by their own sensors, perform data conversion, and obtain their own conversion results. Their own conversion results naturally cover the received conversion results and the information reflected by their own sensors, and are transmitted to other data converters in the next layer. Therefore, for a certain perception data of a certain target, Knowing data, which is relatively symmetrical across all data converters, can prevent the data conversion process and conversion results of a single data converter from being tampered with or forged, thus affecting the conversion results. It also becomes a means of discovering faulty or tampered data converters and data converters with substandard performance. This fundamentally solves the fundamental hidden dangers of traditional information technology, namely, false information, forged information, and erroneous information caused by information asymmetry, which in turn becomes an entry point for fraud and cyber attacks, and complex integrated applications with poor accuracy, excessive time consumption, poor credibility, and poor adaptability. It can truly become the information infrastructure for comprehensive urban management and the infrastructure of the digital economy. Unlike blockchain technology, which still uses each node to independently calculate and determine the results and focuses on the technical solution of original data evidence, the present invention focuses on the data conversion of the data converter itself, allowing each data converter to adjust its own data processing model (i.e., data conversion algorithm) and model parameters during data conversion. The adjustment is the feedback of all data converters to their own adjustments, thereby turning the calculations of all data converters into a whole. Each data converter no longer completes calculation and recognition independently, but all data converters complete it together. After the data processing model of the data converter is adjusted, it is an objective adjustment that will affect the next data processing.
[0111] For a data converter, its conversion results can be selectively sent to specific other data converters based on implementation requirements. In specific implementations, the conversion results of a data converter do not necessarily need to be received by all other data converters, and some data converters can be selected as subsequent data converters in the next layer.
[0112] In the present invention, some or all of the data converters are provided with at least one type of sensor (one type of sensor is one type of data acquisition device) for collecting different corresponding types of perception data; the data converters in the data conversion system collect any perception data that can be perceived within their perception range through all the sensors they are provided with; at the same time, any data converter also receives the conversion results output by other data converters, obtains its own conversion results and outputs them; the entire data conversion system continuously performs perception, data acquisition, input, output, data conversion, etc. Based on this, the multiple data converters in the data conversion system perform data conversion on all perception data collected in the ubiquitous range, convert them into the conversion results of each data converter and output them, so that the data conversion system generates the next navigation information, controls the display component to match the next navigation information to output visual data, and controls the rotation mechanism to match the vehicle to adjust the angle; wherein, in the process of taking over the vehicle navigation, the visual data is output through the display component corresponding to the next navigation information.
[0113] The real-time decision-making of full-area integration described in the present invention refers to the real-time perception of all factors in the entire area where the data converter is ubiquitous. The conversion result obtained at each moment corresponds to the current comprehensive state generated by combining the current state and historical comprehensive state of all factors in the entire area at the current moment and historical moments, and the next step navigation information generated based on the real-time current and previous comprehensive states of all factors in the entire area is used to make real-time decisions for all factors in the entire area (including all factors including display mechanisms and vehicles).
[0114] In specific implementation, the present invention only needs to determine in advance or in real time the next navigation information of the vehicle on the next display mechanism or the current display mechanism; taking over the vehicle navigation based on the said next navigation information is a real-time generative integrated decision, which does not generate navigation decisions for certain vehicles and certain display mechanisms separately, but generates different decision contents for all display mechanisms and vehicles in an integrated manner for all situations. The next navigation information, the corresponding display mechanism, and the position and angle of the corresponding display module are obtained through data conversion based on the actual situation of all vehicles in a ubiquitous range, and there is no need for pre-set complete next navigation information, the corresponding display mechanism, and the position and angle of the corresponding display module.
[0115] Assume that there is a navigation route, that is, a navigation route that connects several display mechanisms and the next navigation information in series. This is information that is sorted out after the completion of the task of taking over the vehicle navigation task, including the next navigation information generated in real time for the vehicle, the corresponding display mechanism, and the position and angle of the corresponding display module. In specific implementation, there is no need to generate a visible or perceptible complete navigation route corresponding to the conversion result. The vehicle only needs to obtain the visual data output by the matching display mechanism through vision, without the need to obtain the complete navigation route in advance. However, according to implementation requirements, the present invention can also determine in advance or in real time the completed navigation route or the remaining navigation route of the vehicle from the departure point or current position to the destination, and generate the next navigation information through the conversion result if it needs to be visible or perceptible, and output it using the display mechanism.
[0116] Among them, the next step of navigation information, the corresponding display mechanism, the position and angle of the corresponding display module are for real-time decision-making based on global factors in a ubiquitous range for full-area integration, and are controlled by the output conversion results, just like throwing a ball at a person. Its evasive action is actually based on the whole person's visual, auditory, olfactory, somatosensory, internal organs and other sensory information as input, which is directly converted into the execution stimulation of glands, muscle fibers, tendons and other human organs, and then completes the execution action, that is, the evasive action. In specific implementation, the data conversion system is a black box model (such as GPT, which is also a black box model. After a certain amount of pre-training, it can output the required results based on the input). All the sensory data are input, and after the gradual conversion of each data converter, the output conversion result contains all the execution instructions. Between the input and the output, there will be no other visible and perceptible steps, such as the step-by-step process of identifying, obtaining certain factors, interacting, and transmitting.
[0117] Specifically, a certain data converter is taken as the current data converter, and the conversion results of its predecessor data converter and subsequent data converter are transferred (the predecessor data converter and subsequent data converter in the present invention are only used to describe the relationship between the current data converter in the process of data conversion and conversion result transfer, and do not mean that there is a necessary relationship between them and priority). Correspondingly, the current data converter receives the conversion results output by other data converters (including the predecessor data converter), and the subsequent data converter receives the conversion results output by other data converters (including the current data converter). For the current data converter, the collected perception data is combined with the conversion results from other data converters (including the predecessor data converter) to perform data conversion, obtain the conversion result of the current data converter, and send it to other data converters (including the subsequent data converter). Similarly, the working process of the subsequent data converter is the same as that of the current data converter, and the predecessor data converter also receives the conversion result of the predecessor data converter of the predecessor data converter, and performs the same working process as the current data converter; that is, the data converters in the data conversion system perform the same working process. Furthermore, as the data converters in the data conversion system collect and convert sensory data, they transform all data into the ability to achieve precise, real-time decision-making (accurate decisions based on the subject's identity and historical information). Data is no longer stored on a specific medium, but rather is equivalently implemented through the data converter's data conversion capabilities. The conversion results output by a data converter are only received and used as input by the subsequent data converter layer, and the conversion results of the subsequent data converter layer will include the conversion results of the previous data converter layer (including the aforementioned data converter). In the present invention, the display output of the next navigation information (i.e., visual data) used to guide the vehicle and the angle adjustment of the rotation mechanism are the conversion results directly converted and output by the data conversion system based on the status data acquired by all data acquisition devices (or sensors). The parameters of each data converter in the data conversion system are formed during each previous data conversion process. Therefore, the conversion results of the data conversion system cover both the current and previous situations.
[0118] When the data conversion result can determine the display mechanism, vehicle, next navigation information, display module matching the visual data, angle adjustment corresponding to the rotation mechanism, and a certain environmental factor, the determination of the display mechanism, vehicle, next navigation information, display module matching the visual data, angle adjustment corresponding to the rotation mechanism, and discovery of the environmental factor are complete. In this embodiment, the data conversion system's discovery of the environmental factor includes the content of the environmental factor, the location of the environmental factor, and the corresponding response. The determination of the next navigation information includes at least the content of the next navigation information and the interactive object. The determination of the angle adjustment of the rotation mechanism matching the visual data includes at least the actions required to perform the angle adjustment of the display mechanism, display module, and rotation mechanism. In the present invention, the discovery of events, environmental factors, behaviors, behavior results, execution results of the next navigation information, etc. and / or the corresponding display modules and rotation mechanisms are responded to not by a single data converter for identification and control, but by multiple data converters in the data conversion system for data conversion, which is equivalent to achieving the effect of "first perception - then transmission - then judgment - then result generation". However, it is substantially different from the existing technology based on the mindset of "first perception - then transmission - then judgment - then result generation" (that is, first collecting status data and transmitting it to several specific computing units for calculation according to certain limited rules, and then confirming events, environmental factors, etc. based on the calculation results, and then setting the execution content accordingly based on the confirmation results).
[0119] In the present invention, the data conversion system uses different types of data acquisition devices (or sensors) to collect different types of perception data in real time, that is, multimodal perception data, and converts and obtains conversion results corresponding to the collected perception data (that is, different types of perception data collected for objects within the monitoring range, corresponding data output, such as display instructions that need to be issued to the display component, rotation instructions that need to be issued to the rotation mechanism, and other processing solutions, and then controls the display component to output visual data for a specific vehicle, and controls the rotation mechanism to match the vehicle for angle adjustment; the conversion results corresponding to the collected perception data include but are not limited to display instructions, rotation instructions, etc.). The various types of sensory data collected as described above (since the present invention is implemented in the real world, and the real world operates based on various legal and human constraints, in specific implementation, the sensory data also includes but is not limited to laws and regulations, implementation standards, specifications, and custom constraints, and thus, the calculated conversion results can comply with the operating rules of the real world) and the conversion results corresponding to the collected sensory data are converted into data. The entire data conversion system is a multimodal real-time large model synchronized with reality, which generates display instructions and rotation instructions by outputting data results. Correspondingly, it controls the display component to output the next navigation information, controls the rotation mechanism to adjust the angle, and so on. Thus, the next navigation information can be obtained by using the ubiquitous data converter to obtain the conversion results.
[0120] The data conversion system described in the present invention utilizes a cloud-network converged architecture, where computing (in this invention, data conversion into a computation based on a data processing model) and storage are defined as the cloud, and data transmission is defined as the network. The data converter then integrates computing, storage, and transmission into a single data conversion process. This differs from a cloud-network separation architecture, which utilizes standalone computers, such as computers, mobile phones, routers, storage, and servers. Its fundamental characteristic is the separation of cloud (computing and storage) and network (transmission). This cloud-network separation architecture results in data being stored in a variety of ways and standards across a vast number of devices that cannot be uniformly managed, making it impossible to ensure consistency. This leads to information fragmentation and disparity, resulting in severe information asymmetry and, in turn, making it difficult to eradicate false information, fake news, and fraud. Furthermore, this large amount of separately stored information is easily stolen and tampered with by hackers and spies, posing significant security risks when connecting various information systems. Consequently, it is impossible to securely and controllably connect the major information systems that are the main arteries of economic and social development. Existing large language models, such as ChatGPT, are similar structures that only integrate cloud (computing and storage). chatGPT converts 45T of Internet data into 170 billion parameters, but does not store this Internet data. Any question raised by anyone to chatGPT is regarded as a character sequence, which is converted into a corresponding text by the converter of these 170 billion parameters. Therefore, there is no traditional information computing logic. The content and internal logic contained in the 45T data are equivalent to being fully analyzed and output results through the new logic of data conversion, thereby realizing the fusion of calculation and storage of all information (fusion into data conversion) and comprehensive response. However, since ChatGPT does not have a fusion network (transmission), chatGPT cannot determine the authenticity, validity, and legality of the received information, so "nonsense" may occur. The cloud-network fusion architecture provided by the present invention integrates the network (transmission), and the network connects various sensors. Therefore, it can synchronize and mutually verify the data conversion system with the real world, which can eliminate the defects of ChatGPT.
[0121] The cloud-network convergence architecture does not perform specific analysis on received data (i.e., various sensory data collected or conversion results received). Instead, it parameterizes this data. Within a larger scope, all data converters perform parameterized data conversion. From a global perspective, the data conversion system formed by all these converters converts all data in an integrated manner, thus forming an architecture for integrated data processing—the cloud-network convergence architecture. Within this cloud-network convergence architecture, the integrated processing of all data eliminates false and inaccurate data, thereby achieving security and control. For example, a person can dodge a ball with agility because all their neurons are performing data conversion. From the perspective of the entire nervous system, the act of dodging the ball is actually the conversion of all sensory data (visual, auditory, olfactory, balance, visceral, and various hormonal indicators) and all empirical data (which is reflected in the biological characteristics of all neurons, i.e., parameters) into output data for thousands or trillions of glands, muscle fibers, bones, ligaments, and so on.
[0122] At the same time, the integrated data processing based on the cloud-network fusion architecture can achieve trillions or even more millisecond-level processing tasks when deployed at the city level. This high-speed processing task is provably impossible, even in theory, with the existing cloud-network separation architecture.
[0123] In the present invention, data conversion based on a cloud-network fusion architecture converts all data into the ability to achieve accurate real-time decision-making. Data is no longer recorded on a certain medium, but is equivalently realized by the conversion capability of data converters for data conversion. When the present invention uses data conversion as a way to express information, all existing hacker and spy intrusion behaviors cannot be stolen or tampered with (existing intrusion behaviors are inseparable from the original data recorded on the medium). Another necessary condition for hacker and spy intrusion is to take advantage of information asymmetry to impersonate identities and steal system permissions. The data conversion system of the present invention realizes the ability to convert all data into accurate real-time decision-making in a cloud-network fusion architecture. The ubiquitous deployment of the data conversion system eliminates information asymmetry. All existing impersonation and permission theft behaviors will become factors that affect interaction. Based on the data conversion system's response through the output of the conversion result (i.e., eliminating factors that affect decision-making, for example, a common decision for vehicles that impersonate identities and steal permissions is to terminate the takeover of vehicle navigation), it fundamentally achieves security and controllability.
[0124] In the present invention, the cloud-network fusion architecture is used to influence the parameters of each data converter through all received data. For all requirements, the entire data conversion system directly converts the requirements into results (corresponding to the obtained data results), and the data conversion process uses all parameters. Therefore, the repeated calculation of data is minimized, and the storage consumption is minimized (for example, when integrating calculation and storage to realize a large language model, the tens of terabytes of text data required to train the large speech model only take up tens of gigabytes when expressed in hundreds of billions of parameters in the present invention (i.e., parameters are formed through data conversion behavior). Correspondingly, the energy consumed by transmission is also reduced in the same proportion.
[0125] In the present invention, the data converter is equipped with a data processing model, which is used to perform data conversion to obtain a conversion result. In specific implementation, each data converter gradually forms functional differentiation during the data conversion process due to the differences in its physical location, connected sensors, display components, and rotation mechanisms. Each data converter may change the architecture and model parameters of its own data processing model when performing data conversion (collecting sensory data, receiving the conversion results output by the previous data converter, and obtaining its own conversion results). That is, the data processing model adjusts the model parameters according to each conversion result received, reflecting the influence of the data converters on each other through the output conversion results; just like human neurons, they will gradually change some of their own biological characteristics according to the electrical signals conducted by other neurons, thereby reflecting human memory and learning as a whole. The influence includes improving the accuracy of the conversion results and the increasing degree of perception of the target or event. In the present invention, the current data converter receives the conversion results transmitted by other data converters and uses the conversion results as feedback signals; the feedback signals and the perception data collected by the data acquisition device connected to the current data converter are used to adjust the conversion parameters of the data conversion model of the current data converter, so that the data converter can obtain more accurate conversion results when performing data conversion.
[0126] In order to accurately reflect the mutual influence between data converters and determine whether the data processing model of the current data converter is suitable for the sensor, display component and rotation mechanism to which it is connected, in the present invention, the data processing model loaded on the data converter performs adaptive perception calculation on the data processing model of the previous data converter. Specifically, when a data converter performs calculation processing on the conversion results from other data converters, the adaptive perception calculation includes performing verification calculation on the conversion results of the current data converter and other related data converters and / or verification calculation on the historical conversion results of the current data converter to obtain an adaptability value or serve as input to the adaptability judgment model. In the present invention, based on data conversion, the result of the verification calculation is reflected in the conversion result of the data converter, so that the conversion results of a series of data converters can drive the model training facility to make greater adjustments to the data processing model of the problem data converter. The implementation method of the adaptability value can be used as an implementation method to replace the aforementioned adjustment method based on data conversion.
[0127] When the data processing model of a data converter cannot adapt to the sensor, display component and rotation mechanism to which it is connected, the adaptability value of its adaptive perception calculation affects the current conversion result of the current data converter as follows: in the current conversion result of the current data converter, a preset flag bit is assigned a value; or, other related data converters perform a comprehensive calculation on the current conversion result of the current data converter based on their own data processing models, and when the obtained conversion result enables subsequent data converters to use the conversion result as input, the conversion result is used for calculation by other data converters, and then drives the data processing model of the current data converter to be adjusted.
[0128] For the data processing model, adaptive perceptual computing is included in other calculations (including the calculation of conversion results, adjustment of the data processing model, etc.). That is to say, only one round of calculation is performed, which includes both other types of calculations and adaptive perceptual computing, that is, adaptive perceptual computing and the calculation of conversion results are performed simultaneously.
[0129] In the present invention, the adjustment of the data processing model occurs during the conversion of the current conversion result or during the conversion of several data transfers and conversion results. Specifically, the data processing model of the data converter should cover the following modes:
[0130] Mode 1: When it is found that the adaptability value of the data processing model of a certain data converter exceeds the degree threshold, the conversion result output by the data converter will add the data converter connected to the model training facility to the receiving node list. When the data converter connected to the model training facility receives such data, it will include the driving command for driving the model training facility in the conversion result obtained by its current data conversion. According to different implementation requirements, the degree threshold is a set value or a dynamic value. If the degree threshold is a dynamic value, it is determined by a pre-set program or by a dynamically updated data processing model. In the present invention, based on data conversion, during the calculation process of the conversion result of the data converter, the model training facility can be driven to adjust the data processing model of the problem data converter. The implementation method of the driving command can be used as an implementation method to replace the aforementioned adjustment method based on data conversion.
[0131] Mode 2: The model training facility is regarded as a type of sensor, and the signal it sends is added to the connected data converter. After the conversion result of the data converter is calculated and sent out, the corresponding data converter in the data conversion system will drive the data storage module of the connected sensor after calculating the conversion result. By establishing a file transfer channel between the data converters in the data conversion system or establishing a file transfer channel in other network communication modes, the perception data specified by the model training facility is sent to a specific location to participate in model training and improvement. The improved data processing model will be deployed in the same way to the data converter that the original data processing model cannot adapt to.
[0132] As another embodiment, in the present invention, the model training facility can also drive multiple data converters to use their own perception data to generate new data processing models in a federated computing manner and update the data processing models.
[0133] In the present invention, different data transmission principles can be selected according to different implementation requirements, including application scenarios, implementation type and number of sensors, etc.; specifically, the principle of data transmission between data converters is: when the conversion result of the current data converter changes, or the change in the conversion result reaches a preset threshold, the latest conversion result is sent to other data converters; or, the current data converter continuously sends each conversion result to other data converters at a certain frequency.
[0134] To further ensure the credibility of the data source and data conversion process, in the present invention, all data converters encrypt their conversion results based on a cryptographic consensus mechanism, generating encrypted results that are then sent to other data converters. The cryptographic consensus mechanism can include one or more consensus mechanisms, with different consensus mechanisms correspondingly changing the encryption algorithm structure and parameters of the data converters.
[0135] The data converter converts the input into standard-sized data packets. In this embodiment, the conversion result is a standard-sized data packet, and data converters transmit data in standard-sized data packets. In the present invention, the data converters in the data conversion system are analogous to human neurons. Each neuron does not transmit specific data that directly describes an external event. Similarly, the data converters do not output sensory data. Instead, they process sensory data acquired by connected sensors and data acquisition devices into standard-sized data packets (i.e., conversion results, similar to neuronal impulses) based on their own data processing models (similar to the biological characteristics of neurons). The information contained in a single data packet is insufficient to restore any event or target information. Deterministic results can only be achieved by combining the conversion results of the entire data conversion system, multidimensional data matrix elements, and physical space and facility correspondences. Data conversion is not highly dependent on the output of a few data converters and simultaneously processes requests received or initiated by all data converters. This represents a collaborative verification calculation of multidimensional related information, fundamentally changing the single-point security-sensitive nature of traditional information technology.
[0136] In order to ensure the integrity of data and the effective execution of data conversion, in the present invention, the data conversion system deploys a QoS mechanism, which prioritizes the transmission quality of conversion results between data converters.
[0137] In specific implementations, the data conversion system is networked using one or a combination of 4G, 5G, or MESH modes to adapt to different application scenarios and achieve the optimal solution based on factors such as feasibility and cost considerations. The MESH mode is based on the LTE standard and communicates at the LTE physical layer. Data is carried using a customized frame structure, and interaction is performed using a dedicated wireless communication protocol. Customizing the frame structure for data conversion and employing a proprietary wireless communication protocol developed for data conversion in urban clusters further enhances security and reliability. Furthermore, the wireless algorithm fully adapts to the consensus-based multipath channel environment required for data conversion in the data conversion system. Communication distances within cities are 100 meters to 10 kilometers, and outdoor transmission distances of 120 kilometers are also possible using omnidirectional antennas. In this embodiment, the mesh network communication distance is 50-150 meters between data converters indoors and 50 meters to 120 kilometers outdoors. Each node can access 65,535 data converters. In addition, when networking in 4G mode or 5G mode, the communication distance is unlimited, and the number of data converters that can be connected depends on the computing power of the computing chip and the communication delay.
[0138] In the data conversion system of the present invention, the conversion result obtained and output by the data converter during data conversion can be implemented as a state representing the state corresponding to the sensory data, which can be represented by a state value. Consequently, the data converter does not need to store or transmit the sensory data. Based on the technical characteristics of the data conversion system, it can be applied to various scenarios that provide targeted services or control for a specific target or event. Based on this, because the conversion results transmitted between data converters are the processing results of information rather than the information itself, the collected sensory data can be stored without storage. Data converters only receive the calculation results output by other data converters and transmit their own conversion results. The information contained in a single conversion result is insufficient to restore any event or target information. To obtain a definitive result, data conversion must be performed jointly by the conversion results of the entire data conversion system, the multidimensional data matrix elements, and the corresponding relationships between physical space and facilities. Data conversion is less dependent on the information transmitted by a small number of data converters, which can fundamentally change the single-point security sensitivity of traditional information technology.
[0139] In the present invention, since the conversion result output by each data converter reflects the state evolution of the conversion result output by the previous data converter, the behavior, attributes, state, or event of the target when it was perceived by each of the previous data converters can be reversed based on the conversion result received by the current data converter. For example, when it is necessary to find the location of target a 15 minutes ago, the location corresponding to the data converter that perceived target a can be obtained at the current moment, and the location of target a can be inferred. Then, based on the transmission path of the conversion result, the location of target a 15 minutes ago can be reversed to infer the location of target a 15 minutes ago (determined by the data converter that perceived target a). Furthermore, the data converter does not need to store the perception data about target a. That is, based on the present invention, it is not necessary to identify the perception data to achieve the search for target a. Instead, the data converter that perceived target a can be reversed first. If necessary, the perception data of target a at the time of the search can be obtained from the storage device connected to the data converter.
[0140] Based on the data conversion system, when the vehicle travels between display mechanisms based on the next navigation information, the multiple data converters based on the data conversion system collect perception data and convert data to generate a conversion result suitable for driving between the vehicle display mechanisms; wherein, when collecting perception data corresponding to the target (the target at least includes the display mechanism, the display module of the display mechanism, the rotation mechanism, and the vehicle), it is equivalent to determining each unique target as itself without obtaining the display mechanism identity information and the vehicle identity information, which is equivalent to achieving non-specific feature recognition, as well as position identification of the target and obtaining the target's position information. In the present invention, data conversion is equivalent to generating a certain content, and the generated content is equivalent to achieving processes such as discovery, determination, identification, and acquisition of objects including but not limited to targets, behaviors and behavioral results of targets, events, environmental factors, visual data, angle adjustments, etc., but in fact does not perform the clear steps of determination, identification, and acquisition commonly seen in the prior art.
[0141] Specifically, the data converter is connected to a data acquisition device that includes at least one type of sensor (which, in specific implementations, may include one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a lidar, a chemical sensor, and an electromagnetic induction device). The data converter's computing unit converts data based on a data processing model to obtain a conversion result. Data converters located at different acquisition locations (i.e., at different physical installation locations) collect at least one point sample of the object to be identified (i.e., the target for non-specific feature recognition). The point sample represents the sensor data of the corresponding sensor type. Based on the described data conversion system, the present invention can perform data conversion without obtaining the identity information of the object to be identified. This effectively achieves the effect of determining each unique object to be identified as itself, equivalent to achieving non-specific feature recognition. The "non-specific feature recognition" described in the present invention, in its strictest sense, differs from the conventional definition of "identification." Conventional "identification" refers to determining the concrete form or specific identity information of a target, such as who it is (including a license plate, name, and specific information indicating the target's identity) or what it is (e.g., a display mechanism, vehicle, driver, etc.). The "identification" in the "non-specific feature identification" described in the present invention means that each unique object to be identified is determined to be itself; that is, for a certain object to be identified, its existence is unique. After the present invention implements "non-specific feature identification", it determines that the object to be identified is itself, not other objects to be identified. The result of "non-specific feature identification" does not require the determination of the specific features of the object to be identified, nor does it require the determination of the identity information or concrete form of the object to be identified. For example, for a person, it is considered as object A to be identified, and for an object, it is considered as object B to be identified. Then, after implementing "non-specific feature identification", it is not necessary to identify object A to be identified as a person and its specific identity, nor is it necessary to identify object B to be identified as an object and its specific object; instead, it is necessary to determine that object A to be identified is object A to be identified itself, and object B to be identified is object B to be identified itself. Then, corresponding services or controls can be performed for object A to be identified or object B to be identified.
[0142] When an event is detected within the perception range of the data conversion system, based on the technical ideas of the present invention, it is usually not discovered directly by a data converter, but rather by the perception data collected by multiple data converters after data conversion, and the integrated output of the next navigation information, the responses of each display component, and the rotation mechanism is equivalent to determining which perception data changes occurred at which perception locations of which nodes; wherein, all data converters of the data conversion system can convert to obtain effective recognition results. In most cases, there is no clear intermediate conversion result such as what event occurred at which location. Instead, as the event occurs, each data converter drives the execution device that needs to make a targeted response to the event to execute the corresponding execution action based on data conversion to complete the corresponding operation (such as based on the next navigation information, the display component outputs visual data, the rotation mechanism adjusts the angle, etc.).
[0143] In a data conversion system, for a certain point sample of a certain object to be identified, the conversion result transmitted from the data converter that collected the point sample to other data converters can enable subsequent data converters to adjust perceptual attention based on the features of the point sample (the features of the point sample do not necessarily need to be included in the conversion result, but the features of the point sample participate in the data conversion of the previous data converter, so that when the conversion result of the previous data converter serves as the input of the data processing model of the subsequent data converter, the data processing model of the subsequent data converter can achieve the effect of adjusting perceptual attention during data conversion); or, the features of the point sample are reported for subsequent data converters to adjust perceptual attention (the features of the point sample are directly expressed in the conversion result). If other subsequent data converters do not detect the features of the point sample, but it can be determined from the features of other point samples that the features of the undetected point sample still belong to the object to be identified, the features of the undetected point sample continue to be expressed in the conversion result of the current data converter and transmitted to other data converters. For example, the data acquisition device (or sensor) connected to the previous data converter senses the color of the object A to be identified, and the data acquisition device (or sensor) connected to the current data converter does not sense the color of the object A to be identified. However, it can be determined from the perception data of the data acquisition devices (or sensors) connected to other data converters that, in addition to other objects to be identified, there is also an object A to be identified. Then, in the overall data conversion process, the color of the object A to be identified that was not sensed will still be represented in the conversion result of the current data converter.
[0144] In this embodiment, the method for reporting the characteristics of the point sample for subsequent data converters to adjust perceptual attention is: adjusting the parameters of the data processing model of the subsequent data converter based on the characteristics of the point sample provided by the previous data converter, so that the subsequent data converter improves the computing power of identifying the characteristics of the point sample; or, the subsequent data converter uses the perceptual attention model to match the characteristics of the received point sample to adjust the computing power.
[0145] Among them, the above-mentioned "features" have a different meaning from the "feature recognition" in the prior art. The "feature recognition" in the prior art usually refers to information that can determine the identity of the target, while the "feature" of the present invention represents a kind of perceived perceptual data belonging to the object to be identified, such as coordinates, colors on the object to be identified, etc. The "non-specific feature recognition" of the object to be identified cannot be directly completed by the "features" perceived only at a single point.
[0146] In this embodiment, the method of reporting the characteristics of the point sample for subsequent data converters to adjust perceptual attention is: adjusting the parameters of the data processing model of the subsequent data converter based on the conversion result expressing the characteristics of the point sample provided by the previous data converter (in the present invention, the characteristics of the point sample itself are usually not provided, but the characteristics of the point sample are expressed in the conversion result), or the characteristics of the point sample (that is, the characteristics of the point sample itself), so that the subsequent data converter improves the computing power of identifying the characteristics of the point sample; or, the subsequent data converter uses the perceptual attention model to match the characteristics of the received point sample or the conversion result expressing the characteristics of the point sample to adjust the computing power.
[0147] When processing the conversion results output by several preceding data converters, the data converter, based on the data processing model, merges the point sample features and other information described by each data converter into a single target if the conversion results obtained by these preceding data converters indicate that the objects to be identified can be identified as the same target through certain common point sample features. For example, point sample features in physical space that almost completely overlap at the same time can be determined to be the same target.
[0148] When the conversion result received by the data converter indicates that the flag used by the current data converter to identify the object to be identified before the current conversion result is received is different from the flags used by other data converters to identify the object to be identified, and the flags assigned to the object to be identified by the other data converters are more recent, the flag used by the current data converter to identify the object to be identified before the current conversion result is received is converted. Specifically, the method for converting the flag used by the current data converter to identify the object to be identified before the current conversion result is received is:
[0149] The flag used by the current data converter to identify the object to be identified before the current conversion result is received is replaced with the latest flag assigned to the object to be identified by other data converters; this is a relatively simple implementation method provided by the present invention.
[0150] Alternatively, the conversion relationship between the flag used by the current data converter to identify the object to be identified before the current conversion result is received and the flag assigned to the object to be identified by other updated data converters is recorded, and the conversion is performed when the current data converter needs to refer to the current conversion result received; this is a relatively complex implementation method provided by the present invention.
[0151] Alternatively, the data converter deploys a conversion model to perform corresponding conversions on the signs of multiple objects to be identified based on the input perception data or conversion results; this is a more complex implementation method provided by the present invention.
[0152] In the present invention, in order to improve the effectiveness of "non-specific feature recognition", for one or more point samples collected successively by data converters at different collection positions, if the feature values of one or more point samples at different collection positions respectively meet the preset similarity conditions or are determined by a specific model to have a correlation reaching a threshold, and are unique at each collection position, then it is determined that the point samples at different collection positions are associated.
[0153] On the other hand, for one or more point samples collected simultaneously by data converters at different collection positions, if the data converters at different collection positions collect the same spatial field, when there is only a unique object to be identified in the spatial field, or the collected point samples can correctly point to one of the multiple objects to be identified, then for a certain object to be identified, the one or more point samples collected by the data converters at different collection positions are correlated.
[0154] In the present invention, the data acquisition device of the data converter includes one or more combinations of an image acquisition device, an electromagnetic induction device, a temperature measuring device, and a vibration frequency sensing device, and a laser radar. The data collected by the above devices (i.e., one or more combinations of the image acquisition device, the electromagnetic induction device, the temperature measuring device, and the vibration frequency sensing device) and the three-dimensional point cloud collected by the laser radar or the point cloud generated based on images collected by multiple image acquisition devices are jointly calculated to obtain three-dimensional points with data; the image color, contour, line, reflectivity, motion trend, electromagnetic characteristics, temperature, temperature change trend, vibration frequency, and vibration frequency change trend based on two-dimensional perception are used as additional attributes of the corresponding three-dimensional points to form a three-dimensional point cloud with attributes; combined with electromagnetic induction, temperature laws, vibration frequency change characteristics, motion correlation (different motion correlations presented by different materials such as ropes and cloth), and reflectivity, the correspondence between each area of the three-dimensional point cloud with attributes and each part or associated parts of the 3D appearance of the object to be identified is determined. This embodiment uses the attributes of the attributed three-dimensional point cloud and its correlation to determine the relationship between each point, the correspondence between each area to which each related point belongs and each part or associated parts of the 3D appearance of the object to be identified, all of which are used as input to the data converter. It can more accurately determine the point sample features belonging to the object to be identified, and improve the efficiency and accuracy of the equivalent "non-specific feature recognition".
[0155] In the process of realizing "non-specific feature recognition" through data conversion, the present invention can also obtain the identity information of the object to be identified as the input of the data converter when necessary. Specifically, when it is determined that the identity information of the object to be identified needs to be obtained, the identity information acquisition command is triggered, and the identity information acquisition command is used as one of the inputs to participate in the acquisition of the conversion result of the data converter. By driving the data converter connected to the data conversion system with barrier-free data acquisition conditions that can obtain the identity information of the object to be identified to respond to the corresponding conversion result, the identity information of the object to be identified is obtained. Similar to the display component performing a corresponding response display and the rotating mechanism performing a corresponding response execution, the acquisition of identity information is the result of data conversion, that is, the determination that the identity information needs to be obtained triggers the acquisition of identity information, rather than an additional trigger through a specific request command. Based on the present invention, if the permission calculation is triggered by a request command, in most cases, it can be completed without obtaining the identity information. In a few cases where it is found that the permission calculation cannot be completed without obtaining the identity information, the determination that the identity information needs to be obtained is generated according to the implementation requirements. For example, if data conversion reveals that a vehicle's identity information exists in several locations' parking and entry registration systems, customs clearance registration systems, or toll registration systems, and if the vehicle is authorized in advance or legally authorized to access the information, the data conversion system can drive data converters connected to these systems in a barrier-free data acquisition manner. The acquired relevant information is then sent to the data conversion system via each data converter, enabling information comparison and accurate identity information to be provided. This approach also minimizes the possibility of tampering with a system to counterfeit an identity.
[0156] When the data converter in the data conversion system that can obtain identity information does not provide identity information, the information source device that drives the identity information is established through an encrypted file transmission channel established between the data converter input terminal that needs to obtain identity information or an encrypted information transmission channel established in other network communication modes; the identity information is used as one of the inputs of the data converter.
[0157] During specific implementation, the data converter may also be provided with leakage protection and other functions in its power supply device. The data converter may also provide various communication interfaces, including optical fiber interfaces, wireless communication interfaces, etc., so as to load the conversion results on the traditional network and send them to other data converters; it may also provide a data interface for external storage devices, compatible with the original data storage requirements under the cloud-network separation architecture (writing certain data, such as the original data sensed by the sensor, to the external storage is also the conversion result achieved by the integration of the entire conversion system, not the act of accommodating the writing of the original data to the storage medium during the data conversion process). The data converter may be powered by solar energy or mains electricity. The implementation of the data converter, if implemented outdoors, can be installed on poles such as street lights (no cross arm is required, it can be mounted on the main pole, or integrated in the lampshade); in pole-free areas, if implemented indoors, it can be wall-mounted or integrated in the ceiling.
[0158] When implemented indoors and outdoors, data converters, as AI-powered infrastructure installed in public spaces, can serve as digital economic infrastructure for urban agglomerations, providing seamless 24 / 7 coverage. By converting data across these converters, vehicle identification can be achieved with near-100% accuracy at any location within the coverage area. Location accuracy is directly correlated to sensor precision.
[0159] In the data conversion system architecture of the present invention, all data converters are of the same type and function, and each data converter performs real-time and dynamic adjustments to its own data processing model based on the consensus mechanism of the data conversion system. The sensory data collected by the data acquisition device (including sensors, cameras, etc.) connected to each data converter are processed and encrypted by the data converter according to its own data processing model, generating byte-level processing and encryption results (i.e., conversion results), which will be sent to other data converters (the calculation and encryption results output by other data converters received by the current data converter at the same time are also part of the sensory data collected by the current data converter). Therefore, the effect of the sensory data perceived by each sensor will be propagated among the vast number of peer data converters according to the power level. If each data converter sends its own conversion result to 100 surrounding data converters, after four units of time, hundreds of millions of data converters will be affected by the events perceived by the sensor. Under this computing model, information is relatively symmetrical and immune to tampering and forgery, which fundamentally solves the fundamental hidden dangers of traditional information technology, namely, false information, forged information, and erroneous information caused by information asymmetry, which then becomes the entry point for fraud and cyber attacks, as well as complex and comprehensive application problems such as long cycle, poor accuracy, and poor adaptability. It will truly become the information infrastructure for comprehensive urban management and the infrastructure for the urban digital economy.
[0160] The present invention takes into account various events occurring within a ubiquitous range (including the real-time status of traffic, events occurring in real time within the area covered by the ubiquitous range, etc.), which may affect the behavioral results corresponding to the current vehicle's driving behavior (such as a large vehicle blocking the vehicle's driving or blocking the line of sight), and thus affect the current vehicle's execution result of the next navigation information, and ultimately affect the accuracy and adaptability of the latest next navigation information generated in real time (that is, adapting to the driving behavior of each vehicle, each event, and each environmental change in real-time decision). In this embodiment, the perception data collected by various data acquisition devices is used as input, and the perception data at least includes the vehicle's execution result of the next navigation information and reference information; based on the data conversion of the data conversion system, the vehicle's next navigation information is generated. The reference information includes but is not limited to public opinion information, weather information, Internet of Things data, and schedule information authorized to be read by regional users; for example, whether energy conservation is advocated and affects the working status of the display mechanism, whether there is a climate that affects visibility, whether the city Internet of Things recognizes the existence of sudden traffic congestion, whether the driver has a temporary schedule and changes the destination or navigation route, and so on. Therefore, the present invention can regain the next navigation information of each display device and each vehicle in response to various events in a ubiquitous range, and guide the display device and the vehicle to take over the vehicle navigation in a more real-time manner.
[0161] When executing the task of taking over vehicle navigation, as the vehicle travels between display mechanisms, multiple data converters based on the data conversion system collect perception data and perform data conversion to obtain the latest next navigation information corresponding to the next display mechanism of the vehicle. If the vehicle has not completed the current next navigation information at the location of the current display mechanism, and has generated the latest next navigation information corresponding to the next display mechanism, then based on the execution result of the vehicle on the current next navigation information, through data conversion, the latest next display mechanism that matches the execution result is determined, and the latest next navigation information is generated accordingly, and the corresponding visual data is output to guide the vehicle. Therefore, the present invention can also obtain the execution result of the current next navigation information, thereby enabling the vehicle to continue to execute the task of taking over vehicle navigation when the vehicle has not completed the current next navigation information at the current display mechanism.
[0162] In the present invention, further, the perception data also includes at least the driving behavior of the vehicle; data conversion is performed based on multiple data converters in the data conversion system to generate display instructions for controlling the display component and rotation instructions for the rotation mechanism, the display component is controlled to output visual data corresponding to the vehicle, and the rotation mechanism is controlled to make an angle adjustment to match the position of the vehicle (the rotation mechanism matches the visual data, and the angle adjustment of the rotation mechanism that matches the visual data also matches the visual data); wherein, the display instruction and the rotation instruction are represented in the conversion result; the display component and the rotation mechanism connected to the data converter receive the conversion result through the data converter, and control the display component to output visual data corresponding to the vehicle and control the rotation mechanism to make a corresponding angle adjustment through the display instruction and the rotation instruction represented by the conversion result. During specific implementation, the display component and the rotating mechanism are connected to the data converter, or a data processing model is deployed and serves as one of the data converters, or the data converter connected to the display component and the rotating mechanism is equivalent to the neuron of the display module or the display component of the display module, the rotating mechanism or the executive component of the rotating mechanism; all data acquired by the data converter (including various types of perception data received by each data converter, conversion results transmitted between data converters, etc.) are used as input to the data conversion system, and the output of the data conversion system is the display instruction of the display module or the display component of the display module, the rotation instruction of the rotating mechanism or the executive component of the rotating mechanism (actually, it is the conversion result calculated by a data converter, and the display module or the display component of the display module, the rotating mechanism or the executive component of the rotating mechanism responds to the conversion result to complete the corresponding response display and response execution). Based on this, the specific display instructions and rotation instructions are generated by the entire data conversion system and represented in the conversion results, rather than being independently generated by a data converter connected to the display component and the rotation mechanism. The display component responds to display and the rotation mechanism responds to execution based on the conversion results obtained by data conversion. Therefore, the response efficiency is high, avoiding illegal responses such as false display, false execution, or not displaying when it should be displayed or not executing when it should be executed due to network attacks. To avoid hijacking, the present invention can also use multiple data converters to collaboratively control the display component and the rotation mechanism, further improving the immunity to hijacking attacks, and being immune to various types of intrusions and hijacking by existing hackers. At the same time, the data conversion system uses all the perception data of the entire monitoring range and the output of the data converter (usually the conversion result obtained by the data converter for data conversion) as input. The output obtained by conversion includes the display instructions of the display module or the display component of the display module, the rotation instructions of the rotation mechanism or the execution component of the rotation mechanism, which is like using a God's perspective to control the display module or the display component of the display module, the rotation mechanism or the execution component of the rotation mechanism within the monitoring range, which can greatly reduce the probability of errors and accidents.
[0163] The present invention also senses the behavior of all vehicles and various events in a ubiquitous range (including all display devices, various events occurring in all lanes, and driving behaviors or events occurring during vehicle driving) in the process of taking over the vehicle navigation task and inputs them into the data converter, which is equivalent to knowing what the vehicle has done in the past, what it has encountered in the past, what it will encounter in the future, what has happened in the ubiquitous range (including all display devices, all lanes), and other information, and generates a conversion result based on this, which is equivalent to using this information as the basis for generating the latest next-step navigation information, visual data, and angle adjustment.
[0164] In a specific implementation, data conversion is performed based on multiple data converters in a data conversion system to perform an integrated response, such as discovery, determination, and generation, to the vehicle's execution result for the current next-step navigation information, reference information, and driving behavior. The vehicle's execution result for the current next-step navigation information, reference information, and driving behavior are used as perception data. Based on the data conversion by the data conversion system, the latest next-step navigation information for the corresponding vehicle is obtained, and display instructions for controlling a display component and rotation instructions for a rotation mechanism are generated. When the latest next-step navigation information, display instructions, and rotation instructions are related to the vehicle's execution result for the current next-step navigation information, reference information, or driving behavior, the latest next-step navigation information obtained in real time represents the impact of the vehicle's execution result for the current next-step navigation information, reference information, or driving behavior on the underlying next-step navigation information. Furthermore, the vehicle's latest next-step navigation information is retrieved based on the vehicle's execution result for the current next-step navigation information, reference information, and driving behavior, using the output conversion result, to determine the latest next-step navigation information for the corresponding vehicle on the next display mechanism.
[0165] When considering the navigation routes of all vehicles (i.e., the navigation routes planned by the on-board navigation device), the working status of all display mechanisms (including whether the display modules and rotating mechanisms are normal, and the busy / idle status of the display modules), and their impact on the next navigation information or the latest next navigation information of all relevant display mechanisms and vehicles, in the present invention, when obtaining the next navigation information or the latest next navigation information corresponding to each display mechanism and vehicle, it is also equivalent to realizing that the execution results of the current next navigation information of all display mechanisms and vehicles based on their respective next navigation information or the latest next navigation information can form a mutual influence, and similarly to the aforementioned technical solution for obtaining the latest next navigation information, the latest next navigation information corresponding to all display mechanisms and vehicles is obtained. Specifically, the navigation routes of all vehicles and the working status of all display mechanisms are obtained; correspondingly, data conversion is performed based on multiple data converters in the data conversion system to generate the next navigation information corresponding to all vehicles and all display mechanisms. The present invention obtains the next navigation information or the latest next navigation information that needs to be executed by the current display mechanism corresponding to the current vehicle at the current moment, and the next navigation information or the latest next navigation information that needs to be executed by the current vehicle corresponding to the current display mechanism at the current moment based on the navigation routes of all vehicles and the working status of all display mechanisms. The present invention does not obtain in advance the complete navigation routes (information that is serially organized by the next navigation information corresponding to the task of taking over the vehicle navigation) or the latest next navigation information of the display mechanisms corresponding to all related vehicles, and the complete navigation routes or the latest next navigation information of the vehicle corresponding to all display mechanisms. Therefore, the present invention can more efficiently obtain the next navigation information or the latest next navigation information with higher adaptability at the current moment for each vehicle, reduce the number of times and the length of navigation routes obtained, and is beneficial to the optimal configuration of computing resources of the data conversion system.
[0166] In the present invention, the execution results of the current next navigation information by different vehicles on their respective corresponding display mechanisms based on their respective next navigation information or the vehicle whose latest next navigation information has been completed can affect the latest next navigation information generated by other vehicles and other display mechanisms in the future. That is, for the current vehicle and the current display mechanism, other vehicles and other display mechanisms each navigate through the next navigation information, perform parameterization based on data conversion, and adjust the conversion parameters of the data conversion model of the data converter; when the data conversion system based on real-time adjustment of conversion parameters obtains the latest next navigation information of the current vehicle and the current display mechanism, the other vehicles and other display mechanisms each navigate through the next navigation information, and the conversion parameters of the data conversion model based on the data converter are adjusted based on the adjustment performed (that is, the execution results of the current next navigation information by the other vehicles and other display mechanisms based on their respective next navigation information or the vehicle whose latest next navigation information has been completed, specifically, the parameterization based on data conversion and adjustment of the conversion parameters of the data conversion model of the data converter), forming the decision background for the latest next navigation information of the current vehicle and the current display mechanism. In the present invention, different vehicles and different display mechanisms each navigate through the next navigation information and serve as the background for mutual decision-making. This is the inevitable result of the data conversion system making real-time decisions based on full-area integration in the international scene. It is determined by the continuous adjustment of the conversion parameters of the data conversion model of the data converter as data conversion and transmission of conversion results are continuously carried out. Therefore, the present invention does not require a judgment process of "different vehicles and different display mechanisms each navigate through the next navigation information and serve as the background for mutual decision-making", but is based on the objective fact of "yes is yes, no is no" (that is, the conversion parameters of the adjusted data conversion model have determined what kind of conversion results will be obtained corresponding to the input perception data).
[0167] Based on implementation requirements, when it is necessary to reflect the impact of other vehicles' completed execution results on the current next navigation information, or to reflect the decision context formed, in the next navigation information corresponding to the current vehicle, this embodiment further generates, based on data conversion, descriptions of the execution results of other vehicles and other display devices on the current next navigation information, based on their respective next navigation information or the latest next navigation information, and pushes them to the vehicle or driver. Overall, the execution results of the current next navigation information by a large number of vehicles and display devices serve as decision contexts (influencing each other), integrating and interacting across vehicles and display devices to form a decision network. As new vehicles join, existing vehicles leave, new display devices join, existing display devices leave, and navigation takes over for all vehicles, the decision network automatically advances. Accordingly, the next navigation information or the latest next navigation information for each vehicle and display device is also generated in an integrated manner based on the progress of the decision network, ultimately ensuring that the next navigation information for each vehicle and display device is closest to the actual road conditions or navigation needs. In the present invention, the results of the vehicle's and display's execution of the current next navigation information serve as the context for each other's decision-making. The next navigation information or the latest next navigation information corresponding to the vehicle's display can be considered as a data conversion system that generates the next navigation information or the latest next navigation information in real time based on the results of the vehicle's and display's execution of the current next navigation information, combined with all other factors. Furthermore, the present invention replaces the need for pre-existing next navigation information with the ability to generate decisions. Specifically, conventional navigation solutions require a comprehensive pre-planned plan. Under the technical guidance of the prior art, no matter how detailed the conditions are, they cannot achieve the real-time decision-making that adapts to each vehicle, display, and event as described in the present invention.
[0168] In the present invention, the data conversion system is a cloud-network fusion architecture, that is, the data acquisition device, computing power unit and data processing model of the data converter are collaboratively designed. As a result, there may be differences in hardware and software between different data converters, especially software differences, that is, different data converters have different data processing models and different model parameters, resulting in different data converters generating different outputs for the same input. Therefore, in the present invention, the data processing model is made to learn and utilize the hardware-specific analog properties of the data converter, wherein the data processing model does not need to know the specific hardware-specific analog properties, such as the internal connection method of the data converter and the function by which the input and output of the data converter are related. Based on this, the present invention simulates back propagation as follows to obtain the behavior pattern of the gradient, so as to realize the data processing model learning and utilizing the hardware-specific analog properties of the data converter and complete the complete deep learning process, as follows:
[0169] Behavior mode 1: output disturbance, specifically:
[0170] 1.1) Load a random output perturbation vector (composed of random small perturbations) to the output corresponding to each data converter of the data conversion system;
[0171] 1.2) Based on one or a small number of samples, measure the change in the global loss function (if the output of the data converter does not obtain the expected output value (i.e., the conversion result of the data converter), by constructing a loss function between the output value and the true value) after using the output perturbation vector;
[0172] 1.3} Based on the improvement of the loss function, the effect of the output perturbation vector is permanently loaded into the output of the data converter in a proportional manner.
[0173] The behavior pattern based on output perturbations is roughly consistent with backpropagation, that is, it roughly follows the gradient.
[0174] Behavior mode 2: Input disturbance, specifically:
[0175] 2.1) Generate a random input perturbation vector and perform perturbation on the input of each data converter;
[0176] 2.2) Observe the changes in the loss function under several samples (small batches of samples);
[0177] 2.3) Compute how to change the output of the data converter to follow the gradient.
[0178] The behavior pattern based on input perturbations is exactly the same as backpropagation, that is, it fully follows the gradient.
[0179] In the present invention, a large number of loss functions are used to define the local objectives of different data translators in the data conversion system, and then the data conversion system is divided into a large number of small conversion subsystems, and then the behavior pattern of the output disturbance or input disturbance is used to learn the data processing model of the conversion subsystem.
[0180] Example: Peer-to-peer computing system
[0181] The peer-to-peer computing system of the present invention is based on collaborative computing, does not rely on single-point identification, and distributes all computing functions in the peer-to-peer computing system, reducing the software and hardware requirements of single-point computing, with high execution efficiency and greatly improved anti-attack capabilities; the information is relatively symmetrical between node devices, and can be immune to the problem of illegal data tampering. Even if a single node device is physically cracked and the data it sends is tampered with, because the calculation of the peer-to-peer computing system is a complex calculation with ultra-high redundancy and ultra-multi-dimensional verification, the tampering of the data sent by a single node device does not affect the calculation results of the peer-to-peer computing system, and the fault and the tampered node device can be quickly located to ensure the credibility of the calculation results of the peer-to-peer computing system. Furthermore, it can resolve the contradiction between data sharing and information security between departments.
[0182] The result data transmitted between node devices can be the processing result of information, rather than the information itself, and thus the collected original data (i.e., perception data) does not need to be stored. The node device only receives the calculation results output by other node devices and sends out its own calculation results. The amount of information contained in a single calculation result is not enough to restore any event and target information. The calculation results on the entire peer computing system, the multi-dimensional data matrix elements, and the correspondence between physical space and facilities must be collaboratively calculated to obtain a definite result. Collaborative computing has less dependence on information transmitted by a few node devices, and thus can fundamentally change the nature of traditional information technology that is sensitive to single-point security.
[0183] In the present invention, vehicle identity and location information can be obtained through collaborative computing within the peer-to-peer computing system provided herein. Specifically, the peer-to-peer computing system is used to perform non-specific feature recognition and location identification on the vehicle. In this embodiment, the definition of "non-specific feature recognition" is the same as in the data conversion system embodiment.
[0184] The peer-to-peer computing system includes multiple node devices, and there is no primary-secondary relationship between all node devices, forming a decentralized network and computing architecture. Unlike the traditional information-based single-point convergence computing model, the direction of data transmission between the node devices of the present invention does not have a fixed, preset path relationship. In the peer-to-peer computing system described in the present invention, for a certain node device, the collected original data is processed to obtain result data, and the result data is transmitted to other node devices; the other node devices that receive the result data use the result data as one of the collected original data, and influence the result data of other node devices through the result data. For the convenience of expression, the aforementioned "certain node device" is referred to as the "current node device" and the "other node devices" are referred to as "subsequent node devices". One of the influences is that the result data calculated by the subsequent node device is not completely determined by the original data collected by itself, but is jointly determined with the result data output by the current node device; wherein, the result data output by the current node device may change the data processing model and parameters used by the subsequent node device to calculate the result data, thereby affecting the result data of the subsequent node device. For example, if the result data output by the current node device is correlated with the original data collected by the subsequent node device, it is necessary to consider the impact of the result data output by the current node device on the accuracy of the result data of the subsequent node device; specifically, for the perception of a specific vehicle, if the result data obtained is calculated only based on the original data collected by the subsequent node device, it can only reflect the real-time (including real-time location and time) single-point result judgment of the vehicle within the perception range of the subsequent node device; and the result data output by the current node device reflects the direct perception data and result judgment about the vehicle at other locations and other times, or other indirectly related perception data and result judgment, which helps to improve the accuracy and comprehensiveness of the result data of the subsequent node devices, including superposition calculations of the same dimension and correlation references of different dimensions.
[0185] Since there is no master-slave relationship between node devices in the peer-to-peer computing system, point-to-point transmission can be carried out between node devices. Therefore, for the calculation result corresponding to a certain perception data of a certain vehicle reflected in the result data output by a certain node device, the information is relatively symmetrical in other node devices that receive the result data. Other node devices use the received result data as input, combine it with the perception data of their own sensors, and calculate their own result data. Their own result data naturally includes the received result data and the information reflected by their own sensors, and transmit it to other node devices in the next layer. Therefore, for a certain perception data of a certain vehicle, the information is relatively symmetrical among all node devices, which can be immune to the impact of tampering and forgery of the calculation process and calculation results of a single node device on the result data. It also becomes a means to discover faulty or tampered node devices and node devices with non-compliant performance, fundamentally solving the fundamental hidden dangers of traditional information technology, namely, false information, forged information, and erroneous information caused by information asymmetry, which then becomes an entry point for fraud and network attacks, and complex integrated applications with poor accuracy, excessive time consumption, poor credibility, and poor adaptability. It can truly become the information infrastructure for comprehensive management of larger regions and the infrastructure of the digital economy. Unlike blockchain technology, which still uses each node to independently calculate and determine the results, and focuses on the technical solution of original data evidence, the present invention focuses on peer-to-peer collaborative computing between node devices. Through peer-to-peer collaborative computing, each node device can adjust its own data processing model (i.e., the algorithm for calculating the result data) and parameters when processing data. The adjustment is the feedback of all node devices on their own adjustments, thereby turning the calculations of all node devices into a whole. Each node device no longer completes the calculation independently, but all node devices complete the calculation together. After the data processing model of the node device is adjusted, it is an objective adjustment that will affect the next data processing.
[0186] The node device is provided with a data acquisition device (in specific implementation, it may include one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a laser radar, a chemical sensor, and an electromagnetic induction device), and an operation module. The data acquisition device includes at least one type of sensor for collecting perception data of different corresponding types. The operation module calculates and obtains the result data based on the data processing model. The node devices set at different collection positions (that is, located at different physical installation positions) collect at least one point sample of the vehicle, and the point sample is the perception data of the corresponding sensor type. Based on this, without the need to obtain the identity information of the vehicle, multiple node devices in the peer computing system perform collaborative calculations to determine each unique vehicle as itself, realize non-specific feature recognition, and perform position identification on the vehicle.
[0187] Specifically, taking a certain node device as the current node device, combined with the data transmission of its predecessor node device and subsequent node device (the predecessor node device and subsequent node device in the present invention are only used to describe the front-end relationship with the current node device in the current calculation and data transmission process, and do not mean that there is a necessary front-end relationship and priority relationship between them), correspondingly, the current node device receives the result data output by other node devices (including the predecessor node device), and the subsequent node device receives the result data output by other node devices (including the current node device). For the current node device, the collected perception data is combined with the result data from other node devices (including the predecessor node device) to calculate the result data of the current node device and send it to other node devices (including the subsequent node device). Similarly, the working process of the subsequent node device is the same as that of the current node device, and the predecessor node device also receives the result data of the predecessor node device of the predecessor node device, and performs the same working process as the current node device; that is, the node devices in the peer computing system perform the same working process. Furthermore, the node devices in the peer computing system perform collaborative computing as the perception data is collected and the result data is calculated. The result data output by a certain node device is only received and used as input by the subsequent node device at a layer. The result data of the subsequent node device at a layer will cover the result data of the previous node device at a layer (including the aforementioned node device).
[0188] Node devices communicate with each other using standard-sized data packets (i.e., result data or calculation results). In the present invention, the node devices of the peer-to-peer computing system are similar to human neurons. Each neuron does not transmit specific data that directly describes external events. Similarly, the node devices do not output raw data, but process the raw data obtained by the connected sensors and data acquisition devices into standard-sized data packets (i.e., result data or calculation results, similar to the nerve impulses of neurons) based on their own data processing models (similar to the biological characteristics of nerve cells). The amount of information contained in a single data packet is not enough to restore any event and target information. The calculation results, multi-dimensional data matrix elements, and physical space and facility correspondences on the entire peer-to-peer computing system must be collaboratively calculated to obtain a definite result. Collaborative computing has little dependence on the data output by a few node devices, and collaborative computing simultaneously processes the needs received or initiated by all node devices. It is a collaborative verification calculation of ultra-multi-dimensional related information, which can fundamentally change the nature of traditional information technology that is sensitive to single-point security.
[0189] The present invention utilizes the collaborative computing of a peer computing system. When the result data of the collaborative computing can determine a certain event, the discovery of the event is completed. In this embodiment, the discovery of the event by the peer computing system includes the content of the event, the location where the event occurred, and the corresponding response disposal. In a peer computing system, all events are processed synchronously, and it is not necessary to clearly generate such interim result outputs as what event was discovered and what the specific content of the event is. In a peer computing system, only the perception of the sensor and the corresponding execution device (the present invention, that is, the display mechanism and the rotation mechanism) are clearly responded to. The other intermediate processes are all processed simultaneously by collaborative computing. That is, during the operation of the present invention, the intermediate process of event discovery is imperceptible. As the collaborative computing proceeds, the result data of the node device is obtained, and the corresponding execution device automatically responds and executes.
[0190] In the present invention, each display mechanism and rotation mechanism participates in a peer-to-peer computing system through one or more node devices. To prevent hijacking, the present invention utilizes multiple node devices to collaboratively control the display mechanism and rotation mechanism, further enhancing immunity to hijacking attacks. The vehicle's onboard navigation device, acting as an access device, connects to the node devices and submits navigation requests to the peer-to-peer computing system. In the present invention, a navigation request can be considered a request command, i.e., a request for the vehicle to autonomously drive from one location to another. Responses to request commands can include various scenarios, such as "request-execution," "request-response," and others. When the result data calculated by one or more node devices in the peer-to-peer computing system matches the request command, the result corresponding to the request command is represented in the result data output by one or more node devices, according to preset conditions or pre-deployed programs or data processing models deployed on the node devices. If, based on collaborative computing, the current node device determines that a response to the request command is required, the current node device sends instructions to an execution device connected to the current node device based on the calculated result data, controlling the execution device to complete the response action; this is a "request-execution" scenario. In the present invention, if it is determined based on collaborative calculation that the display mechanism needs to present the next navigation information based on the corresponding vehicle and the rotation mechanism needs to adjust the angle based on the position and speed of the corresponding vehicle, the current node device will send a display instruction to the display mechanism connected to the current node device according to the calculated result data, control the display mechanism to complete the navigation information presentation, and send a rotation instruction to the rotation mechanism connected to the current node device to control the rotation mechanism to complete the angle adjustment.
[0191] Based on collaborative computing in a peer-to-peer computing system, an execution device can serve as one of the node devices. As the collaborative computing proceeds, when the result data obtained by the execution device is capable of performing the relevant operation corresponding to the request command, the execution device completes the response to the request command. In the present invention, the vehicle's next navigation information is represented by the result data; the display mechanism receives the result data output by the connected node device. If a specific element in the result data indicates that the display mechanism needs to present navigation information, or if the result data is used as one of the inputs of the node device's data processing model and the corresponding display mechanism is determined to present navigation information, the display mechanism will present the corresponding navigation information.
[0192] When the display mechanism needs to present navigation information, the display mechanism combines the result data received from other node devices to calculate its own result data, and uses the obtained result data to control the display mechanism to present the corresponding navigation information. In the present invention, the display mechanism does not need to first determine whether it needs to present navigation information. Instead, it combines the result data received from other node devices with the sensor data collected by its own sensors and inputs it into its own data processing model. The output result data indicates whether the display mechanism should present navigation information and the content of the navigation information to be presented.
[0193] In the present invention, the result data obtained by calculation includes the optimal solution of all situations obtained based on the collaborative calculation of all vehicles in the channel and the external environment at the current moment; the vehicle's next navigation information is presented through the display mechanism. In the present invention, the results of the calculation of various types of information by the peer computing system are all reflected in the result data. All display mechanisms, as one of the node devices, when participating in the collaborative calculation of the peer computing system, their output includes the optimal solution of all situations; furthermore, the control instructions of all display mechanisms are the optimal solution instructions output by the node devices connected to them after the collaborative calculation. The present invention does not have the traditional generation instructions and sending instructions, that is, to avoid the security vulnerabilities existing in the generation instructions and sending instructions, making the display mechanism a risk point.
[0194] In this embodiment, the display mechanism is a node device connected to the execution components of specific functions. The execution feedback information of the execution components of the display mechanism is fed back to the display mechanism and participates in the calculation of subsequent result data of the display mechanism.
[0195] In the present invention, since the display mechanism can serve as one of the node devices, the display mechanism responds and executes accordingly based on the computational results obtained through collaborative computing. This provides high response efficiency and avoids illegal responses such as false execution or non-execution due to network attacks. To prevent hijacking, the present invention can also use multiple node devices to collaboratively control the display mechanism, further improving immunity to hijacking attacks.
[0196] The same applies to the angle adjustment of the rotating mechanism.
[0197] In a peer-to-peer computing system, the result data obtained and output by the node device can be implemented as a state corresponding to the perception data (i.e., the original data), which can be represented by a state value. Therefore, the node device does not need to store and send the original data. In this embodiment, the data or elements in the multidimensional matrix are related to the installation location, attributes, etc. of each node device. Therefore, when the result data is transmitted, what is actually transmitted is the transcoded result after multiple sets of parameters are transcoded. The so-called multidimensional matrix is actually a combination of multiple sets of parameters. For example, the path of a vehicle starts from abcd, and the physical position of the abcd node device is fixed, so the sequence of abcd can be expressed by one character or a similar concept when multiple sets of parameters are transcoded and transmitted.
[0198] In the present invention, the display mechanism receives the result data output by other node devices. The principle is: when the corresponding display mechanism is required to present navigation information, if the result data calculated by one or more node devices can determine the display mechanism that needs to present the navigation information, the corresponding display mechanism is added to the node list for transmitting the current result data, and the one or more node devices directly transmit the result data to the display mechanism or the node device to which the display mechanism is connected, wherein the corresponding display mechanism is added to the node list for transmitting the result data according to the preset conditions or algorithm output or model output. Alternatively, the display mechanism receives the result data output by other node devices in a layer-by-layer transmission manner. In the process of collaborative computing of the peer computing system, the node device will also calculate the node list that needs to receive the result data when calculating the result data each time. One or more display mechanisms that need to be added are clearly known based on the current result data and will be added to the node list. The display mechanism or the node device to which the display mechanism is connected will be directly used as the subsequent node device of the next layer to directly receive the current result data, thereby achieving transcendence of normal layer-by-layer transmission and turning the peer computing system into a three-dimensional architecture. For example, the result data of the current node device clearly indicates that it needs to be documented. If the normal layer-by-layer transmission method is used, the result data of the current node device needs to be transmitted to the corresponding node device through at least one or more layers of transmission. If the corresponding node device is added to the node list, the corresponding node device can directly receive the result data of the current node device when transmitting it to the next layer, which will greatly shorten the processing time and improve the response capability. The present invention adopts a peer-to-peer computing system, so this temporary construction is precisely the advantage of the present invention. The traditional information-based layer-by-layer convergence architecture cannot withstand the complex computing requirements brought about by this temporary network construction.
[0199] The above embodiments are only used to illustrate the present invention and are not intended to limit the present invention. As long as they are based on the technical essence of the present invention, any changes or modifications to the above embodiments will fall within the scope of the claims of the present invention.
Claims
1. A roadside display system adapted to a moving vehicle, characterized in that: The display device includes a display mechanism disposed beside a lane, a display component disposed on an outer side of the display mechanism, and the display component is visible toward an oncoming vehicle; the display component displays corresponding visual data for the vehicle through a display area of a certain size; Identify and obtain the vehicle's position information, driving direction, and speed information, and determine whether the display mechanism is within the vehicle's effective visual range; when the display area displaying corresponding visual data enters the vehicle's effective visual range, the display area moves from the starting display position to the ending display position in the display component along the vehicle's driving direction at a moving speed adapted to the vehicle's speed information, and maintains display at the ending display position until the display area exits the vehicle's effective visual range.
2. The roadside display system adapted to a moving vehicle according to claim 1, characterized in that: The display component includes a plurality of display modules arranged in a horizontal direction. The number and position of the display modules used to display the visual data are determined based on the size and position of the display area corresponding to the visual data. Accordingly, each display module displays a portion of the visual data. The display module is connected to a rotating mechanism, and the rotating mechanism drives the display area to rotate with the vertical direction as the axis to adjust the angle between the display module and the direction of the oncoming vehicle.
3. The roadside display system adapted to a moving vehicle according to claim 2, characterized in that: The rotation mechanism includes a switching transmission assembly and a rotation drive assembly respectively connected to the display module; the switching transmission assembly includes a telescopic drive device and a transmission connection structure, one end of the telescopic drive device is rotationally connected to the display module, and the other end of the telescopic drive device is a telescopic rod, which is connected to the transmission connection structure; the rotation drive assembly includes a reciprocating plate and a reciprocating drive device, the reciprocating drive device is connected to the reciprocating plate, and drives the reciprocating plate to reciprocate in the horizontal direction; When the telescopic rod of the telescopic drive device drives the transmission connection structure to connect with the reciprocating motion plate, the reciprocating drive device drives the reciprocating motion plate to reciprocate in the horizontal direction, thereby driving the display module to rotate with the vertical direction as the axis; when the telescopic rod of the telescopic drive device drives the transmission connection structure to separate from the reciprocating motion plate, the display module stops rotating.
4. The roadside display system adapted to a moving vehicle according to claim 3, characterized in that: The rotation drive assembly includes a first reciprocating plate and a second reciprocating plate arranged in parallel and spaced apart from each other. The first reciprocating plate is connected to a first reciprocating drive device, and the second reciprocating plate is connected to a second reciprocating drive device. A transmission connection structure is located between the first reciprocating plate and the second reciprocating plate. The telescopic rod of the telescopic drive device drives the transmission connection structure to movably connect with the first reciprocating plate and the second reciprocating plate, or to separate from the first reciprocating plate and the second reciprocating plate. When the transmission connection structure is movably connected to the first reciprocating plate, the corresponding display module is driven by the first reciprocating plate to rotate with the vertical direction as the axis; when the transmission connection structure is movably connected to the second reciprocating plate, the corresponding display module is driven by the second reciprocating plate to rotate with the vertical direction as the axis; when the transmission connection structure is separated from the first reciprocating plate and the second reciprocating plate, the display module stops rotating.
5. The roadside display system adapted to a moving vehicle according to claim 4, characterized in that: The transmission connection structure includes a yielding link and a movable connection part. One end of the yielding link is connected to the telescopic rod, and the other end of the yielding link is connected to the movable connection part. The yielding link is a bent structure, and the end of the yielding link connected to the movable connection part is located between the first reciprocating motion plate and the second reciprocating motion plate. The movable connection part is driven by the extension and retraction of the telescopic rod to movably connect or separate with the first reciprocating motion plate and the second reciprocating motion plate respectively.
6. The roadside display system adapted to a moving vehicle according to claim 5, characterized in that: The movable connection part is a spherical structure or a cylindrical structure, and a plurality of arc slots are provided on the side of the first reciprocating motion plate and the second reciprocating motion plate opposite to the movable connection part; When the movable connection part of the spherical structure or the cylindrical structure is located in the arc groove, the movable connection part is movably connected to the first reciprocating motion plate and the second reciprocating motion plate through the arc groove.
7. The roadside display system adapted to a moving vehicle according to any one of claims 2 to 6, characterized in that: In combination with the vehicle's position information and the display mechanism's position information, the lateral distance between the vehicle and the display mechanism is determined. In combination with the lateral distance between the vehicle and the display mechanism and the vehicle's field of view angle range, the optimal visual angle between the vehicle and the display module is determined. Based on the optimal visual angle, the angle between the display module and the direction of the oncoming vehicle is adjusted to the optimal rotation angle. When the lateral distance between the vehicle and the display mechanism changes, the optimal visual angle and the optimal rotation angle are determined in real time, and the angle between the display module and the direction of the oncoming vehicle is adjusted accordingly.
8. The roadside display system adapted to a moving vehicle according to claim 7, characterized in that: When the visual data remains displayed at the end display position, the front and rear distance between the vehicle and the display module corresponding to the display area when the visual data is at the end display position is determined in combination with the vehicle's position information and the display mechanism's position information; the visual optimization angle between the vehicle and the display module is determined in real time in combination with the front and rear distance and the vehicle's field of view angle range; based on the real-time visual optimization angle, the angle between the display module and the direction of the oncoming vehicle is adjusted in real time until the display area exits the vehicle's effective viewing distance.
9. The roadside display system adapted to a moving vehicle according to claim 7, characterized in that: The display assembly is provided with multiple rows of display modules arranged in the horizontal direction along the height direction; and different rows of display modules are designated for lanes at different lateral distances from the display mechanism; The display areas corresponding to several vehicles in the same lane are set in the same row of display modules; or, among all the vehicles in the same lane, the display areas corresponding to several vehicles in different parts are respectively set in different rows of display modules; For multiple vehicles traveling in the same direction, the visual data corresponding to each vehicle is allowed to be displayed simultaneously in different display areas.
10. The roadside display system adapted to a moving vehicle according to claim 9, characterized in that: For multiple vehicles traveling in the same direction, the display area, location of the display area, and display duration of visual data for different vehicles are calculated based on the position information and speed information of each vehicle. Based on the vehicle's position information, it is determined that the effective viewing distance of the vehicle reaches the corresponding display area, and the corresponding visual data begins to be displayed. In which, the display area corresponding to the leading vehicle stops displaying its corresponding visual data at least before the effective viewing distance of the trailing vehicle reaches its corresponding display area, and displays its corresponding visual data no later than when the effective viewing distance of the trailing vehicle reaches its corresponding display area.
11. The roadside display system adapted to a moving vehicle according to claim 1, characterized in that: Identify and obtain the vehicle's position information, driving direction, and speed information, and then obtain one or more display devices within the vehicle's current effective visual range, as well as the real-time positional relationship between all display devices and the vehicle; based on the real-time positional relationship between the display device and the vehicle, determine the external area on the other side of the vehicle where the display device is located and is blocked by the display device in real time, and display the image of the external area blocked by the display device in real time on the display module other than the display module used to display the corresponding visual data, to simulate the perspective effect.
12. The roadside display system adapted to a moving vehicle according to claim 11, characterized in that: A certain distance range is defined in the lane in front of the display mechanism along the direction of travel as a perspective area, and the perspective area is within the effective visual range of the vehicle; based on the vehicle's position information, travel direction, and speed information, the display mechanism closest to the vehicle within the current effective visual range is determined, as well as the real-time positional relationship between the closest display mechanism and the vehicle, to determine whether the vehicle has entered the perspective area; When the vehicle enters the perspective area, the display modules of the display mechanism closest to the front, except for the display module used to display the corresponding visual data, display the image of the external area blocked by the display mechanism in real time, simulating the perspective effect.
13. The roadside display system adapted to a moving vehicle according to claim 12, characterized in that: If the current vehicle enters the perspective area and there is no other vehicle in front of the current vehicle in the perspective area, then the display modules of the display mechanism closest to the front, except for the display module used to display the corresponding visual data, display the image of the external area blocked by the display mechanism in real time, corresponding to the current vehicle; If there are other vehicles in front of the current vehicle within the perspective area when the current vehicle enters the perspective area, after the other vehicles in front leave the perspective area, the display modules of the display mechanism closest to the front, except for the display module used to display the corresponding visual data, will display the image of the external area that is blocked in real time by the display mechanism corresponding to the current vehicle.
14. The roadside display system adapted to a moving vehicle according to claim 13, characterized in that: The real-time positional relationship between the display mechanism and the vehicle includes the real-time distance relationship between the display mechanism and the vehicle, the viewing angle relationship determined based on the effective viewing distance, and the image of the external area blocked by the display mechanism in real time, combined with the vehicle's driving direction and speed information.
15. The roadside display system adapted to a moving vehicle according to claim 14, characterized in that: The method for obtaining the image of the external area blocked by the display mechanism in real time is as follows: A camera with an adjustable shooting angle is provided to capture an image of an external area that is blocked in real time by the display mechanism and is located on the other side of the vehicle. Based on the real-time positional relationship between the display mechanism and the vehicle, the camera's shooting angle is determined and controlled in real time to capture and display the image of the external area that is blocked in real time by the display mechanism in real time. Alternatively, a default effective viewing distance and a default viewing angle range are set, and corresponding to the default effective viewing distance and the default viewing angle range, a panoramic image or a sequence image of the external area where the display mechanism is located on the other side opposite to the vehicle and is blocked by the display mechanism in real time is pre-stored. Based on the real-time positional relationship between the display mechanism and the vehicle obtained in real time, the display area in the panoramic image, or the image sequence in the sequence image, is determined in real time, and real-time dynamic switching and display are performed.
16. The roadside display system adapted to a moving vehicle according to claim 1, characterized in that: If the starting display position and the ending display position of the corresponding visual data are located at different display mechanisms respectively, then the height distance between the display components of each display mechanism from the starting display position to the ending display position and the road surface is obtained; if the difference in the height distance between multiple consecutively arranged display components and the road surface exceeds the set height difference threshold, then the height overlapping range of the display modules of the shortest display component with the smallest height distance to the road surface and the tallest display component with the largest height distance to the road surface among the multiple consecutively arranged display components is determined as the standard display height of the display module, including the lower end position and the upper end position of the display height; multiple consecutively arranged display components use the standard display height as the display height, and then determine the upper end position and the lower end position of the available display range.
17. The roadside display system adapted to a moving vehicle according to claim 16, characterized in that: The height difference threshold includes a height rise threshold and a height fall threshold. Among multiple consecutively arranged display components, if the height difference between several consecutively arranged display components and the road surface exceeds the height rise threshold, it is an ascending segment; if the height difference between several consecutively arranged display components and the road surface exceeds the height fall threshold, it is a descending segment. Among them, the adjacent ascending section and descending section, the multiple continuously arranged display components of the ascending section, and the multiple continuously arranged display components of the descending section respectively determine the standard display height based on the first and last display components.
18. The roadside display system adapted to a moving vehicle according to claim 2 or 11, characterized in that: The display assembly includes one or more display surfaces facing different directions relative to the lanes, and display modules adjacent to each other in the horizontal direction on the display surface are visible in different directions; correspondingly, the display surface presents a continuous V-shaped structure based on the display modules visible in different directions.
19. The roadside display system adapted to a moving vehicle according to claim 18, characterized in that: The display mechanisms are arranged at intervals or in contact with each other; the display mechanisms include a straight-line display mechanism arranged on a straight-line section of a road, and a corner display mechanism arranged at a turning intersection; When the display mechanisms are arranged at intervals, the display assembly of the straight-ahead display mechanism is provided with three adjacent vertical display surfaces, namely a main display surface parallel to the lane, a forward display surface arranged perpendicularly at both ends of the main display surface, and a reverse display surface, wherein the forward display surface faces the direction of oncoming vehicles and the reverse display surface faces the opposite direction; the forward display surface is used to display corresponding visual data or simulated perspective effects for vehicles in the oncoming direction; and the reverse display surface is used to display corresponding visual data or simulated perspective effects for vehicles in the opposite direction; The display component of the corner display mechanism includes at least a first display surface and a second display surface respectively parallel to the intersecting lanes, and displays corresponding visual data or simulated perspective effects for vehicles in the oncoming direction and the opposite direction in each lane of the intersecting lanes; When the display mechanisms are arranged in contact, the display components of the straight-ahead display mechanism include main display surfaces parallel to the lanes, with adjacent main display surfaces contacting each other; The display component of the corner display mechanism includes a first display surface and a second display surface, which are respectively parallel to the intersecting lanes, and respectively display corresponding visual data or simulated perspective effects for vehicles in the oncoming direction and the opposite direction in each lane of the intersecting lanes; the first display surface and the second display surface are respectively connected to the main display surface of the adjacent straight display mechanism.
20. A method for automatically taking over vehicle navigation, characterized in that: Deploying a roadside display system according to any one of claims 1 to 19 beside a lane; The vehicle-mounted navigation device performs real-time navigation based on a planned navigation route; monitors whether the vehicle-mounted navigation device has failed navigation; if so, obtains the vehicle's location information and driving direction, and then obtains a display device within the vehicle's current visual range; plans a new navigation route based on the latest destination information before the navigation failed, or a remaining navigation route corresponding to the remaining distance of the navigation route planned by the vehicle-mounted navigation device, and displays next navigation information corresponding to the vehicle's current location information and driving direction; Following the movement of the vehicle, the real-time next navigation information is continuously displayed through the display device within the vehicle's visual range until the navigation takeover is completed.
21. The method for automatically taking over vehicle navigation according to claim 20, characterized in that: Based on the vehicle's location information, driving direction, and speed information, a prediction model pre-trained under preset conditions or through machine learning is used to predict the vehicle's next state, including the vehicle's location information, driving direction, and speed information. The next navigation information is displayed in advance on a display device that matches the predicted next state of the vehicle.
22. The method for automatically taking over vehicle navigation according to claim 21, characterized in that: If the prediction of the vehicle's next state is inaccurate, the display mechanism that displays the vehicle's next navigation information will be corrected based on the vehicle's real-time position information, driving direction, and speed information, and the vehicle density, environmental information, and position information, driving direction, and speed information of other vehicles around the vehicle will be used as training samples and added to the sample library for further training and adjustment of the prediction model.
23. The method for automatically taking over vehicle navigation according to claim 20, characterized in that: Based on the vehicle's real-time location information, driving direction, and speed information, the driving direction and speed information of the following vehicle are determined, and the display mechanism, which is located at a certain distance and visual angle from the vehicle and within the visible range of the vehicle's driving direction, displays the vehicle's next navigation information; Alternatively, based on the planned navigation route corresponding to the vehicle and the vehicle's real-time location information, a data conversion system is used to perform data conversion, determine a display mechanism for the vehicle to display the next navigation information that needs to be displayed next, and control the display mechanism to display the next navigation information that needs to be displayed next; wherein the display mechanism for the vehicle to display the next navigation information that needs to be displayed next is a display mechanism that is maintained at a certain distance and a certain visual angle from the vehicle within the vehicle's visual range relative to the vehicle's real-time location information, driving direction, and speed information; Alternatively, based on the vehicle's navigation route and the vehicle's real-time position information, a computing system is used to perform calculations to obtain a display mechanism that matches the position of each vehicle where the next navigation information needs to be displayed next; and relative to the vehicle's real-time position information, driving direction, and driving speed, the display mechanism is maintained at a certain distance and a certain viewing angle from the vehicle to display the vehicle's next navigation information.
24. The method for automatically taking over vehicle navigation according to claim 23, characterized in that: The vehicle-mounted navigation device associated with the vehicle is connected to the data acquisition device, and the data acquisition device obtains the vehicle's destination information and / or the planned navigation route through the vehicle-mounted navigation device associated with the vehicle and uses it as perception data; The vehicle's current location information and driving direction are also used as perception data; all perception data are input into the data conversion system, and through data conversion, the next step of navigation information corresponding to the vehicle's current location information and driving direction is generated; Alternatively, the data collection device collects the driver's trip information as perception data; the vehicle's current location information and travel direction are also used as perception data; all of the perception data are input into a data conversion system, and through data conversion, next navigation information corresponding to the vehicle's current location information and travel direction is generated; wherein the trip information includes confirmed destination information or estimated destination information, and the confirmed destination information or estimated destination information corresponds to the final destination or the next of multiple consecutive destinations; Alternatively, the computing system obtains the vehicle's destination information and / or planned navigation route through an onboard navigation device associated with the vehicle, and obtains next navigation information corresponding to the vehicle's current location information and driving direction; Alternatively, the computing system obtains the destination information of the vehicle through an onboard navigation device associated with the vehicle, and calculates the next navigation information of the vehicle based on the position information and driving direction of the vehicle.
25. The method for automatically taking over vehicle navigation according to claim 24, characterized in that: The visual range is within the effective visual range and without any sight obstruction; When obtaining a display mechanism within the visual range, determine whether there is a display mechanism in front of the vehicle that is within the effective visual range corresponding to the vehicle and there is no obstacle between the vehicle and the display mechanism that blocks the line of sight. If so, determine that the display mechanism is within the visual range of the current vehicle.
26. The method for automatically taking over vehicle navigation according to claim 25, characterized in that: Performing three-dimensional modeling on real objects within the monitoring area covered by all cameras to construct a three-dimensional global model; the three-dimensional global model includes three-dimensional object models corresponding to real objects; the real objects include but are not limited to display mechanisms, vehicles, and obstacles; Based on the position information and driving direction of the vehicle in the monitoring area, the position, orientation, and visual point of the three-dimensional vehicle model corresponding to the real object vehicle in the three-dimensional global model are obtained accordingly; in real time, a three-dimensional display mechanism model is obtained in the three-dimensional global model, which satisfies the requirements of being within the visual range corresponding to the three-dimensional vehicle model and without any three-dimensional obstacle model that blocks the line of sight with the three-dimensional vehicle model; and the display mechanism of the real object corresponding to the three-dimensional display mechanism model is used to display the next navigation information corresponding to the current position information and driving direction of the vehicle.
27. The method for automatically taking over vehicle navigation according to claim 20, characterized in that: The heartbeat connection is used to monitor the working status of the vehicle-mounted navigation device based on the navigation software and / or hardware circuit, and then determine whether the navigation of the vehicle-mounted navigation device has failed. Specifically, the navigation software generates a software heartbeat signal, and the hardware circuit generates a hardware heartbeat signal. The software heartbeat signal and the hardware heartbeat signal are continuously monitored. When the software heartbeat signal or the hardware heartbeat signal is interrupted more than a preset number of times, it is determined that the navigation software or hardware circuit has failed, and then it is determined that the navigation has failed.
28. The method for automatically taking over vehicle navigation according to claim 27, characterized in that: When the satellite positioning signal is invalid, it will follow the movement of the vehicle and continuously display the real-time next navigation information through the display mechanism within the vehicle's visual range until the satellite positioning signal is restored.