A road perspective method and device based on image sharing
Through image sharing technology, road conditions images are collected and screened by on-board and road monitoring devices, the risk of traffic accidents caused by large vehicles blocking their sight is solved, and the drivers of the rear vehicle can achieve a longer-distance perspective of the road conditions ahead, improving driving safety.
Patent Information
- Application Number
- CN202011612338.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-30
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2040-12-30
AI Technical Summary
When large vehicles block out their sight, it is difficult for small vehicles to obtain information on road conditions ahead, resulting in an increase in the risk of traffic accidents.
Through the road perspective method and device based on image sharing, the vehicle-mounted monitoring device, mobile terminal and road monitoring device collects road conditions images, determines the area to be seen based on the perspective instructions input by the user, and filters and displays the images to be seen further, so as to help the driver behind the vehicle see the distance Distance of road conditions.
Effectively reduce and avoid traffic accidents, improve drivers' awareness of road conditions ahead, and enhance driving safety.
Smart Images

Figure CN114697608B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a road image sharing technology, and in particular to a road perspective method based on image sharing, and a road perspective device based on image sharing. Background Art
[0002] At present, the use of cars is becoming more and more widespread. Large vehicles such as large SUVs, buses, long-distance passenger vehicles, vans and container trucks are all common transportation vehicles in road traffic. Due to their large size, large vehicles have a serious impact on the observation of road conditions by vehicles behind them.
[0003] Especially for drivers of small vehicles, if a large vehicle blocks their view while driving, it is difficult for the driver of the car behind to know important road condition information such as whether there is an intersection ahead, whether there are pedestrians crossing the road, the real-time status of the traffic light ahead, whether there is congestion ahead, etc. At this time, if the vehicle behind rashly changes lanes, overtakes, or accelerates without knowing the road conditions ahead, it is very easy to cause a traffic accident.
[0004] In order to solve the above problems, this field is in urgent need of a road perspective technology. The road image sharing technology helps drivers extend their line of sight, so that the drivers of following vehicles can see the road conditions at a farther distance with the help of shared road images, thereby reducing and avoiding the occurrence of traffic accidents. Summary of the invention
[0005] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or decisive elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.
[0006] In order to solve the above problems, the present invention provides a road perspective method based on image sharing, a road perspective device based on image sharing, and a computer-readable storage medium, which can help drivers extend their line of sight based on road image sharing technology, so that drivers of following vehicles can see road conditions at a farther distance with the help of shared road images, thereby reducing and avoiding the occurrence of traffic accidents.
[0007] The above-mentioned road perspective method based on image sharing provided by the present invention includes: determining the area to be perspective according to the perspective instruction input by the user; obtaining the road condition image of the corresponding area according to the area to be perspective, wherein the road condition image includes the vehicle-mounted monitoring image taken by the vehicle-mounted monitoring device located in the corresponding area; filtering the acquired road condition image according to the perspective instruction; and displaying the filtered road condition image on the display of the vehicle to perform perspective on the area to be perspective.
[0008] Preferably, in some embodiments of the present invention, the step of filtering the road condition image may include: shooting the road condition image in front of the vehicle to identify the license plate information of the vehicle in front; and filtering the acquired on-board monitoring image according to the license plate information to obtain the on-board monitoring image taken by the vehicle in front.
[0009] Preferably, in some embodiments of the present invention, the step of screening the road condition image may further include: calculating the perspective distance of the on-board monitoring image taken by the vehicle in front based on the position information of the vehicle and the position information of the vehicle in front; in response to the perspective distance being less than the target perspective distance indicated by the perspective instruction, performing secondary recognition on the on-board monitoring image taken by the vehicle in front to obtain the license plate information of the vehicle in front; and performing secondary screening on the acquired on-board monitoring image based on the license plate information of the vehicle in front to screen and obtain the on-board monitoring image taken by the vehicle in front.
[0010] Optionally, in some embodiments of the present invention, the road condition image may also include a mobile terminal image taken by a user's mobile terminal located in the corresponding area, and / or a road monitoring image taken by a road monitoring device located in the corresponding area. The step of screening the road condition image may also include: determining the target position of the area to be viewed according to the position information of the vehicle and the target perspective distance indicated by the perspective instruction; and screening the acquired mobile terminal image and / or road monitoring image according to the target position to screen and obtain the road condition image of the target position.
[0011] Preferably, in some embodiments of the present invention, the step of screening the road condition images may further include: in response to the perspective instruction indicating an observation mode of road congestion, determining the target positions of the areas to be screened of multiple optional routes according to the position information, navigation information of the vehicle, and the target perspective distance indicated by the perspective instruction; and screening the road monitoring images according to each of the target positions to obtain the road monitoring images of each of the target positions.
[0012] Preferably, in some embodiments of the present invention, the step of displaying the road condition image may include: displaying the road monitoring image of each of the target positions on multiple displays of the vehicle, or on multiple areas of the same display.
[0013] Optionally, in some embodiments of the present invention, the step of acquiring the road condition image may include: determining a transmission channel for the road condition image according to a target perspective distance indicated by the perspective instruction; in response to the target perspective distance being less than or equal to a preset distance threshold, connecting all image capture devices within the target perspective distance range using a near-field communication module to acquire all road condition images within the target perspective distance range; and in response to the target perspective distance being greater than the distance threshold, acquiring all road condition images within the target perspective distance range from the cloud using a network communication module.
[0014] Preferably, in some embodiments of the present invention, the step of displaying the road condition image may include: in response to screening and obtaining a plurality of road condition images that comply with the perspective instruction, displaying the road condition image acquired through the near-field communication module on the display of the vehicle; and / or in response to screening and obtaining a plurality of road condition images that comply with the perspective instruction, displaying a road condition image with a higher resolution on the display of the vehicle.
[0015] Optionally, in some embodiments of the present invention, the road perspective method may further include: uploading the road condition image taken by the vehicle to the cloud in real time, so that the cloud can store the license plate information of the vehicle and the road condition image taken by the vehicle in association; and / or responding to an image request signal sent by the rear vehicle, using the near-field communication module of the vehicle to transmit the road condition image taken by the vehicle to the rear vehicle in real time.
[0016] Optionally, in some embodiments of the present invention, the road perspective method may be implemented by a vehicle-mounted system or a user mobile terminal.
[0017] According to another aspect of the present invention, this article also provides a road perspective device based on image sharing, which can help drivers extend their line of sight based on road image sharing technology, so that drivers of following vehicles can see road conditions at a farther distance with the help of shared road images, thereby reducing and avoiding the occurrence of traffic accidents.
[0018] The above-mentioned road perspective device based on image sharing provided by the present invention includes a memory and a processor. The processor is connected to the memory and is configured to: determine the area to be perspective according to the perspective instruction input by the user; obtain the road condition image of the corresponding area according to the area to be perspective, wherein the road condition image includes the vehicle monitoring image taken by the vehicle monitoring device located in the corresponding area; filter the obtained road condition image according to the perspective instruction; and display the filtered road condition image on the display of the vehicle to perform perspective on the area to be perspective.
[0019] Preferably, in some embodiments of the present invention, the processor can be further configured to: capture the road condition image in front of the vehicle to identify the license plate information of the vehicle in front; and filter the acquired vehicle-mounted monitoring image according to the license plate information to obtain the vehicle-mounted monitoring image captured by the vehicle in front.
[0020] Preferably, in some embodiments of the present invention, the processor can also be configured to: calculate the perspective distance of the vehicle-mounted monitoring image taken by the vehicle in front based on the position information of the vehicle and the position information of the vehicle in front; in response to the perspective distance being less than the target perspective distance indicated by the perspective instruction, perform secondary recognition on the vehicle-mounted monitoring image taken by the vehicle in front to obtain the license plate information of the vehicle in front; and perform secondary screening on the acquired vehicle-mounted monitoring image based on the license plate information of the vehicle in front to screen and obtain the vehicle-mounted monitoring image taken by the vehicle in front.
[0021] Optionally, in some embodiments of the present invention, the road condition image may also include a mobile terminal image taken by a user mobile terminal located in the corresponding area, and / or a road monitoring image taken by a road monitoring device located in the corresponding area. The processor may also be configured to: determine the target position of the area to be perspective according to the position information of the vehicle and the target perspective distance indicated by the perspective instruction; and filter the acquired mobile terminal image and / or road monitoring image according to the target position to filter and obtain the road condition image of the target position.
[0022] Preferably, in some embodiments of the present invention, the processor may also be configured to: in response to the perspective instruction indicating an observation mode of road congestion conditions, determine the target positions of the areas to be perspectived for multiple optional routes according to the position information, navigation information of the vehicle, and the target perspective distance indicated by the perspective instruction; and filter the road monitoring images according to each of the target positions to obtain the road monitoring images of each of the target positions.
[0023] Preferably, in some embodiments of the present invention, the processor may be further configured to: display the road monitoring images of each of the target locations on multiple displays of the vehicle, or on multiple areas of the same display.
[0024] Optionally, in some embodiments of the present invention, the processor can be further configured to: determine the transmission channel of the road condition image according to the target perspective distance indicated by the perspective instruction; in response to the target perspective distance being less than or equal to a preset distance threshold, use a near-field communication module to connect all image capture devices within the target perspective distance range to obtain all road condition images within the target perspective distance range; and in response to the target perspective distance being greater than the distance threshold, use a network communication module to obtain all road condition images within the target perspective distance range from the cloud.
[0025] Preferably, in some embodiments of the present invention, the processor can be further configured to: in response to screening and obtaining a plurality of road condition images that comply with the perspective instruction, display the road condition image acquired through the near-field communication module on the display of the vehicle; and / or in response to screening and obtaining a plurality of road condition images that comply with the perspective instruction, display a road condition image with a higher resolution on the display of the vehicle.
[0026] Optionally, in some embodiments of the present invention, the processor can also be configured to: upload the road condition image taken by the vehicle to the cloud in real time, so that the cloud can store the license plate information of the vehicle and the road condition image taken by the vehicle in association; and / or respond to the image request signal sent by the rear vehicle, use the near-field communication module of the vehicle to transmit the road condition image taken by the vehicle to the rear vehicle in real time.
[0027] Optionally, in some embodiments of the present invention, the road perspective device may include a vehicle-mounted system or a user mobile terminal.
[0028] According to another aspect of the present invention, a computer-readable storage medium is also provided herein.
[0029] The computer-readable storage medium provided by the present invention stores computer instructions thereon. When the computer instructions are executed by a processor, the road perspective method described in any of the above embodiments can be implemented, which can help drivers extend their sight based on the road image sharing technology, so that the drivers of the following vehicles can see the road conditions at a longer distance with the help of the shared road image, thereby reducing and avoiding the occurrence of traffic accidents. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.
[0031] Figure 1 A schematic diagram of the architecture of a road perspective system provided according to some embodiments of the present invention is shown.
[0032] Figure 2 A schematic diagram of the architecture of a road perspective device based on image sharing provided according to some embodiments of the present invention is shown.
[0033] Figure 3 A schematic flow chart of a road perspective method based on image sharing provided according to some embodiments of the present invention is shown.
[0034] Figure 4 A schematic diagram showing the working principle of a screening module provided according to some embodiments of the present invention is shown. DETAILED DESCRIPTION
[0035] The following specific embodiments illustrate the implementation of the present invention, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to this implementation. On the contrary, the purpose of introducing the invention in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, the following description will include many specific details. The present invention can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present invention, some specific details will be omitted in the description.
[0036] As mentioned above, if a large vehicle blocks the view while driving, it is difficult for the driver of the car behind to know important road condition information such as whether there is an intersection ahead, whether there are pedestrians crossing the road, the real-time status of the traffic light ahead, whether there is congestion ahead, etc. At this time, if the vehicle behind rashly changes lanes, overtakes, or accelerates without knowing the road conditions ahead, it is very easy to cause a traffic accident.
[0037] In order to solve the above problems, the present invention provides a road perspective method based on image sharing, a road perspective device based on image sharing, and a computer-readable storage medium, which can help drivers extend their line of sight based on road image sharing technology, so that drivers of following vehicles can see road conditions at a farther distance with the help of shared road images, thereby reducing and avoiding the occurrence of traffic accidents.
[0038] Please refer to Figure 1 , Figure 1 A schematic diagram of the architecture of a road perspective system provided according to some embodiments of the present invention is shown.
[0039] like Figure 1As shown, in some embodiments of the present invention, the road perspective system based on image sharing can be implemented based on the Internet of Vehicles technology, including the vehicle-mounted systems of multiple vehicles 11-13, the user mobile terminals 21-22 of multiple users, the road monitoring device 30 set on the road, and the cloud server 40 configured in the cloud. The vehicle-mounted monitoring device of the front vehicle 12-13 and the user mobile terminal 22 can collect the road condition image in front of the vehicle in real time as a sharing end of the road condition image. The road monitoring device 30 set in each area of the road can collect the road condition image of the area in real time as a sharing end of the road condition image. The cloud server 40 is configured in the cloud of the Internet of Vehicles, which can serve as a transfer end of the road condition image and provide the road condition image uploaded by the sharing end to the receiving end in need. The driver of the rear vehicle 11 can use the vehicle-mounted system of the vehicle or the user mobile terminal 21 as the receiving end of the road condition image, and achieve the effect of road perspective by acquiring and displaying the road condition image in front.
[0040] The following will describe the above-mentioned road perspective method based on image sharing in conjunction with some embodiments in which the vehicle-mounted system of the rear vehicle 11 is used as a road perspective device. Figure 2 and Figure 3 , Figure 2 A schematic diagram of the architecture of a road perspective device based on image sharing provided according to some embodiments of the present invention is shown. Figure 3 A schematic flow chart of a road perspective method based on image sharing provided according to some embodiments of the present invention is shown.
[0041] like Figure 2 As shown, the above-mentioned road perspective device based on image sharing provided by the present invention may include a memory 111 and a processor 112. The memory 111 may include a computer-readable storage medium on which computer instructions are stored. The processor 112 is connected to the memory 111 and is suitable for executing the computer instructions stored on the memory 111 to implement a road perspective method based on image sharing. The road image sharing technology helps the driver extend his line of sight, so that the driver of the rear vehicle 11 can see the road conditions at a longer distance with the help of the shared road image, thereby reducing and avoiding the occurrence of traffic accidents.
[0042] like Figure 3 As shown, the road perspective method based on image sharing provided by the present invention may include step 301: determining the area to be perspective according to the perspective instruction input by the user.
[0043] In some embodiments of the present invention, the road perspective function can be activated in response to the user's operation of the vehicle system. Specifically, during the driving of the vehicle, the user can open the road perspective application by operating the central control system. The interface of the road perspective program may include a button for vehicle perspective mode. The user can click the vehicle perspective mode button to activate the vehicle perspective mode, so as to observe the traffic conditions such as the status of traffic lights, traffic flow, and pedestrian flow in the area blocked by the large vehicle 12 in front, so as to decide whether to change lanes, overtake, or accelerate.
[0044] In response to the user's selection of the vehicle perspective mode, the processor 112 may further require the user to input the number of vehicles to be perspective or the target perspective distance. Afterwards, the processor 112 may determine the area to be perspective based on the perspective instruction input by the user. In some embodiments, if the perspective instruction input by the user indicates the number of vehicles to be perspective, the processor 112 may use the vehicle network communication module to send the position information and the quantity information of the vehicle 11 to the cloud server 40, thereby determining the area to be perspective surrounded by the corresponding number of nearby vehicles through the cloud server 40, and determining all image capture devices in the area to be perspective. The vehicle network communication module here is preferably a 5G network communication module, which is used to improve the real-time performance of live broadcast of road conditions. The image capture device here includes but is not limited to the vehicle-mounted monitoring device of the front vehicles 12 to 13, the user mobile terminal 22 and the road monitoring device 30. The vehicle-mounted monitoring device may be a digital video recorder (DVR).
[0045] In other embodiments, if the perspective instruction input by the user indicates the target perspective distance, the processor 112 may first perform a threshold judgment on the target perspective distance input by the user to determine the method for determining the area to be perspective. Specifically, the distance threshold may be determined based on the maximum communication distance (e.g., 5 to 50 meters) of a near-field communication module such as a vehicle-mounted Bluetooth module. If the target perspective distance input by the user is less than or equal to the maximum communication distance of the vehicle-mounted Bluetooth module, the processor 112 may directly adjust the scanning distance of the vehicle-mounted Bluetooth module to the corresponding distance to determine the area to be perspective. Conversely, if the target perspective distance input by the user is greater than the maximum communication distance of the vehicle-mounted Bluetooth module, the processor 112 may use the vehicle-mounted network communication module to send the location information of the vehicle 11 and the target perspective distance to the cloud server 40, thereby determining the target perspective distance range as the area to be perspective through the cloud server 40, and determining all image capture devices within the area to be perspective.
[0046] like Figure 3 As shown, the road perspective method based on image sharing provided by the present invention may further include step 302: acquiring a road condition image of a corresponding area according to the area to be perspectived.
[0047] After determining the area to be viewed and all the image capturing devices therein, the processor 112 can determine the transmission channel of the road condition image according to the perspective instruction input by the user. In some embodiments, the processor 112 can perform a threshold judgment on the target perspective distance input by the user to determine the transmission channel of the road condition image. The distance threshold can be determined according to the maximum communication distance of the vehicle-mounted Bluetooth module. If the target perspective distance input by the user is less than or equal to the maximum communication distance of the vehicle-mounted Bluetooth module, the processor 112 can use a near-field communication module such as a vehicle-mounted Bluetooth module to search and connect all image capturing devices within the target perspective distance range to obtain all road condition images within the target perspective distance range. On the contrary, if the target perspective distance input by the user is greater than the maximum communication distance of the vehicle-mounted Bluetooth module, the processor 112 can use the vehicle-mounted network communication module to send the location information of the vehicle 11 and the target perspective distance to the cloud server 40, thereby obtaining all road condition images within the target perspective distance range from the cloud server 40.
[0048] Those skilled in the art will appreciate that the above-mentioned scheme of acquiring all road condition images within a long distance from the cloud server 40 is only a non-limiting implementation mode provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide some specific schemes that are convenient for the public to implement, rather than to limit the protection scope of the present invention. Optionally, in other embodiments, if the target perspective distance input by the user is greater than the maximum communication distance of the vehicle-mounted Bluetooth module, the processor 112 may first use the vehicle-mounted Bluetooth module to acquire all road condition images within its maximum communication distance range, and then use the vehicle-mounted network communication module to acquire all road condition images outside the maximum communication distance range of the vehicle-mounted Bluetooth module from the cloud server 40, so as to also obtain all road condition images within the target perspective distance range.
[0049] like Figure 3 As shown, the road perspective method based on image sharing provided by the present invention may further include step 303: filtering the acquired road condition images according to the perspective instruction.
[0050] As described above, the road condition images acquired by the vehicle system may include vehicle monitoring images, mobile terminal images, and road monitoring images acquired through network transmission channels and Bluetooth transmission channels. The processor 112 needs to filter these road condition images from various sources to determine the appropriate road condition images for display. In some embodiments of the present invention, the filtering of road condition images can be implemented with the help of a filtering module.
[0051] Please refer to Figure 4 , Figure 4 A schematic diagram showing the working principle of a screening module provided according to some embodiments of the present invention is shown.
[0052] like Figure 4 As shown, the above-mentioned screening module 113 can be a software module or a hardware module configured in the vehicle system. In the above-mentioned vehicle perspective mode, the processor 112 can control the vehicle-mounted monitoring device of the vehicle 11 to capture the road condition image in front of the vehicle 11 in real time. The screening module 113 can obtain the road condition image in front of the vehicle 11 in real time, and perform image recognition on the obtained road condition image to determine the license plate information of the vehicle 12 in front. Afterwards, the screening module 113 can filter the obtained vehicle-mounted monitoring image according to the recognized license plate information to filter and obtain the vehicle-mounted monitoring image captured by the vehicle 12 in front.
[0053] Optionally, in some embodiments, if the front vehicle 12 is not equipped with an on-board monitoring device or does not provide an on-board monitoring image, the screening module 113 can screen the acquired mobile terminal image according to the recognized license plate information to screen and obtain the mobile terminal image shot by the user mobile terminal 22 bound to the front vehicle 12. The mobile terminal image can be a shared image directly uploaded by the user mobile terminal 22 to the cloud server 40, or a live broadcast image obtained by the cloud server 40 from other network live broadcast platforms through an open network interface.
[0054] Optionally, in some embodiments, if the front vehicle 12 is not equipped with an onboard monitoring device or does not provide an onboard monitoring image, the processor 112 may also send the license plate information identified by the screening module 113 to the cloud server 40, so that the cloud server 40 determines the position of the front vehicle 12 and feeds back the identity information of the road monitoring device 30 at the corresponding position. The screening module 113 may screen the acquired road monitoring image according to the acquired identity information to screen and obtain the road monitoring image taken by the road monitoring device 30 at the corresponding position.
[0055] In some preferred embodiments, the processor 112 may also calculate the actual perspective distance of the vehicle-mounted monitoring image taken by the vehicle ahead according to the position information of the vehicle 11 and the position information of the vehicle ahead. If the perspective distance is less than the target perspective distance indicated by the perspective instruction input by the user, the processor 112 may control the screening module 113 to perform secondary recognition on the vehicle-mounted monitoring image taken by the vehicle ahead to obtain the license plate information of the vehicle ahead 13. Afterwards, the screening module 113 may perform secondary screening on the acquired vehicle-mounted monitoring image according to the license plate information of the vehicle ahead 13 to screen and obtain the vehicle-mounted monitoring image taken by the vehicle ahead 13.
[0056] It is understandable that, compared with the above mobile terminal images and the above road monitoring images, the vehicle monitoring images taken by the vehicle monitoring device are more in line with the driver's first-person perspective, and can give the driver of the rear vehicle 11 a visual experience of seeing through the front vehicle 12. Therefore, the vehicle monitoring image is more suitable as the preferred road condition image of the above vehicle perspective mode, which is conducive to improving the user experience.
[0057] like Figure 3 As shown, the road perspective method based on image sharing provided by the present invention may further include step 304: displaying the screened road condition image on the display of the vehicle 11 to perform perspective on the area to be perspectived.
[0058] After screening and obtaining the road condition image of the area to be viewed, the processor 112 can send the screened road condition image to the display 114 of the vehicle 11 to display the road condition image. The display 114 includes but is not limited to the central control display screen, the smart rearview mirror, and the user mobile terminal 21 such as a smart phone and a tablet computer bound to the vehicle 11. By displaying the road condition image taken by the front truck 12 on the display 114 of the vehicle 11, the driver of the rear vehicle 11 can clearly observe the road condition image in front of the front truck 12 as if he has viewed the front truck 12, thereby effectively reducing and avoiding the occurrence of traffic accidents.
[0059] In some embodiments, if the screening module 113 obtains multiple road condition images that meet the target perspective distance, the processor 112 can give priority to displaying the road condition images obtained through the near field communication module such as the vehicle-mounted Bluetooth module to the display 114 of the vehicle 11 to improve the real-time performance of the road perspective. In some embodiments, if the screening module 113 obtains multiple road condition images that meet the target perspective distance, the processor 112 can also give priority to displaying the road condition images with higher resolution to the display of the vehicle 11 to improve the clarity of the road perspective.
[0060] Those skilled in the art will appreciate that the above-mentioned vehicle perspective mode is only a non-limiting perspective mode provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit the scope of protection of the present invention.
[0061] Optionally, in other embodiments, the interface of the road perspective program may further include a road congestion observation mode button. The user may click the vehicle perspective mode button in the navigation state to start the road condition observation mode, so as to observe the congestion condition of the road ahead.
[0062] Specifically, in response to the user's selection of the road condition observation mode, the processor 112 may further require the user to input a target perspective distance. The target perspective distance in the road condition observation mode may generally be 1 to 10 kilometers. Afterwards, the processor 112 may determine the position of the vehicle 11 after the target perspective distance along the navigation route as the target position of the area to be perspective based on the position information, navigation information, and target perspective distance input by the user of the vehicle 11. Thereafter, the processor 112 may use the vehicle network communication module to send the target position of the area to be perspective to the cloud server 40 to obtain the identity identification information of the road monitoring device 30 at the corresponding position from the cloud server 40. The screening module 113 may screen the acquired road monitoring images based on the acquired identity identification information to screen and obtain the road monitoring images taken by the road monitoring device 30 at the corresponding position.
[0063] Compared with the above-mentioned vehicle-mounted monitoring images and the above-mentioned mobile terminal images, the road monitoring images taken by the road monitoring device 30 have a higher, wider and more stable observation angle, which is more conducive to the driver's overall observation of the entire road section, so as to provide the driver with a reference for whether to change the navigation route. Especially in today's "Sky Eye" era, the road monitoring device 30 is spread across every corner of the city road, and can provide the driver with road condition images of any area without blind spots, so that the driver can clearly observe the road congestion conditions in any area on the navigation route.
[0064] In some preferred embodiments, for the scenario where the navigation program provides multiple optional routes, the processor 112 can also determine the position of the vehicle 11 after traveling the target perspective distance along each optional route as the target position of multiple areas to be perspective based on the position information of the vehicle 11, the navigation information of the multiple navigation routes, and the target perspective distance input by the user. Afterwards, the processor 112 can use the vehicle network communication module to send the target positions of the multiple areas to be perspective to the cloud server 40 to obtain the identity recognition information of the road monitoring device 30 at each corresponding position from the cloud server 40. The screening module 113 can screen the acquired road monitoring images according to the acquired identity recognition information to screen and obtain the road monitoring images taken by the road monitoring device 30 at each corresponding position.
[0065] After screening and obtaining the road monitoring images of each corresponding position, the processor 112 can display the road monitoring images of each target position on multiple displays of the vehicle 11 for split-screen display, or display the road monitoring images of each target position on multiple areas of the same display for partitioned display, so that the driver can simultaneously observe the road congestion conditions of each optional route to select a smoother navigation route.
[0066] Those skilled in the art will appreciate that the above-mentioned scheme of using the vehicle-mounted system of the vehicle 11 as a road perspective device is only some non-limiting implementation methods provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit the protection scope of the present invention. Optionally, in other embodiments, the driver of the rear vehicle 11 can also use a user mobile terminal 21 such as a smart phone or a tablet computer as a road perspective device to achieve the same road perspective effect.
[0067] As described above, the road perspective method and road perspective device provided by the present invention need to be implemented based on the sharing of road condition images. Therefore, in some embodiments of the present invention, the processor 112 can also upload the vehicle-mounted monitoring image captured by the vehicle-mounted monitoring device of the vehicle 11, and / or the mobile terminal image captured by the user mobile terminal 21 bound to the vehicle 11 to the cloud server 40 in real time. The cloud server 40 can store the license plate information of the vehicle 11 and the road condition image captured by the vehicle 11 in association, so that the rear vehicle (not shown) can obtain the road condition image captured by the vehicle 11 to perform road perspective on the vehicle 11.
[0068] Optionally, in other embodiments, in response to an image request signal sent by a rear vehicle (not shown) to the vehicle 11 via a near-field communication module such as an on-board Bluetooth module, the processor 112 may also utilize the near-field communication module corresponding to the vehicle 11 to directly transmit the road condition image taken by the vehicle 11 to the rear vehicle (not shown) in real time, so that the rear vehicle (not shown) can directly obtain the road condition image taken by the vehicle 11 to perform road perspective on the vehicle 11.
[0069] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.
[0070] Those skilled in the art will appreciate that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips cited throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof.
[0071] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of the two. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps are generally described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. The technician may implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present invention.
[0072] Although the processor 112 described in the above embodiment can be implemented by a combination of software and hardware. However, it is understood that the processor 112 can also be implemented in software or hardware alone. For hardware implementation, the processor 112 can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic devices for performing the above functions, or a selection combination of the above devices. For software implementation, the processor 112 can be implemented by independent software modules such as procedures and function modules running on a general-purpose chip, each of which can perform one or more functions and operations described herein.
[0073] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in cooperation with a DSP core, or any other such configuration.
[0074] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A road perspective method based on image sharing, characterized in that: include: Determine the area to be perspective according to the perspective instruction; Acquire a road condition image of a corresponding area according to the area to be viewed through, wherein the road condition image includes a vehicle monitoring image taken by a vehicle monitoring device located in the corresponding area; Filtering the acquired road condition image according to the perspective instruction; as well as Displaying the screened road condition image on the display of the vehicle to perform perspective viewing of the area to be perspective viewed; The step of screening the road condition image comprises: Capture the road conditions in front of the vehicle to identify the license plate information of the vehicle ahead; and The acquired vehicle-mounted monitoring image is screened according to the license plate information to obtain the vehicle-mounted monitoring image taken by the vehicle in front; The step of screening the road condition image also includes: Calculate the perspective distance of the vehicle monitoring image taken by the vehicle in front according to the position information of the vehicle and the position information of the vehicle in front; In response to the perspective distance being less than the target perspective distance indicated by the perspective instruction, performing secondary recognition on the vehicle-mounted monitoring image taken by the vehicle in front to obtain the license plate information of the vehicle in front; and The acquired vehicle-mounted monitoring image is screened for the second time according to the license plate information of the vehicle ahead, so as to screen and obtain the vehicle-mounted monitoring image shot by the vehicle ahead.
2. The road perspective method according to claim 1, wherein: The road condition image also includes a mobile terminal image taken by a user mobile terminal located in the corresponding area, and / or a road monitoring image taken by a road monitoring device located in the corresponding area, and the step of screening the road condition image also includes: Determining the target position of the area to be viewed according to the position information of the vehicle and the target viewing distance indicated by the viewing instruction; and The acquired mobile terminal image and / or road monitoring image is screened according to the target location to obtain the road condition image of the target location.
3. The road perspective method according to claim 2, wherein: The step of screening the road condition image also includes: In response to the perspective instruction indicating an observation mode of a road congestion condition, determining target positions of areas to be perspective-viewed of a plurality of optional routes according to the position information and navigation information of the vehicle and the target perspective distance indicated by the perspective instruction; and The road monitoring images are screened according to the target locations to obtain the road monitoring images of the target locations.
4. The road perspective method according to claim 3, wherein: The step of displaying the road condition image comprises: The road monitoring images of each target position are displayed on multiple displays of the vehicle, or on multiple areas of the same display.
5. The road perspective method according to claim 1, wherein: The steps of acquiring the road condition image include: Determining a transmission channel for the road condition image according to a target perspective distance indicated by the perspective instruction; In response to the target perspective distance being less than or equal to a preset distance threshold, connecting all image capturing devices within the target perspective distance range using a near field communication module to acquire all road condition images within the target perspective distance range; and In response to the target perspective distance being greater than the distance threshold, all road condition images within the target perspective distance range are acquired from the cloud using a network communication module.
6. The road perspective method according to claim 5, wherein: The step of displaying the road condition image comprises: In response to screening and obtaining a plurality of road condition images that meet the perspective instruction, displaying the road condition images acquired by the near field communication module on a display of the vehicle; and / or In response to screening and obtaining a plurality of road condition images that meet the perspective instruction, a road condition image with a higher resolution is displayed on a display of the vehicle.
7. The road perspective method according to claim 5, further comprising: Uploading the road condition image taken by the vehicle to the cloud in real time, so that the cloud can store the license plate information of the vehicle and the road condition image taken by the vehicle in association; and / or In response to an image request signal sent by a rear vehicle, the road condition image taken by the vehicle is transmitted in real time to the rear vehicle using the near field communication module of the vehicle.
8. The road perspective method according to claim 1, wherein: The road perspective method is implemented by a vehicle-mounted system or a user mobile terminal.
9. A road perspective device based on image sharing, characterized in that: include: Memory; as well as A processor, the processor is connected to the memory and configured to: Determine the area to be perspective according to the perspective instruction; Acquire a road condition image of a corresponding area according to the area to be viewed through, wherein the road condition image includes a vehicle monitoring image taken by a vehicle monitoring device located in the corresponding area; Filtering the acquired road condition image according to the perspective instruction; as well as Displaying the screened road condition image on the display of the vehicle to perform perspective viewing of the area to be perspective viewed; The processor is further configured to: Capture the road conditions in front of the vehicle to identify the license plate information of the vehicle ahead; and The acquired vehicle-mounted monitoring image is screened according to the license plate information to obtain the vehicle-mounted monitoring image taken by the vehicle in front; The processor is further configured to: Calculate the perspective distance of the vehicle monitoring image taken by the vehicle in front according to the position information of the vehicle and the position information of the vehicle in front; In response to the perspective distance being less than the target perspective distance indicated by the perspective instruction, performing secondary recognition on the vehicle-mounted monitoring image taken by the vehicle in front to obtain the license plate information of the vehicle in front; as well as The acquired vehicle-mounted monitoring image is screened for the second time according to the license plate information of the vehicle ahead, so as to screen and obtain the vehicle-mounted monitoring image shot by the vehicle ahead.
10. The road perspective device according to claim 9, wherein: The road condition image also includes a mobile terminal image taken by a user mobile terminal located in the corresponding area, and / or a road monitoring image taken by a road monitoring device located in the corresponding area, and the processor is further configured to: Determining the target position of the area to be viewed according to the position information of the vehicle and the target viewing distance indicated by the viewing instruction; and The acquired mobile terminal image and / or road monitoring image is screened according to the target location to obtain the road condition image of the target location.
11. The road perspective device according to claim 10, wherein: The processor is further configured to: In response to the perspective instruction indicating an observation mode of a road congestion condition, determining target positions of areas to be perspective-viewed of a plurality of optional routes according to the position information and navigation information of the vehicle and the target perspective distance indicated by the perspective instruction; as well as The road monitoring images are screened according to the target locations to obtain the road monitoring images of the target locations.
12. The road perspective device according to claim 11, wherein: The processor is further configured to: The road monitoring images of each target position are displayed on multiple displays of the vehicle, or on multiple areas of the same display.
13. The road perspective device according to claim 9, wherein: The processor is further configured to: Determining a transmission channel for the road condition image according to a target perspective distance indicated by the perspective instruction; In response to the target perspective distance being less than or equal to a preset distance threshold, connecting all image capturing devices within the target perspective distance range using a near field communication module to acquire all road condition images within the target perspective distance range; and In response to the target perspective distance being greater than the distance threshold, all road condition images within the target perspective distance range are acquired from the cloud using a network communication module.
14. The road perspective device according to claim 13, wherein: The processor is further configured to: In response to screening and obtaining a plurality of road condition images that meet the perspective instruction, displaying the road condition images acquired by the near field communication module on a display of the vehicle; and / or In response to screening and obtaining a plurality of road condition images that meet the perspective instruction, a road condition image with a higher resolution is displayed on a display of the vehicle.
15. The road perspective device according to claim 13, wherein: The processor is further configured to: Uploading the road condition image taken by the vehicle to the cloud in real time, so that the cloud can store the license plate information of the vehicle and the road condition image taken by the vehicle in association; and / or In response to an image request signal sent by a rear vehicle, the road condition image taken by the vehicle is transmitted in real time to the rear vehicle using the near field communication module of the vehicle.
16. The road perspective device according to claim 9, wherein: The road perspective device includes a vehicle-mounted system or a user mobile terminal.
17. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed by a processor, the road perspective method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Vehicle-mounted real-time image sharing system, method, equipment and storage medium
CN107798860A
Method for displaying road condition in road navigation based on images, device and storage medium
CN108088458A