System for data communication using vehicle camera, method for the system and vehicle
By installing camera sensors and processors in vehicles and utilizing V2X communication technology, vehicles can efficiently and securely transmit and process vehicle identification information, solving the problems of low efficiency and insufficient security in existing technologies, improving the reliability and security of data communication, and supporting vehicle driving assistance and traffic management.
Patent Information
- Application Number
- CN202211353031.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-11-01
- Filing Date
- 2022-10-31
- Publication Date
- 2026-02-13
- Estimated Expiration
- 2042-10-31
AI Technical Summary
Existing V2X communication technology suffers from low efficiency and insufficient security in the transmission and reception of vehicle identification information, making it difficult to transmit and process vehicle identification information efficiently and securely.
By installing camera sensors, processors, and communication units in vehicles, and utilizing V2X communication technology, vehicles can extract vehicle identification information from images and achieve efficient and secure data exchange with traffic control systems through redundant data processing and secure unlocking mechanisms.
It enables efficient and secure transmission of vehicle identification information, improves data reliability and communication security, and supports vehicle driving assistance and traffic management.
Smart Images

Figure CN116071918B_ABST
Abstract
Description
[0001] Cross-references to related applications
[0002] This application claims the benefit and priority of Korean Application No. 10-2021-0147686, filed on November 1, 2021, the contents of which are incorporated herein by reference in their entirety. Technical Field
[0003] This disclosure relates to a data communication system for vehicles applicable to all fields, and more specifically, to a system for collecting data related to images captured by vehicle cameras and performing transmission and reception via vehicle-to-anything (V2X) communication. Background Technology
[0004] V2X communication is a technology that sends and receives data via a vehicle-centric wired or wireless network and is used to refer to communication between a vehicle and all other objects, including vehicle-to-vehicle (V2V) communication and vehicle-to-infrastructure (V2I) communication.
[0005] Vehicle-to-vehicle (V2V) communication refers to information communication between vehicles, allowing them to share information such as location and speed. Therefore, vehicles can use this information to assist drivers and for various purposes (e.g., preventing traffic accidents). For example, when V2V communication devices are linked to a vehicle's braking system and control system, the vehicle can automatically brake or provide warnings to the driver in emergency situations.
[0006] Vehicle-to-infrastructure (V2I) communication is a vehicle communication technology that enables communication between vehicles and roadside infrastructure. Vehicles can receive traffic information or safety support services from the infrastructure. In addition, vehicles can send and receive various driving environment information from the outside world through vehicle-centric communication such as vehicle-to-mobile (V2P) communication and vehicle-to-network (V2N) communication, and use this information to increase driving convenience and reduce accident risk.
[0007] In other words, through V2X communication, vehicles can send and receive information about various traffic conditions (such as fog, slopes, and traffic accidents) that are difficult to detect using built-in sensors. This information can not only be used to improve the vehicle's own mobility but also to effectively manage road traffic networks and for various other purposes.
[0008] For example, disclosed Korean Patent No. 10-2014-0030691 ("Automatic Black Box Image Transmission Device and Method Using V2X Communication") discloses a technology of protecting image data by transmitting an image of a black box to a neighboring base station in case of a risk of a vehicle accident. Even if the black box image is damaged by a traffic accident, image data is transmitted to an external storage device before the accident occurs to preserve image information about the situation of the traffic accident. Accordingly, using this technology, it is possible to analyze the cause of the traffic accident and the problem of accident liability.
[0009] In addition to the above, the V2X-based communication technology of a vehicle has various applicable fields, and there is a need for technical improvement to use it for new purposes and uses. SUMMARY
[0010] Therefore, embodiments of the present disclosure relate to a data communication system that substantially obviates one or more problems due to limitations and disadvantages of the related art.
[0011] An object of the present disclosure is to provide a system that transmits and receives vehicle identification information of an image obtained from a vehicle camera based on V2X.
[0012] Another object of the present disclosure is to provide a system that efficiently transmits and receives vehicle identification information through redundant data processing.
[0013] Still another object of the present disclosure is to provide a system that improves data reliability and communication security by securely transmitting / receiving vehicle identification information.
[0014] The technical tasks obtainable from the present disclosure are not limited to what has been described above based on the technical tasks of the related art. And, those of ordinary skill in the art of the technical field to which the present disclosure belongs can understand that other technical tasks can be implemented from the description below.
[0015] Additional advantages, objects, and features of the disclosure will be set forth in part by the description of the disclosure and in part apparent to those skilled in the art. Those aspects can also be understood by those skilled in the art from the disclosure herein.
[0016] To achieve these objects and other advantages, according to one technical aspect of the present disclosure, a system for data communication includes a vehicle having a camera sensor, and a server that transmits and receives data to and from the vehicle. The vehicle includes a processor that extracts vehicle identification information from an image captured by the camera sensor. The vehicle transmits the vehicle identification information to the server.
[0017] Preferably, the vehicle further includes a communication unit for transmitting and receiving data to and from the server, and the communication unit communicates with the server based on V2X.
[0018] Preferably, the vehicle further includes a storage device for storing vehicle identification information, the camera sensor includes a front camera sensor that captures a view in a front direction of the vehicle and a side camera sensor that captures a view in a side direction of the vehicle, and the camera sensor can adjust a viewing angle.
[0019] According to another technical aspect of the disclosure, a method for data communication includes obtaining vehicle identification information from an image captured by a camera sensor of a vehicle, unlocking security of a server to communicate with the server based on V2X through a communication unit of the vehicle, and transmitting the vehicle identification information from the communication unit to the server.
[0020] Preferably, unlocking the security includes requesting seed information from the communication unit to the server, and transmitting a key value from the communication unit to the server.
[0021] According to still another technical aspect of the disclosure, a method for data communication using a data communication system includes receiving, by a vehicle, vehicle identification information of a specific vehicle from a server, checking, by the vehicle, whether the vehicle identification information of the specific vehicle is stored in a storage device, and in response to a result of the checking in the checking step, transmitting, by the vehicle, the vehicle identification information of the specific vehicle and information related to the vehicle identification information to the server.
[0022] According to still another technical aspect of the disclosure, a method for data communication using a data communication system includes obtaining vehicle identification information from an image captured by a camera sensor of a vehicle, unlocking security of a server to communicate with the server based on V2X through a communication unit of the vehicle, and transmitting the vehicle identification information from the communication unit to the server. The obtaining of the vehicle identification information includes adjusting a viewing angle of the camera sensor in consideration of whether different vehicles are traveling in a side direction of the vehicle.
[0023] Accordingly, the disclosure provides various effects and / or advantages.
[0024] According to embodiments of the disclosure, a system for transmitting and receiving vehicle identification information obtained from an image acquired by a camera of a vehicle based on V2X can be provided.
[0025] According to embodiments of the disclosure, a system capable of safely and efficiently transmitting and receiving vehicle identification information can be provided.
[0026] According to embodiments of the disclosure, various direct and indirect effects such as tracking of a specific vehicle or the like and driving assistance using vehicle identification information can be obtained via vehicle identification information collection.
[0027] Effects obtainable from the present disclosure can not be limited to the above-mentioned effects. And, other unmentioned effects can be clearly understood from the following description by one of ordinary skill in the art to which the present disclosure pertains. It should be understood that the foregoing General Overview and the following Detailed Description of the Disclosure are exemplary and explanatory only and are intended to provide further explanation to the disclosure as claimed. BRIEF DESCRIPTION OF DRAWINGS
[0028] The accompanying drawings, which are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this application, illustrate embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. The above and other aspects, features, and advantages of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
[0029] Figure 1 is a general block diagram of a vehicle system configured to communicate data according to one of the embodiments of the present disclosure;
[0030] Figure 2 shows a vehicle to which a data communication system according to one of the embodiments of the present disclosure is applicable;
[0031] Figure 3 shows a data communication system according to one of the embodiments of the present disclosure;
[0032] Figure 4 is a block diagram of a vehicle system to which a data communication system according to one of the embodiments of the present disclosure is applicable;
[0033] Figure 5 is a flowchart showing a process for transmitting vehicle identification information in a data communication system according to one of the embodiments of the present disclosure;
[0034] Figure 6 is a flowchart showing a process for receiving vehicle identification information in a data communication system according to one of the embodiments of the present disclosure;
[0035] Figure 7 is a flowchart showing a process for transmitting and receiving vehicle identification information in a data communication system according to one of the embodiments of the present disclosure;
[0036] Figure 8 is a flowchart showing a process for transmitting and receiving vehicle identification information in a data communication system according to one of the embodiments of the present disclosure; and
[0037] Figure 9 is a flowchart showing a process for obtaining vehicle identification information in a data communication system according to one of the embodiments of the present disclosure. DETAILED DESCRIPTION
[0038] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily implement the present disclosure. However, the present disclosure can be implemented in various different forms, and is not limited to the embodiments described herein. Also, in order to describe the present disclosure clearly in the drawings, portions unrelated to the description are omitted, and like reference numerals are assigned to like portions throughout the specification.
[0039] Throughout the specification, when a component "includes" a certain component, it means that it can further include other components, rather than excluding other components, unless otherwise specified.
[0040] Figure 1 is a general block diagram of a vehicle system configured to communicate data according to one of the embodiments of the present disclosure. Figure 2 A vehicle to which a data communication system according to one of the embodiments of the present disclosure is applied is illustrated.
[0041] First, the structure and functions of a vehicle to which the system according to the present embodiment is applied will be described with reference to Figure 1 and Figure 2
[0042] As illustrated in Figure 1 , the vehicle 1000 can be implemented with the driving integrated control unit 600 at the center, which transmits and receives data required for driving control of the vehicle through the operation information input interface 101, the driving information input interface 201, and the passenger output interface 301. However, the driving integrated control unit 600 can be referred to as a controller or a processor, or can be simply referred to as a control unit in the present specification.
[0043] The driving integrated control unit 600 can obtain operation information according to the manipulation of the user input unit 100 by the passenger in the autonomous driving mode or the manual driving mode of the vehicle through the operation information input interface 101. As illustrated in Figure 1 , the user input unit 100 can include a driving mode switch 110 and a control panel 120 (for example, a navigation terminal installed on the vehicle, a smart phone or a tablet PC owned by the passenger, etc.), and thus the operation information can include driving mode information and navigation information of the vehicle.
[0044] For example, the driving mode (i.e., autonomous / manual driving mode or sport / economy / safety / normal mode) of the vehicle determined by the manipulation of the driving mode switch 110 by the passenger can be transmitted to the driving integrated control unit 600 as the above-described operation information through the operation information input interface 101.
[0045] Further, navigation information such as a destination of a passenger and a route to the destination (a shortest route or a preferred route among candidate routes to the destination) input by the passenger through the control panel 120 can be transmitted to the driving integrated control unit 600 as the above-mentioned operation information through the operation information input interface 101.
[0046] In some embodiments, the control panel 120 can be implemented with a touch screen that provides a user interface (UI) for the driver to input or modify information for autonomous driving control of the vehicle, and in this case, the driving mode switch 110 can be implemented with a touch button on the control panel 120.
[0047] Further, the driving integrated control unit 600 can obtain driving information indicating a driving state of the vehicle through the driving information input interface 201. The driving information can include a steering angle formed by a manipulation of a steering wheel by the passenger, an accelerator pedal stroke or a brake pedal stroke formed by stepping on an accelerator or brake pedal, and various information indicating a driving state and behavior of the vehicle, such as a vehicle speed, an acceleration, a yaw, a pitch, a roll, etc. As shown, each of the above-mentioned driving information can be detected through a driving information detection unit 200 including a steering angle sensor 210, an acceleration position sensor / pedal stroke sensor (APS / PTS) 220, a vehicle speed sensor 230, an acceleration sensor 240, and a yaw / pitch / roll sensor 250. Figure 1
[0048] Further, the driving information of the vehicle can include vehicle position information that can be obtained through a global positioning system (GPS) receiver 260 applied to the vehicle. These driving information are transmitted to the driving integrated control unit 600 through the driving information input interface 201 for controlling driving of the vehicle in the autonomous or manual driving mode of the vehicle.
[0049] Further, the driving integrated control unit 600 can transmit driving state information provided to the passenger in the autonomous or manual driving mode of the vehicle to the output unit 300 through the passenger output interface 301. That is, the driving integrated control unit 600 transmits the driving state information of the vehicle to the output unit 300, thereby enabling the passenger to check the autonomous or manual driving state of the vehicle based on the driving state information output through the output unit 300. In this case, the driving state information can include various information indicating a driving state of the vehicle, such as a current driving mode of the vehicle, a current transmission range of the vehicle, a current speed of the vehicle, etc.
[0050] Further, when it is determined that the driver needs a warning in addition to the above-described driving state information in the autonomous driving mode or the manual driving mode of the vehicle, the driving integrated control unit 600 can transmit the warning information to the output unit 300 through the passenger output interface 301, thereby enabling the output unit 300 to output the warning to the driver. To output the driving state information and the warning information aurally and visually, the output unit 300 can include a speaker 310 and a display device 320, as shown in Figure 1 FIG. 2. In this case, the display device 320 can be implemented with the same device as the above-described control panel 120, or can be implemented with a separate independent device.
[0051] Further, the driving integrated control unit 600 can transmit control information for controlling driving of the vehicle in the autonomous driving mode or the manual driving mode of the vehicle to the sub-control system 400 applied to the vehicle through the vehicle control output interface 401. As shown in Figure 1 FIG. 3, the sub-control system 400 for driving control of the vehicle can include an engine control system 410, a brake control system 420, and a steering control system 430, and the driving integrated control unit 600 can transmit engine control information, brake control information, and steering control information as control information to the sub-control systems 410, 420, and 430, respectively, through the vehicle control output interface 401. Accordingly, the engine control system 410 can control the vehicle speed and acceleration of the vehicle by increasing or decreasing fuel supplied to the engine, the brake control system 420 can control vehicle braking by adjusting the braking force of the vehicle, and the steering control system 430 can control the steering of the vehicle by a steering device (e.g., a motor-driven power steering (MDPS) system) applied to the vehicle.
[0052] As described above, the driving integrated control unit 600 of the present embodiment can obtain operation information according to the manipulation of the driver and driving information indicating the driving state of the vehicle through the operation information input interface 101 and the driving information input interface 201, respectively, transmit driving state information and warning information generated according to the autonomous driving algorithm to the output unit 300 through the passenger output interface 301, and transmit control information generated according to the driving algorithm to the sub-control system 400 to implement driving control of the vehicle through the vehicle control output interface 401.
[0053] On the other hand, in order to secure stable autonomous driving of the vehicle, it is necessary to continuously monitor the driving state by accurately measuring the driving environment of the vehicle and to control driving to suit the measured driving environment. To this end, as shown in Figure 1 FIG. 4, the vehicle according to the present embodiment can include a sensor unit 500 for detecting objects (e.g., surrounding vehicles, pedestrians, roads, or fixed facilities (e.g., traffic lights, road signs, traffic signs, construction fences, etc.), etc.) around the vehicle.
[0054] As Figure 1 illustrated, the sensor unit 500 can include at least one of a laser radar sensor 510, a radar sensor 520, and a camera sensor 530 to detect surrounding objects outside the vehicle.
[0055] The laser radar sensor 510 can detect surrounding objects outside the vehicle by emitting a laser signal around the vehicle and receiving a signal reflected back from a corresponding object, and can detect surrounding objects located within a configured distance, a configured vertical angle of view (Vertical Field of View), and a configured horizontal angle of view (Horizontal Field of View) predefined according to a specification. The laser radar sensor 510 can include a front laser radar sensor 511, a top laser radar sensor 512, and a rear laser radar sensor 513 mounted on the front side, the top side, and the rear side of the vehicle, respectively, but the mounting location and the number of its installation are not limited to a specific embodiment. A threshold for determining the validity of the laser signal reflected back from the corresponding object can be pre-stored in a memory (not shown) of the driving integrated control unit 600, and the driving integrated control unit 600 can determine the position (including the distance to the corresponding object), the speed, and the moving direction of the corresponding object in a manner of measuring the time taken for the laser signal transmitted by the laser radar sensor 510 to return by being reflected from the corresponding object.
[0056] The radar sensor 520 can detect surrounding objects outside the vehicle by emitting an electromagnetic wave around the vehicle and receiving a signal reflected back from a corresponding object, and can detect surrounding objects located within a configured distance, a configured vertical angle of view, and a configured horizontal angle of view predefined according to a specification. The radar sensor 520 can include a front radar sensor 521, a left radar sensor 521, a right radar sensor 522, and a rear radar sensor 523 mounted on the front, left, right, and rear sides of the vehicle, respectively, but the mounting location and the number of its installation are not limited to a specific embodiment. The driving integrated control unit 600 can determine the position (including the distance to the corresponding object), the speed, and the moving direction of the corresponding object in a manner of analyzing the power of the electromagnetic wave transmitted and received by the radar sensor 520.
[0057] The camera sensor 530 can detect surrounding objects outside the vehicle by photographing the surrounding environment of the vehicle, and can detect surrounding objects located within a configured distance, a configured vertical angle of view, and a configured horizontal angle of view predefined according to a specification. The vertical and horizontal angles of view of the camera sensor 530 can be adjustable. That is, by adjusting the range of the angle of view, the range of detecting objects (e.g., surrounding vehicles) can be appropriately manipulated as needed.
[0058] The camera sensor 530 can include a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534 mounted on the front, left, right, and rear sides of the vehicle, respectively, but the mounting positions and the number of mounts are not limited to specific embodiments. The driving integrated control unit can determine the position (including the distance to the corresponding object), the speed, the moving direction, etc. of the corresponding object by applying a pre-defined image processing to the image photographed through the camera sensor 530.
[0059] In addition, an interior camera sensor 535 for photographing the inside of the vehicle can be mounted at a predetermined position (e.g., a rearview mirror), and the driving integrated control unit 600 can monitor the behavior and state of the passenger based on the image obtained through the interior camera sensor 535 and output a guide or a warning to the passenger through the above-described output unit 300.
[0060] In addition to the laser radar sensor 510, the radar sensor 520, and the camera sensor 530, the sensor unit 500 can include an ultrasonic sensor 540 as shown in FIG. 5, and various types of sensors for detecting objects around the vehicle can be further employed in the sensor unit 500. Figure 2
[0061] To help understand the present embodiment, Figure 2 It is shown that the front laser radar sensor 511 or the front radar sensor 521 is mounted on the front side of the vehicle, the rear laser radar sensor 513 or the rear radar sensor 524 is mounted on the rear side of the vehicle, and the front camera sensor 531, the left camera sensor 532, the right camera sensor 533, and the rear camera sensor 534 are mounted on the front, left, right, and rear sides of the vehicle, respectively, but as described above, the mounting positions and the number of sensors are not limited to specific embodiments.
[0062] In addition, the sensor unit 500 can further include a biometric sensor for detecting a biometric signal (e.g., heart rate, ECG, respiration, blood pressure, body temperature, brain wave, blood flow (pulse wave), blood sugar, etc.) of the passenger to determine the condition of the passenger in the vehicle. The biometric sensor can include a heart rate sensor, an electrocardiogram sensor, a respiration sensor, a blood pressure sensor, a body temperature sensor, an electroencephalogram sensor, a photoplethysmography sensor, a blood sugar sensor, etc.
[0063] Finally, the sensor unit 500 additionally includes a microphone 550, and an interior microphone 551 and an exterior microphone 552 are used for different purposes, respectively.
[0064] For example, the interior microphone 551 can be used to analyze the voice of the passenger on the autonomous vehicle 1000 based on AI or to immediately respond to a direct voice command.
[0065] On the other hand, the external microphone 552 can be used to appropriately respond to safe driving or the like by analyzing various sounds generated outside the autonomous vehicle 1000 using various analysis tools such as deep learning.
[0066] As a reference, Figure 1 the reference numerals shown can perform the same or similar functions to Figure 1 the reference numerals shown, and can be distinguished from Figure 2 in that, Figure 3 More specifically, the relative positional relationship of the respective components is shown (based on the inside of the autonomous vehicle 1000).
[0067] Figure 3 A data communication system (hereinafter, data communication system) according to one of the embodiments of the present disclosure is shown. The data communication system includes a vehicle 3000 having a camera sensor and a traffic control system 2000 connected to the vehicle 3000 via a communication network.
[0068] Figure 1 The vehicle 3000 shown can correspond to the vehicle 1000 described in Figure 2 and Figure 1 In addition, the camera sensor provided in the vehicle 3000 can correspond to the camera sensor 530 described in Figure 2 and Figure 3 and, according to the installation position thereof, can include a front camera sensor 531, a left side camera sensor 532, a right side camera sensor 533, a rear camera sensor 534, and / or an interior camera sensor 535.
[0069] Figure 4 The traffic control system 2000 shown can include a traffic information center 2100 and a traffic information communication network 2200. The traffic control system 2000 is a system constructed for signal control, traffic information collection, traffic information provision, operation management, or the like, and can include a traffic information center 2100 for storing and processing traffic-related information and a traffic information communication network 2200 for transmitting and receiving traffic-related information. The traffic information center 2100 and the vehicle 3000 can transmit and receive data via the traffic information communication network 2200 through V2X-based communication.
[0070] In this specification, the traffic control system 2000 can be referred to as a "server" having a comprehensive meaning. The server having a comprehensive meaning is a computer system that provides information or services to a client through a network, and can refer to a computer program or a device. That is, the server according to the embodiments of the present disclosure can refer to a computer system for transmitting and receiving various data based on V2X-based communication with the vehicle 3000.
[0071] Meanwhile, the vehicle 3000 can transmit data collected from various sensors provided in the vehicle 3000 to the traffic control system 2000, or receive data from the traffic control system 2000. The data transmission and reception can be performed in real time during a driving period of the vehicle 3000, or can be performed through mutual information requests as needed. The vehicle 3000 can transmit data not only with the traffic control system 2000 based on V2X, but also with other vehicles. In addition, the number of vehicles 3000 according to the present embodiment is not limited, and the data communication system according to the present embodiment enables information to be transmitted and received through mutual communication between a plurality of vehicles and the traffic control system 2000.
[0072] Figure 4 is a block diagram of a vehicle system to which a data communication system according to one of the embodiments of the present disclosure is applicable. The vehicle 4000 includes a camera sensor 4100, a processor 4200, a storage unit 4300, and a communication unit 4400.
[0073] Figure 1 The illustrated vehicle 4000 can correspond to the vehicle 1000 described in Figure 2 and Figure 3 , and the vehicle 3000 described in Figure 4 . In addition, Figure 1 The illustrated camera sensor 4100 can correspond to the camera sensor 530 described in Figure 2 and Figure 1 , and according to the installation position thereof, can include a front camera sensor 531, a left side camera sensor 532, a right side camera sensor 533, a rear camera sensor 534, and / or an interior camera sensor 535.
[0074] The camera sensor 4100 captures an image photographed. The camera sensor 4100 can include a camera lens and a CCD or CMOS sensor to capture an image photographed through the camera lens and transmit the captured image according to a data transmission standard.
[0075] The processor 4200 is configured to correspond to the autonomous driving integrated control unit 600 of Figure 5 , and extracts vehicle identification information based on image data photographed by the camera sensor 4100. The vehicle identification information is unique information capable of identifying a specific vehicle, and can include information composed of characters or numbers written on a license plate of a specific vehicle. That is, the processor 4200 can extract vehicle identification information by recognizing a license plate of a vehicle photographed by the camera sensor 4100.
[0076] In more detail, the processor 4200 can identify a license plate and a vehicle number (vehicle identification information) through a license plate recognition module and a text recognition module. The license plate recognition module can identify a license plate area of a specific vehicle from an image photographed by the camera sensor 4100, and the text recognition module can identify and extract text located in the license plate area as data. The license plate and text recognition process can improve recognition accuracy through data learning using a machine learning or deep learning artificial intelligence (AI) algorithm.
[0077] Further, the processor 4200 can generate information related to the accuracy of the vehicle identification information by calculating a text recognition accuracy. For example, the text recognition accuracy is expressed in the range of 0% to 100% as the recognition accuracy of the text identified by the processor 4200, and the accuracy can be calculated for each text.
[0078] The storage unit 4300 can be configured as a memory for storing various types of data, programs, etc. The memory is a volatile memory and / or a non-volatile memory and can consist of a DRAM, a NAND flash, a NOR flash, an SD card memory, etc., and can store a license plate recognition module program and a text recognition module program.
[0079] Further, the storage unit 4300 can store vehicle identification information, text recognition accuracy, and information acquired from various sensors provided in the vehicle. For example, for specific vehicle identification information, various related information including time information of a vehicle identification information acquisition time, vehicle location information at the time of acquiring the vehicle identification information, a vehicle travel direction at the time of acquiring the vehicle identification information, travel road information (name, length) at the time of acquiring the vehicle identification information, etc. can be stored together. Further, the storage unit 4300 can store vehicle identification information and information related thereto for a predetermined period of time, or can store a predetermined amount of the latest information while maintaining a preset storage capacity.
[0080] The communication unit 4400 is configured to transmit and receive data between the vehicle 4000 and the traffic control system through V2X-based communication, and the vehicle 4000 can transmit and receive various information to and from the traffic control system through the communication unit 4400.
[0081] Figure 4 is a flowchart illustrating a process for transmitting vehicle identification information in a data communication system according to one of the embodiments of the present disclosure. That is, a method of communicating vehicle identification information between a vehicle and a traffic control system is illustrated.
[0082] First, when the vehicle starts driving (S510), the camera sensor of the vehicle is operated to identify surrounding vehicles and obtain vehicle identification information of the identified vehicles (S520). The vehicle identification information can be obtained by performing a license plate and text recognition process on an image captured by the camera sensor built in the vehicle, and this process can be performed by the processor 4200 described in Figure 6
[0083] Subsequently, the vehicle performs a process of releasing communication security to transmit the vehicle identification information to the traffic control system (S530). In the process of releasing communication security, seed information is requested from the traffic control system from the vehicle (S532), a key value is calculated based on the seed information received from the traffic control system according to the request, and the key value is transmitted to the traffic control system (S534). The key value can be calculated from the received seed information using a predetermined algorithm in the camera sensor or the processor of the vehicle. In addition, the process of requesting and receiving the seed information and the process of transmitting the key value can be performed by the communication unit of the vehicle.
[0084] After transmitting the key value, the traffic control system verifies whether the key value received from the vehicle is valid, and transmits to the vehicle whether communication security is released, and the vehicle receives whether communication security is released (S536). Then, when communication security is released, the vehicle encrypts the vehicle identification information (S540), and transmits the vehicle identification information to the traffic control system (S550). The encryption of the vehicle identification information can be performed by the processor using various known algorithms based on the V2X communication security standard specification. The above communication security release process can use the security access 27 hex of the UDS specification (ES95486-02 / 00).
[0085] Figure 7 is a flowchart illustrating a process for receiving vehicle identification information in a data communication system according to one of the embodiments of the present disclosure. That is, a process of receiving vehicle identification information by a traffic control system after a vehicle transmits vehicle identification information to the traffic control system is illustrated. The traffic control system receives vehicle identification information from the vehicle (S610), and stores the received vehicle identification information (S620). Then, the encrypted vehicle identification information is decrypted (S630) and the vehicle identification information is checked (S640), and a response data reception completion is transmitted to the vehicle (S650).
[0086] Figure 7 is a flowchart illustrating a process for transmitting and receiving vehicle identification information in a data communication system according to one of the embodiments of the present disclosure. Figure 5 can be understood as Figure 6 the transmission process of Figure 7 the reception process of Figure 6 the processes corresponding to S722 to S730 in FIG. 7B correspond to the processes of S610 to S650 in FIG. 6B. Figure 7 the processes corresponding to S722 to S730 in FIG. 7B correspond to the processes of S610 to S650 in FIG. 6B.
[0087] Further, Figure 5 the contents of the communication preparation step S706 to the communication security unlocking step S716 of FIG. 7A are described in detail in the processes of S610 to S650 in FIG. 6B. Figure 8 the communication security unlocking step S530 in FIG. 6B. Next, the vehicle requests seed information from the traffic control system (S708), and the traffic control system determines the requested contents and responds to the vehicle (S710).
[0088] When the response result is "Yes", the traffic control system transmits seed information to the vehicle, and the vehicle calculates a key value based on the received seed information and transmits the calculated key value to the traffic control system (S712). The traffic control system checks the received key value and responds to the vehicle (S714). When the key value is valid, the communication security is unlocked (S716), and the vehicle can transmit data to the traffic control system.
[0089] In this case, if the response of the traffic control system is "No" due to the seed request of the vehicle or the transmitted key value being invalid, the vehicle can return to the communication preparation step S706 and request seed information from the traffic control system again.
[0090] The system according to the present embodiment transmits vehicle identification information to the traffic control system in real time while the vehicle is traveling. Accordingly, the traffic control system can collect vehicle identification information data identified by the camera sensor of the traveling vehicle, track and search for a specific vehicle based on the collected information, or provide information related to surrounding vehicles to the driver.
[0091] Figure 8 A process for performing communication of data related to vehicle identification information by a vehicle that is a system according to one of the embodiments of the present disclosure in response to a request from a traffic control system is shown.
[0092] The vehicle can receive an information request for a specific vehicle from the traffic control system (S810). For example, the traffic control system can request information related to a specific vehicle by transmitting vehicle identification information (e.g., a vehicle number) of the specific vehicle to the vehicle. The vehicle that receives the vehicle identification information can search whether the corresponding vehicle identification information is stored in a storage unit (memory) (S820). Then, it is determined whether the vehicle identification information and related information are stored (S830). When the vehicle identification information and related information are stored in the storage unit, the vehicle transmits the vehicle identification information and related information to the traffic control system (S840), and transmits a response completion (S850). If the information is not stored, the response completion (S850) is immediately transmitted.
[0093] Here, the information related to the vehicle identification information can include a time and a place where the corresponding vehicle identification information is obtained from the vehicle, a traveling direction of the vehicle, traveling road information (name, length), etc. Thus, the traffic control system can collect information such as a sighting position, a sighting time, a traveling direction, a speed, etc. of a specific vehicle through the vehicle identification information, and can easily track the specific vehicle.
[0094] Although Figure 7 not shown in the Figure 9 , the communication security unlocking process and the encryption or decryption process can be applied to the system according to the present embodiment (similar to the system of
[0095] Figure 1 A process for obtaining vehicle identification information in a data communication system according to one of the embodiments of the present disclosure is illustrated. In the present embodiment, the vehicle includes a front camera sensor for photographing a front side of the vehicle and a side (left or right) camera sensor for photographing a side of the vehicle. The camera sensor can adjust a photographing range or a capturing range of an image by adjusting a viewing angle.
[0096] In the system according to the present embodiment, the process of obtaining the vehicle identification information can adjust the viewing angle of the camera sensor in consideration of whether another vehicle is traveling on the side of the vehicle. In more detail, it is checked whether another vehicle is traveling on the side of the vehicle (first condition) (S920). When another vehicle is traveling on the side of the vehicle, it is checked whether the other vehicle includes a front camera sensor (second condition) (S930).
[0097] When the other vehicle includes the front camera sensor, the vehicle obtains vehicle identification information of another vehicle traveling in the same lane only by adjusting the viewing angle of the front camera sensor, and transmits the vehicle identification information to the traffic control system (S940). When the other vehicle does not include the front camera sensor, the vehicle obtains vehicle identification information of a plurality of other vehicles traveling in a plurality of lanes by adjusting the viewing angle of the front camera sensor, and transmits the vehicle identification information to the traffic control system (S950).
[0098] That is, when both the first condition and the second condition are "Yes", the vehicle obtains vehicle identification information of another vehicle having the front camera sensor located in the same lane only. When any one of the first condition and the second condition is "No", the front camera sensor can obtain vehicle identification information of other vehicles traveling in at least two lanes by adjusting the viewing angle.
[0099] According to the present embodiment, since redundant data generated when a plurality of vehicles acquire vehicle identification information is removed, efficient data communication can be performed. In the present embodiment, when another vehicle located at the side acquires vehicle identification information through the front camera sensor, the vehicle acquires vehicle identification information of only another vehicle located in the same lane as the lane in which the vehicle is traveling, thereby not acquiring the same information as the vehicle located at the side.
[0100] Meanwhile, the data communication vehicle according to the present embodiment includes a camera sensor 4100, a processor 4200 for extracting vehicle identification information from an image captured by the camera sensor, and a communication unit 4400 for transmitting and receiving data to and from a server based on V2X. In addition, the data communication vehicle can further include a storage unit 4300 capable of storing vehicle identification information. The camera sensor 4100 corresponds to the camera sensor 530 of Figure 9 and can adjust the angle of view according to a control command of the control unit 600. Therefore, as described in the data communication vehicle can capture a single lane or a plurality of lanes by adjusting the angle of view of the camera sensor according to a specific condition.
[0101] In another aspect of the present disclosure, the above proposals or operations of the present disclosure can be provided as code, an application storing or containing the code, a computer-readable storage medium, a computer program product, etc., which can be implemented, realized, or executed by a "computer" (including a comprehensive concept of a system on chip (SoC) or a microprocessor), which are also within the scope of the present disclosure.
[0102] A detailed description of preferred embodiments of the present disclosure disclosed as described above is provided so that those skilled in the art can implement and realize the present disclosure. Although described with reference to preferred embodiments of the present disclosure, those skilled in the art will understand that various modifications and changes can be made to the present disclosure without departing from the spirit or scope of the present disclosure. For example, those skilled in the art can use the various components described in the above embodiments in a manner of combining them with each other.
[0103] Therefore, the present disclosure is not intended to be limited to the embodiments shown herein, but to give the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A system for data communication, comprising: a vehicle having a camera sensor; and a server sending and receiving data to and from the vehicle, wherein the vehicle comprises a processor extracting vehicle identification information from an image captured by the camera sensor, wherein the vehicle sends the vehicle identification information to the server, and wherein the processor checks whether a different vehicle is driving on the same lane of the vehicle, checks whether the different vehicle has a front camera sensor based on the different vehicle currently driving on the same lane of the vehicle, obtains vehicle identification information of another vehicle located in the same lane of the vehicle using a front camera sensor of the vehicle if the different vehicle has a front camera sensor, and obtains respective vehicle identification information of other vehicles located in at least two lanes using the front camera sensor of the vehicle if the different vehicle does not have a front camera sensor.
2. The system of claim 1, wherein, The vehicle further comprises a communication unit unlocking a security of a server to communicate with the server based on V2X.
3. The system of claim 2, wherein, The communication unit sends and receives data to and from the server.
4. The system of claim 3, wherein, The vehicle further comprises a storage device for storing the vehicle identification information.
5. The system of claim 1, wherein a front camera sensor of the camera sensor is configured to take a view in a front direction of the vehicle; wherein the camera sensor further comprises a side camera sensor taking a view in a side direction of the vehicle, and wherein the camera sensor adjusts a viewing angle.
6. The system of claim 2, wherein, The communication unit sends and receives the vehicle identification information to and from the server.
7. The system of claim 6, wherein, The vehicle further comprises a storage device storing the vehicle identification information.
8. The system of claim 6, wherein, The camera sensor adjusts the viewing angle according to a control command.
9. A method for data communication, the method comprising: obtaining vehicle identification information from an image captured by a camera sensor of a vehicle; unlocking a security of a server by a communication unit of the vehicle to communicate with the server based on V2X; and sending the vehicle identification information to the server from the communication unit, wherein obtaining the vehicle identification information comprises: checking whether a different vehicle is driving on the same lane of the vehicle; checking whether the different vehicle has a front camera sensor based on the different vehicle currently driving on the same lane of the vehicle; obtaining vehicle identification information of another vehicle located in the same lane of the vehicle using a front camera sensor of the vehicle if the different vehicle has a front camera sensor; and obtaining respective vehicle identification information of other vehicles located in at least two lanes using the front camera sensor of the vehicle if the different vehicle does not have a front camera sensor. Unlocking the security comprises:
10. The method of claim 9, wherein, requesting seed information from the server by the communication unit; and sending a key value to the server from the communication unit. Sending the vehicle identification information to the server comprises encrypting the vehicle identification information.
11. The method of claim 9, wherein, 12. The method of claim 9, further comprising: receiving the vehicle identification information in the server; storing the vehicle identification information in the server; and decrypting the vehicle identification information in the server.
13. The method of claim 9, obtaining the vehicle identification information includes adjusting a field of view of the camera sensor in view of whether a different vehicle is traveling in a side direction of the vehicle. wherein
Citation Information
Patent Citations
Device and method of transfering blackbox image using V2X communication
KR1020140030691A
Error correction circuit and method for error correctoin encoding
KR1020210147686A
Internet of Vehicles safety communication method, vehicle-mounted terminal, server and system
CN106453269A
Other vehicle detection device and other vehicle detection method
JP2005215964A
Methods and systems for tracking non-connected vehicles
US20210103740A1