Information Monitoring System and Method for Collecting and Managing State Information of Vehicles with Added Autonomous Driving Functions
The information monitoring system addresses the limitations of existing vehicle monitoring systems by independently managing autonomous driving vehicle status through sensor data analysis, generating control commands, and providing real-time status updates, enhancing operational stability and management efficiency.
Patent Information
- Application Number
- KR1020260014821
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2026-01-26
- Publication Date
- 2026-11-06
- Estimated Expiration
- 2046-01-26
AI Technical Summary
Existing vehicle monitoring systems fail to comprehensively assess the operational status of vehicles equipped with autonomous driving capabilities, particularly in modified vehicles, due to limitations in data accessibility and integration of autonomous driving controllers, sensor modules, and communication devices, leading to difficulties in identifying control anomalies and managing status information across multiple vehicles.
An information monitoring system utilizing a processor to collect and manage status information by recognizing driving environments and vehicle states, generating control commands, and providing autonomous driving control status to external systems, independent of manufacturer data restrictions.
Enables reliable identification and management of autonomous driving vehicle status without relying on manufacturer-restricted data, improving operational stability and management efficiency for single and multiple vehicles.
Smart Images

Figure 112026010463624-PAT00056_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to an information monitoring system and method for collecting and managing operational status information of a vehicle to which an autonomous driving function has been added to an existing vehicle. Background Technology
[0002] With the recent advancement of vehicle technology, research and demonstration of autonomous driving technology are actively underway. Consequently, there is an increasing number of cases where autonomous driving functions are added to or modified from existing standard vehicles for operation. Unlike vehicles where autonomous driving capabilities are designed as a single integrated unit during the manufacturing process, these vehicles equipped with autonomous driving functions feature a structure in which autonomous driving controllers, sensor modules, and communication devices are additionally installed into the existing vehicle's control system. In particular, vehicles intended for testing and demonstration purposes, those operating in restricted environments, and autonomous vehicles capable of remote intervention are mostly implemented by modifying existing mass-produced vehicles.
[0003] Meanwhile, existing vehicle monitoring systems designed to check vehicle status are primarily provided by vehicle manufacturers or maintenance and operation companies, and are structured around information obtainable through the vehicle's on-board diagnostics (OBD). While these systems are useful for verifying engine and battery status, as well as basic vehicle fault information, the scope of information provided varies by manufacturer, and accessible data items are often limited. In particular, a significant amount of status information generated by the vehicle's internal control systems is restricted from being provided to external systems or is often treated as a "black box" according to manufacturer policies, creating structural limitations for third parties to utilize it.
[0004] Existing vehicle monitoring methods suffer from a problem in that they fail to adequately consider the operating environment of vehicles equipped with autonomous driving capabilities. In the case of vehicles modified for autonomous driving, core control functions such as steering, acceleration, braking, and gear shifting are directly controlled or intervened in by the autonomous driving controller; however, existing monitoring systems are not designed to comprehensively assess the operational status of this controller or the validity of control commands. Consequently, it is difficult to identify control anomalies or changes in operating status occurring during autonomous driving in real time, or to analyze the vehicle's condition based on driving history.
[0005] Furthermore, since modified autonomous vehicles often feature existing vehicle systems and autonomous driving-related systems configured in parallel, it is difficult to accurately assess the vehicle's overall operational status without the integrated management of status information generated by each system. However, conventional monitoring systems are designed based on standard vehicles, which limits their ability to effectively collect and manage information generated from additional components such as autonomous driving controllers, sensor modules, and communication devices. Consequently, it is difficult to systematically monitor whether the autonomous driving function is properly activated and what state the vehicle was in during operation.
[0006] Furthermore, existing vehicle monitoring systems focus on verifying the status of a single vehicle, making it difficult to manage the status of each vehicle according to consistent standards in environments where multiple modified autonomous vehicles are operated simultaneously. In particular, the inability to systematically store and manage history of status changes or anomalies over time imposes limitations on analyzing the operational history or conducting post-operation verification of these vehicles. Due to these issues, there is a continuously being raised need for a comprehensive status monitoring system to support the stable operation of modified autonomous vehicles. The problem to be solved
[0007] The objective of the present invention is to enable the stable determination of the operational status of a vehicle equipped with autonomous driving functions by collecting and managing status information essential for operation without being dependent on the manufacturer.
[0008] However, the technical problems that the present invention aims to solve are not limited to those described above, and other unmentioned problems will be clearly understood by those skilled in the art from the description of the invention below. means of solving the problem
[0009] A processor configured to store instructions according to one aspect of the present invention, and to execute instructions stored in the memory to recognize a driving environment and vehicle state based on sensor data and vehicle state data collected from a vehicle with added autonomous driving functions, determine whether to perform autonomous driving based on the recognized driving environment and vehicle state, generate a control command for at least one of steering, acceleration, braking, and shifting according to the determination result, transmit the control command to a vehicle control system to control the driving of the vehicle, store control state and operation state information generated during the autonomous driving control process, and provide an autonomous driving control state to an external system or user terminal using the stored information.
[0010] Preferably, the processor may be configured to recognize driving environment information including at least one of objects around the vehicle, road shape, lane information, and drivable area from the sensor data, and to recognize vehicle state information including at least one of vehicle speed, steering state, acceleration state, and braking state from the vehicle state data.
[0011] Preferably, the processor may be configured to determine whether to perform autonomous driving by determining at least one of an autonomous driving capable state, an autonomous driving restricted state, and an autonomous driving impossible state based on the recognized driving environment and vehicle state.
[0012] Preferably, the processor may be configured to generate control commands for steering, acceleration, braking, and shifting when the result of determining whether to perform autonomous driving is determined to be in an autonomous driving state, and to generate control commands to restrict or release autonomous driving control when the result is determined to be in an autonomous driving restricted state or an autonomous driving impossible state.
[0013] Preferably, the processor may be configured to control the driving of the vehicle by transmitting the control command to at least one of a steering control system, an acceleration control system, a braking control system, and a transmission control system within the vehicle.
[0014] Preferably, the processor may be configured to generate autonomous driving control history information by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order.
[0015] Preferably, the processor may be configured to provide the autonomous driving control status to an external system or user terminal in real time or periodically based on the generated autonomous driving control history information.
[0016] An information monitoring method according to one aspect of the present invention comprises: a step of recognizing a driving environment and a vehicle state based on sensor data and vehicle state data collected from a vehicle with added autonomous driving functions; a step of determining whether to perform autonomous driving based on the recognized driving environment and vehicle state; a step of generating a control command for at least one of steering, acceleration, braking, and shifting according to the determination result; a step of transmitting the control command to a vehicle control system to control the driving of the vehicle, a step of storing control state and operation state information generated during the autonomous driving control process, and a step of providing an autonomous driving control state to an external system or a user terminal using the stored information. Effects of the invention
[0017] According to the present invention, for a vehicle to which autonomous driving functions have been added or modified based on an existing conventional vehicle, driving can be controlled by utilizing sensor data and vehicle status data without being dependent on the vehicle manufacturer to recognize the driving environment and vehicle status, determine whether to perform autonomous driving, and generate and transmit control commands. Furthermore, control status and operational status information generated during such autonomous driving control processes can be efficiently collected and stored and provided to an external system or user terminal. Accordingly, the operational status of the autonomous driving modified vehicle can be reliably identified without relying on data that is restricted from access by manufacturer or blacked out, and by systematically managing vehicle status information according to the vehicle unit and time flow, the management of operational history and status tracking of the autonomous driving modified vehicle becomes easier.
[0018] In addition, by implementing these information collection, management, and provision functions in a consistent system configuration, the present invention can be applied not only to a single vehicle but also to an environment where multiple modified autonomous vehicles are operated simultaneously, thereby providing the effect of improving the stability and management efficiency of autonomous vehicle operation.
[0019] In addition, various other additional effects may be achieved by various embodiments of the present invention. These various effects of the present invention are described in detail in each embodiment, or the description of effects that are easily understood by those skilled in the art is omitted. Brief explanation of the drawing
[0020] The following drawings attached to this specification illustrate preferred embodiments of the present invention and serve to further enhance understanding of the technical concept of the present invention together with the detailed description of the invention provided below; therefore, the present invention should not be interpreted as being limited only to the matters described in such drawings. FIG. 1 is a diagram illustrating components for performing an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions according to an embodiment of the present invention. FIG. 2 is a diagram illustrating elements constituting a system for performing an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions according to an embodiment of the present invention. FIG. 3 is a diagram showing an example of an information monitoring method for collecting and managing status information of a vehicle with added autonomous driving functions implemented by the system of FIG. 2. FIG. 4 is a flowchart illustrating an information monitoring method for collecting and managing status information of a vehicle with added autonomous driving functions according to an embodiment of the present invention. Specific details for implementing the invention
[0021] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. Prior to this, terms and words used in this specification and claims should not be interpreted as being limited to their ordinary or dictionary meanings, and should be interpreted in a meaning and concept consistent with the technical spirit of the present invention, based on the principle that the inventor can appropriately define the concept of the terms to best describe his invention.
[0022] Therefore, the embodiments described in this specification and the configurations illustrated in the drawings are merely the most preferred embodiments of the present invention and do not represent all of the technical ideas of the present invention; thus, it should be understood that various equivalents and modifications that can replace them may exist at the time of filing this application.
[0023] FIG. 1 is a diagram illustrating components for performing an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions according to an embodiment of the present invention, FIG. 2 is a diagram illustrating elements constituting a system (100) for performing an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions according to an embodiment of the present invention, and FIG. 3 is a diagram showing an example of an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions implemented by the system (100) of FIG. 2.
[0024] Referring to FIGS. 1 to 3, an information monitoring system (100) according to one embodiment of the present invention may include a memory (110) and a processor (120). However, it is not limited thereto, and other general-purpose components may be further included in the information monitoring system (100).
[0025] Memory (110) may be configured to store instructions of a computer program or application that implements an information monitoring method, and a processor (120) may execute the instructions stored in memory (110) to execute the program or application. For example, memory (110) may be implemented as non-volatile memory such as ROM, PROM, EPROM, EEPROM, flash memory, PRAM, MRAM, RRAM, FRAM, etc., or volatile memory such as DRAM, SRAM, SDRAM, PRAM, RRAM, FeRAM, etc., and may be implemented in the form of HDD, SSD, SD, Micro-SD, etc., or a combination thereof. The processor (120) may be implemented as an array of logic gates, a microprocessor, a CPU, a GPU, an AP, or a combination thereof.
[0026] Specifically, the processor (120) can recognize the driving environment and vehicle status of a vehicle based on sensor data and vehicle status data collected from a vehicle with added autonomous driving functions. Here, the sensor data may be data obtained from various sensors mounted on or connected to the vehicle to detect the surrounding environment of the vehicle, and the vehicle status data may be data obtained from a control system or vehicle operation system inside the vehicle. By comprehensively processing the sensor data and vehicle status data collected in this manner, the processor (120) can simultaneously recognize the driving environment around the vehicle and the current state of the vehicle itself, and thereby secure basic information necessary for autonomous driving control.
[0027] Additionally, the processor (120) can determine whether to perform autonomous driving based on the perceived driving environment and vehicle state. At this time, the processor (120) can determine whether to perform autonomous driving by comprehensively considering the complexity of the driving environment, the stability of the vehicle state, and the possibility of activating the autonomous driving function, and this determination may include a determination on whether to continue autonomous driving, perform it on a limited basis, or not perform autonomous driving. That is, the processor (120) does not merely determine whether to execute autonomous driving, but rather determines whether to operate autonomous driving suitable for the environment and state the vehicle is currently in, thereby enabling control in subsequent stages to be carried out rationally.
[0028] Additionally, the processor (120) may generate a control command for at least one of steering, acceleration, braking, and shifting based on the judgment result. The control command generated at this time may be a command to maintain the vehicle's driving stably, change the driving state, or restrict or disable autonomous driving if necessary, by reflecting the judgment result regarding whether to perform autonomous driving. The processor (120) can ensure continuity and consistency of autonomous driving control by generating a control command suitable for the vehicle's current driving situation by linking the results of recognizing the driving environment and vehicle state with the judgment result regarding whether to perform autonomous driving.
[0029] Additionally, the processor (120) controls the driving of the vehicle by transmitting control commands to the vehicle's control system and can store control state and operation state information generated during the autonomous driving control process. Here, the control system may include at least one of a steering control system, an acceleration control system, a braking control system, and a transmission control system within the vehicle, and the processor (120) can ensure that the control commands generated through interaction with the control system are reflected in the actual driving of the vehicle. Furthermore, the processor (120) can manage the history and operation state of autonomous driving control over time by storing together the control state information generated during the process of generating and transmitting control commands and the operation state information during the performance of autonomous driving.
[0030] Additionally, the processor (120) may be configured to provide the autonomous driving control status to an external system (200) or a user terminal (300) using stored information. In this case, the external system (200) may be a control system for managing or monitoring the operational status of an autonomous vehicle, and the user terminal (300) may be a terminal used by a vehicle manager or operator. By providing the stored autonomous driving control status and operational status information in real time or periodically, the processor (120) enables the current status and past operational status of a vehicle with added autonomous driving functions to be checked externally, thereby improving the reliability and management efficiency of the operational status of the autonomous vehicle.
[0031] In one embodiment, the processor (120) may be configured to collect status information separated by vehicle control system in order to more precisely monitor the state of a vehicle with added autonomous driving functions. Specifically, the processor (120) may collect steering angle, target angle, steering control status, and fault information occurring in the steering system in relation to the steering system, and thereby check whether steering commands are being executed normally and the steering response status.
[0032] Additionally, the processor (120) can collect acceleration command information, acceleration response status, acceleration control status, and acceleration system fault information in relation to the acceleration system. This acceleration-related status information can be used to determine whether longitudinal control of the vehicle is being performed normally during autonomous driving.
[0033] Additionally, the processor (120) can collect braking status information including braking command status, braking capability, and emergency stop (E-Stop) status in relation to the braking system. The processor (120) can use this braking status information to monitor control status directly related to vehicle safety in real time.
[0034] Additionally, the processor (120) can collect information indicating the current gear position, target gear state, and whether the gear shift failed in relation to the transmission system, and through this, can determine whether the vehicle is maintaining a normal driving state in the current driving environment.
[0035] In addition, the processor (120) can collect the vehicle's power voltage status and fault information regarding the electrical system, and through this, can verify the overall stability of the autonomous driving system and the vehicle control system.
[0036] Additionally, the processor (120) may collect common state information including vehicle speed, operating mode, an Enable signal indicating whether autonomous driving is active, and an Alive signal indicating whether the autonomous driving system is operating normally, in order to determine the overall operating state of the vehicle. This common state information can be comprehensively analyzed together with state information of individual control systems and used to determine the overall operating state of the vehicle.
[0037] In this way, the processor (120) systematically collects status information classified into steering, acceleration, braking, transmission, electrical systems, and common systems, thereby enabling a comprehensive understanding of the operational status of a vehicle with added or modified autonomous driving functions, without being dependent on the manufacturer. This status information is subsequently linked to the steps of determining whether to perform autonomous driving, generating control commands, storing control status and operational status information, and providing it to an external system or user terminal, thereby enabling the systematic management of the vehicle status according to the vehicle unit and the flow of time.
[0038] According to the present invention, for a vehicle to which an autonomous driving function has been added or modified based on an existing general vehicle, the driving of the vehicle can be controlled by using sensor data and vehicle status data to recognize the driving environment and vehicle status, determine whether to perform autonomous driving, and generate and transmit control commands, without being dependent on the vehicle manufacturer. Additionally, control status and operational status information generated during such autonomous driving control processes can be efficiently collected and stored and provided to an external system (200) or a user terminal (300). Accordingly, the operational status of the autonomous driving modified vehicle can be reliably identified without relying on data that is restricted from access by manufacturer or blacked out, and by systematically managing vehicle status information according to vehicle unit and time flow, the operational history management and status tracking of the autonomous driving modified vehicle become easier.
[0039] In addition, by implementing these information collection, management, and provision functions in a consistent system configuration, the present invention can be applied not only to a single vehicle but also to an environment where multiple modified autonomous vehicles are operated simultaneously, thereby providing the effect of improving the stability and management efficiency of autonomous vehicle operation.
[0040] In one embodiment, the processor (120) can recognize driving environment information including at least one of objects around the vehicle, road shape, lane information, and drivable area from sensor data. For example, the processor (120) can recognize whether objects around the vehicle exist, the relative position and direction of movement of objects based on distance information, image information, reflection signal, or position information included in the sensor data, and can identify the driving environment around the vehicle using the results of such recognition.
[0041] The processor (120) can also recognize at least one of road shape, lane information, and drivable area by analyzing road surface information, boundary information, or lane-related feature information included in the sensor data. At this time, the processor (120) may recognize driving environment information by combining sensor data obtained from multiple sensors as well as data obtained from a single sensor, thereby enabling stable recognition of the vehicle's driving environment without relying on the data format of a specific sensor or a specific manufacturer. According to this structure, the processor (120) can recognize the driving environment using externally obtainable sensor data without relying on internal control data that is restricted from access or blacked out by manufacturer.
[0042] Additionally, the processor (120) may be configured to recognize vehicle state information including at least one of vehicle speed, steering state, acceleration state, and braking state from vehicle state data.
[0043] Here, the vehicle state data may be data obtained from a control system, operating system, or modified autonomous driving controller within the vehicle, and may be common state information not dependent on the vehicle manufacturer. The processor (120) can use this vehicle state data to recognize the vehicle's current driving state, changes in steering angle, acceleration or deceleration state, braking status, etc., and thereby obtain basic information to determine whether the vehicle is in a stable driving state.
[0044] In one embodiment, the processor (120) may independently recognize driving environment information and vehicle state information, respectively, and then align them temporally to process them integrally. For example, the processor (120) may combine driving environment information E(t) recognized at time t with vehicle state information V(t) recognized at the same time or a close time to form the following state vector S(t) (see Equation 1).
[0045] [Mathematical Formula 1]
[0046] S(t) = [E(t), V(t)]
[0047] Here, E(t) is driving environment information including at least one of object information, lane information, and drivable area information, and V(t) may be vehicle state information including at least one of vehicle speed, steering state, acceleration state, and braking state. The processor (120) can comprehensively determine the current driving situation of the vehicle based on this state vector S(t) and can utilize this in the subsequent steps of determining whether to perform autonomous driving and generating control commands.
[0048] In another embodiment, the processor (120) may calculate the reliability of autonomous driving control by assigning weights to each of the recognized driving environment information and vehicle state information. For example, the reliability of the driving environment information may be set to w₁ and the reliability of the vehicle state information to w₂, and the following evaluation values may be calculated using these.
[0049] [Mathematical Formula 2]
[0050] R(t) = [w₁x E′+ w₂x V′]
[0051] Here, E′ may be normalized driving environment information and V′ may be normalized vehicle state information, and w₁ and w₂ may be set to the same or different values. The processor (120) can use these evaluation values R(t) to secure the reliability of the autonomous driving control judgment that comprehensively considers the driving environment and vehicle state, and this can contribute to improving the accuracy of the judgment on whether to perform autonomous driving.
[0052] In this way, the processor (120) is configured to recognize driving environment information and vehicle status information using sensor data and vehicle status data, thereby enabling the acquisition of core information necessary for autonomous driving without being dependent on the vehicle manufacturer, even for vehicles that have had autonomous driving functions added or modified based on existing conventional vehicles. Accordingly, the operational status of the autonomous modified vehicle can be reliably identified without relying on data that is restricted from access or blacked out by manufacturer, and the recognized driving environment and vehicle status information can be naturally linked to determining whether to perform autonomous driving, generating and transmitting control commands, and storing and providing control status and operational status information. This structure allows for the systematic management of vehicle status information according to vehicle units and time flow, thereby facilitating the management of operational history and status tracking of the autonomous modified vehicle, and contributes to improving the stability and management efficiency of autonomous vehicle operation not only in a single vehicle but also in an environment where multiple autonomous modified vehicles are operated simultaneously.
[0053] In one embodiment, the processor (120) may be configured to determine whether to perform autonomous driving by determining at least one of an autonomous driving possible state, an autonomous driving restricted state, and an autonomous driving impossible state based on a recognized driving environment and vehicle state.
[0054] The driving environment and vehicle state recognized here may be information obtained based on sensor data and vehicle state data as previously described, and the processor (120) can determine in stages whether it is appropriate to perform autonomous driving by comprehensively considering this information.
[0055] Specifically, the processor (120) can utilize the results of recognizing the driving environment and the results of recognizing the vehicle state as input information required for determining autonomous driving performance. For example, the driving environment may include the presence of objects around the vehicle, road shape, lane continuity, and stability of the drivable area, and the vehicle state may include changes in vehicle speed, stability of the steering state, and suitability of the acceleration or braking state. The processor (120) can make a determination regarding autonomous driving performance by individually or in combination with these driving environments and vehicle states, and by using only common information that is not dependent on a specific manufacturer or specific vehicle structure, it enables stable determination even in an environment of a modified autonomous vehicle.
[0056] In one embodiment, the processor (120) may calculate autonomous driving judgment indicators reflecting the driving environment and vehicle state over time and manage them in the form of sets. For example, the processor (120) may form the following sets of judgment information by pairing the autonomous driving judgment indicators calculated at each point in time with the corresponding point in time (see Equation 3).
[0057] [Mathematical Formula 3]
[0058]
[0059] Here may be an autonomous driving judgment indicator calculated by comprehensively reflecting the driving environment and vehicle status perceived at the i-th time point, and may be a positive real value representing the time at which the corresponding judgment indicator was calculated. The processor (120) can use this set of judgment information to comprehensively consider changes in the autonomous driving performance state over time without relying on the judgment result at a single point in time.
[0060] Additionally, the processor (120) can determine at least one of an autonomous driving possible state, an autonomous driving restricted state, and an autonomous driving impossible state by comparing the autonomous driving judgment indicator calculated at each point in time with a preset reference value. For example, the processor (120) can determine the autonomous driving judgment indicator If the value is greater than or equal to the first threshold, it is determined to be in a state where autonomous driving is possible; if the value is less than the first threshold and greater than or equal to the second threshold, it is determined to be in a state where autonomous driving is restricted; and if the value is less than the second threshold, it is determined to be in a state where autonomous driving is impossible. Generalizing this, it can be expressed as the following mathematical formula 4.
[0061] [Mathematical Formula 4]
[0062]
[0063] Here and It can be set to be the same or different depending on the complexity of the driving environment, the stability of the vehicle state, or the operation policy of the autonomous driving system, and is not limited to a specific numerical value or calculation method. By determining whether to perform autonomous driving step by step through the comparison of these reference values, the processor (120) can derive a more detailed autonomous driving operation state rather than a simple binary judgment.
[0064] In another embodiment, the processor (120) may determine to perform autonomous driving in a limited manner or allow only some control functions when it is determined to be in an autonomous driving restricted state, and may determine to stop or disable autonomous driving when it is determined to be in an autonomous driving impossible state. These determination results are subsequently linked to a step of generating control commands for steering, acceleration, braking, and shifting, so that autonomous driving control suitable for the vehicle's driving environment and vehicle condition is performed.
[0065] In this way, the processor (120) is configured to determine whether to perform autonomous driving by determining at least one of an autonomous driving possible state, an autonomous driving restricted state, and an autonomous driving impossible state based on the recognized driving environment and vehicle state. Consequently, even for vehicles to which autonomous driving functions have been added or modified based on existing general vehicles, the determination of whether to perform autonomous driving can be made reliably using sensor data and vehicle state data without being dependent on the vehicle manufacturer. Accordingly, the operational status of the autonomous driving modified vehicle can be accurately identified without relying on data that is restricted from access or blacked out by manufacturer. Furthermore, the results of this determination are linked to the generation and transmission of control commands, and the storage and external provision of control and operational status information, thereby allowing the vehicle status to be systematically managed on a vehicle-by-vehicle basis and over time. Moreover, by implementing these information collection, management, and provision functions in a consistent system configuration, the present invention can be applied not only to a single vehicle but also to an environment where multiple autonomous driving modified vehicles are operated simultaneously, thereby providing the effect of improving the stability and management efficiency of autonomous driving vehicle operation.
[0066] In one embodiment, the processor (120) may be configured to generate control commands for steering, acceleration, braking, and shifting when the result of determining whether to perform autonomous driving is determined to be an autonomous driving possible state, and to generate control commands to limit or release autonomous driving control when the result is determined to be an autonomous driving restricted state or an autonomous driving impossible state.
[0067] Here, the result of the judgment on whether to perform autonomous driving may be a result derived based on the perceived driving environment and vehicle state as previously explained, and the processor (120) may use the judgment result as an input value for the control command generation step.
[0068] Specifically, when the processor (120) determines that the vehicle can stably perform autonomous driving in the current driving environment and vehicle state when it is determined to be in an autonomous driving state, it can generate control commands for steering, acceleration, braking, and shifting accordingly. The control commands generated at this time may include at least one of a steering command to maintain the vehicle's target driving path, an acceleration or deceleration command to achieve or maintain a target speed, a braking command to ensure driving safety, or a shifting command to set a gear ratio suitable for the driving situation. Through these control commands, the processor (120) can continuously and consistently control the vehicle's driving in an autonomous driving manner.
[0069] On the other hand, if the processor (120) determines that the autonomous driving is in a restricted state, it may determine that the driving environment or vehicle condition is not sufficiently stable to fully perform autonomous driving and may generate a control command to restrict autonomous driving control. For example, the processor (120) may generate a control command to limit the vehicle speed to within a preset range, limit the amount of change in the steering angle, or allow only specific driving assistance functions in the restricted state of autonomous driving. Such control may be a measure to ensure driving safety without completely stopping autonomous driving.
[0070] Additionally, if the processor (120) determines that autonomous driving is not possible, it may determine that autonomous driving is not safe and generate a control command to release autonomous driving control. In this case, the processor (120) may generate a control command to stop autonomous driving control and transfer control authority of the vehicle to the driver or an external control entity, and may generate a control command to induce the vehicle to decelerate or stop if necessary. Such release of autonomous driving control may be based on the result of a judgment to prioritize the safety of the vehicle.
[0071] In one embodiment, the processor (120) converts the result of the judgment on whether to perform autonomous driving into a quantified control judgment value, and may adjust the intensity or range of the control command according to the value. For example, the processor (120) has an autonomous driving judgment indicator Control command strength based on It can be set as follows (see Equation 5).
[0072] [Mathematical Formula 5]
[0073]
[0074] Here may be a function that adjusts the size, frequency, or allowable range of control commands according to autonomous driving judgment indicators, and is not limited to a specific function form. The processor (120) controls the strength of these control commands By using this, control commands can be generated to perform active control in an autonomous driving state and relaxed control in an autonomous driving restricted state.
[0075] In another embodiment, the processor (120) may manage the timing of restricting or releasing autonomous driving control over time in an autonomous driving restricted state or an autonomous driving impossible state. For example, the processor (120) may generate a control command to restrict or release autonomous driving control only when the condition for restricting or releasing autonomous driving persists for a certain period of time or longer, which can be expressed as follows (see Equation 6).
[0076] [Mathematical Formula 6]
[0077]
[0078] Here indicates the restricted or released state of autonomous driving control, and This may indicate the time at which the state is applied. By taking this time information into account, the processor (120) can prevent the autonomous driving control from being unnecessarily released due to temporary environmental changes.
[0079] In this way, the processor (120) generates control commands for steering, acceleration, braking, and shifting, or generates control commands to restrict or release autonomous driving control, depending on the result of the determination of whether autonomous driving is performed. This allows for stable control of the vehicle's driving using sensor data and vehicle status data, even for vehicles that have had autonomous driving functions added or modified based on existing conventional vehicles, without being dependent on the vehicle manufacturer. Accordingly, the operational status of the modified autonomous driving vehicle can be accurately identified without relying on data that is restricted from access or blacked out by manufacturer. Furthermore, the control status and operational status information generated during this control process can be linked to storage and external provision stages, allowing for systematic management of the vehicle status on a vehicle-by-vehicle basis and over time. Moreover, by implementing these information collection, management, and provision functions in a consistent system configuration, the present invention can be applied not only to a single vehicle but also to environments where multiple modified autonomous driving vehicles are operated simultaneously, thereby providing the effect of improving the stability and management efficiency of autonomous driving vehicle operation.
[0080] In one embodiment, the processor (120) may be configured to control the driving of the vehicle by transmitting the control command to at least one of the vehicle's steering control system, acceleration control system, braking control system, and transmission control system.
[0081] Here, the above control command is a command generated based on the result of a judgment regarding whether to perform autonomous driving, and the processor (120) can control the driving of the vehicle integrally by individually transmitting the control command to a single control system or by transmitting it to multiple control systems simultaneously or sequentially.
[0082] Specifically, when the processor (120) determines that the vehicle is in a state capable of autonomous driving, it may prioritize generating and transmitting control commands for a steering control system, an acceleration control system, and a transmission control system to satisfy the vehicle's target driving trajectory, target speed, and driving stability conditions. At this time, the processor (120) may dynamically adjust the order and weight of the transmission of control commands by considering the characteristics of each control system and the current vehicle state. For example, if the vehicle's lateral stability is relatively low, it may be configured to transmit control commands for the steering control system first, and if longitudinal speed control is required, it may transmit control commands for the acceleration or braking control system subsequently.
[0083] In one embodiment, the processor (120) can calculate the control contribution for each control system by reflecting the driving environment and vehicle state, and distribute control commands based thereon. For example, the processor (120) can [calculate] the steering stability index , longitudinal velocity stability indicator , braking safety indicators and transmission suitability indicators Calculate and use the control command vector can be defined as follows (see Equation 7).
[0084] [Mathematical Formula 7]
[0085]
[0086] Here These are weights corresponding to steering, acceleration, braking, and transmission control systems, respectively, and can be set to be the same or different depending on the complexity of the driving environment, the stability of the vehicle state, or the autonomous driving operation policy. The processor (120) controls these control command vectors You can use this to determine how much control command to transmit to which control system.
[0087] In another embodiment, if the processor (120) determines that the autonomous driving is in a restricted state, it may reduce the scope of autonomous driving control and transmit control commands. For example, the processor (120) may generate control commands to maintain control commands for the steering control system and the braking control system, but to limit the size or frequency of control commands for the acceleration control system, or to limit the automatic transmission function for the transmission control system. Such control may be a control strategy to prioritize securing the driving stability of the vehicle without completely stopping autonomous driving.
[0088] Additionally, if the processor (120) determines that autonomous driving is not possible, it can generate a control command to disable autonomous driving control and transmit the control command to the braking control system first to induce the vehicle to decelerate or stop. At this time, the processor (120) can transmit a control command to the transmission control system to switch the vehicle to a safe gear state, and can transmit a control command to the steering control system to maintain only minimal stabilization control.
[0089] In one embodiment, the processor (120) can perform closed-loop control using control response information received from each control system after transmitting a control command to each control system. For example, the processor (120) can control a control command and the corresponding control response Compare with control error can be calculated, and this can be expressed as follows (see Equation 8).
[0090] [Mathematical Formula 8]
[0091]
[0092] The processor (120) has the above control error If the allowable range is exceeded, the control strategy can be dynamically changed to readjust the weights of control commands or to strengthen or restrict control over specific control systems. This control error-based correction process can be performed using externally observable control response information without directly accessing the internal control logic of each vehicle manufacturer.
[0093] In this way, as the processor (120) is configured to control the driving of a vehicle by transmitting a control command to at least one of the in-vehicle steering control system, acceleration control system, braking control system, and transmission control system, the driving of the vehicle can be effectively controlled using sensor data and vehicle status data without being dependent on the vehicle manufacturer, even for vehicles that have had autonomous driving functions added or modified based on existing conventional vehicles. Accordingly, autonomous driving control is possible without relying on data that is restricted from access or blacked out by manufacturer, and control status and operational status information generated during the process of transmitting and responding to control commands is linked to subsequent storage and external provision stages, allowing the vehicle status to be systematically managed on a vehicle-by-vehicle basis and over time. Furthermore, this structure enables the application of the same control logic not only to a single vehicle but also to an environment where multiple modified autonomous vehicles are operated simultaneously, thereby providing the effect of significantly improving the stability and management efficiency of autonomous vehicle operation.
[0094] In one embodiment, the processor (120) may be configured to generate autonomous driving control history information by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order.
[0095] Here, the autonomous driving control process may be a series of processes including recognizing the driving environment and vehicle state, determining whether to perform autonomous driving, generating control commands, and transmitting them to the vehicle control system, as previously described, and the processor (120) may systematically store key information generated throughout this process according to the flow of time.
[0096] Specifically, the processor (120) can store control command information generated for each control cycle together with control response information received from at least one of the vehicle's steering control system, acceleration control system, braking control system, and transmission control system in response to the control command. Additionally, the processor (120) stores autonomous driving operation state information, such as an autonomous driving enabled state, an autonomous driving restricted state, or an autonomous driving disabled state, in conjunction with the control command information and the control response information, thereby enabling clear tracking of which control was performed in which operation state the vehicle was in at a specific point in time.
[0097] In one embodiment, the processor (120) may configure a set of autonomous driving control history including time information. For example, the processor (120) may include control command information at each point in time. , control response information , autonomous driving operation status and time information These can be grouped into a single record to generate the following set of historical information (see Equation 9).
[0098] [Mathematical Formula 9]
[0099]
[0100] Here is control command information generated at the i-th time point, is control response information for the corresponding control command, indicates the autonomous driving operation status, may be a value indicating the time when the information occurred. The processor (120) has a set of such historical information. By storing it in chronological order, autonomous driving control history information can be systematically managed.
[0101] In another embodiment, the processor (120) may additionally calculate and store control error information to analyze the relationship between control command information and control response information. For example, the processor (120) controls the control command and control response Using the difference between them, the following control error values It can be calculated (see Equation 10).
[0102] [Mathematical Formula 10]
[0103]
[0104] The processor (120) has the above control error value By storing this as part of the autonomous driving control history information, it is possible to analyze over time how accurately control commands were reflected in the vehicle control system. This control error information can subsequently be used to correct control strategies, adjust criteria for determining whether to perform autonomous driving, or reset control command weights.
[0105] In one embodiment, the processor (120) may classify and store control history according to autonomous driving operation states. For example, by distinguishing and managing control history generated in an autonomous driving capable state, control history generated in an autonomous driving restricted state, and control history generated in an autonomous driving non-capable state, control characteristics and stability for each operation state can be compared and analyzed. Additionally, the processor (120) may set importance by assigning weights to this classified history information, and, for example, by assigning higher weights to control history that occurred in an autonomous driving restricted state or an autonomous driving non-capable state, history directly related to safety can be managed preferentially.
[0106] In this way, the processor (120) is configured to generate autonomous driving control history information by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order. Consequently, the entire process of autonomous driving control can be recorded as objective data without being dependent on the vehicle manufacturer, even for vehicles to which autonomous driving functions have been added or modified based on existing conventional vehicles. Accordingly, the operation status of the autonomous driving modified vehicle can be reliably identified without relying on data that is restricted from access by manufacturer or blacked out. Furthermore, the autonomous driving control history information is systematically managed according to vehicle units and time flow, facilitating the management of the operation history and status tracking of the autonomous driving modified vehicle. Moreover, this history information can be provided to external systems or user terminals, thereby providing the effect of significantly improving the stability and management efficiency of autonomous driving vehicle operation, not only in a single vehicle but also in an environment where multiple autonomous driving modified vehicles are operated simultaneously.
[0107] In one embodiment, the processor (120) may be configured to provide the autonomous driving control status to an external system (200) or a user terminal (300) in real time or periodically based on the generated autonomous driving control history information.
[0108] The autonomous driving control history information generated here may be information generated by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order as described above, and the processor (120) may use this history information as reference data for external provision.
[0109] Specifically, the processor (120) can provide information directly related to the current time point among the autonomous driving control history information to an external system (200) or a user terminal (300) in real time. For example, the processor (120) can provide in real time the autonomous driving control status indicating whether the vehicle is currently in an autonomous driving capable state, an autonomous driving restricted state, or an autonomous driving impossible state, as well as the type of control command being executed in that state and key control response information. Through this, the external system (200) or the user terminal (300) can immediately check the current autonomous driving control status of the vehicle.
[0110] Additionally, the processor (120) may periodically aggregate autonomous driving control history information and provide it to an external system (200) or a user terminal (300). In this case, the processor (120) may summarize or process the autonomous driving control history information according to preset time intervals or event conditions and provide it. For example, it may generate and provide summary information including the rate of autonomous driving performance over a certain period, the frequency of autonomous driving restriction or release, and the average error between control commands and control responses.
[0111] In one embodiment, the processor (120) may set the importance of externally provided information by assigning weights to each item included in the autonomous driving control history information. For example, a relatively high weight may be assigned to control history or control error history that occurred in a state where autonomous driving is not possible or history where the control error exceeded a certain standard, and a low weight may be assigned to control history that was performed normally in a state where autonomous driving is possible. Generalizing this, the processor (120) may provide the following provision priority indicators It can be calculated (see Equation 11).
[0112] [Mathematical Formula 11]
[0113]
[0114] Here may be a numerical value representing the autonomous driving operation state corresponding to the i-th history, and may be a value representing the error between the control command and the control response, and and It can be set with the same or different weights. The processor (120) provides these priority indicators Information to be provided to an external system (200) or user terminal (300) can be selected or highlighted using [this method].
[0115] In another embodiment, the processor (120) may divide autonomous driving control history information by time interval and provide it to an external system (200) or a user terminal (300). For example, the processor (120) may define a set of autonomous driving control history information corresponding to a recent certain time interval as follows (see Equation 12).
[0116] [Mathematical Formula 12]
[0117]
[0118] Here is a specific time interval It may be a subset containing autonomous driving control history information that occurred during that period. The processor (120) uses this history information by time interval to provide the trend of change in the autonomous driving control state to an external system (200) or a user terminal (300), thereby enabling the identification of changes in the autonomous driving operation state over time, going beyond simply providing the current state.
[0119] Additionally, the processor (120) can provide autonomous driving control history information generated for each vehicle to an external system (200) in an environment where multiple modified autonomous vehicles are operated simultaneously. In this case, the external system (200) can compare and analyze the autonomous driving control status of each vehicle according to the same criteria, and the processor (120) enables autonomous driving status management even in a multi-vehicle operation environment by providing the autonomous driving control status along with vehicle unit identification information.
[0120] In this way, as the processor (120) is configured to provide the autonomous driving control status to an external system (200) or user terminal (300) in real time or periodically based on the generated autonomous driving control history information, the autonomous driving control status can be reliably verified externally without being dependent on the vehicle manufacturer, even for vehicles to which autonomous driving functions have been added or modified based on existing general vehicles. Accordingly, the operational status of the autonomous driving modified vehicle can be accurately identified without relying on data that is restricted from access by manufacturer or blacked out, and the autonomous driving control history information is systematically managed according to vehicle units and time flow, facilitating the management of the operational history and status tracking of the autonomous driving modified vehicle. Furthermore, by implementing these information collection, management, and provision functions with a consistent system configuration, the present invention is applicable not only to a single vehicle but also to an environment where multiple autonomous driving modified vehicles are operated simultaneously, thereby providing the effect of significantly improving the stability and management efficiency of autonomous driving vehicle operation.
[0121] FIG. 4 is a flowchart illustrating an information monitoring method for collecting and managing status information of a vehicle with added autonomous driving functions according to an embodiment of the present invention.
[0122] Referring to FIG. 4, an information monitoring method for collecting and managing state information of a vehicle with added autonomous driving functions according to one embodiment of the present invention may include the following steps S1 to S5. However, it is not limited thereto, and other general steps may be further included in the information monitoring method.
[0123] The above information monitoring method may consist of steps processed chronologically in the aforementioned information monitoring system (100). Therefore, even if details are omitted below, the description of the information monitoring system (100) above may be equally applicable to the information monitoring method for collecting and managing status information of a vehicle with added autonomous driving functions, which will be described later.
[0124] In the above S1 step, the processor (120) can recognize the driving environment and vehicle status of the vehicle based on sensor data and vehicle status data collected from the vehicle with added autonomous driving functions.
[0125] In the above S2 step, the processor (120) can determine whether to perform autonomous driving based on the recognized driving environment and vehicle state.
[0126] In the above S3 step, the processor (120) can generate a control command for at least one of steering, acceleration, braking, and shifting based on the result of the judgment.
[0127] In the above S4 step, the processor (120) transmits a control command to the vehicle's control system to control the vehicle's driving, and can store control state and operation state information generated during the autonomous driving control process.
[0128] In the above S5 step, the processor (120) can provide the autonomous driving control state to an external system (200) or a user terminal (300) using the stored information.
[0129] Meanwhile, the information monitoring method performed by the information monitoring system (100) may be implemented in the form of a computer program stored on a computer-readable storage medium. That is, the computer program may include instructions for implementing the information monitoring method, and the instructions of the computer program may be stored on a computer-readable storage medium. The computer program may include a mobile application.
[0130] For example, computer-readable storage media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute computer program instructions, such as ROM, RAM, and flash memory. Computer program instructions may include machine code generated by a compiler and high-level language code that can be executed by a computer using an interpreter, etc.
[0131] As described above, although the present invention has been explained by limited embodiments and drawings, the present invention is not limited thereto, and it is obvious that various modifications and variations are possible within the scope of the technical spirit of the present invention and the equivalent scope of the claims described below by those skilled in the art to which the present invention belongs.
[0132] Meanwhile, although terms indicating directions such as up, down, left, right, front, and back have been used in this invention, these terms are used merely for convenience of explanation, and it is obvious to those skilled in the art that they may vary depending on the position of the object or the position of the observer. Explanation of the symbols
[0133] 100 : System 110 : Memory 120 : Processor 200 : External system 300 : User terminal
Claims
Claim 1 A memory configured to store instructions; and a processor configured to execute instructions stored in the memory to recognize the driving environment and vehicle state of a vehicle based on sensor data and vehicle state data collected from a vehicle with added autonomous driving functions, determine whether to perform autonomous driving based on the recognized driving environment and vehicle state, generate a control command for at least one of steering, acceleration, braking, and shifting according to the determination result, transmit the control command to a vehicle control system to control the driving of the vehicle, store control state and operation state information generated during the autonomous driving control process, and provide the autonomous driving control state to an external system or user terminal using the stored information, wherein the autonomous driving control process is a series of processes including recognizing the driving environment and vehicle state, determining whether to perform autonomous driving, generating a control command, and transmitting to a vehicle control system, wherein the processor is configured to generate autonomous driving control history information by storing control command information, control response information, and autonomous driving operation state information generated during the autonomous driving control process in chronological order, and wherein the processor comprises a set of autonomous driving control history including time information, and control command information at each point in time , control response information , autonomous driving operation status and time information Group them into a single record to generate a set of historical information as shown in Mathematical Formula 1 below, and [Mathical Formula 1] (Here is control command information generated at the i-th time point, is control response information for the corresponding control command, indicates the autonomous driving operation status, (is a value indicating the time when the relevant information occurred.) The above processor, the above history information set It stores in chronological order, additionally calculates and stores control error information to analyze the relationship between control command information and control response information, and control command information and control response information Using the difference between them, the control error value as shown in Equation 2 below Calculate and, [Mathematical Formula 2] The above processor, the above control error value It is configured to store as part of autonomous driving control history information and to provide the autonomous driving control status to an external system or user terminal in real-time or periodically based on the generated autonomous driving control history information, wherein the autonomous driving control history information is information generated by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order, and the processor sets the importance of the externally provided information by assigning a weight to each item included in the autonomous driving control history information, and the importance of the externally provided information is a provision priority indicator such as Equation 3 below. Calculated as, [Mathematical Formula 3] (Here is a numerical value representing the autonomous driving operation status corresponding to the i-th history, and is a value representing the error between the control command and the control response, and and are each and A weight assigned to, which is set to be the same or different.) Information monitoring system. Claim 2 An information monitoring system according to claim 1, wherein the processor is configured to recognize driving environment information including at least one of objects around the vehicle, road shape, lane information and drivable area from the sensor data, and to recognize vehicle state information including at least one of vehicle speed, steering state, acceleration state and braking state from the vehicle state data. Claim 3 In claim 1, the information monitoring system is configured such that the processor determines whether to perform autonomous driving by determining at least one of an autonomous driving possible state, an autonomous driving restricted state, and an autonomous driving impossible state based on the recognized driving environment and vehicle state. Claim 4 An information monitoring system according to claim 1, wherein the processor is configured to generate control commands for steering, acceleration, braking, and shifting when the result of determining whether to perform autonomous driving is determined to be in an autonomous driving possible state, and to generate control commands to limit or release autonomous driving control when the result is determined to be in an autonomous driving restricted state or an autonomous driving impossible state. Claim 5 In claim 1, the information monitoring system is configured to control the driving of a vehicle by transmitting the control command to at least one of a steering control system, an acceleration control system, a braking control system, and a transmission control system. Claim 6 delete Claim 7 delete Claim 8 An information monitoring method performed by an information monitoring system comprises: a step of recognizing a driving environment and vehicle state based on sensor data and vehicle state data collected from a vehicle with added autonomous driving functions; a step of determining whether to perform autonomous driving based on the recognized driving environment and vehicle state; a step of generating a control command for at least one of steering, acceleration, braking, and shifting according to the determination result; a step of transmitting the control command to a vehicle control system to control the driving of the vehicle and storing control state and operation state information generated during the autonomous driving control process; and a step of providing the autonomous driving control state to an external system or user terminal using the stored information, wherein the autonomous driving control process is a series of processes including recognizing a driving environment and vehicle state, determining whether to perform autonomous driving, generating a control command, and transmitting it to a vehicle control system, and wherein the information monitoring system is configured to generate autonomous driving control history information by storing control command information, control response information, and autonomous driving operation state information generated during the autonomous driving control process in chronological order, and wherein the information monitoring system constitutes a set of autonomous driving control history including time information, and control command information at each point in time , control response information , autonomous driving operation status and time information Group them into a single record to generate a set of historical information as shown in Mathematical Formula 1 below, and [Mathical Formula 1] (Here is control command information generated at the i-th time point, is control response information for the corresponding control command, indicates the autonomous driving operation status, (is a value indicating the time when the relevant information occurred.) The above information monitoring system comprises the above historical information set It stores in chronological order, additionally calculates and stores control error information to analyze the relationship between control command information and control response information, and control command information and control response information Using the difference between them, the control error value as shown in Equation 2 below Calculate and, [Mathematical Formula 2] The above information monitoring system, the above control error value It is configured to store [the information] as part of autonomous driving control history information and to provide the autonomous driving control status to an external system or user terminal in real-time or periodically based on the generated autonomous driving control history information, wherein the autonomous driving control history information is information generated by storing control command information, control response information, and autonomous driving operation status information generated during the autonomous driving control process in chronological order, and the information monitoring system sets the importance of the externally provided information by assigning a weight to each item included in the autonomous driving control history information, and the importance of the externally provided information is a provision priority indicator such as Equation 3 below. Calculated as, [Mathematical Formula 3] (Here is a numerical value representing the autonomous driving operation status corresponding to the i-th history, and is a value representing the error between the control command and the control response, and and are each and A weight assigned to, which is set to be the same or different.) Information monitoring method.
Citation Information
Patent Citations
System and method for supporting operation of autonomous vehicle
KR1020200071840A
Autonomous driving monitoring system
US20210078588A1
