Augmented sensing system and method for non-autonomous vehicle

The augmented sensing system addresses the challenge of automating military vehicles by using external sensors and a sensor fusion algorithm to provide precise environmental data for humanoid robots, enabling accurate driving decisions and flexible automation without structural modifications.

WO2026235358A1PCT designated stage Publication Date: 2026-11-12CROWDWORKS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2026/005892
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-09
Filing Date
2026-05-07
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Existing military vehicles, particularly internal combustion engine vehicles like military trucks, lack autonomous driving capabilities due to minimal electronic components and structural limitations, making it difficult and costly to integrate autonomous driving systems, and there is a need for a flexible and adaptable solution to enable automated operation.

Method used

An augmented sensing system comprising multiple external sensors, a sensor fusion system, and a robot interface unit that processes and integrates sensor data using a predetermined algorithm to provide precise environmental information for a humanoid robot to make driving decisions without modifying the vehicle structure.

Benefits of technology

Enables accurate driving decisions and automation of non-autonomous vehicles, including military trucks, by integrating sensor data through a sensor fusion algorithm, enhancing vehicle flexibility and safety in complex environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2026005892_12112026_PF_FP_ABST
    Figure KR2026005892_12112026_PF_FP_ABST
Patent Text Reader

Abstract

Provided are an augmented sensing system and method for a non-autonomous vehicle. The system comprises: a sensor system including a plurality of types of sensors mounted on the outside of a target vehicle; a sensor fusion system for generating integrated sensor data by processing and integrating a plurality of types of sensor data collected by the sensor system that uses the plurality of types of sensors according to a prescribed sensor fusion algorithm so as to be used for driving decision-making of a humanoid robot that drives the target vehicle; and a robot interface unit for transmitting the integrated sensor data generated by the sensor fusion system to a driving control unit of the humanoid robot.
Need to check novelty before this filing date? Find Prior Art

Description

Augmented sensing system and method for non-autonomous vehicles

[0001] The present invention relates to an augmented sensing system and method for a non-autonomous vehicle.

[0002] While the automation of vehicle driving is accelerating due to advancements in autonomous driving technology, a significant number of vehicles still operate without autonomous driving capabilities. In particular, conventional internal combustion engine vehicles, especially special-purpose vehicles such as military trucks, are manufactured with minimal electronic components, making it practically difficult to add autonomous driving functions. Military trucks are generally designed with minimized electronic control units to maintain reliability on the battlefield and maximize ease of maintenance, which consequently makes it challenging to directly apply autonomous driving systems. Furthermore, implementing autonomous driving functions by modifying existing military vehicles requires significant costs and structural changes, thus necessitating a more flexible and easily adaptable alternative.

[0003] To address these issues, research is currently being conducted on technology that uses humanoid robots to automatically drive existing military trucks. The method in which a humanoid robot sits in the driver's seat and operates the vehicle directly has the advantage of enabling automated operation without modifying the existing vehicle structure. However, this requires a sensing system that supports the humanoid robot in recognizing the external driving environment in real time and making appropriate driving decisions.

[0004] In particular, many vehicles currently in military operation are aging, making it structurally impossible to integrate them with autonomous driving systems or electronic control units, or difficult to apply due to technical limitations. Furthermore, during wartime or emergencies, there may be a shortage of skilled drivers, or a situation where the number of personnel capable of driving is absolutely insufficient compared to the number of vehicles.

[0005] Under these circumstances, a humanoid robot-based replacement system capable of driving in place of humans without modifying existing military vehicles is highly effective and holds significant strategic value. Reflecting this reality, a sensing system is required to enable the automated operation of existing non-autonomous vehicles, such as military trucks, with minimal modifications.

[0006] The problem that the present invention aims to solve is to provide an augmented sensing system and method for a non-autonomous vehicle.

[0007] The problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned problems will be clearly understood by a person skilled in the art from the description below.

[0008] A system according to one aspect of the present invention for solving the above-described problem comprises: a sensor system including a plurality of types of sensors mounted on the exterior of a target vehicle; a sensor fusion system that generates sensor integration data by processing and integrating a plurality of types of sensor data collected by the sensor system using the plurality of types of sensors according to a predetermined sensor fusion algorithm so as to be utilized for driving decision-making of a humanoid robot driving the target vehicle; and a robot interface unit that transmits the sensor integration data generated by the sensor fusion system to a driving control unit of the humanoid robot.

[0009] A method according to another aspect of the present invention for solving the above-described problem comprises, as a method performed by a computer system, a step of collecting a plurality of types of sensor data using a plurality of types of sensors mounted on the exterior of a target vehicle; a step of generating sensor integration data by processing and integrating the plurality of types of sensor data according to a predetermined sensor fusion algorithm so as to be utilized for driving decision-making of a humanoid robot driving the target vehicle; and a step of transmitting the sensor integration data to a driving control unit of the humanoid robot.

[0010] Other specific details of the present invention are included in the detailed description and drawings.

[0011] According to the present invention, a humanoid robot can assist in driving existing internal combustion engine vehicles, particularly vehicles such as military trucks that lack autonomous driving capabilities.

[0012] In addition, according to the present invention, the driving environment can be precisely recognized by utilizing an external sensor system without changing the structure of an existing vehicle, and the integrated data can be provided in a form that a humanoid robot can utilize through a sensor fusion algorithm, thereby increasing the flexibility of vehicle automation.

[0013] In addition, according to the present invention, even vehicles without separate autonomous driving functions can be automated with minimal modifications, and can be efficiently applied to special purpose vehicles such as military vehicles.

[0014] In addition, according to the present invention, by combining various types of sensors to more precisely recognize the environment around the vehicle, the humanoid robot can make more accurate driving decisions and ensure safety even in complex driving environments.

[0015] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below.

[0016] FIG. 1 is a schematic diagram illustrating the configuration of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0017] FIG. 2 is a schematic diagram illustrating sensor data collection of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0018] FIG. 3 is a schematic diagram illustrating the process of generating sensor integration data by processing and integrating a plurality of types of sensor data of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0019] FIG. 4 is a schematic diagram illustrating the process of generating sensor integrated data including a plurality of data processing blocks of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0020] FIG. 5 is a schematic diagram illustrating the connection between a robot interface unit of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention and a humanoid robot.

[0021] FIG. 6 is a schematic diagram illustrating the process of a humanoid robot performing driving operations of a target vehicle using sensor integration data transmitted by an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0022] FIG. 7 is a schematic diagram illustrating the configuration of an augmented sensing system for a non-autonomous vehicle according to another embodiment of the present invention.

[0023] FIG. 8 is a schematic diagram illustrating the configuration of an augmented sensing method for a non-autonomous vehicle according to another embodiment of the present invention.

[0024] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the present invention, and the present invention is defined only by the scope of the claims.

[0025] The terms used in this specification are for describing the embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other components in addition to the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and "and / or" includes each of the mentioned components and all combinations of one or more. Although terms such as "first," "second," etc., are used to describe various components, these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, the first component mentioned below may be the second component within the technical scope of the invention.

[0026] Unless otherwise defined, all terms used herein (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0027] In describing the present invention, detailed descriptions of related prior art are omitted if they are deemed obvious to a person skilled in the art and could unnecessarily obscure the essence of the invention.

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0029] FIG. 1 is a schematic diagram illustrating the configuration of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0030] Referring to FIG. 1, an augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention includes a sensor system (110), a sensor fusion system (120), and a robot interface unit (130).

[0031] The sensor system (110) includes a plurality of types of sensors mounted on the exterior of the target vehicle. The sensor system (110) may include, for example, a first sensor (111), a second sensor (112), a third sensor (113), and a fourth sensor (114) of different types, but is not limited thereto.

[0032] The first sensor (111), the second sensor (112), the third sensor (113), and the fourth sensor (114) may include, for example, one or more of a camera sensor, a distance measuring and environment recognition sensor, a location and movement related sensor, and various sensors for detecting the vehicle and road environment. The camera sensor may include, for example, an RGB camera, an infrared camera, a thermal imaging camera, and a stereo camera, but is not limited thereto. The distance measuring and environment recognition sensor may include a LiDAR sensor, an ultrasonic sensor, and a radar sensor, but is not limited thereto. The location and movement related sensor may include a GNSS (Global Navigation Satellite System) sensor, an Inertial Measurement Unit (IMU), a gyroscope, and an accelerometer, but is not limited thereto. The sensor for detecting the vehicle and road environment may include a sensor capable of recognizing, detecting, or collecting various data such as road markers, lanes, traffic lights, traffic signs, road surface conditions, air quality, and weather conditions. The sensors may be mounted on the target vehicle individually or in combination with each other.

[0033] Unlike what is shown in FIG. 1, the sensor system (110) may include various types and various numbers of sensors mounted at various locations on the target vehicle.

[0034] The sensor fusion system (120) is connected to the sensor system (110) and receives the plurality of types of sensor data from the sensor system (110). The sensor fusion system (120) processes and integrates the plurality of types of sensor data collected by the sensor system (110) using the plurality of types of sensors to generate sensor integration data.

[0035] The sensor fusion system (120) can efficiently process and integrate multiple types of sensor data collected by the sensor system (110) according to various sensor fusion algorithms well known in the technical field to which the present invention belongs.

[0036] Meanwhile, the sensor fusion system (120) may perform various controls for the augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention. The sensor fusion system (120) can control the sensor system (110) and the robot interface unit (130) in real time by transmitting control commands to them. The sensor fusion system (120) may receive various signals, data, or information from the sensor system (110) and the robot interface unit (130), and transmit various signals, data, or information to the sensor system (110) and the robot interface unit (130). Although not clearly illustrated in FIG. 1, the sensor fusion system (120) may be connected to the sensor system (110) and the robot interface unit (130) via wired, wireless, or a combination thereof.

[0037] The robot interface unit (130) is connected to the sensor fusion system (120). The robot interface unit (130) is also connected to an external humanoid robot (200).

[0038] Here, the humanoid robot (200) refers to a driving robot that directly drives a target vehicle. The humanoid robot (200) can be implemented with various specifications and configurations. Additionally, the humanoid robot (200) can be implemented in various forms depending on the type of target vehicle, driving environment, driving method, etc. As illustrated in FIG. 1, the humanoid robot (200) may be a complete humanoid robot having a body structure similar to a human (e.g., two arms and two legs). Alternatively, the humanoid robot (200) may be a partial humanoid robot having only a part of a body structure similar to a human, or a robot that does not follow a humanoid body structure and, for example, has a multi-joint robot arm.

[0039] Although the morphological characteristics of the humanoid robot (200) may vary, since the augmented sensing system (100) according to one embodiment of the present invention is intended for non-autonomous vehicles, it is assumed that the humanoid robot (200) operates the vehicle in the same manner as a human driver. That is, the humanoid robot (200) sits in the actual driver's seat just like a human driver and physically operates the steering wheel, pedals, transmission, etc.

[0040] The robot interface unit (130) transmits sensor integration data generated by the sensor fusion system (120) to the humanoid robot (200). As described below, a driving control unit is installed inside the humanoid robot (200). The sensor integration data is transmitted to the driving control unit inside the humanoid robot (200). The humanoid robot (200) can utilize the sensor integration data for driving decision-making when driving a target vehicle.

[0041] That is, an augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention transmits sensor integration data generated by processing and integrating a plurality of types of sensor data according to a predetermined sensor fusion algorithm to a humanoid robot (200) so that it can be utilized for driving decision-making of a humanoid robot (200) driving a target vehicle.

[0042] An augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention is basically applicable to a non-autonomous vehicle. For example, the target vehicle may be a completely non-autonomous vehicle with no autonomous driving function at all, such as a conventional internal combustion engine vehicle or an electric vehicle. Alternatively, the target vehicle may be a partially autonomous vehicle equipped with a partially autonomous driving function. Here, a partially autonomous vehicle refers to a vehicle with an autonomous driving level of Level 1 to Level 2, equipped with driving assistance functions such as automatic braking or speed control, or a vehicle capable of driving without driver intervention under specific conditions through partial automation.

[0043] In cases where the target vehicle is not equipped with a fully autonomous driving function, the augmented sensing system (100) generates sensor integration data in real time using the sensor fusion system (120) and provides it to the humanoid robot (200) so that the humanoid robot (200) can drive the vehicle in place of the driver.

[0044] Thus, non-autonomous vehicles can also be converted to autonomous driving capabilities through a combination of augmented sensing (100) and a humanoid robot (200). Additionally, even in the case of vehicles equipped with partially autonomous driving capabilities, the precision of driving decision-making can be improved by applying the augmented sensing system (100).

[0045] Below, the detailed operation of an augmented sensing system (100) for a non-autonomous vehicle is described based on the components shown in FIG. 1.

[0046] FIG. 2 is a schematic diagram illustrating sensor data collection of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0047] Referring to FIG. 2, an augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention includes a plurality of types of sensors and collects a plurality of types of sensor data using the plurality of types of sensors.

[0048] For example, the augmented sensing system (100) may include two or more sensors among camera sensors, radar sensors, and lidar sensors as multiple types of sensors.

[0049] For example, the first sensor (111) may be a camera sensor. The first sensor (111) may be mounted, for example, on the front of the target vehicle to collect and generate first sensor data regarding the road environment, pedestrians, vehicles, or obstacles in front of the target vehicle. The first sensor data may include image data or video data as the output of the camera sensor.

[0050] For example, the second sensor (112) may be a LiDAR sensor. The second sensor (112) may be mounted, for example, on the roof or center of the target vehicle to collect and generate second sensor data as omnidirectional data regarding the surrounding environment of the target vehicle. The second sensor (112) may be implemented as a rotary LiDAR sensor. Alternatively, the second sensor (112) may be implemented as a fixed LiDAR sensor to collect data regarding the surrounding environment in a specific direction of the target vehicle, for example, front, side, or rear. The second sensor (112) may be implemented as a 2D LiDAR sensor or a 3D LiDAR sensor. The second sensor data may include, for example, location data, distance data, or point cloud data as the output of the LiDAR sensor.

[0051] For example, the third sensor (113) may be a radar sensor. The third sensor (113) may be mounted, for example, on the rear of the target vehicle to collect and generate third sensor data regarding the rear road environment, pedestrians, vehicles, or obstacle information of the target vehicle. The third sensor (113) may be implemented, for example, as a short-range radar sensor, a long-range radar sensor, or a combination thereof. The third sensor data may include, for example, speed data or object detection data as the output of the radar sensor.

[0052] For example, the fourth sensor (114) may be a camera sensor. The third sensor (114) may be mounted, for example, on the side of the target vehicle to collect and generate fourth sensor data regarding the lateral environment of the target vehicle, pedestrians, vehicles, or obstacle information. The fourth sensor data may include image data or video data as the output of the camera sensor.

[0053] In FIG. 2, the reference numerals "11", "12", "13", and "14" schematically illustrate the sensing areas of the first sensor (111), the second sensor (112), the third sensor (113), and the fourth sensor (114), respectively.

[0054] An augmented sensing system (100) according to one embodiment of the present invention can precisely detect the surrounding environment through various sensors placed on the front, side, rear, and top of the vehicle. Through this, it performs the role of assisting a humanoid robot (200) to safely drive the vehicle even if the target vehicle does not possess autonomous driving capabilities.

[0055] FIG. 3 is a schematic diagram illustrating the process of generating sensor integration data by processing and integrating a plurality of types of sensor data of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0056] Referring to FIG. 3, a sensor fusion system (120) of an augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention receives various types of sensor data (first sensor data, second sensor data, third sensor data, fourth sensor data) from various types of sensors (first sensor (111), second sensor (112), third sensor (113), fourth sensor (114)), and applies a predetermined sensor fusion algorithm to process the sensor data in an integrated manner to generate sensor integrated data that can be utilized by a humanoid robot (200).

[0057] The sensor fusion system (120) can generate sensor integration data containing more reliable driving environment information by comparing and analyzing the collected first sensor data, second sensor data, third sensor data, and fourth sensor data. To this end, the sensor fusion system (120) applies a predetermined sensor fusion algorithm to improve data accuracy and enables the sensor integration data to be utilized in driving decision-making of the humanoid robot (200).

[0058] For example, the sensor fusion system (120) can perform sensor data synchronization and alignment. Since each sensor collects data at different time intervals, the sensor fusion system (120) can perform timestamp synchronization for each sensor data. In addition, the sensor fusion system (120) can perform coordinate transformation to convert sensor data collected from different sensors into a common coordinate system.

[0059] For example, the sensor fusion system (120) can perform sensor data filtering and preprocessing. The sensor fusion system (120) can remove noise within the sensor data, such as removing camera image blur and filtering lidar reflection signals. Additionally, the sensor fusion system (120) can perform anomaly detection and removal, such as correcting errors in lidar sensor data or correcting false object detection.

[0060] For example, the sensor fusion system (120) can integrate sensor data by applying the following sensor fusion algorithm. The sensor fusion system (120) can fuse sensor data based on the reliability of information provided by camera sensors, lidar sensors, and radar sensors using a probabilistic sensor fusion algorithm. At this time, the sensor fusion system (120) can apply a Bayesian filter, a Kalman filter, etc. Alternatively, the sensor fusion system (120) can combine various sensor data based on an artificial intelligence model using a deep learning-based sensor fusion algorithm. To this end, the sensor fusion system (120) can utilize various artificial intelligence models such as a Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM). Alternatively, the sensor fusion system (120) can perform sensor data integration by physically analyzing the movement of an object and correcting the sensor data using a physics-based sensor fusion algorithm. The sensor fusion system (120) can apply candesian coordinate transformation, dynamic object tracking algorithms, etc.

[0061] The sensor fusion system (120) can generate sensor integration data including real-time integrated driving environment information through the various processes described above.

[0062] The sensor fusion system (120) is connected to the robot interface unit (130) and can transmit sensor integration data to the robot interface unit (130).

[0063] The sensor fusion system (120) can transmit sensor integration data to the humanoid robot (200) in real time via wired or wireless communication. The sensor fusion system (120) can compress the data and optimize the data size so that the humanoid robot (200) can process the data smoothly. Additionally, the sensor fusion system (120) can generate and transmit sensor integration data by integrating the driving environment information, removing unnecessary information, and including only the core data necessary for the driving decision of the humanoid robot (200). At this time, the sensor fusion system (120) can consider the type, number, and role of the sensors internally contained in the humanoid robot (200).

[0064] FIG. 4 is a schematic diagram illustrating the process of generating sensor integrated data including a plurality of data processing blocks of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0065] Referring to FIG. 4, a sensor fusion system (120) of an augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention may include a plurality of data processing blocks for sensor fusion. For example, the sensor fusion system (120) may include a sensor data processing block (121), a sensor data integration block (122), a feature extraction block (123), and a model analysis block (124). Each of the blocks (121, 122, 123, 124) performs the role of generating sensor integration data in a format suitable for driving decision-making of a humanoid robot (200) by performing refinement, integration, unique feature extraction, and final analysis of sensor data.

[0066] For example, the sensor data processing block (121) performs the role of preprocessing raw sensor data collected from each sensor and converting it into an analyzable state. The sensor data processing block (121) can perform noise removal of camera sensor data, such as removing lighting changes; noise removal of lidar sensor data, such as filtering signal reflection noise; and noise removal of radar sensor data, such as removing signal interference and false object detection. The sensor data processing block (121) can perform synchronization of each sensor data collected at different time intervals, coordinate alignment and normalization, etc., to unify the data coordinate systems of the camera sensor, lidar sensor, and radar sensor and convert them so that they can be analyzed within the same framework.

[0067] For example, the sensor data integration block (122) performs the role of enabling more precise recognition of the surrounding environment by combining sensor data obtained from different sensors. The sensor data integration block (122) can perform multi-sensor data matching to perform object recognition by combining camera images and LiDAR data. Alternatively, the sensor data integration block (122) can perform sensor data supplementation and reliability evaluation by utilizing other sensor data to correct when specific sensor data is incomplete or lost. Alternatively, the sensor data integration block (122) can utilize multi-layered sensor fusion, such as initial-level integration that combines sensor data at the raw data stage, intermediate-level integration that combines information at the object detection stage, and advanced-level integration that generates an optimal driving strategy at the decision-making stage. Through the above process, the sensor data integration block can generate more reliable sensor integration data.

[0068] For example, the feature extraction block (123) can perform the role of analyzing meaningful features from sensor integration data to select only the information necessary for driving decision-making of the humanoid robot (200). The feature extraction block (123) can identify environmental elements necessary for driving the target vehicle, such as lanes, road signs, traffic lights, pedestrians, and surrounding vehicles. The feature extraction block (123) can perform object detection and analysis, such as determining the distance, speed, and direction of movement of pedestrians, surrounding vehicles, and obstacles. In addition, the feature extraction block (123) can perform road condition and traffic flow prediction, such as vehicle flow analysis and signal change prediction. The feature extraction block (123) enables the extraction of only the most important core information for driving decision-making of the humanoid robot (200) from the sensor integration data.

[0069] For example, the model analysis block (124) can perform the role of analyzing driving patterns and generating an optimal driving strategy by applying an artificial intelligence model and algorithm based on feature data extracted by the feature extraction block (123). The model analysis block (124) can perform image-based object recognition using a deep learning-based prediction model, for example, using a Convolutional Neural Network (CNN), or perform traffic flow prediction and driving path determination using a Long Short-Term Memory (LSTM). The model analysis block (124) can execute algorithms for risk avoidance and collision prevention, such as obstacle avoidance and emergency braking judgment. The model analysis block (124) can generate an optimal driving path based on the current vehicle's location, speed, and road conditions, including a driving decision model.

[0070] Sensor integration data including the analysis results by the model analysis block (124) is finally transmitted to the driving control unit of the humanoid robot (200), thereby enabling actual vehicle operation by the humanoid robot (200). At this time, the sensor fusion system (120) can generate sensor integration data in a format corresponding to the driving decision of the humanoid robot (200).

[0071] FIG. 5 is a schematic diagram illustrating the connection between a robot interface unit of an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention and a humanoid robot.

[0072] Referring to FIG. 5, the robot interface part (130) of the augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention can be connected to a humanoid robot (200) via a wire.

[0073] The robot interface unit (130) and the humanoid robot (200) are connected to each other via a physical cable or connector and can transmit and receive data. The robot interface unit (130) and the humanoid robot (200) can be connected to each other using various wired interfaces, such as USB (Universal Serial Bus), Ethernet, PCIe (Peripheral Component Interconnect Express) as a high-speed data transmission cable, CAN (Controller Area Network) bus, RS-232, RS-485, SPI (Serial Peripheral Interface) as a serial or parallel communication cable, and M12, M8, Pogo pins as a connector capable of power and data transmission. Through the wired connection, the robot interface unit (130) and the humanoid robot (200) can transmit and receive data with low latency and high reliability.

[0074] As shown in the example illustrated in FIG. 5, the robot interface part (130) may include a connecting cable (131) and a connecting connector (132).

[0075] The connecting cable (131) has a fixed length and may include one or more communication lines for transmitting sensor integration data generated by the sensor fusion system (120) to the humanoid robot (200). The connecting cable (131) may be implemented in various types to increase the data transmission method and reliability.

[0076] A connection connector (132) can be formed at the end of the connection cable (131) facing the humanoid robot (200). The connection connector (132) can be implemented in a form corresponding to a connector formed on the outer surface of the humanoid robot (200). By connecting the two connectors, for example, male and female, a communication line capable of transmitting and receiving data can be secured. Depending on the connection method, the connection connector (132) can support various interfaces such as a physical connection type, a magnetic connection type, or a dustproof / waterproof type. The connection connector (132) can perform the role of supplying power to the humanoid robot (200) in addition to simple data transmission.

[0077] Alternatively, unlike as illustrated in FIG. 5, the robot interface part (130) of the augmented sensing system (100) for a non-autonomous vehicle according to one embodiment of the present invention and the humanoid robot (200) may be wirelessly connected.

[0078] If the humanoid robot (200) needs to be physically separated from the target vehicle, the robot interface unit (130) and the humanoid robot (200) may be connected to each other using wireless communication technology. The robot interface unit (130) and the humanoid robot (200) can be connected to each other without physical constraints using various wireless communication methods such as, for example, Wi-Fi, Bluetooth, Zigbee, Z-Wave, LoRa, 5G, LTE, V2X (Vehicle-to-Everything) communication.

[0079] The robot interface unit (130) and the humanoid robot (200) may be connected via wired, wireless, or a combination thereof.

[0080] FIG. 6 is a schematic diagram illustrating the process of a humanoid robot performing driving operations of a target vehicle using sensor integration data transmitted by an augmented sensing system for a non-autonomous vehicle according to one embodiment of the present invention.

[0081] Referring to FIG. 6, the humanoid robot (200) performs driving operations of the target vehicle using sensor integration data transmitted through the robot interface part (130) of the augmented sensing system (110).

[0082] As a configuration for driving operation of a target vehicle, the humanoid robot (200) may include an internal sensor system (210), a driving control unit (220), and an actuator unit (230).

[0083] The internal sensor system (210) includes one or more sensors equipped by the humanoid robot (200). The internal sensor system (210) detects the state of the humanoid robot (200) and performs the role of collecting environmental data necessary during operation.

[0084] The internal sensor system (210) may include various types of sensors, such as an IMU sensor, a gyroscope, an accelerometer, a 3D vision camera sensor, an RGB-D camera sensor, a proximity sensor, a force sensor, a voice recognition sensor, etc.

[0085] The internal sensor system (210) is not basically a sensor specialized for driving a vehicle, but is designed to perform various functions that mimic human physical activities, such as controlling the robot's posture, maintaining balance, and performing specific movements, so it is necessary to connect with the augmented sensing system (100) according to one embodiment of the present invention.

[0086] The driving control unit (220) performs decision-making for driving the target vehicle. This decision-making is referred to as "driving decision-making" in this specification. The driving control unit (220) performs optimal decision-making by analyzing various data received from the outside.

[0087] The driving control unit (220) is connected to the internal sensor system (210) and can receive internal sensor data from the internal sensor system (210). The internal sensor data may include, for example, sensor data regarding the movement of the humanoid robot (200), changes in posture, operation status of the steering wheel, pedals, transmission, etc., and the internal environment of the vehicle, but is not limited thereto.

[0088] Additionally, the driving control unit (220) is connected to the robot interface unit (130) of the augmented sensing system (100) and can receive sensor integration data from the robot interface unit (130). The sensor integration data may include, for example, data regarding the external environment of the vehicle, road and surrounding vehicle information, pedestrian information, obstacle information, etc., but is not limited thereto.

[0089] The driving control unit (220) may make driving decisions based on sensor integration data or a combination of internal sensor data and said sensor integration data. Alternatively, the driving control unit (220) may include one or more pre-trained artificial intelligence driving models or algorithms and may make driving decisions based further on said models or algorithms. The driving control unit (220) may make various driving decisions, such as lane keeping, lane changing, speed control, braking decision, turning decision, direction change decision, driving strategy decision after recognizing traffic lights and traffic signs, collision avoidance, emergency braking, and emergency situation response.

[0090] The driving control unit (220) can generate driving operation commands corresponding to driving decision-making. The driving control unit (220) transmits driving operation commands to the actuator unit (230) to enable the target vehicle operation to be performed.

[0091] The actuator unit (230) represents a driving unit that realizes the movement of the humanoid robot (200). The actuator (230) is connected to the driving control unit (220) and can receive driving operation commands from the driving control unit (220). The actuator (230) drives the vehicle by physically operating the actual steering wheel, pedals, transmission, etc. of the target vehicle according to the driving operation commands. The actuator (230) implements the body movements of the humanoid robot (200) according to the driving operation commands. For example, the arms and hands of the humanoid robot (230) can perform roles such as operating the steering wheel of the target vehicle, shifting gears, and operating buttons or switches. For example, the legs and feet of the humanoid robot (230) can perform roles such as operating the accelerator pedal, brake pedal, clutch, etc. of the target vehicle. To this end, the actuator section (230) may include various actuators such as a multi-joint robot arm, a multi-joint structure, a mechanical gripper, an electric servo motor, an electric motor, a reduction gear, and a hydraulic, pneumatic, or electric drive type.

[0092] Up to this point, the configuration of an augmented sensing system for a non-autonomous vehicle according to an embodiment of the present invention has been described with reference to FIGS. 1 to 6. The augmented sensing system (100) for a non-autonomous vehicle according to an embodiment of the present invention may further include various other components not shown in FIGS. 1 to 6, or may not include some of the components shown in FIGS. 1 to 6.

[0093] FIG. 7 is a schematic diagram illustrating the configuration of an augmented sensing system for a non-autonomous vehicle according to another embodiment of the present invention.

[0094] Referring to FIG. 7, an augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention includes a processor (410), memory (420), storage (430), sensor system (440), robot interface unit (450), input unit (460), output unit (470), and communication unit (480).

[0095] A processor (410) performs general control of an augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention. The processor (410) can control other components within the system (400), such as memory (420), storage (430), sensor system (440), robot interface unit (450), input unit (460), output unit (470), and communication unit (480). The processor (410) may be implemented by including a CPU (Central Processing Unit), MPU (Micro Processor Unit), MCU (Micro Controller Unit), GPU (Graphic Processing Unit), or various types of processors well known in the art to which the present invention belongs. The processor (410) can perform various operations by executing one or more instructions or computer programs stored in memory (420). The processor (410) can generate sensor integration data by executing various sensor fusion algorithms described with reference to FIGS. 3 and 4 to process and integrate various types of sensor data received from the sensor system (440). The processor (410) may also control an augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention in accordance with a control command from a user terminal (not shown) or an administrator terminal (not shown) received through the communication unit (480).

[0096] The memory (420) stores one or more instructions, computer programs, data or information, etc. for the operation of an augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention. For example, the memory (420) may include RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or various forms of computer-readable recording media well known in the art to which the present invention belongs.

[0097] Storage (430) is a non-volatile storage device for storing and managing data of an augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention, and operates in conjunction with memory (420) to efficiently process and store data. Storage (430) can store large amounts of data, configuration information, system logs, user input data, and other related data. Storage (430) may include a Hard Disk Drive (HDD), a Solid State Drive (SSD), an embedded Multi-Media Card (eMMC), a Non-Volatile Memory Express (NVMe), or various storage devices widely known in the technical field to which the present invention belongs.

[0098] The sensor system (440) includes a plurality of types of sensors mounted on the exterior of the target vehicle. The sensor system (440) may include various types and a variety of numbers of sensors mounted at various locations on the target vehicle. The sensor system (440) may collect multiple types of sensor data using the plurality of types of sensors.

[0099] The robot interface unit (450) is connected to the humanoid robot (200) via a wired, wireless, or a combination thereof. The robot interface unit (450) transmits sensor integration data generated by the processor (410) to the humanoid robot (200).

[0100] The input unit (460) may include a camera for inputting video signals, a microphone for receiving audio signals, and various input units for receiving information from a user. Image data or voice data collected by the input unit (460) may be analyzed and processed into user commands. The input unit (460) may include mechanical input means or touch input means.

[0101] The output unit (470) may include one or more of a display unit, an acoustic output unit, a haptic module, and an optical output unit for generating outputs related to sight, hearing, or touch.

[0102] The communication unit (480) may include a wired communication unit, a wireless communication unit, or a combination thereof. The wireless communication unit may include, for example, one or more of a mobile communication module, a wireless internet module, or a short-range communication module. The mobile communication module may transmit and receive wireless signals with at least one of a base station, an external terminal, or a server on a mobile communication network built according to technical standards or communication methods for mobile communication. The wireless internet module may transmit and receive wireless signals on a communication network according to wireless internet technologies. The short-range communication module is for short-range communication and may support short-range communication using at least one of Bluetooth, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies.

[0103] Up to this point, the configuration of an augmented sensing system for a non-autonomous vehicle according to another embodiment of the present invention has been described with reference to FIG. 7. The augmented sensing system (400) for a non-autonomous vehicle according to another embodiment of the present invention may include various other components not shown in FIG. 7, or may not include some of the components shown in FIG. 7.

[0104] Hereinafter, with reference to FIG. 8, an augmented sensing method for a non-autonomous vehicle according to an embodiment of the present invention will be described.

[0105] The augmented sensing method for a non-autonomous vehicle according to an embodiment of the present invention may be performed by an augmented sensing system for a non-autonomous vehicle according to some embodiments of the present invention described with reference to FIGS. 1 to 7, but is not limited thereto. The augmented sensing method for a non-autonomous vehicle according to an embodiment of the present invention may also be performed by any computer system.

[0106] FIG. 8 is a schematic diagram illustrating the configuration of an augmented sensing method for a non-autonomous vehicle according to another embodiment of the present invention.

[0107] For the sake of convenience of explanation, detailed explanations regarding content that overlaps with the content explained with reference to FIGS. 1 to 7 are omitted.

[0108] Referring to FIG. 8, in step S510, the computer system collects multiple types of sensor data using multiple types of sensors mounted on the exterior of the target vehicle. The target vehicle may be a conventional internal combustion engine vehicle without autonomous driving capabilities. The multiple types of sensors may include two or more sensors among camera sensors, radar sensors, and lidar sensors.

[0109] Next, in step S520, the computer system processes and integrates the plurality of types of sensor data according to a predetermined sensor fusion algorithm to generate sensor integration data so that it can be utilized for driving decision-making of the humanoid robot driving the target vehicle. At this time, the computer system can generate the sensor integration data in a format corresponding to the driving decision-making of the humanoid robot.

[0110] Subsequently, in step S530, the computer system transmits the sensor integration data to the driving control unit of the humanoid robot. The humanoid robot can perform driving operations of the target vehicle using the sensor integration data transmitted to the driving control unit.

[0111] According to an embodiment of the present invention, a humanoid robot can assist in driving existing internal combustion engine vehicles, particularly military trucks that lack autonomous driving capabilities. Furthermore, by utilizing an external sensor system to precisely perceive the driving environment without altering the structure of the existing vehicle, and by providing integrated data through a sensor fusion algorithm in a form that the humanoid robot can utilize, the flexibility of vehicle automation can be increased. Additionally, even vehicles without separate autonomous driving capabilities can be automated with minimal modifications, and can be efficiently applied to special-purpose vehicles such as military vehicles. Moreover, by combining various types of sensors to more precisely perceive the environment surrounding the vehicle, the humanoid robot can make more accurate driving decisions and ensure safety even in complex driving environments.

[0112] The methods described in connection with embodiments of the present invention may be implemented as a computer program and stored on a computer-readable recording medium. A computer program stored on a computer-readable recording medium may be combined with a computing device to execute the methods described above.

[0113] In some embodiments of the present invention, devices or systems may, depending on the embodiment of the present invention, have a function performed by one function block performed by a plurality of function blocks, or have functions performed by a plurality of function blocks performed by one function block.

[0114] The steps of the methods according to some embodiments of the present invention may be further divided into additional steps or combined into fewer steps, depending on the embodiment of the present invention. Additionally, some steps may be omitted as necessary, and the order of the steps may be changed.

[0115] The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. The software module may reside in RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0116] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without altering its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.

Claims

1. A sensor system comprising a plurality of types of sensors mounted on the exterior of a target vehicle; A sensor fusion system that generates sensor integration data by processing and integrating multiple types of sensor data collected by the sensor system using the multiple types of sensors according to a predetermined sensor fusion algorithm so as to be utilized for driving decision-making of a humanoid robot driving the target vehicle; and A robot interface unit that transmits sensor integration data generated by the sensor fusion system to the driving control unit of the humanoid robot, Augmented sensing system for non-autonomous vehicles.

2. In Paragraph 1, The above plurality of types of sensors include two or more sensors among camera sensors, radar sensors, and lidar sensors. Augmented sensing system for non-autonomous vehicles.

3. In Paragraph 1, The sensor fusion system generates the sensor integration data in a format corresponding to the driving decision of the humanoid robot. Augmented sensing system for non-autonomous vehicles.

4. In Paragraph 1, The humanoid robot performs driving operations of the target vehicle using the sensor integration data transmitted to the driving control unit. Augmented sensing system for non-autonomous vehicles.

5. In Paragraph 1, The above-mentioned target vehicle is a conventional internal combustion engine vehicle without autonomous driving capabilities, Augmented sensing system for non-autonomous vehicles.

6. A method performed by a computer system, A step of collecting multiple types of sensor data using multiple types of sensors mounted on the exterior of a target vehicle; A step of generating sensor integration data by processing and integrating the plurality of sensor data according to a predetermined sensor fusion algorithm so as to be utilized for driving decision-making of a humanoid robot driving the target vehicle; and A method comprising the step of transmitting the above sensor integration data to the driving control unit of the humanoid robot. Augmented sensing method for non-autonomous vehicles.

7. In Paragraph 6, The above plurality of types of sensors include two or more sensors among camera sensors, radar sensors, and lidar sensors. Augmented sensing method for non-autonomous vehicles.

8. In Paragraph 1, The step of generating the sensor integration data comprises generating the sensor integration data in a format corresponding to the driving decision of the humanoid robot. Augmented sensing method for non-autonomous vehicles.

9. In Paragraph 6, The humanoid robot performs driving operations of the target vehicle using the sensor integration data transmitted to the driving control unit. Augmented sensing method for non-autonomous vehicles.

10. In Paragraph 6, The above-mentioned target vehicle is a conventional internal combustion engine vehicle without autonomous driving capabilities, Augmented sensing method for non-autonomous vehicles.