Sensor integration module for detecting information inside a vehicle and method of operating the same

Abstract

A sensor integration module for detecting information inside a vehicle and an operating method thereof are provided. The sensor integration module includes a first sensor enabled based on first operation information and providing a sensing result as first sensing information, a second sensor enabled based on second operation information and providing a sensing result as second sensing information, a first communication device transmitting and receiving information with an electronic device in the vehicle, and a controller generating the first operation information and the second operation information for selectively enabling the first sensor and the second sensor based on information provided from the first communication device, and providing a result determined based on the first sensing information and the second sensing information to the first communication device.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2020-0145552, filed with the Korean Intellectual Property Office on November 3, 2020, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a sensor integration module for detecting the interior of a vehicle and a method of operating the same. Background Technology

[0004] With technological advancements, various sensors and electronic devices have been installed in vehicles to enhance user convenience. Specifically, research into Advanced Driver Assistance Systems (ADAS) has been actively pursued to improve driving experience. Furthermore, autonomous vehicles are also under active development.

[0005] In addition to improving driving convenience for users, we have also actively developed convenience devices related to user safety, vehicle safety, vehicle theft, and vehicle accidents.

[0006] The large number of these convenience devices installed in vehicles has caused problems with vehicle power consumption. Summary of the Invention

[0007] This disclosure aims to address the aforementioned problems in the prior art while maintaining the advantages achieved by the prior art.

[0008] One aspect of this disclosure provides a sensing integration module for detecting information inside a vehicle to maintain convenient functions for user operation of the vehicle while reducing power consumption. Another aspect of this disclosure provides a method of operating the module.

[0009] The technical problems to be solved by this disclosure are not limited to those described above. Any other technical problems not mentioned herein should be clearly understood by those skilled in the art from the following description.

[0010] According to one aspect of this disclosure, a sensor integration module for detecting information inside a vehicle may include a first sensor, which is determined to be enabled or disabled based on first operational information and provides a sensing result as first sensing information. The sensor integration module may also include a second sensor, which is determined to be enabled or disabled based on second operational information and provides a sensing result as second sensing information. The sensor integration module may also include a first communication device that transmits and receives information using electronic devices in the vehicle. The sensor integration module may further include a controller that generates first operational information and second operational information for selectively enabling the first and second sensors based on information provided from the first communication device. The controller also provides the result determined based on the first and second sensing information to the first communication device.

[0011] According to another aspect of this disclosure, a method for operating a sensor integration module for detecting information inside a vehicle may include identifying driver occupancy, driving, exiting the vehicle, parking, intrusion detection, and vehicle accident situations. The method may further include selectively activating a first sensor and a second sensor based on the identification results, and receiving sensing information provided by the selectively activated first and second sensors. The method may also include: informing a passenger that they are not wearing a seatbelt based on the provided sensing information; executing a command corresponding to the passenger's posture; determining whether there are remaining passengers; determining whether there is an intrusion; determining whether there is an intruder; determining the location and movement of the intruder; determining whether there are passengers; and / or determining the location and movement of passengers. Attached Figure Description

[0012] The above and other objects, features and advantages of this disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings:

[0013] Figure 1 This is a block diagram illustrating the configuration of a sensor integration module for detecting information inside a vehicle according to an embodiment of the present disclosure;

[0014] Figure 2 This is a diagram illustrating the arrangement of a sensor integration module for detecting information inside a vehicle according to an embodiment of the present disclosure;

[0015] Figure 3 This is a table illustrating the functionality of a sensor integration module for detecting information inside a vehicle according to embodiments of the present disclosure; and

[0016] Figure 4 , Figure 5 , Figure 6 , Figure 7 and Figure 8This is a flowchart illustrating the operation of a sensor integration module for detecting information inside a vehicle according to an embodiment of the present disclosure. Detailed Implementation

[0017] Some embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. When adding reference numerals to components in each drawing, it should be noted that the same numerals are used to denote components that are shown as identical or equivalent components in other drawings. Furthermore, in describing embodiments of the present disclosure, detailed descriptions of well-known features or functions have been omitted to avoid unnecessarily obscuring the spirit of the disclosure.

[0018] In describing components according to embodiments of this disclosure, terms such as first, second, "A", "B", (a), (b), etc., may be used. These terms are used only to distinguish one component from another. These terms do not limit the nature, order, or sequence of the constituent components. Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. Terms such as those defined in generally used dictionaries should be interpreted as having a meaning consistent with the context of the relevant technical field. These terms should not be interpreted as having an ideal or overly formal meaning unless expressly defined as having such a meaning in this application. When a component, device, element, etc., of this disclosure is described as having a purpose or performing an operation, function, etc., the component, device, or element should be considered herein as being "configured" to satisfy that purpose or perform that operation or function.

[0019] The following will refer to Figures 1 to 8 The embodiments of this disclosure are described in detail.

[0020] Figure 1 This is a block diagram illustrating the configuration of a sensor integration module for detecting information inside a vehicle according to an embodiment of the present disclosure.

[0021] Reference Figure 1 The sensor integration module 100 for detecting information inside a vehicle according to embodiments of the present disclosure can be implemented in a vehicle. In this case, the sensor integration module 100 for detecting information about the vehicle interior can be integrated with a control unit in the vehicle, or it can be implemented as a separate device connected to the control unit of the vehicle via a separate connection device.

[0022] Reference Figure 1 According to embodiments of the present disclosure, a sensor integration module 100 for detecting the interior of a vehicle may include a first sensor 11, a second sensor 12, a third sensor 13, a controller 20, a first communication device 31, and a second communication device 32.

[0023] Each of the first sensor 11 and the second sensor 12 may include a sensor capable of sensing at least one of the following: whether there are passengers in the vehicle, the location of the passengers, and the movements of the passengers.

[0024] For example, the first sensor 11 may include radar.

[0025] Radar can emit electromagnetic waves and receive electromagnetic waves reflected from objects to generate sensing information, such as the presence of an object, the object's location, and the distance to the object.

[0026] The first sensor 11, including the radar, can be enabled or disabled based on the first operation information R_on. The enabled first sensor 11 can emit electromagnetic waves into the detection area and can generate first sensing information R_s based on the reflected electromagnetic waves.

[0027] The second sensor 12 may include an ultrasonic sensor.

[0028] Ultrasonic sensors can emit ultrasonic waves and receive ultrasonic waves reflected from objects to generate sensing information, such as the presence of an object, the object's location, and its distance from the object.

[0029] The second sensor 12, including the ultrasonic sensor, can be enabled or disabled based on the second operation information U_on. The enabled second sensor 12 can emit ultrasonic waves toward the detection area and can generate second sensing information U_s based on the reflected ultrasonic waves.

[0030] Radar can consume more power than ultrasonic sensors, but it can have a higher sensing resolution over a detection area. On the other hand, ultrasonic sensors may have a lower sensing resolution over a detection area than radar, but they may consume less power.

[0031] Therefore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of this disclosure may include techniques for using ultrasonic sensors while continuing to detect the detection area (i.e., the vehicle interior). In another embodiment, the sensor integration module 100 may include techniques for using both ultrasonic sensors and radar, or using radar alone, when a specific event occurs or when power supply to the vehicle interior is not a concern.

[0032] In the following text, the first sensor 11 is described as a radar and the second sensor 12 is described as an ultrasonic sensor, but are not limited thereto.

[0033] The third sensor 13 may include an inertial sensor capable of sensing conditions such as vehicle tilting, swaying, or collision.

[0034] For example, the third sensor 13, which includes an inertial sensor, can sense the vehicle's tilt, sway, collision, etc., to generate third sensing information I_s.

[0035] In the following text, the third sensor 13 is described as an inertial sensor, but is not limited thereto.

[0036] The controller 20 can provide first operating information R_on and second operating information U_on to the radar 11 and the ultrasonic sensor 12 to determine whether to enable the radar 11 and the ultrasonic sensor 12. The controller 20 can receive first sensing information R_s and second sensing information U_s from the radar 11 and the ultrasonic sensor 12.

[0037] The controller 20 can receive third sensing information I_s from the inertial sensor 13.

[0038] The controller 20 can use the first communication device 31 to send and receive first communication information CA.

[0039] The controller 20 can use the second communication device 32 to send and receive second communication information CB.

[0040] For example, when the vehicle is in motion, the controller 20 can detect the opening of the door and the start of the vehicle based on the first communication information CA provided from the first communication device 31, and can generate the first operation information R_on to enable the radar 11.

[0041] When radar 11 is activated, controller 20 can determine whether there is a passenger, the passenger's location, and the passenger's actions based on the first sensing information R_s provided by radar 11. Controller 20 can then provide the determined results as first communication information CA to the first communication device 31.

[0042] When the vehicle is detected to be off based on the first communication information CA provided by the first communication device 31, the controller 20 can generate both the first operation information R_on and the second operation information U_on within a predetermined time to simultaneously enable the radar 11 and the ultrasonic sensor 12.

[0043] The controller 20 can determine whether there are passengers in the vehicle based on first sensing information R_s and second sensing information U_s provided by the radar 11 and the ultrasonic sensor 12 (which are activated within a predetermined time after the vehicle is turned off), respectively. The controller 20 can provide the determination result as first communication information CA to the first communication device 31.

[0044] When the vehicle is turned off and a predetermined time has elapsed, and the inertial sensor 13 determines that a parking event has occurred (i.e., an impact or vibration is applied to the vehicle), the controller 20 may provide a second operating information U_on to the ultrasonic sensor 12, disabling the radar 11 and enabling only the ultrasonic sensor 12 between the radar 11 and the ultrasonic sensor 12.

[0045] After the vehicle is turned off and a predetermined time has elapsed, i.e., when a parking event occurs after the vehicle has finished parking, the controller 20 can determine an attempt to intrude into the vehicle based on the second sensing information U_s provided by the ultrasonic sensor 12. The controller 20 can also provide the determination result as first communication information CA to the first communication device 31.

[0046] Furthermore, when vehicle intrusion is detected from the abnormal opening of the door or the sensing result of the ultrasonic sensor 12, the controller 20 can provide the radar 11 and the ultrasonic sensor 12 with first operation information R_on and second operation information U_on respectively to enable the radar 11 and the ultrasonic sensor 12.

[0047] Furthermore, when a vehicle intrusion is detected, the controller 20 can determine the intruder's movement and location based on first sensing information R_s and second sensing information U_s provided by the activated radar 11 and the activated ultrasonic sensor 12, respectively. The controller 20 can also provide the determined results as first communication information CA to the first communication device 31.

[0048] The controller 20 can detect vehicle accidents based on first communication information CA provided by the first communication device 31 and third sensing information I_s provided by the inertial sensor 13.

[0049] When a vehicle accident is detected, the controller 20 can provide the radar 11 and the ultrasonic sensor 12 with first operation information R_on and second operation information U_on respectively to enable the radar 11 and the ultrasonic sensor 12.

[0050] In the event of a vehicle accident, the controller 20 can determine the passenger's actions and position based on the first sensing information R_s and the second sensing information U_s provided by the activated radar 11 and the activated ultrasonic sensor 12, respectively, and can provide the determined results as the first communication information CA to the first communication device 31.

[0051] The first communication device 31 can facilitate communication between the controller 20 and electronic devices in the vehicle.

[0052] In this case, the electronic devices in the vehicle that communicate with the first communication device 31 may include display devices, alarm devices, safety devices, door detection devices, start detection devices, telematics multimedia systems (TMS), etc.

[0053] Display devices may include electronic devices for providing visual information to passengers. Alarm devices may include electronic devices for providing auditory information to passengers or the outside of the vehicle.

[0054] Safety devices may include electronic devices for determining whether a passenger is wearing his or her seatbelt or for determining whether a door is closed or open. Additionally, safety devices may include electronic devices capable of detecting whether an airbag has deployed.

[0055] Vehicle door detection equipment may include electronic devices for detecting the open, closed, and locked states of vehicle doors.

[0056] The start-up detection device may include electronic devices for detecting whether the vehicle is started. The TMS may include electronic devices capable of sending notifications, such as text messages, to electronic devices outside the vehicle.

[0057] According to embodiments of this disclosure, the second communication device 32 can perform communication between sensor integration modules 100 used for detecting the interior of a vehicle.

[0058] The second communication device 32 can communicate with another sensor integration module for detecting the interior of the vehicle to enable or disable at least one of a radar and an ultrasonic sensor included in the other sensor integration module for detecting the interior of the vehicle. The second communication device 32 can receive first sensing information R_s and second sensing information U_s sensed from at least one of the radar and ultrasonic sensors that are enabled.

[0059] Figure 2 This is a diagram illustrating the arrangement of a sensor integration module for detecting the interior of a vehicle according to an embodiment of the present disclosure.

[0060] Figure 2 The arrangement of a sensor integration module for detecting the interior of a vehicle according to an embodiment of the present disclosure is shown in the vehicle. The sensor integration module for detecting the interior of a vehicle according to an embodiment of the present disclosure can be arranged on at least one of A, B, and C.

[0061] In this case, according to embodiments of the present disclosure, the sensor integration module 100 for detecting the position inside the vehicle, such as... Figure 2 As shown, A, B, and C are exemplary, but not limited to.

[0062] For example, when the sensor integration module 100 for detecting the interior of a vehicle according to an embodiment of this disclosure is configured as one of A, B, and C, it can be disabled. Figure 1 The second communication device 32 shown.

[0063] Furthermore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of this disclosure can enable all components except the second communication device 32, namely, radar 11, ultrasonic sensor 12, inertial sensor 13, controller 20 and first communication device 31, and can perform the operation of each of them.

[0064] Meanwhile, according to embodiments of this disclosure, a sensor integration module 100 for detecting the interior of a vehicle is installed... Figure 2 At least two of A, B, and C. This can be enabled. Figure 1 The sensor integration module 100 shown for detecting the interior of a vehicle includes all components, namely radar 11, ultrasonic sensor 12, inertial sensor 13, controller 20, first communication device 31 and second communication device 32, to perform each of its operations.

[0065] In this configuration, one of the at least two sensor integration modules 100 arranged in the vehicle for detecting the vehicle interior can be a main sensor integration module for detecting the vehicle interior. A first communication device 31 for the main sensor integration module for detecting the vehicle interior can communicate with electronic devices in the vehicle. For example, the electronic devices may include display devices, alarm devices, security devices, door detection devices, start detection devices, telematics multimedia systems (TMS), etc. In addition to the main sensor integration module, the other sensor integration module 100 for detecting the vehicle interior can be a sub-sensor integration module for detecting information about the vehicle interior. The first communication device for the sub-sensor integration module for detecting the vehicle interior can be disabled.

[0066] Furthermore, the enabling or disabling of radar and ultrasonic sensors included in the sub-sensor integration module 100 for detecting the interior of the vehicle can be determined based on communication information received from the main sensor integration module 100 for detecting the interior of the vehicle.

[0067] For example, the sub-sensor integration module 100 for detecting the interior of a vehicle can transmit sensing information from radar and ultrasonic sensors to the main sensor integration module 100 for detecting the interior of a vehicle.

[0068] Figure 3 This is a table illustrating the functionality of a sensor integration module for detecting the interior of a vehicle according to embodiments of the present disclosure.

[0069] Figure 3 A sensor integration module 100 for detecting information inside a vehicle is illustrated according to an embodiment of the present disclosure. In each case, the sensor integration module 100 selectively activates ultrasonic sensors and radar, for example, in cases of driver occupancy, driving, exiting the vehicle, parking, intrusion detection, or vehicle accident, but is not limited to only... Figure 3 The situation is shown.

[0070] Reference Figure 3 According to embodiments of the present disclosure, the sensor integration module 100 for detecting the interior of a vehicle can activate only the radar 11 between the radar 11 and the ultrasonic sensor 12 when the driver is present. When the sensor integration module 100 for detecting the interior of a vehicle is additionally installed in the vehicle according to embodiments of the present disclosure, the radar of the added sensor integration module 100 for detecting the interior of the vehicle can be activated.

[0071] The sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can, during driving conditions, activate only the radar 11 between the radar 11 and the ultrasonic sensor 12. When the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure is additionally installed in the vehicle, the radar of the added sensor integration module 100 for detecting the interior of the vehicle can be activated.

[0072] The sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can activate all radars 11 and ultrasonic sensors 12 when the vehicle is alighting. When the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure is additionally installed in the vehicle, the radars of the added sensor integration module 100 for detecting the interior of the vehicle can be activated.

[0073] The sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can, when the vehicle is parked, only activate the ultrasonic sensor 12 between the radar 11 and the ultrasonic sensor 12. When the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure is additionally installed in a vehicle, both the radar and the ultrasonic sensor of the added sensor integration module 100 for detecting the interior of the vehicle can be disabled.

[0074] The sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can activate both radar 11 and ultrasonic sensor 12 in the event of intrusion detection. When the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure is additionally installed in the vehicle, the radar of the added sensor integration module 100 for detecting the interior of the vehicle can be activated.

[0075] The sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can simultaneously activate both radar 11 and ultrasonic sensor 12 in the event of a vehicle accident. When the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure is additionally installed in a vehicle, the radar of the added sensor integration module 100 for detecting the interior of the vehicle can be activated.

[0076] The following is for reference. Figure 1 and Figure 3 The present disclosure provides a description to explain the function of a sensor integration module for detecting the interior of a vehicle, the operation of the various components, and the purpose of each component, according to embodiments of the present disclosure.

[0077] First, when the driver is in the vehicle, the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure can enable radar 11 from radar 11 and ultrasonic sensor 12 to detect the passenger's seating position and guide the passenger to wear his or her seat belt via an in-vehicle display (display device) or alarm device.

[0078] In this context, the following description is given to explain the operation of the various components of the sensor integration module 100 used for detecting the interior of the vehicle when the driver is in the vehicle.

[0079] The first communication device 31 can receive information from the door detection device indicating that the vehicle door has changed from a closed state to an open state, and can provide the received information as first communication information CA to the controller 20.

[0080] Since the door is usually unlocked, when the open state is detected from the first communication information CA, the controller 20 can determine that the current situation is that the driver is sitting in the vehicle, and can provide the first operation information R_on to the radar 11 to enable the radar 11.

[0081] When an additional sensor integration module for detecting vehicle interior information is present in the vehicle, the controller 20 can send information via the second communication device 32 to enable the radar of the added sensor integration module for detecting vehicle interior information. The added radar for detecting vehicle interior information can be enabled. Sensing information sensed by the radar of the added sensor integration module for detecting vehicle interior information can be received via the second communication device 32.

[0082] In addition, the first communication device 31 can receive information from the safety device indicating whether the passenger is wearing his or her seat belt, and can provide the received information to the controller 20.

[0083] Based on first sensing information R_s of the sensed passenger location provided by the activated radar 11, the controller 20 can detect passengers in the vehicle who are not wearing seat belts. The controller 20 can also detect whether a passenger is wearing a seat belt, information provided from the safety equipment via a first communication device 31. The controller 20 can provide the detection results as a seat belt wearing instruction and warning sound via at least one of a display device (e.g., a monitor) and an alarm device (e.g., a buzzer or speaker) through the first communication device 31.

[0084] Secondly, in driving situations, the sensor integration module 100 for detecting the interior of the vehicle according to embodiments of the present disclosure can enable radar 11 from radar 11 and ultrasonic sensor 12 to detect the movement of passengers, and execute passenger commands through an in-vehicle display (display device) or alarm device.

[0085] In this context, the following description is given to explain the operation of the various components of the sensor integration module 100 used for detecting the interior of the vehicle under driving conditions.

[0086] The first communication device 31 can receive information indicating vehicle start from the start detection device and can provide the received information as first communication information CA to the controller 20.

[0087] Upon receiving a message indicating vehicle activation as the first communication information CA, the controller 20 can determine the current situation as a driving situation. The controller 20 can continue to provide the radar 11 with the first operating information R_on, thereby keeping the radar 11 active even when a driver is present.

[0088] The controller 20 can detect the passenger's movements (or identify postures) provided by the activated radar 11 and can provide the first communication device 31 with commands corresponding to the passenger's movements as first communication information CA.

[0089] The first communication device 31 can send commands corresponding to the passenger's actions to electronic devices (e.g., display devices and alarm devices) installed in the vehicle, causing the electronic devices to execute the commands corresponding to the passenger's actions.

[0090] Third, in the case of alighting, the sensor integration module 100 for detecting the interior of the vehicle according to the embodiments of the present disclosure can enable both radar 11 and ultrasonic sensor 12 to detect whether a passenger remains in the vehicle, and can provide the detection results to at least one of a display device, an alarm device, and a TMS.

[0091] In this context, the following description is given to explain the operation of the various components of the sensor integration module 100 used for detecting the interior of the vehicle when the vehicle is alighting.

[0092] The first communication device 31 can receive information from the start detection device indicating that the vehicle is turned off, and can receive information from the door detection device indicating that the door is locked. It can also provide the received information as the first communication information CA to the controller 20.

[0093] The controller 20 can determine whether the current situation is a vehicle alighting based on the information indicating that the vehicle is turned off and the information indicating that the door is locked, which are the first communication information CA. The controller 20 can provide the radar 11 and the ultrasonic sensor 12 with the first operation information R_on and the second operation information U_on during a predetermined period of time. Therefore, both the radar 11 and the ultrasonic sensor 12 can be activated during the predetermined period of time after the vehicle alighting situation is detected.

[0094] The controller 20 can determine whether there are remaining passengers based on the first sensing information R_s and the second sensing information U_s provided by the radar 11 and ultrasonic sensor 12, which are activated when the passenger disembarks. The controller 20 can provide the determined result to at least one of a display device, an alarm device, and a TMS.

[0095] For example, controller 20 can determine whether there are remaining passengers based on first sensing information R_s and second sensing information U_s when passengers have disembarked. When passengers remain in the vehicle, controller 20 can notify the driver or passengers of the presence of passengers through at least one of a display device, an alarm device, and a TMS.

[0096] Fourth, in the case of parking, when a parking event occurs (when an impact or vibration is applied to the vehicle), the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure can enable the ultrasonic sensor 12, and can determine whether the occurrence of the parking event is a minor risk based on the second sensing information U_s provided from the enabled ultrasonic sensor 12.

[0097] For example, in a parked situation, when the sensing results of the inertial sensor 13 determine that a parking event has occurred that has impacted the vehicle or detected vehicle vibration, the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure can enable the ultrasonic sensor 12 and determine whether the current situation is a minor risk situation, such as an impact or vibration caused by wind or light contact, or a high risk situation, such as an impact or vibration caused by intrusion.

[0098] In this scenario, when a parking incident is determined to be a minor risk situation, the sensor integration module 100 for detecting the interior of a vehicle, according to embodiments of this disclosure, can activate the ultrasonic sensor 12 for a predetermined period of time.

[0099] Meanwhile, in the case of parking, when it is determined that the parking event is a high-risk situation such as intrusion rather than a minor risk (change in wind or light exposure), the sensor integration module 100 for detecting the interior of the vehicle according to embodiments of this disclosure can enable radar 11 and ultrasonic sensor 12.

[0100] The operation of the various components of the sensor integration module 100 used for detecting the interior of a vehicle in a parked condition is described below.

[0101] The first communication device 31 can receive information from the start detection device indicating that the vehicle is turned off, and can receive information from the door detection device indicating that the door is locked. It can also provide the received information as the first communication information CA to the controller 20.

[0102] When a predetermined time has elapsed after receiving the first communication information CA from the first communication device 31, the controller 20 can determine that the current situation is a parking situation.

[0103] The controller 20 can receive information from the inertial sensor 13 indicating that an impact or vibration has been detected applied to the vehicle when the vehicle is parked, and can determine that a parking event has occurred.

[0104] When a parking event is detected, the controller 20 can provide a second operating information U_on to the ultrasonic sensor 12 to enable the ultrasonic sensor 12.

[0105] The controller 20 can determine whether the parking event is caused by wind or light contact (a minor risk situation) or a high risk situation, such as intrusion, based on the second sensing information U_s provided from the enabled ultrasonic sensor 12.

[0106] When it is determined that the parking event was caused by wind or light exposure, the controller 20 can activate the ultrasonic sensor 12 for a predetermined period of time.

[0107] In this scenario, controller 20 can provide first communication device 31 with information indicating that the parking event is due to wind or light exposure as first communication information (CA). First communication device 31 can then provide the driver with information indicating that the parking event is of minor risk via alarm devices and TMS.

[0108] Meanwhile, when a parking event is determined to be a high-risk situation (intrusion detection situation), the controller 20 can provide the radar 11 and the ultrasonic sensor 12 with first operation information R_on and second operation information U_on respectively to enable the radar 11 and the ultrasonic sensor 12.

[0109] Fifth, in the case of intrusion detection, the sensor integration module 100 for detecting inside a vehicle according to embodiments of the present disclosure can enable both radar 11 and ultrasonic sensor 12 to detect the movement and location of an intruder and can provide the detection results to at least one of a display device, an alarm device, and a TMS.

[0110] In this context, the following description is given to explain the operation of the various components of the sensor integration module 100 used for detecting the interior of a vehicle in an intrusion detection situation.

[0111] When the first communication device 31 receives information from the door detection device indicating that the door is abnormally opened and provides the received information to the controller 20, the controller 20 can determine the current situation as an intrusion detection situation.

[0112] In addition, the controller 20 can determine the current situation as an intrusion detection situation based on the sensing results of the ultrasonic sensor 12 in the parking situation.

[0113] When the current situation is determined to be an intrusion detection situation, the controller 20 can provide the radar 11 and the ultrasonic sensor 12 with first operation information R_on and second operation information U_on respectively to enable the radar 11 and the ultrasonic sensor 12.

[0114] The controller 20 can determine the intruder's actions and location based on first sensing information R_s and second sensing information U_s sensed by the activated radar 11 and the activated ultrasonic sensor 12, respectively. The controller 20 can provide the determined results as first communication information CA to the first communication device 31.

[0115] The first communication device 31 can provide at least one of the display device, alarm device, and TMS with the results of determining the intruder's actions and location.

[0116] Therefore, in the case of intrusion detection, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can be configured to identify intrusions by the driver, passengers or persons around the vehicle, and can identify the intruder's actions and location.

[0117] Sixth, in the event of a vehicle accident, the sensor integration module 100 for detecting the interior of a vehicle according to an embodiment of the present disclosure can enable both radar 11 and ultrasonic sensor 12 to detect the movements and positions of passengers (including the driver inside the vehicle), and can provide the detection results to at least one of a display device, an alarm device, and a TMS.

[0118] In this context, the following description is given to explain the operation of the various components of the sensor integration module 100 used for detecting the interior of a vehicle in the event of a vehicle accident.

[0119] The first communication device 31 can receive information indicating airbag deployment from the safety device, or can receive information indicating that an impact greater than a predetermined impact amount has been detected from the inertial sensor 13, and can provide the received information to the controller 20.

[0120] When it is determined that the airbag has deployed or when an impact greater than the predetermined impact amount is detected, the controller 20 can determine the current situation as a vehicle accident.

[0121] When the current situation is determined to be a vehicle accident, the controller 20 can generate a first operation information R_on and a second operation information U_on to respectively activate the radar 11 and the ultrasonic sensor 12. The controller 20 can provide the generated first operation information R_on and the generated second operation information U_on to the radar 11 and the ultrasonic sensor 12.

[0122] The controller 20 can determine information about the position and movements of passengers, including the driver, based on first sensing information R_s and second sensing information U_s sensed from the activated radar 11 and the activated ultrasonic sensor 12, respectively. The controller 20 can provide the determined results to at least one of a display device, an alarm device, and a TMS via a first communication device 31.

[0123] Therefore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can notify people around the vehicle and a call center of the accident situation and the location and actions of passengers inside the vehicle in the event of a vehicle accident.

[0124] Figures 4 to 8 This is a flowchart illustrating the operation of a sensor integration module for detecting information inside a vehicle according to an embodiment of the present disclosure.

[0125] Figure 4 This is a flowchart illustrating the operation of a sensor integration module for detecting information inside a vehicle while the driver is in the vehicle, according to an embodiment of the present disclosure.

[0126] An operation method for detecting a sensor integration module inside a vehicle according to an embodiment of the present disclosure may include unlocking (S1-1), radar detection (S1-2), determining (S1-3) whether a passenger is riding, providing (S1-4) a notification to wear a seatbelt, and the system being idle (S1-5).

[0127] S1-1 may include detecting whether the door is opened normally.

[0128] For example, S1-1 may include via Figure 1The first communication device 31 receives information from the door detection device indicating that the door is normally open (yes). S1-1 may also include the first communication device 31 transmitting the received information to... Figure 1 The controller 20. S1-1 may also include a controller 20 determining, based on information sent from the first communication device 31, whether the current situation is that the driver is in the vehicle.

[0129] If no door is detected to be open normally (No), S1-1 can proceed to S1-5.

[0130] When a normal door opening is detected in S1-1, S1-2 may include enabling... Figure 1 The radar 11 is activated and the information detected from the activated radar 11 is transmitted to the controller 20.

[0131] For example, when it is determined in S1-1 that the current situation is a driver riding situation, S1-2 may include the controller 20 providing the radar 11 with first operation information R_on to enable the radar 11, and the radar 11, which is activated by receiving the first operation information R_on, providing the controller 20 with the detected first sensing information R_s.

[0132] S1-3 may include determining whether passengers, including the driver, are in the vehicle.

[0133] For example, S1-3 may include determining whether a passenger is in the vehicle based on first sensing information R_s provided from the enabled radar 11.

[0134] Specifically, S1-3 may include determining that a passenger is in the vehicle when a passenger's movement is detected in the vehicle based on first sensing information R_s provided from the enabled radar 11. S1-3 may also include determining that a passenger is not in the vehicle when no passenger movement is detected in the vehicle.

[0135] When a passenger is detected to be seated in S1-3 (yes), S1-4 can be executed.

[0136] If no passenger is detected in S1-3 (no), S1-5 can be executed.

[0137] When a passenger in a vehicle is not wearing his or her seatbelt, S1-4 may include providing a notification to the unbelted passenger to fasten their seatbelt via a display device and / or an alarm device.

[0138] For example, S1-4 may include detecting the location of a passenger in the vehicle from the activated radar 11 and safety equipment (detecting whether a passenger is wearing his or her seatbelt), and may transmit information about a passenger not wearing a seatbelt at that location to a display device and an alarm device based on information provided from the detected passenger location regarding whether the passenger is wearing his or her seatbelt. Therefore, a notification to wear a seatbelt can be provided to passengers who are not wearing their seatbelts.

[0139] S1-5 may include switching to an idle state when no door opening is detected in S1-1, when no passenger is detected in S1-3, or after a notification to wear a seatbelt is provided in S1-4.

[0140] For example, S1-5 may include switching to an idle state in the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure when no door opening is detected in S1-1, no passenger is detected in S1-3, or after a notification to wear a seatbelt is provided in S1-4.

[0141] In this case, the use of radar 11 instead of ultrasonic sensor 12 to detect the passenger's position when the driver is in the vehicle is likely because radar 11 can detect the passenger's position in a shorter time, since radar 11 has a higher detection resolution than ultrasonic sensor 12.

[0142] Therefore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can determine in a short time whether the passenger in each seat is wearing his or her seat belt.

[0143] Figure 5 This is a flowchart illustrating the operation of a sensor integration module for detecting the interior of a vehicle during driving, according to an embodiment of the present disclosure.

[0144] Reference Figure 5 The operation method for detecting the sensor integration module inside a vehicle according to embodiments of the present disclosure may include inputting (S2-1) a command, radar detection (S2-2), identifying (S2-3) a command, executing (S2-4) a command, and system idle (S2-5).

[0145] S2-1 may include enabling the driver or passenger to input a command after the vehicle is started. Figure 1 Radar 11.

[0146] After the vehicle is started, S2-2 can be executed when the driver or passenger enters the command to enable radar 11 in S2-1 (yes).

[0147] After the vehicle is started, if the driver or passenger does not enter a command to enable radar 11 in S2-1 (no), S2-5 can be executed.

[0148] In this case, S2-1 may include using voice commands or button touch commands from the driver or passenger to input commands to activate radar 11.

[0149] S2-2 may include detecting the driver's or passenger's actions, i.e., attitude, via an activated radar 11.

[0150] For example, S2-2 may include detecting the driver's or passenger's movements (attitudes) via the enabled radar 11 and directing the enabled radar 11 towards... Figure 1 The controller 20 provides the detection results.

[0151] S2-3 may include determining whether the driver's or passenger's posture detected in S2-2 is a predetermined action.

[0152] When the driver's or passenger's posture detected in S2-2 is the same as the predetermined action (posture), S2-3 may include determining a command to identify the driver or passenger. Therefore, S2-3 can proceed to S2-4.

[0153] If the driver's or passenger's posture detected in S2-2 is different from the predetermined posture (no), S2-3 may include determining that the driver's or passenger's posture is not a command. Therefore, S2-3 can proceed to S2-5.

[0154] S2-4 may include executing commands corresponding to the posture of the driver or passenger. These commands may include operating electronic devices in the vehicle in response to the posture of the driver or passenger, such as increasing or decreasing speaker volume or raising or lowering windows.

[0155] S2-5 may include switching to an idle state when no command is entered in S2-1 or no command is recognized in S2-3.

[0156] For example, when no command is input in S2-1 or no command is recognized in S2-3, S2-5 may include switching the sensor integration module 100 for detecting the interior of a vehicle according to an embodiment of the present disclosure to an idle state.

[0157] In this case, the use of radar 11 instead of ultrasonic sensor 12 to detect the driver's or passenger's posture during driving may be because radar 11 is able to detect the driver's or passenger's posture in a shorter time, since radar 11 has a higher detection resolution than ultrasonic sensor 12.

[0158] Therefore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can determine the actions of each passenger in the vehicle, including the driver, in a short time in order to execute commands.

[0159] Figure 6 This is a flowchart illustrating the operation of a sensor integration module for detecting the interior of a vehicle when the driver is alighting, according to an embodiment of the present disclosure.

[0160] Reference Figure 6 The operation method of the sensor integrated module for detecting inside a vehicle according to the embodiments of the present disclosure may include determining (S3-1) the disembarkation status, sensor detection (S3-2), determining (S3-3) whether there are remaining passengers, notifying (S3-4) that there are remaining passengers, and the system being idle (S3-5).

[0161] S3-1 may include determining when a passenger (including the driver) disembarks from the vehicle. This determination may include identifying the current situation as disembarkation when the vehicle is turned off and the doors are locked.

[0162] For example, when the vehicle is turned off and the doors are locked (yes), S3-1 may include determining the current situation as an exit situation. Therefore, S3-1 can proceed to S3-2.

[0163] Meanwhile, if the vehicle is not turned off and the doors are not locked (no), S3-1 may include determining that the current situation is not a disembarkation situation. Therefore, S3-1 can proceed to S3-5.

[0164] When it is determined in S3-1 that the current situation is a disembarkation situation, S3-2 may include enabling... Figure 1 Both radar 11 and ultrasonic sensor 12 will provide the results sensed by the activated radar 11 and the activated ultrasonic sensor 12 to [the system / entity]. Figure 1 Controller 20.

[0165] S3-3 may include determining whether there are passengers in the vehicle based on the results sensed in S3-2.

[0166] For example, when it is determined, based on the sensing results of the enabled radar 11 and the enabled ultrasonic sensor 12, that is, when there are remaining passengers (yes), S3-3 can continue to S3-4.

[0167] Meanwhile, when it is determined, based on the results sensed by the activated radar 11 and the activated ultrasonic sensor 12, that no passengers riding in the vehicle are detected, i.e., when there are no remaining passengers (no), S3-3 can continue to S3-5.

[0168] When it is determined that there are still passengers remaining in S3-3, S3-4 can be executed. S3-4 may include transmitting information indicating the presence of passengers remaining in the vehicle to at least one of the display device, alarm device, and TMS. Therefore, the driver or people around the vehicle can be notified that there are passengers in the vehicle.

[0169] S3-5 may include switching to an idle state when it is determined in S3-1 that the current situation is not a disembarkation situation or when there are no passengers in the vehicle in S3-3.

[0170] For example, S3-5 may include switching the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure to an idle state when it is determined in S3-1 that the current situation is not a disembarkation situation or in S3-3 that there are no passengers in the vehicle.

[0171] In this case, using both radar 11 and ultrasonic sensor 12 to detect passengers when they get off the vehicle can more accurately determine whether there are any remaining passengers.

[0172] Therefore, the sensor integration module 100 for detecting the interior of a vehicle according to embodiments of the present disclosure can more accurately determine whether there are passengers and can notify the interior and exterior of the presence of passengers through visual and audible means.

[0173] Figure 7 This is a flowchart illustrating the operation of a sensor integration module for detecting the interior of a vehicle in parking and intrusion detection situations, according to embodiments of the present disclosure.

[0174] Reference Figure 7 The operation method for detecting a sensor integrated module inside a vehicle according to an embodiment of the present disclosure may include locking (S4-1) the vehicle, detecting (S4-2) an abnormal opening of a door, detecting (S4-3) a parking event, ultrasonic detection (S4-4), determining (S4-5) a minor risk, radar detection (S4-6), detecting (S4-7) an intrusion, sending an intrusion notification (S4-8), the system being idle (S4-9), sending a TMS notification (S4-10), and performing sensor detection (S4-11).

[0175] S4-1 may include detecting that the doors are locked after the vehicle is turned off and determining the current situation as a parking situation.

[0176] For example, when Figure 1 The controller 20 via Figure 1 When the first communication device 31 receives information indicating that the vehicle is off and information indicating that the door is locked from the starter and door detection device, S4-1 may include determining the current situation as a parking situation.

[0177] S4-2 may include detecting when a locked door becomes abnormally open.

[0178] For example, S4-2 may include the controller 20 receiving information from the door detection device via the first communication device 31 indicating that a door that is in a locked state has been abnormally opened.

[0179] When it is determined that a locked door has been abnormally opened (yes), S4-2 can proceed to S4-10.

[0180] Meanwhile, when it is determined that the locked door has not been opened abnormally (no), that is, when it is determined that the door remains locked, S4-2 can proceed to S4-3.

[0181] S4-3 may include detecting the occurrence of an event that applies an impact or vibration to the vehicle while it is parked.

[0182] If no collision or vibration event is detected being applied to the vehicle, S4-3 can proceed to S4-9.

[0183] At the same time, when an event of collision or vibration being applied to the vehicle is detected, S4-3 can proceed to S4-4.

[0184] S4-4 may include enabling when an event of a collision or vibration being applied to the vehicle is detected in S4-3. Figure 1 The ultrasonic sensor 12 is used to provide the sensing results of the enabled ultrasonic sensor 12 to a determining component (e.g., controller 20).

[0185] S4-5 may include determining, based on the sensing results of the ultrasonic sensor 12 (which is provided in S4-4), whether the impact or vibration applied to the vehicle is an impact or vibration from wind or light (whether the current situation poses a minor risk).

[0186] If it is determined in S4-5 that the current situation is a minor risk (yes), then S4-9 can be executed.

[0187] If it is determined in S4-5 that the current situation is not a minor risk (no), then S4-6 can be executed.

[0188] In this context, determining whether the current situation poses a minor risk may include distinguishing between when the detected impact or vibration is greater than a predetermined impact or vibration level and when the detected impact or vibration is not greater than a predetermined impact or vibration level. This determination can be performed based on the amount of impact or vibration exerted when an adult is riding in the vehicle.

[0189] S4-6 may include enabling [the function] when it is determined in S4-5 that the current situation is not a minor risk, i.e., when it is determined that the current situation is a high risk. Figure 1The radar 11. S4-6 may also include providing the sensing results of the enabled radar 11 to a determining component (e.g., controller 20).

[0190] S4-7 may include determining the presence of an intruder, the location of the intruder, and the intruder's actions based on the sensing results of the enabled radar 11 and the enabled ultrasonic sensor 12.

[0191] If it is determined that there is no intruder in S4-7 (no), S4-9 can be executed.

[0192] If an intruder is confirmed to exist in S4-7, S4-8 can be executed.

[0193] S4-8 may include transmitting the location and actions of the intruder determined in S4-7 to display devices (monitors), alarm devices (speakers), and TMS inside and outside the vehicle. In this case, S4-8 may include notifying the driver or people around the vehicle of information indicating the presence of an intruder in the vehicle, the intruder's location, and the intruder's actions.

[0194] When no event is detected in the parking situation in S4-3, when the current situation is determined to be a minor risk in S4-5, or when no intruder is detected in S4-7, S4-9 may include switching to an idle state.

[0195] For example, when no event is detected in the parking situation in S4-3, when the current situation is determined to be a minor risk in S4-5, or when no intruder is detected in S4-7, S4-9 may include switching the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure to an idle state.

[0196] When an abnormal opening of the vehicle door is detected in S4-2 (Yes), S4-10 can be executed. S4-10 may include sending text indicating that the vehicle door was abnormally opened to an electronic device such as a portable terminal of the driver.

[0197] For example, S4-10 may include the controller 20 receiving information from the door detection device indicating that the door is abnormally opened, and the controller 20 transmitting this information via... Figure 1 The first communication device 31 provides the TMS with information indicating that the door was opened abnormally. S4-10 may also include the TMS providing warning text (e.g., text indicating that the door was opened abnormally) to the driver.

[0198] S4-11 may include enabling both radar 11 and ultrasonic sensor 12 after (or simultaneously with) the execution of S4-10.

[0199] S4-7 can be executed after S4-11.

[0200] In other words, when an abnormal opening of the car door is detected, a warning text can be sent to the driver, and radar 11 and ultrasonic sensor 12 can be activated. In this case, S4-7 can be executed.

[0201] As described above, S4-7 may include determining the presence of an intruder, the location of the intruder, and the actions of the intruder based on the sensing results of the enabled radar 11 and the enabled ultrasonic sensor 12.

[0202] If it is determined that there is no intruder in S4-7 (no), S4-9 can be executed.

[0203] At the same time, if it is determined that an intruder exists in S4-7, S4-8 can be executed.

[0204] In summary, Figure 7 The operation of the sensor integration module for detecting the interior of a vehicle according to embodiments of the present disclosure in parking and intrusion detection situations is as follows.

[0205] When an abnormal opening of a vehicle door is detected, the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can send a warning text to the driver's portable terminal via the TMS. The sensor integration module can also enable radar 11 and ultrasonic sensor 12 to detect and determine the presence of an intruder, the intruder's location, and the intruder's actions. The sensor integration module can also notify the driver and people around the vehicle of the determined results.

[0206] Furthermore, although no abnormal opening of the vehicle door is detected, when a parking event occurs (when a collision or vibration is detected), the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can activate the ultrasonic sensor 12. The sensor integration module can also determine whether the current situation is a minor or high-risk situation based on the sensing results provided by the activated ultrasonic sensor 12. If the current situation is high-risk (e.g., an intrusion), the sensor integration module can also activate the radar 11. The sensor integration module can also detect and determine the presence of an intruder, the intruder's location, and the intruder's actions based on the sensing results of the activated radar 11 and the activated ultrasonic sensor 12. The sensor integration module can notify the driver and people around the vehicle of the determined results.

[0207] In other words, when it is determined that a car door is abnormally opened or that an impact or vibration is applied to the vehicle under high-risk conditions, the sensor integration module for detecting the interior of the vehicle according to embodiments of the present disclosure can perform more accurate detection and judgment by using both radar 11 and ultrasonic sensor 12.

[0208] When an impact or vibration is applied to the vehicle while the doors are locked, the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can activate only the ultrasonic sensor 12 and can determine minor and high-risk situations. Therefore, the vehicle's power consumption can be reduced.

[0209] Figure 8 This is a flowchart illustrating the operation of a sensor integration module for detecting information inside a vehicle in the event of a vehicle accident (e.g., a traffic accident) according to an embodiment of the present disclosure.

[0210] Reference Figure 8 The operation method of the sensor integrated module for detecting inside a vehicle according to embodiments of the present disclosure may include detecting (S5-1) an accident, performing sensor detection (S5-2), identifying (S5-3) passengers, notifying a rescue request (S5-4), and the system being idle (S5-5).

[0211] S5-1 may include detecting and determining whether a vehicle accident has occurred.

[0212] For example, when the airbag deploys or when an impact exceeding a predetermined amount is detected, S5-1 may include determining that an accident has occurred.

[0213] When it is determined that a vehicle accident has occurred, S5-1 can proceed to S5-2.

[0214] At the same time, if it is determined that no accident has occurred (no), S5-1 can proceed to S5-5.

[0215] S5-2 can be executed when a vehicle accident occurs as described in S5-1. S5-2 may include enabling... Figure 1 Radar 11 and ultrasonic sensor 12.

[0216] S5-3 may include detecting and determining whether there are passengers in the vehicle, the location of the passengers, and the actions of the passengers based on sensing results provided from the enabled radar 11 and the enabled ultrasonic sensor 12.

[0217] For example, when the presence of passengers, including the driver, is detected based on the sensing results provided by the activated radar 11 and the activated ultrasonic sensor 12, S5-3 can proceed to S5-4.

[0218] Meanwhile, if no passenger is detected based on the sensing results provided by the activated radar 11 and the activated ultrasonic sensor 12 (no), S5-3 can proceed to S5-5.

[0219] When the presence of a passenger is detected in the incident situation described in S5-3, S5-4 can be executed. S5-4 may include notifying the inside and outside of the vehicle of the occurrence of the incident, the presence of the passenger, the location of the passenger, and the actions of the passenger through display devices, alarm devices, and TMS.

[0220] When the presence of a passenger is detected in the event of an accident, S5-4 may include notifying people around the vehicle and pre-arranged agencies (e.g., call centers, 119, police stations, etc.) of the occurrence of the accident, the presence of the passenger, the passenger's location, and the passenger's actions.

[0221] When the airbag does not deploy in S5-1, when no impact amount greater than or equal to the predetermined amount is detected in S5-1, or when the presence of a passenger is not detected in S5-3, S5-5 may include switching to an idle state.

[0222] For example, when the airbag does not deploy in S5-1, when no impact amount greater than or equal to a predetermined amount is detected in S5-1, or when the presence of a passenger is not detected in S5-3, S5-5 may include switching the sensor integration module 100 for detecting the interior of the vehicle according to an embodiment of the present disclosure to an idle state.

[0223] In summary, the operation of the sensor integration module for detecting the interior of a vehicle according to the embodiments of this disclosure is as follows.

[0224] When a driver is detected in the vehicle, the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can activate only the radar between the radar and ultrasonic sensors to identify whether a passenger is in the vehicle and the passenger's seating position. The sensor integration module can also provide information about a passenger not wearing a seatbelt to at least one of a display device such as a monitor and an alarm device such as a speaker or buzzer. Therefore, guidance on wearing a seatbelt can be provided to passengers not wearing their seatbelts.

[0225] When a driving situation is detected, the sensor integration module for detecting the interior of a vehicle according to embodiments of the present disclosure can activate only the radar between the radar and the ultrasonic sensor to identify commands corresponding to the passenger's actions (postures) and can execute the identified commands.

[0226] When a passenger disembarks, the sensor integration module for detecting the interior of the vehicle according to embodiments of the present disclosure can activate both radar and ultrasonic sensors to detect whether there are remaining passengers, and can notify the driver and people around the vehicle of the presence of remaining passengers when they are detected.

[0227] When a parking situation is detected and an abnormal opening of a vehicle door is detected, the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can provide warning text or warning notifications to the driver or persons around the vehicle. The sensor integration module can also enable both radar and ultrasonic sensors to detect the presence of an intruder, the intruder's location, and the intruder's actions. The sensor integration module can also notify the driver and persons around the vehicle.

[0228] When a parking situation is detected and an impact or vibration applied to the vehicle is detected, the sensor integration module for detecting the interior of the vehicle according to embodiments of this disclosure can activate only the ultrasonic sensor between the radar and ultrasonic sensors to determine whether the current situation is a minor risk. When it is determined that the current situation is a high-risk situation such as intrusion rather than a minor risk, the sensor integration module can additionally activate the radar to detect the presence, location, and actions of the intruder. The sensor integration module can also notify the driver and people around the vehicle.

[0229] When a vehicle accident is detected, the sensor integration module for detecting the interior of the vehicle according to embodiments of the present disclosure can activate both radar and ultrasonic sensors, and can provide information to the driver, people around the vehicle, and designated agencies regarding the presence of passengers, the location of passengers, and the actions of passengers.

[0230] Therefore, the sensor integration module for detecting inside a vehicle according to embodiments of this disclosure can be a technology capable of detecting the presence of an object (e.g., driver, passenger, or intruder) in the vehicle, the position of the object, and the movement of the object, and notifying the driver, people around the vehicle, and predetermined agencies of this information in the form of visual and auditory information.

[0231] In this context, the sensor integration module for detecting objects inside a vehicle according to embodiments of this disclosure may use other types of sensors (e.g., radar and ultrasonic sensors) to detect the presence of objects in the vehicle, the location of the objects, and the movement of the objects.

[0232] Furthermore, the sensor integration module for detecting the interior of a vehicle according to embodiments of this disclosure can selectively activate sensors suitable for vehicle conditions (e.g., driver riding, driving, getting out of the vehicle, parking, intrusion detection, or an accident). Therefore, vehicle power consumption can be reduced and more accurate detection results can be obtained.

[0233] Furthermore, the sensor integration module for detecting the interior of a vehicle according to embodiments of this disclosure can provide notifications to at least one of the driver, people around the vehicle, and predetermined agencies based on the sensing results depending on each situation.

[0234] The currently available technologies can reduce the vehicle's power consumption while maintaining the vehicle's convenient functions.

[0235] Currently available technologies can reduce power consumption by operating sensors suitable for various situations, such as when a driver is in a vehicle, when the vehicle is in motion, when a passenger has just alighted, when the vehicle is parked, in intrusion detection situations, and in traffic accident situations.

[0236] In addition, various effects that can be directly or indirectly determined through this disclosure may be provided.

[0237] While this disclosure has been described above with reference to specific embodiments and accompanying drawings, it is not limited thereto. Various modifications and alterations can be made to this disclosure by those skilled in the art without departing from the spirit and scope of the disclosure as claimed in the appended claims.

[0238] Therefore, specific embodiments of this disclosure are provided to explain the spirit and scope of this disclosure, and not to limit them. Consequently, the spirit and scope of this disclosure are not limited by these embodiments. The scope of this invention should be determined by the appended claims, and all technical concepts equivalent to the scope of the claims should be included within the scope of this invention.

Claims

1. A sensor integration module for detecting information inside a vehicle, the sensor integration module comprising: The first sensor is configured to determine whether to enable or disable based on first operational information and to provide sensing results as first sensing information. The second sensor is configured to determine whether to enable or disable based on the second operational information, and to provide the sensing result as the second sensing information. The first communication device is configured to send and receive information using electronic devices in the vehicle; as well as The controller is configured to generate the first operation information and the second operation information, for selectively activating the first sensor and the second sensor based on the information provided from the first communication device, and providing the result determined based on the first sensing information and the second sensing information to the first communication device; The controller is configured as follows: Based on the information provided by the first communication device, the driver's passenger status, driving status, alighting status, parking status, intrusion detection status, and vehicle accident status are determined. When the driver's seating situation or driving situation is determined, only the first sensor is activated; When the parking situation is determined, only the second sensor is activated; When the vehicle exit situation, the intrusion detection situation, or the vehicle accident situation is determined, the first sensor and the second sensor are activated.

2. The sensor integration module according to claim 1, wherein, The first sensor includes: The radar is configured to be activated based on the first operational information, to emit electromagnetic waves, and to receive the electromagnetic waves reflected from an object to generate the first sensing information.

3. The sensor integration module according to claim 1, wherein, The second sensor includes: An ultrasonic sensor is configured to be activated based on the second operational information, emit ultrasonic waves, and receive the ultrasonic waves reflected from an object to generate the second sensing information.

4. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device indicating that the door has been detected to be open, it generates the first operation information that enables only the first sensor between the first sensor and the second sensor, and determines the passenger's position based on the first sensing information provided from the enabled first sensor and instructs the passenger to put on his or her seat belt.

5. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device instructing the vehicle to start, it generates first operation information that enables only the first sensor between the first sensor and the second sensor, and determines the passenger's posture based on the first sensing information provided from the enabled first sensor and executes a command corresponding to the passenger's posture.

6. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device instructing the vehicle to turn off and the doors to lock, it generates first operation information and second operation information that enable both the first sensor and the second sensor within a predetermined time, and determines whether there are any remaining passengers based on the first sensing information and second sensing information provided by the enabled first sensor and the enabled second sensor, respectively.

7. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device indicating that an impact or vibration is detected in the vehicle after a predetermined time following the vehicle's shutdown, the controller generates second operational information that enables only the second sensor between the first and second sensors, and determines whether there is an intrusion based on the second sensing information provided from the enabled second sensor.

8. The sensor integration module according to claim 7, wherein, When the intrusion is detected based on the second sensing information, the controller generates the first operation information to enable the first sensor, and determines whether there is an intruder, the location of the intruder, and the actions of the intruder based on the first sensing information and the second sensing information.

9. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device indicating that a locked door has been abnormally opened, it generates first operation information and second operation information that enable both the first sensor and the second sensor, and determines whether there is an intruder, the location of the intruder, and the actions of the intruder based on the first sensing information and the second sensing information provided by the enabled first sensor and the enabled second sensor, respectively.

10. The sensor integration module according to claim 1, wherein, When the controller receives information from the first communication device indicating that a shock or vibration greater than a predetermined amount has been detected, the controller generates first operation information and second operation information that enable both the first sensor and the second sensor, and determines whether there is a passenger, the passenger's location, and the passenger's actions based on the first sensing information and second sensing information provided by the enabled first sensor and the enabled second sensor, respectively.

11. The sensor integration module according to claim 1, wherein, The controller generates first operation information and second operation information that enable at least one of the first sensor and the second sensor based on the determined result, and provides the first communication device with the location of the passenger who is not wearing a seat belt, the command corresponding to the passenger's posture, whether there are remaining passengers, whether there is an intrusion, whether there is an intruder, the location of the intruder, the intruder's actions, whether there are passengers, the location of the passengers, and the actions of the passengers, based on the determination of at least one of the first sensor and the second sensor being enabled.

12. The sensor integration module according to claim 1, further comprising: The second communication device is configured to send and receive information using another sensor integration module for detecting the interior of the vehicle.

13. A method for operating a sensor integrated module for detecting information inside a vehicle, the method comprising: The current situation can be identified as driver passenger status, driving status, exit status, parking status, intrusion detection status, and vehicle accident status; The first and second sensors are selectively activated based on the identification results; Receive sensing information from the selectively enabled first and second sensors; as well as Based on the provided sensing information, notify the passenger that he or she is not wearing a seatbelt, execute commands corresponding to the passenger's posture, determine if there are any remaining passengers, determine if there is an intrusion, determine if there is an intruder, determine the location and actions of the intruder, determine if there are any passengers, or determine the location and actions of the passenger. The selective activation of the first and second sensors based on the identification results includes: When the driver's seating situation or driving situation is determined, only the first sensor is activated; When the parking situation is determined, only the second sensor is activated; When the vehicle exit situation, the intrusion detection situation, or the vehicle accident situation is determined, the first sensor and the second sensor are activated.

14. The operating method according to claim 13, wherein, Identification includes: When a locked door is opened, the current situation is determined to be the driver's passenger situation; When the vehicle starts, the current situation is determined to be the driving situation described above; When the vehicle is turned off and the door is locked, the current situation is determined to be the getting-out situation. When the vehicle is turned off and the door is locked, after a predetermined time has elapsed, the current situation is determined to be the parking situation. When the vehicle door, which is in the locked state, becomes abnormally open, the current situation is determined to be an intrusion detection situation; and When the airbags deploy, the current situation is determined to be a vehicle accident.

15. The method of operation according to claim 14, wherein enabling includes: After determining that the current situation is the driver riding situation and the current situation is the driving situation, the sensor with higher detection resolution between the first sensor and the second sensor is activated for the detection area.

16. The method of operation according to claim 14, wherein enabling includes: After determining that the current situation is the parking situation, the sensor with lower power consumption is activated between the first sensor and the second sensor.

17. The method of operation according to claim 14, wherein enabling includes: After determining that the current situation is the vehicle exit situation, the intrusion detection situation, and the vehicle accident situation, both the first sensor and the second sensor are activated.

18. The method of operation according to claim 15, wherein the notification includes: Based on sensing information provided by the sensor with higher detection resolution for the detection area between the first and second sensors, the passenger is notified that he or she is not wearing a seatbelt, and the command corresponding to the passenger's posture is executed.

19. The method of operation according to claim 16, wherein the determination includes: The presence of an intrusion is determined based on sensing information provided by the enabled sensor, which has lower power consumption, between the first and second sensors.

20. The method of operation according to claim 17, wherein the determination includes: Based on sensing information provided from the first and second sensors that are enabled, it is determined whether there are remaining passengers, whether there is an intruder, the location and actions of the intruder, whether there are passengers, and the location and actions of the passengers.

Images