System and method for detecting mispostures of an occupant using a seatbelt restraint system

The system uses sensors and image comparison to detect and correct false postures in seatbelt systems, improving safety by ensuring proper seatbelt usage and preventing adverse driving conditions.

DE102020106921B4Active Publication Date: 2025-10-09GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
DE102020106921
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-04-19
Filing Date
2020-03-13
Publication Date
2025-10-09
Estimated Expiration
2040-03-13

AI Technical Summary

Technical Problem

Existing seatbelt systems fail to accurately detect and correct false postures of vehicle occupants, which can compromise safety.

Method used

A system comprising a seatbelt buckle sensor, seatbelt output sensor, occupant posture sensor, and control module that determines the presence of a seatbelt latch plate, measures seatbelt pay-out length, and compares occupant images to stored postures to identify false postures, issuing warnings or taking driving actions as necessary.

Benefits of technology

Effectively detects and corrects false postures of vehicle occupants, enhancing safety by ensuring proper seatbelt usage and preventing adverse driving conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A system for determining when an occupant in a motor vehicle seat and restrained by a seat belt restraint system has an incorrect body posture, the system comprising: a seatbelt buckle sensor for detecting the presence of a seatbelt buckle locking plate in the seatbelt buckle to determine whether the seatbelt is fastened; a seat belt dispensing sensor for detecting a first seat belt dispensing length and for detecting a second seat belt dispensing length; an occupant posture sensor for capturing an image of an occupant on the vehicle seat; a control module in communication with the seat belt buckle sensor, the seat belt release sensor, and the occupant posture sensor, the control module having executable code to: Determine the presence of the seat belt locking plate in the seat belt buckle; Determining whether the difference between the first seat belt output length when the seat belt buckle is present in the seat belt buckle and the second seat belt output length is greater than a seat belt output length change threshold; Comparing the image of the occupant captured by the occupant posture sensor with at least one stored image and posture zone if the difference between the first seatbelt output length and the second seatbelt output length is greater than the seatbelt output length change threshold; and Determine whether the occupant has an incorrect posture by comparing the captured image of the occupant with at least one of the stored images and the posture zone. wherein the occupant posture sensor is an ultrasonic sensor, wherein the stored image is at least one of a reference posture image and an actual initial posture image, wherein the posture zone is at least one of a reference posture zone and an actual initial posture zone, where the actual initial posture zone is determined from an actual initial posture image, wherein the control module further comprises executable code for storing the first seatbelt output length within at least a first time window and a second time window, wherein the reference posture image is selected based on the image of the occupant detected by the occupant posture sensor, wherein the reference posture zone is selected from a plurality of stored reference posture images based on a shape of the occupant determined from the captured image of the occupant, wherein the control module further comprises executable code for comparing the image of the occupant captured by the occupant posture sensor with a stored image, further comprising executable code for capturing an image of an occupant on the vehicle seat within at least a first time window or a second time window and storing the image as the stored image, wherein the control module further comprises executable code to determine whether the occupant has an incorrect posture based on the comparison of the captured image of the occupant and the stored image and / or the posture zone, and the posture zone further comprises executable code to determine whether a head, a torso, or a leg of the occupant exceeds a posture threshold.
Need to check novelty before this filing date? Find Prior Art

Description

INTRODUCTION

[0001] The present disclosure relates to seat belt restraint systems and methods for detecting improper posture of an occupant on the vehicle seat.

[0002] Seatbelt systems for restraining occupants in a motor vehicle generally use seatbelt retractors. Seatbelt retractors have a spool around which a seatbelt webbing is wound. The seatbelt webbing can be unwound from the spool by a vehicle occupant and secured around the vehicle occupant by inserting a locking plate coupled to the seatbelt webbing into a seatbelt buckle. When not in use, the seatbelt retractor uses a spring to retract the seatbelt webbing into one or more retractor spools. In addition, seatbelt systems incorporate a sensor in the seatbelt buckle to detect whether an occupant is buckled. If the occupant is not buckled, a warning is issued to the occupant, prompting them to fasten their seatbelt.

[0003] While current seat belt systems serve their purpose, there is a need for a new and improved system and method for securing vehicle occupants in a vehicle seat. The new and improved method should be capable of determining the position and posture of the occupants in a vehicle seat and warning the occupant or taking appropriate driving action if various incorrect postures of the occupant in the vehicle seat are detected.

[0004] WO 2019 / 063470 A1 describes a method for operating a seat belt system for a passenger in a vehicle, comprising a belt webbing for restraining the passenger, a belt buckle, and a sensor for detecting belt webbing extension. The method initiates a reaction when the belt webbing extension exceeds a threshold value that takes into account the minimum belt webbing extension after the buckle is closed.

[0005] WO 2016 / 164793 A1 describes a method and system for determining the size and posture of an occupant in a vehicle interior. In one embodiment, the method comprises receiving one or more images of a vehicle interior from a camera.

[0006] US 2019 009 4355 A1 describes an occupant detection device comprising a wave sensor and a control unit. The wave sensor, positioned higher than the seat in the vehicle, transmits wave motions to a predetermined area, including at least the head area of ​​the occupant, and receives the reflected wave motions. Based on the wave sensor's transmission and reception of wave motion, the control unit calculates a result value, which represents either a first value or a second value. The first value is the received intensity, and the second value is either a time period or a distance. By comparing the result value with a threshold value, the control unit decides either (i) that the seat is occupied by an occupant, or (ii) that the seat is empty or occupied by an object that is not an occupant.

[0007] KR 101 427 922 B1 relates to a safety belt control system and a control method for a vehicle, in particular a safety belt control system and a control method for an automobile, which can improve safety. DESCRIPTION

[0008] The object of the invention is to provide an improved system for detecting incorrect posture. This object is achieved by the subject matter of independent claim 1.

[0009] In accordance with several aspects, a system is provided for determining when an occupant in a motor vehicle seat and restrained by a seatbelt restraint system has an improper posture. The system includes a seatbelt buckle sensor for detecting the presence of a seatbelt locking plate in the seatbelt buckle to determine whether the seatbelt is fastened, a seatbelt dispensing sensor for detecting a first seatbelt dispensing length and for detecting a second seatbelt dispensing length, an occupant posture sensor for detecting an image of an occupant in the motor vehicle seat, and a control module. The control module is in communication with the seatbelt buckle sensor, the seatbelt dispensing sensor, and the occupant posture sensor.The control module has executable code to: determine the presence of the seat belt latch plate in the seat belt buckle, determine if the difference between the first seat belt output length when the seat belt latch plate is present in the seat belt buckle and the second seat belt output length is greater than a seat belt output length change threshold, compare the image of the occupant captured by the occupant posture sensor to a stored image and / or posture zone if the difference between the first seat belt output length and the second seat belt output length is greater than the seat belt output length change threshold, and determine if the occupant has an improper posture based on the comparison of the captured image of the occupant to the stored image and / or posture zone.

[0010] In accordance with another aspect of the present disclosure, the occupant posture sensor is at least one of an infrared sensor, an ultrasonic sensor, and a visual spectrum camera sensor.

[0011] In accordance with another aspect of the present disclosure, the stored image is at least one of a reference pose image and an actual initial pose image.

[0012] In accordance with another aspect of the present disclosure, the posture zone is at least one of a reference posture zone and an actual initial posture zone.

[0013] In accordance with another aspect of the present disclosure, the control module further comprises executable code for storing the first seat belt output length within at least a first and a second time window.

[0014] In accordance with another aspect of the present disclosure, the reference posture image is selected based on the image of the occupant acquired by the occupant posture sensor.

[0015] In accordance with another aspect of the present disclosure, the reference posture zone image is selected from a plurality of stored reference posture images based on a shape of the occupant determined from the captured image of the occupant.

[0016] In accordance with another aspect of the present disclosure, the actual initial posture zone is determined from an actual initial posture image.

[0017] In accordance with another aspect of the present disclosure, the control module further comprises executable code to compare the image of the occupant captured by the occupant posture sensor with a stored image, further comprising executable code to capture an image of an occupant in the vehicle seat within at least a first time window or a second time window and store the image as the stored image.

[0018] In accordance with another aspect of the present disclosure, the control module further comprises executable code to determine whether the occupant is in an incorrect posture based on comparing the captured image of the occupant with at least one of the stored images, and the posture zone further comprises executable code to determine whether at least one of the occupant's head, torso, and leg exceeds a posture threshold.

[0019] In accordance with another aspect of the present disclosure, the control module further comprises executable code to determine whether the occupant is in an incorrect posture based on comparing the captured image of the occupant with at least one of the stored images, and the posture zone further comprises executable code to determine whether at least one of the occupant's head, torso, and leg exceeds a posture threshold.

[0020] In accordance with another aspect of the present disclosure, the control module further includes executable code to output a message to the occupant when the occupant is determined to be in an incorrect posture.

[0021] In accordance with another aspect of the present disclosure, the control module further includes executable code to perform a driving action when the occupant is determined to be in an awkward posture.

[0022] In accordance with another aspect of the present disclosure, the control module further comprises executable code for capturing a second image of an occupant in the vehicle seat when seat movement is detected, and storing the second image as the stored image.

[0023] In accordance with another aspect of the present disclosure, the control module further includes executable code for adjusting the first seat belt output length when movement of the motor vehicle seat is detected.

[0024] In accordance with another aspect of the present disclosure, the control module further comprises executable code to adjust at least one of the following: the actual initial position image, the reference posture image, the actual initial posture zone, and the reference posture zone is adjusted based on the vehicle movement.

[0025] In accordance with another aspect of the present disclosure, a method for determining when an occupant in a motor vehicle seat and restrained by a seatbelt restraint system has an incorrect body posture. The method includes detecting the presence of a seatbelt locking plate in the seatbelt buckle to determine whether the seatbelt is fastened using a seatbelt buckle sensor, storing a first seatbelt dispensing length after the seatbelt buckle sensor detects the presence of the seatbelt locking plate in the buckle, detecting a second seatbelt dispensing length, determining a difference between the first seatbelt dispensing length and the second seatbelt dispensing length, capturing an image of the occupant in the vehicle seat,if the difference between the first and second seat belt output lengths has exceeded the seat belt output length threshold, determining whether an occupant has an incorrect posture based on the image of the occupant on the vehicle seat, and taking an action if the occupant has an incorrect posture based on the image of the occupant on the vehicle seat.

[0026] In accordance with another aspect of the present disclosure, the method includes storing a stored image as at least one of a reference pose image, an actual initial pose image, a reference pose zone, and an actual initial pose zone.

[0027] In accordance with another aspect of the present disclosure, the method further comprises storing the first seatbelt output length within at least a first time window and a second time window In accordance with another aspect of the present disclosure, determining whether an occupant has an incorrect posture based on the image of the occupant in the vehicle seat further comprises comparing the stored image with at least one of the following images: the reference posture image, the actual initial posture image, the reference posture zone, and the actual initial posture zone.

[0028] In accordance with another aspect of the present disclosure, determining whether an occupant has an improper posture based on the image of the occupant on the vehicle seat further comprises comparing the image of the occupant captured by the occupant posture sensor with a stored image. In accordance with another aspect of the present disclosure, determining whether the occupant has an incorrect posture based on comparing the captured image of the occupant with at least one of the stored images and the posture zone further comprises determining whether at least one of the occupant's head, torso, and leg regions exceeds a posture threshold.

[0029] Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE CHARACTERS

[0030] The figures described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. 1A is a front view of a vehicle seat and safety restraint system in an exemplary embodiment; Fig. 1B is a front view of a vehicle seat and alternative safety restraint system according to an exemplary embodiment; Fig. 1C is a front view of a vehicle seat and another alternative safety restraint system according to an exemplary embodiment; Fig. 1D is a front view of a vehicle seat and yet another alternative safety restraint system according to an exemplary embodiment; and Fig. 2 is a flowchart illustrating a method for detecting the position of occupants in a vehicle seat according to an exemplary embodiment; and Fig. 3 and Fig. 4 are front and side views showing an occupant seated in a vehicle seat and restrained by the seat belt webbing of a safety restraint system according to an exemplary embodiment. DETAILED DESCRIPTION

[0031] The following description is merely exemplary and is not intended to limit the present disclosure, application, or uses.

[0032] With reference to Fig. 1a shows a safety restraint system 10 for a motor vehicle according to an embodiment of the invention. The safety restraint system 10 includes a seatbelt retractor 12, a seatbelt webbing 14, a guide loop 16, a locking plate 18, a seatbelt buckle 20, a seatbelt buckle sensor 22, occupancy sensors 24, 25, a seatbelt webbing release sensor 26, and an occupant posture sensor 28. The seatbelt retractor 12 is attached to a structural part of the motor vehicle adjacent to a vehicle seat 30. The seatbelt retractor 12 is bolted, for example, to the base of the B-pillar 32 or another structural part of the vehicle. Alternatively, the seatbelt retractor 12 can be integrated into the base of the seat 30 of the motor vehicle and rigidly attached thereto.A frame 34 of the seat belt retractor 12 is adapted to rotatably support a spool 36 for free rotation within the retractor 12.

[0033] A spring (not shown) is attached at one end to the retractor frame 34 and at the other end to the spool 36 to retract the seat belt webbing 14 onto the spool 36 and into the retractor 12. The seat belt webbing 14 is at least partially wound around the spool 36 to store the seat belt webbing 14 in the retractor 12 when the safety restraint system 10 is not in use. When the safety restraint system 10 is in use, the seat belt webbing 14 is unwound from the spool 36 and pulled out of the retractor 12 by a vehicle occupant. The seat belt webbing 14 is typically made of a woven fabric material such as woven nylon or polyester.

[0034] The seat belt webbing output sensor 26 is in communication with the retractor spool 36. The seat belt webbing output sensor 26 is configured to detect the rotation of the retractor spool 36. A computer or microprocessor control system 38 receives a spool rotation signal from the seat belt webbing output sensor 26 and is configured to determine the length of seat belt webbing output from the rotation of the spool 36 of the retractor 12.

[0035] The guide loop 16 is typically fixedly attached to the motor vehicle, specifically toward the B-pillar 32 of the motor vehicle. An optional slot 40 is provided in the guide loop 16 to receive and slidably engage the seat belt webbing 14. The seat belt webbing 14 typically extends upward from the retractor 12 along the B-pillar 32 and is guided through the guide loop 16, where the seat belt webbing 14 is directed downward toward the base of the seat 30 and secured at one end 41 to a structural member of the motor vehicle or to the seat 30.

[0036] The locking plate 18 has a slot 44 through which the seat belt webbing is threaded to slidably engage the locking plate 18 with the seat belt webbing 14. The locking plate 18 is located on the seat belt webbing 14, generally between the guide loop 16 and the end portion 41 of the seat belt webbing 14. The buckle 20 is configured to releasably engage the locking plate 18. Typically, the locking plate 18 is pushed into a slot 42 in the buckle 20. After the locking plate 18 is fully inserted into the buckle 20, the locking plate 18 is locked in the buckle 20. A button on the buckle 20 is pressed to release the locking plate 18 from the buckle 20.

[0037] The seatbelt buckle sensor 22 is provided in the seatbelt buckle 20. The buckle sensor 22 is configured to detect the presence of the locking plate 18. The buckle sensor 22 transmits a control signal to the microprocessor control system 38. The microprocessor control system 38 contains a control algorithm that receives the control signal from the seatbelt buckle sensor 22 and determines whether the locking plate 18 is present in the seatbelt buckle 20.

[0038] One or more occupancy sensors 24, 25 are provided next to the vehicle seat 30, such as the occupant cabin sensor 24, or in the vehicle seat 30, such as the occupant seat sensor 25. The occupant seat sensor 25 assesses the presence of occupants using various means such as one or more pressure pads, weight pads, load cells, resistance pads, and biometric sensors. The cabin occupancy sensor 24 outside the seat 30 would assess the presence of the occupants in various ways, e.g., via one or more cameras, RADARs, ultrasonic sensors, infrared sensors, etc. The presence sensors 24, 25 are configured to detect the presence of a vehicle occupant (as indicated by reference number 301 in Fig. and Fig. indicated) on the seat 30. Each occupancy sensor 24, 25 sends a control signal to the microprocessor control system 38. The microprocessor control system 38 contains a control algorithm that receives the control signal from the occupancy sensor 24, 25 and determines whether the occupant is on the seat 30. Occupancy sensors 24, 25 can detect certain objects as an occupant. The occupancy sensors 24, 25 can have one or more detection thresholds to distinguish people from objects, detect a person's size, and detect a person's position relative to the seat surface. Additionally, an occupant posture sensor 28 is provided in the passenger compartment of the vehicle 45 to detect an initial posture of a vehicle occupant on the seat 30. The posture sensor 28 can be integrated with the sensors 24, 25 or different from them.The initial posture of the vehicle occupant can then be compared to a current posture of the vehicle occupant to determine if the posture of the vehicle occupant has changed. The occupant posture sensor 28 is a vision- or wave-based sensor system that uses infrared waves, ultrasonic waves, radar, laser, or similar technologies. In one embodiment of the present disclosure, an image of the current posture of a vehicle occupant on the vehicle seat is captured by the occupant posture sensor. The image of the current posture of a vehicle occupant on the vehicle seat is compared to a reference image or a previously obtained image of an occupant sitting upright on the vehicle seat and leaning against the backrest of the vehicle seat 30.In one embodiment of the present disclosure, the image of at least one of the occupant's head, torso, or legs is compared to a zone or zones around the image of an occupant sitting upright on the vehicle seat and against the back of the vehicle seat 30, and this comparison is used to determine if the occupant has an incorrect posture.

[0039] Fig. 1B, Fig. 1C and Fig. 1D show alternative seat belt arrangements. Fig. 1B shows a compartment mount for the retractor 12, and the guide loop 16 is mounted on or near the seat 30. Fig. 1C and Fig. 1D illustrate seat belt systems with two retractors 12. One or both of the retractors 12 have a seat belt webbing output sensor 26. Each webbing output sensor 26 transmits a control signal to the microprocessor control system 38. The locking plate 18 is sewn into the seat belt webbing 14. In embodiments with two seat belt webbing output sensors 26, the method uses the two measured output lengths together. In one embodiment of the present invention, a correction factor is multiplied by one or both output lengths to achieve a more accurate determination according to the method of the present disclosure. In another embodiment, systems with two output sensors 26, the method considers each of the output lengths individually with different thresholds and executes each routine separately for each sensor input.

[0040] The present disclosure includes a plurality of algorithms or methods for determining the posture of a vehicle occupant on seat 30 based on the microprocessor control system 38 receiving and processing the control signals from the seat belt buckle sensor 20, the occupancy sensors 24, 25, the seat belt release sensors 26, and the occupant posture sensor 28. The microprocessor control system 38 includes a computer memory for storing the plurality of algorithms or methods. Furthermore, the microprocessor control system 38 includes a processor for executing the computer code defining the plurality of algorithms or methods.The plurality of algorithms or methods utilize the control signals provided by the seat belt buckle sensor 20, the occupancy sensors 24, 25, the seat belt output sensors 26, and the occupant posture sensor 28 to determine the posture of a vehicle occupant on the seat 30 and to decide whether the determined occupant posture requires an action such as a notification or a drive action, and to either issue a notification to the vehicle occupant or activate a drive action.

[0041] With reference to Fig. 2, there is shown a flowchart illustrating a method 100 for detecting the position of occupants in a vehicle seat according to the present invention. More specifically, the method 100 is configured to detect whether an occupant is positioned forward in the vehicle seat, a child occupant is lying sideways in the seat, multiple occupants are sitting in a seat and some or all are buckled in with a seat belt, a child occupant is sitting inboard or outboard, an occupant is angled in the seat, an occupant is crouching in the seat, an adult or child is leaning forward in the seat, or an occupant is twisted in the seat. The method 100 begins at block 102 after it has been determined that an occupant is in the vehicle seat 30 and the occupant is buckled in. Occupant presence is determined based on the output of the occupancy sensors 24, 25.An occupant is determined to be buckled based on the presence of the locking plate 18 in the seat belt buckle 20, as detected by the buckle sensor 22. In block 104, it is determined whether the seat belt output length has changed beyond a first output length change threshold, which in one exemplary embodiment is the stored static length. The first output length change threshold is a calibratable value or is hard-coded into the methods or algorithm.

[0042] In method 100, the stored static length is determined by one of the following approaches: a) the actual output length upon buckling, b) the average output length over a predetermined time window from the time of buckling, c) the minimum output length over a predetermined time window from the time of buckling (to account for an occupant leaning forward or twisting during or immediately after buckling), d) the average or minimum output length between a predetermined time window beginning and ending at predetermined times after buckling, e) the minimum output length before the seat belt output increases (or increases above a predetermined amount), and alternatively limited to within a predetermined time window after buckling, f) if the ALR function in the seat belt retractor has been activated,then the stored static length is the minimum output length within a predetermined time window after ALR activation, and g) if a belted occupant is present in the vehicle seat, any of the above-mentioned stored static length determination methods may be used to determine the stored static length, however, the stored static length is determined after the belted occupant has retracted the seat belt to remove the slack in the seat belt webbing. Alternatively, in the above examples, the window for determining the stored static length is terminated once the seat belt webbing retraction speed exceeds a predetermined rate. If the change in seat belt output length is not greater than a first predefined change in seat belt output length,the method 100 continues at block 106. At block 106, the method 100 proceeds to the next method or algorithm or returns to block 102.

[0043] However, if the change in seat belt output length is greater than the first output length change threshold, then the method 100 continues to block 108. At block 108, a determination is made as to whether the vehicle seat occupant has an improper posture. Improper posture is defined herein as, for example, an occupant positioned forward in the vehicle seat, a child lying sideways in the seat, multiple occupants sitting in a seat with some or all of them buckled in, a child sitting in the inside or outside, an occupant slouched in the seat, an occupant slouched in the seat, an adult or child leaning forward in the seat, or an occupant twisted in the seat.

[0044] If at block 108 it is determined that the vehicle seat occupant is in an incorrect posture, method 100 continues to block 110. At block 110, a message is delivered to the vehicle occupants and / or a driving action is performed. The messages conveyed to the vehicle occupants are visual, audible, haptic, or a combination thereof. For example, the messages and driving actions that can be taken are: a) instructing the occupant to correct the occupant's posture, b) preventing the trip from commencing, c) entering the vehicle and parking the vehicle in a low-risk location, d) remotely resetting the system, observing the interior environment to assess the situation, or engaging in dialogue with the occupant, and e) activating a message icon, generating an audible tone, vibrating a seat, or a combination thereof. After block 110, the method continues to block 106.From block 106, the method 100 proceeds to the next method or algorithm or returns to block 102.

[0045] If it is determined at block 108 that the vehicle seat occupant does not have a malposition, then method 100 continues with block 106. From block 106, method 100 proceeds to the next method or algorithm or returns to block 102.

[0046] In an exemplary embodiment of the present invention, the incorrect posture of the occupant, as determined in block 108, is determined by capturing an image of the occupant and comparing the captured image to a posture image, such as a reference posture image or an actual initial posture image. For example, the actual initial posture image is determined from a stored image of the occupant on the vehicle seat 30 within a first time window beginning when the occupant inserts the locking plate 18 into the seat belt buckle 20. The length of the first time window is calibratable or hard-programmed. Within the first time window, the actual initial stored image of the occupant is, for example, the correct or upright posture of the occupant. Alternatively, the reference posture image is selected from a plurality of stored posture images of occupants with upright postures.The selection of the stored posture image of the occupant as the reference posture image is based on the occupant's shape. A current image of the occupant is compared with the stored posture images, and a stored posture image that matches the shape is selected as the reference posture image.

[0047] Alternatively, the actual home position image is, for example, an actual image of the occupant captured within the second time window, starting with the occupant's presence on the vehicle seat 30 until the locking plate 18 is detected in the seat belt buckle 20. The image selected as the actual home position image is, for example, an image of the occupant when the occupant is most upright on the vehicle seat 30.

[0048] With reference to the Fig. 3 and Fig. 4, a front and side view of an occupant 301 in the vehicle seat 30 restrained by the seat belt webbing 14 of the safety restraint system 10 is shown in accordance with an embodiment of the present invention. A posture zone 302 is defined around the occupant 301, as illustrated by the dashed boundary line 303. In one example of the present invention, the posture zone 302 is an actual initial posture zone. The actual initial posture zone is defined as the space in which the occupant is located, as determined from a stored image of the occupant in the vehicle seat 30 captured within a first time window when the occupant inserts the locking plate 18 into the seat belt buckle 20, referred to herein as the actual initial posture image.Alternatively, the actual initial posture zone is defined as a space outside the space in which the occupant is located, as determined from a stored image of the occupant on the vehicle seat 30 taken within a first time window when the occupant inserts the locking plate 18 into the seat belt buckle 20. The actual initial posture zone is, in an exemplary embodiment, the shape of the occupant, or the actual initial posture zone threshold is defined as a perimeter around the occupant that is larger than the occupant, as shown in FIG. Fig. 3 and Fig. 4. The elevation of the limit line 303 is a calibratable input or is hard-coded into the method 100.

[0049] Alternatively, posture zone 302 is a reference image posture zone. The reference image posture zone is selected, for example, from a plurality of stored posture images of occupants with an upright posture, referred to herein as a reference posture image. The selection of the reference posture image is based on the size of the occupant. A current image of the occupant is compared with the plurality of stored posture images of the occupant, and a shape-matched stored image of the occupant is selected as the reference posture image. In one example of the present invention, the posture zone of the reference image is defined as the space in which the reference posture image lies. Alternatively, the posture zone of the reference image is defined as a space outside the space in which the reference posture image lies.The posture zone of the reference image is, in an exemplary representation, the shape of the occupant in the reference posture image or the posture zone boundary of the reference image is defined as a perimeter around the occupant in the reference posture image that is larger than the occupant, as shown in FIGS. Fig. 3 and Fig. 4. The increase in the limiting magnitude can be a calibratable input or hard-coded into method 100.

[0050] Furthermore, different posture thresholds are set for different positions to detect whether an occupant's current posture is inappropriate. The posture thresholds are, for example, the amount by which an occupant's body overlaps the posture zone 302, the actual initial posture image, or the posture reference image. In one embodiment of the present disclosure, an incorrect posture is present when at least one of the head, torso, and legs is outside the posture zone 302, the actual initial posture image, or the posture reference image by an amount that exceeds the posture threshold.Alternatively, an incorrect posture is present when at least one of the head, torso, and legs is within the posture zone 302, the actual initial posture image, or the reference posture image by an amount that exceeds the posture threshold. The detection method used to detect an incorrect posture is capable of ignoring weapons, hats, and other objects to prevent a false determination of an incorrect posture. Additionally, the method 100 may remove the head, the legs, or both. The method also has the ability to specify how far or how much overlap is required to reach the posture threshold. This may be a calibratable input or it may be hard-coded into the algorithm.

[0051] The posture zone 302, the actual initial posture image, the reference posture image, and the initial seatbelt output length are changed when the seat position is adjusted to the movement of the seat position. Thus, the posture zone 302, the actual initial posture image, the reference posture image, and the threshold for changing the seatbelt output length are adjusted according to the movement of the vehicle seat. For example, the posture zone 302 moves forward or backward, up or down, or tilts forward or backward, up or down, or tilts during vehicle seat adjustment. The cabin occupancy sensor 24 detects the seat movement, or sensors on the seat mechanisms can detect the seat movement. The initial seatbelt output length is adjusted based on the seat movement.

[0052] Alternatively, an image of the occupant is captured once the seat movement has stopped. The captured image of the occupant is used to create a new, actual initial posture image zone, which represents an image of the acceptable posture.

[0053] The size of the actual initial posture image, reference image, or posture zone, the shape of the actual initial posture image, reference image, or posture zone, and the posture zone threshold can be changed based either on time or on vehicle motion. For example, adjustments to the posture zone size, posture zone shape, and posture zone threshold are made to allow more occupant movement prior to messaging or driving actions or less movement prior to messaging or driving actions. For example, once a vehicle is moving, the amount of occupant movement prior to messaging and driving actions can be reduced, and once the vehicle has stopped, the amount of occupant movement prior to messaging and driving actions can be expanded.As another example, the method could allow more occupant movement for a period of time during which an occupant can reach an object, and then allow less occupant movement after a period of time during which the system detects the occupant reaching for an object and exceeding or falling below the actual initial posture image, the reference posture image, or exceeding a posture zone or threshold. Messaging or driving actions may be delayed for a specified time.

[0054] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations should not be considered a departure from the spirit and scope of the present disclosure.

Claims

[1] A system for determining when an occupant in a motor vehicle seat and restrained by a seat belt restraint system has an incorrect body posture, the system comprising: a seatbelt buckle sensor for detecting the presence of a seatbelt buckle locking plate in the seatbelt buckle to determine whether the seatbelt is fastened; a seat belt dispensing sensor for detecting a first seat belt dispensing length and for detecting a second seat belt dispensing length; an occupant posture sensor for capturing an image of an occupant on the vehicle seat; a control module in communication with the seat belt buckle sensor, the seat belt release sensor, and the occupant posture sensor, the control module having executable code to: Determine the presence of the seat belt locking plate in the seat belt buckle; Determining whether the difference between the first seat belt output length when the seat belt buckle is present in the seat belt buckle and the second seat belt output length is greater than a seat belt output length change threshold; Comparing the image of the occupant captured by the occupant posture sensor with at least one stored image and posture zone if the difference between the first seatbelt output length and the second seatbelt output length is greater than the seatbelt output length change threshold; and Determine whether the occupant has an incorrect posture by comparing the captured image of the occupant with at least one of the stored images and the posture zone. wherein the occupant posture sensor is an ultrasonic sensor, wherein the stored image is at least one of a reference posture image and an actual initial posture image, wherein the posture zone is at least one of a reference posture zone and an actual initial posture zone, where the actual initial posture zone is determined from an actual initial posture image, wherein the control module further comprises executable code for storing the first seatbelt output length within at least a first time window and a second time window, wherein the reference posture image is selected based on the image of the occupant detected by the occupant posture sensor, wherein the reference posture zone is selected from a plurality of stored reference posture images based on a shape of the occupant determined from the captured image of the occupant, wherein the control module further comprises executable code for comparing the image of the occupant captured by the occupant posture sensor with a stored image, further comprising executable code for capturing an image of an occupant on the vehicle seat within at least a first time window or a second time window and storing the image as the stored image, wherein the control module further comprises executable code to determine whether the occupant has an incorrect posture based on the comparison of the captured image of the occupant and the stored image and / or the posture zone, and the posture zone further comprises executable code to determine whether a head, a torso, or a leg of the occupant exceeds a posture threshold.

Citation Information

Patent Citations

  • Safety belt controlling system and method for vehicle

    KR101427922B1

  • Occupant detection apparatus

    US20190094355A1

  • Detection of occupant size and pose with a vehicle interior camera

    WO2016164793A1

  • Method for operating a safety belt system

    WO2019063470A1

  • KR000101427922B1