A seat belt reminder method, system, storage medium and vehicle
By detecting the seat belt status of rear seat occupants through the vehicle controller and selecting an appropriate display device to show the alarm information, the problem of obstructed vision for rear seat occupants not wearing seat belts is solved, thus achieving effective seat belt reminders and occupant safety protection.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2026-03-17
AI Technical Summary
Rear seat occupants cannot receive timely reminders that they are not wearing seat belts, especially due to obstructed vision.
The vehicle controller detects the seat belt wearing status of rear seat occupants, identifies occupants who are not wearing seat belts and their seat positions, and selects an appropriate display device to display alarm information to ensure that the information can be effectively received by the occupants.
It effectively reminds rear seat occupants of not wearing seat belts, raises occupants' safety awareness, ensures timely wearing of seat belts, and enhances occupant safety protection.
Smart Images

Figure CN116588030B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle technology, and more specifically, to a method, system, storage medium, and vehicle for reminding passengers not to wear seat belts. Background Technology
[0002] Seat belts are a passive safety measure used to secure occupants to their seats, reducing the severity of injury. To maximize the protective effect of seat belts, vehicles are equipped with seat belt reminder devices, which issue an alarm when occupants are not wearing seat belts, thus reminding them to put them on immediately.
[0003] In related technologies, when a rear-seat occupant is not wearing a seatbelt, a reminder is displayed on a fixed device in the vehicle, such as the electronic instrument panel. However, the rear seats have a large floor space, and there may be obstructions between the rear-seat occupant's line of sight and the electronic instrument panel, thus preventing them from promptly receiving the seatbelt reminder. Therefore, how to effectively remind rear-seat occupants to wear seatbelts is a problem that urgently needs to be solved. Summary of the Invention
[0004] Based on this, this application provides a method, system, storage medium, and vehicle for reminding rear seat occupants not to wear seat belts, in order to solve the problem of how to effectively remind rear seat occupants not to wear seat belts.
[0005] A first aspect of this application provides a method for reminding passengers not to wear seat belts, applied to an in-vehicle controller, the in-vehicle controller being connected to multiple display devices, the method comprising:
[0006] The detection of the seat belt wearing status of the occupants in the rear seats, wherein the rear seats include the left seat, the middle seat and the right seat;
[0007] Based on the seat belt wearing status of the rear seat occupants, target information of occupants who are not wearing seat belts is determined, and the target information includes: the target seat where the occupant who is not wearing a seat belt is located;
[0008] Based on the target information, at least one target display device from among the plurality of display devices is determined to display the alarm information;
[0009] The alarm information is displayed on at least one target display device, and the alarm information is used to remind occupants who are not wearing seat belts to put on their seat belts.
[0010] Optionally, the target information also includes a target number of occupants not wearing seat belts, and the detection of the seat belt wearing status of rear seat occupants includes:
[0011] The seatbelt wearing status of the rear seats is periodically detected; wherein, in each detection cycle, determining at least one target display device from a plurality of display devices to display alarm information based on the target information includes:
[0012] Based on the target quantity obtained in the previous detection cycle, determine the trend of the target quantity in the current detection cycle;
[0013] Based on the changing trend and the target seat detected in the current detection cycle, at least one target display device is determined from the plurality of display devices.
[0014] Optionally, the plurality of display devices includes a first display device and a plurality of second display devices; wherein the first display device faces the middle seat, and each of the second display devices faces the other rear seats besides the middle seat; determining the at least one target display device from the plurality of display devices based on the changing trend and the target seat detected in the current detection cycle includes:
[0015] If the trend is that the number of targets in the previous detection cycle is less than the number of targets in the current detection cycle, the display device facing the target seat in the current detection cycle is determined as the target display device.
[0016] If the trend indicates that the number of targets in the previous detection cycle is greater than the number of targets in the current detection cycle, the first display device is identified as the target display device.
[0017] Optionally, the vehicle controller is connected to multiple image acquisition modules, wherein the image acquisition modules include a first image acquisition module for acquiring occupant images of all seats in the rear seats, and a second image acquisition module for acquiring occupant images of each of the rear seats respectively. The detection of the seatbelt wearing status of the rear seat occupants includes:
[0018] Detect whether the first image acquisition module is malfunctioning;
[0019] If the first image acquisition module fails, the seat belt wearing status of each rear seat is determined based on the occupant images acquired by the second image acquisition module.
[0020] If the first image acquisition module is not malfunctioning, the seat belt wearing status of the rear seats is determined based on the occupant images acquired by the first image acquisition module.
[0021] Optionally, the second image acquisition module corresponding to the middle seat includes: a first acquisition module and a second acquisition module, wherein the first acquisition module is used to acquire an image of the left occupant of the middle seat, and the second acquisition module is used to acquire an image of the right occupant of the middle seat; when determining the seat belt wearing status of the middle seat based on the occupant image acquired by the second image acquisition module corresponding to the middle seat, the method includes:
[0022] Based on the image of the left-side occupant, a first detection result of the seatbelt wearing status of the middle-seat occupant is obtained;
[0023] Based on the image of the right-side occupant, a second detection result of the seatbelt wearing status of the middle-seat occupant is obtained;
[0024] Based on the first detection result and the second detection result, the seat belt wearing status of the occupant in the middle seat is determined.
[0025] Optionally, determining the seatbelt wearing status of the middle seat occupant based on the first detection result and the second detection result includes:
[0026] If both the first detection result and the second detection result are valid, determine whether the first detection result and the second detection result are consistent.
[0027] If the first detection result is consistent with the second detection result, then the occupant seat belt wearing status indicated by the first detection result and the second detection result is determined as the occupant seat belt wearing status of the middle seat.
[0028] If the first detection result is inconsistent with the second detection result, an alarm is output to instruct the occupant in the middle seat to adjust their sitting posture.
[0029] Optionally, determining the seatbelt wearing status of the middle seat occupant based on the first detection result and the second detection result further includes:
[0030] If either the first detection result or the second detection result is invalid, the occupant seat belt wearing status indicated by the other valid detection result among the first and second detection results shall be determined as the occupant seat belt wearing status of the middle seat.
[0031] A second aspect of this application provides a seatbelt reminder system, the system including an on-board controller and a plurality of display devices connected to the on-board controller, including:
[0032] The detection module is used to detect the seat belt wearing status of the occupants in the rear seats, wherein the rear seats include the left seat, the middle seat and the right seat;
[0033] The determination module is used to determine the target information of occupants who are not wearing seat belts based on the seat belt wearing status of the occupants in the rear seats. The target information includes: the target seat where the occupant who is not wearing a seat belt is located.
[0034] A decision module is configured to determine, based on the target information, at least one target display device from among the plurality of display devices to display the alarm information;
[0035] An execution module is configured to display the alarm information on the at least one target display device, the alarm information being used to prompt occupants who are not wearing seat belts to put them on.
[0036] A third aspect of this application provides a computer-readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the steps of the seatbelt reminder method described in the first aspect of this application.
[0037] A fourth aspect of this application provides a vehicle including the seatbelt reminder system described in the second aspect of this application.
[0038] This application provides a method, system, storage medium, and vehicle for reminding passengers not to wear seat belts. The method includes: detecting the seat belt wearing status of occupants in the rear seats, wherein the rear seats include a left seat, a middle seat, and a right seat; determining target information of an occupant not wearing a seat belt based on the seat belt wearing status of the rear seats, the target information including: the target seat where the occupant not wearing a seat belt is located; determining at least one target display device from a plurality of display devices to display alarm information based on the target information; and displaying the alarm information on the at least one target display device, the alarm information being used to remind the occupant not wearing a seat belt to wear a seat belt.
[0039] The method described in this application is applied to an in-vehicle controller connected to multiple display devices. By detecting the target seat corresponding to an occupant not wearing a seatbelt, the method selects the target display device to display the warning information based on the target seat. This application determines the effective target group for seatbelt reminders based on the target seat, ensuring that the warning information is displayed on a target display device easily visible to occupants not wearing seatbelts. This facilitates targeted and timely delivery of warning information to rear-seat occupants not wearing seatbelts, thereby achieving effective seatbelt reminders for rear-seat occupants. Attached Figure Description
[0040] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0041] Figure 1 This is a flowchart illustrating the steps of a method for reminding someone not to wear a seatbelt, as provided in an embodiment of this application.
[0042] Figure 2 This is a flowchart illustrating the steps of a method for periodically detecting seatbelt wear reminders provided in an embodiment of this application.
[0043] Figure 3 This is a flowchart illustrating the steps of a method for detecting the seatbelt wearing status of an occupant, as provided in an embodiment of this application.
[0044] Figure 4 This is a step diagram illustrating a method for detecting the seatbelt wearing status of a middle seat occupant according to an embodiment of this application;
[0045] Figure 5 This is a schematic diagram of the installation position of a display device and an image acquisition module provided in an embodiment of this application;
[0046] Figure 6 This is a flowchart illustrating the steps of a method for determining the seatbelt wearing status of an occupant based on images of occupants from both sides, as provided in an embodiment of this application.
[0047] Figure 7 This is a flowchart of a method for reminding someone not to wear a seatbelt, provided in an embodiment of this application.
[0048] Figure 8 This is a flowchart of a method for obtaining the seat belt wearing status of the middle seat occupant, provided in an embodiment of this application;
[0049] Figure 9 This is a schematic diagram of a seatbelt reminder system provided in an embodiment of this application. Detailed Implementation
[0050] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.
[0051] The first aspect of this application provides an embodiment, such as... Figure 1The diagram illustrates the steps of a method for reminding passengers not to wear seatbelts. The method is applied to an in-vehicle controller, which is connected to multiple display devices, including:
[0052] Step S101: Detect the seat belt wearing status of the occupants in the rear seats, wherein the rear seats include the left seat, the middle seat, and the right seat.
[0053] The rear seats refer to the passenger seats located behind the driver's seat and the front passenger seat, including three seats that can accommodate three passengers. Based on their relative position to the vehicle body, these three seats can be named the left seat, the middle seat, and the right seat. The seat closest to the left side of the vehicle is the left seat, the seat closest to the right side is the right seat, and the seat located between the left and right seats is the middle seat.
[0054] The occupant's seatbelt wearing status includes whether the occupant is wearing a seatbelt or not. When there are occupants in the rear seats, the occupant seatbelt wearing status detection device can be used to detect the left, middle, and right seats in the rear seats separately, thereby obtaining the occupant seatbelt wearing status of the left, middle, and right seats respectively.
[0055] Step S102: Based on the seat belt wearing status of the rear seat occupants, determine the target information of the occupants who are not wearing seat belts. The target information includes: the target seat where the occupants who are not wearing seat belts are located.
[0056] The seatbelt wearing status of the rear seats includes the seatbelt wearing status of the left, middle, and right seats. Based on the obtained seatbelt wearing status of the left, middle, and right seats, the target information of occupants not wearing seatbelts is determined, including the target seat where the occupant not wearing a seatbelt is located.
[0057] For example, if the occupant seatbelt wearing status detection device detects that the occupant in the left seat and the middle seat is not wearing a seatbelt, while the occupant in the right seat is wearing a seatbelt, then according to the detection results, the occupants not wearing seatbelts are located in the left and middle seats, respectively. Therefore, the target seats for the occupants not wearing seatbelts are the left and middle seats.
[0058] Step S103: Based on the target information, determine at least one target display device from among the plurality of display devices to display the alarm information.
[0059] The target seat refers to the seat corresponding to the occupant who is not wearing a seat belt. If the occupant of the left seat is not wearing a seat belt, then the seat corresponding to the occupant who is not wearing a seat belt is the left seat.
[0060] The warning message is used to remind occupants who are not wearing seat belts to put them on. Therefore, it is clear that the effective target group for the warning message is occupants who are not wearing seat belts.
[0061] For example, if the occupant in the right-hand seat is already wearing a seatbelt, but a warning message reminding them to wear a seatbelt is still sent to them, then since the right-hand occupant is already protected by the seatbelt, sending a seatbelt reminder message to them will not further enhance their safety. Therefore, occupants already wearing seatbelts are not the effective target group for the warning message.
[0062] Conversely, if a warning message reminding an unbelted occupant in the left-hand seat to wear a seatbelt is sent, then that occupant is currently unprotected. However, if the warning message is sent, that occupant is more likely to wear their seatbelt upon receiving the reminder, thus improving their safety. Therefore, unbelted occupants are the effective target group for the warning message.
[0063] In summary, by determining the target seats corresponding to occupants not wearing seat belts and the number of target occupants not wearing seat belts, the effective target group for alarm information can be accurately determined. Then, based on the location of the effective target group, a target display device that facilitates the effective target group to obtain alarm information can be determined.
[0064] Step S104: Display the alarm information on the at least one target display device. The alarm information is used to remind occupants who are not wearing seat belts to put them on.
[0065] After identifying the target display device, the alarm information is displayed on it to remind occupants who are not wearing seat belts to put them on immediately. Furthermore, considering that some occupants who are not wearing seat belts may not realize the protective role of seat belts due to insufficient safety awareness even after receiving the alarm, the alarm information may also include information explaining the protective role of seat belts to enhance occupants' safety awareness.
[0066] The method described in this embodiment is applied to an in-vehicle controller connected to multiple display devices. By detecting the target seat corresponding to an occupant not wearing a seatbelt, the method selects the target display device to show the warning information based on the target seat. This embodiment determines the effective target group for the unbelted seatbelt reminder based on the target seat, ensuring that the warning information is displayed on a target display device easily visible to unbelted occupants. This facilitates the targeted and timely delivery of warning information to rear-seat occupants not wearing seatbelts, thereby achieving effective seatbelt reminders for rear-seat occupants.
[0067] The second aspect of this application provides an embodiment, such as Figure 2 The diagram illustrates the steps of a method for periodically detecting seatbelt unwearing reminders, the method comprising:
[0068] Step S201: Periodically detect the seat belt wearing status of the rear seats.
[0069] Periodically checking the seat belt wearing status of the rear seats refers to checking the seat belt wearing status of the rear seats multiple times at fixed intervals. For example, if the seat belt wearing status of the rear seats is checked in 5-second intervals, then the check should be performed again at multiples of 5 seconds, such as 5 seconds, 10 seconds, etc., after the first check.
[0070] Step S202: Based on the seat belt wearing status of the rear seat occupants, determine the target information of occupants who are not wearing seat belts. The target information includes: the target seat where the occupants who are not wearing seat belts are located and the target number of occupants who are not wearing seat belts.
[0071] The target seat refers to the seat corresponding to the occupant who is not wearing a seat belt. If the occupant of the left seat is not wearing a seat belt, then the seat corresponding to the occupant who is not wearing a seat belt is the left seat.
[0072] The target number of occupants refers to the number of occupants who are not wearing seat belts. If, in the rear seats, the occupants of the left and middle seats are not wearing seat belts, it means that the occupants who are not wearing seat belts are located in the left and right seats, and the target number of occupants is two.
[0073] For example, if the detection results show that the occupant of the left seat is not wearing a seatbelt, the occupant of the middle seat is not wearing a seatbelt, and the occupant of the right seat is wearing a seatbelt, then according to the detection results, the occupants not wearing seatbelts are located in the left and middle seats, and there are two occupants not wearing seatbelts. Therefore, the target seats for the unbelted occupants are the left and middle seats, and the target number of unbelted occupants is two.
[0074] Step S203: In each detection cycle, based on the number of targets obtained in the previous detection cycle, determine the trend of the change in the number of targets in the current detection cycle; based on the trend of change and the target seats detected in the current detection cycle, determine the at least one target display device from the plurality of display devices.
[0075] Each inspection cycle acquires target information on occupants not wearing seat belts. This information includes the target number of occupants not wearing seat belts and the target seats where these occupants are located. By comparing the target number acquired in the current inspection cycle with that acquired in the previous cycle, the trend of the target number in the current inspection cycle can be obtained.
[0076] Taking this inspection cycle as the second inspection cycle as an example, the previous inspection cycle is the first inspection cycle. If the target number of occupants not wearing seat belts is one in the first inspection cycle, and the target number of occupants not wearing seat belts is two in the second inspection cycle, since the target number in the first cycle is less than the target number in the second inspection cycle, the trend of the target number in the second inspection cycle can be determined as the target number in the previous inspection cycle being less than the target number in this inspection cycle.
[0077] When the target information of unbelted occupants in the rear seats changes between two adjacent detection cycles, in order to avoid the problem of frequent switching of the display interface of the display device caused by the alarm information jumping between different display devices, the target display device can be determined by combining the changing trend of the number of targets in this detection cycle and the target seats detected in this detection cycle.
[0078] Step S204: Display the alarm information on the target display device. The alarm information is used to remind occupants who are not wearing seat belts to put on their seat belts.
[0079] After identifying the target display device, the alarm information is displayed on it to remind occupants who are not wearing seat belts to put them on immediately. The alarm information includes reminders for all seat belt-wearing occupants in the target seats. Furthermore, considering that some occupants who are not wearing seat belts may not realize the protective role of seat belts due to insufficient safety awareness even after receiving the alarm reminder, the alarm information may also include information explaining the protective role of seat belts to enhance occupant safety awareness.
[0080] Specifically, on the target display device, seats where occupants are wearing seat belts can be displayed in gray, while seats where occupants are not wearing seat belts can be displayed in red.
[0081] Optionally, the plurality of display devices include a first display device and a plurality of second display devices; wherein the first display device faces the middle seat, and each of the second display devices faces the other rear seats besides the middle seat, and step S203 includes:
[0082] Step a: If the trend is that the number of targets in the previous detection cycle is less than the number of targets in the current detection cycle, the display device facing the target seat in the current detection cycle is determined as the target display device.
[0083] The trend of the target number in this inspection cycle is that the target number in the previous inspection cycle is less than the target number in this inspection cycle, meaning the target number in this inspection cycle is greater than the target number in the previous inspection cycle, and the target number in this inspection cycle is relatively higher than the target number in the previous inspection cycle. For example, if the target number of unbelted occupants in the previous inspection cycle was one, then the target number in this inspection cycle will be two or three. When the target number of unbelted occupants increases, to ensure the effectiveness of the alarm information for newly added unbelted occupants in this inspection cycle, the display device facing the target seat in this inspection cycle should be designated as the target display device.
[0084] Taking the previous testing cycle as an example where the target quantity was two, and this testing cycle has three target quantities, with the target seats being the left, middle, and right seats, the trend of the target quantity in this testing cycle can be determined based on the target quantity of the previous testing cycle: the target quantity of the previous testing cycle is less than the target quantity of this testing cycle. Based on this, and considering that the target seats in this testing cycle are the left, middle, and right seats, the target display devices are determined to be display devices facing the left, right, and middle seats, respectively. Specifically, the target display devices consist of a first display device facing the middle seat and two second display devices facing the left and right seats, respectively.
[0085] Step b: If the trend shows that the number of targets in the previous detection cycle is greater than the number of targets in the current detection cycle, then the first display device is identified as the target display device.
[0086] The trend of the target number in this inspection cycle is that the target number in the previous inspection cycle is greater than the target number in this inspection cycle, meaning the target number in this inspection cycle is less than the target number in the previous inspection cycle, and the target number in this inspection cycle is lower than the target number in the previous inspection cycle. For example, if the target number of occupants not wearing seat belts was three in the previous inspection cycle, then the target number in this inspection cycle will be one or two. Even if the target number of occupants not wearing seat belts decreases, regardless of whether the target number in this inspection cycle decreases to one or two, to avoid frequent switching of the display interface caused by alarm information jumping between display devices, the alarm information should be directly displayed on the display device that is easily visible to all occupants in the rear seats, i.e., the first display device facing the middle seat.
[0087] Optionally, the vehicle controller is connected to multiple image acquisition modules, wherein the image acquisition modules include a first image acquisition module for acquiring occupant images of all seats in the rear seats, and a second image acquisition module for acquiring occupant images of each of the rear seats respectively, such as... Figure 3 The diagram illustrates the steps of a method for detecting the wearing status of an occupant's seatbelt. Step S101 includes:
[0088] Step S1011: Detect whether the first image acquisition module is malfunctioning.
[0089] To accommodate the large space of the rear seats while ensuring the effectiveness of capturing seatbelt wearing status, the vehicle controller is connected to multiple image acquisition modules for collecting images of rear seat occupants. These image acquisition modules are of two types: a first image acquisition module for capturing images of the left, right, and middle rear seats, and multiple second image acquisition modules for capturing images of each rear seat occupant individually.
[0090] During the image acquisition process, the scheme for acquiring rear seat occupant images can be determined based on the working status of the first image acquisition module. The working status of the first image acquisition module includes: failure and not failure. First image acquisition module failure means that the first image acquisition module malfunctions or cannot determine the seatbelt wearing status of the rear seat occupants based on the acquired occupant images. First image acquisition module effectiveness means that the vehicle controller can obtain the seatbelt wearing status of all rear seats, including the left, middle, and right seats, based on the acquired occupant images.
[0091] If the first image acquisition module fails, proceed to step S1012; if the first image acquisition module does not fail, proceed to step S1013.
[0092] Step S1012: If the first image acquisition module fails, the seat belt wearing status of each rear seat is determined based on the occupant images acquired by the second image acquisition module.
[0093] When the first image acquisition module fails, i.e., the first image acquisition module malfunctions, or cannot determine the seat belt wearing status of the rear seats based on the occupant images it has acquired, the seat belt wearing status of each rear seat can be determined based on the occupant images acquired by the second image acquisition module.
[0094] Step S1013: If the first image acquisition module is not faulty, then the occupant seat belt wearing status of the rear seat is determined based on the occupant image acquired by the first image acquisition module.
[0095] When the first image acquisition module is not malfunctioning, that is, when the vehicle controller can obtain the seat belt wearing status of all rear seats, including the left, middle and right seats, based on the occupant images it has acquired, in order to save the resources required for vehicle operation, the seat belt wearing status of the rear seats can be obtained directly from the occupant images acquired by the first image acquisition module.
[0096] Optionally, the second image acquisition module corresponding to the middle seat includes: a first acquisition module and a second acquisition module, wherein the first acquisition module is used to acquire an image of the left occupant of the middle seat, and the second acquisition module is used to acquire an image of the right occupant of the middle seat, such as... Figure 4 The diagram illustrates a method for detecting the seatbelt wearing status of a middle seat occupant. Step S1012 includes:
[0097] Step 1: Based on the left occupant image, obtain the first detection result of the seat belt wearing status of the middle seat occupant.
[0098] Due to space limitations in the rear seats, the second image acquisition module for capturing images of the middle seat occupant cannot be installed directly in front of the middle seat. If the seatbelt wearing status of the middle seat occupant is determined solely by the image acquired by a single second image acquisition module, errors in judgment are likely to occur. Therefore, the second image acquisition module includes a first acquisition module for capturing images of the occupant on the left side of the middle seat, and a second image acquisition module for capturing images of the occupant on the right side of the middle seat. By combining the images of the left and right occupants, the seatbelt wearing status of the middle seat occupant is determined, thereby ensuring the accuracy of the seatbelt wearing status assessment.
[0099] The first acquisition module is installed on the left side of the middle seat to acquire an image of the left occupant. Based on this image, image recognition technology is used to determine the occupant's seatbelt wearing status, and this determination is taken as the first detection result. If the seatbelt wearing status is determined to be unbelted, the first detection result is "occupant not wearing seatbelt"; otherwise, if it is determined to be "occupant wearing seatbelt," the first detection result is "occupant wearing seatbelt."
[0100] Step 2: Based on the image of the right-side occupant, obtain a second detection result of the seat belt wearing status of the middle-seat occupant.
[0101] The second acquisition module is installed on the right side of the middle seat to acquire an image of the right-side occupant. Based on this image, it determines the occupant's seatbelt wearing status and uses this determination as the second detection result. If the seatbelt wearing status is determined to be unbelted, the second detection result is "occupant not wearing seatbelt"; otherwise, it is "occupant wearing seatbelt".
[0102] Step 3: Based on the first detection result and the second detection result, determine the seat belt wearing status of the occupant in the middle seat.
[0103] The first detection result is determined based on the image of the left occupant, and the second detection result is determined based on the image of the right occupant. Therefore, by combining the first and second detection results, the seat belt wearing status of the middle seat occupant is determined, achieving multi-angle determination and ensuring the accuracy of the determination result.
[0104] like Figure 5 The diagram shows the installation position of a display device and an image acquisition module. The relative positions of the display device and the image acquisition module can be referenced. Figure 5 The layout is as shown.
[0105] The first display device is located in front of the middle seat, specifically, it can be installed on the vehicle roof. Two second display devices are installed in front of the left and right seats respectively, specifically behind the driver's seat and the front passenger seat. Considering that the first display device provides good coverage for image acquisition and display when installed on the vehicle roof, and its position meets the acquisition requirements of the first image acquisition module, the first image acquisition module can be integrated into the first display device to improve the vehicle's information transmission efficiency.
[0106] Similarly, to improve the efficiency of vehicle information transmission, the second image acquisition module for acquiring images of the left-side seat occupants and the second image acquisition module for acquiring images of the left-side seat occupants of the middle seat can be integrated into the second display device facing the left-side seat, and the second image acquisition module for acquiring images of the right-side seat occupants and the second image acquisition module for acquiring images of the right-side seat occupants of the middle seat can be integrated into the second display device facing the right-side seat.
[0107] Optionally, such as Figure 6 The diagram illustrates the steps of a method for determining occupant seatbelt wearing status based on images of both sides of the occupants. Step 3 includes:
[0108] Step 31: If both the first detection result and the second detection result are valid detection results, determine whether the first detection result and the second detection result are consistent.
[0109] A valid test result refers to a test result that accurately indicates the seat belt wearing status of the middle seat occupant. For example, if the first test result indicates that the middle seat occupant is not wearing a seat belt, then either the first test result or the second test result indicates that the middle seat occupant is wearing a seat belt or not wearing a seat belt, both are valid test results.
[0110] If the first test result is consistent with the second test result, proceed to step 32; if the first test result is inconsistent with the second test result, proceed to step 33.
[0111] Step 32: If the first detection result is consistent with the second detection result, then the occupant seat belt wearing status indicated by the first detection result and the second detection result is determined as the occupant seat belt wearing status of the middle seat.
[0112] If both the first and second test results are valid, and if they are consistent, then both results indicate that the occupant of the middle seat is either not wearing a seatbelt or wearing a seatbelt. If the first and second test results are consistent, it indicates that the seatbelt wearing status indicated by both results is accurate, and this status can be determined as the seatbelt wearing status of the middle seat.
[0113] Step 33: If the first detection result is inconsistent with the second detection result, an alarm is output to instruct the occupant in the middle seat to adjust their sitting posture.
[0114] If the first test result is inconsistent with the second test result, it indicates that the seat belt wearing status indicated by the first test result and the second test result is inaccurate. The occupant needs to further adjust his or her sitting posture, and then re-capture the left and right occupant images of the middle seat.
[0115] Optionally, if either the first detection result or the second detection result is invalid, the occupant seat belt wearing status indicated by the other valid detection result between the first detection result and the second detection result shall be determined as the occupant seat belt wearing status of the middle seat.
[0116] An invalid detection result means that the vehicle controller cannot determine the occupant's seatbelt wearing status based on the occupant image collected by the first or second detection module. When either the first or second detection result is invalid, the occupant's seatbelt wearing status indicated by the other valid detection result can be directly determined as the occupant's seatbelt wearing status for the middle seat.
[0117] For example, if the first test result is invalid and the second test result is valid, then the occupant seat belt wearing status indicated by the second test result will be determined as the occupant seat belt wearing status of the middle seat.
[0118] Alternatively, the target display device may also be determined based on the user's selection.
[0119] After determining the target display devices based on the target seats and number of unbelted occupants, the user can disable the display of alarm information on some target display devices via voice control or other means to avoid affecting the user's use of the display devices. Furthermore, when the user disables all target display devices up to the last one, further disabling will be prohibited. However, after the engine is turned off and then powered on again, the system will re-determine the target display devices. This means the disabling effect before the engine was turned off will not affect the re-determination after the vehicle is started; in other words, it does not memorize the settings, maximizing user safety every time the vehicle is started.
[0120] A third aspect of this application provides an embodiment, such as... Figure 7 A flowchart illustrating a method for reminding someone not to wear a seatbelt is shown, the method comprising:
[0121] The system periodically acquires the seat belt wearing status of the rear seats. When the first image acquisition module is not malfunctioning, the seat belt wearing status of the rear seats is determined by the occupant images acquired by the first image acquisition module. When the first image acquisition module is malfunctioning, the seat belt wearing status of the rear seats is determined by the occupant images of each rear seat acquired by multiple second image acquisition modules.
[0122] Based on the seatbelt wearing status of occupants, determine the target seats where occupants without seatbelts are located and the target number of occupants without seatbelts. Based on the target number in the previous inspection cycle, determine the trend of the target number in the current inspection cycle, that is, determine whether the target number in the previous inspection cycle is greater than the target number in the current inspection cycle.
[0123] If the number of targets in the previous testing cycle is greater than the number of targets in the current testing cycle, the first display device facing the middle seat is determined as the target display device; if the number of targets in the previous testing cycle is less than the number of targets in the current testing cycle, the display device facing the target seat in the current testing cycle is determined as the target display device.
[0124] Among them, such as Figure 8 The flowchart illustrating a method for obtaining the seatbelt wearing status of the middle seat occupant includes:
[0125] The first acquisition module acquires an image of the left occupant of the middle seat, and the second acquisition module determines the image of the right occupant of the middle seat. A first detection result is obtained based on the left occupant image, and a second detection result is obtained based on the right occupant image.
[0126] If both the first and second test results are valid, determine whether the first and second test results are consistent. If they are consistent, the occupant seatbelt wearing status indicated by the first and second test results is determined as the occupant seatbelt wearing status of the middle seat. If they are inconsistent, issue an alarm to the occupant of the middle seat to adjust their sitting posture, and obtain the first and second test results again.
[0127] If neither the first nor the second test result is a valid result, it is determined whether only one of the first and second test results is invalid. If only one invalid result exists, the occupant seatbelt detection status indicated by the other valid result is determined as the occupant seatbelt detection status of the middle seat. If not only one invalid result exists, i.e., both the first and second test results are invalid, the occupant seatbelt wearing status of the middle seat is displayed as invalid on the target display device.
[0128] The fourth aspect of this application provides an embodiment, such as Figure 9 The diagram illustrates a seatbelt reminder system, which includes:
[0129] The system includes an on-board controller and multiple display devices connected to the on-board controller, including:
[0130] The detection module is used to detect the seat belt wearing status of the occupants in the rear seats, wherein the rear seats include the left seat, the middle seat and the right seat;
[0131] The determination module is used to determine the target information of occupants who are not wearing seat belts based on the seat belt wearing status of the occupants in the rear seats. The target information includes: the target seat where the occupant who is not wearing a seat belt is located.
[0132] A decision module is configured to determine, based on the target information, at least one target display device from among the plurality of display devices to display the alarm information;
[0133] An execution module is configured to display the alarm information on the at least one target display device, the alarm information being used to prompt occupants who are not wearing seat belts to put them on.
[0134] Optionally, the detection module is further configured to periodically detect the seat belt wearing status of the occupants of the rear seats; wherein, in each detection cycle, the determining module is further configured to determine the changing trend of the target quantity in the current detection cycle based on the target quantity obtained in the previous detection cycle; and determine the at least one target display device from the plurality of display devices according to the changing trend and the target seats detected in the current detection cycle.
[0135] Optionally, the plurality of display devices includes a first display device and a plurality of second display devices; wherein the first display device faces the middle seat, and each of the second display devices faces the other rear seats besides the middle seat; the decision module is further configured to, when the trend is that the number of targets in the previous detection period is less than the number of targets in the current detection period, determine the display device facing the target seat in the current detection period as the target display device; and when the trend is that the number of targets in the previous detection period is greater than the number of targets in the current detection period, determine the first display device as the target display device.
[0136] Optionally, the vehicle controller is connected to multiple image acquisition modules, wherein the image acquisition modules include a first image acquisition module for acquiring occupant images of all seats in the rear seats, and a second image acquisition module for acquiring occupant images of each of the rear seats respectively; the detection module is further configured to detect whether the first image acquisition module is malfunctioning; if the first image acquisition module is malfunctioning, the seat belt wearing status of each rear seat is determined based on the occupant images acquired by the second image acquisition module; if the first image acquisition module is not malfunctioning, the seat belt wearing status of the rear seats is determined based on the occupant images acquired by the first image acquisition module.
[0137] Optionally, the second image acquisition module corresponding to the middle seat includes a first acquisition module and a second acquisition module, wherein the first acquisition module is used to acquire an image of the left occupant of the middle seat, the second acquisition module is used to acquire an image of the right occupant of the middle seat, and the detection module is further used to obtain a first detection result of the seat belt wearing status of the middle seat occupant based on the left occupant image; obtain a second detection result of the seat belt wearing status of the middle seat occupant based on the right occupant image; and determine the seat belt wearing status of the middle seat occupant based on the first detection result and the second detection result.
[0138] Optionally, the detection module is further configured to determine whether the first detection result and the second detection result are consistent if both the first detection result and the second detection result are valid detection results; if the first detection result and the second detection result are consistent, then the occupant seat belt wearing status indicated by the first detection result and the second detection result is determined as the occupant seat belt wearing status of the middle seat; if the first detection result and the second detection result are inconsistent, then an alarm is output to instruct the occupant in the middle seat to adjust their sitting posture.
[0139] Optionally, the detection module is further configured to determine the occupant seat belt wearing status indicated by the other valid detection result among the first detection result and the second detection result as the occupant seat belt wearing status of the middle seat if either the first detection result or the second detection result is an invalid detection result.
[0140] This application also provides a computer-readable storage medium storing a computer program / instructions thereon, which, when executed by a processor, implements a method for reminding someone not to wear a seatbelt as disclosed in this application.
[0141] This application also provides a vehicle, including a seatbelt reminder system provided in this application.
[0142] The method described in this application is applied to an in-vehicle controller connected to multiple display devices. By detecting the target seat corresponding to an occupant not wearing a seatbelt, the method selects the target display device to display the warning information based on the target seat. This application determines the effective target group for seatbelt reminders based on the target seat, ensuring that the warning information is displayed on a target display device easily visible to occupants not wearing seatbelts. This facilitates targeted and timely delivery of warning information to rear-seat occupants not wearing seatbelts, thereby achieving effective seatbelt reminders for rear-seat occupants.
[0143] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.
[0144] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, systems, electronic devices, and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0145] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0146] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0147] Although preferred embodiments of the present application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present application.
[0148] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes the element.
[0149] The above provides a detailed description of a method, system, storage medium, and vehicle for reminding passengers not to wear seat belts. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. A seat belt non-wearing reminding method characterized by comprising: The method is applied to a vehicle-mounted controller connected with multiple display devices, and comprises the following steps: detecting a seat belt wearing state of passengers in rear seats, wherein the rear seats comprise a left seat, a middle seat and a right seat; determining target information of passengers without seat belts according to the seat belt wearing state of passengers in the rear seats, wherein the target information comprises a target seat where the passengers without seat belts are located, and the target information further comprises a target number of passengers without seat belts; determining at least one target display device for displaying warning information from the multiple display devices based on the target information; displaying the warning information on the at least one target display device, wherein the warning information is used to prompt the passengers without seat belts to wear seat belts; the detection of the seat belt wearing state of passengers in the rear seats comprises periodic detection of the seat belt wearing state of passengers in the rear seats, wherein in each detection period, the determination of the at least one target display device for displaying warning information from the multiple display devices based on the target information comprises determination of a change trend of the target number in the current detection period based on the target number obtained in the last detection period, and determination of the at least one target display device from the multiple display devices according to the change trend and the target seat detected in the current detection period.
2. The method of claim 1, wherein, the multiple display devices comprise a first display device and multiple second display devices, wherein the first display device faces the middle seat, and each second display device faces a rear seat other than the middle seat, and the determination of the at least one target display device from the multiple display devices according to the change trend and the target seat detected in the current detection period comprises: in a case where the change trend is that the target number in the last detection period is less than the target number in the current detection period, determining a display device facing the target seat in the current detection period as the target display device; in a case where the change trend is that the target number in the last detection period is greater than the target number in the current detection period, determining the first display device as the target display device.
3. The method of claim 1, wherein, the vehicle-mounted controller is connected with multiple image acquisition modules, wherein the image acquisition modules comprise a first image acquisition module for acquiring passenger images of all seats in the rear seats, and second image acquisition modules for respectively acquiring passenger images of each rear seat, and the detection of the seat belt wearing state of passengers in the rear seats comprises: detecting whether the first image acquisition module is invalid; if the first image acquisition module is invalid, determining the seat belt wearing state of passengers in each rear seat based on the passenger images acquired by the second image acquisition modules; if the first image acquisition module is not invalid, determining the seat belt wearing state of passengers in the rear seats based on the passenger images acquired by the first image acquisition module.
4. The method of claim 3, wherein, The second image acquisition module corresponding to the middle seat comprises a first acquisition module and a second acquisition module, wherein the first acquisition module is configured to acquire a left passenger image of the middle seat, and the second acquisition module is configured to acquire a right passenger image of the middle seat; when determining the passenger seat belt wearing state of the middle seat based on the passenger image acquired by the second image acquisition module corresponding to the middle seat, the method comprises: obtaining a first detection result of the middle seat passenger seat belt wearing state based on the left passenger image; obtaining a second detection result of the middle seat passenger seat belt wearing state based on the right passenger image; determining the passenger seat belt wearing state of the middle seat based on the first detection result and the second detection result.
5. The method of claim 4, wherein, The determination of the passenger seat belt wearing state of the middle seat based on the first detection result and the second detection result comprises: in the case that the first detection result and the second detection result are both valid detection results, determining whether the first detection result and the second detection result are consistent; if the first detection result and the second detection result are consistent, determining the passenger seat belt wearing state indicated by the first detection result and the second detection result as the passenger seat belt wearing state of the middle seat; if the first detection result and the second detection result are inconsistent, outputting an alarm to indicate that the passenger located in the middle seat adjusts the sitting posture.
6. The method of claim 4, wherein, The determination of the passenger seat belt wearing state of the middle seat based on the first detection result and the second detection result further comprises: in the case that any one of the first detection result and the second detection result is an invalid detection result, determining the passenger seat belt wearing state indicated by the other valid detection result of the first detection result and the second detection result as the passenger seat belt wearing state of the middle seat.
7. A seat belt non-wearing reminding system characterized by comprising: The system comprises a vehicle-mounted controller and a plurality of display devices connected to the vehicle-mounted controller, comprising: a detection module configured to detect the passenger seat belt wearing state of the rear seats, wherein the rear seats comprise a left seat, a middle seat and a right seat; the detection of the passenger seat belt wearing state of the rear seats comprises periodic detection of the passenger seat belt wearing state of the rear seats; wherein in each detection period, based on target information, at least one target display device for displaying alarm information is determined from a plurality of display devices, comprising: based on the target quantity obtained in the last detection period, determining the change trend of the target quantity in the current detection period; according to the change trend and the target seat detected in the current detection period, determining the at least one target display device from a plurality of display devices; a determination module configured to determine target information of the passenger who does not wear a seat belt according to the passenger seat belt wearing state of the rear seats, the target information comprising: the target seat where the passenger who does not wear a seat belt is located; the target information further comprises the target quantity of the passenger who does not wear a seat belt; A decision module is configured to determine at least one target display device to display the warning information from the plurality of display devices based on the target information. An execution module is configured to display the warning information on the at least one target display device, the warning information being used to prompt the occupant without wearing the safety belt to wear the safety belt.
8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program, when executed by a processor, implements the steps of the method for reminding the occupant without wearing the safety belt according to any one of claims 1-6.
9. A vehicle characterized by comprising: The system for reminding the occupant without wearing the safety belt according to claim 7. The system for reminding the occupant without wearing the safety belt according to claim 7.
Citation Information
Patent Citations
Vehicle warning device
US20180345903A1