In-vehicle life monitoring method and in-vehicle life monitoring system
The method and system utilize point cloud analysis to detect the presence of a child in a vehicle by calculating noise ratios and adjusting scores, addressing the ineffectiveness of existing CPD technologies and ensuring timely alarm issuance.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-02-07
- Publication Date
- 2026-04-10
AI Technical Summary
Existing child presence detection (CPD) technologies in vehicles lack effectiveness and real-time monitoring capabilities, failing to accurately determine the presence of a child alone in a vehicle and issue timely alarms as required by regulations.
A method and system using a detector to obtain point cloud information, calculate noise ratios, and determine the presence of a living organism by analyzing mean and standard deviation, issuing alarms based on state parameters and score adjustments.
Effectively and in real-time determines the presence of a child in a vehicle, ensuring timely alarm issuance, thereby enhancing safety compliance.
Smart Images

Figure 0007843881000001 
Figure 0007843881000002 
Figure 0007843881000003
Abstract
Description
Technical Field
[0001] The present invention relates to a method and system for monitoring living beings, and particularly to a method and system for monitoring living beings inside a vehicle. Prior Art
[0002] In the automotive field, child presence detection (CPD) is currently being gradually emphasized to improve safety. On the other hand, the European CPD regulations include two important descriptions. One is that when a child is left alone in the vehicle and unable to escape, the system needs to issue a warning within a predetermined time. The other is that when a warning is issued and an adult goes to rescue or the adult stays in the vehicle, the system continues to detect and解除 the warning within a predetermined time. In well-known technologies, the actual application of CPD is not yet mature, the effect is poor, and there is a lack of a method and system for effectively and real-time monitoring the presence of a child alone in the vehicle and issuing an alarm in the current market. Therefore, all related industries are seeking solutions to this problem.
Summary of the Invention
Problems to be Solved by the Invention
[0003] The object of the present invention is to obtain state parameters corresponding to the state of the vehicle interior space by judging the average value and standard deviation and calculating the score value, effectively judge whether a child exists alone in the vehicle interior space and whether to issue an alarm, and solve the problem that the actual application effect of well-known technologies is not good, and provide a method and system for monitoring living beings inside a vehicle.
Means for Solving the Problems
[0004] According to one embodiment of the method of the present invention, a method for monitoring life inside a vehicle is provided, comprising: detecting the vehicle interior space with a detector and obtaining a plurality of point cloud information; receiving this point cloud information from the detector with a processor, calculating this point cloud information to obtain a plurality of noise ratios corresponding to this point cloud information, and calculating these noise ratios to obtain the mean value and standard deviation of these noise ratios; and performing a determination step with the processor, which includes determining whether life exists in the vehicle interior space according to the mean value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result.
[0005] According to another embodiment of the method of the present invention, a method for monitoring life inside a vehicle is provided, comprising: detecting the vehicle interior space with a detector and obtaining a plurality of point cloud information; receiving this point cloud information from the detector with a processor, calculating this point cloud information to obtain a plurality of noise ratios corresponding to this point cloud information, and calculating these noise ratios to obtain one of the mean value and standard deviation of these noise ratios; and performing a determination step with the processor, which determines whether life exists in the vehicle interior space according to one of the mean value and standard deviation and the number of point clouds located in the space above the vehicle interior space, generates a state determination result, and outputs state parameters corresponding to the state of the vehicle interior space according to the state determination result.
[0006] According to one embodiment of the structural aspects of the present invention, an in-vehicle life monitoring system for monitoring the interior space of a vehicle is provided, comprising: a detector for detecting the interior space of a vehicle and obtaining a plurality of point cloud information; and a processor connected to the detector, which receives the point cloud information, calculates the point cloud information to obtain a plurality of noise ratios corresponding to the point cloud information, calculates the average value and standard deviation of the noise ratios, and performs a decision operation, wherein the decision operation includes determining whether a living organism is present in the interior space according to the average value and standard deviation, generating a state decision result, and outputting state parameters corresponding to the state of the interior space according to the state decision result. [Effects of the Invention]
[0007] As a result, the in-vehicle life monitoring system and method of the present invention can obtain state parameters corresponding to the state of the in-vehicle space by determining at least one of the mean and standard deviation and calculating a score value, and can effectively and in real time determine whether a child is present alone in the in-vehicle space and whether an alarm should be issued. [Brief explanation of the drawing]
[0008] [Figure 1] This is a schematic diagram showing an in-vehicle life monitoring system according to the first embodiment of the present invention. [Figure 2] This is a flowchart showing a method for monitoring living organisms inside a vehicle according to a second embodiment of the present invention. [Figure 3] This is a flowchart showing a method for monitoring living organisms inside a vehicle according to a third embodiment of the present invention. [Figure 4A] Figure 3 is a flowchart of the first score adjustment program. [Figure 4B] Figure 4A is a flowchart showing effective detection. [Figure 4C] Figure 4A is a flowchart for detecting invalidity. [Figure 5A] Figure 3 is a flowchart of the second score adjustment program. [Figure 5B]Figure 5A is a flowchart showing effective detection. [Figure 5C] Figure 5A is a flowchart showing the first score adjustment mechanism for invalid detection. [Figure 5D] Figure 5A is a flowchart showing the second score adjustment mechanism for invalid detection. [Figure 6] This is a flowchart showing a method for monitoring living organisms inside a vehicle according to a fourth embodiment of the present invention. [Modes for carrying out the invention]
[0009] Hereinafter, several embodiments of the present invention will be described with reference to the drawings. In this specification, when an element is "connected" to another element, it may mean that the element is directly connected to the other element, or it may mean that the element is indirectly connected to the other element, that is, that the other element is between the element and the other element. On the other hand, terms such as first, second, third, etc. are used only to describe different elements and are not a restriction on the elements themselves, so the first element can be read as the second element.
[0010] Please refer to Figure 1. Figure 1 is a schematic diagram showing a first embodiment of the in-vehicle life monitoring system 100 of the present invention. The in-vehicle life monitoring system 100 is used to monitor the interior space 110 of a vehicle and includes a detector 200 and a processor 300. The detector 200 is used to detect the interior space 110 and obtain multiple point clouds. The processor 300 is connected to the detector 200 and receives this point cloud information. The processor 300 calculates these point clouds to obtain multiple noise ratios corresponding to these point clouds, calculates these noise ratios to obtain the mean value and standard deviation of these noise ratios, and performs a decision operation. The decision operation includes determining whether a living organism 102 exists in the interior space 110 according to the mean value and standard deviation, generating a state decision result, and outputting state parameters corresponding to the state of the interior space 110 according to the state decision result.
[0011] In one embodiment, the detector 200 may be a radar (e.g., a frequency-modulated continuous wave (FMCW) radar), the processor 300 may be a cloud processor, a digital signal processor (DSP), a microprocessor (MPU), a central processing unit (CPU), or other electronic processor, and may transmit state parameters corresponding to the state of the interior space 110 to the user's mobile device (e.g., a mobile phone), the living being 102 may be a child, the interior space 110 includes the upper space 112, and each point cloud information includes coordinate values (x, y, z). The present invention is not limited to the above.
[0012] Please refer to Figures 1 and 2 together. Figure 2 is a flowchart of the in-vehicle life monitoring method S0 of a second embodiment of the present invention. The in-vehicle life monitoring method S0 is used to monitor the in-vehicle space 110 and is used in the in-vehicle life monitoring system 100, and includes performing steps S02, S04, and S06. Step S02 includes detecting the in-vehicle space 110 with a detector 200 and obtaining a plurality of point cloud information. Step S04 includes receiving this point cloud information from the detector 200 with a processor 300, calculating this point cloud information to obtain a plurality of noise ratios corresponding to this point cloud information, and calculating these noise ratios to obtain the mean value and standard deviation of these noise ratios. Step S06 includes performing a decision step with the processor 300. The decision step includes determining whether a living organism 102 exists in the in-vehicle space 110 according to the mean value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the in-vehicle space 110 according to the state determination result.
[0013] Please refer to Figures 1, 2, and 3. Figure 3 is a flowchart of the in-vehicle life monitoring method S2 according to a third embodiment of the present invention. The in-vehicle life monitoring method S2 is used to monitor the in-vehicle space 110 and is used in the in-vehicle life monitoring system 100. During the monitoring process, from start (when a certain condition that triggers the start of monitoring, such as engine stop, is met) to end (when a certain condition that triggers the end of monitoring, such as engine start, is met), the detector 200 of the in-vehicle life monitoring system 100 continues to receive signals and monitor the in-vehicle space 110 with the in-vehicle life monitoring method S2. Each time the detector 200 receives a signal, the in-vehicle life monitoring system 100 executes the flow of the in-vehicle life monitoring method S2 in order to make a CPD (Continuing Professional Development) judgment. The period from the start to the end of the monitoring process can be divided into multiple cycles, for example, the i-1th cycle (previous cycle), the ith cycle (current cycle), etc., where i is a positive integer of 2 or more, and the flow of the in-vehicle life monitoring method S2 is executed once in each cycle. In other words, unless monitoring has ended, the in-vehicle life monitoring method S2 is periodically and repeatedly executed to continue monitoring the in-vehicle space 110 until the conditions that trigger the termination of monitoring are met, regardless of whether an alarm signal is issued. The in-vehicle life monitoring method S2 includes performing steps S22, S24, S26, and S28. Steps S22 and S24 are similar to steps S02 and S04 in Figure 2, respectively, and will not be described further.
[0014] Step S26 includes the processor 300 performing a decision step. The decision step includes determining whether a living organism 102 exists in the vehicle interior space 110 according to the mean and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space 110 according to the state determination result. More specifically, the decision step further includes determining whether to execute a first score adjustment program S262 or a second score adjustment program S264 in the current cycle according to the state parameters in the previous cycle, generating a decision result, performing calculations on the score value according to the decision result, and determining whether to adjust the state parameters according to the score value after the calculation. The state parameter is one of a first state parameter and a second state parameter, the first state parameter representing the presence of a living organism 102 in the vehicle interior space 110, and the second state parameter representing the absence of a living organism 102 in the vehicle interior space 110. The first score adjustment program S262 and the second score adjustment program S264 are different from each other. The first score adjustment program S262 corresponds to the statement "the state parameter in the previous period is the first state parameter," while the second score adjustment program S264 corresponds to the statement "the state parameter in the previous period is the second state parameter."
[0015] Step S28 includes determining whether the processor 300 will issue an alarm signal depending on the state parameter of the interior space 110 in the current cycle. If the state parameter of the interior space 110 in the current cycle is the first state parameter, the processor 300 will issue an alarm signal. If the state parameter of the interior space 110 in the current cycle is the second state parameter, the processor 300 will not issue an alarm signal.
[0016] As a result, the in-vehicle life monitoring system 100 and in-vehicle life monitoring methods S0 and S2 of the present invention effectively determine whether a child is present alone in the in-vehicle space 110 and whether an alarm should be issued by obtaining state parameters corresponding to the state of the in-vehicle space 110 through the determination of the mean and standard deviation and the calculation of a score value.
[0017] Please refer to FIGS. 3 and 4A together. FIG. 4A is a flowchart showing the first score adjustment program S262 of FIG. 3. The first score adjustment program S262 includes executing steps S262a, S262b, S262c, S262d, S262e, and S262f. Step S262a includes setting the child detection state parameter (cpd_condition) to 0. That the child detection state parameter is equal to 0 indicates that there is no living body 102 in the vehicle interior space 110.
[0018] Step S262b includes comparing whether the average value (snr) of these noise ratios is less than or equal to a preset average value (v1) to generate a first comparison result, and comparing whether the standard deviation (Deviation_CPD) of these noise ratios is between two preset standard deviations (v21, v22) to generate a second comparison result, and determining whether the number of point groups (up_zone_count) located in the upper space 112 of the vehicle interior space 110 is less than or equal to a preset upper space score value (v3) to generate a score determination result, and determining whether there is a living body 102 in the vehicle interior space 110 according to the first comparison result, the second comparison result, and the score determination result. When the first comparison result is YES, and the second comparison result is YES, and the score determination result is YES, the processor 300 executes step S262c (that is, the processor 300 determines that there is a living body 102 in the vehicle interior space 110), and conversely, executes step S262d.
[0019] The above-mentioned preset average value, two preset standard deviations, and the preset upper space score value correspond to a plurality of characteristic values of the living body 102 detected by the detector 200. In one embodiment, when the living body 102 is a child, the preset average value (v1) may be 14 dB (25 watts), and the two preset standard deviations (v21, v22) may be 2.2 and 8.2 respectively (which is regarded as a range, and when the living body 102 is a child, the corresponding standard deviation is between v21 and v22, that is, this range corresponds to the characteristic value of the living body 102 detected by the detector 200), and the preset upper space score value (v3) may be 5, but the present invention is not limited thereto. In other embodiments, step S262b may determine whether there is a living body 102 in the vehicle interior space 110 according to only any two of the first comparison result, the second comparison result, and the score determination result (for example, it can be determined whether there is a living body 102 in the vehicle interior space 110 according to only the first comparison result and the second comparison result. When the first comparison result is YES and the second comparison result is YES, the processor 300 determines that there is a living body 102 in the vehicle interior space 110, and conversely, determines that there is no living body 102 in the vehicle interior space 110).
[0020] Step S262c includes setting the child detection state parameter to 1. When the child detection state parameter is equal to 1, it represents that there is a living body 102 in the vehicle interior space 110.
[0021] Step S262d includes determining whether these point cloud data belong to effective detection according to a first detection determination condition and generating a first detection determination result, where effective detection includes the presence of a living organism 102 in the vehicle interior space 110. The first detection determination condition includes that the number of these point cloud data points (num_valid_point) is greater than or equal to a first preset number threshold, and that the average value of their noise ratios is greater than a first preset average threshold. The first preset number threshold may be one of a number threshold (NVDT_1, where NVDT is an abbreviation for "NUM VALID DETECTION THRESHOLD") and another number threshold (NVDT_2), and the first preset average threshold may be one of an average threshold (AST_1, where AST is an abbreviation for "AVG SNR THRESHOLD") and another average threshold (AST_2). In this embodiment, the first detection determination condition includes either a first determination condition or a second determination condition. The first judgment condition includes that the number of these point cloud information points is greater than or equal to a numerical threshold (NVDT_1) and that the average value of their noise ratios is greater than the average threshold (AST_1). The second judgment condition includes that the number of these point cloud information points is greater than or equal to another numerical threshold (NVDT_2) and that the average value of their noise ratios is greater than another average threshold (AST_2). If the first detection judgment result is YES, the processor 300 executes step S262e, and conversely, if the first detection judgment result is NO, it executes step S262f.
[0022] Step S262e includes performing a score calculation corresponding to valid detection. In step S262e, the processor 300 generates a first adjusted score value by adding at least one value to the score value according to a first parameter set, and then decides whether to adjust the state parameters according to the first adjusted score value. The first parameter set includes child detection state parameters, the movement stability of the organism 102, the score value, and the number of these point cloud information. The movement stability of the organism 102 may be expressed numerically, and a higher numerical value indicates that the movement of the organism 102 is more stable. The magnitude of the score value corresponds to the probability that the organism 102 is a child.
[0023] Step S262f includes performing a score calculation corresponding to non-effective detection. In step S262f, the processor 300 performs at least one subtraction on the score value according to another first set of parameters to generate another first adjusted score value, and then decides whether to adjust the state parameters according to this other first adjusted score value. This other first set of parameters includes child sensing state parameters, score values, and the number of these point cloud information.
[0024] Please also refer to Figures 3, 4A, and 4B. Figure 4B is a flowchart of the effective detection (step S262e) in Figure 4A. In this embodiment, step S262e includes executing steps S2ea, S2eb, S2ec, S2ed, S2ee, S2ef, S2eg, S2eh, S2ei, S2ej, S2ek, and S2el. Step S2ea includes checking whether the child detection state parameter is equal to 1 and generating a first confirmation result. If the first confirmation result is YES, the processor 300 executes step S2eb, and conversely, if the first confirmation result is NO, it executes step S2ec. Step S2eb includes adding to the score value (adding 3). Step S2ec includes checking whether the movement stability (stable) of the living organism 102 corresponds to a preset stability value (STABLE_LEVEL) and checking whether the child detection state parameter is equal to 1, and generating a second confirmation result. If the second confirmation result is YES, the processor 300 executes step S2ed; conversely, if the second confirmation result is NO, it executes step S2ee. Step S2ed includes adding to the score value (adding 2). Step S2ee includes checking whether the child sensing state parameter is equal to 0 and whether the score value is greater than 0 to generate a third confirmation result. If the third confirmation result is YES, the processor 300 executes step S2ef; conversely, if the third confirmation result is NO, it executes step S2eg. Step S2ef includes subtracting from the score value (subtracting 2).
[0025] Step S2eg includes checking whether the child detection state parameter is equal to 1 and whether the number of these point cloud information is greater than or equal to a threshold (NVDT_3) to generate a fourth confirmation result. If the fourth confirmation result is YES, the processor 300 executes step S2eh; conversely, if the fourth confirmation result is NO, it executes step S2ei. Step S2eh includes adding to the score value (adding 3). Step S2ei includes checking whether the score value is greater than or equal to a preset activation alarm critical value (SCORE_THRESHOLD_ACTIVE) to generate a fifth confirmation result. If the fifth confirmation result is YES, the processor 300 executes step S2ej; conversely, if the fifth confirmation result is NO, it executes step S2ek. Step S2ej includes setting the state parameter (state) to the first state parameter (OCCUPYING) and setting the alarm hold time critical value (hold_time_threshold) to a preset alarm cycle (HOLD_TIME_CYCLE). The alarm duration critical value represents the critical value for the duration of the alarm signal. Step S2ek includes setting the state parameter to the second state parameter (NO_OCCUPIED). Step S2el includes setting the maintenance cycle count parameter (detect2freeCount) to 0. The maintenance cycle count parameter represents the maintenance cycle for which the alarm signal is emitted. Finally, the score value obtained after performing step S262e is the first adjusted score value, and a higher score value indicates a higher probability that a living organism 102 exists alone in the vehicle interior space 110.
[0026] Please also refer to Figures 3, 4A, 4B, and 4C. Figure 4C is a flowchart of invalid detection (step S262f) in Figure 4A. In this embodiment, step S262f includes executing steps S2fa, S2fb, S2fc, S2fd, S2fe, S2ff, S2fg, S2fh, S2fi, S2fj, and S2fk. Step S2fa includes checking whether the number of these point cloud information is greater than 0 and whether the score value is greater than 0 to generate a first confirmation result. If the first confirmation result is YES, the processor 300 executes step S2fb, and conversely, if the first confirmation result is NO, it executes step S2fc. Step S2fc includes subtracting from the score value (subtracting 1). Step S2fb includes checking whether the child sensing state parameter is equal to 0 and whether the score value is greater than 0 to generate a second confirmation result. If the second confirmation result is YES, the processor 300 executes step S2fd; conversely, if the second confirmation result is NO, it executes step S2fe. Step S2fd includes subtracting from the score value (subtracting 1). Step S2fe includes checking whether the score value is greater than 0 to generate a third confirmation result. If the third confirmation result is YES, the processor 300 executes step S2ff; conversely, if the third confirmation result is NO, it executes step S2fj.
[0027] Step S2ff includes checking whether the score value is less than or equal to a preset acceleration / decrease critical value (SCORE_THRESHOLD_PROTECT_DECREASE_QUICK) and whether the number of these point cloud information is equal to 0, thereby generating a fourth confirmation result. If the fourth confirmation result is YES, the processor 300 executes step S2fg; conversely, if the fourth confirmation result is NO, it executes step S2fh. Step S2fg includes subtracting from the score value (subtracting 1). Step S2fh includes checking whether the number of these point cloud information is equal to 0 and whether the state parameter (previous_state) in the previous period is the second state parameter, thereby generating a fifth confirmation result. If the fifth confirmation result is YES, the processor 300 executes step S2fi; conversely, if the fifth confirmation result is NO, it executes step S2fj. Step S2fi includes subtracting from the score value (subtracting 1). Step S2fj includes checking whether the score value is less than a preset activation alarm critical value (SCORE_THRESHOLD_ACTIVE) and generating a sixth confirmation result. If the sixth confirmation result is YES, the processor 300 executes step S2fk; conversely, if the sixth confirmation result is NO, it terminates step S262f. Step S2fk includes setting the state parameter to the second state parameter.
[0028] Please also refer to Figures 3, 4A, and 5A. Figure 5A is a flowchart of the second score adjustment program S264 in Figure 3. The second score adjustment program S264 includes performing steps S264a, S264b, S264c, S264d, S264e, and S264f, where steps S264a, S264b, and S264c are the same as steps S262a, S262b, and S262c in Figure 4A, respectively, and will not be explained further.
[0029] Step S264d includes determining whether these point cloud data belong to effective detection according to the second detection determination conditions and generating a second detection determination result, where effective detection includes the presence of a living organism 102 in the vehicle interior space 110. The second detection determination conditions include the average value of these noise ratios being greater than a second preset average threshold (ASRDIO, an abbreviation for "AVG SNR REMAIN DETECTION IN OCCUPANCY"), the number of these point cloud data being greater than or equal to a second preset number threshold (NVDRDIO, an abbreviation for "NUM VALID DETECTION REMAIN DETECTION IN OCCUPANCY"), and the child detection state parameter being equal to 1, where the child detection state parameter being equal to 1 indicates the presence of a living organism 102 in the vehicle interior space 110. If the second detection determination result is YES, the processor 300 executes step S264e, and conversely, if the second detection determination result is NO, it executes step S264f.
[0030] Step S264e includes performing a score calculation corresponding to the valid detection. In step S264e, the processor 300 generates a second adjusted score value by adding at least one value to the score value according to a second parameter set, and then decides whether to adjust the state parameters according to the second adjusted score value. The second parameter set includes the score value and the movement stability of the organism 102.
[0031] Step S264f includes performing a score calculation corresponding to invalid detection. In step S264f, the processor 300 generates another second adjusted score value by subtracting at least one value from the score value according to another second set of parameters, and then decides whether to adjust the state parameters according to this other second adjusted score value. This other second set of parameters includes the number of these point cloud information, the score value, the mean value of their noise ratios, and the maintenance period count parameter.
[0032] Please also refer to Figures 3, 5A, and 5B. Figure 5B is a flowchart of the validity detection (step S264e) in Figure 5A. In this embodiment, step S264e includes executing steps S4ea, S4eb, S4ec, S4ed, S4ee, S4ef, and S4eg. Step S4ea includes checking whether the score value is equal to 0 and generating a first confirmation result. If the first confirmation result is YES, the processor 300 executes step S4eb; conversely, if the first confirmation result is NO, it executes step S4ec. Step S4eb includes setting the maintenance period count parameter to 0. Step S4ec includes checking whether the score value is less than the maximum score value (SCORE_MAX_VALUE) and generating a second confirmation result. If the second confirmation result is YES, the processor 300 executes step S4ed; conversely, if the second confirmation result is NO, it executes step S4eg. Step S4ed includes adding to the score value (adding 2). Step S4ee includes checking whether the movement stability of the living organism 102 corresponds to a preset stability value and generating a third confirmation result. If the third confirmation result is YES, the processor 300 executes step S4ef; conversely, if the third confirmation result is NO, it executes step S4eg. Step S4ef includes adding to the score value (adding 1). Step S4eg includes setting the alarm maintenance time critical value to a preset alarm cycle.
[0033] Please also refer to Figures 3, 5A, 5B, 5C, and 5D. Figure 5C is a flowchart showing the first score adjustment mechanism (step S264h) of invalid detection (step S264f) in Figure 5A, and Figure 5D is a flowchart showing the second score adjustment mechanism (step S264i) of invalid detection (step S264f) in Figure 5A. Step S264f includes executing steps S264g, S264h, and S264i. In Figure 5A, step S264g includes checking whether the number of these point cloud information is less than or equal to a threshold (NVDTH, an abbreviation for "NUM VALID DETECTION TO HOLD") and generating a confirmation result. If the confirmation result is YES, the processor 300 executes step S264h, and conversely, if the confirmation result is NO, it executes step S264i.
[0034] In Figure 5C, step S264h is used to significantly reduce the score value and includes executing steps S4ha, S4hb, S4hc, S4hd, S4he, S4hf, S4hg, S4hh, S4hi, S4hj, S4hk, and S4hl. Step S4ha includes checking whether the score value is greater than 0 and generating a first confirmation result. If the first confirmation result is YES, the processor 300 executes step S4hb; conversely, if the first confirmation result is NO, it executes step S4hc. Step S4hb includes subtracting from the score value (subtracting 3). Step S4hc includes checking whether the number of these point cloud pieces is equal to 0 and whether the score value is less than a preset score value (SCORE_MAX_VALUE / 1.5) and generating a second confirmation result. If the second confirmation result is YES, the processor 300 executes step S4hd; conversely, if the second confirmation result is NO, it executes step S4hi. Step S4hd includes subtracting from the score value (subtracting 2). Step S4he includes checking whether the average of these noise ratios is greater than a preset average value (v4) to generate a third confirmation result. If the third confirmation result is YES, the processor 300 executes step S4hf; conversely, if the third confirmation result is NO, it executes step S4hg. Step S4hf includes subtracting from the score value (subtracting 2). Step S4hg includes checking whether the average of these noise ratios is greater than a preset average value (v1) to generate a fourth confirmation result. If the fourth confirmation result is YES, the processor 300 executes step S4hh; conversely, if the fourth confirmation result is NO, the processor 300 executes step S4hi. Step S4hh includes subtracting from the score value (subtracting 1). Step S4hi includes checking whether the maintenance cycle count parameter is greater than or equal to the alarm maintenance time critical value and generating a fifth confirmation result. If the fifth confirmation result is YES, the processor 300 executes step S4hj; conversely, if the fifth confirmation result is NO, it executes step S4hk.Step S4hj includes setting the state parameter to the second state parameter and setting the maintenance cycle count parameter, alarm maintenance time critical value, and score value to 0. Step S4hk includes checking whether the score value is less than or equal to a preset score value (SCORE_MAX_HIGH_CONFIDENT) and generating a sixth confirmation result. If the sixth confirmation result is YES, the processor 300 executes step S4hl; conversely, if the sixth confirmation result is NO, it terminates step S264h. Step S4hl includes adding to the maintenance cycle count parameter (adding 1).
[0035] In Figure 5D, step S264i is used to slightly decrease the score value and includes executing steps S4ia, S4ib, S4ic, S4id, S4ie, S4if, S4ig, S4ih, S4ii, and S4ij. Step S4ia includes checking whether the score value is greater than 0 and generating a first confirmation result. If the first confirmation result is YES, the processor 300 executes step S4ib; conversely, if the first confirmation result is NO, it executes step S4ig. Step S4ib includes subtracting from the score value (subtracting 2). Steps S4ic, S4id, S4ie, and S4if are the same as steps S4he, S4hf, S4hg, and S4hh in Figure 5C, respectively; steps S4ig and S4ih are the same as steps S4hk and S4hl in Figure 5C, respectively; and steps S4ii and S4ij are the same as steps S4hi and S4hj in Figure 5C, respectively. No further explanation is needed.
[0036] In the examples shown in Figures 3 to 5D, the numerical thresholds (NVDT_1, NVDT_2, NVDT_3) are equal to 3, 2, and 3 respectively, the average thresholds (AST_1, AST_2) are equal to 1.5 and 2.0 respectively, the preset stable value (STABLE_LEVEL) is equal to 2, the preset activation alarm critical value (SCORE_THRESHOLD_ACTIVE) is equal to 16, the preset alarm cycle (HOLD_TIME_CYCLE) is equal to 15, and the preset acceleration / deceleration critical value (SCORE E_THRESHOLD_PROTECT_DECREASE_QUICK) is equal to 6, the second preset average threshold (ASRDIO) is equal to 2, the second preset number threshold (NVDRDIO) is equal to 2, the number threshold (NVDTH) is equal to 2, the maximum score value (SCORE_MAX_VALUE) is equal to 46, the preset average value (v4) is equal to 27 watts, and the preset score value (SCORE_MAX_HIGH_CONFIDENT) is equal to 15. The present invention is not limited to the above.
[0037] Please also refer to Figures 1 and 6. Figure 6 is a flowchart of the in-vehicle life monitoring method S4 of the fourth embodiment of the present invention. The in-vehicle life monitoring method S4 is used to monitor the in-vehicle space 110 and is used in the in-vehicle life monitoring system 100, and includes performing steps S42, S44, and S46. Step S42 includes detecting the in-vehicle space 110 with a detector 200 and obtaining a plurality of point cloud information. Step S44 includes receiving this point cloud information from the detector 200 with a processor 300, calculating this point cloud information to obtain a plurality of noise ratios corresponding to this point cloud information, and calculating these noise ratios to obtain one of the mean value and standard deviation of these noise ratios. Step S46 includes a decision step performed by the processor 300, which includes determining whether a living organism 102 exists in the vehicle interior space 110 based on one of the mean and standard deviation and the number of points in the upper space 112 above the vehicle interior space 110, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space 110 according to the state determination result. Thus, the vehicle interior living organism monitoring method S4 of the present invention can obtain state parameters corresponding to the state of the vehicle interior space 110 by calculating a score value through the determination of one of the mean and standard deviation and the number of points in the upper space 112 above the vehicle interior, and can determine in real time whether a child is present alone in the vehicle interior space 110 and whether an alarm should be issued.
[0038] As can be seen from the above embodiments, the present invention has the following advantages. First, by determining the mean and standard deviation and calculating a score value, state parameters corresponding to the state of the interior space of the vehicle can be obtained, and it is possible to effectively determine whether a child is present alone in the interior space and whether an alarm should be issued, thereby solving the problem that the actual application effect of known technologies is not good. Second, by comprehensively determining either the mean and standard deviation and the number of points in the upper space of the vehicle, state parameters corresponding to the state of the interior space can be obtained by calculating a score value, and it is possible to determine in real time whether a child is present alone in the interior space and whether an alarm should be issued.
[0039] Although the present invention has been disclosed in embodiments as described above, these embodiments are not intended to limit the present invention, and any person skilled in the art can make various modifications and alterations without departing from the spirit and scope of the invention. Therefore, the scope of protection of the present invention should be based on the scope of patents of any later appended applications. [Explanation of symbols]
[0040] 100: In-vehicle life monitoring system 102: Life form 110: Interior space 112: Upper space 200: Detector 300: Processor S0, S2, S4: In-vehicle life monitoring method S02, S04, S06, S22, S24, S26, S28, S262a, S262b, S262c, S262d, S262e, S262f, S264a, S264b, S264c, S264d, S264e, S264 f, S264g, S264h, S264i, S2ea, S2eb, S2ec, S2ed, S2ee, S2ef, S2eg, S2eh, S2ei, S2ej, S2ek, S2el, S2fa, S2fb, S2fc, S2fd S2fe, S2ff, S2fg, S2fh, S2fi, S2fj, S2fk, S42, S44, S46, S4ea, S4eb, S4ec, S4ed, S4ee, S4ef, S4eg, S4ha, S4hb, S4hc, S4hd, S4he, S4hf, S4hg, S4hh, S4hi, S4hj, S4hk, S4hl, S4ia, S4ib, S4ic, S4id, S4ie, S4if, S4ig, S4ih, S4ii, S4ij: Step S262: First Score Adjustment Program S264: Second Score Adjustment Program
Claims
1. A method for monitoring life forms inside a vehicle, for monitoring the interior space of a vehicle, The detector detects the interior space of the vehicle and obtains multiple point cloud information, The processor receives the plurality of point cloud information from the detector, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, and calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios. The processor performs a determination step which includes determining whether living organisms are present in the vehicle interior space according to the mean value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result. Includes, The aforementioned determination step is, The first comparison result is generated by comparing whether the average value of the plurality of noise ratios is less than or equal to a preset average value, A second comparison result is generated by comparing whether the standard deviations of the aforementioned plurality of noise ratios are between two preset standard deviations, To determine whether the living organism is present in the vehicle interior space based on the first and second comparison results, It further includes, The aforementioned preset mean value and the two preset standard deviations correspond to the multiple characteristic values of the living organism detected by the detector. Methods for monitoring life inside a vehicle.
2. The method for monitoring a living organism inside a vehicle according to claim 1, wherein if the first comparison result is YES and the second comparison result is YES, the processor determines that the living organism is present in the vehicle interior space.
3. The aforementioned determination step is, The system determines whether the number of points located in the upper space above the interior of the vehicle is less than or equal to a preset upper space score value, and generates a score determination result. To determine whether the living organism is present in the vehicle interior space based on the first comparison result, the second comparison result, and the score judgment result, The method for monitoring a living organism inside a vehicle according to claim 1, further comprising:
4. The method for monitoring a living organism inside a vehicle according to claim 3, wherein if the first comparison result is YES, the second comparison result is YES, and the score judgment result is YES, the processor determines that the living organism is present in the vehicle interior space.
5. A method for monitoring life inside a vehicle for monitoring the interior space of a vehicle, The detector detects the interior space of the vehicle and obtains multiple point cloud information, The processor receives the plurality of point cloud information from the detector, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, and calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios. The processor performs a determination step which includes determining whether living organisms are present in the vehicle interior space according to the mean value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result. Includes, The aforementioned determination step is, Depending on the state parameters in the previous cycle, it is decided to execute either the first score adjustment program or the second score adjustment program in the current cycle and a decision result is generated, and each of the current cycle and the previous cycle is a processing time in which the in-vehicle life monitoring method is executed once. The process involves performing calculations on the score value according to the result of the aforementioned determination, and deciding whether to adjust the state parameters according to the score value after the calculation. It further includes, The state parameter is one of a first state parameter and a second state parameter, the first state parameter indicates the presence of the living organism in the vehicle interior space, the second state parameter indicates the absence of the living organism in the vehicle interior space, the first score adjustment program and the second score adjustment program are different from each other, the first score adjustment program corresponds to the state parameter in the previous cycle being the first state parameter, and the second score adjustment program corresponds to the state parameter in the previous cycle being the second state parameter. Methods for monitoring life inside a vehicle.
6. The first score adjustment program is The process includes determining whether the plurality of point cloud pieces of information belong to a valid detection according to a first detection determination condition and generating a first detection determination result, wherein the valid detection includes the presence of the living organism in the vehicle interior space, and the first detection determination condition is The number of the aforementioned multiple point cloud information is greater than or equal to a first preset threshold number, The average value of the plurality of noise ratios is greater than a first preset average threshold, A method for monitoring a living organism inside a vehicle according to claim 5, including the method described in claim 5.
7. If the first detection result is YES, the processor generates a first adjusted score value by adding at least one value to the score value according to the first parameter set, and then decides whether to adjust the state parameters according to the first adjusted score value. If the first detection result is NO, the processor performs at least one subtraction on the score value according to another first parameter set to generate another first adjusted score value, and then decides whether to adjust the state parameters according to the other first adjusted score value. The method for monitoring a living organism in a vehicle according to claim 6, wherein the first parameter set includes a child detection state parameter, the movement stability of the living organism, the score value, and the number of the plurality of point cloud information, the magnitude of which corresponds to the possibility that the living organism is a child, and the other first parameter set includes the child detection state parameter, the score value, and the number of the plurality of point cloud information.
8. The second score adjustment program is: The process includes determining whether the plurality of point cloud pieces of information belong to a valid detection according to the second detection determination condition and generating a second detection determination result, wherein the valid detection includes the presence of the living organism in the vehicle interior space, and the second detection determination condition is The average value of the aforementioned plurality of noise ratios is greater than a second preset average threshold, The number of the aforementioned multiple point cloud information is greater than or equal to a second preset threshold, The method for monitoring a living being inside a vehicle according to claim 5, which includes the child detection state parameter being equal to 1, wherein if the child detection state parameter is equal to 1, the vehicle interior space is occupied by the living being and the living being is a child.
9. If the second detection result is YES, the processor generates a second adjusted score value by adding at least one value to the score value according to the second parameter set, and then decides whether to adjust the state parameters according to the second adjusted score value. If the second detection result is NO, the processor performs at least one subtraction on the score value according to another second parameter set to generate another second adjusted score value, and then decides whether to adjust the state parameters according to the other second adjusted score value. The method for monitoring an in-vehicle organism according to claim 8, wherein the second parameter set includes the score value and the mobility stability of the organism, the magnitude of the score value corresponding to the possibility that the organism is the child, and the other second parameter set includes the number of the plurality of point cloud information, the score value, the average value of the plurality of noise ratios and a maintenance period count parameter.
10. The processor further includes determining whether to issue an alarm signal in accordance with the state parameters of the vehicle interior space in the current cycle, If the state parameter of the interior space of the vehicle in the current cycle is the first state parameter, the processor issues the alarm signal. The method for monitoring a living organism inside a vehicle according to claim 5, wherein the processor does not issue the alarm signal when the state parameter of the vehicle interior space in the current cycle is the second state parameter.
11. A method for monitoring life forms inside a vehicle, for monitoring the interior space of a vehicle, The detector detects the interior space of the vehicle and obtains multiple point cloud information, The processor receives the plurality of point cloud information from the detector, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, and calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios. The processor performs a determination step that includes determining whether living organisms exist in the vehicle interior space based on the mean value, the standard deviation, and the number of points located in the space above the vehicle interior space, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result. Includes, The aforementioned determination step is, The first comparison result is generated by comparing whether the average value of the plurality of noise ratios is less than or equal to a preset average value, The system determines whether the number of points located in the upper space above the interior of the vehicle is less than or equal to a preset upper space score value, and generates a score determination result. To determine whether the living organism is present in the vehicle interior space based on the first comparison result and the score judgment result, It further includes, The aforementioned preset average value corresponds to the characteristic value of the living organism detected by the detector. Methods for monitoring life inside a vehicle.
12. A method for monitoring life inside a vehicle for monitoring the interior space of a vehicle, The detector detects the interior space of the vehicle and obtains multiple point cloud information, The processor receives the plurality of point cloud information from the detector, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, and calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios. The processor performs a determination step that includes determining whether living organisms exist in the vehicle interior space based on the mean value, the standard deviation, and the number of points located in the space above the vehicle interior space, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result. Includes, The aforementioned determination step is, A second comparison result is generated by comparing whether the standard deviations of the aforementioned plurality of noise ratios are between two preset standard deviations, The system determines whether the number of points located in the upper space above the interior of the vehicle is less than or equal to a preset upper space score value, and generates a score determination result. To determine whether the living organism is present in the vehicle interior space based on the aforementioned average value, the second comparison result, and the score judgment result, It further includes, The two pre-set standard deviations correspond to the two characteristic values of the living organism detected by the detector. Methods for monitoring life inside a vehicle.
13. A method for monitoring life inside a vehicle for monitoring the interior space of a vehicle, The detector detects the interior space of the vehicle and obtains multiple point cloud information, The processor receives the plurality of point cloud information from the detector, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, and calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios. The processor performs a determination step that includes determining whether living organisms exist in the vehicle interior space based on the mean value, the standard deviation, and the number of points located in the space above the vehicle interior space, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space according to the state determination result. Includes, The processor further includes determining whether to issue an alarm signal according to the state parameter of the interior space of the vehicle, wherein the state parameter is one of a first state parameter and a second state parameter, the first state parameter indicating the presence of the living organism in the interior space, and the second state parameter indicating the absence of the living organism in the interior space. If the state parameter of the interior space is the first state parameter, the processor issues the alarm signal. If the state parameter of the interior space is the second state parameter, the processor does not issue the alarm signal. Methods for monitoring life inside a vehicle.
14. A vehicle life monitoring system for monitoring the interior space of a vehicle, A detector for detecting the interior space of the vehicle and obtaining multiple point cloud information, A processor connected to the detector, which receives the plurality of point cloud information, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios, and performs a decision operation. Includes, The aforementioned determination operation includes determining whether living organisms are present in the vehicle interior space based on the average value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space based on the state determination result. The aforementioned decision-making process is, The first comparison result is generated by comparing whether the average value of the plurality of noise ratios is less than or equal to a preset average value, A second comparison result is generated by comparing whether the standard deviations of the aforementioned plurality of noise ratios are between two preset standard deviations, To determine whether the living organism is present in the vehicle interior space based on the first and second comparison results, It further includes, The aforementioned preset mean value and the two preset standard deviations correspond to multiple characteristic values of the living organism detected by the detector. If the first comparison result is YES and the second comparison result is YES, the processor determines that the living organism is present in the vehicle interior space. In-vehicle life monitoring system.
15. The aforementioned decision-making process is, The system determines whether the number of points located in the upper space above the interior of the vehicle is less than or equal to a preset upper space score value, and generates a score determination result. To determine whether the living organism is present in the vehicle interior space based on the first comparison result, the second comparison result, and the score judgment result, It further includes, The in-vehicle life monitoring system according to claim 14, wherein if the first comparison result is YES, the second comparison result is YES, and the score judgment result is YES, the processor determines that the living organism is present in the in-vehicle space.
16. An in-vehicle life monitoring system for monitoring the interior space of a vehicle, A detector for detecting the interior space of the vehicle and obtaining multiple point cloud information, A processor connected to the detector, which receives the plurality of point cloud information, calculates the plurality of point cloud information to obtain a plurality of noise ratios corresponding to the plurality of point cloud information, calculates the plurality of noise ratios to obtain the mean value and standard deviation of the plurality of noise ratios, and performs a decision operation. Includes, The aforementioned determination operation includes determining whether living organisms are present in the vehicle interior space based on the average value and standard deviation, generating a state determination result, and outputting state parameters corresponding to the state of the vehicle interior space based on the state determination result. The aforementioned decision-making process is, Depending on the state parameters in the previous cycle, it is decided to execute either the first score adjustment program or the second score adjustment program in the current cycle to generate a determination result, and each of the current cycle and the previous cycle is a processing time in which the in-vehicle life monitoring system performs processing once. The process involves performing calculations on the score value according to the result of the aforementioned determination, and deciding whether to adjust the state parameters according to the score value after the calculation. It further includes, The state parameter is one of a first state parameter and a second state parameter, the first state parameter indicates the presence of the living organism in the vehicle interior space, the second state parameter indicates the absence of the living organism in the vehicle interior space, the first score adjustment program and the second score adjustment program are different from each other, the first score adjustment program corresponds to the state parameter in the previous cycle being the first state parameter, and the second score adjustment program corresponds to the state parameter in the previous cycle being the second state parameter. In-vehicle life monitoring system.
17. The processor determines whether to issue an alarm signal according to the state parameters of the vehicle interior space in the current cycle. If the state parameter of the interior space of the vehicle in the current cycle is the first state parameter, the processor issues the alarm signal. The in-vehicle life monitoring system according to claim 16, wherein the processor does not issue the alarm signal when the state parameter of the in-vehicle space in the current cycle is the second state parameter.
Citation Information
Patent Citations
Action detection device and method based on neural network
CN114910902A
In-vehicle passenger identification method and related equipment thereof
CN117864054A
Method and system for detecting seat occupancy state of seating arrangement on the basis of radar point clouds
JP2024000973A
Occupant detection device and occupant detection method
JP2024032257A
Key point detection device based on wireless radar signal, method, and electronic apparatus
JP2024086653A