Control method and system based on children's emotion recognition

Abstract

The present invention discloses a control method and system based on child emotion recognition, the method comprising: detecting the pressure of the rear seat to obtain the rear seat pressure value; judging whether the rear seat pressure value reaches a preset pressure threshold; if so, detecting the temperature of the target object on the rear seat to judge whether the target object is alive; if so, determining that there is a child in the rear seat, triggering the central lock to lock and the window opening to rise to the preset opening value; determining the current emotional state of the child according to the sound characteristic value and temperature value of the child in the rear seat; and regulating the child's emotion through the intelligent cockpit system according to the current emotional state of the child. The control method and system based on child emotion recognition of the present invention can realize child emotion recognition and relief, does not require the additional arrangement of rear row cameras, has low cost, and does not involve user privacy; and does not require hardware upgrades, only the existing system in the car needs to be used to realize low-cost child emotion detection and care.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle safe driving, and in particular to a control method and system based on children's emotion recognition. Background Art

[0002] After children stay in the enclosed space of a car for a period of time, they are prone to emotional fluctuations, which may affect the driver's driving and even cause safety accidents.

[0003] At present, children's emotion recognition is realized through cameras. The realization principle is to add facial texture to the facial expression training data in the video image mode, and fuse the GFCC features and MFCC features of the training data set in the voice mode. Finally, according to the recognition results of vision and voice, they are fused at the decision layer according to the weight value to realize multimodal children's emotion recognition. The disadvantages of this solution are that, on the one hand, it only recognizes emotions without relieving them; on the other hand, children's emotion recognition based on visual recognition has a large computing pressure, and the camera may involve data security issues.

[0004] Therefore, there is an urgent need for a control method and system based on children's emotion recognition. Summary of the invention

[0005] The purpose of the present invention is to provide a control method and system based on children's emotion recognition to solve the problems in the above-mentioned prior art, which can realize children's emotion recognition and relief without the need to deploy cameras and has low cost.

[0006] The present invention provides a control method based on children's emotion recognition, which includes:

[0007] Testing the rear seat pressure to obtain the rear seat pressure value;

[0008] Determining whether the rear seat pressure value reaches a preset pressure threshold, where the preset pressure threshold is used to indicate a weight limit of a child;

[0009] If yes, then detecting the temperature of the target on the rear seat to determine whether the target is alive;

[0010] If so, it is determined that there is a child in the rear seat, the central lock is triggered to lock and the window opening increases to the preset opening value;

[0011] Determine the current emotional state of the child according to the voice characteristic value and temperature value of the child in the back row;

[0012] According to the child’s current emotional state, the child’s emotions are adjusted through the intelligent cockpit system.

[0013] In the control method based on child emotion recognition as described above, preferably, the detecting of the rear seat pressure specifically includes:

[0014] The rear seat pressure is detected by a rear seat pressure sensor to obtain a rear seat pressure value;

[0015] The rear seat pressure sensor transmits the detected rear seat pressure value to the vehicle body controller.

[0016] In the control method based on child emotion recognition as described above, preferably, the step of judging whether the rear seat pressure value reaches a preset pressure threshold value specifically includes:

[0017] The vehicle body controller determines whether the rear seat pressure value reaches a preset pressure threshold.

[0018] In the control method based on child emotion recognition as described above, preferably, when it is determined that the pressure value of the rear seat reaches a preset pressure threshold, detecting the temperature of the target object on the rear seat to determine whether the target object is alive specifically includes:

[0019] The vehicle body controller determines whether the door is in a closed state and whether the IGN power supply of the vehicle is in a powered-on state;

[0020] If both are yes, the temperature of the target object on the rear seat is detected by the child left behind detection system to obtain a target temperature value;

[0021] If the target temperature value exceeds a preset temperature threshold, it is determined that the target object is a living body.

[0022] In the control method based on child emotion recognition as described above, preferably, the triggering of locking the central lock and raising the window opening to a preset opening value specifically includes:

[0023] After the child-left-behind detection system detects that the target object on the rear seat is alive, the child-left-behind detection system sends a flag to the entertainment information controller;

[0024] The entertainment information controller sends the flag bit to the vehicle body controller;

[0025] The vehicle body controller sends a working instruction to the central lock and the window in response to the flag position, so as to trigger the central lock to lock and the window opening to rise to a preset value.

[0026] In the control method based on child emotion recognition as described above, preferably, determining the current emotional state of the child according to the sound feature value and temperature value of the child in the back row specifically includes:

[0027] The voice feature values ​​of the children in the back row are detected in real time through the back row voice module;

[0028] When the voice feature value of the child detected by the voice module meets the preset feature value of bad mood, the child left behind detection system detects the temperature value of the child in the back row in real time;

[0029] The rear-seat voice module sends the detected sound feature value to the entertainment information controller, and the child left behind detection system sends the detected rear-seat child temperature value to the entertainment information controller;

[0030] The entertainment information controller calculates the difference between the current rear-seat child temperature value and the rear-seat temperature value at the previous moment to obtain a temperature difference;

[0031] The entertainment information controller determines whether the temperature difference satisfies a preset temperature range;

[0032] If so, the entertainment information controller performs weighted summation on the sound feature value input by the rear voice module and the rear child temperature value input by the child left behind detection system, and determines the current emotional state of the child based on the result of the weighted summation.

[0033] In the control method based on child emotion recognition as described above, preferably, the step of adjusting the child's emotion through the intelligent cockpit system according to the current child's emotional state specifically includes:

[0034] If the child is in a bad mood, the sound source localization module will locate the child and send the child location information to the entertainment information controller.

[0035] The entertainment information controller sends a first-level emotion adjustment instruction to the cockpit domain controller, so that the cockpit domain controller responds to the first-level emotion adjustment instruction and executes a first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of the non-children's audio program in the rear, and adjusting the interior atmosphere light to change the color and / or flashing frequency with the music;

[0036] After the time for the cockpit domain controller to execute the first-level emotion relief strategy meets the first preset time range, returning to the step of determining the current emotional state of the child according to the voice feature value and the temperature value of the child in the back row, and in the step of determining the current emotional state of the child, increasing the weight of the voice feature value and reducing the weight of the temperature value of the child in the back row;

[0037] If the child's emotional state is still not good at this time, the entertainment information controller sends a second-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the second-level emotion regulation instruction and executes a second-level emotion relief strategy, wherein the second-level emotion relief strategy includes: turning on the chat mode of the rear voice module and the voice speaker is a child;

[0038] After the time for the cockpit domain controller to execute the second-level emotion relief strategy meets the second preset time range, returning to the step of determining the current emotional state of the child according to the voice feature value and the temperature value of the child in the back row, and in the step of determining the current emotional state of the child, increasing the weight of the voice feature value and reducing the weight of the temperature value of the child in the back row;

[0039] If the child's emotional state is still not good at this time, the entertainment information controller sends a third-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the third-level emotion regulation instruction and executes a third-level emotion relief strategy, wherein the third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character image performing a preset action on the rear central control screen, wherein the preset action includes making a sound and performing a dance action;

[0040] During the process of the cockpit domain controller executing the third-level emotion relief strategy, every third preset time, the step of determining the current emotional state of the child according to the voice feature value and the temperature value of the child in the back row is returned, and in the step of determining the current emotional state of the child, the weight of the voice feature value is increased, and the weight of the temperature value of the child in the back row is reduced;

[0041] If the child's emotional state is relieved at this time, the cockpit domain controller controls the virtual image to exit the dance movements, turns off the rear central control screen, and prompts that the music mode is about to be turned on, returning to the first-level emotion relief strategy.

[0042] The present invention also provides a control system based on children's emotion recognition using the above method, comprising:

[0043] A rear seat pressure sensor, a body controller, a child left behind detection system, an intelligent cockpit system and an entertainment information controller, wherein the entertainment information controller is connected to the body controller, the child left behind detection system and the intelligent cockpit system respectively, and the body controller is also connected to the rear seat pressure sensor, wherein:

[0044] The rear seat pressure sensor is used to detect the rear seat pressure and obtain the rear seat pressure value;

[0045] The body controller is used to determine whether the rear seat pressure value reaches a preset pressure threshold, and the preset pressure threshold is used to represent the weight limit of the child;

[0046] The child-remaining detection system is used to detect the temperature of a target object on the rear seat when the vehicle body controller determines that the pressure value of the rear seat reaches a preset pressure threshold, so as to determine whether the target object is alive;

[0047] The vehicle body controller is also used to determine that there is a child in the rear seat when the target object is a living body, and trigger the central lock to lock and the window opening to rise to a preset opening value;

[0048] The entertainment information controller is used to determine the current emotional state of the child according to the sound characteristic value and temperature value of the child in the back seat;

[0049] The smart cockpit system is used to adjust the child's emotions according to the child's current emotional state.

[0050] In the control system based on child emotion recognition as described above, preferably, the vehicle body controller is specifically used to: determine whether the vehicle door is in a closed state, and whether the IGN power supply of the vehicle is in a powered-on state;

[0051] The child abandonment detection system is specifically used to: when the vehicle door is in a closed state and the IGN power supply of the whole vehicle is in a powered-on state, detect the temperature of the target object on the rear seat to obtain a target temperature value, and when the target temperature value exceeds a preset temperature threshold, determine that the target object is alive, and when the target object is alive, send a flag to the entertainment information controller;

[0052] The entertainment information controller is further used to: send the flag bit to the vehicle body controller;

[0053] The vehicle body controller is also used to: in response to the flag position, send a working instruction to the central lock and the window to trigger the central lock to lock and the window opening to rise to a preset value.

[0054] The control system based on child emotion recognition as described above, wherein preferably, the control system based on child emotion recognition further includes a rear-seat voice module, connected to the entertainment information controller, for detecting the voice feature values ​​of the rear-seat children in real time, and sending the detected voice feature values ​​to the entertainment information controller;

[0055] The child left behind detection system is further used to: when the voice characteristic value of the child detected by the voice module meets the preset characteristic value of bad mood, detect the temperature value of the child in the back row in real time, and send the detected temperature value of the child in the back row to the entertainment information controller;

[0056] The entertainment information controller is also used to: calculate the difference between the current temperature value of the rear-seat child and the temperature value of the rear-seat child at the previous moment to obtain the temperature difference, and determine whether the temperature difference meets a preset temperature range, and if the temperature difference meets the preset temperature range, perform weighted summation on the sound feature value input by the rear-seat voice module and the temperature value of the rear-seat child input by the child left behind detection system, and determine the current emotional state of the child according to the result of the weighted summation,

[0057] The smart cockpit system includes a cockpit domain controller and a sound source localization module connected to the cockpit domain controller, a sound field, rear speakers, interior ambient lights, a rear voice module and a rear central control screen, wherein:

[0058] The sound source positioning module is specifically used to locate the child's position when the child is in a bad emotional state, and send the child's positioning information to the entertainment information controller;

[0059] The entertainment information controller is also used to issue a first-level emotion adjustment instruction to the cockpit domain controller;

[0060] The cockpit domain controller is specifically used to: respond to the first-level emotion adjustment instruction and execute the first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of the non-children's audio program in the rear, and adjusting the interior atmosphere light to change the color and / or flashing frequency with the music;

[0061] The entertainment information controller is further used to: send a second-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the first-level emotion relief strategy;

[0062] The cockpit domain controller is further used to: respond to the second-level emotion regulation instruction and execute the second-level emotion relief strategy, wherein the second-level emotion relief strategy includes: turning on the chat mode of the rear voice module and the voice speaker is a child;

[0063] The entertainment information controller is further used to: send a third-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the second-level emotion relief strategy;

[0064] The cockpit domain controller is further used to: respond to the third-level emotion regulation instruction and execute the third-level emotion relief strategy, wherein the third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character performing a preset action on the rear central control screen, wherein the preset action includes making a sound and performing a dance action;

[0065] The cockpit domain controller is also used to: after the child's emotional state is alleviated, control the virtual image to exit the dance movements, turn off the rear central control screen, and prompt that the music mode is about to be turned on, returning to the first-level emotion relief strategy.

[0066] The present invention provides a control method and system based on child emotion recognition. Through pressure detection of the rear seat combined with temperature detection of the target on the rear seat, it is judged whether there is a child in the rear seat, and when there is a child, the central control lock is triggered to lock, and the window opening is increased to ensure the safety of the child; according to the voice characteristic value and temperature value of the child in the rear seat, the child's emotional state is determined, and the child's emotion is adjusted through the intelligent cockpit system, so that both the recognition of the child's emotion and the relief of the child's emotion can be realized, and no additional rear camera is required, the cost is low, and the user privacy is not involved; and the MP5 system does not need to upgrade the hardware, and only needs to use the rear voice module and the child left behind detection system in the car to work together to realize low-cost child emotion detection and care; MP5 outputs the child's emotion and position value after integrating infrared detection, voice source positioning and sound characteristics, and then controls the atmosphere light, online program, sound effect and other systems in the cockpit according to the child's emotion to divert the child's attention and relieve the child's emotion; through the linkage of the child left behind detection system, the rear voice module and MP5, the result evaluation is carried out according to the detection weight in different scenes, and the emotion result is output, so as to realize the recognition and relief of the child's emotion. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described below with reference to the accompanying drawings, in which:

[0068] Figure 1 A flowchart of an embodiment of a control method based on children's emotion recognition provided by the present invention;

[0069] Figure 2 This is a structural block diagram of an embodiment of a control system based on children's emotion recognition provided by the present invention. DETAILED DESCRIPTION

[0070] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended to limit the present disclosure and its application or use. The present disclosure can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the present disclosure thorough and complete and to fully express the scope of the present disclosure to those skilled in the art. It should be noted that unless otherwise specifically stated, the relative arrangement of the components and steps, the composition of the materials, the numerical expressions and the numerical values ​​set forth in these embodiments should be interpreted as being merely exemplary and not as limiting.

[0071] The words "first", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different parts. The words "include" or "comprises" and similar words mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of including other elements. "Up", "down" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0072] In the present disclosure, when a specific component is described as being located between a first component and a second component, there may or may not be an intermediate component between the specific component and the first component or the second component. When a specific component is described as being connected to other components, the specific component may be directly connected to the other components without an intermediate component, or may not be directly connected to the other components but have an intermediate component.

[0073] All terms (including technical terms or scientific terms) used in the present disclosure have the same meanings as those understood by ordinary technicians in the field to which the present disclosure belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries, such as general dictionaries, should be interpreted as having meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined herein.

[0074] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0075] Existing mid-to-high-end configuration vehicles are pre-installed with child left-behind detection systems to detect whether there are children or pets left in the car after leaving the car, but they are not fully utilized in driving scenarios.

[0076] like Figure 1 As shown, the control method based on children's emotion recognition provided by this embodiment includes the following steps in actual execution:

[0077] Step S1, detecting the rear seat pressure to obtain the rear seat pressure value.

[0078] In one embodiment of the control method based on children's emotion recognition of the present invention, step S1 may specifically include:

[0079] Step S11: Detect the rear seat pressure by a rear seat pressure sensor to obtain a rear seat pressure value.

[0080] Step S12: The rear seat pressure sensor sends the detected rear seat pressure value to the body controller.

[0081] Step S2: Determine whether the rear seat pressure value reaches a preset pressure threshold, where the preset pressure threshold is used to indicate a weight limit for a child.

[0082] Specifically, the body controller (BCM) determines whether the rear seat pressure value reaches a preset pressure threshold. In a specific implementation, a pressure sensor can be set under each rear seat, and a weight range of 3-6-year-old children is preset in the body controller. It should be noted that the present invention does not specifically limit the weight limit of children.

[0083] Step S3: If yes, detect the temperature of the target object on the rear seat to determine whether the target object is alive.

[0084] In one embodiment of the control method based on children's emotion recognition of the present invention, step S3 may specifically include:

[0085] Step S31: The vehicle body controller determines whether the vehicle door is in a closed state and whether the IGN power supply of the vehicle is in a powered-on state.

[0086] Step S32: If both are yes, the temperature of the target object on the rear seat is detected by the child left behind detection system to obtain a target temperature value.

[0087] Step S33: If the target temperature value exceeds a preset temperature threshold, it is determined that the target object is a living body.

[0088] Among them, the child abandoned detection system detects the temperature of the target object on the rear seat through an infrared detection sensor and determines whether the target object is alive.

[0089] Step S4: If yes, it is determined that there is a child in the rear seat, the central lock is triggered to lock and the window opening increases to a preset opening value.

[0090] In one embodiment of the control method based on children's emotion recognition of the present invention, step S4 may specifically include:

[0091] Step S41: After the child-left-behind detection system detects that the target object on the rear seat is alive, the child-left-behind detection system sends a flag to an entertainment information controller (MP5).

[0092] Step S42: The entertainment information controller (MP5) sends the flag to the vehicle body controller.

[0093] Step S43: the vehicle body controller sends a working instruction to the central lock and the window in response to the flag position to trigger the central lock to lock and the window opening to rise to a preset value.

[0094] The vehicle body controller can trigger the central lock to lock and the window opening to rise to a preset value to ensure that children will not lean out of the vehicle. The preset value of the window opening is, for example, 70% or 80%, which is not specifically limited in the present invention.

[0095] Step S5: Determine the current emotional state of the child based on the sound feature value and temperature value of the child in the back row.

[0096] In one embodiment of the control method based on children's emotion recognition of the present invention, step S5 may specifically include:

[0097] Step S51, detecting the voice feature values ​​of the children in the back row in real time through the back row voice module.

[0098] Step S52: When the voice characteristic value of the child detected by the voice module meets the preset characteristic value of bad mood (ie, the characteristic value of bad mood), the child left behind detection system detects the temperature value of the child in the back row in real time.

[0099] Among them, the voice feature values ​​of children with bad emotions are pre-trained in the voice algorithm of the voice module, which is convenient for comparing the real-time detected voice feature values ​​of children with the voice feature values ​​of children with bad emotions.

[0100] Step S53: the rear-seat voice module sends the detected sound feature value to the entertainment information controller, and the child left behind detection system sends the detected rear-seat child temperature value to the entertainment information controller.

[0101] Step S54: The entertainment information controller calculates the difference between the current rear-seat child temperature value and the rear-seat temperature value at the previous moment to obtain a temperature difference.

[0102] Step S55: The entertainment information controller determines whether the temperature difference satisfies a preset temperature range.

[0103] The preset temperature range is, for example, 0.1° C.-0.5° C. It should be noted that the preset temperature range is not specifically limited in the present invention.

[0104] Step S56: If the conditions are met, the entertainment information controller performs weighted summation on the sound feature value input by the rear-seat voice module and the rear-seat child temperature value input by the child left behind detection system, and determines the current emotional state of the child based on the result of the weighted summation.

[0105] In one embodiment of the present invention, the weight of the sound characteristic value is 0.6, and the weight of the temperature value of the children in the back row is 0.4. It should be noted that the present invention does not specifically limit the weights of the sound characteristic value and the temperature value of the children in the back row.

[0106] Step S6: According to the child's current emotional state, the child's emotions are adjusted through the intelligent cockpit system.

[0107] In one embodiment of the control method based on children's emotion recognition of the present invention, step S6 may specifically include:

[0108] Step S61: If the child is currently in a bad emotional state, the child's position is located by the sound source localization module, and the child's location information is sent to the entertainment information controller.

[0109] Step S62, the entertainment information controller sends a first-level emotion adjustment instruction to the cockpit domain controller, so that the cockpit domain controller responds to the first-level emotion adjustment instruction and executes a first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of non-children's audio programs in the rear, and adjusting the interior ambient light to change color and / or flashing frequency with the music.

[0110] The first-level emotion relief strategy can attract the child's attention and help relieve the child's emotions. Preferably, the color and flashing frequency of the interior ambient light change with the music.

[0111] Step S63: After the time for the cockpit domain controller to execute the first-level emotion relief strategy meets the first preset time range, return to the step of determining the current emotional state of the child based on the sound feature value and temperature value of the child in the back row, and in the step of determining the current emotional state of the child, increase the weight of the sound feature value and reduce the weight of the temperature value of the child in the back row.

[0112] In one embodiment of the present invention, the weight of the sound characteristic value is increased from 0.6 to 0.7, and the weight of the temperature value of the children in the back row is reduced from 0.4 to 0.3. It should be noted that the present invention does not specifically limit the weight adjustment strategy of the sound characteristic value and the temperature value of the children in the back row.

[0113] Step S64: If the child's emotional state is still not good at this time, the entertainment information controller sends a second-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the second-level emotion regulation instruction and executes a second-level emotion relief strategy. The second-level emotion relief strategy includes: turning on the chat mode of the rear voice module and the voice speaker is the child.

[0114] Children's attention can be better captured through second-level emotion relief strategies.

[0115] Step S65: After the time for the cockpit domain controller to execute the second-level emotion relief strategy meets the second preset time range, return to the step of determining the current emotional state of the child based on the sound feature value and temperature value of the child in the back row (i.e., return to step S5), and in the step of determining the current emotional state of the child, increase the weight of the sound feature value and reduce the weight of the temperature value of the child in the back row.

[0116] In one embodiment of the present invention, the weight of the sound characteristic value is increased from 0.7 to 0.8, and the weight of the temperature value of the children in the back row is reduced from 0.3 to 0.2. It should be noted that the present invention does not specifically limit the weight adjustment strategy of the sound characteristic value and the temperature value of the children in the back row.

[0117] Step S66: If the child's emotional state is still not good at this time, the entertainment information controller sends a third-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the third-level emotion regulation instruction and executes a third-level emotion relief strategy. The third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character performing preset actions on the rear central control screen. The preset actions include making sounds and performing dance moves.

[0118] In one embodiment of the present invention, the virtual image can interact with the child through voice or manual operations.

[0119] Step S67: During the process of the cockpit domain controller executing the third-level emotion relief strategy, every third preset time, return to the step of determining the current emotional state of the child based on the sound characteristic value and temperature value of the child in the back row (i.e. return to step S5).

[0120] Step S68: If the child's emotional state is relieved at this time, the cockpit domain controller controls the virtual image to exit the dance movements, turns off the rear central control screen, and prompts that the music mode is about to be turned on, returning to the first level emotion relief strategy.

[0121] Step S68 can prevent children from suffering from visual fatigue due to looking at the central control screen for a long time.

[0122] The control method based on child emotion recognition provided by the embodiment of the present invention determines whether there is a child in the rear seat by combining the pressure detection of the rear seat with the temperature detection of the target object on the rear seat, and triggers the locking of the central control lock when there is a child, and the window opening increases to ensure the safety of the child; the emotional state of the child is determined according to the voice characteristic value and temperature value of the child in the rear seat, and the child emotion is adjusted by the intelligent cockpit system, which can realize both the recognition of the child's emotion and the relief of the child's emotion, and does not require the additional arrangement of the rear camera, the cost is low, and does not involve user privacy; and the MP5 system does not need to upgrade the hardware, and only needs to use the rear voice module and the child left behind detection system in the car to realize low-cost child emotion detection and care; MP5 outputs the child's emotion and position value after integrating infrared detection, voice source positioning and sound characteristics, and then controls the atmosphere lights, online programs, sound effects and other systems in the cabin according to the child's emotion to divert the child's attention and relieve the child's emotion; through the linkage of the child left behind detection system, the rear voice module and MP5, the result evaluation is carried out according to the detection weight in different scenarios, and the emotion result is output to realize the recognition and relief of the child's emotion.

[0123] Accordingly, if Figure 2 As shown, the present invention also provides a control system based on child emotion recognition, comprising: a rear seat pressure sensor 1, a body controller 2, a child left behind detection system 5, an intelligent cockpit system 3 and an entertainment information controller 4, wherein the entertainment information controller 4 is connected to the body controller 2, the child left behind detection system 5 and the intelligent cockpit system 3 respectively, and the body controller 2 is also connected to the rear seat pressure sensor 1, wherein:

[0124] The rear seat pressure sensor 1 is used to detect the rear seat pressure and obtain the rear seat pressure value;

[0125] The vehicle body controller 2 is used to determine whether the rear seat pressure value reaches a preset pressure threshold, and the preset pressure threshold is used to represent the weight limit of the child;

[0126] The child-remaining detection system 5 is used to detect the temperature of the target object on the rear seat when the vehicle body controller 2 determines that the pressure value of the rear seat reaches a preset pressure threshold, so as to determine whether the target object is alive;

[0127] The vehicle body controller 2 is also used to determine that there is a child in the rear seat when the target object is a living body, and trigger the central lock to lock and the window opening to rise to a preset opening value;

[0128] The entertainment information controller 4 is used to determine the current emotional state of the child according to the sound characteristic value and temperature value of the child in the back seat;

[0129] The smart cockpit system 3 is used to adjust the child's emotions according to the child's current emotional state.

[0130] The vehicle body controller 2 is specifically used to: determine whether the vehicle door is in a closed state, and whether the IGN power supply of the vehicle is in a powered-on state;

[0131] The child abandoned detection system 5 is specifically used for: when the vehicle door is in a closed state and the IGN power supply of the whole vehicle is in a powered-on state, detecting the temperature of the target object on the rear seat, obtaining a target temperature value, and determining that the target object is a living body when the target temperature value exceeds a preset temperature threshold, and sending a flag bit to the entertainment information controller 4 when the target object is a living body;

[0132] The entertainment information controller 4 is further used to: send the flag bit to the vehicle body controller 2;

[0133] The vehicle body controller 2 is further used for sending working instructions to the central lock and the window in response to the flag position, so as to trigger the central lock to lock and the window opening to rise to a preset value.

[0134] Furthermore, the control system based on children's emotion recognition also includes a rear-seat voice module 6, which is connected to the entertainment information controller 4 and is used to detect the voice feature values ​​of the rear-seat children in real time and send the detected voice feature values ​​to the entertainment information controller 4;

[0135] The child left behind detection system 5 is also used for: when the voice characteristic value of the child detected by the voice module meets the preset characteristic value of bad mood, real-time detection of the temperature value of the child in the back row, and sending the detected temperature value of the child in the back row to the entertainment information controller 4;

[0136] The entertainment information controller 4 is also used to calculate the difference between the current temperature value of the rear-seat child and the temperature value of the rear-seat child at the previous moment to obtain the temperature difference, and determine whether the temperature difference satisfies a preset temperature range, and if the temperature difference satisfies the preset temperature range, perform weighted summation on the sound feature value input by the rear-seat voice module 6 and the temperature value of the rear-seat child input by the child left-behind detection system 5, and determine the current emotional state of the child according to the result of the weighted summation.

[0137] The smart cockpit system 3 includes a cockpit domain controller and a sound source localization module connected to the cockpit domain controller, a sound field, rear speakers, interior ambient lights, a rear voice module 6 and a rear central control screen, wherein:

[0138] The sound source positioning module is specifically used to locate the child's position when the child is in a bad emotional state, and send the child positioning information to the entertainment information controller 4;

[0139] The entertainment information controller 4 is also used to issue a first-level emotion adjustment instruction to the cockpit domain controller;

[0140] The cockpit domain controller is specifically used to: respond to the first-level emotion adjustment instruction and execute the first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of the non-children's audio program in the rear, and adjusting the interior atmosphere light to change the color and / or flashing frequency with the music;

[0141] The entertainment information controller 4 is also used to: send a second-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the first-level emotion relief strategy;

[0142] The cockpit domain controller is further used to: respond to the second-level emotion regulation instruction and execute the second-level emotion relief strategy, wherein the second-level emotion relief strategy includes: turning on the chat mode of the rear voice module 6 and the voice speaker is a child;

[0143] The entertainment information controller 4 is further used to: send a third-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the second-level emotion relief strategy;

[0144] The cockpit domain controller is further used to: respond to the third-level emotion regulation instruction and execute the third-level emotion relief strategy, wherein the third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character performing a preset action on the rear central control screen, wherein the preset action includes making a sound and performing a dance action;

[0145] The cockpit domain controller is also used to: after the child's emotional state is alleviated, control the virtual image to exit the dance movements, turn off the rear central control screen, and prompt that the music mode is about to be turned on, returning to the first-level emotion relief strategy.

[0146] The control system based on child emotion recognition provided by the embodiment of the present invention determines whether there is a child in the rear seat by combining the pressure detection of the rear seat with the temperature detection of the target object on the rear seat, and triggers the locking of the central control lock when there is a child, and the window opening increases to ensure the safety of the child; the emotional state of the child is determined according to the voice characteristic value and temperature value of the child in the rear seat, and the child emotion is adjusted by the intelligent cockpit system, which can not only realize the recognition of the child's emotion, but also realize the relief of the child's emotion, without the need to arrange the rear camera additionally, the cost is low, and does not involve user privacy; and the MP5 system does not need to upgrade the hardware, and only needs to use the rear voice module and the child left behind detection system in the car to realize low-cost child emotion detection and care; MP5 outputs the child's emotion and position value after integrating the infrared detection and voice source positioning and sound characteristics, and then controls the atmosphere lights, online programs, sound effects and other systems in the cockpit according to the child's emotion to divert the child's attention and relieve the child's emotion; through the linkage of the child left behind detection system, the rear voice module and MP5, the result evaluation is carried out according to the detection weight in different scenarios, and the emotion result is output to realize the recognition and relief of the child's emotion.

[0147] So far, various embodiments of the present disclosure have been described in detail. In order to avoid obscuring the concept of the present disclosure, some details known in the art are not described. Based on the above description, those skilled in the art can fully understand how to implement the technical solution disclosed here.

[0148] Although some specific embodiments of the present disclosure have been described in detail by way of examples, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified or some technical features may be replaced by equivalents without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A control method based on children's emotion recognition, characterized in that: include: Testing the rear seat pressure to obtain the rear seat pressure value; Determining whether the rear seat pressure value reaches a preset pressure threshold, where the preset pressure threshold is used to indicate a weight limit of a child; If yes, then detecting the temperature of the target on the rear seat to determine whether the target is alive; If so, it is determined that there is a child in the rear seat, the central lock is triggered to lock and the window opening increases to the preset opening value; Determine the current emotional state of the child according to the voice characteristic value and temperature value of the child in the back row; According to the current emotional state of the child, the child's emotions are adjusted through the intelligent cockpit system. Determining the current emotional state of the child according to the sound characteristic value and temperature value of the child in the back row specifically includes: The voice feature values ​​of the children in the back row are detected in real time through the back row voice module; When the voice feature value of the child detected by the voice module meets the preset feature value of bad mood, the child left behind detection system detects the temperature value of the child in the back row in real time; The rear-seat voice module sends the detected sound feature value to the entertainment information controller, and the child left behind detection system sends the detected rear-seat child temperature value to the entertainment information controller; The entertainment information controller calculates the difference between the current rear-seat child temperature value and the rear-seat temperature value at the previous moment to obtain a temperature difference; The entertainment information controller determines whether the temperature difference satisfies a preset temperature range; If so, the entertainment information controller performs weighted summation on the sound feature value input by the rear voice module and the rear child temperature value input by the child left behind detection system, and determines the current emotional state of the child based on the result of the weighted summation.

2. The control method based on children's emotion recognition according to claim 1, characterized in that: The detection of the rear seat pressure specifically includes: The rear seat pressure is detected by a rear seat pressure sensor to obtain a rear seat pressure value; The rear seat pressure sensor transmits the detected rear seat pressure value to the vehicle body controller.

3. The control method based on children's emotion recognition according to claim 2, characterized in that: The determining whether the rear seat pressure value reaches a preset pressure threshold specifically includes: The vehicle body controller determines whether the rear seat pressure value reaches a preset pressure threshold.

4. The control method based on children's emotion recognition according to claim 1, characterized in that: In the case where it is determined that the pressure value of the rear seat reaches a preset pressure threshold, detecting the temperature of the target object on the rear seat to determine whether the target object is a living body specifically includes: The vehicle body controller determines whether the door is in a closed state and whether the IGN power supply of the vehicle is in a powered-on state; If both are yes, the temperature of the target object on the rear seat is detected by the child left behind detection system to obtain a target temperature value; If the target temperature value exceeds a preset temperature threshold, it is determined that the target object is a living body.

5. The control method based on children's emotion recognition according to claim 4, characterized in that: The triggering of the central lock to lock and the window opening to rise to the preset opening value specifically includes: After the child-left-behind detection system detects that the target object on the rear seat is alive, the child-left-behind detection system sends a flag to the entertainment information controller; The entertainment information controller sends the flag bit to the vehicle body controller; The vehicle body controller sends a working instruction to the central lock and the window in response to the flag position, so as to trigger the central lock to lock and the window opening to rise to a preset value.

6. The control method based on children's emotion recognition according to claim 1, characterized in that: The method of regulating the child's emotions through the intelligent cockpit system according to the child's current emotional state specifically includes: If the child is in a bad mood, the sound source localization module will locate the child and send the child location information to the entertainment information controller. The entertainment information controller sends a first-level emotion adjustment instruction to the cockpit domain controller, so that the cockpit domain controller responds to the first-level emotion adjustment instruction and executes a first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of the non-children's audio program in the rear, and adjusting the interior atmosphere light to change the color and / or flashing frequency with the music; After the time for the cockpit domain controller to execute the first-level emotion relief strategy meets the first preset time range, returning to the step of determining the current emotional state of the child according to the voice feature value and the temperature value of the child in the back row, and in the step of determining the current emotional state of the child, increasing the weight of the voice feature value and reducing the weight of the temperature value of the child in the back row; If the child's emotional state is still not good at this time, the entertainment information controller sends a second-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the second-level emotion regulation instruction and executes a second-level emotion relief strategy, wherein the second-level emotion relief strategy includes: turning on the chat mode of the rear voice module and the voice speaker is a child; After the time for the cockpit domain controller to execute the second-level emotion relief strategy meets the second preset time range, returning to the step of determining the current emotional state of the child according to the sound feature value and temperature value of the child in the back row; If the child's emotional state is still not good at this time, the entertainment information controller sends a third-level emotion regulation instruction to the cockpit domain controller, so that the cockpit domain controller responds to the third-level emotion regulation instruction and executes a third-level emotion relief strategy, wherein the third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character image performing a preset action on the rear central control screen, wherein the preset action includes making a sound and performing a dance action; During the process of the cockpit domain controller executing the third-level emotion relief strategy, every third preset time, returning to the step of determining the current emotional state of the child according to the sound feature value and temperature value of the child in the back row; If the child's emotional state is relieved at this time, the cockpit domain controller controls the virtual image to exit the dance movements, turns off the rear central control screen, and prompts that the music mode is about to be turned on, returning to the first-level emotion relief strategy.

7. A control system based on children's emotion recognition, characterized in that: include: A rear seat pressure sensor, a body controller, a child left behind detection system, an intelligent cockpit system and an entertainment information controller, wherein the entertainment information controller is connected to the body controller, the child left behind detection system and the intelligent cockpit system respectively, and the body controller is also connected to the rear seat pressure sensor, wherein: The rear seat pressure sensor is used to detect the rear seat pressure and obtain the rear seat pressure value; The body controller is used to determine whether the rear seat pressure value reaches a preset pressure threshold, and the preset pressure threshold is used to represent the weight limit of the child; The child-remaining detection system is used to detect the temperature of a target object on the rear seat when the vehicle body controller determines that the pressure value of the rear seat reaches a preset pressure threshold, so as to determine whether the target object is alive; The vehicle body controller is also used to determine that there is a child in the rear seat when the target object is a living body, and trigger the central lock to lock and the window opening to rise to a preset opening value; The entertainment information controller is used to determine the current emotional state of the child according to the sound characteristic value and temperature value of the child in the back seat; The intelligent cockpit system is used to adjust the child's emotions according to the child's current emotional state. The control system based on children's emotion recognition also includes a rear-seat voice module, which is connected to the entertainment information controller and is used to detect the voice feature values ​​of the children in the rear seats in real time and send the detected voice feature values ​​to the entertainment information controller; The child left behind detection system is further used to: when the voice characteristic value of the child detected by the voice module meets the preset characteristic value of bad mood, detect the temperature value of the child in the back row in real time, and send the detected temperature value of the child in the back row to the entertainment information controller; The entertainment information controller is also used to: calculate the difference between the current rear-seat child temperature value and the rear-seat temperature value at the previous moment to obtain the temperature difference, and determine whether the temperature difference satisfies a preset temperature range, and when the temperature difference satisfies the preset temperature range, perform weighted summation on the sound feature value input by the rear-seat voice module and the rear-seat child temperature value input by the child left behind detection system, and determine the current child's emotional state based on the result of the weighted summation.

8. The control system based on children's emotion recognition according to claim 7, characterized in that: The vehicle body controller is specifically used to: determine whether the vehicle door is in a closed state and whether the IGN power supply of the vehicle is in a powered-on state; The child abandonment detection system is specifically used to: when the vehicle door is in a closed state and the IGN power supply of the whole vehicle is in a powered-on state, detect the temperature of the target object on the rear seat to obtain a target temperature value, and when the target temperature value exceeds a preset temperature threshold, determine that the target object is alive, and when the target object is alive, send a flag to the entertainment information controller; The entertainment information controller is further used to: send the flag bit to the vehicle body controller; The vehicle body controller is also used to: in response to the flag position, send a working instruction to the central lock and the window to trigger the central lock to lock and the window opening to rise to a preset value.

9. The control system based on children's emotion recognition according to claim 8, characterized in that: The smart cockpit system includes a cockpit domain controller and a sound source localization module connected to the cockpit domain controller, a sound field, rear speakers, interior ambient lights, a rear voice module and a rear central control screen, wherein: The sound source positioning module is specifically used to locate the child's position when the child is in a bad emotional state, and send the child's positioning information to the entertainment information controller; The entertainment information controller is also used to issue a first-level emotion adjustment instruction to the cockpit domain controller; The cockpit domain controller is specifically used to: respond to the first-level emotion adjustment instruction and execute the first-level emotion relief strategy, wherein the first-level emotion relief strategy includes: adjusting the position of the sound effect field according to the child positioning information, and controlling the sound output port of the children's audio program to output from the rear speakers, while reducing the sound output of the non-children's audio program in the rear, and adjusting the interior atmosphere light to change the color and / or flashing frequency with the music; The entertainment information controller is further used to: send a second-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the first-level emotion relief strategy; The cockpit domain controller is further used to: respond to the second-level emotion regulation instruction and execute the second-level emotion relief strategy, wherein the second-level emotion relief strategy includes: turning on the chat mode of the rear voice module and the voice speaker is a child; The entertainment information controller is further used to: send a third-level emotion regulation instruction to the cockpit domain controller when the child's emotional state is still not good after executing the second-level emotion relief strategy; The cockpit domain controller is further used to: respond to the third-level emotion regulation instruction and execute the third-level emotion relief strategy, wherein the third-level emotion relief strategy includes: automatically turning on the rear central control screen, and displaying a virtual cartoon character performing a preset action on the rear central control screen, wherein the preset action includes making a sound and performing a dance action; The cockpit domain controller is also used to: after the child's emotional state is alleviated, control the virtual image to exit the dance movements, turn off the rear central control screen, and prompt that the music mode is about to be turned on, returning to the first-level emotion relief strategy.

Images