A back row child behavior monitoring method and system based on visual recognition technology

Abstract

The application belongs to the technical field of automobile safety, and discloses a rear child behavior monitoring method and system based on visual recognition technology, which comprises the following steps: collecting physiological information and environmental information of rear children; adjusting the adaptive viewing angle of the rear entertainment screen according to the physiological information; adjusting the brightness of the rear entertainment screen, the temperature in the vehicle and the air quality in the vehicle according to the environmental information; and adjusting the state of the vehicle window according to the temperature in the vehicle and the air quality in the vehicle. According to the posture and position of the children, the application automatically adjusts the viewing angle and height of the rear entertainment screen, so that the children can obtain the best viewing experience when watching the entertainment content. This personalized adjustment not only improves the riding comfort of the children, but also embodies the humanized design of the technology.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of automobile safety, and particularly relates to a rear child behavior monitoring method and system based on visual recognition technology. BACKGROUND

[0002] With the rapid development of automobile technology, automobiles have penetrated into every corner of people's life and become an indispensable part. It is not only a means of transportation, but also an intelligent space integrating technology, comfort and safety. With the continuous integration of intelligent technology, the use scenarios of automobiles are also expanding from traditional road driving to today's automatic driving, intelligent navigation, vehicle entertainment, and even remote control and vital sign monitoring, which shows the diversified development of automobile technology.

[0003] Currently, some advanced vehicle models are equipped with vital sign monitoring technology. The application of this innovative technology is mainly to further improve the safety and user experience of vehicles. However, although this technology has brought new breakthroughs in automobile safety, the existing vital sign monitoring technology functions are still relatively single. Most systems only provide a child left-behind alarm reminder function, that is, after the vehicle is turned off and locked, if the system detects that there is a child or pet left behind in the rear row through the built-in sensor, it will immediately remind the owner through a mobile phone APP, SMS or other means, thereby effectively avoiding possible accidents.

[0004] However, the existing vital sign monitoring system still has some obvious limitations. They mainly rely on sensors to detect whether there is a living body left in the vehicle, but cannot achieve comprehensive monitoring of the child's rear environment and physiological information. For example, these systems cannot monitor the temperature, humidity, air quality and other key environmental factors in the vehicle in real time, nor can they obtain the child's body temperature, heart rate and other important physiological indicators. This means that although the existing vital sign monitoring system can improve the safety of the vehicle to some extent, there is still a lot of room for improvement in providing comprehensive and detailed vital sign monitoring. SUMMARY

[0005] The purpose of the present application is to provide a rear child behavior monitoring method and system based on visual recognition technology to solve the limitation of only reminding someone in the prior art.

[0006] To achieve the above-mentioned purpose, the technical scheme adopted by the present application is as follows:

[0007] In a first aspect, the present application provides a rear child behavior monitoring method based on visual recognition technology, comprising:

[0008] Collecting physiological information and environmental information of the rear child;

[0009] Adjust the adaptive viewing angle of the rear entertainment screen according to physiological information;

[0010] Adjust the brightness of the rear entertainment screen according to environmental information, and adjust the temperature and air quality in the vehicle.

[0011] Adjust the state of the vehicle window according to the temperature and air quality in the vehicle.

[0012] Optionally, physiological information and environmental information of the rear child are collected, wherein the physiological information includes posture, position, behavior, heart rate, heart rate variability, and blood oxygen saturation; the environmental information includes temperature, brightness, and PM2.5 content; the heart rate, heart rate variability, and blood oxygen saturation physiological parameters of the child are monitored through the imaging photoelectric plethysmography technology of the camera.

[0013] Optionally, the adaptive viewing angle of the rear entertainment screen is adjusted according to physiological information, including:

[0014] A camera is arranged on the rear entertainment screen, which collects the posture and position of the child, and transmits to the vehicle domain controller through the WiFi module and the T-BOX module for processing, and sends adjustment instructions to the screen adjustment mechanism, which adjusts the pitch angle and height of the screen in combination with the posture and position of the child through the screen adjustment mechanism.

[0015] Optionally, the screen adjustment mechanism includes an angle adjustment mechanism and a height adjustment mechanism, the angle adjustment mechanism includes an angle motor and a first fixed support, the angle motor and the first fixed support are fixedly connected with the rear entertainment display screen, and the rear entertainment display screen is rotated around the motor rotating shaft through the forward and reverse rotation of the angle motor to realize the angle adjustment of the rear entertainment display screen; the height adjustment mechanism includes a height motor, a screen guide rail, a motor guide rail, a motor mounting bracket, and a second fixed support, the angle adjustment mechanism is connected with the height adjustment mechanism through the hinge with the second fixed support, the angle adjustment mechanism, the height motor, the motor mounting bracket, the second fixed support, and the rear entertainment display screen are moved up and down along the screen guide rail and the motor guide rail through the forward and reverse rotation of the height motor to realize the height adjustment of the rear entertainment display screen.

[0016] Optionally, the brightness of the rear entertainment screen is adjusted according to environmental information, including:

[0017] The light intensity signal of the corresponding area of the rear screen is collected in real time through the brightness sensor, and the brightness of the rear entertainment display screen is adjusted according to the light intensity signal, and the light intensity signal is also sent to the T-BOX module through the WiFi module, and then sent to the domain controller by the T-BOX module, and the domain controller adjusts the rear light based on the light intensity signal.

[0018] Optionally, the temperature and air quality in the vehicle are adjusted, including:

[0019] When the camera on the rear entertainment display screen recognizes that a child enters the vehicle, the information is sent to the intelligent cabin domain controller, which controls the vehicle to enter the child care mode, at which time the air conditioning system adjusts the temperature of the corresponding area to the preset value, and the PM2.5 sensor monitors the PM2.5 value in the vehicle in real time, and switches to the internal circulation mode when the detected PM2.5 value exceeds the preset value, and the air purifier and negative ion generator are turned on.

[0020] Optionally, the state of the vehicle window is adjusted according to the temperature in the vehicle and the air quality in the vehicle, including:

[0021] After entering the child care mode, the domain controller controls the vehicle door system to lock the child lock on one side of the vehicle door; the vehicle window system adjusts the temperature and ventilation in the vehicle by opening and closing the vehicle window and sunroof when the air conditioning system is not working.

[0022] In a second aspect, the present application provides a rear child behavior monitoring system based on visual recognition technology, comprising:

[0023] A data acquisition module is configured to acquire physiological information and environmental information of the rear child;

[0024] An angle adjustment module is configured to adjust the adaptive viewing angle of the rear entertainment screen according to the physiological information;

[0025] An environmental adjustment module is configured to adjust the brightness of the rear entertainment screen and the temperature and air quality in the vehicle according to the environmental information;

[0026] A vehicle window adjustment module is configured to adjust the state of the vehicle window according to the temperature in the vehicle and the air quality in the vehicle.

[0027] In a third aspect, the present application provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to realize the steps of the rear child behavior monitoring method based on visual recognition technology.

[0028] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, wherein the computer program is executed by a processor to realize the steps of the rear child behavior monitoring method based on visual recognition technology.

[0029] Compared with the prior art, the present application has the following technical effects:

[0030] The present application not only monitors whether children are left in the car, but also comprehensively collects physiological information (such as posture, position, behavior, heart rate, heart rate variability, and blood oxygen saturation) and environmental information (such as temperature, brightness, and PM2.5 content) of children through sensors such as cameras. This comprehensive monitoring can provide more detailed and comprehensive evaluation of the safety and health of children.

[0031] The present application automatically adjusts the viewing angle and height of the rear entertainment screen according to the posture and position of the child, ensuring the best viewing experience for the child when watching entertainment content. This personalized adjustment not only improves the comfort of children during the ride, but also reflects the humanization of technology.

[0032] According to the environmental information, the brightness of the rear entertainment screen is automatically adjusted, and the temperature and air quality in the car are ensured to be comfortable and healthy. Especially when the PM2.5 value is detected to be excessive, the internal circulation mode is automatically switched to and the air purifier and negative ion generator are turned on, effectively improving the air quality in the car.

[0033] Through visual recognition technology, the child enters the child care mode after entering the car, and the child lock of the car door is controlled to be locked, effectively preventing the child from opening the car door during driving. At the same time, the temperature and ventilation in the car are adjusted by opening and closing the windows and sunroofs, further improving the safety of driving.

[0034] This technical solution combines intelligent technology with car safety, health, entertainment, and other aspects, not only improving the safety of the vehicle, but also enhancing the user experience. Children can receive more detailed and comprehensive care and attention during the ride, and parents can also be more at ease.

[0035] This technical solution is based on visual recognition technology and has high expandability. In the future, more sensors and intelligent devices can be integrated to achieve more comprehensive and in-depth monitoring and analysis of children's behavior, emotions, and health status, providing strong support for the development of car intelligence and safety.

[0036] In summary, the rear child behavior monitoring method based on visual recognition technology provides a new idea and direction for the development of car intelligence and safety by comprehensively monitoring children's physiological information and environmental information, personalized entertainment experience, intelligent adjustment of the car environment, improved driving safety, enhanced user experience, and strong technical expandability. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1 , system architecture schematic diagram.

[0038] Figure 2 , rear entertainment display screen and screen adjusting mechanism position schematic diagram.

[0039] Figure 3 , rear row entertainment display screen schematic diagram.

[0040] Figure 4 , rear row entertainment display screen and screen adjusting mechanism relative position schematic diagram.

[0041] Figure 5 , screen adjusting mechanism schematic diagram.

[0042] Figure 6 , flow chart of the present application.

[0043] Wherein:

[0044] 1, rear row entertainment screen; 2, front row seat; 3, screen adjusting mechanism; 4, camera; 5, WiFi module; 6, brightness sensor; 7, height adjusting mechanism; 8, angle adjusting mechanism; 9, first fixed support; 10, angle motor; 11, screen guide rail; 12, motor mounting support; 13, height motor; 14, motor guide rail; 15, second fixed support. DETAILED DESCRIPTION

[0045] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0046] In the description of the present application, it should be understood that the terms "include" and "contain" indicate the existence of described features, whole, steps, operations, elements and / or components, but do not exclude the existence or addition of one or more other features, whole, steps, operations, elements, components and / or sets thereof.

[0047] It should also be understood that the terms used in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and the appended claims of the present application, the singular forms "a", "an" and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0048] It should be further understood that the term "and / or" used in the specification and the appended claims of the present application means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations, for example, A and / or B can represent three cases of A alone, A and B together, and B alone. In addition, the character " / " in the present application generally represents an "or" relationship between the front and rear associated objects.

[0049] It should be understood that, although the terms first, second, third, etc. can be employed in describing the preset ranges, etc. in the embodiments of the present application, the preset ranges should not be limited to these terms. These terms are only used to distinguish the preset ranges from each other. For example, the first preset range can also be referred to as the second preset range, and similarly, the second preset range can also be referred to as the first preset range, without departing from the scope of the embodiments of the present application.

[0050] Depending on the context, the word "if" as used herein can be interpreted to mean "when" or "while" or "in response to determining" or "in response to detecting." Similarly, the phrase "if it is determined" or "if (a stated condition or event) is detected" can be interpreted to mean "when it is determined" or "in response to determining" or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)".

[0051] Various structural diagrams according to the disclosed embodiments of the present application are shown in the accompanying drawings. These drawings are not drawn to scale, in which certain details are exaggerated for the purpose of clarity and certain details can be omitted. The shapes of various regions, layers, and the relative size and positional relationship therebetween shown in the drawings are only exemplary, and in actuality, there can be deviations due to manufacturing tolerances or technical limitations, and a person skilled in the art can additionally design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0052] Embodiment 1, please refer to Figure 6 The present application provides 1. A rear child behavior monitoring method based on visual recognition technology, comprising:

[0053] Collecting physiological information and environmental information of the rear child;

[0054] Adjusting the adaptive viewing angle of the rear entertainment screen according to the physiological information;

[0055] Adjusting the brightness of the rear entertainment screen, as well as the temperature and air quality in the vehicle according to the environmental information;

[0056] Adjusting the state of the vehicle window according to the temperature and air quality in the vehicle.

[0057] The present application not only monitors whether the child is left in the vehicle, but also comprehensively collects the physiological information (such as posture, position, behavior, heart rate, heart rate variability, and blood oxygen saturation) and environmental information (such as temperature, brightness, and PM2.5 content) of the child through sensors such as cameras. This comprehensive monitoring can provide more detailed and comprehensive evaluation of the safety and health status of the child.

[0058] Embodiment 2, please refer to Figures 1 to 5A rear child behavior monitoring method based on visual recognition technology, specifically comprising:

[0059] Figure 1 For the system architecture diagram of the rear child behavior monitoring system described in the application, the system includes an intelligent cabin domain controller, an air conditioning system, a window system, a door system, a lamp system, a sound system, a voice interaction system, a central control display screen, a rear entertainment screen, a T-BOX module, a screen adjusting mechanism, etc.

[0060] The intelligent cabin domain controller is responsible for receiving and processing information sent by the rear entertainment screen camera, the outdoor temperature sensor, the indoor temperature sensor, the PM2.5 sensor, etc., and sending execution instructions to the corresponding systems, which are then executed by the respective systems.

[0061] In addition to the basic components such as compressor, condenser, evaporator, etc., the air conditioning system also includes components such as indoor temperature sensor, outdoor temperature sensor, PM2.5 sensor, air purifier, negative ion generator, etc. When the camera on the rear entertainment screen recognizes that a child has entered the vehicle, it sends this information to the intelligent cabin domain controller, which immediately controls the vehicle to enter the child care mode. At this time, the air conditioning system adjusts the temperature of the corresponding area to the preset value, and the PM2.5 sensor monitors the PM2.5 value in the vehicle in real time. When the detected PM2.5 value exceeds the preset value, it switches to the internal circulation mode, and simultaneously turns on the air purifier and negative ion generator to improve the air quality in the vehicle.

[0062] The window system is mainly used to adjust the temperature and ventilation in the vehicle by opening and closing the windows and sunroofs when the air conditioning is not in operation.

[0063] The door system has an automatic child lock function. When the child care mode is entered, the child lock of the corresponding side door is immediately controlled to be locked, ensuring the safety of the rear child passengers.

[0064] The lamp system is mainly used to execute the light on / off or brightness adjustment instructions of the intelligent cabin.

[0065] The sound system is used to play all relevant audio information in the vehicle.

[0066] The voice interaction system is used for voice interaction with children in the child care mode, or to control the rear entertainment screen to play videos, audio or start games through voice. In addition, when the camera on the rear entertainment screen detects abnormal physiological parameters of the child, it can remind the driver to stop and check the child's condition through voice.

[0067] In addition to displaying HMI-related interface information, the central control display screen can also project real-time video information of the children captured by the rear camera when the children in the back seat exhibit dangerous behavior or abnormal physiological parameters, allowing the driver to check the status of the children in the back seat without having to look back.

[0068] The T-BOX module is used to connect the vehicle to mobile devices, and also connects the rear entertainment screen to the cockpit domain controller via WiFi network.

[0069] The rear entertainment screen provides functions such as video playback, voice interaction information display, and gaming entertainment. Figure 2 As shown, the rear entertainment screen 1 is installed on the back of the front seat 2 and is connected to the front seat via the screen adjustment mechanism 3. Figure 4 As shown, the screen adjustment mechanism 3 is installed inside the back of the front seat and consists of an angle adjustment mechanism 8 and a height adjustment mechanism 7, which are used to adjust the angle and height of the rear entertainment screen, so that the screen position can be adjusted according to children of different ages and heights.

[0070] like Figure 5 As shown, the angle adjustment mechanism 8 consists of an angle motor 10 and a first fixed bracket 9. The angle motor 10 and the first fixed bracket 9 are fixedly connected to the rear entertainment screen 1. By rotating the angle motor 10 forward and backward, the rear entertainment screen 1 can rotate around the motor shaft as the central axis, thereby realizing the angle adjustment of the rear entertainment screen 1. The height adjustment mechanism 7 consists of a height motor 13, a screen guide rail 11, a motor guide rail 14, a motor mounting bracket 12, and a second fixed bracket 15. The angle adjustment mechanism 8 is connected to the height adjustment mechanism by hinge to the second fixed bracket 15. By rotating the height motor 13 forward and backward, the angle adjustment mechanism 8, the height motor 13, the motor mounting bracket 12, the second fixed bracket 15, and the rear entertainment screen 1 as a whole can move up and down along the screen guide rail 11 and the motor guide rail 14, thereby realizing the height adjustment of the rear entertainment screen 1.

[0071] like Figure 3The rear row entertainment screen is internally integrated with a camera 4, a WiFi module 5, a brightness sensor 6 and the like hardware. The camera can monitor the posture, behavior, main physiological parameters and the like of the child in real time based on visual recognition technology, and transmit the various state information of the child in the rear row collected by the camera to the intelligent cockpit domain controller through the WiFi module and the T-BOX module. The brightness sensor can collect the illumination brightness signal of the corresponding area of the rear row screen in real time, and adjust the brightness of the rear row entertainment screen according to the brightness signal. Meanwhile, the brightness signal is sent to the T-BOX module through the WiFi module, and then sent to the intelligent cockpit domain controller by the T-BOX module. The intelligent cockpit domain controller adjusts the rear row light based on the brightness signal, thereby protecting the vision of the child.

[0072] The camera can monitor the heart rate, heart rate variability, blood saturation and the like physiological parameters of the child through the imaging photoelectric plethysmography technology, and further monitor the health state and fatigue state of the child based on the above parameters.

[0073] After the vehicle is started, when a passenger enters the rear row, the camera on the rear row entertainment screen first identifies the passenger, identifies the facial features of the passenger based on a preset algorithm, determines whether the passenger is a child, and if not, does not start the child care mode. If the passenger is determined to be a child, the camera live detection function is started, and whether it is a live body is determined based on the facial blood flow condition through the imaging photoelectric plethysmography technology. If it is not a live body, the child care mode is not started. If it is determined to be a live body, the corresponding information is sent to the intelligent cockpit domain controller through the WiFi module, and the intelligent cockpit domain controller initiates the start of the child care mode. In this mode, the intelligent cockpit domain controller first sends a child lock drop lock instruction to the door system, and the door system adjusts the child lock of the corresponding side door to the drop lock state to prevent the child from opening the door by mistake and causing an accident. At the same time, the camera also determines whether the child is properly fastened with a seat belt through visual recognition technology. If not, the driver is reminded to fasten the seat belt for the child through the voice interaction system. When the child fastens the seat belt, the camera on the rear row display screen determines whether the current screen position is the best position according to the relative position of the collected face and the camera. If there is a difference from the preset best position, the domain controller sends an adjustment instruction to the screen adjusting mechanism to adjust the screen position, and adjusts the relative position of the face and the camera to the preset state. If there is no difference from the preset best position, the intelligent cockpit domain controller does not send an adjustment instruction.

[0074] After the rear entertainment screen is adjusted to the preset position, the user can select or control the screen by voice to open video, game, audio and other entertainment functions on the screen, and at the same time, the air conditioning system adjusts the temperature of the corresponding area to the preset value, and the PM2.5 sensor monitors the PM2.5 value in the vehicle in real time, and switches to the internal circulation mode when the detected PM2.5 value exceeds the preset value, and the air purifier and negative ion generator are started to improve the air quality in the vehicle. When the air conditioner is running, the intelligent cockpit domain controller also sends instructions to the window system to close the windows and sunroof.

[0075] In addition, the brightness sensor on the rear entertainment screen can collect the light brightness signal of the corresponding area of the rear screen in real time, and adjust the brightness of the rear entertainment screen according to the brightness signal, and also send the brightness signal to the T-BOX module through the WiFi module, and then send it to the intelligent cockpit domain controller by the T-BOX module. The intelligent cockpit domain controller adjusts the rear light based on the brightness signal, thereby protecting the child's vision.

[0076] During the entire ride, the camera monitors the child's heart rate, heart rate variability, and blood oxygen saturation in real time. When the child has an abnormal condition during the ride, the camera sends the abnormal information to the T-BOX module through the WiFi module, and then the T-BOX module forwards it to the intelligent cockpit domain controller. The intelligent cockpit domain controller starts the abnormal situation processing mechanism, and projects the child's state video captured by the camera to the central control display screen, and reminds the driver through the voice interaction system that the child's physiological parameters are abnormal, and checks the above projection information. The driver determines whether to take measures such as stopping the car to check or sending the child to the hospital.

[0077] At the same time, based on the existing research results, heart rate variability can also reflect whether the human body is in a state of fatigue or drowsiness, combined with visual recognition technology to collect whether the child has behaviors such as nodding and eyes that cannot be opened due to drowsiness. The above physiological parameters and behaviors are sent to the T-BOX module through the WiFi module, and then the T-BOX module forwards them to the intelligent cockpit domain controller. The intelligent cockpit domain controller determines whether the child is in a drowsy state. If so, it enters a lull mode, which includes the rear entertainment screen exiting the current entertainment function and playing slow-paced sleep-aiding music, the sound system reducing the volume, the windows and sunroof being closed, the air conditioning system entering a preset sleep mode, and the interior light brightness being adjusted. If not, the rear entertainment screen continues to be in the entertainment function state.

[0078] When the vehicle reaches the destination and the engine is turned off, the rear entertainment screen monitors whether the child is still in the vehicle, and if so, reminds the driver through the voice interaction system not to leave the child in the vehicle when leaving the vehicle. When a preset time elapses, the camera monitors that the child is still in the vehicle, and the T-BOX module sends information that the child is left in the vehicle to the driver's mobile terminal device, reminding the driver to return in time. At the same time, the driver can also check the real-time video information of the child shot by the camera on the rear entertainment screen through the mobile terminal device. When another preset time elapses, the camera monitors that the child is still in the vehicle, and the temperature sensor of the air conditioning system monitors the temperature inside and outside the vehicle, when the temperature inside the vehicle is high, the intelligent cabin domain controller sends an opening instruction to the window system, and the window or sunroof is opened slightly to ventilate and cool down. When the temperature inside the vehicle is low, the intelligent cabin domain controller sends a heating instruction to the air conditioner to maintain the temperature inside the vehicle at a preset value, and the outside circulation should also be started to maintain normal ventilation inside the vehicle.

[0079] In another embodiment of the present application, a rear child behavior monitoring system based on visual recognition technology is provided, which can be used to implement the above-mentioned rear child behavior monitoring method based on visual recognition technology. Specifically, the system comprises:

[0080] A data acquisition module is configured to acquire physiological information and environmental information of the rear child.

[0081] An angle adjustment module is configured to adjust the adaptive viewing angle of the rear entertainment screen according to the physiological information.

[0082] An environment adjustment module is configured to adjust the brightness of the rear entertainment screen according to the environmental information, and adjust the temperature and air quality inside the vehicle.

[0083] A window adjustment module is configured to adjust the state of the window according to the temperature and air quality inside the vehicle.

[0084] The division of the modules in the embodiments of the present application is illustrative, and is only a logical function division. In actual implementation, another division mode can be used. In addition, the function modules in each embodiment of the present application can be integrated in one processor, or can be physically separated, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of a software function module.

[0085] In another embodiment of the present application, a computer device is provided, which comprises a processor and a memory, the memory is configured to store a computer program, the computer program comprises program instructions, and the processor is configured to execute the program instructions stored in the computer storage medium. The processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., which are the computing core and control core of the terminal, and are suitable for implementing one or more instructions, and are particularly suitable for loading and executing one or more instructions in the computer storage medium to implement a corresponding method process or a corresponding function; the processor in the embodiments of the present application can be used for the operation of the rear child behavior monitoring method based on visual recognition technology.

[0086] In another embodiment of the present application, the present application further provides a storage medium, specifically a computer readable storage medium (Memory), which is a memory device in the computer device, and is configured to store programs and data. It can be understood that the computer readable storage medium herein can include the built-in storage medium in the computer device, and of course can also include the expansion storage medium supported by the computer device. The computer readable storage medium provides a storage space, and the storage space stores the operating system of the terminal. In addition, one or more instructions suitable for being loaded and executed by the processor are also stored in the storage space, and the instructions can be one or more computer programs (including program codes). It should be noted that the computer readable storage medium herein can be a high-speed RAM memory, or a non-volatile memory such as at least one disk memory. One or more instructions stored in the computer readable storage medium can be loaded and executed by the processor to implement the corresponding steps of the rear child behavior monitoring method based on visual recognition technology in the above embodiments.

[0087] Those skilled in the art will appreciate that embodiments of the application can be devised for a method, a system, or a computer program product. Accordingly, the present application can be embodied in the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0088] The present application is described in reference to the flowchart and / or block diagrams of the method, apparatus (system) and computer program product according to embodiments of the application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0089] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0090] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0091] Finally, it should be noted that the above-mentioned embodiments are merely intended for describing the technical solutions of the present application, but not for limiting it. Although the present application is described in detail with reference to the above embodiments, those skilled in the field should understand that the specific embodiments of the present application can be modified or replaced equivalently without departing from the spirit and scope of the present application, and any modification or equivalent replacement without departing from the spirit and scope of the present application should be covered in the protection scope of the claims of the present application.

Claims

1. A method for monitoring behavior of children in the back row based on visual recognition technology, characterized in that, include: Collect physiological and environmental information of children in the back row; Adjust the viewing angle of the rear entertainment screen according to physiological information; Adjust the brightness of the rear entertainment screen based on environmental information, as well as adjust the interior temperature and air quality. Adjust the window settings according to the interior temperature and air quality; Physiological and environmental information of children in the back row is collected. The physiological information includes posture, position, behavior, heart rate, heart rate variability, and blood oxygen saturation. The environmental information includes temperature, brightness, and PM2.5 content. The imaging photoplethysmography technology of the camera is used to monitor the children's physiological parameters such as heart rate, heart rate variability, and blood oxygen saturation. Adjusting the viewing angle of the rear entertainment screen based on physiological information, including: A camera is installed on the rear entertainment screen. The camera captures the child's posture and position, and transmits the data to the vehicle domain controller via the WiFi module and T-BOX module for processing. The controller then sends adjustment commands to the screen adjustment mechanism, which, in conjunction with the child's posture and position, adjusts the screen's tilt and height. 2.The method of claim 1, wherein, The screen adjustment mechanism includes an angle adjustment mechanism and a height adjustment mechanism. The angle adjustment mechanism includes an angle motor and a first fixed bracket. The angle motor and the first fixed bracket are fixedly connected to the rear entertainment display screen. By rotating the angle motor forward and backward, the rear entertainment display screen rotates around the motor shaft as the central axis, thereby adjusting the angle of the rear entertainment display screen. The height adjustment mechanism includes a height motor, a screen guide rail, a motor guide rail, a motor mounting bracket, and a second fixed bracket. The angle adjustment mechanism is connected to the height adjustment mechanism by hinge to the second fixed bracket. By rotating the height motor forward and backward, the angle adjustment mechanism, the height motor, the motor mounting bracket, the second fixed bracket, and the rear entertainment display screen move up and down along the screen guide rail and the motor guide rail, thereby adjusting the height of the rear entertainment display screen. 3.The method of claim 1, wherein, Adjusting the brightness of the rear entertainment screens based on environmental information, including: The brightness sensor collects the illumination signal of the corresponding area of ​​the rear entertainment screen in real time, and adjusts the brightness of the rear entertainment screen according to the brightness signal. At the same time, the brightness signal is also sent to the T-BOX module via the WiFi module, and then sent to the vehicle domain controller by the T-BOX module. The vehicle domain controller adjusts the rear lights based on the brightness signal. 4.The method of claim 1, wherein, Regulating the interior temperature and air quality of the vehicle, including: When the camera on the rear entertainment display screen detects a child entering the vehicle, it sends the information to the vehicle domain controller. The vehicle domain controller then controls the vehicle to enter child care mode. At this time, the air conditioning system adjusts the temperature of the corresponding area to the preset value, while the PM2.5 sensor monitors the PM2.5 value in the vehicle in real time. When the detected PM2.5 value exceeds the preset value, it switches to recirculation mode and turns on the air purifier and negative ion generator.

5. The method of claim 4, wherein the method further comprises: Adjust the window settings according to the interior temperature and air quality, including: Once the child care mode is activated, the vehicle domain controller will lock the child locks on the corresponding side of the door system. When the air conditioning is not in operation, the window system will adjust the interior temperature and ventilation by opening and closing the windows and sunroof.

6. A rear child behavior monitoring system based on visual recognition technology, which is used to implement the steps of the rear child behavior monitoring method based on visual recognition technology according to any one of claims 1 to 5, characterized in that, The application relates to a back-row child behavior monitoring method based on visual recognition technology. The data acquisition module is used for acquiring physiological information and environmental information of back-row children. The angle adjustment module is used for adjusting the adaptive viewing angle of the back-row entertainment screen according to the physiological information. The environmental adjustment module is used for adjusting the brightness of the back-row entertainment screen, the temperature in the vehicle and the air quality in the vehicle according to the environmental information. The window adjustment module is used for adjusting the window state according to the temperature in the vehicle and the air quality in the vehicle.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to realize the steps of the back-row child behavior monitoring method based on visual recognition technology.

8. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 7. The computer program is executed by the processor to realize the steps of the back-row child behavior monitoring method based on visual recognition technology.

Images