Vehicle cockpit interaction methods, devices, vehicles and storage media

Abstract

This application discloses a vehicle cockpit interaction method, device, vehicle, and storage medium. The method includes: when the actual intention of an infant is identified as a feeding intention and a user's milk-making instruction is received, simultaneously controlling the vehicle's onboard intelligent milk maker to perform the corresponding milk-making action according to the instruction, and controlling at least one interactive device in the vehicle cockpit to perform an adaptation action corresponding to the pre-milk-making action; and when the user has completed feeding, controlling at least one interactive device in the vehicle cockpit to return to its state before the action was performed. This application embodiment can accurately identify the actual intention of an infant, thereby controlling the cockpit to perform corresponding interactive actions, assisting the user in comforting the infant, reducing manual operation by the user, proactively providing convenient services, improving the user's driving experience, and effectively meeting usage needs.

Description

Technical Field

[0001] This application relates to the field of cockpit interaction technology, and in particular to a cockpit interaction method, device, vehicle, and storage medium for a vehicle. Background Technology

[0002] Currently, while using a car, there are often scenarios where users need to soothe infants by preparing formula or changing diapers. In such situations, infants are often quite agitated and require immediate comforting from the user. Multiple soothing actions, such as preparing the right formula or changing diapers, can make it difficult for users to handle multiple soothing actions simultaneously. This can lead to confusion and make it harder to soothe the infant, increasing the risk of errors and reducing the effectiveness of the soothing.

[0003] However, in the relevant technologies, the vehicles do not have an interactive scenario for infant mode. Guardians, especially rear-seat passengers, can only perform multiple tasks at the same time, such as soothing the infant, confirming that the water temperature is appropriate, pouring the precise ratio of milk powder and water, and shaking the milk powder. They are very busy and easily cause problems such as poor water temperature, incorrect ratio, and continuous crying of the infant. This also affects the driver's driving safety to a certain extent and urgently needs to be improved. Summary of the Invention

[0004] In view of this, this application aims to propose a vehicle cabin interaction method that can identify the actual intentions of infants and young children, thereby controlling the vehicle cabin to perform corresponding interactive actions, assisting users in comforting infants and young children, reducing manual operation by users, proactively providing convenient services to users, improving the user's driving experience, and effectively meeting user needs.

[0005] To achieve the above objectives, the technical solution of this application is implemented as follows:

[0006] Firstly, a vehicle cockpit interaction method is provided, the method comprising:

[0007] Identify the true intentions of infants and young children;

[0008] When the actual intention is a preset feeding intention or when a user's milk preparation instruction is received, the vehicle's onboard smart milk preparation machine in the vehicle cabin is controlled to perform the corresponding milk preparation action according to the milk preparation instruction, and at least one interactive device in the vehicle cabin is controlled to perform the adaptation action corresponding to the milk preparation action.

[0009] The system detects whether the user has finished feeding the baby, and when it detects that the user has finished feeding the baby, it controls at least one interactive device in the vehicle cabin to return to the state before the action was performed.

[0010] The above technical solution can identify the actual intentions of infants and young children, and then control the vehicle to perform corresponding interactive actions when the infants and young children need to be fed. This helps users soothe the infants and young children, reduces manual operation by the users, proactively provides convenient services for users, improves the user's driving experience, and effectively meets the user's needs.

[0011] In conjunction with the first aspect, in some possible implementations, the at least one interactive device controlling the vehicle cabin performs an adaptation action corresponding to the pre-milk-making action, including:

[0012] Control at least one seat of the interactive device to perform a corresponding space-making action, and control the air conditioning system and multimedia system of the interactive device to perform a corresponding first interactive action.

[0013] The above technical solution enables users to perform corresponding interactive actions by controlling the cockpit interaction devices, including the seats, air conditioning system, and multimedia system, in order to assist users in feeding infants.

[0014] In conjunction with the first aspect, some possible implementations also include:

[0015] When the actual intention is the preset diaper changing intention, the seat is controlled to perform the corresponding space clearing action, and the air conditioning system and fragrance system of the interactive device are controlled to perform the corresponding second interactive action. After the space clearing action is completed, the diaper changing table of the interactive device is lowered.

[0016] The above technical solution enables the system to control the cabin interaction devices, including the seat, air conditioning system, fragrance system, and diaper changing table, to perform corresponding interactive actions when the system detects that the infant needs a diaper change, thus assisting the user in changing the diaper.

[0017] In conjunction with the first aspect, some possible implementations also include:

[0018] When the actual intention is a preset sleep-inducing intention, the multimedia system of the interactive device is controlled to perform the best playback action, and the sleep-related device of the interactive device is controlled to perform the corresponding third interactive action.

[0019] The above technical solution enables the system to control the cockpit interactive devices, including the multimedia system and sleep-related devices, to perform corresponding interactive actions when it is detected that the infant needs to be soothed to sleep, thus assisting the user in soothing the infant to sleep.

[0020] In conjunction with the first aspect, in some possible implementations, the optimal playback action includes at least one of music type, listening position, and volume.

[0021] The above technical solutions can determine the optimal playback action based on several factors, including music type, listening position, and volume, to better help users soothe infants to sleep and provide a better sleep environment for them.

[0022] In conjunction with the first aspect, in some possible implementations, before controlling at least one interactive device in the vehicle cabin to perform the adaptation action corresponding to the pre-prepared milk-making action, the method further includes:

[0023] Determine whether the seat is occupied;

[0024] If the space is in the occupied state, the space-clearing action is generated with a first adjustment amount and a first adjustment speed;

[0025] If the space is not in the occupied state, the space-making action is generated with a second adjustment amount and a second adjustment speed, wherein the second adjustment amount is greater than the first adjustment amount and the second adjustment speed is greater than the first adjustment speed.

[0026] The above technical solution can generate space-making actions based on different seat states with different adjustment amounts and speeds, avoiding the impact on passenger experience due to excessively fast adjustment speeds or excessive adjustment amounts when the seat is occupied.

[0027] In conjunction with the first aspect, in some possible implementations, identifying the infant's actual intention includes:

[0028] Receive the user's voice command and identify the actual intention based on the voice command;

[0029] And / or, acquire a current in-vehicle image of the vehicle and extract at least one user action feature from the current in-vehicle image to analyze the actual intent based on the at least one user action feature.

[0030] The above technical solutions enable the identification of infants' actual intentions based on user voice commands and / or motion feature analysis based on in-vehicle images, thereby achieving automatic adjustment of the cockpit interaction equipment and a higher level of intelligence.

[0031] Secondly, a vehicle cockpit interaction device is provided, which includes:

[0032] The recognition module is used to identify the actual intentions of infants and young children;

[0033] The first control module is used to control the in-vehicle intelligent milk maker in the vehicle cabin to perform the corresponding milk preparation action according to the milk preparation instruction when the actual intention is a preset feeding intention or when a user's milk preparation instruction is received, and to control at least one interactive device in the vehicle cabin to perform the adaptation action corresponding to the milk preparation action.

[0034] The second control module is used to detect whether the user has finished feeding, and when the user finishes feeding, it controls at least one interactive device in the vehicle cabin to return to the state before the action was performed.

[0035] In conjunction with the second aspect, in some possible implementations, the first control module includes:

[0036] The control unit is used to control at least one seat of the interactive device to perform a corresponding space-making action, and to control the air conditioning system and multimedia system of the interactive device to perform a corresponding first interactive action.

[0037] In conjunction with the second aspect, some possible implementations also include:

[0038] The third control module is used to control the seat to perform a corresponding space-making action when the actual intention is a preset diaper changing intention, and to control the air conditioning system and fragrance system of the interactive device to perform a corresponding second interactive action. After the space-making action is completed, the diaper changing table of the interactive device is lowered.

[0039] In conjunction with the second aspect, some possible implementations also include:

[0040] The fourth control module is used to control the multimedia system of the interactive device to perform the best playback action when the actual intention is a preset sleep-inducing intention, and to control the sleep-related device of the interactive device to perform the corresponding third interactive action.

[0041] In conjunction with the second aspect, in some possible implementations, the optimal playback action includes at least one of music type, listening position, and volume.

[0042] In conjunction with the second aspect, some possible implementations also include:

[0043] The determination module is used to determine whether the seat is occupied.

[0044] The first adjustment module is used to generate the space-clearing action with a first adjustment amount and a first adjustment speed when the space is in the occupied state.

[0045] The second adjustment module is used to generate the space-making action with a second adjustment amount and a second adjustment speed when the space is not in the occupied state, wherein the second adjustment amount is greater than the first adjustment amount and the second adjustment speed is greater than the first adjustment speed.

[0046] In conjunction with the second aspect, in some possible implementations, the identification module includes:

[0047] The recognition unit is used to receive the user's voice commands and recognize the actual intention based on the voice commands.

[0048] And / or, a data acquisition unit is used to acquire a current in-vehicle image of the vehicle and extract at least one user action feature from the current in-vehicle image to analyze the actual intent based on the at least one user action feature.

[0049] The advantages of the vehicle's cockpit interaction device and the aforementioned vehicle cockpit interaction method compared to the prior art are the same, and will not be repeated here.

[0050] Thirdly, a vehicle is provided, including: a cockpit interaction device for a vehicle as described in the above embodiments.

[0051] Fourthly, a computer-readable storage medium is provided, which stores computer program code that, when executed on a computer, causes the computer to perform the vehicle cockpit interaction method described in the first aspect or any possible implementation thereof. Attached Figure Description

[0052] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0053] Figure 1 This is a flowchart illustrating a vehicle cockpit interaction method according to an embodiment of this application;

[0054] Figure 2 This is a schematic diagram illustrating the principle of a breastfeeding scenario according to an embodiment of this application;

[0055] Figure 3 This is a schematic diagram of a breastfeeding device UI (User Interface) according to an embodiment of this application;

[0056] Figure 4 This is a flowchart of a diaper changing scenario according to an embodiment of this application;

[0057] Figure 5 A flowchart of a sleep-inducing scenario according to an embodiment of this application;

[0058] Figure 6 This is a schematic diagram illustrating the principle of a vehicle cockpit interaction method according to an embodiment of this application;

[0059] Figure 7 This is a schematic diagram of the structure of a vehicle cockpit interaction device according to an embodiment of this application;

[0060] Figure 8 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0061] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0062] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0063] Traditional vehicles lack solutions to address the diverse needs of infants and toddlers. Infants and toddlers often struggle to control their own needs, and when these needs are not met, they frequently resort to crying as a form of external feedback. When their needs remain unmet, they become difficult to soothe, affecting not only the user's mood but also potentially their health. Furthermore, when users attempt to soothe infants and toddlers, the limited space inside a vehicle, the restrictive methods available, and the need for users to juggle multiple tasks simultaneously can severely hinder the efficiency and effectiveness of soothing the child.

[0064] For example, when an infant needs to be fed in the car, the user has to do multiple things, such as make room for feeding, prepare formula according to a set ratio, and soothe the infant. This can make the user feel overwhelmed and flustered, increasing the probability of user errors.

[0065] Therefore, the relevant technologies lack cabin interaction methods to meet the needs of infants and toddlers, and the level of automation and intelligence is low, making it difficult for passengers to efficiently soothe infants and toddlers, which in turn affects the passenger's riding experience.

[0066] Figure 1 This is a schematic flowchart of a vehicle cockpit interaction method provided in an embodiment of this application.

[0067] For example, such as Figure 1 As shown, the method includes:

[0068] In step S101, the infant's actual intention is identified.

[0069] In actual implementation, the embodiments of this application can accurately identify the actual intentions of infants and young children, such as the intention to lull them to sleep, the intention to feed them, the intention to change their diapers, etc.

[0070] For example, in this application embodiment, the age of all passengers can be determined first based on the occupant monitoring system, or based on the use of infant seats in the vehicle, to determine whether there are infants in the vehicle. When it is confirmed that there are infants in the vehicle, the intentions of the infants can be monitored in real time, such as based on the infants' crying, the user's voice commands, touch commands, or the intentions can be identified from the in-vehicle images, to confirm the actual needs of the infants or users. This will be described in detail below.

[0071] The embodiments of this application can accurately identify the intentions of infants and young children, improve the intelligence level of vehicles, and thus facilitate subsequent cooperation with users in comforting infants and young children.

[0072] Optionally, in one embodiment of this application, identifying the actual intention of an infant or toddler includes: receiving a user's voice command and identifying the actual intention based on the voice command; and / or, acquiring a current in-vehicle image and extracting at least one user action feature from the current in-vehicle image to analyze the actual intention based on at least one user action feature.

[0073] In some embodiments, the user can determine the infant's actual intention and, based on the infant's actual intention, use voice commands triggered by keywords to enable the vehicle to identify the actual intention from the voice commands after capturing the keywords in the voice. For example, when the voice command is "to lull the infant to sleep", this embodiment of the application can extract the keyword "to lull to sleep" to determine that the infant's actual intention is to lull the infant to sleep.

[0074] In other embodiments, this application embodiment can also obtain the actual intention of the infant by collecting in-vehicle images. The collection method can be in-vehicle camera. After collecting in-vehicle images, this application embodiment can identify the infant from the images to determine that the vehicle is currently in an infant interaction scenario. Furthermore, this application embodiment can identify at least one user action feature of other passengers beside the infant from the images, and then analyze the actual intention based on at least one user action feature.

[0075] For example, when the user's action feature is identified as holding a baby bottle, this embodiment of the application can determine that the user is preparing to feed the baby, and the baby's actual intention at this time should be the intention to feed the baby; when the user's action feature is identified as holding a diaper, this embodiment of the application can determine that the user is preparing to change the baby's diaper, and the baby's actual intention at this time should be the intention to change the diaper.

[0076] Furthermore, this application embodiment can further accurately determine the actual intentions of infants and toddlers through a combination of voice and image. At the same time, this application embodiment can also record data in each infant and toddler interaction scenario, such as infant and toddler crying data, user command data, etc., and achieve adaptive learning, so that the vehicle can obtain the actual intentions of infants and toddlers based on their crying characteristics, such as voice characteristics and movement characteristics.

[0077] In step S102, when the actual intention is a preset feeding intention or a user's milk preparation instruction is received, the vehicle-mounted intelligent milk preparation machine in the vehicle cabin is controlled to perform the corresponding milk preparation action according to the milk preparation instruction, and at least one interactive device in the vehicle cabin is controlled to perform the adaptation action corresponding to the pre-milk preparation action.

[0078] As one possible implementation, embodiments of this application can identify the infant's actual intention as a preset feeding intention when, for example, the infant is found to be crying incessantly through in-vehicle voice recordings, or the infant is identified as putting their fingers or other objects in their mouth based on in-vehicle images, or when a user's milk-making instruction is received. In this case, the corresponding in-vehicle device, such as a smart milk maker, can be activated. For example, once the smart milk maker is activated, it can identify whether the bottle is placed correctly and obtain parameters such as the amount of milk to be prepared through voice interaction, thereby completing the milk-making action based on these parameters.

[0079] Meanwhile, embodiments of this application can also control at least one interactive device in the vehicle cabin to perform the adaptation action corresponding to the pre-milk preparation action, thereby assisting the user in feeding the infant.

[0080] Optionally, in one embodiment of this application, controlling at least one interactive device in the vehicle cabin to perform an adaptation action corresponding to the pre-milk preparation action includes: controlling at least one seat of the interactive device to perform a corresponding space-making action, and controlling the air conditioning system and multimedia system of the interactive device to perform a corresponding first interactive action.

[0081] In some embodiments, the present application embodiments can also control at least one seat, such as the seat in front of the infant's current seat moving forward to make room for feeding, and control the air conditioning system to maintain the best feeding environment, such as adjusting the air conditioning temperature to 25°C and setting it to a breeze-free setting, and control the multimedia system to play soothing music. Users can improve the efficiency of soothing infants by combining music and manual comfort.

[0082] Furthermore, once the smart milk maker has finished preparing the milk, it can remind the user through voice prompts, allowing the user to remove the bottle and begin feeding.

[0083] It is important to note that the formula preparation parameters of a smart formula maker can be obtained through voice interaction or by directly executing the formula preparation action through pre-setting. It can also automatically determine the optimal formula preparation parameters by recognizing the infant's actual age stage and using big data matching. The operating parameters of the air conditioning system can also be obtained through voice interaction commands or by pre-setting operating parameters. The music played by the multimedia system can be set by the user or automatically adjusted to the optimal music based on the infant's current state.

[0084] Optionally, in one embodiment of this application, before controlling at least one interactive device in the vehicle cabin to perform the adaptation action corresponding to the pre-milk-making action, the method further includes: determining whether the seat is occupied; if it is occupied, generating a space-making action with a first adjustment amount and a first adjustment speed; if it is not occupied, generating a space-making action with a second adjustment amount and a second adjustment speed, wherein the second adjustment amount is greater than the first adjustment amount, and the second adjustment speed is greater than the first adjustment speed.

[0085] In actual implementation, this application embodiment can determine whether at least one seat in front of the infant seat is occupied, i.e., whether there is a passenger or an object on the seat, before controlling at least one seat to perform the corresponding space-making action.

[0086] If the seat is occupied, in order to avoid affecting the riding experience of the seat occupant, or to prevent objects on the seat from falling due to seat displacement, the embodiments of this application can smoothly generate a space-making action according to a first adjustment amount and a first adjustment speed. The first adjustment amount and the first adjustment speed can be set by those skilled in the art, and no specific limitations are made here.

[0087] If the seat is not occupied, the embodiments of this application can generate a space-making action with a second adjustment amount and a second adjustment speed, wherein the second adjustment amount is greater than the first adjustment amount and the second adjustment speed is greater than the first adjustment speed, so that the adjustment speed of the seat is faster, the space made up is larger, and it is more conducive to improving the soothing effect. The second adjustment amount and the second adjustment speed can be set by those skilled in the art, and no specific limitation is made here.

[0088] In step S103, it is detected whether the user has finished feeding, and when it is detected that the user has finished feeding, at least one interactive device in the vehicle cabin is controlled to return to the state before the action was performed.

[0089] Furthermore, embodiments of this application can detect whether the user has finished feeding, such as determining whether the feeding action has ended through in-vehicle images, obtaining the user's end command through voice, or determining whether the infant has stopped crying through voice. When the user is detected to have finished feeding, embodiments of this application can control at least one seat, air conditioning system, and multimedia system to return to the state before the action was performed, thereby ensuring the riding experience of the occupants in the vehicle.

[0090] The following example illustrates the breastfeeding scenario of this application.

[0091] Taking voice control as an example, in this application embodiment, in this scenario, it can be achieved through, for example... Figure 2 The framework shown is implemented.

[0092] like Figure 2 As shown, the startup scenario of this application embodiment is as follows: When it is necessary to feed an infant, the user places the bottle in the in-vehicle smart formula maker (the formula maker's constant temperature water is 45 degrees Celsius by default, and it is necessary to ensure that the formula maker contains sufficient water and formula powder), wakes up the device via voice, and says the command "formula preparation mode". After receiving the command, the voice prompt says "Okay, please state the amount of formula to prepare". The UI of the formula maker in this scenario can be as follows: Figure 3 As shown, the seat and air conditioning can be adjusted accordingly (seat moves forward, air conditioning temperature and airflow are adjusted to 25°C for a gentle breeze), and the multimedia system will play soothing music so parents can comfort their children simultaneously; the voice reply will say "Make 120ml", and after preparation, a TTS (Text To Speech) prompt will be given, allowing for direct feeding.

[0093] End of scenario: After the action is completed, the user can bring up the scenario via voice or central control screen command, and the seat position and air conditioning settings will be restored to the previously memorized values ​​(which can be automatically memorized by the domain module controller).

[0094] The milk maker connects to the IoT peripheral interface and forwards relevant information to the multimedia screen through the IoT peripheral interface. At the same time, it receives relevant setting information sent by the multimedia screen through the IoT peripheral interface. The smart peripheral communicates with the IoT peripheral interface through a serial port, and the IoT peripheral interface communicates with the multimedia screen through CAN-FD (CAN with Flexible Data-Rate).

[0095] Optionally, in one embodiment of this application, it further includes: when the actual intention is a preset diaper changing intention, controlling the seat to perform a corresponding space-making action, and controlling the air conditioning system and fragrance system of the interactive device to perform a corresponding second interactive action, and after the space-making action is completed, lowering the diaper changing table of the interactive device.

[0096] In some embodiments, when the actual intention of the infant is determined to be a preset diaper changing intention, such as when the infant is crying incessantly through voice recordings in the vehicle, or when the infant's movements are large based on in-vehicle image recognition, or when a user's diaper changing instruction is received, the system can control at least one seat in front of the infant seat to perform the aforementioned space-making action and lower the diaper changing table in the vehicle. This allows the user to use the diaper changing table to change the infant's diaper. At the same time, the system can also control the air conditioning system to maintain the best comfort environment in the vehicle and control the fragrance system to activate the in-vehicle fragrance or maintain air circulation between the inside and outside of the vehicle, thereby reducing odors in the vehicle and providing a good riding experience for passengers.

[0097] Furthermore, embodiments of this application can also detect whether the user has completed changing the diaper, and when it is detected that the diaper has been changed, control at least one seat, air conditioning system and fragrance system to return to the state before the action was performed, or after the diaper has been changed, embodiments of this application can also control the air conditioning system or fragrance system to increase the ventilation volume to achieve rapid odor dissipation.

[0098] Users can also manually control the lowering of the diaper table for changing. The parameters for maintaining the optimal comfort environment inside the vehicle can be set by those skilled in the art or preset by the user. The fragrance system can detect whether there is a built-in fragrance before starting the vehicle. If there is no built-in fragrance, the air exchange function between the inside and outside of the vehicle can be activated.

[0099] The following is a detailed description of a diaper changing scenario according to an embodiment of this application.

[0100] Taking voice control as an example, such as Figure 4 As shown, the embodiments of this application may include the following steps in this scenario:

[0101] Step S401: Voice activation. Activation scenario: When it is necessary to change a baby's diaper, the central control unit can be activated by voice by saying the command "Change diaper".

[0102] Step S402: Obtain information. The multimedia screen is triggered, and the occupant monitoring system is started.

[0103] Step S403: Send signal. Send the function activation signal to the gateway and then to the seat / air conditioning controller to automatically control and adjust the air conditioning to turn on the external circulation mode, adjust the temperature to the optimal comfortable 24 degrees Celsius (customizable according to actual needs), and turn on the fragrance system.

[0104] Step S404: Execution Module. The system uses an occupant monitoring system or image recognition to determine if the seat requiring adjustment is occupied. If occupied, seat adjustment is initiated while a TTS announcement is made stating "Seat will be finely adjusted forward soon." The adjustment amount is preset to 40mm forward (the front passenger can interrupt the process at any time using any button on the electric seat).

[0105] When not in use, the adjustment range is preset to 90mm (the specific adjustment should be based on the optimal human-machine layout model, and can be customized). This provides a more comfortable operating space for diaper changing and also soothes infants.

[0106] Step S405: End. After the action is completed, this scene can be recalled via voice or central control screen commands.

[0107] Step S406: Restore. The seat position and air conditioning settings are restored to their previous memory values ​​(which can be automatically remembered by the domain module controller).

[0108] Optionally, in one embodiment of this application, it further includes: when the actual intention is a preset sleep-inducing intention, controlling the multimedia system of the interactive device to perform the best playback action, and controlling the sleep-related device of the interactive device to perform the corresponding third interactive action.

[0109] In other embodiments, when the actual intention of the infant is determined to be to put the infant to sleep, such as when the infant is found to be crying incessantly by collecting in-vehicle voice recordings, or when a user's instruction to put the infant to sleep is received, the multimedia system is controlled to perform the best playback action, such as playing white noise or soft music. The system also controls the vehicle's sleep-related devices, such as adjusting the linkage functions of fragrance, humidifier, ambient lighting, seat ventilation and heating, etc., to promote sleep comfort in combination with weather and time, in order to perform the corresponding third interactive action, thereby providing the best atmosphere for putting the infant to sleep.

[0110] Furthermore, in this embodiment of the application, after detecting that the infant has fallen asleep, the ambient light and multimedia system can be turned off, while the functions of fragrance, seat ventilation and heating, and air conditioning system can be maintained until the infant is detected to have woken up.

[0111] Optionally, in one embodiment of this application, the optimal playback action includes at least one of music type, listening position, and volume.

[0112] Specifically, the optimal playback action in this application embodiment may include music type, listening position, and volume, wherein the music type may be white noise or light music, the listening position is the optimal listening position, in the scenario of soothing infants to sleep, the optimal listening position may be near the infant seat, and the volume may be set based on the user's pre-set sleep standard.

[0113] The following example illustrates the sleep-inducing scenario of this application.

[0114] Taking voice control as an example, as Figure 5 shown, the embodiments of the present application may include the following steps in this scenario:

[0115] Step S501: Occupant monitoring. Identify the age of the occupant through an occupant monitoring system or by combining images and voices, and monitor fatigue and emotions.

[0116] Step S502: Monitor whether it is infant fatigue / crying. Identify whether there is an infant among the occupants, and whether the infant is starting to feel sleepy or cry.

[0117] Step S503: Trigger the scenario engine script. Trigger the corresponding function according to the current sleep哄睡scene.

[0118] Step S504: Start the multimedia system. The scenario engine (automatically triggers certain functions according to the scenario) actively sends a command to the multimedia system to start the multimedia sleep哄睡light music or white noise, and the system automatically adjusts the best listening position to the rear row and the volume to a moderate level (the default settings are preset according to the sleep standard).

[0119] Step S505: Gateway signal transmission.

[0120] Step S506: Start the linkage controller. Including but not limited to controllers such as air conditioners, aromatherapy diffusers, humidifiers, ambient lights, seat ventilation and heating.

[0121] Step S507: Execute the scenario set value. Control the air conditioner, adjust the temperature to the optimal 25° for the body feeling and the air volume to the imperceptible wind automatically; on this basis, more linkage functions can be further included but not limited to, such as combining the weather and time to adjust the aromatherapy diffuser, humidifier, ambient light, seat ventilation and heating and other linkage functions to promote sleep comfort.

[0122] Step S508: End.

[0123] Step S509: The linkage controller restores the memory value.

[0124] Combined with Figures 2 to 6 shown, the working principle of the vehicle cockpit interaction method of the embodiments of the present application is elaborated in detail with an embodiment.

[0125] In the actual execution process, when the vehicle cockpit interaction method of the embodiments of the present application is applied, it can be implemented through the architecture as Figure 6 shown.

[0126] As Figure 6 shown, the architecture includes: multimedia large screen application, seat, air conditioner and breast pump.

[0127] The multimedia screen can be used to manage infant and toddler interaction modes, including music / video soothing, voice TTS broadcasting, and notification pop-ups.

[0128] The seat can be adjusted to move forward or return to its original position using preset internal logic within the module.

[0129] The air conditioner can adjust its parameters through preset internal logic of the module.

[0130] The milk maker can complete the milk preparation action based on the milk preparation parameters through the preset internal logic of the module.

[0131] Furthermore, when applied, the embodiments of this application can include the following three interactive application scenarios for infants and toddlers:

[0132] I. Breastfeeding Scenarios

[0133] Taking voice control as an example, in this application embodiment, in this scenario, it can be achieved through, for example... Figure 4 The framework shown is implemented.

[0134] like Figure 4 As shown, the startup scenario of this application embodiment is as follows: When it is necessary to feed an infant, the user places the bottle in the car's smart formula maker (the formula maker's constant temperature water is 45 degrees Celsius by default, and it is necessary to ensure that the formula maker contains sufficient water and formula powder), wakes up the device via voice, and says the command "formula maker mode". After receiving the command, the voice prompt says "Okay, please state the amount of formula". In this scenario, the formula maker's display UI (User Interface) can be as follows: Figure 5 As shown, the seat and air conditioning can be adjusted according to the "diaper" scenario linkage logic (seat moved forward, air conditioning temperature and airflow adjusted to 25°C for a gentle breeze), and the multimedia system will start playing soothing music so that parents can comfort their children simultaneously; the voice reply will say "make 120ml", and a voice TTS prompt will be given after the milk is prepared, so that the child can be fed directly.

[0135] End of scenario: After the action is completed, the user can bring up the scenario via voice or central control screen command, and the seat position and air conditioning settings will be restored to the previously memorized values ​​(which can be automatically memorized by the domain module controller).

[0136] The milk maker connects to the IoT peripheral interface and forwards relevant information to the multimedia screen through the IoT peripheral interface. At the same time, it receives relevant setting information sent by the multimedia screen through the IoT peripheral interface. The smart peripheral communicates with the IoT peripheral interface through a serial port, and the IoT peripheral interface communicates with the multimedia screen through CAN-FD (CAN with Flexible Data-Rate).

[0137] II. Diaper Changing Scenarios

[0138] Taking voice control as an example, such as Figure 4 As shown, the embodiments of this application may include the following steps in this scenario:

[0139] Step S401: Voice activation. Activation scenario: When it is necessary to change a baby's diaper, the central control unit can be activated by voice by saying the command "Change diaper".

[0140] Step S402: Obtain information. The multimedia screen is triggered, and the occupant monitoring system is started.

[0141] Step S403: Send signal. Send the function activation signal to the gateway and then to the seat / air conditioning controller to automatically control and adjust the air conditioning to turn on the external circulation mode, adjust the temperature to the optimal comfortable temperature of 25 degrees Celsius (customizable according to actual needs), and turn on the fragrance system.

[0142] Step S404: Execution Module. The system uses an occupant monitoring system or image recognition to determine if the seat requiring adjustment is occupied. If occupied, seat adjustment is initiated while a TTS announcement is made stating "Seat will be finely adjusted forward soon." The adjustment amount is preset to 50mm forward (the front passenger can interrupt the process at any time using any button on the electric seat).

[0143] When not in use, the adjustment range is preset to 90mm (the specific adjustment should be based on the optimal human-machine layout model, and can be customized). This provides a more comfortable operating space for diaper changing and also soothes infants.

[0144] Step S405: End. After the action is completed, this scene can be recalled via voice or central control screen commands.

[0145] Step S406: Restore. The seat position and air conditioning settings are restored to their previous memory values ​​(which can be automatically remembered by the domain module controller).

[0146] III. Bedtime Scenes

[0147] Taking voice control as an example, such as Figure 5 As shown, the embodiments of this application may include the following steps in this scenario:

[0148] Step S501: Occupant Monitoring. Using an occupant monitoring system or a combination of image and voice methods, identify occupant ages and monitor fatigue and mood.

[0149] Step S502: Monitor for infant fatigue / crying. Identify whether there are infants or young children among the passengers, and whether the infants or young children are starting to feel tired, sleepy, or crying.

[0150] Step S503: Scene engine script trigger. Based on the current sleep-inducing scene, trigger the corresponding function.

[0151] Step S504: The multimedia system starts. The scene engine (which automatically triggers certain functions according to the scene) actively sends a command to the multimedia system to turn on the soothing lullaby music or white noise. The system automatically adjusts the best listening position to the rear row and sets the volume to a moderate level (default settings are preset according to sleep standards).

[0152] Step S505: Gateway signal transmission.

[0153] Step S506: The linkage controller starts. This includes but is not limited to controllers such as air conditioners, aroma diffusers, humidifiers, ambient lights, seat ventilation and heating.

[0154] Step S507: Execute the scene setting values. Control the air conditioner, set the temperature to the optimal 25°C for the body feeling and automatically adjust the air volume to a non-intrusive level. On this basis, further but not limited to more linkage functions can be added, such as adjusting the aroma diffuser, humidifier, ambient lights, seat ventilation and heating in combination with the weather and time to enhance the sleep comfort.

[0155] Step S508: End.

[0156] Step S509: The linkage controller restores the memory values.

[0157] Through the embodiments of this application, presets and reminders are made for the scenarios of soothing infants and young children and the high-frequency childcare scenarios during short or long-distance driving for users, and a larger applicable space is actively provided in the corresponding scenarios in the third space inside the vehicle. At the same time, the content that users need to manually operate is reduced, such as soothing music, air conditioner adjustment, seat adjustment, pouring milk powder & hot water, etc. Personalized parameter settings (such as air conditioner problems, seat adjustment, etc.) are made according to user habits. The passengers in the car can focus on the baby's situation and avoid being distracted and getting into other dangers. The driver can also share the commands for the rear passengers.

[0158] In summary, this application can identify the actual intentions of infants and young children, thereby controlling the vehicle cockpit to perform corresponding interaction actions, cooperate with users to soothe infants and young children, reduce the manual operations of users, actively provide convenient services for users, improve the user's driving and riding experience, effectively meet the usage requirements, enable the driver to concentrate on controlling the vehicle, improve the driving safety of the vehicle, and enhance the riding experience of the passengers. Thus, it solves the problems in the related technologies, such as the lack of an interactive mode for infants and young children, making it difficult for the passengers in the car to efficiently soothe infants and young children, and thus affecting the riding experience of the passengers.

[0159] Figure 7 This is a schematic structural diagram of a cockpit interaction device of a vehicle provided by an embodiment of this application.

[0160] Exemplarily, as Figure 7 shown, the device 70 may include: an identification module 701, a first control module 702, and a second control module 703.

[0161] Specifically, the recognition module 701 is used to recognize the actual intentions of infants and young children.

[0162] The first control module 702 is used to control the on-board intelligent milk maker in the vehicle cabin to perform the corresponding milk preparation action according to the milk preparation instruction when the actual intention is a preset feeding intention or when a milk preparation instruction is received from the user, and to control at least one interactive device in the vehicle cabin to perform the adaptation action corresponding to the pre-milk preparation action.

[0163] The second control module 703 is used to detect whether the user has finished feeding, and when the user finishes feeding, controls at least one interactive device in the vehicle cabin to return to the state before the action was performed.

[0164] Optionally, in one embodiment of this application, the first control module 702 includes a control unit.

[0165] The control unit is used to control at least one seat of the interactive device to perform a corresponding space-making action, and to control the air conditioning system and multimedia system of the interactive device to perform a corresponding first interactive action.

[0166] Optionally, in one embodiment of this application, the vehicle's cockpit interaction device 70 further includes a third control module.

[0167] The third control module is used to control the seat to perform the corresponding space-making action when the actual intention is the preset diaper changing intention, and to control the air conditioning system and fragrance system of the interactive device to perform the corresponding second interactive action. After the space-making action is completed, the diaper changing table of the interactive device is lowered.

[0168] Optionally, in one embodiment of this application, the vehicle's cockpit interaction device 70 further includes a fourth control module.

[0169] The fourth control module is used to control the multimedia system of the interactive device to perform the best playback action when the actual intention is the preset sleep-inducing intention, and to control the sleep-related devices of the interactive device to perform the corresponding third interactive action.

[0170] Optionally, in one embodiment of this application, the optimal playback action includes at least one of music type, listening position, and volume.

[0171] Optionally, in one embodiment of this application, the vehicle's cockpit interaction device 70 further includes: a judgment module, a first adjustment module, and a second adjustment module.

[0172] The judgment module is used to determine whether at least one seat is occupied.

[0173] The first adjustment module is used to generate a space-making action with a first adjustment amount and a first adjustment speed when the space is occupied.

[0174] The second adjustment module is used to generate a space-making action with a second adjustment amount and a second adjustment speed when it is not in an occupied state, wherein the second adjustment amount is greater than the first adjustment amount and the second adjustment speed is greater than the first adjustment speed.

[0175] Optionally, in one embodiment of this application, the identification module 701 includes: an identification unit and / or a data acquisition unit.

[0176] The recognition unit is used to receive the user's voice commands and recognize the actual intent based on the voice commands.

[0177] The acquisition unit is used to acquire current images of the vehicle's interior and extract at least one user action feature from the current images to analyze the actual intent based on the user action feature.

[0178] It should be noted that the specific implementation of the vehicle cockpit interaction device in this application embodiment is similar to the specific implementation of the vehicle cockpit interaction method. In order to reduce redundancy, it will not be described in detail here.

[0179] In summary, this application can identify the actual intentions of infants and toddlers, thereby controlling the vehicle cabin to perform corresponding interactive actions to help users soothe them, reducing manual operation by the user, proactively providing convenient services, improving the user's driving experience, effectively meeting usage needs, allowing the driver to concentrate on controlling the vehicle, improving vehicle driving safety, and enhancing the passenger experience. Therefore, it solves the problem of the lack of infant and toddler interaction modes in related technologies, which makes it difficult for passengers to efficiently soothe infants and toddlers, thus affecting the passenger experience.

[0180] Figure 8 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application.

[0181] It should be understood that the methods described above can be applied to... Figure 8 In the vehicle with the structure shown.

[0182] Furthermore, this application also protects an apparatus that can be applied in a vehicle. The apparatus may include a memory 801 and a processor 802. The memory 801 stores executable program code, and the processor 802 is used to call and execute the executable program code to perform the vehicle cockpit interaction method provided in this application.

[0183] Furthermore, the device also includes a communication interface 803 for communication between the memory 801 and the processor 802.

[0184] This embodiment can divide the device into functional modules based on the above method example. For example, each module can correspond to a separate function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0185] When each functional module is divided according to its corresponding function, the device may also include an identification module, a first control module, and a second control module. It should be noted that all relevant content regarding the steps involved in the above method embodiments can be referenced to the functional descriptions of the corresponding functional modules, and will not be repeated here.

[0186] It should be understood that the device provided in this embodiment is used to execute the above-described vehicle cockpit interaction method, and therefore can achieve the same effect as the above-described implementation method.

[0187] When using an integrated unit, the device may include a processing module and a storage module. When the device is applied to a vehicle, the processing module can be used to control and manage the vehicle's movements. The storage module can be used to support the vehicle in executing program code, etc.

[0188] The processing module may be a processor 802 or a controller, which may implement or execute various exemplary logic blocks, modules, and circuits as disclosed in this application. The processor 802 may also be a combination of computing functions, such as a combination of one or more microprocessors 802, a combination of digital signal processing (DSP) and microprocessor 802, etc., and the storage module may be a memory 801.

[0189] In addition, the device provided in the embodiments of this application may specifically be a chip, component or module. The chip may include a connected processor 802 and a memory 801. The memory 801 is used to store instructions. When the processor 802 calls and executes the instructions, the chip can execute the vehicle cockpit interaction method provided in the above embodiments.

[0190] This embodiment also provides a computer-readable storage medium storing computer program code. When the computer program code is run on a computer, the computer executes the above-described related method steps to implement a vehicle cockpit interaction method provided in the above embodiment.

[0191] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement a vehicle cockpit interaction method provided in the above embodiment.

[0192] In this embodiment, the device, computer-readable storage medium, computer program product, or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0193] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0194] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0195] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for interacting with a vehicle cabin, the method comprising: The method comprises the following steps: identifying the actual intention of the infant; when the actual intention is a preset feeding intention or a user's milk preparation instruction is received, controlling a vehicle-mounted intelligent milk preparation machine in the vehicle cabin to perform a corresponding milk preparation action according to the preset feeding intention or the milk preparation instruction, and controlling at least one interactive device in the vehicle cabin to perform an adaptive action corresponding to the milk preparation action, which specifically comprises: controlling at least one seat of the interactive device to perform a corresponding space clearing action, and controlling an air conditioning system and a multimedia system of the interactive device to perform a corresponding first interactive action; and detecting whether the user has finished feeding, and when it is detected that the user has finished feeding, controlling at least one interactive device in the vehicle cabin to return to a state before the action is performed; the vehicle-mounted intelligent milk preparation machine is in communication connection with the multimedia system through an Internet of Things peripheral interface, and the milk preparation parameters of the vehicle-mounted intelligent milk preparation machine can be determined by identifying the actual age range of the infant to determine the optimal milk preparation parameters; before controlling at least one interactive device in the vehicle cabin to perform an adaptive action corresponding to the milk preparation action, further comprising: judging whether the seat is in an occupied state; if the seat is in the occupied state, generating the space clearing action with a first adjustment amount and a first adjustment speed; if the seat is not in the occupied state, generating the space clearing action with a second adjustment amount and a second adjustment speed, wherein the second adjustment amount is greater than the first adjustment amount, and the second adjustment speed is greater than the first adjustment speed.

2. The method of claim 1, wherein, further comprising: when the actual intention is a preset diaper changing intention, controlling the seat to perform a corresponding space clearing action, and controlling an air conditioning system and a fragrance system of the interactive device to perform a corresponding second interactive action, and after the space clearing action is performed, lowering a diaper changing table board of the interactive device.

3. The method of claim 1, wherein, further comprising: when the actual intention is a preset lullaby intention, controlling a multimedia system of the interactive device to perform an optimal playing action, and controlling sleep-related devices of the interactive device to perform a corresponding third interactive action.

4. The method of claim 3, wherein, The optimal playing action comprises at least one of a music type, a listening position and a volume.

5. The method of claim 1, wherein, The identification of the actual intention of the infant comprises: receiving a voice instruction of the user, and identifying the actual intention according to the voice instruction; and / or, collecting a current vehicle interior picture of the vehicle, and extracting at least one user action feature from the current vehicle interior picture to analyze the actual intention based on the at least one user action feature.

6. A cabin interaction device of a vehicle, characterized by, The method for realizing the cabin interaction of the vehicle as claimed in any one of claims 1 to 5, the device comprises: an identification module for identifying the actual intention of the infant; a first control module for, when the actual intention is a preset feeding intention or a user's milk preparation instruction is received, controlling a vehicle-mounted intelligent milk preparation machine in the vehicle cabin to perform a corresponding milk preparation action according to the preset feeding intention or the milk preparation instruction, and controlling at least one interactive device in the vehicle cabin to perform an adaptive action corresponding to the milk preparation action; and A second control module is configured to detect whether the user has finished feeding, and control at least one interactive device of the vehicle cabin to return to a state before performing an action when it is detected that the user has finished feeding.

7. A vehicle characterized by comprising: The application relates to a vehicle cabin interactive method and device. The application relates to a vehicle cabin interactive device.

8. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program which, when executed, implements the vehicle cabin interactive method of any one of claims 1 to 5.

Images