Control method and device and carrying tool

Abstract

The invention discloses a control method and device and a carrying tool, relates to the field of intelligent cabins, can be applied to a cabin of the carrying tool, and comprises the following steps: when a mode related to rest of a user in the cabin is detected to be started; controlling one or more of a seat, fragrance, a sound production device, a light device, an air conditioner and a display device in the cabin to be adjusted to a certain preset state; acquiring human body posture information; according to the human body posture information, one or more devices are controlled to be adjusted from a preset state to another state. The embodiment can be applied to an intelligent automobile or an electric automobile, the driving experience of a user can be improved, and the intelligent degree of a carrying tool can be improved.

Description

Control method, device and vehicle Technical Field

[0001] The present application relates to the field of smart cockpits, and more specifically, to a control method, device, and vehicle. Background Art

[0002] With the development of intelligent vehicles, more and more vehicles are equipped with modes that help users relax or rest, such as nap mode. Currently, when entering nap mode, the vehicle adjusts the in-cabin devices to the configured state according to the user's pre-configured settings. When users need to adjust the device status, they need to perform tedious manual adjustments, which can affect the user's driving experience.

[0003] Summary of the Invention

[0004] The embodiments of the present application provide a control method, device, and vehicle, which can automatically adjust the state of cabin equipment in a first mode through human body posture information, thereby helping to improve the user's driving experience and also helping to improve the intelligence level of the vehicle.

[0005] The vehicles in this application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or recreational equipment. For example, the vehicle may be a vehicle, which is a vehicle in a broad sense, and may be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiments of this application do not specifically limit the type of vehicle. For another example, the vehicle may be a vehicle such as an airplane or a ship.

[0006] In a first aspect, a control method is provided, which is applied to a cabin of a vehicle, the cabin including cabin equipment, the cabin equipment including at least one of a seat, a fragrance, a sound-emitting device, a lighting device, an air conditioner, and a display device. The method comprises: upon detecting that a first mode is turned on, controlling the cabin equipment to be in a first state, the first mode being a mode related to rest for a user in the cabin; obtaining human body posture information; and controlling the cabin equipment to adjust from the first state to a second state based on the human body posture information.

[0007] In an embodiment of the present application, the status of the cockpit equipment in the first mode can be automatically adjusted through human body posture information. The vehicle computer can independently make adjustment decisions based on the human body posture information, and can also adjust the cockpit equipment according to the instruction information contained in the human body posture information, which helps to improve the user's driving experience and also helps to improve the intelligence level of the vehicle.

[0008] In some possible implementations, the human body posture information includes hand gestures or torso postures.

[0009] Exemplarily, the hand gesture includes an air gesture. For example, the hand gesture may be a hover gesture, where the user's five fingers are spread out and the palm is facing the display device. For another example, the hand gesture may be a waving gesture, such as a waving gesture from left to right, or a waving gesture from top to bottom.

[0010] For example, the torso posture may include the user's head posture and limb posture. For example, the head posture may include the facial posture. The facial posture may be used to determine whether the user is in an open-eyes or closed-eyes state. For another example, the limb posture may include the posture of the user's two arms and two legs. Data collected by sensors in the cabin may be used to determine the frequency of changes in limb posture within a preset time period from the time the user enters a sleep state, thereby determining whether the user is in an uncomfortable or comfortable state.

[0011] The cockpit equipment being in the first state may include the seat being at a first angle, the fragrance type being a first type, the sound device being at a first volume, the lighting device being at a first brightness, the air conditioner being at a first temperature or a first air flow speed, the display device being at a second brightness, etc. Adjusting the cockpit equipment from the first state to the second state may include adjusting the seat angle to a second angle, adjusting the fragrance type to a second type, adjusting the sound device volume to a second volume, adjusting the lighting device brightness to a third brightness, adjusting the air conditioner temperature to a second temperature, adjusting the air conditioner air flow speed to a second air flow speed, adjusting the display device brightness to a fourth brightness, etc.

[0012] In some possible implementations, the second state is adapted to the human body posture information.

[0013] The above second state being adapted to the human body posture can also be understood as the comfort level of the user in the cockpit when the cockpit equipment is in the second state is greater than the comfort level of the user in the cockpit when the cockpit equipment is in the first state.

[0014] In combination with the first aspect, in some implementations of the first aspect, the first mode is a nap mode, a sleep mode, a rest mode, or a camping mode.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: obtaining sleep comfort, which is used to indicate the comfort level or sleep depth of the user when in a sleeping state; wherein, controlling the cockpit equipment to adjust from the first state to the second state based on the human body posture information includes: controlling the cockpit equipment to adjust from the first state to the second state based on the human body posture information and the sleep comfort.

[0016] In this embodiment of the present application, the vehicle computer can autonomously adjust the state of the cabin equipment in the first mode based on human posture information and sleep comfort, eliminating the need for manual adjustment by the user. This helps enhance the user's driving experience and the level of intelligence in the vehicle. Furthermore, by adjusting the state of the cabin equipment in the first mode based on sleep comfort, the user's sleep quality can be improved.

[0017] In some possible implementations, the sleep comfort level is used to indicate the user's comfort level when in a sleeping state. For example, the user's comfort level when in a sleeping state may include whether the user is in a comfortable state or an uncomfortable state when in a sleeping state. In some possible implementations, the sleep comfort level may be used to indicate the user's sleep depth when in a sleeping state. For example, the sleep depth may include a light sleep state and a deep sleep state.

[0018] In some possible implementations, obtaining the sleeping comfort level includes: when the human body posture information indicates that the user is in a sleeping state, obtaining the sleeping comfort level.

[0019] In an embodiment of the present application, the user's sleeping comfort is obtained when it is determined that the user is in a sleeping state through human body posture information, thereby avoiding determining the sleeping comfort through data collected by sensors in the cabin or data sent by wearable devices when the user is in a non-sleeping state, which helps to save the computing overhead of the vehicle and thus helps to reduce the power consumption of the vehicle.

[0020] In some possible implementations, the human body posture information used to determine whether the user is in a sleeping state includes the eye opening and closing state and / or the head angle.

[0021] In combination with the first aspect, in certain implementations of the first aspect, obtaining the sleep comfort includes: determining the sleep comfort based on first data collected by a sensor in the cabin; or, receiving second data sent by a wearable device and determining the sleep comfort based on the second data.

[0022] In the embodiments of the present application, the user's sleep comfort level can be determined based on data collected by sensors within the cabin or data transmitted by a wearable device. Thus, by adjusting the state of the cabin devices in the first mode based on the sleep comfort level, the user's sleep quality can be improved.

[0023] In some possible implementations, the sensors in the cockpit include cameras and / or millimeter-wave radars.

[0024] Exemplarily, obtaining the sleeping comfort level includes: determining that the user is in an uncomfortable state when the number of times the user's torso posture changes is greater than or equal to a preset number of times determined by the first data collected by the sensor in the cabin within a preset time period since the user entered the sleeping state; or determining that the user is in a comfortable state when the number of times the user's torso posture changes is less than the preset number of times determined by the first data collected by the sensor within a preset time period since the user entered the sleeping state.

[0025] Exemplarily, obtaining sleep comfort includes: determining the user's physiological parameters through first data collected by a sensor or second data sent by a wearable device within a preset time from the time the user enters a sleep state, the physiological parameters including heart rate and / or breathing rate; and determining whether the user is in a deep sleep state or a light sleep state based on the physiological parameters.

[0026] In some possible implementations, obtaining the sleep comfort level includes determining the sleep comfort level based on first data collected by a sensor in the cabin and second data sent by a wearable device.

[0027] For example, the user's breathing frequency can be determined to be a first frequency based on first data collected by the millimeter-wave radar in the cabin, and a second frequency based on second data sent by the wearable device. Based on the first and second frequencies, it can be determined whether the user is in a deep sleep state or a light sleep state. For example, the user's deep sleep state or light sleep state can be determined based on the average of the first and second frequencies.

[0028] In combination with the first aspect, in certain implementations of the first aspect, the cabin equipment includes an air conditioner, and when in the first state, the temperature of the air conditioner is a first temperature. The cabin equipment is controlled to adjust from the first state to the second state based on the human body posture information and the sleep comfort, including: when the human body posture information indicates that the user is in a sleeping state, the temperature of the air conditioner is controlled to adjust from the first temperature to the second temperature based on the sleep comfort.

[0029] In embodiments of the present application, the air conditioner temperature can be adjusted based on the user's sleep comfort level while the user is asleep, thereby improving the user's sleep quality. For example, after a user enters a deep sleep state, their body temperature will also change accordingly. By adjusting the air conditioner temperature, the user can be prevented from being woken by cold or heat during deep sleep, which would affect the user's sleep quality.

[0030] In some possible implementations, the wind speed of the air conditioner is the first wind speed when in the first state, and the cabin equipment is controlled to adjust from the first state to the second state based on the human body posture information and the sleeping comfort, including: when the human body posture information indicates that the user is in a sleeping state, the wind speed of the air conditioner is controlled to adjust from the first wind speed to the second wind speed based on the sleeping comfort.

[0031] In an embodiment of the present application, the air conditioner's wind speed can be adjusted based on the user's sleep comfort level while the user is asleep, helping to improve the user's sleep quality. For example, the air conditioner's wind speed is relatively high when the user first enters the first mode. Once the user enters a deep sleep state, maintaining a relatively high wind speed can affect the user's perceived thermal comfort and skin dryness. By adjusting and reducing the air conditioner's wind speed, the user's perceived thermal comfort and skin comfort can be improved in a deep sleep state, thereby improving the user's sleep quality.

[0032] In some possible implementations, when in the first state, the air outlet direction of the air conditioner is a first direction, and based on the human body posture information and the sleeping comfort, the cabin equipment is controlled to adjust from the first state to the second state, including: when the human body posture information indicates that the user is in a sleeping state, based on the sleeping comfort, the air outlet direction of the air conditioner is controlled to adjust from the first direction to the second direction.

[0033] In combination with the first aspect, in certain implementations of the first aspect, the cockpit equipment includes a sound-emitting device, and when in the first state, the volume of the sound-emitting device is a first volume. The cockpit equipment is controlled to adjust from the first state to the second state based on the human body posture information and the sleep comfort, including: when the human body posture information indicates that the user is in a sleeping state, according to the sleep comfort, the volume of the sound-emitting device is controlled to adjust from the first volume to the second volume, or the sound-emitting device is turned off, and the second volume is less than the first volume.

[0034] In an embodiment of the present application, when the user is sleeping, the volume of the sound-emitting device can be lowered or turned off according to the user's sleeping comfort, so as to avoid disturbing the user due to excessive volume, which helps to improve the user's sleep quality and thus helps to improve the user's driving experience.

[0035] In combination with the first aspect, in certain implementations of the first aspect, the cockpit device includes a seat, and controlling the cockpit device to adjust from the first state to the second state based on the human body posture information includes: controlling the state of the seat massage function based on the human body posture information.

[0036] In an embodiment of the present application, the state of the seat massage function can be automatically adjusted based on human posture information. For example, when the first mode is activated, the seat massage function is off. If the human posture information indicates that the user has been unable to fall asleep for a long time, the seat massage function can be automatically turned on to help the user relax and fall asleep as quickly as possible. If the human posture information indicates that the user is about to fall asleep, the seat massage function can be turned off or the massage intensity can be reduced. This helps prevent the seat massage from disturbing the user after falling asleep, thereby improving the user's sleep quality.

[0037] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: prompting the user to start the seat massage function.

[0038] In an embodiment of the present application, before controlling the state of the seat massage function to start, the user can also be prompted to start the seat massage function. This can avoid disturbing the user by automatically starting the seat massage function, and help improve the user's driving experience.

[0039] In some possible implementations, before prompting the user to start the seat massage function, the method further includes: within a preset time period from the time the cockpit equipment is in the first state, determining that the number of times the user's torso posture changes is greater than or equal to a preset number, wherein prompting the user to start the seat massage function includes: at the end of the first mode, prompting the user to turn on the seat massage function.

[0040] In this embodiment of the present application, statistics can be collected on the number or frequency of changes in the user's torso posture within a preset period of time since the cabin device was in the first state. For example, if the frequency of changes in the user's torso posture is excessive within the preset period of time since the cabin device was in the first state, the user may be deemed to be experiencing discomfort. Upon the end of the first mode, the user may be prompted to activate the seat massage function, thereby helping the user relax and alleviate discomfort.

[0041] In combination with the first aspect, in certain implementations of the first aspect, the human posture information includes the user's eye state, the cockpit equipment includes a display device and the brightness of the display device is a first brightness when in the first state, and the cockpit equipment is controlled to adjust from the first state to the second state based on the human posture information, including: when the eye state indicates that the user is with his eyes closed, controlling the brightness of the display device to adjust from the first brightness to the second brightness, or turning off the display device, and the second brightness is less than the first brightness.

[0042] In the embodiment of the present application, when the user closes his eyes, the brightness of the display device can be reduced or the display device can be turned off. In this way, by reducing the brightness of the display device, it helps to promote the user's sleep, thereby helping to improve the user's driving experience.

[0043] In some possible implementations, the method further includes: before detecting that the first mode is turned on, controlling the brightness of the display device to a third brightness, wherein the third brightness is higher than the first brightness; when detecting that the first mode is turned on, controlling the brightness of the display device to be adjusted from the third brightness to the first brightness; when the human body posture information indicates that the user is in a sleeping state, controlling the brightness of the display device to be adjusted from the first brightness to the second brightness.

[0044] In some possible implementations, when the human body posture information indicates that the user's eyes change from an open state to a closed state, the brightness of the display device is controlled to be adjusted from the first brightness to the second brightness.

[0045] In combination with the first aspect, in certain implementations of the first aspect, the human body posture information includes a first gesture of the user, and controlling the cockpit device to adjust from the first state to the second state based on the human body posture information includes: controlling the cockpit device to adjust from the first state to the second state based on the first gesture.

[0046] In the embodiments of the present application, the state of the cabin equipment in the first mode can be adjusted through hand gestures, which helps enhance the user's driving experience and also helps to improve the intelligence of the vehicle. For example, in the first mode, the user's seat angle is adjusted to a reclining position. If the user needs to lower the volume of the sound device, the user does not need to stand up and operate the display device to lower the volume. Instead, the user can lower the volume directly from the reclining position through hand gestures, making the volume lowering method more user-friendly.

[0047] In combination with the first aspect, in certain implementations of the first aspect, the cockpit includes a first area, the user is located in the first area, and the cockpit device is controlled to adjust from the first state to the second state according to the first gesture posture, including: according to the first gesture posture, controlling the device associated with the first area in the cockpit device to adjust from the first state to the second state.

[0048] In the embodiment of the present application, when multiple users are in the cabin in the first mode, gestures performed by users in the first zone can be used to adjust the status of cabin devices associated with the first zone. This allows for precise control of each zone within the cabin. When a user in the first zone wishes to adjust the status of a cabin device associated with the first zone, this avoids causing confusion for users in the second zone within the cabin. This helps enhance the driving experience for multiple users in the first mode and also helps improve the intelligence of the vehicle.

[0049] For example, taking a vehicle as an example, the first area can be the main driver's seat area or the passenger driver's seat area, where the main driver's seat area can be the area where the driver's seat is located, and the passenger driver's seat area can be the area where the passenger seat is located. If the first area is the main driver's seat area, devices associated with the first area may include the main driver's seat area, the main driver's seat air conditioner, the instrument panel, the main driver's seat ambient lighting, the main driver's seat door speakers, the main driver's seat headrest speakers, etc.

[0050] In combination with the first aspect, in certain implementations of the first aspect, the duration of the first mode is a first duration, and the method further includes: at the end of the first duration, prompting the user to turn off the first mode through an alarm; according to the user's second gesture, controlling the alarm to turn off, or controlling the alarm to delay the prompt.

[0051] When a user is awakened by an alarm, their emotions and consciousness are usually unclear. If the user is asked to operate on the display device to turn off the alarm at this time, it will bring inconvenience to the user and be inhumane. In the embodiment of the present application, when the duration of the first mode ends, the alarm can be turned off by a second gesture, or the alarm can be controlled to delay the reminder by the second gesture. This avoids the user having to turn off the alarm or delay the reminder by clicking on the display device, making it convenient for the user to turn off the alarm or control the alarm delay reminder in time, and also making the method of turning off the alarm or controlling the alarm delay reminder more humane.

[0052] In some possible implementations, controlling the alarm to turn off includes: controlling the alarm to turn off when a hover gesture of the user is detected.

[0053] In some possible implementations, the hovering gesture is a gesture in which the user's five fingers are spread out with the palm facing the display device.

[0054] In some possible implementations, controlling the alarm to delay the prompt includes: controlling the alarm to delay the prompt when a left-slide gesture or a right-slide gesture of the user is detected.

[0055] In some possible implementations, the user sits on the first seat in the first area, and before detecting that the first mode is turned on, the angle of the first seat is determined to be the first angle when the first mode is started, based on the user's advance setting operation of the first seat angle or based on the state of the first seat before the last exit from the first mode; the method also includes: when detecting that the first mode is turned on, detecting whether there is a user on the second seat; when there is a user on the second seat and adjusting the angle of the first seat to the first angle will affect the user on the second seat, controlling the scheduling of the first seat to be adjusted to a second angle, the second seat being a seat located behind the first seat and adjacent to the first seat, and the second angle being smaller than the first angle.

[0056] In this embodiment of the present application, when the first mode is activated, the system can detect whether a user is occupying the second seat behind the first seat. If a user is occupying the second seat and adjusting the first seat's angle to the first angle would affect the user in the second seat, the first seat's angle can be adjusted to the second angle. This prevents inconvenience to the user in the second seat caused by the first seat's state after entering the first mode, helps improve the driving experience for multiple users in the cabin, and also contributes to the intelligent level of the vehicle.

[0057] The angle of the first seat may be the angle formed between the seat cushion of the first seat and the backrest of the first seat.

[0058] In a second aspect, a control device is provided, which includes: a detection unit for detecting that a first mode is turned on, the first mode being a mode related to rest for a user in a cabin of a vehicle, the cabin including cabin equipment, the cabin equipment including at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner and a display device; a control unit for controlling the cabin equipment to be in a first state; an acquisition unit for acquiring human body posture information; the control unit is also for controlling the cabin equipment to adjust from the first state to the second state according to the human body posture information.

[0059] In combination with the second aspect, in certain implementations of the second aspect, the acquisition unit is further used to obtain sleep comfort, which is used to indicate the comfort level or sleep depth of the user when in a sleeping state; wherein the control unit is used to: control the cabin equipment to adjust from the first state to the second state according to the human body posture information and the sleep comfort.

[0060] In combination with the second aspect, in some implementations of the second aspect, the acquisition unit is used to: determine the sleeping comfort based on first data collected by the sensor in the cabin; or, receive second data sent by the wearable device and determine the sleeping comfort based on the second data.

[0061] In combination with the second aspect, in certain implementations of the second aspect, the cabin equipment includes an air conditioner, and when in the first state, the temperature of the air conditioner is a first temperature. The control unit is used to: when the human body posture information indicates that the user is in a sleeping state, control the temperature of the air conditioner from the first temperature to the second temperature according to the sleeping comfort.

[0062] In combination with the second aspect, in certain implementations of the second aspect, the cockpit equipment includes a sound-emitting device, and when in the first state, the volume of the sound-emitting device is a first volume. The control unit is used to: when the human body posture information indicates that the user is in a sleeping state, according to the sleeping comfort, control the volume of the sound-emitting device from the first volume to the second volume, or turn off the sound-emitting device, and the second volume is less than the first volume.

[0063] In combination with the second aspect, in certain implementations of the second aspect, the cockpit equipment includes a seat, and the control unit is used to control a state of a massage function of the seat according to the human body posture information.

[0064] In combination with the second aspect, in some implementations of the second aspect, the device further includes: a first prompting unit, configured to prompt a user to start the seat massage function.

[0065] In combination with the second aspect, in certain implementations of the second aspect, the human body posture information includes the user's eye state, the cockpit equipment includes a display device and the brightness of the display device is a first brightness when in the first state, and the control unit is used to: when the eye state indicates that the user is closing his eyes, control the brightness of the display device to adjust from the first brightness to the second brightness, or turn off the display device, and the second brightness is less than the first brightness.

[0066] In combination with the second aspect, in some implementations of the second aspect, the human body posture information includes a first gesture of the user, and the control unit is used to: control the cockpit equipment to adjust from the first state to the second state according to the first gesture.

[0067] In combination with the second aspect, in certain implementations of the second aspect, the cockpit includes a first area, the user is located in the first area, and the control unit is used to: control the device associated with the first area in the cockpit device to adjust from the first state to the second state according to the first gesture posture.

[0068] In combination with the second aspect, in certain implementations of the second aspect, the duration of the first mode is a first duration, and the device also includes: a second prompt unit, used to prompt the user to turn off the first mode through an alarm when the first duration ends; wherein the control unit is also used to control the alarm to turn off according to the user's second gesture, or to control the alarm to delay the prompt.

[0069] In combination with the second aspect, in certain implementations of the second aspect, the second state is adapted to the human body posture information.

[0070] In combination with the second aspect, in some implementations of the second aspect, the first mode is a nap mode, a sleep mode, a rest mode, or a camping mode.

[0071] In a third aspect, a control device is provided, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the control device to perform any possible method in the first aspect.

[0072] In a fourth aspect, a control system is provided, which includes cockpit equipment and a computing platform, wherein the computing platform includes any possible control device in the second aspect or the third aspect, and the cockpit equipment includes at least one of a seat, a fragrance, a sound-emitting device, a lighting device, an air conditioner, and a display device.

[0073] In some possible implementations, the control system further includes one or more sensors.

[0074] In a fifth aspect, a vehicle is provided, which includes any possible control device in the second aspect, or includes the control device described in the third aspect, or includes the control system described in the fourth aspect.

[0075] In some possible implementations, the vehicle is a vehicle.

[0076] In a sixth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any possible method in the first aspect.

[0077] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or separately packaged with the processor, and the embodiments of the present application do not specifically limit this.

[0078] In a seventh aspect, a computer-readable medium is provided, wherein the computer-readable medium stores a program code, and when the computer program code is run on a computer, the computer is caused to execute any possible method in the first aspect.

[0079] In an eighth aspect, an embodiment of the present application provides a chip system, which includes a processor for calling a computer program or computer instructions stored in a memory so that the processor executes any possible method in the above-mentioned first aspect.

[0080] In combination with the eighth aspect, in a possible implementation, the processor is coupled to the memory through an interface.

[0081] In combination with the eighth aspect, in one possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored.

[0082] In the embodiment of the present application, the state of the cockpit equipment in the first mode can be automatically adjusted through human body posture information, which helps to improve the user's driving experience and also helps to improve the intelligence level of the vehicle.

[0083] By adjusting the state of the cabin equipment in the first mode based on the user's sleep comfort, it helps to improve the user's sleep quality when sleeping. When the user is sleeping, the temperature of the air conditioner can be adjusted according to the user's sleep comfort, which helps to improve the user's sleep quality when sleeping.

[0084] When the user is sleeping, the wind speed of the air conditioner can be adjusted according to the user's sleeping comfort, which can improve the user's perceived thermal comfort and skin comfort in deep sleep, thereby improving the user's sleep quality.

[0085] When the user is sleeping, the volume of the sound device can be lowered or turned off according to the user's sleeping comfort, so as to avoid disturbing the user due to excessive volume, which helps to improve the user's sleep quality and thus helps to improve the user's driving experience.

[0086] If body posture information indicates that the user is unable to fall asleep for a long time, the seat massage function can be automatically activated to help the user relax and fall asleep as soon as possible. The seat massage function can also be turned off or the massage intensity can be reduced when body posture information indicates that the user is falling asleep. This helps avoid disruption to the user after falling asleep and improves sleep quality.

[0087] The status of the cockpit equipment in the first mode can be adjusted through hand gestures, which helps to improve the user's driving experience and also helps to improve the intelligence level of the vehicle.

[0088] In the first mode, when multiple users are in the cabin, gestures from users in the first zone can adjust the status of devices associated with the first zone. This allows for precise control of each zone within the cabin. When a user in the first zone wishes to adjust the status of a device associated with the first zone, this avoids causing confusion for users in the second zone.

[0089] When the duration of the first mode ends, the alarm can be turned off by a second gesture, or the alarm can be controlled to delay the reminder by the second gesture, avoiding the user having to turn off the alarm or delay the reminder by clicking on the display device, making it convenient for the user to turn off the alarm or control the alarm delay reminder in time, and also making the method of turning off the alarm or controlling the alarm delay reminder more user-friendly. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] FIG1 is a functional block diagram of a vehicle provided in an embodiment of the present application.

[0091] FIG2 is a functional block diagram of a vehicle provided in an embodiment of the present application.

[0092] FIG3 is a schematic diagram of the distribution of display screens in a vehicle cabin according to an embodiment of the present application.

[0093] FIG4 is a schematic flow chart of a control method provided in an embodiment of the present application.

[0094] FIG5 is a schematic diagram of estimating a user's gesture posture provided by an embodiment of the present application.

[0095] FIG6 is another schematic flow chart of the control method provided in an embodiment of the present application.

[0096] FIG7 is another schematic flow chart of the control method provided in an embodiment of the present application.

[0097] FIG8 is a schematic block diagram of a control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0098] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a way to describe the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. "At least one" means one or more. For example, "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, at least one of A and B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0099] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

[0100] Figure 1 is a functional block diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 may include a perception system 120, a cockpit device 130 and a computing platform 150, wherein the perception system 120 may include one or more sensors for sensing information about the environment surrounding the vehicle 100. For example, the perception system 120 may include a positioning system, and the positioning system may be a global positioning system (GPS), a Beidou system or other positioning systems. The perception system 120 may also include one or more of an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, a microphone array, a temperature sensor, a light sensor and a camera. The camera in the embodiment of the present application includes but is not limited to a red green blue (RGB) camera, a time of flight (TOF) camera or an infrared radiation (IR) camera.

[0101] Some or all functions of the vehicle 100 can be controlled by the computing platform 150. The computing platform 150 may include one or more processors, such as processors 151 to 15n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include a memory for storing instructions. Some or all of the processors 151 to 15n may call the instructions in the memory and execute the instructions to implement corresponding functions.

[0102] The cabin equipment 130 may include at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner, and a display device.

[0103] For example, display devices are mainly divided into two categories: the first is in-vehicle display screens; the second is projection display screens, such as heads-up displays (HUDs). An in-vehicle display screen is a physical display screen and a key component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, such as the digital instrument panel, the center console, the display in front of the front passenger (also known as the front passenger), the display in front of the left rear passenger, and the display in front of the right rear passenger. Even the windows can serve as display screens. A head-up display, also known as a head-up display system, is primarily used to display driving information such as speed and navigation on a display device in front of the driver (e.g., the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by the driver's gaze shift, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD), windshield-HUD (W-HUD), and augmented reality HUD (AR-HUD). It should be understood that other types of HUD systems may appear as technology evolves, and this application is not limited to this.

[0104] The above display device is described by taking a vehicle display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device can also be a light display screen or a projection screen.

[0105] Exemplarily, the lighting device may include an ambient light, a reading light, and the like.

[0106] In an embodiment of the present application, the computing platform 150 can receive data sent by the perception system 120 and adjust the status of the cockpit equipment 130 according to the data.

[0107] It should be understood that the connection between the computing platform 150 and the perception system 120 and the cockpit equipment 130 via a connecting line in Figure 1 above may indicate that the computing platform 150, the perception system 120 and the cockpit equipment 130 are connected in a wired manner, or it may also indicate that the computing platform 150, the perception system 120 and the cockpit equipment 130 are connected in a wireless manner.

[0108] Taking a vehicle as an example, FIG2 shows a functional block diagram of a vehicle 200 according to an embodiment of the present application. Vehicle 200 may include a microphone 201, an in-cabin camera 202, a millimeter-wave radar 203, other cabin sensors 204, a vehicle-mounted platform 205, seats 206, air conditioning 207, a cabin display 208, speakers 209, ambient lighting 210, and a vehicle fragrance 211. The microphone 201, in-cabin camera 202, millimeter-wave radar 203, and other cabin sensors 204 may be located in the aforementioned perception system 120, the vehicle-mounted platform 205 may be located in the aforementioned computing platform 150, and the seats 206, air conditioning 207, cabin display 208, speakers 209, ambient lighting 210, and a vehicle fragrance 211 may be located in the aforementioned cabin equipment 130.

[0109] The other cabin sensors 204 mentioned above may include a temperature sensor, a light sensor, and the like.

[0110] The vehicle platform 205 can receive data collected by one or more of the microphone 201, the in-cabin camera 202, the millimeter-wave radar 203, and other in-cabin sensors 204. Based on this data, the vehicle platform 205 can adjust the status of one or more of the following devices: the seat 206, the air conditioner 207, the in-cabin display 208, the speaker 209, the ambient light 210, and the in-cabin fragrance 211.

[0111] For example, when nap mode is enabled, the vehicle platform 205 can control the temperature of the air conditioner 207 to 20°C and the brightness of the in-cabin display 208 to 200 nits. The vehicle platform 205 can also control the in-cabin camera 202 to turn on and capture images of the cabin. If the vehicle platform 205 determines from these images that the user in the cabin has entered a sleep state, it can increase the temperature of the air conditioner 207 from 20°C to 26°C and reduce the brightness of the in-cabin display 208 from 200 nits to 100 nits.

[0112] Figure 3 shows a schematic diagram of an exemplary display screen layout within a vehicle cabin, as provided in an embodiment of the present application. As shown in Figure 3 , the vehicle cabin may include display screen 301 (or, alternatively, a central control screen), display screen 302 (or, alternatively, a passenger entertainment screen), display screen 303 (or, alternatively, a second-row left entertainment screen), display screen 304 (or, alternatively, a second-row right entertainment screen), and an instrument panel.

[0113] It should be understood that the graphical user interface (GUI) in the following embodiments is described using the five-seater vehicle shown in FIG2 as an example, and the embodiments of the present application are not limited thereto. For example, for a seven-seater sport utility vehicle (SUV), the cockpit may include a central control screen, a co-pilot entertainment screen, an entertainment screen in the second row left area, an entertainment screen in the second row right area, an entertainment screen in the third row left area, and an entertainment screen in the third row right area. For another example, for a passenger car, the cockpit may include a front row entertainment screen and a rear row entertainment screen; or, the cockpit may include a display screen in the driving area and an entertainment screen in the passenger area. In one implementation, the entertainment screen in the passenger area may also be set on the top of the cockpit.

[0114] As previously mentioned, when the vehicle enters nap mode, the vehicle adjusts the device to the configured state based on the user's pre-configured manual configuration. When the user needs to change the device state, the user needs to perform tedious manual adjustments, which will affect the user's driving experience.

[0115] The embodiments of the present application provide a control method, device, and vehicle, which can automatically adjust the state of cabin equipment in a first mode through human body posture information, thereby helping to improve the user's driving experience and also helping to improve the intelligence level of the vehicle.

[0116] Figure 4 shows a schematic flow chart of a control method 400 provided in an embodiment of the present application. The method 400 can be executed by a vehicle (e.g., a vehicle), or the method 400 can be executed by the above-mentioned computing platform (e.g., a vehicle platform), or the method 400 can be executed by a system consisting of a computing platform and a cockpit device, or the method 400 can be executed by a system-on-a-chip (SoC) in the above-mentioned computing platform, or the method 400 can be executed by a processor in the computing platform. The method 400 can be applied to a cockpit of a vehicle, which includes cockpit equipment, and the cockpit equipment includes at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner, and a display device. The method 400 includes:

[0117] S410: When it is detected that the first mode is turned on, the cockpit device is controlled to be in a first state, where the first mode is a mode related to rest of the user in the cockpit.

[0118] Exemplarily, the first mode includes but is not limited to a nap mode, a sleep mode, a rest mode or a camping mode.

[0119] In one embodiment, the detecting that the first mode is turned on includes: turning on the first mode when detecting an input from a user indicating turning on the first mode.

[0120] In one embodiment, when a user input is detected indicating that the first mode is to be turned on, the first mode is turned on, including: detecting a first operation of the user when the first mode is off, displaying a display interface of the first mode, the display interface including a control for turning on the first mode; detecting the user input to the control, and turning on the first mode.

[0121] Exemplarily, the first operation is an operation of the user sliding from the top to the bottom of the display device, and the display interface may be a drop-down menu display interface, which includes a control for turning on the first mode.

[0122] In one embodiment, when a user input indicating that the first mode is to be turned on is detected, the first mode is turned on, including: obtaining a user's voice instruction when the first mode is off, the voice instruction being used to instruct to turn on the first mode; and turning on the first mode according to the voice instruction.

[0123] For example, a user is located in the main driver's seat of a vehicle. Upon detecting that the user issues a voice command "enable nap mode," the user's location can be determined based on the voice command captured by the microphone array in the cabin. For example, the user's location can be determined based on the voice command captured by the microphone array. Consequently, the cabin devices in the main driver's seat can be controlled to be in the first state.

[0124] In one embodiment, the detecting that the first mode is turned on includes: automatically turning on the first mode when detecting the user's intention to rest or sleep.

[0125] In one embodiment, the first mode is automatically activated when the user's intention to rest or sleep is detected, including: automatically activating the first mode when the user's yawning expression or sleepy expression is detected.

[0126] In one embodiment, when the user's yawning expression is detected, the first mode is automatically turned on, including: when the number of times the user yawns is detected to be greater than or equal to a preset number within a first preset time period, the first mode is automatically turned on.

[0127] Exemplarily, the first preset duration is 5 minutes, and the preset number of times is 5 times.

[0128] In one embodiment, automatically turning on the first mode when a sleepy expression of the user is detected includes: automatically turning on the first mode when it is detected that the duration of the sleepy expression of the user is greater than or equal to a second preset duration.

[0129] Exemplarily, the second preset duration is 3 minutes.

[0130] In the embodiment of the present application, when a yawning or sleepy expression of a user is detected, the first mode can be automatically activated. In this way, the user does not need to manually activate the first mode, which helps to improve the user experience and also helps to improve the intelligence level of the vehicle.

[0131] In one embodiment, when the user's intention to rest or sleep is detected, the first mode is automatically turned on, including: when the user's intention to rest or sleep is detected in the non-main driver area, the cabin equipment in the non-main driver area is controlled to be in the first state.

[0132] In one embodiment, when the user's intention to rest or sleep is detected, the first mode is automatically turned on, including: when the user's intention to rest or sleep is detected in the main driving area and the current vehicle is in the parking state, the cabin equipment in the main driving area is controlled to be in the first state.

[0133] In one embodiment, the vehicle stores a mapping relationship between the user and the state of the cabin equipment, and controlling the cabin equipment to be in the first state includes: determining that the first user triggers the start of the first mode; and controlling the cabin equipment to be in the first state according to the first user and the mapping relationship.

[0134] Exemplarily, Table 1 shows a mapping relationship between a user and the status of a cockpit device.

[0135] Table 1

[0136] Table 1 above is merely illustrative, and embodiments of the present application are not limited thereto. For example, the cabin equipment status may also include the air conditioning wind speed and airflow direction, and the type of fragrance (e.g., refreshing, deodorizing, soothing, etc.).

[0137] The angle of the above seats can be the angle formed between the seat cushion and the seat back.

[0138] In one embodiment, before detecting that the first mode is turned on, the method 400 further includes: obtaining a setting instruction from a user, where the setting instruction is used to indicate that the state of the cockpit device is the first state when the first mode is turned on.

[0139] In one embodiment, before detecting that the first mode is turned on, the method 400 further includes: recording a state of the cockpit device during the last operation of the first mode, where the state of the cockpit device is the first state.

[0140] In one embodiment, the last time the first mode was run, the first moment was the moment of exiting the first mode, and the recording of the state of the cockpit equipment during the last time the first mode was entered included: recording the state of the cockpit equipment at the first moment, and the state of the cockpit equipment was the first state.

[0141] S420: Acquire human body posture information.

[0142] In one embodiment, the human body posture information includes the user's hand gestures and torso posture.

[0143] Exemplarily, taking the acquisition of the user's hand gesture as an example, FIG4 shows a schematic diagram of estimating the user's hand gesture provided by an embodiment of the present application. As shown in FIG4 , when a user is detected in the main driving area of ​​the vehicle cabin, the image data of the main driving area collected by the RGB camera can be input into the neural network (NN), so that a 2-dimensional (2D) result of the human hand and a human hand model can be output. The 2.5-dimensional (2.5-dimension, 2.5D) result of the key points of the human hand can be determined by the human hand model. Based on the 2.5D results of the key points of the human hand and the 2D results of the human hand, the 3D key point position of the entire human hand can be obtained by the perspective-n-point (PNP) algorithm. By inputting the 3D key point position into the hand gesture estimation module, the hand gesture of the user in the main driving area can be obtained.

[0144] Similarly, the user's torso pose can be determined by referring to the process shown in Figure 4 above. For example, image data of the main driving area captured by an RGB camera can be input into the neural network, which can output a 2D torso result and a torso model. The torso model can be used to determine the 2.5D results of the torso key points. Based on the 2.5D results of the torso key points and the 2D results of the torso, the 3D key point positions of the torso can be obtained using the PNP algorithm. By inputting the 3D key point positions of the torso into the torso pose estimation module, the torso pose of the user in the main driving area can be determined.

[0145] It should be understood that the process of estimating the hand gesture posture shown in FIG4 is merely illustrative, and the embodiments of the present application are not limited thereto. Hand gesture posture and torso posture may also be determined in other ways. For example, hand gesture posture may also be estimated using a convolutional pose machine (CPM) algorithm.

[0146] S430: Control the cockpit equipment to adjust from the first state to a second state according to the human body posture information.

[0147] Optionally, the second state is adapted to the human body posture information.

[0148] The above second state is adapted to the human body posture information, which can also be understood as the comfort level of the user in the cockpit when the cockpit device is in the second state is greater than the comfort level of the user in the cockpit when the cockpit device is in the first state.

[0149] Optionally, the method 400 also includes: obtaining sleep comfort, which is used to indicate the comfort level or sleep depth of the user when in a sleeping state; wherein, controlling the cockpit equipment to adjust from the first state to the second state based on the human body posture information includes: controlling the cockpit equipment to adjust from the first state to the second state based on the human body posture information and the sleep comfort.

[0150] Optionally, the sleep comfort level can be used to indicate the user's sleep depth. For example, the sleep depth level can include light sleep and deep sleep. This allows for automatic adjustment of cabin equipment in the first mode based on body posture information and sleep comfort, eliminating the need for manual adjustments by the user. This helps enhance the user's driving experience and the level of intelligence within the vehicle. Furthermore, adjusting cabin equipment in the first mode based on sleep comfort helps improve the user's sleep quality.

[0151] Optionally, obtaining the sleeping comfort level includes: when the human body posture information indicates that the user is in a sleeping state, obtaining the sleeping comfort level.

[0152] Exemplarily, when the human body posture information indicates that the user's eyes change from an open state to a closed state, it can be determined that the user is in a sleeping state.

[0153] Optionally, when the ambient brightness in the cabin is greater than or equal to a preset ambient brightness, the user's eye state can be determined based on data collected by the RGB sensor and / or IR sensor in the cabin; or, when the ambient brightness in the cabin is less than the preset ambient brightness, the user's eye state can be determined based on data collected by the IR sensor and / or millimeter-wave radar in the cabin.

[0154] Exemplarily, the preset ambient brightness is 100 lux.

[0155] Exemplarily, if the frequency of changes in the user's torso posture is detected to be less than or equal to a first preset frequency within a preset time period from when the human body posture information indicates that the user's eyes change from an open state to a closed state, it can be determined that the user is in a sleeping state.

[0156] Optionally, obtaining the sleep comfort level includes: determining the sleep comfort level based on first data collected by a sensor in the cabin; or receiving second data sent by a wearable device and determining the sleep comfort level based on the second data.

[0157] For example, the sensors in the cabin may include millimeter-wave radar. Data collected by the millimeter-wave radar can be used to determine the user's breathing rate or heart rate. This can then be used to determine the user's sleeping comfort.

[0158] For example, when the user's heart rate is determined to be within [70 beats / minute, 100 beats / minute] based on the data collected by the millimeter-wave radar, it can be determined that the user is in a light sleep state; or, when the user's heart rate is determined to be within [50 beats / minute, 70 beats / minute) based on the data collected by the millimeter-wave radar, it can be determined that the user is in a deep sleep state.

[0159] For example, when the user's breathing rate is determined to be within [16 times / minute, 20 times / minute] according to the data collected by the millimeter-wave radar, it can be determined that the user is in a light sleep state; or, when the user's heart rate is determined to be within (12 times / minute, 16 times / minute) according to the data collected by the millimeter-wave radar, it can be determined that the user is in a deep sleep state.

[0160] Optionally, the sleep comfort level can also be determined by combining the first data and the second data. For example, the first data collected by the millimeter-wave radar in the cabin determines that the user's heart rate is 65 beats / minute, and the second data sent by the wearable device determines that the user's heart rate is 71 beats / minute. Then, the user can be determined to be in a deep sleep state based on the average of the heart rate determined by the first data and the heart rate determined by the second data (for example, 68 beats / minute).

[0161] Optionally, the sleeping comfort level is used to indicate the comfort level of the user when the user is in a sleeping state. For example, the comfort level of the user when the user is in a sleeping state includes whether the user is in a comfortable state or an uncomfortable state when the user is in a sleeping state.

[0162] Exemplarily, the sensor in the cabin may include a camera, such as a camera of a driver monitor system (DMS) or a camera of a cabin monitor system (CMS). For example, after the user enters a sleep state, if the frequency of changes in the user's torso posture is greater than or equal to a second preset frequency and less than the first preset frequency, it can be determined that the user is in an uncomfortable state while sleeping; or, if the frequency of changes in the user's torso posture is less than the second preset frequency, it can be determined that the user is in a comfortable state while sleeping, wherein the first preset frequency is greater than the second preset frequency.

[0163] Exemplarily, the vehicle can receive data sent by a smart watch or smart bracelet and determine the user's sleeping comfort based on the data. For example, when the human body posture information indicates that the user is in a sleeping state, the vehicle can initiate a connection request to the smart watch, and the connection request is used to request to establish a connection with the smart watch; the smart watch can establish a connection with the vehicle based on the connection request. For example, the vehicle and the smart watch can establish a connection through short-range communication technology, and short-range communication technology includes but is not limited to Bluetooth connection or Wi-Fi connection. For another example, the vehicle and the smart watch can also establish a connection through a cloud server. After the vehicle and the smart watch establish a connection, the smart watch can periodically send data to the vehicle.

[0164] For another example, upon detecting that the first mode is on, the vehicle may send a broadcast message requesting a connection with the user's wearable device. The broadcast message may include the user's identification information. After receiving the broadcast message, the smartwatch may establish a connection with the vehicle based on the user's identification information.

[0165] Exemplarily, receiving data sent by a smartwatch or smart bracelet includes receiving one or more of the user's heart rate, respiratory rate, blood circulation rate, and blood pressure information sent by the smartwatch or smart bracelet. The user's sleep comfort level is determined based on one or more of the heart rate, respiratory rate, blood circulation rate, and blood pressure information.

[0166] Exemplarily, receiving data sent by a smart watch or a smart bracelet includes: receiving information sent by the smart watch or the smart bracelet to indicate the user's sleeping comfort.

[0167] In the embodiments of the present application, the user's sleep comfort level can be determined based on data collected by sensors within the cabin or data transmitted by a wearable device. Thus, by adjusting the state of the cabin devices in the first mode based on the sleep comfort level, the user's sleep quality can be improved.

[0168] Optionally, the cabin equipment includes an air conditioner, and when in the first state, the temperature of the air conditioner is a first temperature. The cabin equipment is controlled to adjust from the first state to the second state based on the human posture information and the sleep comfort level, including: when the human posture information indicates that the user is in a sleep state, the temperature of the air conditioner is controlled to adjust from the first temperature to the second temperature based on the sleep comfort level. In this way, the temperature of the air conditioner can be adjusted based on the user's sleep comfort level while the user is in a sleep state, which helps to improve the user's sleep quality while in a sleep state. For example, after a user enters a deep sleep state, their body temperature will also change accordingly. By adjusting the temperature of the air conditioner, the user can be prevented from being woken up by cold or heat in a deep sleep state, thereby preventing the user from being woken up by cold or heat in a deep sleep state, thereby affecting the user's sleep quality.

[0169] Optionally, the temperature of the air conditioner is controlled to be adjusted from the first temperature to the second temperature according to the sleeping comfort and the duration of the sleeping state.

[0170] For example, the first mode starts at time T1 and ends at time T2. If the user enters a sleep state at time T3 between T1 and T2, a prediction can be made for the user's sleep state during the time period from T3 to T2. For example, the prediction is that the user is in light sleep during the time period [T3, T4] and in deep sleep during the time period [T4, T2]. For example, if the air conditioner is in cooling mode and the temperature is 20°C in the first mode, the air conditioner temperature can be gradually increased from 20°C to a comfortable sleep temperature (e.g., 26°C) during the time period [T3, T4]. If the time period [T3, T4] lasts 20 minutes, the air conditioner temperature can be controlled to increase by 0.3°C per minute during the time period [T3, T4]. The air conditioner temperature is maintained at 26°C during the time period [T4, T2]. This ensures that the air conditioner temperature is comfortable when the user enters a deep sleep state.

[0171] The above description is based on the example of a comfortable sleeping temperature of 26°, but the present invention is not limited thereto. For example, a comfortable sleeping temperature of 23° may also be used.

[0172] The above example uses the air conditioner temperature control to increase by 0.3°C per minute during the time period [T3, T4]. The air conditioner temperature can be adjusted linearly or nonlinearly. For example, the air conditioner temperature can be adjusted based on the human thermal comfort curve.

[0173] For example, if it is determined at time T5 before time T4 that the user has entered a deep sleep state from a light sleep state, the frequency of the air conditioner temperature change can be increased within a preset duration after time T5. For example, if the duration of the time period [T3, T5] is 10 minutes, then the air conditioner temperature is raised to 23°C at time T5. After time T5, the air conditioner temperature is increased by 0.6°C per minute until it is adjusted to 26°C. In this way, if it is determined that the user has entered a deep sleep state early, the speed of the air conditioner temperature change can be increased, so that the air conditioner temperature changes quickly to a temperature suitable for the user's deep sleep, which helps improve the user's sleep quality.

[0174] For example, if it is not detected that the user has entered a deep sleep state from a light sleep state at time T4, the temperature of the air conditioner can be maintained at 26° C. during the time period [T4, T2].

[0175] For example, after a user enters a deep sleep state from a light sleep state, the vehicle can also adjust the air conditioning temperature. For example, because the air conditioning temperature and the human body's thermal comfort temperature do not completely coincide, the vehicle can identify the thickness of the user's clothing and adjust the air conditioning temperature to ensure that the user's perceived temperature meets human thermal comfort.

[0176] In one embodiment, when predicting the user's sleep state in the time period from T3 to T2, the user's historical sleep data can be referred to. For example, the historical sleep data includes the ratio between the length of light sleep and the length of deep sleep after the user starts the first mode and enters the sleep state in the past period of time (for example, within a month).

[0177] In one embodiment, the proportion of light sleep (e.g., 60% of the total sleep time) and the proportion of deep sleep (e.g., 40% of the total sleep time) can be preset in advance. For example, if the duration of the time period [T3, T2] is 30 minutes, it can be predicted that the user will be in light sleep for 18 minutes and in deep sleep for 12 minutes.

[0178] The above description uses the user's sleep state including the light sleep state and the deep sleep state as an example, but the embodiments of the present application are not limited to this. For example, after entering the sleep state, the user can successively experience the light sleep state, the deep sleep state and the light sleep state. For example, it is predicted that the user is in the light sleep state during the time period [T3, T4], switches from the light sleep state to the deep sleep state during the time period (T4, T6), and switches from the deep sleep state to the light sleep state during the time period (T6, T2). During the time period (T6, T2), the temperature of the air conditioner is controlled to gradually return to 20°C.

[0179] Optionally, when in the first state, the wind speed of the air conditioner is a first wind speed, and the cabin equipment is controlled to adjust from the first state to the second state according to the human body posture information and the sleeping comfort, including: when the human body posture information indicates that the user is in a sleeping state, the wind speed of the air conditioner is controlled to adjust from the first wind speed to the second wind speed according to the sleeping comfort.

[0180] For example, taking the air conditioner in cooling state and the wind speed of the air conditioner in the first state as 2 meters per second (m / s), the wind speed of the air conditioner can be controlled to gradually decrease from 2m / s to 1m / s during the time period [T3, T4]. If the duration of the time period [T3, T4] is 10 minutes, the wind speed of the air conditioner can be controlled to decrease by 0.1m / s per minute during the time period [T3, T4]. The temperature of the air conditioner is maintained at 1m / s during the time period [T4, T2]. In this way, it can be ensured that the wind speed of the air conditioner is at a wind speed that the user feels more comfortable when entering a deep sleep state.

[0181] For example, if it is determined at time T5 before time T4 that the user has entered a deep sleep state from a light sleep state, the frequency of the air-conditioning temperature change can be increased within a preset time period after time T5. If the duration of the time period [T3, T5] is 5 minutes, then the wind speed of the air-conditioning will drop to 1.5m / s at time T5. After time T5, the wind speed of the air-conditioning will be reduced by 0.2m / s per minute until the wind speed of the air-conditioning is adjusted to 1m / s. In this way, when it is determined that the user has entered a deep sleep state in advance, the speed of the air-conditioning wind speed change can be increased so that the wind speed of the air-conditioning changes quickly to a wind speed suitable for the user's deep sleep, which helps to improve the user's sleep quality.

[0182] For example, if it is not detected that the user has entered a deep sleep state from a light sleep state at time T4, the wind speed of the air conditioner can be maintained at 1 m / s during the time period [T4, T2].

[0183] In an embodiment of the present application, the air conditioner's wind speed can be adjusted based on the user's sleep comfort level while the user is asleep, thereby improving the user's sleep quality. For example, the air conditioner's wind speed is relatively high when the user first enters the first mode. Once the user enters a deep sleep state, the higher wind speed will affect the user's perceived comfort and generate a lot of noise. By adjusting and lowering the air conditioner's wind speed, the user's perceived comfort can be improved and the impact of noise on the user can be reduced, thereby improving the user's sleep quality.

[0184] Optionally, when in the first state, the air outlet direction of the air conditioner is a first direction, and the cabin equipment is controlled to adjust from the first state to the second state according to the human body posture information and the sleeping comfort, including: when the human body posture information indicates that the user is in a sleeping state, the air outlet direction of the air conditioner is controlled to adjust from the first direction to the second direction according to the sleeping comfort.

[0185] For example, if the air conditioner is in cooling mode and the air flow direction is toward the user in the first state, the air flow direction can be controlled to gradually move away from the user during the time period [T3, T4]. This prevents the air conditioner from blowing directly onto the user when the user enters a deep sleep state, thus improving the user experience.

[0186] For example, when the first direction is toward the core area of ​​the user (for example, the face, neck, heart or middle torso) and the user enters a sleep state, the air outlet direction of the air conditioner can be controlled to gradually deviate from the core area of ​​the user; or, when the first direction is toward the non-core area of ​​the user and the user enters a sleep state, the air outlet direction of the air conditioner may not be adjusted.

[0187] Optionally, the cockpit equipment includes a sound-emitting device, and when in the first state, the volume of the sound-emitting device is a first volume. The cockpit equipment is controlled to adjust from the first state to the second state according to the human body posture information and the sleeping comfort, including: when the human body posture information indicates that the user is in a sleeping state, according to the sleeping comfort, controlling the volume of the sound-emitting device to adjust from the first volume to the second volume, or turning off the sound-emitting device, and the second volume is less than the first volume.

[0188] For example, when the first mode is turned on, the volume of the speaker in the cabin is 70dB in the first state. When the human body posture information indicates that the user has entered a sleep state, the volume of the speaker in the cabin can be reduced to 60dB. In the time period [T3, T4], the volume of the speaker can be controlled to gradually decrease from 60dB to 30dB. If the duration of the time period [T3, T4] is 10 minutes, the volume of the speaker can be reduced by 3dB per minute in the time period [T3, T4]. The volume of the speaker is maintained at 30dB in the time period [T4, T2]. In this way, the impact of excessive volume of the speaker on the user's sleep quality after the user enters a deep sleep state can be avoided.

[0189] In one embodiment, when the first mode is enabled, the volume of the cabin speaker is 70dB in the first state. When the body posture information indicates that the user has entered a sleep state, the volume of the cabin speaker can be reduced to 60dB. When the user enters a deep sleep state, the cabin speaker can be directly turned off or controlled to 0dB.

[0190] In an embodiment of the present application, when the user is in a sleeping state and the user's sleeping comfort is low, the volume of the sound-emitting device is lowered or turned off to avoid disturbing the user due to excessive volume, which helps to improve the user's sleep quality and thus helps to improve the user's driving experience.

[0191] In one embodiment, the cockpit device includes a seat, and controlling the cockpit device to adjust from the first state to the second state based on the human body posture information includes: controlling the state of the seat massage function based on the human body posture information.

[0192] For example, when it is detected that the first mode is turned on, the seat massage function can be controlled to be in the on state; when the human posture information indicates that the user has entered a sleep state, the vehicle computer can autonomously control the seat massage function to switch from the on state to the off state.

[0193] For example, when it is detected that the first mode is turned on, the seat massage function can be controlled to be in the off state; when the human posture information indicates that the user has not entered the sleep state within the preset time, the vehicle computer can autonomously control the seat massage function to switch from the off state to the on state.

[0194] Exemplarily, when the body posture information indicates that the user has not fallen asleep within a preset time period, the seat massage function may be controlled to switch from an off state to an on state, including: when the body posture information indicates that the user has not fallen asleep within a preset time period and the frequency of changes in the user's torso posture within the preset time period is greater than a first preset frequency, the seat massage function may be controlled to switch from an off state to an on state. Exemplarily, the preset time period is 40% of the operating time of the first mode. For example, if the operating time of the first mode is 30 minutes, then the preset time period may be 12 minutes.

[0195] In one embodiment, the method 400 further includes: controlling the massage intensity of the seat massage function according to the human body posture information.

[0196] For example, when the human posture information indicates that the user has not entered a sleep state within a preset time period, the seat massage function can be controlled to switch from an off state to an on state and the massage intensity of the seat massage function can be controlled to be a first intensity; when the human posture information indicates that the user has entered a sleep state, the massage intensity of the seat massage function can be controlled to be reduced from the first intensity to the second intensity; when it is detected that the user has entered a deep sleep state, the massage intensity of the seat massage function can be reduced from the second intensity to the third intensity, or the seat massage function can be turned off.

[0197] In an embodiment of the present application, the state of the seat massage function can be automatically adjusted based on human posture information. For example, when the first mode is activated, the seat massage function is off. If the human posture information indicates that the user has been unable to fall asleep for a long time, the seat massage function can be automatically turned on to help the user relax and fall asleep as quickly as possible. If the human posture information indicates that the user is about to fall asleep, the seat massage function can be turned off, or the massage intensity can be reduced. This helps to prevent the seat massage from disturbing the user after falling asleep, thereby improving the user's sleep quality.

[0198] In one embodiment, the method 400 further includes prompting the user to activate the seat massage function. Thus, before controlling the state of the seat massage function, the user can be prompted to activate the seat massage function. This can avoid disturbing the user by automatically activating the seat massage function, thereby improving the user's driving experience.

[0199] For example, the seat massage function is disabled when the first mode is activated. If the body posture information indicates that the user has been unable to fall asleep for a long period of time, the user may be prompted to activate the seat massage function. For example, a voice message may be sent, such as "We detect that you are feeling unwell. Do you want to activate the seat massage function?" The seat massage function may be activated upon detecting user input indicating activation of the seat massage function (e.g., the user issues a voice command, "Activate the seat massage function").

[0200] In one embodiment, the prompting the user to activate the seat massage function includes: when there are multiple users in the cabin, controlling a sound-emitting device at the headrest of the seat where the user is seated to prompt the user to activate the seat massage function.

[0201] For example, in the case of a vehicle, users are present in both the driver's seat and the passenger seat of the vehicle cabin. If the user in the driver's seat selects to activate the first mode, the cabin equipment in the driver's seat can be controlled to operate in a first state, in which the seat massage function is disabled. If the user's posture information indicates that they have been unable to sleep for an extended period of time, the speaker in the driver's seat headrest can be controlled to emit a prompt tone, prompting the user in the driver's seat to activate the seat massage function. This prevents interference with the user in the passenger seat.

[0202] In one embodiment, before prompting the user to activate the seat massage function, the method 400 further includes: determining that the frequency of changes in the user's torso posture is greater than or equal to a preset frequency within a preset time period starting from the time the cockpit device is in the first state, wherein prompting the user to activate the seat massage function includes: prompting the user to activate the seat massage function at the end of the first mode. In this way, the frequency of changes in the user's torso posture within a preset time period starting from the time the cockpit device is in the first state can be counted. For example, if the frequency of changes in the user's torso posture within the preset time period is too large, it can be considered that the user is in an uncomfortable state. At the end of the first mode, the user can be proactively prompted to activate the seat massage function, thereby helping the user to relax and alleviate the user's discomfort.

[0203] In one embodiment, the human posture information includes the user's eye state. The cockpit equipment includes a display device, and when in the first state, the brightness of the display device is a first brightness. Controlling the cockpit equipment from the first state to the second state based on the human posture information includes: when the eye state indicates that the user has their eyes closed, controlling the brightness of the display device to adjust from the first brightness to a second brightness, or turning off the display device, the second brightness being less than the first brightness. In this way, when the user has their eyes closed, the brightness of the display device can be reduced or turned off. By reducing the brightness of the display device, the user's sleep is facilitated, thereby enhancing the user's driving experience.

[0204] In one embodiment, the method 400 further includes: before detecting that the first mode is turned on, controlling the brightness of the display device to a third brightness, wherein the third brightness is higher than the first brightness; when detecting that the first mode is turned on, controlling the brightness of the display device to be adjusted from the third brightness to the first brightness; when the human body posture information indicates that the user is in a sleeping state, controlling the brightness of the display device to be adjusted from the first brightness to the second brightness.

[0205] Exemplarily, when the eye state indicates that the user is with eyes closed, the vehicle computer actively controls the brightness of the display device to adjust from the first brightness to the second brightness, or turns off the display device, including: when the user's eyes change from an open state to a closed state, controlling the brightness of the display device to adjust from the first brightness to the second brightness, or turns off the display device.

[0206] In one embodiment, when the eye state indicates that the user is closing his eyes, controlling the brightness of the display device to adjust from the first brightness to the second brightness includes: controlling the brightness of the display device to adjust from the first brightness to the second brightness according to the brightness of the environment.

[0207] Exemplarily, when the eye state indicates that the user is with eyes closed, if the brightness of the environment is less than 50 lux, the brightness of the display device can be controlled to decrease from 200 nits to 0 nits; or, if the brightness of the environment is greater than or equal to 50 lux and less than 100 lux, the brightness of the display device can be controlled to decrease from 200 nits to 150 nits; or, if the brightness of the environment is greater than or equal to 100 lux, the brightness of the display device can be controlled to decrease from 200 nits to 180 nits.

[0208] In one embodiment, the human body posture information includes a first hand gesture of the user, and controlling the cockpit device to adjust from the first state to the second state based on the human body posture information includes: controlling the cockpit device to adjust from the first state to the second state based on the first hand gesture. In this way, the hand gesture may contain instruction information for adjusting the state of the cockpit device in the first mode, which helps to improve the user's driving experience and also helps to improve the intelligence level of the vehicle. For example, in the first mode, the user's seat angle is adjusted to a lying state. If the user needs to lower the volume of the sound-emitting device at this time, the user does not need to stand up and operate the display device to lower the volume. Instead, the user can directly lower the volume through a hand gesture in the lying state, thereby making the method of lowering the volume more humane.

[0209] In one embodiment, the vehicle stores a mapping relationship between gesture postures and state adjustments of cabin equipment.

[0210] For example, Table 2 shows a mapping relationship between gesture postures and state adjustments of cockpit equipment.

[0211] Table 2

[0212] The mapping relationship shown in Table 2 above is merely illustrative and is not specifically limited in this embodiment of the present application.

[0213] For example, when the first mode is on, the air conditioner temperature is 20°C in the first state. When the user waves upward from the bottom, the air conditioner temperature can be raised from 20°C to 21°C. When the user waves upward from the bottom again, the air conditioner temperature can be raised from 21°C to 22°C.

[0214] For example, when the first mode is on, the air conditioner's temperature is 20°C in the first state. When a user is detected waving their hand from the bottom to the top, the air conditioner's temperature can be increased based on the distance the hand moves from the bottom to the top. For example, if the distance the user's hand moves from the bottom to the top is less than a first preset distance, the air conditioner's temperature can be increased from 20°C to 21°C; or, if the distance the user's hand moves from the bottom to the top is greater than or equal to the first preset distance, the air conditioner's temperature can be increased from 20°C to 22°C.

[0215] For example, when the first mode is on, the air conditioner's temperature is 20°C in the first state. Upon detecting a user waving their hand from the bottom to the top, the air conditioner's temperature may be increased based on the speed of the hand movement. For example, if the speed of the user's hand movement from the bottom to the top is less than a first preset speed, the air conditioner's temperature may be increased from 20°C to 21°C; or, if the speed of the user's hand movement from the bottom to the top is greater than or equal to the first preset speed, the air conditioner's temperature may be increased from 20°C to 22°C.

[0216] In one embodiment, the cockpit includes a first area, the user is located in the first area, and the cockpit device is controlled to adjust from the first state to the second state according to the first gesture, including: according to the first gesture, controlling the device associated with the first area in the cockpit device to adjust from the first state to the second state. When there are multiple users in the cockpit in the first mode, the state of the device associated with the first area in the cockpit device can be adjusted through the gesture of the user in the first area. In this way, fine control of the different areas in the cockpit can be achieved. When a user in the first area wants to adjust the state of the device associated with the first area in the cockpit device, it will not cause trouble to users in other areas in the cockpit, which helps to improve the driving experience of multiple users in the cockpit and also helps to improve the intelligence level of the vehicle.

[0217] In one embodiment, the duration of the first mode is a first duration, and the method further includes: when the first duration ends, prompting the user to turn off the first mode through an alarm; controlling the alarm to turn off according to the user's second gesture, or controlling the alarm to delay the prompt.

[0218] When a user is awakened by an alarm, their emotions and consciousness are unclear. If the user is asked to turn off the alarm by operating the display device at this time, it will bring inconvenience to the user and be inhumane. In the embodiment of the present application, when the duration of the first mode ends, the alarm can be turned off by a second gesture, or the alarm can be controlled to delay the reminder by the second gesture. This avoids the user having to turn off the alarm or delay the reminder by clicking on the display device, making it convenient for the user to turn off the alarm or control the alarm delay reminder in time, and also making the method of turning off the alarm or controlling the alarm delay reminder more humane.

[0219] In one embodiment, the method 400 further includes: exiting the first mode when the alarm is turned off.

[0220] The above exiting the first mode may include: restoring the state of the cockpit equipment to the state before the first mode is turned on.

[0221] For example, before the first mode is activated, the seat angle in the cabin is 100°, the air conditioning is off, and the brightness of the display screen in the cabin is 200 nits. Before the user's second gesture is detected, the seat angle in the cabin is 170°, the air conditioning temperature is 26°C, and the brightness of the display screen is 100 nits. When the alarm is turned off using the second gesture, the seat angle in the cabin can be adjusted from 170° to 100°, the air conditioning can be turned off, and the brightness of the display screen can be adjusted from 100 nits to 200 nits.

[0222] In one embodiment, controlling the alarm to turn off includes: controlling the alarm to turn off when a hover gesture of the user is detected.

[0223] Exemplarily, the hovering gesture is a gesture in which the user's five fingers are spread out and the palm faces the display device.

[0224] In one embodiment, controlling the alarm to delay the prompt includes: controlling the alarm to delay the prompt when a left-side sliding gesture or a right-side sliding gesture of the user is detected.

[0225] In one embodiment, a user is seated in a first seat in a first area. Before detecting the activation of the first mode, the angle of the first seat is determined to be the first angle when the first mode is activated, based on the user's pre-set operation on the first seat angle or the state of the first seat before the last exit from the first mode. The method further includes: upon detecting the activation of the first mode, detecting whether a user is in a second seat; if a user is in the second seat and adjusting the angle of the first seat to the first angle would affect the user in the second seat, adjusting the first seat to a second angle, the second seat being located behind and adjacent to the first seat, the second angle being smaller than the first angle. In this way, when the first mode is activated, the presence of a user in the second seat behind the first seat can be detected. If a user is in the second seat and adjusting the angle of the first seat to the first angle would affect the user in the second seat, the angle of the first seat can be adjusted to the second angle. This avoids inconvenience caused to the user in the second seat by the state of the first seat after entering the first mode, helps improve the driving experience of multiple users in the cabin, and also helps improve the intelligence of the vehicle.

[0226] In this embodiment of the present application, human posture information can be used to automatically adjust the state of the cabin equipment in the first mode, eliminating the need for manual adjustment by the user. This helps enhance the user's driving experience and also helps improve the intelligence level of the vehicle. Furthermore, adjusting the cabin equipment based on human posture information can also improve the accuracy of the adjustment, ensuring that the cabin equipment is always in a comfortable state for the user.

[0227] FIG6 shows a schematic flow chart of a control method 600 provided in an embodiment of the present application. As shown in FIG6 , the method 600 can be executed by a vehicle (e.g., a vehicle), or the method 600 can be executed by the above-mentioned computing platform (e.g., a vehicle-mounted platform), or the method 600 can be executed by a system consisting of a computing platform and cockpit equipment, or the method 600 can be executed by a SoC in the above-mentioned computing platform, or the method 600 can be executed by a processor in the computing platform. The method 600 includes:

[0228] S601: When it is detected that the first mode is turned on, control the cockpit device to be in the first state.

[0229] The implementation process of the above S601 can refer to the above S410 and will not be repeated here.

[0230] S602, controlling the sensors in the cockpit to turn on.

[0231] Exemplarily, the sensors in the cockpit include cameras, millimeter-wave radars, etc.

[0232] For example, the data collected by the camera in the cabin can be used to determine that the user in the cabin is user A, and the cabin equipment is controlled to be in the first state, including: according to the mapping relationship between the user and the state of the cabin equipment shown in Table 1 above, controlling the brightness of the central control screen to 200 nits, the volume of the speaker to 60 decibels, the color of the light strip to blue, the temperature of the air conditioner to 23°C, the seat massage function to be turned on, and the seat angle to 160°.

[0233] S603 , performing human multi-target detection, human key point detection, and millimeter wave human detection based on data collected by sensors in the cockpit.

[0234] The above human multi-target detection and human key point detection process can refer to the implementation process shown in Figure 4. For example, the human multi-target detection result can be the above-mentioned human hand 2D result or torso 2D result, and the above-mentioned human key point detection result can be the above-mentioned human hand 3D key points or torso 3D key points.

[0235] The above millimeter-wave human body detection can be understood as determining the user's sleeping comfort through data collected by the millimeter-wave radar.

[0236] S604 : Determine the user's sleeping state and sleeping comfort according to the human multi-target detection results, the human key point detection results, and the millimeter wave human body detection results.

[0237] For example, the user's facial pose can be determined based on the torso 2D results and the torso's 3D key points. The user's eye state can be determined by analyzing the facial pose. If the eye state is open, it can be determined that the user is not asleep; alternatively, if the eye state is closed, it can be determined that the user is asleep.

[0238] For example, when the user's heart rate is determined to be within [70 beats / minute, 100 beats / minute] based on the data collected by the millimeter-wave radar, it can be determined that the user is in a light sleep state; or, when the user's heart rate is determined to be within [50 beats / minute, 70 beats / minute) based on the data collected by the millimeter-wave radar, it can be determined that the user is in a deep sleep state.

[0239] S605: Adjust the state of at least one of the air conditioner, seat, and sound device in the cabin according to the user's sleeping state and sleeping comfort.

[0240] For example, when it is determined that user A has entered a sleep state and is in a light sleep state, the volume of the speaker can be controlled to decrease from 60 decibels to 40 decibels, the seat massage function can be switched from on to off, and the temperature of the air conditioner can be increased from 23°C to 24°C.

[0241] For example, when it is determined that user A is in a deep sleep state, the volume of the speaker may be controlled to decrease from 40 decibels to 20 decibels, and the temperature of the air conditioner may be increased from 24° C. to 26° C.

[0242] S606: Determine the cabin ambient brightness.

[0243] Exemplarily, when the ambient brightness in the cabin is greater than or equal to the preset ambient brightness, S607 may be executed; otherwise, S608 may be executed.

[0244] For example, the preset ambient brightness is 100 lux.

[0245] S607 : When the ambient brightness in the cabin is greater than or equal to the preset ambient brightness, determine the user's eye state based on data collected by the RGB camera and / or the IR camera.

[0246] For example, the user's eye state may be determined primarily using data collected by the RGB camera and supplemented by data collected by the IR camera.

[0247] S608: When the ambient brightness in the cabin is less than a preset ambient brightness, determine the user's eye state based on data collected by the IR camera and / or the millimeter-wave radar.

[0248] For example, the user's eye state may be determined primarily based on data collected by an IR camera and supplemented by data collected by a millimeter-wave radar.

[0249] S609: Determine whether the user is in an eyes-open state.

[0250] Exemplarily, if the user is in an eye-open state, execute S610; otherwise, execute S611.

[0251] S610: When the user's eyes are open, the brightness of the display screen in the cockpit is maintained unchanged.

[0252] For example, when user A has his eyes open, the brightness of the display screen in the cabin can be maintained at 200 nits.

[0253] S611: When the user closes his eyes, reduce the brightness of the display screen in the cockpit.

[0254] In one embodiment, when the user closes their eyes, reducing the brightness of the display screen in the cabin includes reducing the brightness of the display screen when the user closes their eyes for a duration greater than or equal to a preset duration, for example, 10 seconds.

[0255] For example, when user A is in a closed-eye state, the brightness of the display screen may be controlled to decrease from 200 nits to 100 nits.

[0256] In one embodiment, reducing the brightness of the display screen in the cabin includes: reducing the brightness of the display screen in the cabin according to the user's sleeping comfort.

[0257] For example, when user A is in a light sleep state, the brightness of the display screen may be controlled to decrease from 200 nits to 100 nits.

[0258] For another example, when user A enters a deep sleep state from a light sleep state, the brightness of the display screen may be controlled to decrease from 100 nits to 50 nits, or the display screen may be turned off.

[0259] The above describes the process of adjusting the state of cabin equipment based on the user's sleep state and sleep comfort, using the control method shown in Figure 6. The following describes the process of adjusting the state of cabin equipment, delaying the alarm, or turning it off based on the user's gestures, using the control method shown in Figure 7.

[0260] FIG7 shows a schematic flow chart of a control method 700 provided in an embodiment of the present application. As shown in FIG7 , the method 700 can be executed by a vehicle (e.g., a vehicle), or the method 700 can be executed by the above-mentioned computing platform (e.g., a vehicle platform), or the method 700 can be executed by a system consisting of a computing platform and cockpit equipment, or the method 700 can be executed by a SoC in the above-mentioned computing platform, or the method 700 can be executed by a processor in the computing platform. The method 700 includes:

[0261] S701: When it is detected that the first mode is turned on, control the cockpit device to be in the first state.

[0262] S702, control the sensors in the cockpit to turn on.

[0263] The above S701-S702 can refer to the description of the above S601-S602, which will not be repeated here.

[0264] S703: Perform human multi-target detection and human key point detection based on the data collected by the sensors in the cabin.

[0265] The above process of performing human multi-target detection and human key point detection can refer to the description of S603 above, which will not be repeated here.

[0266] S704: Determine the user's gesture posture based on the human multi-target detection results and the human key point detection results.

[0267] The above process of determining the user's gesture posture can refer to the description in Figure 4 above, and will not be repeated here.

[0268] S705: Adjust the status of the cockpit equipment according to the user's gestures.

[0269] For example, as shown in Table 2 above, when it is detected that the user is waving his hand from the bottom to the top, the temperature of the air conditioner can be increased.

[0270] For example, when it is detected that the user makes an OK gesture, the seat massage function can be turned on.

[0271] S706: Determine whether the alarm is ringing.

[0272] Exemplarily, when the duration of the first mode reaches a preset duration, the alarm can be controlled to ring; otherwise, the alarm remains in an off state.

[0273] S707: When the alarm rings, determine whether the user has waved.

[0274] S708: When a waving action of the user is detected, the alarm is controlled to delay ringing.

[0275] For example, when it is detected that the user is waving from the left side to the right side or from the right side to the left side, the alarm can be controlled to delay ringing.

[0276] S709: When no waving action of the user is detected, the alarm continues to ring.

[0277] In one embodiment, when the alarm rings, it can also be determined whether the user has made a hovering gesture. When a hovering gesture is detected, the alarm can be turned off; otherwise, the alarm continues to ring.

[0278] Figure 8 shows a schematic block diagram of a control device 800 provided in an embodiment of the present application. As shown in Figure 8 , device 800 includes: a detection unit 810 for detecting the activation of a first mode, which is a mode associated with resting a user in a vehicle's cabin, wherein the cabin includes cabin equipment, including at least one of a seat, a fragrance, a sound-generating device, a lighting device, an air conditioner, and a display device; a control unit 820 for controlling the cabin equipment to be in a first state; and an acquisition unit 830 for acquiring human posture information. Control unit 820 is further configured to control the cabin equipment to adjust from the first state to a second state based on the human posture information.

[0279] Optionally, the acquisition unit 830 is also used to obtain sleep comfort, which is used to indicate the comfort level or sleep depth of the user when in a sleeping state; wherein the control unit 820 is used to: control the cabin equipment to adjust from the first state to the second state according to the human body posture information and the sleep comfort.

[0280] Optionally, the acquisition unit 830 is configured to: determine the sleep comfort level based on first data collected by a sensor in the cabin; or receive second data sent by a wearable device and determine the sleep comfort level based on the second data.

[0281] Optionally, the cabin equipment includes an air conditioner, and the temperature of the air conditioner is a first temperature when in the first state. The control unit 820 is used to: when the human body posture information indicates that the user is in a sleeping state, control the temperature of the air conditioner from the first temperature to the second temperature according to the sleeping comfort.

[0282] Optionally, the cockpit equipment includes a sound-emitting device, and when in the first state, the volume of the sound-emitting device is a first volume. The control unit 820 is used to: when the human body posture information indicates that the user is in a sleeping state, according to the sleeping comfort, control the volume of the sound-emitting device to be adjusted from the first volume to the second volume, or turn off the sound-emitting device, and the second volume is less than the first volume.

[0283] Optionally, the cockpit equipment includes a seat, and the control unit 820 is used to control the state of the seat massage function according to the human body posture information.

[0284] Optionally, the device 800 further includes: a first prompting unit, configured to prompt the user to start the seat massage function.

[0285] Optionally, the human body posture information includes the user's eye state, the cockpit equipment includes a display device and the brightness of the display device is a first brightness when in the first state, and the control unit 820 is used to: when the eye state indicates that the user is closing his eyes, control the brightness of the display device to adjust from the first brightness to a second brightness, or turn off the display device, and the second brightness is less than the first brightness.

[0286] Optionally, the human body posture information includes a first hand gesture of the user, and the control unit 820 is configured to control the cockpit device to adjust from the first state to the second state according to the first hand gesture.

[0287] Optionally, the cockpit includes a first area, the user is located in the first area, and the control unit 820 is used to control the device associated with the first area in the cockpit device to adjust from the first state to the second state according to the first gesture posture.

[0288] Optionally, the duration of the first mode is the first duration, and the device 800 also includes: a second prompt unit, used to prompt the user to turn off the first mode through an alarm when the first duration ends; wherein the control unit 820 is also used to control the alarm to turn off according to the user's second gesture, or to control the alarm to delay the prompt.

[0289] Optionally, the second state is adapted to the human body posture information.

[0290] Optionally, the first mode is a nap mode, a sleep mode, a rest mode or a camping mode.

[0291] For example, detection unit 810 may be the computing platform shown in Figure 1 or a processing circuit, processor, or controller within the computing platform. For example, if detection unit 810 is processor 151 within the computing platform, processor 151 may obtain data collected by the in-cabin camera and touch sensor. Based on the data collected by the in-cabin camera and touch sensor, processor 151 may determine that the user in the driver's seat has activated the first mode.

[0292] For another example, control unit 820 may be the computing platform in FIG1 or a processing circuit, processor, or controller in the computing platform. For example, if control unit 820 is processor 152 in the computing platform, processor 152 may control the cabin equipment in the cabin to be in the first state when processor 151 determines that the user in the main driving area has activated the first mode.

[0293] For another example, acquisition unit 830 may be the computing platform in Figure 1 or a processing circuit, processor, or controller within the computing platform. For example, if acquisition unit 830 is processor 153 within the computing platform, processor 153 may determine the human body posture information of the user in the primary driver's seat based on data collected by sensors within the cabin when processor 152 controls the cabin equipment to be in the first state.

[0294] The processor 152 may also adjust the state of the cockpit equipment from the first state to the second state according to the body posture information of the user in the main driving area determined by the processor 153 .

[0295] The functions implemented by the above detection unit 810, the functions implemented by the control unit 820, and the functions implemented by the acquisition unit 830 can be implemented by different processors, or some functions can be implemented by the same processor, or all functions can be implemented by the same processor. The embodiments of the present application do not limit this.

[0296] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0297] In an embodiment of the present application, a processor is a circuit with the ability to process signals. In one implementation, the processor may be a circuit with the ability to read and execute instructions, such as a CPU, a microprocessor, a GPU, or a DSP. In another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit may be fixed or reconfigurable, such as a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the configuration of the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, DPU, etc.

[0298] It can be seen that each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0299] In addition, the various units in the above apparatus may be fully or partially integrated together, or may be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the apparatus. The at least one processor may be of different types, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0300] An embodiment of the present application also provides a control device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to execute the control method executed by the above embodiment.

[0301] Alternatively, if the device is located in a vehicle, the processing unit may be the processors 151 - 15n shown in FIG. 1 .

[0302] An embodiment of the present application further provides a control system, which may include a computing platform and cockpit equipment, and the computing platform may include the above-mentioned control device 800.

[0303] Exemplarily, the cockpit equipment may include a display device, which may include an on-board display screen, such as one or more of display screen 301, display screen 302, display screen 303 or display screen 304 in FIG. 3 .

[0304] Optionally, the control system further includes one or more sensors.

[0305] An embodiment of the present application also provides a vehicle, which may include the above-mentioned control device 800 or control system.

[0306] Optionally, the vehicle may be a vehicle.

[0307] An embodiment of the present application further provides a computer program product, which includes: computer program code, which, when executed on a computer, enables the computer to execute the control method in the above embodiment.

[0308] An embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code is run on a computer, the computer executes the control method in the above embodiment.

[0309] An embodiment of the present application further provides a chip, which includes a circuit, and the circuit is used to execute the control method in the above embodiment.

[0310] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0311] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0312] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0313] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0314] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0315] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0316] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0317] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0318] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0319] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be covered and fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A control method, It is characterized in that The method is applied to a cockpit of a vehicle, wherein the cockpit includes cockpit equipment, and the cockpit equipment includes at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner, and a display device. When it is detected that the first mode is turned on, the cockpit device is controlled to be in a first state, where the first mode is a mode related to rest of the user in the cockpit; Obtain human body posture information; According to the human body posture information, the cockpit equipment is controlled to adjust from the first state to a second state.

2. The method according to claim 1, It is characterized in that The method further comprises: Acquire sleeping comfort, where the sleeping comfort is used to indicate the comfort level or sleeping depth of the user when the user is in a sleeping state; Wherein, controlling the cockpit equipment to adjust from the first state to the second state according to the human body posture information includes: According to the human body posture information and the sleeping comfort, the cockpit equipment is controlled to adjust from the first state to the second state.

3. The method according to claim 2, It is characterized in that The step of obtaining the sleeping comfort level comprises: determining the sleeping comfort level according to first data collected by a sensor in the cabin; or, Receive second data sent by the wearable device and determine the sleeping comfort level according to the second data.

4. The method according to claim 2 or 3, It is characterized in that The cockpit device includes an air conditioner, and when in the first state, the temperature of the air conditioner is a first temperature. According to the human body posture information and the sleeping comfort, controlling the cockpit device to adjust from the first state to the second state includes: When the human body posture information indicates that the user is in a sleeping state, the temperature of the air conditioner is controlled to be adjusted from the first temperature to the second temperature according to the sleeping comfort.

5. The method according to claim 2 or 3, It is characterized in that The cockpit equipment includes a sound-generating device, and the volume of the sound-generating device is a first volume when in the first state. According to the human body posture information and the sleeping comfort, controlling the cockpit equipment to adjust from the first state to the second state includes: When the human body posture information indicates that the user is in a sleeping state, the volume of the sound-generating device is controlled to be adjusted from the first volume to a second volume according to the sleeping comfort, or the sound-generating device is turned off, and the second volume is smaller than the first volume.

6. The method according to any one of claims 1 to 5, It is characterized in that The cockpit device includes a seat, and controlling the cockpit device to adjust from the first state to the second state according to the human body posture information includes: The state of the seat massage function is controlled according to the human body posture information.

7. The method according to claim 6, It is characterized in that The method further comprises: The user is prompted to start the seat massage function.

8. The method according to any one of claims 1 to 7, It is characterized in that The human body posture information includes an eye state of a user, the cockpit equipment includes a display device, and when in the first state, the brightness of the display device is a first brightness, and controlling the cockpit equipment to adjust from the first state to the second state according to the human body posture information includes: When the eye status indicates that the user has closed eyes, the brightness of the display device is controlled to be adjusted from the first brightness to a second brightness, or the display device is turned off, and the second brightness is less than the first brightness.

9. The method according to any one of claims 1 to 8, It is characterized in that The human body posture information includes a first hand gesture of a user, and controlling the cockpit device to adjust from the first state to the second state according to the human body posture information includes: According to the first gesture posture, the cockpit equipment is controlled to adjust from the first state to the second state.

10. The method according to claim 9, It is characterized in that The cockpit includes a first area, the user is located in the first area, and according to the first gesture posture, controlling the cockpit device to adjust from the first state to the second state includes: According to the first gesture, a device in the cockpit device associated with the first area is controlled to adjust from the first state to the second state.

11. The method according to any one of claims 1 to 10, It is characterized in that The duration of the first mode is a first duration, and the method further includes: When the first time period ends, an alarm is used to remind the user to turn off the first mode; According to the user's second gesture, the alarm is controlled to be turned off, or the alarm is controlled to delay the reminder.

12. The method according to any one of claims 1 to 11, It is characterized in that The second state is adapted to the human body posture information.

13. The method according to any one of claims 1 to 12, It is characterized in that The first mode is a nap mode, a sleep mode, a rest mode or a camping mode.

14. A control device, It is characterized in that include: a detection unit, configured to detect that a first mode is turned on, wherein the first mode is a mode related to rest of a user in a cabin of a vehicle, wherein the cabin includes cabin equipment, and the cabin equipment includes at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner, and a display device; A control unit, used for controlling the cockpit equipment to be in a first state; An acquisition unit, used for acquiring human body posture information; The control unit is further used to control the cockpit equipment to adjust from the first state to the second state according to the human body posture information.

15. The device according to claim 14, It is characterized in that The acquisition unit is further used to acquire the sleep comfort level, where the sleep comfort level is used to indicate the comfort level or sleep depth of the user when the user is in a sleeping state; Wherein, the control unit is used to control the cockpit equipment to adjust from the first state to the second state according to the human body posture information and the sleeping comfort.

16. The device according to claim 15, It is characterized in that The acquisition unit is used to: determining the sleeping comfort level according to first data collected by a sensor in the cabin; or, Receive second data sent by the wearable device and determine the sleeping comfort level according to the second data.

17. The device according to claim 15 or 16, It is characterized in that The cabin equipment includes an air conditioner, and the temperature of the air conditioner is a first temperature when in the first state, and the control unit is used to: When the human body posture information indicates that the user is in a sleeping state, the air conditioner is controlled according to the sleeping comfort. The temperature is adjusted from the first temperature to the second temperature.

18. The device according to claim 15 or 16, It is characterized in that The cockpit equipment includes a sound-generating device, and the volume of the sound-generating device is a first volume when in the first state. The control unit is used to: When the human body posture information indicates that the user is in a sleeping state, the volume of the sound-generating device is controlled to be adjusted from the first volume to a second volume according to the sleeping comfort, or the sound-generating device is turned off, and the second volume is smaller than the first volume.

19. The device according to any one of claims 14 to 18, It is characterized in that The cockpit equipment includes a seat, and the control unit is used to: The state of the seat massage function is controlled according to the human body posture information.

20. The device according to claim 19, It is characterized in that The device also includes: The first prompting unit is used to prompt the user to start the seat massage function.

21. The device according to any one of claims 14 to 20, It is characterized in that The human body posture information includes the user's eye state, the cockpit equipment includes a display device, and the brightness of the display device is a first brightness when in the first state, and the control unit is used to: When the eye status indicates that the user has closed eyes, the brightness of the display device is controlled to be adjusted from the first brightness to a second brightness, or the display device is turned off, and the second brightness is less than the first brightness.

22. The device according to any one of claims 14 to 21, It is characterized in that The human body posture information includes a first hand gesture of a user, and the control unit is used to: According to the first gesture posture, the cockpit equipment is controlled to adjust from the first state to the second state.

23. The device according to claim 22, It is characterized in that The cockpit includes a first area, the user is located in the first area, and the control unit is used to: According to the first gesture, a device in the cockpit device associated with the first area is controlled to adjust from the first state to the second state.

24. The device as claimed in any one of claims 14 to 23, It is characterized in that The duration of the first mode is a first duration, and the device further includes: A second prompting unit, configured to prompt the user to turn off the first mode through an alarm when the first duration ends; Wherein, the control unit is further used to control the alarm to turn off, or control the alarm to delay the reminder, according to the user's second gesture.

25. The device according to any one of claims 14 to 24, It is characterized in that The second state is adapted to the human body posture information.

26. The device according to any one of claims 14 to 25, It is characterized in that The first mode is a nap mode, a sleep mode, a rest mode or a camping mode.

27. A control device, It is characterized in that include: Memory for storing computer programs; A processor, configured to execute a computer program stored in the memory so that the device performs the control method according to any one of claims 1 to 13.

28. A control system, It is characterized in that It comprises cockpit equipment and a computing platform, wherein the computing platform comprises a device as described in any one of claims 14 to 27, and the cockpit equipment comprises at least one of a seat, a fragrance, a sound device, a lighting device, an air conditioner and a display device.

29. A vehicle, It is characterized in that Comprising a control device according to any one of claims 14 to 27, or comprising a control system according to claim 28.

30. The vehicle according to claim 29, It is characterized in that The vehicle is a vehicle.

31. A computer-readable storage medium, It is characterized in that A computer program is stored thereon, and when the computer program is executed by a computer, the control method according to any one of claims 1 to 13 is implemented.

32. A chip, It is characterized in that The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the control method according to any one of claims 1 to 13.

Images