Vehicle environment adjustment method and device based on picking action, equipment and medium

Abstract

The present application relates to the field of vehicle control, and discloses a vehicle environment adjusting method and device based on picking action, equipment and storage medium, which are used for improving the convenience and safety of picking up articles in the vehicle. The vehicle environment adjusting method based on picking action comprises the following steps: collecting the body data of a target person in real time, establishing or updating a target model according to the body data of the target person, and the target person is on a target vehicle; matching the target model with a preset model library, the preset model library comprising a picking posture model and a standard posture model; when the target model is successfully matched with the picking posture model, adjusting the environmental parameters of the target vehicle, the environmental parameters of the target vehicle comprising the position of a seat and the switch states of a lighting lamp, an electronic handbrake system, a broadcast system and an automatic driving system; continuing to monitor the target model, and when the target model is successfully matched with the standard posture model, restoring the environmental parameters of the target vehicle.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to a method, apparatus, device, and storage medium for adjusting the vehicle environment based on pickup actions. Background Technology

[0002] When users pick up items that have fallen inside the car, they need to manually adjust the seat position to make room for searching. If the lighting inside the car is poor, they also need to manually turn on the interior lights. Usually, multiple adjustments are needed to achieve the best picking environment, which is not very convenient.

[0003] Furthermore, if the vehicle is in motion or starting up when the item is picked up, the user may obstruct the rearview mirror, accidentally touch the steering wheel or accelerator while searching in a confined space, leading to an accident and posing a safety hazard. Summary of the Invention

[0004] The main objective of this invention is to provide a vehicle environment adjustment method, device, equipment, and storage medium based on picking actions, thereby improving the convenience and safety of personnel picking up items inside the vehicle.

[0005] The first aspect of this invention provides a vehicle environment adjustment method based on pickup actions, comprising: real-time acquisition of body shape data of a target person; establishing or updating a target model based on the body shape data of the target person, wherein the target person is riding in a target vehicle; matching the target model with a preset model library, the preset model library including pickup posture models and standard posture models; when the target model successfully matches the pickup posture model, adjusting the environmental parameters of the target vehicle, the environmental parameters of the target vehicle including the position of the seat and the on / off status of the lighting, electronic parking brake system, broadcast system and autonomous driving system; continuing to monitor the target model, and when the target model successfully matches the standard posture model, restoring the environmental parameters of the target vehicle to their original settings.

[0006] Optionally, in a first implementation of the first aspect of the present invention, when the target model successfully matches the picking posture model, the environmental parameters of the target vehicle are adjusted. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lighting, electronic parking brake system, broadcasting system, and autonomous driving system. This includes: when the target model successfully matches the picking posture model, determining whether the target vehicle is in a driving state or a stationary state; if the target vehicle is stationary and the current gear is forward, then activating the electronic parking brake system; if the target vehicle is in a driving state, then collecting the position information of the target person, determining whether the target person is the driver based on the position information of the target person, and if so, activating the broadcasting system or the autonomous driving system, wherein the broadcasting system is used to issue a voice alarm; reading the body data and position information of the target person, and adjusting the seat and lighting based on the body data and position information of the target person.

[0007] Optionally, in a second implementation of the first aspect of the present invention, if the target vehicle is in motion, the location information of the target person is collected, and the location information of the target person is used to determine whether the target person is the driver. If so, the broadcasting system or the autonomous driving system is activated. The broadcasting system is used to issue a voice alarm, including: if the target vehicle is in motion, collecting the location information of the target person; determining whether the location information of the target person indicates the driver's seat position; if so, determining that the target person is the driver, activating the broadcasting system to issue a voice alarm and starting a timer; monitoring the value of the timer; when the value of the timer is greater than a threshold, detecting whether the target model and the picking posture model still match successfully; if so, activating the autonomous driving system.

[0008] Optionally, in a third implementation of the first aspect of the present invention, the step of reading the body shape data and position information of the target person, and adjusting the seat and lighting according to the body shape data and position information of the target person includes: reading the body shape data of the target person, obtaining the body parameters of the target person based on the body shape data, and adjusting the height and fore-and-aft offset distance of the seat according to the body parameters of the target person; reading the position information of the target person, and turning on the lighting at the corresponding position according to the position information of the target person.

[0009] Optionally, in the fourth implementation of the first aspect of the present invention, the step of continuing to monitor the target model and restoring the environmental parameters of the target vehicle when the target model successfully matches the standard posture model includes: continuing to monitor the target model; when the target model successfully matches the standard posture model, determining whether the target person is a driver and the target vehicle has activated the autonomous driving system; if so, issuing a voice broadcast to remind the driver that the autonomous driving system will be deactivated; reading the default parameters of the target vehicle, which are the environmental parameters of the target vehicle before the last successful matching of the target model and the picking posture model; determining whether the current environmental parameters of the target vehicle are the default parameters of the target vehicle; if not, restoring the current environmental parameters of the target vehicle to the default parameters of the target vehicle.

[0010] Optionally, in a fifth implementation of the first aspect of the present invention, after matching the target model with a preset model library, and before adjusting the environment of the target vehicle when the target model is successfully matched with the picking posture model, the method further includes: collecting the position information of the seats in the target vehicle and the on / off status of the lighting, electronic parking brake system, broadcasting system and autonomous driving system to obtain the default parameters of the target vehicle, wherein the position information of the seats includes the seat height and the seat front-to-back offset distance.

[0011] Optionally, in a sixth implementation of the first aspect of the present invention, the real-time acquisition of the body shape data of the target person, and the establishment or updating of a target model based on the body shape data of the target person, wherein the target person is riding in a target vehicle, includes: receiving a start command from the target vehicle, the start command triggering the acquisition system; acquiring the body shape data of the target person in real time through the acquisition system, and establishing a target model based on the body shape data of the target person; monitoring the change range of the body shape data, and updating the target model when the change range of the body shape data exceeds the deviation range of the target model.

[0012] A second aspect of the present invention provides a vehicle environment adjustment device based on a pickup action, comprising: a first acquisition module, configured to acquire body data of a target person in real time, and establish or update a target model based on the body data of the target person, wherein the target person is riding in a target vehicle; a matching module, configured to match the target model with a preset model library, the preset model library including a pickup posture model and a standard posture model; an adjustment module, configured to adjust the environmental parameters of the target vehicle when the target model is successfully matched with the pickup posture model, the environmental parameters of the target vehicle including the position of the seat and the on / off status of the lighting, electronic parking brake system, broadcast system and autonomous driving system; and a monitoring module, configured to continue monitoring the target model, and restore the environmental parameters of the target vehicle to their original settings when the target model is successfully matched with the standard posture model.

[0013] Optionally, in a first implementation of the second aspect of the present invention, the adjustment module includes: a first judgment unit, configured to determine whether the target vehicle is in a driving state or a stationary state when the target model and the picking posture model are successfully matched; if the target vehicle is stationary and the current gear is forward, then activate the electronic handbrake system; a second judgment unit, configured to collect the position information of the target person if the target vehicle is in a driving state, and determine whether the target person is a driver based on the position information of the target person; if so, then activate the broadcast system or the automatic driving system, wherein the broadcast system is used to issue a voice alarm; and an adjustment unit, configured to read the body data and position information of the target person, and adjust the seat and lighting based on the body data and position information of the target person.

[0014] Optionally, in a second implementation of the second aspect of the present invention, the second determining unit is specifically used for: if the target vehicle is in a driving state, collecting the location information of the target person; determining whether the location information of the target person indicates the driver's seat position; if so, determining that the target person is the driver, activating the broadcast system to issue a voice alarm and starting a timer; monitoring the value of the timer; when the value of the timer is greater than a threshold, detecting whether the target model and the picking posture model are still successfully matched; if so, activating the autonomous driving system.

[0015] Optionally, in a third implementation of the second aspect of the present invention, the adjustment unit is specifically used to: read the body shape data of the target person, obtain the body parameters of the target person based on the body shape data, adjust the height and fore-and-aft offset distance of the seat based on the body parameters of the target person; read the position information of the target person, and turn on the lighting at the corresponding position based on the position information of the target person.

[0016] Optionally, in the fourth implementation of the second aspect of the present invention, the monitoring module is specifically used for: continuing to monitor the target model; when the target model successfully matches the standard posture model, determining whether the target person is a driver and the target vehicle has activated the autonomous driving system; if so, issuing a voice broadcast to remind the driver that the autonomous driving system will be deactivated; reading the default parameters of the target vehicle, the default parameters of the target vehicle being the environmental parameters of the target vehicle before the most recent successful matching of the target model and the picking posture model; determining whether the current environmental parameters of the target vehicle are the default parameters of the target vehicle; if not, restoring the current environmental parameters of the target vehicle to the default parameters of the target vehicle.

[0017] Optionally, in a fifth implementation of the second aspect of the present invention, after the matching module and before the adjustment module, a second acquisition module is further included, which is used to acquire the position information of the seats in the target vehicle and the on / off status of the lighting, electronic parking brake system, broadcasting system and autonomous driving system to obtain the default parameters of the target vehicle. The position information of the seats includes the seat height and the seat front-to-back offset distance.

[0018] Optionally, in a sixth implementation of the second aspect of the present invention, the first acquisition module is specifically used for: receiving a start command from the target vehicle, the start command triggering the acquisition system; acquiring body data of the target person in real time through the acquisition system, establishing a target model based on the body data of the target person; monitoring the change range of the body data, and updating the target model when the change range of the body data exceeds the deviation range of the target model.

[0019] A third aspect of the present invention provides a vehicle environment adjustment device based on a pickup action, comprising: a memory and at least one processor, wherein the memory stores instructions; the at least one processor invokes the instructions in the memory to cause the vehicle environment adjustment device based on the pickup action to perform the above-described vehicle environment adjustment method based on the pickup action.

[0020] A fourth aspect of the present invention provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the above-described vehicle environment adjustment method based on picking actions.

[0021] In the technical solution provided by this invention, the body shape data of a target person is collected in real time, and a target model is established or updated based on the body shape data. The target person is riding in a target vehicle. The target model is matched with a pre-set model library, which includes a picking posture model and a standard posture model. When the target model successfully matches the picking posture model, the environmental parameters of the target vehicle are adjusted. The environmental parameters of the target vehicle include the position of the seats and the on / off status of the lighting, electronic parking brake system, broadcast system, and autonomous driving system. The target model is continuously monitored, and when the target model successfully matches the standard posture model, the environmental parameters of the target vehicle are restored. In this embodiment of the invention, by recognizing the posture of the person inside the vehicle to determine whether there is a picking action, and adjusting the in-vehicle environmental parameters when the person is picking up items, a convenient and safe picking environment can be provided, improving the convenience and safety of people picking up items inside the vehicle. Attached Figure Description

[0022] Figure 1 This is a schematic diagram of an embodiment of the vehicle environment adjustment method based on picking action in the present invention;

[0023] Figure 2 This is a schematic diagram of another embodiment of the vehicle environment adjustment method based on picking action in the present invention;

[0024] Figure 3 This is a schematic diagram of one embodiment of the vehicle environment adjustment device based on picking action in the present invention;

[0025] Figure 4 This is a schematic diagram of another embodiment of the vehicle environment adjustment device based on picking action in this invention;

[0026] Figure 5 This is a schematic diagram of one embodiment of the vehicle environment adjustment device based on picking action in the present invention. Detailed Implementation

[0027] This invention provides a vehicle environment adjustment method, device, equipment, and storage medium based on picking actions. By recognizing the posture of people inside the vehicle to determine whether there is a picking action, the vehicle environment parameters are adjusted when people are picking actions, so as to provide a convenient and safe picking environment and improve the convenience and safety of people picking up items inside the vehicle.

[0028] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” or “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0029] For ease of understanding, the specific process of the embodiments of the present invention is described below. It should be understood that the execution subject of the present invention can be a vehicle environment adjustment device based on picking actions, or an in-vehicle terminal; no specific limitation is made here. The embodiments of the present invention are illustrated using an in-vehicle terminal as the execution subject.

[0030] Please see Figure 1 One embodiment of the vehicle environment adjustment method based on picking action in this invention includes:

[0031] 101. Collect the body shape data of the target personnel in real time, and build or update the target model based on the body shape data of the target personnel, with the target personnel riding in the target vehicle;

[0032] The vehicle-mounted terminal receives a start command from the target vehicle, which triggers a data acquisition system. This system collects real-time body shape data of the target person. The system includes at least one of a camera, LiDAR, or infrared sensor. A target model is then built based on the body shape data. This document provides a method for obtaining body shape data of the target person using a camera and generating a target model:

[0033] 1. The vehicle-mounted terminal acquires images of the target personnel captured by the camera from different angles;

[0034] 2. Preprocess the acquired images of the target personnel to remove background data from the image data. Background data refers to the data in the image other than the target personnel.

[0035] 3. Register the pre-processed images of the target person from different angles to obtain a complete body data, which includes the head, shoulders, arms, waist, hips, knees and feet of the target person.

[0036] 4. Extract information about human joints from the shape data, and generate a virtual body, i.e., the target model, based on the information about human joints.

[0037] After generating the target model, the vehicle-mounted terminal monitors changes in the body shape data of the target person and updates the target model accordingly. Preferably, to reduce the amount of data computation, the target model is only updated when the change in body shape data exceeds a set deviation range.

[0038] Furthermore, when there are multiple occupants in the target vehicle, the on-board terminal acquires images of all occupants through the acquisition system. The acquired images are then categorized, with each occupant corresponding to a category. Each category contains all images involving the corresponding occupant. When an image captures at least two occupants, the image is copied and stored in at least two categories corresponding to the at least two occupants. The images in each category are preprocessed to remove data other than the occupant corresponding to that category. The body data of each occupant is obtained through registration. The human joint information of each occupant is extracted from the body data of each occupant. Multiple models corresponding to multiple occupants are built based on the human joint information of each occupant. After the models are built, the changes in the body data of multiple occupants are monitored.

[0039] For example, when a car is started with a driver and a passenger in the vehicle, the onboard terminal receives the start command and triggers the acquisition system to capture images of the driver and passenger from different angles. Images containing the driver are categorized as driver images, and images containing the passenger are categorized as passenger images. When an image contains both a driver and a passenger, it is copied and stored in both the driver and passenger categories. The onboard terminal preprocesses and registers the images in the driver category to obtain the driver's body data, extracts the driver's keypoint information from the body data, and generates a driver model. Similarly, the onboard terminal preprocesses and registers the images in the passenger category to obtain the passenger's body data, extracts the passenger's keypoint information from the body data, and generates a passenger model. The onboard terminal monitors changes in the driver's and passenger's body data, and updates the driver or passenger model when the change exceeds a set deviation range.

[0040] 102. Match the target model with the pre-set model library, which includes the picking pose model and the standard pose model;

[0041] A pre-built model library is established, including pickup posture models and standard posture models. Pickup posture models are those with bent-over and stooped postures, while standard posture models are those with an upright sitting posture. Each model contains the same joint information as the target model. The vehicle-mounted terminal matches the target model against the pre-built model library. The matching method involves acquiring the joint information of each model and calculating the key relative distance and key angle that indicate pickup and sitting behaviors based on the joint information. When the key relative distance is within the coverage area of ​​the pickup posture model, the target model matches the pickup posture model successfully; when the key angle is within the coverage area of ​​the standard posture model, the target model matches the standard posture model successfully.

[0042] For example, the vehicle terminal acquires information about joints such as shoulders, waist, hips, and knees from the target model, the picking posture model, and the standard posture model. It calculates the relative distance between the shoulder joints and the knee joints and determines the minimum relative distance as the critical relative distance. It also calculates the angle between the straight lines containing the shoulder and waist joints and the straight lines containing the hip and knee joints and determines this angle as the critical angle. When the critical relative distance of the target model is less than the critical relative distance of the picking posture model, the target model and the picking posture model are successfully matched. When the critical angle of the target model is greater than the critical angle of the standard posture model, the target model and the standard posture model are successfully matched.

[0043] 103. When the target model and the picking posture model are successfully matched, the environmental parameters of the target vehicle are adjusted. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lights, electronic parking brake system, broadcast system and autonomous driving system.

[0044] When the target model is successfully matched with the picking posture model, the vehicle terminal determines the position of the target person in the target vehicle, turns on the lights at that position, and adjusts the seat at that position downwards and backwards. If the seat at that position cannot be adjusted, the seat in front of that seat that can be adjusted is adjusted forwards.

[0045] Furthermore, to ensure the safety of people inside the vehicle when picking up items, when the target person is the driver, the on-board terminal determines whether the vehicle is in motion. If it is not in motion and the current gear is forward, the electronic parking brake system is activated. If it is in motion, the broadcast system is activated to remind the driver that the car is being driven and to pay attention to driving safety. If the driver ignores the warning from the broadcast system and continues to pick up items, the on-board terminal activates the automatic driving system.

[0046] 104. Continue monitoring the target model. When the target model successfully matches the standard attitude model, restore the environmental parameters of the target vehicle.

[0047] The vehicle terminal continues to monitor the target model. When the target model successfully matches the standard attitude model, the environmental parameters of the target vehicle are restored to the environmental parameters before the adjustment in step 103.

[0048] In this embodiment of the invention, a target model is established by collecting the body data of passengers in the vehicle. The target model is then matched with models in the model library. When the matching result indicates that the passenger is in a picking posture, the environmental parameters of the vehicle are automatically adjusted to provide a convenient and safe picking environment, thereby improving the convenience and safety of people picking up items in the vehicle.

[0049] Please see Figure 2 Another embodiment of the vehicle environment adjustment method based on picking action in this invention includes:

[0050] 201. Collect the body shape data of the target personnel in real time, and build or update the target model based on the body shape data of the target personnel, with the target personnel riding in the target vehicle;

[0051] The vehicle-mounted terminal receives a start command from the target vehicle, which triggers a data acquisition system. This system collects real-time body shape data of the target person. The system includes at least one of a camera, LiDAR, or infrared sensor. A target model is then built based on the body shape data. This document provides a method for obtaining body shape data of the target person using a camera and generating a target model:

[0052] 1. The vehicle-mounted terminal acquires images of the target personnel captured by the camera from different angles;

[0053] 2. Preprocess the acquired images of the target personnel to remove background data from the image data. Background data refers to the data in the image other than the target personnel.

[0054] 3. Register the pre-processed images of the target person from different angles to obtain a complete body data, which includes the head, shoulders, arms, waist, hips, knees and feet of the target person.

[0055] 4. Extract information about human joints from the shape data, and generate a virtual body, i.e., the target model, based on the information about human joints.

[0056] After generating the target model, the vehicle-mounted terminal monitors changes in the target person's body shape data and updates the target model accordingly. To reduce computational load, the target model is only updated when the change in body shape data exceeds a set deviation range.

[0057] Furthermore, when there are multiple occupants in the target vehicle, the on-board terminal acquires images of all occupants through the acquisition system, categorizes the acquired images, assigning one category to each occupant, and containing all images related to that occupant in each category. When an image captures at least two occupants, the image is copied and stored in at least two categories corresponding to the at least two occupants. The images in each category are preprocessed to remove data other than the occupant corresponding to that category. Body data is obtained through registration, and information on human joint points is extracted from the body data. Multiple models corresponding to multiple occupants are built based on the information on human joint points. After the models are built, the changes in the body data of multiple occupants are monitored.

[0058] For example, when a car is started with a driver and a passenger in the vehicle, the onboard terminal receives the start command and triggers the acquisition system to capture images of the driver and passenger from different angles. Images containing the driver are categorized as driver images, and images containing the passenger are categorized as passenger images. When an image contains both a driver and a passenger, it is copied and stored in both the driver and passenger categories. The onboard terminal preprocesses and registers the images in the driver category to obtain the driver's body data, extracts the driver's keypoint information from the body data, and generates a driver model. Similarly, the onboard terminal preprocesses and registers the images in the passenger category to obtain the passenger's body data, extracts the passenger's keypoint information from the body data, and generates a passenger model. The onboard terminal monitors changes in the driver's and passenger's body data, and updates the driver or passenger model when the change exceeds a set deviation range.

[0059] 202. Match the target model with the pre-set model library, which includes the picking pose model and the standard pose model;

[0060] A pre-built model library is established, including pickup posture models and standard posture models. Pickup posture models are those with bent-over and stooped postures, while standard posture models are those with an upright sitting posture. Each model contains the same joint information as the target model. The vehicle-mounted terminal matches the target model against the pre-built model library. The matching method involves acquiring the joint information of each model and calculating the key relative distance and key angle that indicate pickup and sitting behaviors based on the joint information. When the key relative distance is within the coverage area of ​​the pickup posture model, the target model matches the pickup posture model successfully; when the key angle is within the coverage area of ​​the standard posture model, the target model matches the standard posture model successfully.

[0061] For example, the vehicle terminal acquires information about joints such as shoulders, waist, hips, and knees from the target model, the picking posture model, and the standard posture model. It calculates the relative distance between the shoulder joints and the knee joints and determines the minimum relative distance as the critical relative distance. It also calculates the angle between the straight lines containing the shoulder and waist joints and the straight lines containing the hip and knee joints and determines this angle as the critical angle. When the critical relative distance of the target model is less than the critical relative distance of the picking posture model, the target model and the picking posture model are successfully matched. When the critical angle of the target model is greater than the critical angle of the standard posture model, the target model and the standard posture model are successfully matched.

[0062] 203. Collect the position information of the seats in the target vehicle and the on / off status of the lights, electronic parking brake system, broadcast system and automatic driving system to obtain the default parameters of the target vehicle. The seat position information includes seat height and seat fore-aft offset distance.

[0063] After the target model begins matching with the pre-set model library, the vehicle terminal collects the position and on / off status of all lights in the target vehicle, the on / off status of the electronic parking brake system, the broadcast system and the autonomous driving system, the seat height, obtains the factory position of the seat on the slide rail, calculates the front and rear offset distance of the seat on the slide rail based on the factory position, and determines the collected and calculated parameters as the default parameters of the target vehicle.

[0064] 204. When the target model and the picking posture model are successfully matched, determine whether the target vehicle is in a driving state or a stationary state. If the target vehicle is in a stationary state, activate the electronic parking brake system.

[0065] When the target model is successfully matched with the picking posture model, the vehicle terminal determines that the passenger corresponding to the target model has a picking action, and continues to determine whether the target vehicle is in a moving state or a stationary state. If the target vehicle is in a stationary state and the current gear is forward, the electronic parking brake system is activated.

[0066] Furthermore, to improve the adaptability to environmental conditions, if the target vehicle is stationary and the current gear is forward, the on-board terminal continues to collect the location information of the target person. Based on the location information, it determines whether the target person is the driver. If so, the electronic parking brake system is activated; otherwise, it is not activated.

[0067] 205. If the target vehicle is in motion, the location information of the target personnel is collected. Based on the location information of the target personnel, it is determined whether the target personnel is the driver. If so, the broadcast system or the automatic driving system is activated. The broadcast system is used to issue a voice alarm.

[0068] If the target vehicle is in motion, the on-board terminal collects the location information of the target person and determines whether the location information indicates the driver's seat. If so, the target person is determined to be the driver, the broadcast system is activated to issue a voice alarm and a timer is started. The timer value is monitored. When the timer value is greater than the threshold, it is checked whether the target model and the picking posture model are still successfully matched. If so, the autonomous driving system is activated.

[0069] For example, when the vehicle terminal detects that the driver is making a picking action, it issues a voice alarm to warn the driver to pay attention to safety and starts a timer. When the timer value is greater than the set value of 2 seconds, the vehicle terminal checks the matching degree between the target model and the picking posture model again. If they still match, it is determined that the driver has maintained a picking action for a certain period of time while the vehicle is in motion, which is considered dangerous driving, and the autonomous driving system is activated to assist driving.

[0070] 206. Read the target person's body shape data and location information, and adjust the seat and lighting according to the target person's body shape data and location information;

[0071] The vehicle-mounted terminal reads the target person's body shape data and obtains their body parameters, including chest, waist, and thigh circumference. It estimates the weight based on this data and queries a pre-set seat adjustment parameter table for the corresponding adjustment parameters. The terminal then adjusts the seat height and fore-aft offset according to these parameters. If the seat at that position cannot be adjusted, the adjustable seat in front of it is adjusted forward by the corresponding offset distance. Simultaneously, the terminal reads the target person's location information and activates the corresponding lighting.

[0072] Furthermore, in order to turn on the light closest to the dropped item to provide a better lighting environment for picking up the item, the vehicle terminal obtains the picking direction based on the target person's body shape data, predicts the location where the item will fall based on the picking direction, and turns on the light closest to the predicted location.

[0073] With the headlights on, the vehicle terminal uses a light sensor to detect the brightness of the under-vehicle light in the corresponding area of ​​the headlights, and adjusts the brightness of the headlights according to the brightness of the under-vehicle light in the corresponding area to help provide a better pickup environment.

[0074] 207. Continue monitoring the target model. When the target model successfully matches the standard attitude model, restore the environmental parameters of the target vehicle.

[0075] The vehicle terminal continues to monitor the target model. When the target model successfully matches the standard posture model, it determines whether the target person is the driver and whether the target vehicle has activated the autonomous driving system. If so, it issues a voice broadcast to remind the driver that the autonomous driving system will be deactivated soon. It reads the default parameters of the target vehicle, which are the environmental parameters of the target vehicle before the last successful match between the target model and the picked posture model. It determines whether the current environmental parameters of the target vehicle are the default parameters of the target vehicle. If not, it restores the current environmental parameters of the target vehicle to the default parameters of the target vehicle.

[0076] In this embodiment of the invention, a target model is established by collecting the body data of passengers in the vehicle. The target model is then matched with models in the model library. When the matching result indicates that the passenger is in a picking posture, different vehicle environmental parameters are adjusted according to the vehicle's driving status, the target passenger's position, and body data. This not only provides a convenient and safe picking environment and improves the convenience and safety of people picking up items in the vehicle, but also saves resources.

[0077] The vehicle environment adjustment method based on pickup action in the embodiments of the present invention has been described above. The vehicle environment adjustment device based on pickup action in the embodiments of the present invention will be described below. Please refer to [link / reference]. Figure 3 One embodiment of the vehicle environment adjustment device based on picking action in this invention includes:

[0078] The first acquisition module 301 is used to acquire the body data of the target person in real time, and to build or update the target model based on the body data of the target person, with the target person riding in the target vehicle.

[0079] The matching module 302 is used to match the target model with a preset model library, which includes a pick-up pose model and a standard pose model.

[0080] The adjustment module 303 is used to adjust the environmental parameters of the target vehicle when the target model is successfully matched with the picking posture model. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lights, electronic parking brake system, broadcast system and autonomous driving system.

[0081] The monitoring module 304 is used to continue monitoring the target model. When the target model successfully matches the standard attitude model, the environmental parameters of the target vehicle are restored and set.

[0082] In this embodiment of the invention, a target model is established by collecting the body data of passengers in the vehicle. The target model is then matched with models in the model library. When the matching result indicates that the passenger is in a picking posture, the environmental parameters of the vehicle are automatically adjusted to provide a convenient and safe picking environment, thereby improving the convenience and safety of people picking up items in the vehicle.

[0083] Please see Figure 4 Another embodiment of the vehicle environment adjustment device based on the picking action in this invention includes:

[0084] The first acquisition module 301 is used to acquire the body data of the target person in real time, and to build or update the target model based on the body data of the target person, with the target person riding in the target vehicle.

[0085] The matching module 302 is used to match the target model with a preset model library, which includes a pick-up pose model and a standard pose model.

[0086] The adjustment module 303 is used to adjust the environmental parameters of the target vehicle when the target model is successfully matched with the picking posture model. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lights, electronic parking brake system, broadcast system and autonomous driving system.

[0087] The monitoring module 304 is used to continue monitoring the target model. When the target model successfully matches the standard attitude model, the environmental parameters of the target vehicle are restored and set.

[0088] Optionally, the adjustment module 303 includes:

[0089] The first judgment unit 3031 is used to determine whether the target vehicle is in a driving state or a stationary state when the target model and the picking posture model are successfully matched. If the target vehicle is in a stationary state and the current gear is forward, the electronic handbrake system is activated.

[0090] The second judgment unit 3032 is used to collect the location information of the target person if the target vehicle is in motion, and to determine whether the target person is the driver based on the location information. If so, the broadcasting system or the automatic driving system is activated. The broadcasting system is used to issue a voice alarm.

[0091] The adjustment unit 3033 is used to read the body shape data and position information of the target person, and adjust the seat and lighting according to the body shape data and position information of the target person.

[0092] Optionally, the second judgment unit 3032 is specifically used for:

[0093] If the target vehicle is in motion, the location information of the target person is collected; it is determined whether the location information of the target person indicates the driver's seat position. If so, the target person is determined to be the driver, the broadcast system is activated to issue a voice alarm and start a timer; the value of the timer is monitored. When the value of the timer is greater than the threshold, it is checked whether the target model and the picking posture model are still successfully matched. If so, the autonomous driving system is activated.

[0094] Optionally, the adjustment unit 3033 is specifically used for:

[0095] Read the target person's body shape data, obtain the target person's body parameters based on the body shape data, and adjust the height and fore-aft offset distance of the seat according to the target person's body parameters; read the target person's position information, and turn on the corresponding lighting according to the target person's position information.

[0096] Optionally, monitoring module 304 is specifically used for:

[0097] Continue monitoring the target model. When the target model successfully matches the standard posture model, determine whether the target person is the driver and the target vehicle has activated the autonomous driving system. If so, issue a voice broadcast to remind the driver that the autonomous driving system will be deactivated soon. Read the default parameters of the target vehicle. The default parameters of the target vehicle are the environmental parameters of the target vehicle before the last successful match between the target model and the picked posture model. Determine whether the current environmental parameters of the target vehicle are the default parameters of the target vehicle. If not, restore the current environmental parameters of the target vehicle to the default parameters of the target vehicle.

[0098] Optionally, the vehicle environment adjustment device based on the picking action also includes a second acquisition module 305, which is used to acquire the position information of the seats in the target vehicle and the on / off status of the lighting, electronic parking brake system, broadcast system and autonomous driving system to obtain the default parameters of the target vehicle. The seat position information includes the seat height and the seat fore-and-aft offset distance.

[0099] Optionally, the first acquisition module 301 is specifically used for:

[0100] The system receives the start command from the target vehicle, which triggers the data acquisition system. The system then collects the body shape data of the target personnel in real time and builds a target model based on this data. The system monitors the range of change in the body shape data and updates the target model when the range of change exceeds the deviation range of the target model.

[0101] In this embodiment of the invention, a target model is established by collecting the body data of passengers in the vehicle. The target model is then matched with models in the model library. When the matching result indicates that the passenger is in a picking posture, different vehicle environmental parameters are adjusted according to the vehicle's driving status, the target passenger's position, and body data. This not only provides a convenient and safe picking environment and improves the convenience and safety of people picking up items in the vehicle, but also saves resources.

[0102] above Figure 3 and Figure 4The vehicle environment adjustment device based on picking action in the embodiments of the present invention will be described in detail from the perspective of modular functional entities. The vehicle environment adjustment device based on picking action in the embodiments of the present invention will be described in detail from the perspective of hardware processing.

[0103] Figure 5 This is a schematic diagram of a vehicle environment control device based on pickup action provided in an embodiment of the present invention. The vehicle environment control device 500 based on pickup action can vary significantly due to different configurations or performance. It may include one or more central processing units (CPUs) 510 (e.g., one or more processors) and a memory 520, and one or more storage media 530 (e.g., one or more mass storage devices) for storing application programs 533 or data 532. The memory 520 and storage media 530 can be temporary or persistent storage. The program stored in the storage media 530 may include one or more modules (not shown in the diagram), each module may include a series of instruction operations on the vehicle environment control device 500 based on pickup action. Furthermore, the processor 510 may be configured to communicate with the storage media 530 and execute the series of instruction operations in the storage media 530 on the vehicle environment control device 500 based on pickup action.

[0104] The vehicle environment control device 500 based on pickup actions may also include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input / output interfaces 560, and / or one or more operating systems 531, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc. Those skilled in the art will understand that... Figure 5 The illustrated vehicle environment control device structure based on pickup action does not constitute a limitation on vehicle environment control devices based on pickup action, and may include more or fewer components than illustrated, or combine certain components, or have different component arrangements.

[0105] The present invention also provides a vehicle environment adjustment device based on picking action, wherein the computer device includes a memory and a processor, the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor performs the steps of the vehicle environment adjustment method based on picking action in the above embodiments.

[0106] The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium, wherein the computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the steps of the vehicle environment adjustment method based on the picking action.

[0107] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0108] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0109] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A vehicle environment adjustment method based on pickup actions, characterized in that, The vehicle environment adjustment method based on picking actions includes: Real-time acquisition of body shape data of target personnel; establishment or updating of target model based on body shape data of target personnel; target personnel riding in target vehicle. The target model is matched with a preset model library, which includes a picking pose model and a standard pose model. When the target model is successfully matched with the picking posture model, the environmental parameters of the target vehicle are adjusted. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lights, electronic parking brake system, broadcast system and autonomous driving system. Continue monitoring the target model. When the target model successfully matches the standard attitude model, restore and set the environmental parameters of the target vehicle. Specifically, when the target model successfully matches the pickup posture model, the environmental parameters of the target vehicle are adjusted. These environmental parameters include the seat position and the on / off status of the lighting, electronic parking brake system, announcement system, and autonomous driving system. The adjustments include: when the target model successfully matches the pickup posture model, determining whether the target vehicle is in a moving or stationary state; if the target vehicle is stationary and the current gear is forward, activating the electronic parking brake system; if the target vehicle is in a moving state, collecting the location information of the target occupant, determining whether the target occupant is the driver based on the location information, and if so, activating the announcement system or autonomous driving system, with the announcement system used to issue a voice alarm; reading the shape data and location information of the target occupant, and adjusting the seat and lighting based on the shape data and location information of the target occupant.

2. The vehicle environment adjustment method based on picking action according to claim 1, characterized in that, If the target vehicle is in motion, the location information of the target person is collected. Based on the location information, it is determined whether the target person is the driver. If so, the broadcast system or the autonomous driving system is activated. The broadcast system is used to issue a voice alarm, including: If the target vehicle is in motion, the location information of the target person is collected; Determine whether the location information of the target person indicates the driver's seat position. If so, determine that the target person is the driver, activate the broadcast system to issue a voice alarm and start the timer. Monitor the value of the timer. When the value of the timer is greater than the threshold, check whether the target model and the picking posture model are still successfully matched. If so, activate the autonomous driving system.

3. The vehicle environment adjustment method based on picking action according to claim 1, characterized in that, The step of reading the body shape data and position information of the target person, and adjusting the seat and lighting according to the body shape data and position information of the target person, includes: Read the body shape data of the target person, obtain the body parameters of the target person based on the body shape data, and adjust the height and fore-aft offset distance of the seat according to the body parameters of the target person; Read the location information of the target person and turn on the corresponding lighting based on the location information of the target person.

4. The vehicle environment adjustment method based on picking action according to claim 1, characterized in that, The process of continuing to monitor the target model, and when the target model successfully matches the standard attitude model, restoring and setting the environmental parameters of the target vehicle, includes: Continue monitoring the target model. When the target model successfully matches the standard posture model, determine whether the target person is the driver and whether the target vehicle has activated the autonomous driving system. If so, issue a voice broadcast to remind the driver that the autonomous driving system will be deactivated soon. Read the default parameters of the target vehicle, which are the environmental parameters of the target vehicle before the most recent successful matching between the target model and the picking posture model; Determine whether the current environmental parameters of the target vehicle are the default parameters of the target vehicle. If not, restore the current environmental parameters of the target vehicle to the default parameters of the target vehicle.

5. The vehicle environment adjustment method based on picking action according to any one of claims 1-4, characterized in that, After matching the target model with a pre-set model library, and before adjusting the environment of the target vehicle when the target model successfully matches the picking posture model, the process further includes: The system collects the position information of the seats in the target vehicle, as well as the on / off status of the lights, electronic parking brake system, broadcast system, and autonomous driving system, to obtain the default parameters of the target vehicle. The seat position information includes the seat height and the seat fore-and-aft offset distance.

6. The vehicle environment adjustment method based on picking action according to claim 1, characterized in that, The real-time acquisition of the target person's body shape data, the establishment or updating of the target model based on the target person's body shape data, and the target person riding in the target vehicle, include: Receive the start command from the target vehicle, and the start command triggers the acquisition system; The system collects the body shape data of the target person in real time and establishes a target model based on the body shape data. Monitor the magnitude of change in the shape data, and update the target model when the magnitude of change in the shape data exceeds the deviation range of the target model.

7. A vehicle environment adjustment device based on a pickup action, characterized in that, The vehicle environment adjustment device based on the picking action includes: The first acquisition module is used to acquire the body data of the target person in real time, and to establish or update the target model based on the body data of the target person, wherein the target person is riding in the target vehicle; A matching module is used to match the target model with a preset model library, which includes a pick-up pose model and a standard pose model. An adjustment module is used to adjust the environmental parameters of the target vehicle when the target model is successfully matched with the picking posture model. The environmental parameters of the target vehicle include the position of the seat and the on / off status of the lights, electronic parking brake system, broadcast system and autonomous driving system. The monitoring module is used to continue monitoring the target model. When the target model successfully matches the standard posture model, the environmental parameters of the target vehicle are restored and set. Specifically, when the target model successfully matches the pickup posture model, the environmental parameters of the target vehicle are adjusted. These environmental parameters include the seat position and the on / off status of the lighting, electronic parking brake system, announcement system, and autonomous driving system. The adjustments include: when the target model successfully matches the pickup posture model, determining whether the target vehicle is in a moving or stationary state; if the target vehicle is stationary and the current gear is forward, activating the electronic parking brake system; if the target vehicle is in a moving state, collecting the location information of the target occupant, determining whether the target occupant is the driver based on the location information, and if so, activating the announcement system or autonomous driving system, with the announcement system used to issue a voice alarm; reading the shape data and location information of the target occupant, and adjusting the seat and lighting based on the shape data and location information of the target occupant.

8. A vehicle environment control device based on pickup action, characterized in that, The vehicle environment adjustment device based on picking action includes: a memory and at least one processor, wherein the memory stores instructions; The at least one processor invokes the instructions in the memory to cause the vehicle environment adjustment device based on pickup action to perform the vehicle environment adjustment method based on pickup action as described in any one of claims 1-6.

9. A computer-readable storage medium storing instructions thereon, characterized in that, When the instructions are executed by the processor, they implement the vehicle environment adjustment method based on picking actions as described in any one of claims 1-6.

Images