In-vehicle environment regulation and control method and device

Abstract

The invention relates to the technical field of vehicle control, and discloses an in-vehicle environment regulation and control method and device, and the method comprises the steps: obtaining an initial travel scene of a target driver and passengers and space environment parameters in a target space, and the initial travel scene is determined based on the travel information of the target driver and passengers; preliminarily adjusting the in-vehicle environment of the target vehicle based on the initial travel scene and the space environment parameters to obtain an initial in-vehicle environment; when the target driver and the passenger approach the target vehicle, adjusting the initial travel scene based on the approach information of the actual driver and the passenger in the detection area to obtain a target travel scene; based on the actual riding position of the driver and the passenger in the target travel scene, the initial in-vehicle environment is regulated and controlled, so that a target in-vehicle environment corresponding to the actual riding position of the driver and the passenger is obtained; according to the invention, the reliability of in-vehicle environment regulation and control of the target vehicle can be improved, so that the travel experience of a user is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle control, and in particular to a method and device for controlling an in-vehicle environment. Background Art

[0002] With the continuous advancement of intelligent transportation and autonomous driving technologies, the interaction between vehicles and the environment has become increasingly close, and the demand for personalized vehicle comfort configuration has gradually become the focus of users. In related technologies, most vehicle comfort configuration technologies rely on fixed preset conditions or driver input, but in actual use, this single static control method is difficult to adapt to the diverse needs of different drivers and passengers, thereby reducing the user's travel experience. Summary of the invention

[0003] In view of this, the present invention provides a method and device for controlling an in-vehicle environment to solve the problem in vehicle control related technologies that the control of the vehicle cabin environment depends on fixed preset conditions or driver input, thereby reducing the user's travel experience.

[0004] In the first aspect, the present invention provides a method for regulating the in-vehicle environment, the method comprising: obtaining the initial travel scene of the target driver and passenger and the spatial environment parameters in the target space, the initial travel scene being determined based on the travel information of the target driver and passenger; preliminarily adjusting the in-vehicle environment of the target vehicle based on the initial travel scene and the spatial environment parameters to obtain the initial in-vehicle environment; when the target driver and passenger approaches the target vehicle, adjusting the initial travel scene based on the approach information of the actual driver and passenger in the detection area to obtain the target travel scene, the actual driver and passenger including at least one target driver and passenger; regulating the initial in-vehicle environment based on the seating position of the actual driver and passenger in the target travel scene to obtain the target in-vehicle environment corresponding to the seating position of the actual driver and passenger. Through the above process, the reliability of in-vehicle environment regulation can be improved, thereby improving the travel experience of users.

[0005] In some optional implementations, obtaining the travel information of the target driver and passenger and the spatial environment parameters in the target space includes:

[0006] Obtain the social network data and smart home data of the target driver and passengers;

[0007] Determine the travel information of target drivers and passengers based on social network data;

[0008] Determine the initial travel scenario of the target driver and passenger based on the travel information;

[0009] Determine spatial environment parameters within the target space based on smart home data.

[0010] In some optional implementations, the interior environment of the target vehicle is preliminarily adjusted based on the initial travel scenario and the spatial environment parameters to obtain the initial interior environment, including:

[0011] Based on the initial travel scenario, determine the travel time and preferred in-car environment parameters of the target driver and passenger;

[0012] The preferred in-vehicle environment parameters are fused with the space environment parameters to obtain fused environment parameters;

[0013] Based on the travel time and fused environmental parameters, the interior environment of the target vehicle is preliminarily adjusted to obtain the initial interior environment.

[0014] In some optional implementations, when the target driver or passenger approaches the target vehicle, the initial travel scenario is adjusted based on the approach information of the actual driver or passenger in the detection area to obtain the target travel scenario, including:

[0015] Determining whether the target occupant is close to the target vehicle based on the signal strength of the received key signal;

[0016] When the target driver and passenger approaches the target vehicle, the number of actual drivers and passengers in the detection area and the approach direction are obtained;

[0017] Based on the number of actual drivers and passengers and their approach directions, the identities of the actual drivers and passengers are identified to obtain the identity information of the actual drivers and passengers;

[0018] Based on the identity information of each actual driver and passenger, the initial travel scenario is adjusted to obtain the target travel scenario.

[0019] In some optional implementations, the initial travel scenario is adjusted based on the identity information of each actual driver and passenger to obtain a target travel scenario, including:

[0020] When the actual driver is a single person and the identity information indicates that the actual driver is a driver, the initial travel scenario is adjusted to individual travel, and the target travel scenario includes individual travel;

[0021] When there are multiple actual drivers and passengers, and the identity information indicates that the multiple actual drivers and passengers are family members, the initial travel scenario is adjusted to family travel, and the target travel scenario includes family travel;

[0022] When there are multiple actual drivers and passengers, and the identity information indicates that there are non-family members among the multiple actual drivers and passengers, the initial travel scenario is adjusted to social travel, and the target travel scenario includes social travel.

[0023] In some optional implementations, based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger, including:

[0024] When the target travel scenario is personal travel, personal privacy environment data corresponding to the personal travel is obtained, and the personal privacy environment data is used to represent the adjustment parameters used by the driver to adjust the internal privacy environment of the target vehicle;

[0025] Based on personal privacy environment data, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passengers.

[0026] In some optional implementations, based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger, including:

[0027] When the target travel scenario is family travel, obtaining family privacy environment data corresponding to the family travel, where the family privacy environment data is used to represent adjustment parameters for family members to adjust the internal privacy environment of the target vehicle;

[0028] Based on the family privacy environment data, the initial in-car environment is adjusted to obtain the target in-car environment corresponding to the actual seating position of the driver and passengers.

[0029] In some optional implementations, based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger, including:

[0030] When the target travel scenario is a social travel, social privacy environment data corresponding to the social travel is obtained, where the social privacy environment data is used to characterize the adjustment parameters for adjusting the internal privacy environment of the target vehicle by non-family members;

[0031] Based on the social privacy environment data, the initial in-vehicle environment is adjusted to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passengers.

[0032] In some optional implementations, based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger, including:

[0033] Identify the identities of the actual drivers and passengers at each seating position to obtain the identity information of each actual driver and passenger;

[0034] Based on the identity information of each actual driver and passenger, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

[0035] In the second aspect, the present invention provides an in-vehicle environment control device, which mainly includes: a parameter acquisition module, which is used to obtain the initial travel scene of the target driver and passenger and the spatial environment parameters in the target space, and the initial travel scene is determined based on the travel information of the target driver and passenger; a parameter adjustment module, which is used to preliminarily adjust the in-vehicle environment of the target vehicle based on the initial travel scene and the spatial environment parameters to obtain the initial in-vehicle environment; a scene adjustment module, which is used to adjust the initial travel scene based on the approach information of the actual driver and passenger in the detection area when the target driver and passenger are close to the target vehicle, and obtain the target travel scene, and the actual driver and passenger include at least one target driver and passenger; an environment control module, which is used to control the initial in-vehicle environment based on the seating position of the actual driver and passenger in the target travel scene, so as to obtain the target in-vehicle environment corresponding to the seating position of the actual driver and passenger. Through the above modules, the reliability of the in-vehicle environment control can be improved, thereby improving the user's travel experience.

[0036] In a third aspect, the present invention provides a vehicle, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the in-vehicle environment control method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0037] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the in-vehicle environment control method of the first aspect or any corresponding embodiment thereof.

[0038] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions for causing a computer to execute the in-vehicle environment control method of the first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 is a flow chart of a method for controlling an in-vehicle environment according to an embodiment of the present invention;

[0041] Figure 2 is an application scenario diagram of the in-vehicle environment control method according to an embodiment of the present invention;

[0042] Figure 3 is a data flow diagram of the in-vehicle environment control system according to an embodiment of the present invention;

[0043] Figure 4 is a structural block diagram of a vehicle interior environment control device according to an embodiment of the present invention;

[0044] Figure 5 Schematic diagram of the hardware structure of a vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0046] According to an embodiment of the present invention, an embodiment of a method for controlling an in-vehicle environment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0047] In this embodiment, a method for controlling the in-vehicle environment is provided, which can be used in the above-mentioned vehicle. Figure 1 is a flow chart of a method for controlling an in-vehicle environment according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0048] Step 110, obtaining the initial travel scene of the target driver and passenger and the spatial environment parameters in the target space.

[0049] Among them, the initial travel scenario is determined based on the travel information of the target driver and passenger, and the travel information of the target driver and passenger may include but is not limited to travel time, travel route, travel purpose and other information. The initial travel scenario of the target driver and passenger may include personal travel, family travel and social travel. The spatial environment parameters in the target space may involve temperature, humidity, light intensity, air quality, etc. By collecting this information, the system can more accurately predict the comfort needs of the driver and passenger, and adjust the in-car environment accordingly to meet the personalized needs of different drivers and passengers.

[0050] In some optional implementations, when obtaining the travel information of the target driver and passenger and the spatial environment parameters in the target space, the social network data and smart home data of the target driver and passenger can be collected first. The travel information of the target driver and passenger is determined using the social network data, and then the initial travel scene of the target driver and passenger is inferred based on the travel information. At the same time, the spatial environment parameters in the target space are analyzed through the smart home data.

[0051] In practice, see Figure 2 , by analyzing social network data to determine the travel information of the target driver and passenger, and determining the initial travel scenario of the target driver and passenger based on the travel information: first, obtain the location data of the target driver and passenger, perform device GPS positioning through the authorized in-vehicle APP, and use geocoding technology to convert the location into the precise coordinates required for vehicle identification. Then, extract the travel event keywords based on the social status information posted by the target driver and passenger, and perform sentiment analysis, and only extract the travel intensity score to judge the travel intention. That is, the in-vehicle system (system) extracts key information related to travel from social media content based on Python's spaCy library. This process includes keyword recognition (such as "travel", "departure", "home", etc.) and word frequency statistics to determine the importance of keywords. After sentiment analysis, the text data can further determine the intensity of travel intention. For example, content with positive emotions usually means that the user is about to or has started traveling. Based on the context analysis of the large model, the time, location and other details of the travel plan are identified, and the content is marked through the event detection model to distinguish events such as "travel", "business trip" or "family travel", and then the initial travel scenario of the target driver and passenger is obtained.

[0052] In actual operation, when analyzing smart home data to determine the spatial environment parameters in the target space, the door lock status in the smart home can be monitored, that is, the unlocking / locking status and time of the door lock can be collected to determine whether the user has gone out. Data can also be collected from the temperature control system of the smart home in the target space to collect the current temperature control settings and modes to assist in determining whether the user is at home. In addition, the temperature settings and working modes (such as cooling, heating or dehumidification) of the temperature control device are obtained through the smart home API, and the target space, such as the changes in the indoor temperature, are monitored to make data-driven preparations for subsequent in-vehicle comfort adjustment. Data can also be collected from the lighting system of the smart home in the target space, such as real-time monitoring of the status of the lighting system (switch status and brightness) through the smart home API to reflect the intensity of user activities. Thus, the user's activity context can be judged by analyzing the lighting mode. For example, turning the light to high brightness or low brightness at night during non-normal rest time indicates increased activity or an increased probability of going out.

[0053] In addition, the collected social network data and smart home data can be cleaned and standardized, and uploaded to the cloud through encrypted transmission. Anonymization and data minimization techniques are further used to ensure that all data meets privacy protection requirements, especially the fuzzification of location information and social information.

[0054] In some optional implementations, when obtaining the initial travel scenario of the target driver and passenger, the fusion results of the social network data and the smart home data may also be used for judgment.

[0055] Specifically, define social network data S social : Includes the user's current activity status E travel、 Sentiment score E emotion .

[0056] Defining Smart Home Data home :Including the home door lock status H lock , temperature control state H temp , lighting status H light .

[0057] Define the fusion result as the scene feature vector V scene , used to preliminarily determine the initial travel scenario.

[0058] V scene =[N approach ,D approach ,E travel ,E emotion ,H lock ,H temp ,H light ]

[0059] Use the weighted fusion model to calculate the scene classification score S scene , each weight w i Reflect the importance of data:

[0060]

[0061] By preliminarily classifying the current scene based on the fused scene feature vector, a basis is provided for subsequent personalized settings.

[0062] Furthermore, the scene classification criteria include:

[0063] Based on the scene classification score S scene and the preset threshold T scene , determine the initial travel scenario:

[0064] Personal travel: If S scene ≤T personal , it is judged as personal travel.

[0065] Family travel: If T personal scene ≤T family , it is judged as a family trip.

[0066] Social travel: If S scene >T family , it is judged as social travel.

[0067]

[0068] In addition, if new occupants or changes in environmental data are detected, the system dynamically updates the scene feature vector V scene and scene classification score S scene Adjust scene classification results in real time.

[0069] Continuous determination formula:

[0070]

[0071] Where α is the smoothing coefficient, which ensures the stability of scene classification.

[0072] Step 120 , preliminarily adjust the interior environment of the target vehicle based on the initial travel scenario and the spatial environment parameters to obtain an initial interior environment.

[0073] As mentioned above, by preliminarily adjusting the interior environment of the target vehicle (hereinafter referred to as the vehicle) based on the initial travel scenario and spatial environment parameters, the initial interior environment is obtained, so as to provide suitable comfort configuration in advance as much as possible before the driver and passengers enter the vehicle.

[0074] In some optional embodiments, the interior environment of the target vehicle is preliminarily adjusted based on the initial travel scenario and spatial environment parameters. When the initial interior environment is obtained, the travel time and preferred interior environment parameters of the target driver and passenger can be determined based on the initial travel scenario; the preferred interior environment parameters are fused with the spatial environment parameters to obtain fused environment parameters; and the interior environment of the target vehicle is preliminarily adjusted based on the travel time and the fused environment parameters to obtain the initial interior environment.

[0075] Specifically, when the preferred in-vehicle environment parameters are fused with the spatial environment parameters, they can be obtained based on the union and / or weighted average of the two. When the in-vehicle environment of the target vehicle is initially adjusted based on the travel time and the fused environment parameters, it can be detected whether the fused environment parameters match the in-vehicle environment parameters; when the fused environment parameters do not match the in-vehicle environment parameters, the in-vehicle environment of the vehicle is initially adjusted based on the fused environment parameters to obtain an initial in-vehicle environment that matches the fused environment parameters.

[0076] ​In actual operation, the initial travel scenario is personal travel.

[0077] Seat adjustment: The driver's seat position is adjusted to the driver's historical preferences to ensure that it meets their habitual sitting posture and safety needs; the rear seats remain folded or the backrests are lowered to increase trunk space.

[0078] Air conditioning preset: Set the appropriate air conditioning temperature based on the driver's temperature preference and home temperature control information. For example, if the home air conditioning is in "cooling" mode, the car air conditioning will be set to a lower temperature; if the home temperature control system is in "heating" mode, the car temperature will be appropriately raised.

[0079] Audio system: Based on the driver's music preferences, plays their favorite music list or radio station and adjusts the volume to a level suitable for single-person driving.

[0080] Lighting adjustment: Adjust the in-car ambient lighting based on smart home lighting data; if the home lights are frequently turned on at night, the in-car ambient lighting will be adjusted to a brighter state; if the driver prefers soft lighting, the ambient lighting will be dimmed to avoid visual stimulation.

[0081] In actual operation, the initial travel scenario is family travel.

[0082] Seat adjustment: Based on passenger identity data, the rear seats are adjusted to a height and angle suitable for family members to ensure the comfort of children or elderly members.

[0083] Air conditioning zone control: The front and rear areas are adjusted to suit the temperature requirements of different family members. The rear ventilation mode is adjusted to a gentle mode to ensure air circulation without strong airflow.

[0084] Audio system: Plays background music that family members often listen to, and balances the volume of the front and rear rows to ensure that all passengers can enjoy a comfortable volume.

[0085] Lighting adjustment: Adjust the light to warm mode to create a gentle environment suitable for family travel.

[0086] In actual operation, when the initial travel scenario is a multi-person scenario (social travel) other than family travel:

[0087] Seat adjustment: The rear seats are adjusted to a comfortable angle for adult passengers to ensure sufficient space.

[0088] Climate Balance: Adjusts the climate system to ensure even temperature in all areas of the vehicle; may enable zone control to adjust the temperature according to the preferences of rear passengers.

[0089] Audio system: Play music suitable for social atmosphere, turn off the driver's personal playlist, and play general songs randomly. The volume is adjusted to a level suitable for all passengers, taking into account the needs of the front and rear rows.

[0090] Lighting adjustment: Adjust the interior ambient lighting to a brightness suitable for social environments, ensuring sufficient lighting to create a lively atmosphere.

[0091] In addition, the temperature, humidity, lighting intensity, and seat position in the car can be automatically adjusted according to the passengers' personal preferences and travel time to meet the comfort needs of different passengers at different times. For example, for passengers traveling in the morning, the system may increase the lighting intensity in the car to adapt to the darker environment in the morning; while for passengers traveling at night, the lighting intensity may be reduced to create a more relaxing atmosphere. In addition, the seat's tilt angle and support strength can be automatically adjusted according to the length of the travel time to ensure the comfort of passengers during long rides. Through these intelligent adjustments, passengers can be provided with a more personalized and humane travel experience.

[0092] Step 130 : When the target driver or passenger approaches the target vehicle, the initial travel scenario is adjusted based on the approaching information of the actual driver or passenger in the detection area to obtain the target travel scenario.

[0093] The actual occupants include at least one target occupant, and the target occupants include a driver, or a driver and a passenger, that is, the actual occupants may be a driver, or a driver and a passenger.

[0094] In some optional embodiments, when the target driver and passenger approaches the target vehicle, the initial travel scenario is adjusted based on the approach information of the actual driver and passenger in the detection area. When the target travel scenario is obtained, it can be determined whether the target driver and passenger is close to the target vehicle based on the signal strength of the received key signal; when the target driver and passenger approaches the target vehicle, the number and approach direction of the actual drivers and passengers in the detection area are obtained; based on the number and approach direction of the actual drivers and passengers, the identity of each actual driver and passenger is identified to obtain the identity information of each actual driver and passenger; based on the identity information of each actual driver and passenger, the initial travel scenario is adjusted to obtain the target travel scenario.

[0095] In actual operation, based on the signal strength of the received key signal, when determining whether the target driver or passenger is close to the target vehicle, taking the target driver as an example, the distance between the driver and the target vehicle can be detected by the Bluetooth / NFC signal strength of the key or mobile phone.

[0096] When the signal strength S meets the threshold condition:

[0097] S≥S min And S≤Smax

[0098] Enter "Approach Detection Mode", where S min and S max Represent the minimum and maximum signal strength thresholds respectively, ensuring that the driver is between 1 meter and 3 meters away from the vehicle.

[0099] Signal dynamic acquisition frequency: Set the initial acquisition frequency to f 0 =1Hz, that is, the signal strength is collected once per second. When the system detects that the approach speed v increases, the collection frequency f increases dynamically to:

[0100] f=f 0 +k·v

[0101] Where k is a dynamic adjustment coefficient used to improve collection efficiency.

[0102] To improve data reliability, the driver’s geographic location L driver Perform two-step verification. Location verification is determined by the following conditions:

[0103] ||L driver -L vehicle ||≤d threshold

[0104] Where L vehicle is the vehicle position, d threshold is the distance threshold to ensure that the driver is indeed near the target vehicle.

[0105] In actual operation, when the target drivers and passengers approach the target vehicle, the proximity sensor on the target vehicle can be used to identify the number of actual drivers and passengers in the detection area and the approach direction, such as first activating the external radar and the internal infrared sensor to detect the surrounding environment data.

[0106] Collection frequency: Set the initial collection frequency to f out =2Hz, i.e., data is collected every 500 milliseconds. The collected data includes the number of people N surround and approach direction θ approach .

[0107] Data standardization: standardize the collected data and convert N surround and θ approach Convert to standard value N ′ and θ ′ , in order to meet the data format required for subsequent analysis.

[0108] Furthermore, when the actual driver or passenger opens the door and prepares to enter the car, the system activates the in-car camera, temperature sensor, and fingerprint / NFC recognition device.

[0109] Data collection frequency: The collection frequency is increased to f in =5Hz, that is, it collects data every 200 milliseconds to ensure real-time performance. The camera collects facial images I face Used for authentication.

[0110] Data quality filtering: Setting image quality threshold Q threshold :

[0111] Q(I face )≥Q threshold

[0112] Only images of acceptable quality are retained to ensure the accuracy of face recognition.

[0113] At the same time, the in-vehicle environment data, including temperature and light intensity, can also be collected synchronously to provide a basis for personalized configuration. The in-vehicle and out-vehicle environment data include in-vehicle temperature and in-vehicle and out-vehicle light intensity.

[0114] Infrared temperature sensors can be used to collect temperature data of the front and rear areas of the vehicle, denoted as T front and T rear .

[0115] The acquisition frequency is:

[0116]

[0117] To ensure that the acquisition frequency dynamically adapts to different distances.

[0118] The temperature data is smoothed by weighted average method to prevent sudden abnormal values ​​from appearing during the collection process:

[0119] T smooth =αT current +(1-α)T prev

[0120] Where α is the smoothing coefficient.

[0121] When collecting light intensity, you can use a light sensor to collect light intensity data inside and outside the car, denoted as L in and L out .

[0122] Collection frequency: Once per second when the target driver or passenger approaches the vehicle; after entering the vehicle, the frequency is increased to once every 500 milliseconds.

[0123] In addition, the light pair data can be normalized to the interval [0,1] to meet the needs of subsequent lighting adjustment.

[0124] In some optional implementations, multi-modal identity authentication can also be performed on the actual driver and passenger after they enter the vehicle, and personalized settings can be activated after successful authentication. Specifically:

[0125] First, the driver’s facial image I is collected through the front camera inside the car. driver-face , collected once per second to ensure that facial features are captured from multiple angles. The front camera and rear camera in the car collect facial images of passengers. passenger-face , collected once per second to ensure that facial features are captured from multiple angles.

[0126] In the image I face In the above example, facial feature points F are extracted. face :

[0127] F face ={(x i ,y i )|i=1,2,…,n}

[0128] Where (x i ,y i ) is the coordinate of the i-th feature point.

[0129] By comparing feature points, if the similarity σ(F face ,F stored ) satisfies the threshold σ threshold :

[0130] σ(F face ,F stored )≥σ threshold

[0131] The authentication is successful.

[0132] Subsequently, secondary verification is performed through fingerprint recognition or NFC data, and the data is recorded as D finger .

[0133] If the matching score γ(D finger ,D stored ) meets the preset matching threshold:

[0134] γ(D finger ,D stored )≥γ threshold

[0135] The authentication is successful.

[0136] Finally, in the multimodal identity authentication process, the weighted scoring method is used to obtain the final identity confirmation result S final :

[0137] S final =α·σ(F face ,Fstored )+β·γ(D finger ,D stored )

[0138] Where α and β are the weights of face and fingerprint / NFC authentication respectively, and α+β=1.

[0139] In some optional embodiments, when the actual driver and passenger is a single person and the identity information represents that the actual driver and passenger is a driver, the initial travel scenario can be adjusted to personal travel, and the target travel scenario includes personal travel; when the actual driver and passenger is multiple people and the identity information represents that the multiple actual drivers and passengers are all family members, the initial travel scenario can be adjusted to family travel, and the target travel scenario includes family travel; when the actual driver and passenger is multiple people and the identity information represents that there are non-family members among the multiple actual drivers and passengers, the initial travel scenario can be adjusted to social travel, and the target travel scenario includes social travel.

[0140] Step 140 , based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

[0141] As mentioned above, by performing preliminary configuration before the target drivers and passengers enter the car, and further confirming the scenario after the actual drivers and passengers enter the car, the configuration is finely adjusted to ensure that the vehicle settings are highly matched with actual needs.

[0142] Specifically, the infrared sensor can be used to collect the actual passenger position distribution data of the driver and passengers to generate the heat source distribution matrix M heat :

[0143]

[0144] Where T ij represents the temperature of the i-th row and j-th column.

[0145] Cluster analysis: for the matrix M heat Cluster analysis was performed to identify the locations of different passengers.

[0146] As mentioned above, by identifying the actual position of the driver and passengers in the car, precise support is provided for seat adjustment and air conditioning settings.

[0147] In some optional embodiments, when the initial in-vehicle environment is adjusted based on the actual seating positions of the driver and passengers in the target travel scenario to obtain a target in-vehicle environment corresponding to the actual seating positions of the driver and passengers, the identities of the actual drivers and passengers at each seating position can be identified to obtain the identity information of each actual driver and passenger; based on the identity information of each actual driver and passenger, the initial in-vehicle environment is adjusted to obtain the target in-vehicle environment corresponding to the actual seating positions of the driver and passengers.

[0148] In some optional implementations, in order to improve the accuracy of travel scenario determination, the target travel scenario may be further confirmed after the driver and passengers among the actual occupants enter the target vehicle.

[0149] Specifically, after the driver and the passenger enter the car, by combining the feature vector V scene And the in-vehicle feature vectors are used to further confirm and refine the initial scene judgment to ensure that the vehicle's usage scenario accurately matches the personalized settings:

[0150] In-car feature vector construction: based on the driver’s fingerprint F collected in the car finger 、Driver's face I driver-face , passenger facial information, and passenger heat source distribution matrix to construct the in-vehicle feature vector:

[0151] V inside =[F finger ,I driver-face ,I passenger-face ,M heat ]

[0152] The scene feature V scene and the vehicle interior feature vector V inside Fusion into a complete feature vector V combined , used for scene confirmation and judgment:

[0153] V combined =[V scene ,V inside ]

[0154] Scene judgment model: The complete feature vector V combined Input to the scene confirmation model Calculate the final classification result C of the scene scene , the classification results include (personal travel, family travel, social travel, cannot be determined):

[0155]

[0156] Through the above steps, the system further confirms the preliminary scene classification based on the data after the passengers and drivers enter the car, and generates the final scene label, that is, the target travel scene.

[0157] In actual operation, when the initial in-vehicle environment is adjusted to obtain the target in-vehicle environment corresponding to the actual seat position of the driver and passengers, if the initial configuration is consistent with the actual situation, the configuration remains unchanged; if it is detected that the initial judgment is inconsistent with the actual scene, the system will reconfigure according to the newly identified scene. Personal travel is only confirmed when it is judged that there is only one person in the car, so there will be no misjudgment. Therefore:

[0158] Scenario 1: The initial judgment is "family travel", but it is actually a "multi-person scenario without family travel".

[0159] Correction process: Confirm through the in-car camera that the rear passengers are non-family members, and the system switches to the "non-family multi-person travel" scenario.

[0160] Seat Adjustment: All seats return to the default comfort position, maximizing passenger space without additional personalized adjustments.

[0161] Air conditioning zones: Adjust the front and rear air conditioning to maintain a balanced temperature and ensure that all passengers enjoy the appropriate temperature and wind speed.

[0162] Audio and lighting: Choose music that fits the social atmosphere, turn off private playlists, set the volume to a level that all passengers can hear comfortably, and adjust the lighting to medium brightness to create a social atmosphere.

[0163] Scenario 2: The initial judgment was "multi-person scenario for non-family travel", but it was actually "family travel".

[0164] Correction process: After further identifying the rear passengers as family members, reconfirm it as a "family travel" scenario.

[0165] Seat adjustment: Switch to family mode to ensure that the seat position is consistent with the historical riding records of family members, providing a personalized comfort experience.

[0166] Air conditioning system optimization: the front and rear rows are adjusted to temperatures and wind speeds suitable for family members, and a family-specific soft ventilation mode is enabled in the rear row.

[0167] Audio configuration: Play music suitable for the whole family, adjust the volume evenly, and create a warm atmosphere.

[0168] In some optional embodiments, based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger. When the target travel scenario is personal travel, personal privacy environment data corresponding to personal travel is obtained, and the personal privacy environment data is used to characterize the adjustment parameters used by the driver to adjust the internal privacy environment of the target vehicle; based on the personal privacy environment data, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger. When the target travel scenario is family travel, family privacy environment data corresponding to family travel is obtained, and the family privacy environment data is used to characterize the adjustment parameters used by family members to adjust the internal privacy environment of the target vehicle; based on the family privacy environment data, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger. When the target travel scenario is social travel, the social privacy environment data corresponding to the social travel is obtained. The social privacy environment data is used to characterize the adjustment parameters for adjusting the internal privacy environment of the target vehicle by non-family members; based on the social privacy environment data, the initial in-vehicle environment is adjusted to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passengers. In this way, comprehensive privacy protection measures can be provided in the "multi-person travel but non-family members" scenario to ensure that the privacy of the owner and passengers in the car is effectively protected. In the "personal travel" and "family travel" scenarios, the privacy protection requirements are relatively low, so the configuration is relatively open. Through the aforementioned identity recognition and scenario judgment results, the privacy protection measures are adjusted dynamically in real time to ensure that they are highly matched with the needs of the travel scenario.

[0169] For example, when the target travel scenario is judged to be personal travel, the car owner is the only passenger and the privacy protection requirement is low. The configuration is as follows:

[0170] Storage space management: The storage space in the car (such as the glove box, door storage slots, etc.) remains unlocked for the owner's convenience.

[0171] Window transparency management: The windows maintain normal transparency to ensure that the owner has a good external view and ensure driving safety.

[0172] Audio system management: Automatically plays the set music list and adjusts the volume according to the owner's personal preferences to ensure a comfortable audio experience for the owner.

[0173] When the target travel scenario is family travel, the owner and passengers are all family members, and the privacy protection requirements are relatively low. The configuration is as follows:

[0174] Storage Space Management: Rear and door storage spaces remain unlocked for easy access by family members.

[0175] Window transparency management: The rear windows can be adjusted to semi-transparent mode to reduce external interference and ensure a comfortable atmosphere in the car, but the privacy glass is not enabled to ensure natural communication inside and outside the car.

[0176] Audio and lighting management: The audio system plays relaxing background music commonly used in the home, and the lighting is adjusted to a soft and comfortable mode to enhance the interaction and comfort among family members.

[0177] Information screen and device connection management: The in-car display can show the content needed by family members, such as route information or entertainment content. The owner's device is automatically connected to the car system to ensure that family members' devices do not need to be verified.

[0178] When the target travel scenario is a multi-person non-family travel scenario, that is, a social travel scenario, the owner and passengers are visitors or non-family members, and the privacy protection requirement is high. The configuration is as follows:

[0179] Storage Space Lock: Private spaces such as the glove box and door storage slots are automatically locked to prevent non-family members from accessing the owner's personal belongings.

[0180] Activation of window privacy glass: The rear windows are adjusted to privacy glass mode to prevent outsiders from prying, especially in crowded areas or when parking. The privacy glass is automatically activated to ensure that the privacy of passengers in the car is not disturbed.

[0181] Audio and lighting management: The audio system plays neutral and sociable background music at a moderate volume to avoid disturbing passengers. The lighting is adjusted to a soft mode to create an appropriate social atmosphere and enhance the sense of privacy.

[0182] Information screen and communication management: The in-vehicle screen automatically hides or blurs the owner's private information to prevent outsiders from peeping. At the same time, the in-vehicle system manages the communication connection with the outside world according to the owner's privacy needs to prevent external communications from leaking the owner's information.

[0183] In actual operation, privacy protection can also be confirmed and dynamically adjusted after the passengers enter the car.

[0184] For example, after a passenger enters the car, the system further confirms the passenger's identity through sensor data and the consistency of the initial scene judgment. If the confirmation is consistent, the original configuration is maintained; if not, adjustments and corrections are made.

[0185] The situation where the previous judgment is consistent:

[0186] When the system detects that the actual situation after the passenger enters the car is inconsistent with the initial judgment, further adjustment and correction are required. The specific situation is as follows:

[0187] Switch from "Individual Travel" to "Multiple Travel" or "Multiple Non-Family Members Traveling".

[0188] When the system initially determines that the vehicle is traveling individually and the identity of the owner or passenger changes, and the system detects that other non-family members or outsiders have entered the vehicle, it will automatically activate stronger privacy protection measures, including but not limited to:

[0189] Storage Space Lock: The system automatically locks private spaces such as the glove box and door storage slots to prevent outsiders from accessing the owner's personal belongings.

[0190] Activation of window privacy glass: The rear windows and side windows are switched to privacy glass mode to ensure that the privacy inside the car cannot be peeped at by outsiders.

[0191] Sound system and lighting adjustment: The sound system plays neutral background music at a moderate volume, and the lighting is adjusted to a soft mode to create an environment suitable for socializing while ensuring a sense of privacy.

[0192] Information screen management: The central control screen and rear entertainment screen automatically hide or encrypt sensitive information of the owner and passengers (such as itinerary, communication records, etc.).

[0193] Switch from "Family travel" to "Multiple non-family members travel".

[0194] When it is initially determined that the trip is a family trip, but the actual situation is that multiple people are not family members, the system will adjust the privacy protection measures according to the change in the passenger's identity:

[0195] Storage space management: Storage spaces in the vehicle (such as rear storage slots) will be locked or protected based on the owner's privacy settings.

[0196] Window privacy glass activation: The rear windows will switch to privacy glass mode to prevent outsiders from prying.

[0197] Audio and lighting adjustments: The system will adjust the audio and lighting settings based on the identity of the new passenger and the travel scenario, ensuring a comfortable social atmosphere while protecting privacy.

[0198] Switch from "Traveling with multiple non-family members" to "Traveling as a family".

[0199] When the system initially determines that multiple people are not family members traveling, but the actual situation is that they are family members traveling, the system will withdraw or reduce privacy protection measures:

[0200] Storage space unlocked: The rear storage space will be restored to the unlocked state, allowing family members to use it freely.

[0201] Window transparency restoration: The transparency of the rear windows will return to normal or translucent state to enhance interaction and communication within the car.

[0202] The audio and lighting return to home mode: the audio returns to the family's commonly used music list, and the lighting returns to comfortable and warm settings to create a family atmosphere.

[0203] Switch from "Family Travel" to "Individual Travel".

[0204] When the system initially determines that the trip is a family trip, but the actual situation is a personal trip, the system will quickly switch to personal mode and adjust the privacy protection measures:

[0205] Storage space unlocking: The glove box and door storage slots are restored to the unlocked state for the owner's convenience.

[0206] Window transparency restored: The windows return to normal transparency to ensure the driver's driving vision.

[0207] Audio System Adjustment: The audio system will play the owner's personal music playlist and adjust the volume to meet the owner's comfort needs.

[0208] Information screen and device management: The owner's device will automatically connect to the vehicle system and display the owner's personalized information (such as navigation, contacts, etc.).

[0209] Furthermore, in some special scenarios, if the above judgment result is that it cannot be judged, the system can make adaptive privacy protection adjustments:

[0210] Fuzzy identity recognition: The system will automatically increase privacy protection measures and enable a stricter protection mode.

[0211] Sensor-triggered privacy protection: When the system detects changes in the in-car environment (for example, the owner temporarily leaves, someone is conducting private activities in the car, etc.), the system will make appropriate adjustments based on the preset privacy requirements to prevent private information from being leaked.

[0212] Dynamic recognition based on driving scenarios This application can further refine and expand privacy protection measures. The system not only provides reasonable privacy protection under different travel modes, but also can be dynamically adjusted according to the actual passenger situation. This mechanism ensures that the personal information and private space of car owners and passengers are maximally protected in changing travel scenarios, and has a high degree of flexibility and intelligent management.

[0213] In some optional implementations, the multimodal data collected by various sensors can also be uploaded to the cloud for centralized storage and management, providing high-quality data support for subsequent analysis and modeling. The data information of the multimodal data is shown in Table 1.

[0214] Table 1 Data information of multimodal data

[0215]

[0216]

[0217] Furthermore, all data types are converted based on the cloud data processing module so that they can be directly used for modeling and calculation later:

[0218] Converts a timestamp from "datetime" format to numeric format Unix timestamp.

[0219] The original value of geographic coordinates is in the form of longitude and latitude, and it is preserved in numerical form for calculating distance or location features.

[0220] Perform Label Encoding on the travel event label and convert it into integer form.

[0221] Convert the Door Lock Operation Time to a numeric timestamp.

[0222] Perform label encoding on the temperature control mode (such as "cooling" and "heating") and convert it into an integer value.

[0223] Expand the passenger location and heat source distribution dictionary into multiple separate feature columns, and record the temperature and heat source of each seat separately. Convert the state of each area into a floating point value to form a clear feature input;

[0224] After each piece of data is uploaded to the cloud, receive the upload confirmation A from the cloud upload , if A upload =1 means the upload is successful.

[0225] Upload retry mechanism: If the upload fails (i.e. A upload =0), the system will re-upload, and the number of retries is set to N retry , to ensure that the data is uploaded completely.

[0226] The beneficial effects of the vehicle interior environment control method provided by this embodiment are as follows:

[0227] By comprehensively considering data from multiple sources such as social networks, smart homes, and vehicle sensors, the accurate identification and travel intention analysis of drivers and passengers can be achieved. Relevant information can be obtained in advance when the user approaches the vehicle, and the comfort configuration of the vehicle, including seats, air conditioning, and audio, can be dynamically adjusted. Through the effective integration of multiple data sources, the limitations of single perception or fixed configuration methods in related technologies are resolved, so that the vehicle can provide more personalized and flexible comfort adjustments based on the identity, preferences, and changes in the external environment of different drivers, significantly improving the user's travel experience.

[0228] Through multimodal identity authentication and dynamic scene recognition, a new identity authentication and travel scene determination method is proposed. It can not only identify the identity of the driver and passengers in real time, but also determine the travel scene, such as personal travel, family travel or social travel, based on social network data, home smart device information, vehicle sensor data, etc. This technology solves the bottleneck that related technologies cannot accurately identify user needs in complex scenarios. It can dynamically adjust the in-vehicle environment settings, such as temperature, seat position, audio system, etc., according to different travel modes and passenger needs, to ensure that the comfort configuration is always highly matched with actual needs.

[0229] The vehicle approach and in-vehicle data collection mechanism adopts a phased activation strategy, and the system ensures efficient and accurate data collection at different stages through the step-by-step activation of devices such as external radar, infrared sensors, and temperature sensors. First, the driver's travel intention is understood in advance through smart home data and social network information; when the driver approaches the vehicle, the system further confirms the identity and scene through Bluetooth / NFC signal strength and sensors inside and outside the vehicle; finally, when the driver enters the vehicle, the in-vehicle settings are adjusted in real time through identity authentication and temperature and humidity data. The phased data collection and sensor activation mechanism enables the system to make the best response according to different travel stages and environmental conditions, avoiding the perception lag and data redundancy problems existing in traditional methods.

[0230] Privacy protection measures are adjusted in real time according to the identity of the driver and passengers, travel scenarios, and changes in vehicle internal information. In "personal travel" mode, the interior space is open; in "multi-person travel" or "non-family travel" scenarios, the system automatically activates privacy protection measures, such as window privacy glass, storage space locks, etc. This mechanism can make precise dynamic adjustments based on the user's privacy needs, ensuring that the personal information and privacy of the owner and passengers are protected without affecting the vehicle's comfort configuration, solving the problem of privacy protection being too static and lacking adaptability in existing technologies.

[0231] The in-vehicle environment control method provided in this embodiment can not only perceive the travel scene from the identity, travel plan, social activities and other information of the driver and passengers, but also provide real-time feedback and adjustments in combination with vehicle sensor data, home smart systems, etc. Through the real-time decision feedback mechanism, the system can automatically preset the comfort configuration when the driver approaches the vehicle, and further adjust the configuration according to the actual situation after the passenger enters the vehicle. This real-time dynamic feedback mechanism enables the vehicle to adapt to complex traffic and home environments, ensuring that the comfort configuration always meets actual needs, thereby avoiding the defects of static configuration.

[0232] This embodiment provides a vehicle interior environment control device, such as Figure 4 As shown, including:

[0233] A parameter acquisition module 310 is used to acquire an initial travel scenario of a target driver and passenger and a spatial environment parameter in a target space, wherein the initial travel scenario is determined based on the travel information of the target driver and passenger;

[0234] The parameter adjustment module 320 is used to perform preliminary adjustment on the interior environment of the target vehicle based on the initial travel scenario and the spatial environment parameters to obtain an initial interior environment;

[0235] A scene adjustment module 330 is used to adjust the initial travel scene based on the approach information of the actual drivers and passengers in the detection area when the target driver and passenger approaches the target vehicle, so as to obtain the target travel scene, wherein the actual drivers and passengers include at least one target driver and passenger;

[0236] The environment control module 340 is used to control the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario, so as to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

[0237] In some optional implementations, the parameter acquisition module 310 includes:

[0238] A data acquisition submodule is used to acquire social network data and smart home data of target drivers and passengers;

[0239] An information determination submodule, for determining the travel information of the target driver and passenger based on the social network data;

[0240] A scenario determination submodule, used to determine the initial travel scenario of the target driver and passenger based on the travel information;

[0241] The parameter determination submodule is used to determine the spatial environment parameters in the target space based on the smart home data.

[0242] In some optional implementations, the parameter adjustment module 320 includes:

[0243] The preference acquisition submodule is used to determine the travel time and preferred in-vehicle environment parameters of the target driver and passenger based on the initial travel scenario;

[0244] A parameter fusion submodule is used to fuse the preferred in-vehicle environment parameters with the space environment parameters to obtain fused environment parameters;

[0245] The environment adjustment submodule is used to perform preliminary adjustments to the interior environment of the target vehicle based on the travel time and fused environmental parameters to obtain an initial interior environment.

[0246] In some optional implementations, the scene adjustment module 330 includes:

[0247] A signal determination submodule, for determining whether a target driver or passenger is close to a target vehicle based on the signal strength of a received key signal;

[0248] The personnel determination submodule is used to obtain the number of actual passengers and approach directions in the detection area when the target passengers approach the target vehicle;

[0249] The identity recognition submodule is used to recognize the identity of each actual driver and passenger based on the number of actual drivers and passengers and the approach direction, and obtain the identity information of each actual driver and passenger;

[0250] The scene adjustment submodule is used to adjust the initial travel scene based on the identity information of each actual driver and passenger to obtain a target travel scene.

[0251] In some optional embodiments, the initial travel scenario is adjusted based on the identity information of each actual driver and passenger to obtain the target travel scenario. When the actual driver and passenger is a single person and the identity information represents that the actual driver and passenger is a driver, the initial travel scenario is adjusted to personal travel, and the target travel scenario includes personal travel; when the actual driver and passenger is multiple people and the identity information represents that the multiple actual drivers and passengers are all family members, the initial travel scenario is adjusted to family travel, and the target travel scenario includes family travel; when the actual driver and passenger is multiple people and the identity information represents that there are non-family members among the multiple actual drivers and passengers, the initial travel scenario is adjusted to social travel, and the target travel scenario includes social travel.

[0252] In some optional implementations, the environment control module 340 includes:

[0253] The first environment control submodule is used to obtain personal privacy environment data corresponding to personal travel when the target travel scenario is personal travel. The personal privacy environment data is used to characterize the adjustment parameters of the driver for adjusting the internal privacy environment of the target vehicle; based on the personal privacy environment data, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passengers.

[0254] The second environment control submodule is used to obtain family privacy environment data corresponding to family travel when the target travel scenario is family travel. The family privacy environment data is used to characterize the adjustment parameters used by family members to adjust the internal privacy environment of the target vehicle; based on the family privacy environment data, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passengers.

[0255] The third environment control submodule is used to obtain social privacy environment data corresponding to the social travel when the target travel scenario is a social travel. The social privacy environment data is used to characterize the adjustment parameters for adjusting the internal privacy environment of the target vehicle when there are non-family members. Based on the social privacy environment data, the initial in-vehicle environment is adjusted to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passengers.

[0256] The fourth environmental control submodule is used to identify the identities of the actual drivers and passengers at each seating position to obtain the identity information of each actual driver and passenger; based on the identity information of each actual driver and passenger, the initial in-vehicle environment is controlled to obtain a target in-vehicle environment corresponding to the actual driver and passenger seating position.

[0257] The in-vehicle environment control device provided by the present invention obtains the initial travel scene of the target driver and passenger and the spatial environment parameters in the target space through the parameter acquisition module, and the initial travel scene is determined based on the travel information of the target driver and passenger; the in-vehicle environment of the target vehicle is preliminarily adjusted based on the initial travel scene and the spatial environment parameters through the parameter adjustment module to obtain the initial in-vehicle environment; when the target driver and passenger approaches the target vehicle, the initial travel scene is adjusted based on the approach information of the actual driver and passenger in the detection area through the scene adjustment module to obtain the target travel scene, and the actual driver and passenger include at least one target driver and passenger; the initial in-vehicle environment is adjusted based on the seating position of the actual driver and passenger in the target travel scene through the environment control module to obtain the target in-vehicle environment corresponding to the seating position of the actual driver and passenger. Through the above modules, the reliability of in-vehicle environment control can be improved, thereby improving the travel experience of users.

[0258] The position information acquisition module obtains the current position information of the target vehicle through the SOC controller in the domain controller; the obstacle information acquisition module obtains the target obstacle information around the target vehicle based on the current position information; the control information generation module generates key control information for controlling the target vehicle based on the current position information and the target obstacle information; the target in-vehicle environment control module sends the key control information to the MCU controller in the domain controller, so that the MCU controller controls the in-vehicle environment of the target vehicle based on the key control information. Through the above modules, the safety and reliability of in-vehicle environment control can be improved.

[0259] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0260] The in-vehicle environment control device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0261] See also Figure 4 The following is a detailed description of the in-vehicle environment control system provided by an embodiment of the present application using a specific example. The in-vehicle environment control system includes:

[0262] (1) Data acquisition module.

[0263] External data collection unit: collects external data of drivers and passengers, including social networks, smart homes, trip plans, etc.

[0264] Proximity detection unit: detects the driver's proximity through Bluetooth / NFC and sensors, and determines whether he is close to the target vehicle based on the GPS location.

[0265] In-vehicle sensor acquisition unit: collects various status data in the target vehicle, including temperature, light, seat position, etc., for real-time adjustment.

[0266] (2)Data processing module.

[0267] Data cleaning and preprocessing unit: cleans and standardizes the collected external and in-vehicle data to remove noise and abnormal data.

[0268] Privacy protection processing unit: Encrypt and anonymize sensitive data to ensure that user privacy is not violated.

[0269] Data fusion unit: Fusion of multi-source data (social networks, home, vehicle sensors, etc.) to create a complete user environment portrait.

[0270] Sentiment Analysis and Intention Recognition Unit: Perform sentiment analysis on social media data, identify the driver’s travel intention, and predict upcoming scenarios.

[0271] (3) Scene judgment module.

[0272] Travel scenario judgment unit: Based on the data analysis results, determine whether the current scenario is personal travel, family travel or social travel.

[0273] Environmental adaptability judgment unit: Combines weather, temperature and other information to determine the impact of the external environment on the interior of the target vehicle and prepares corresponding adjustment plans.

[0274] Scene classification verification unit: Verify whether the preliminary judgment of scene classification results is accurate, and adjust the scene classification according to subsequent data.

[0275] (4) Identity recognition module.

[0276] Driver identity confirmation unit: Identifies the current driver through facial recognition, fingerprint recognition and other means to ensure that the vehicle configuration meets the driver's personalized needs.

[0277] Passenger identification unit: detects the identity of passengers in the car and determines whether they are family members or visitors to decide whether to turn privacy protection measures on or off.

[0278] Multimodal Authentication Unit: Use multimodal data (face, fingerprint, NFC, etc.) for cross-verification to improve the accuracy of identity recognition.

[0279] (5) Configure the storage module.

[0280] Personalized configuration data storage unit: stores historical configuration data of the driver and passengers, including seat position, air conditioning temperature, audio preferences, etc.

[0281] Scenario-adaptive data storage unit: stores the best configuration solutions for different scenarios for fast loading and application.

[0282] Cloud Sync Unit: Synchronizes personalized configuration data to the cloud for easy sharing across devices and future updates.

[0283] (6) Configuration management module.

[0284] Seat adjustment unit: automatically adjusts seat position, heating, angle, etc. according to the identity and preferences of the driver and passengers.

[0285] Air conditioning control unit: Automatically adjusts the air conditioning temperature and wind speed in the car according to the outdoor temperature and the driver's temperature control preferences.

[0286] Audio system management unit: selects appropriate music playlists and volume based on travel scenarios and user preferences.

[0287] Lighting management unit: adjusts the interior ambient lighting and lighting brightness to suit the current travel scenario and user preferences.

[0288] Window control unit: adjusts window transparency or activates privacy glass according to privacy protection needs.

[0289] (7) Privacy protection module.

[0290] Privacy detection unit: automatically determines privacy protection needs based on travel scenarios and enables or disables privacy protection measures.

[0291] Storage Space Locking Unit: Automatically locks sensitive areas such as the glove box and door storage slots when non-family members are out.

[0292] Information screen encryption unit: Hide or encrypt the driver's personal information according to the scenario to avoid privacy leakage.

[0293] External call and communication management unit: manages the communication connection between the vehicle and the outside world to avoid the leakage of private information during social travel.

[0294] (8) Dynamic adjustment module.

[0295] Real-time monitoring unit: Continuously monitors environmental data such as temperature and light inside and outside the vehicle, and dynamically adjusts the configuration to maintain optimal comfort.

[0296] Dynamic configuration update unit: Instantly adjust vehicle configuration based on the real-time needs or status changes of the driver and passengers (such as new passengers entering).

[0297] Feedback and Learning Unit: Record user feedback for each adjustment, optimize the configuration for similar scenarios in the future, and improve user satisfaction.

[0298] (9)Data upload and cloud storage module.

[0299] Data encryption transmission unit: encrypts all data uploaded to the cloud to ensure data security.

[0300] Cloud data backup unit: Back up historical data and user configurations to facilitate future data recovery or sharing.

[0301] Data retransmission mechanism: When uploading fails, the system will automatically retry uploading to ensure the reliability and integrity of data transmission.

[0302] The embodiment of the present invention further provides a vehicle having the above Figure 3 The in-vehicle environment control device shown.

[0303] See also Figure 5 , Figure 5 is a schematic diagram of a vehicle structure provided by an optional embodiment of the present invention, such as Figure 5As shown, the vehicle includes: one or more processors 510, a memory 520, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed in the vehicle, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple vehicles can be connected, and each device provides some necessary operations (for example, as a storage server array, a group of blade storage servers, or a multi-processor system). Figure 5 A processor 510 is taken as an example.

[0304] The processor 510 may be a central processing unit, a network processor or a combination thereof. The processor 510 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0305] The memory 520 stores instructions executable by at least one processor 510 so as to enable at least one processor 510 to implement the method shown in the above embodiment.

[0306] The memory 520 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created based on the use of a vehicle displayed on a small program landing page, etc. In addition, the memory 520 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 520 may optionally include a memory remotely arranged relative to the processor 510, and these remote memories may be connected to the vehicle via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a server cluster, a mobile communication network, and a combination thereof.

[0307] The memory 520 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 520 may also include a combination of the above types of memory.

[0308] The vehicle also includes a communication interface 530 for the vehicle to communicate with other devices or communication networks.

[0309] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0310] In one embodiment, the storage medium includes control logic / operations that can be provided to the processor for execution in the form of instructions. For example, the identity and needs of the driver approaching the vehicle can be automatically identified, so that the required modules can be started in advance to prepare personalized vehicle configuration. In addition, the processor can adjust the configuration of the vehicle in real time based on the current travel scenario. For example, when it is detected that the passenger is not a family member, the privacy protection mode can be automatically started.

[0311] In addition, in different application scenarios, this embodiment can be used in conjunction with other external devices, such as linkage with smart home systems, social platforms, etc., to make the vehicle configuration more scenario-adaptive. For example, the processor can obtain the driver's current environmental data through the smart home interface, and determine the temperature and lighting configuration required by the vehicle based on the data, thereby achieving advance adjustment of the vehicle's interior environment.

[0312] In some complex scenarios, such as social scenarios where non-family members are riding in the car, the system can automatically lock private storage spaces, activate privacy glass, etc. to ensure vehicle privacy. By controlling the various modules in the system, the system can flexibly adapt to a variety of travel scenarios and achieve the best configuration effect, thereby improving the comfort and safety of vehicle use.

[0313] The processor may implement some or all of the functional modules in a combination of hardware or software according to specific needs. For example, the processor may load the relevant modules into a computer-readable storage medium through an independent storage chip or as part of system integration. In such embodiments, the storage medium may include but is not limited to RAM (random access memory), ROM (read-only memory), EEPROM (electrically erasable programmable read-only memory) and other types of storage devices to ensure that the system has sufficient scalability and flexibility and can quickly respond to the personalized needs of users.

[0314] In scenarios where remote data interaction is required, the modules in the storage medium can provide various connection methods, including but not limited to Wi-Fi, cellular networks, Bluetooth, etc., to obtain external data in real time. The instructions contained in the storage medium can guide the processor to dynamically adjust the vehicle configuration to adapt to different travel modes by combining cloud servers and local data. The multi-source data collection and processing method of this technical solution can automatically detect travel intentions when the user approaches the vehicle and provide the user with the best personalized settings.

[0315] The program content stored in the computer-readable storage medium is not only applicable to personalized configuration scenarios in smart cars, but can also be used in other fields that require dynamic configuration according to the external environment. The device can be any form of computer equipment, including but not limited to desktop computers, smart phones, embedded systems, etc., and can be contained in various other types of removable storage devices, such as optical disks, memory cards, hard disks, etc. In addition, the program stored in the computer-readable storage medium can include all algorithms and modules for configuring sensor data acquisition, scene analysis, configuration adjustment, privacy protection, and user preference learning, so that the device can automatically adjust its personalized configuration by communicating with external devices.

[0316] During the configuration process, different modules can be flexibly loaded or unloaded to cope with different usage environments or travel needs, such as uploading part or all of the system configuration data to the cloud to provide users with a more accurate personalized configuration experience. At the same time, the storage medium can also include a set of adaptive algorithms to dynamically adjust the system's response speed and resource allocation under different travel modes, so that the system not only has intelligent functions, but also has high efficiency and economy.

[0317] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for controlling the in-vehicle environment, characterized in that: The method comprises: Acquire an initial travel scenario of a target driver and passenger and a spatial environment parameter in a target space, wherein the initial travel scenario is determined based on travel information of the target driver and passenger; Preliminarily adjusting the interior environment of the target vehicle based on the initial travel scenario and the spatial environment parameters to obtain an initial interior environment; When the target driver and passenger approaches the target vehicle, the initial travel scene is adjusted based on the approaching information of the actual driver and passenger in the detection area to obtain a target travel scene, wherein the actual driver and passenger includes at least one of the target driver and passenger; Based on the actual seating position of the driver and passenger in the target travel scenario, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

2. The method according to claim 1, characterized in that The obtaining of the travel information of the target driver and passenger and the space environment parameters in the target space includes: Acquiring social network data and smart home data of the target driver and passenger; Determining travel information of the target driver and passenger based on the social network data; Determining an initial travel scenario of the target driver and passenger based on the travel information; A spatial environment parameter in the target space is determined based on the smart home data.

3. The method according to claim 1, characterized in that The preliminarily adjusting the interior environment of the target vehicle based on the initial travel scenario and the spatial environment parameters to obtain the initial interior environment includes: Based on the initial travel scenario, determining the travel time and preferred in-vehicle environment parameters of the target driver and passenger; Fusing the preferred in-vehicle environment parameters with the spatial environment parameters to obtain fused environment parameters; Based on the travel time and the fused environment parameters, the interior environment of the target vehicle is preliminarily adjusted to obtain the initial interior environment.

4. The method according to claim 1, characterized in that: When the target driver and passenger approaches the target vehicle, adjusting the initial travel scene based on the approaching information of the actual driver and passenger in the detection area to obtain the target travel scene includes: Determining whether the target occupant is close to the target vehicle based on the signal strength of the received key signal; When the target driver and passenger approaches the target vehicle, obtaining the number and approach direction of the actual driver and passenger in the detection area; Based on the number and approach direction of the actual drivers and passengers, the identity of each of the actual drivers and passengers is identified to obtain identity information of each of the actual drivers and passengers; Based on the identity information of each actual driver and passenger, the initial travel scene is adjusted to obtain the target travel scene.

5. The method according to claim 4, characterized in that The adjusting the initial travel scenario based on the identity information of each actual driver and passenger to obtain the target travel scenario includes: When the actual driver and passenger is a single person, and the identity information indicates that the actual driver and passenger is a driver, the initial travel scenario is adjusted to individual travel, and the target travel scenario includes the individual travel; When there are multiple actual drivers and passengers, and the identity information indicates that the multiple actual drivers and passengers are family members, the initial travel scenario is adjusted to family travel, and the target travel scenario includes the family travel; When there are multiple actual drivers and passengers, and the identity information indicates that there are non-family members among the multiple actual drivers and passengers, the initial travel scenario is adjusted to a social travel, and the target travel scenario includes the social travel.

6. The method according to claim 5, characterized in that The adjusting and controlling the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger includes: When the target travel scenario is personal travel, obtaining personal privacy environment data corresponding to the personal travel, wherein the personal privacy environment data is used to represent adjustment parameters used by the driver to adjust the internal privacy environment of the target vehicle; Based on the personal privacy environment data, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

7. The method according to claim 5, characterized in that The adjusting and controlling the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger includes: When the target travel scenario is a family travel, obtaining family privacy environment data corresponding to the family travel, wherein the family privacy environment data is used to represent adjustment parameters used by family members to adjust the internal privacy environment of the target vehicle; Based on the family privacy environment data, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

8. The method according to claim 5, characterized in that The adjusting and controlling the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger further includes: When the target travel scenario is a social travel, obtaining social privacy environment data corresponding to the social travel, wherein the social privacy environment data is used to characterize the adjustment parameters for adjusting the internal privacy environment of the target vehicle by non-family members; Based on the social privacy environment data, the initial in-vehicle environment is regulated to obtain the target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

9. The method according to claim 1, characterized in that: The adjusting and controlling the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger includes: Identify the identities of the actual drivers and passengers at each seating position to obtain identity information of each actual driver and passenger; Based on the identity information of each actual driver and passenger, the initial in-vehicle environment is regulated to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

10. A vehicle interior environment control device, characterized in that: The device comprises: A parameter acquisition module, used to acquire an initial travel scenario of a target driver and passenger and a spatial environment parameter in a target space, wherein the initial travel scenario is determined based on the travel information of the target driver and passenger; A parameter adjustment module, used to perform preliminary adjustment on the interior environment of the target vehicle based on the initial travel scenario and the spatial environment parameters to obtain an initial interior environment; A scene adjustment module, configured to adjust the initial travel scene based on the approach information of actual drivers and passengers in the detection area when the target driver and passenger approaches the target vehicle, so as to obtain a target travel scene, wherein the actual drivers and passengers include at least one of the target driver and passenger; The environment control module is used to control the initial in-vehicle environment based on the actual seating position of the driver and passenger in the target travel scenario, so as to obtain a target in-vehicle environment corresponding to the actual seating position of the driver and passenger.

Images